Bleeding without breaking hymen!

So I had my first intercourse during my period so I didn't notice that but now I know. I always bleed when it comes to initiating penetration and I noticed my hymen is still there! I decided to stretch it with lots of lube and no rubbing or friction (just stretching) and I still bleed a little (especially stretching down toward the anus). Will it stop at some point? I like sex and don't want to give it up 😢