painful sex postpartum?

So I'm 10, almost 11 weeks postpartum. At my 6 week check dr said I was good to go and that my bladder was drooping a bit but said kegal and with time it'll be better. Sex has been less painful each time we've tried, but we've only done missionary and with a condom so far. When I'm laying on my back and he enters me, there's almost a  pulling, scraping, tugging sensation on the top was of my vagina. I'm going to give the doctor a call, but I'm nervous. I feel broken. Has anyone else had issues or still