Pain during sex? 🙁

Natalie
So it's been 11 weeks since I gave birth to my beautiful baby girl. And I just had sex for the first time since I had her. And I only did it because I felt bad for the hubby and my doctor said I should try. I didn't care for it and it kind of hurt. The pain was more on the outside and like the clit area and the lower vagina closer to my behind. We even used a condom and lube. 
Has anyone else experienced this? Any recommendations? 
I'm definitely going to talk to my doctor. But what if I'm never in the mood ever again?! What if my sex drive never comes back?
:(