I'm worried 😩

I've been sexually active since I was 16. When I turned 18, I had a few very serious relationships throughout the years and in most of them, we never used protection or withdrawal. Despite that, I never ended up getting pregnant. Honestly I was convinced that since it hadn't happened, I was infertile or something 🤷🏾‍♀️ which didn't bother me any at the time lol. Fast forward to 2015, I was 21. I was dating this terrible guy for about a year and a half. We were living wild & recklessly for a while, doing everything under the sun. And then boom: HE GOT ME PREGNANT 😳 I wasn't ready but I tried to be happy with the thought of a family with him. He was a class A d***head who treated me terribly and stressed me tf out ultimately leading to a miscarriage at 8 weeks 😪 I was crushed. When I went to the hospital, I chose to let the fetus come out naturally and they gave me some pain killers for the cramps. Since then I met a man that I'd love to start a family with but it's been three years since my miscarriage and I haven't been able to get pregnant again 😰 I'm terrified that I won't be able to conceive again with the man I love 😢 my periods have always been regular but I just haven't gotten pregnant. What's wrong with me!? I can't fathom the thought of not being able to have children with him. Any advice or help?