Gut feelings

I’ve never tried to have a baby because my husband and I just weren’t ready. Well, we are trying this month. I’ve been told I have PCOS but then I’ve been told I don’t. All my lab work is normal, I’m healthy, my blood sugar is healthy. My periods aren’t like clock work but they are mostly regular, give or take 1-3 days. I took ovulation tests, I got my positive LH surge. We’ve been having sex consistently. We are doing all the things to have a baby. However, for some reason I just feel like I won’t ever be able to have a baby and i don’t know why. Has anyone ever just felt like that? Like it just wouldn’t happen? My OBGYN doesn’t feel like I’ll have any issues getting pregnant/having a healthy baby. Maybe I’m just scared, since I’ve never tried. But I just have a feeling it won’t happen for me.