Fears

I got pregnant 2 years ago almost and because my ex was scared and an ass, he pressured me into getting rid of our child. I was only 6 weeks along but it has left last effects emotionally and mentally. Recently, I have decided to try to conceive again and my ovulation is in a few weeks. I have no fertility issues and the doctors have said my uterus and cervix are textbook (great.) but, I’m still afraid I won’t conceive as quickly this time. It only took one time two years ago and I wasn’t actively trying. I’m now 33 and emotionally damaged. Should I just relax? Are these just irrational fears coming to play?