This anxiety has got to go!

Any one else struggle with anxiety? I got off the pill about 4 months ago. This will be my husband and I’s fourth month of trying. I have been so depressed thinking we’re going to have problems conceiving. I know it will happen in Gods time but each time I get my period I get even more depressed. I keep thinking there’s something wrong with me or my husband. How do I shake the anxiety about this? I’ve been told that we need to stop trying and just have fun and it will happen. But Im not even certain my body has fully adjusted to being off the pill... I was on it for 7 years! My periods still aren’t back to normal but they duration is normal and it comes every 29-30 days which I’ve read is normal. Help please!!