Getting frustrated

I removed my IUD May 8th of this year me and my H started trying right away. The months have passed I have been tracking with the app but that's about it. I had an abortion when I was 20 due to wrong timing by far one of the hardest thing I have ever had to do in my life! I suffered from some pretty serious depression after that. Now that we are actively trying and are ready for a baby we can't get it right. This is our 5th month trying and every month that goes by I just get more and more discouraged. I have been taking prenatal vitamins and folic acid. I just ordered ovulation strips and a thermometer to track my temp. If we don't get it right in November I'm giving up and going to the doctor see what they think. My husband has a child from a past relationship so I know he doesn't have any issues with fertility. My periods had always been word before when I was younger and ever since I got the IUD removed they have been to time every month! I need advice and hope because I just keep getting frustrated and discouraged... I feel like I'm being punished for my past action 😭💔