no judgement please

My husband and I have been trying for about 1 1/2 years to get pregnant. No luck. We conceived before, 5 years ago but weren't ready. So I have a medical abortion (the pill). Of course I blame myself and feel like we can't conceive now because of that. I regretted doing it the second after. I have had some tests done and all came back good. The next step is a semen analysis for my husband. I'm terrified something is wrong with one of us and I gave up my chance. What if it never happens? What if I through our only chance away? I look back now to when I was 22 years old and I was so young and would never ever do anything like now😢 I guess I'm just looking for some advice