Ladies please give advice!

So I am 22 and my boyfriend is 23. I have been off birth control for almost two year and have not yet conceived! We have not been trying but not been preventing either. I did try for a little bit but stoped because I was keeping it from my boyfriend that I was trying and felt like it was wrong even though, again, we were not preventing. So here I am, just started another period this morning and trying desperately not to cry at work and I just texted my boyfriend telling him that I am very upset because of the situation and is not having any luck yet after almost two whole years and he just said maybe it’s not our time yet, it’s hard because he doesn’t know how I feel and thinks it’s no big deal and all I want is a baby in my life. That is literally all I want is my own child and I want it now😭😭 I am so terrified something is wrong with one of us!! And I am really scared something is wrong with me. I unfortunately had a abortion when I was 18 because my dad basically forced me even though I know I had the choice since it was my body I was scared and just turned 18 and was terrified of my dad and now I retreat that decision more than anything in the world, I always have but especially now and I feel like god is punishing me for that choice I made all those years ago. I just need advice. Good or bad ladies, someone please help!! TIA!