Never Having Babies 😰

A little back story. I started taking the pill in high school to correct my period. I was never regular. I finally went to the doctor after I realized that I hadn't had a period in over a year. 
My husband and I are going to start trying to get pregnant soon and I know that when I get off the pill, my period will be irregular again. I know it can be hard for women with a regular period to get pregnant. I'm so scared that I'm never going to get pregnant this way. 
My husband has told me that we will try constantly and for as long as it takes. I just feel like we're going to fight a losing battle.