Periods and pregnancy

So ever since I started my period at the age of 11 I never had it ninth to month in 22 now. I rennet going to the gyno and they told me I could possibly never have kids because of or it would be very hard to conceive atleast.... At 21 I started the inplanon in my my arm as birth control and just took it off this past June, since then I have finally had regular period every month. I'm just curious to know how difficult it will be to conceive now? My husband and I have had unprotected sex since I been off birth control so 5 months now.  It kind of gets me worried always having the negative thought it my head all the time so I try not to stress about it... Please help