BC affecting fertility????!

I was on the pill since i was 16, im now 21, and over a year ago i stopped taking it and eventually went on nuva ring. I took it and then stopped then started again and then completely stopped and havent been on any BC since like march. Me and my husband are not actively trying to conceive but we’re not preventing either. No BC, no condoms, pull out method. I just get very anxious and worried that from the birth control and starting and stopping that it somehow will affect my fertility and i wont be able to get pregnant. Any advice or something to ease my thoughts.