Is something wrong?

My husband and I have been having unprotected sex, not using the pullout method either, for 3 years now. We aren’t trying for a baby so we don’t really plan sex around when I’m supposed to be ovulating (I also don’t track my ovulation so I’m not sure if the app is right on when it is). Sometimes we have sex once a week, if that, sometimes it’s 3-4 times a week.

I’m wondering if I should be worried about being infertile since we’ve been having unprotected sex for 3 years or if I should overthink too much since we aren’t actually trying.