sterile..?

I've been on and off the pill for about 3 years now. I would take it for awhile and then stop for months at a time. Not sure why..but my boyfriend has been cumming inside me a lot lately, even if I'm fertile. It doesn't bother me because I've kind of been hoping for a baby. Anyway, this has been happening for a few months and I haven't been on the pill. I haven't gotten pregnant and I'm starting to wonder if one of us is "challenged"...it breaks my heart every time I see a negative test. Anyone have any tips..? 😪