Not trying to get pregnant but confused ??

My boyfriend and I have been having sex for about 4 months now and we DO NOT want to get pregnant. The first three months I was not on birth control and we went raw a lot and sometimes he got some cum in me and I never took plan B and I never got pregnant. I started birth control about a month ago and he came in me four times in the first week I took birth control before it was protected and I didn't get pregnant. I'm so happy I'm not but I'm just starting to wonder if my boyfriend has a fertility issue or are we just super lucky ???