Help 👶👶👶

So my S/O & I have been together for 4 years and we use the pull out method. We aren't trying to get pregnant but would be happy if it happened. One night he came in me and we still have never gotten pregnant or even an extremely late period. I'm hoping to start trying for a baby in the semi-near future, but I'm kind of worried now that it will be difficult to conceive...😞 is it possible that we will have troubles or are we just really good and this method