Pull out method....

So my fiancé and I have been using the pull out method since we started dating, so for the last 4 years. I've heard so many stories of the pull out method ending in pregnancy so I'm just curious....is he just really good at knowing when to pull out or should I be worried that we might have trouble conceiving when the time comes?