Pill and no pull out

not that I want to be pregnant but I have been on the pill for 7 years and the past 2 yrs everytime me and my boyfriend have sex we do not withdraw. I asked my doctor if it's normal for my birth control to be this accurate and effective. I told her I don't take it everyday at the same time and occasionally miss it. I'm just feeling very infertile. or maybe the pill is just working really good. Not that I'm ready to be pregnant just starting to worry. anyone else have this problem?