could we be infertile ??

My boyfriend and I have been together for over 4 years. We are not trying to have a baby but the only form of birth control we use (if you can call it that) is the pull out method. I'm just wondering if there could b possibly a problem with one of us ? I had got pregnant 10 years ago and had to abort it (I was only 16) -please don't judge-  
So I know I can get pregnant but I scares me the thought that I might have an issue ... Because we want to ttc in a year or so