Unprotected sex

I have been having unprotected sex with my boyfriend for almost 3 years now. (We are also each other's first). I have been worrying about if I am ever going to be able to conceive. I have had pregnancy scares but never been pregnant. Also he always uses the pull out method. But it still worries me when in the future we want to start a family......I think I'm infertile.