Scared Boyfriend

So my boyfriend and I have been having sex for three months and I am not able to go on birth control for certain health reasons. He says he's paranoid even though we use a condom and pull out every time. I feel bad but I feel pretty safe with our method. What do you guys think?