sex with birth control

So my boyfriend and I were both virgins and just recently lost it to each other. I am on the birth control pill and have been for about 4 months. The second time we had sex we did it without a condom but he pulled out. Considering he pulled out and I am on birth control I should be fine right?? I just get paranoid!