About pregnancy on birth control?

Hi, I'm 21 years old and currently taking Larin-Fe 1/20 birth control pill once a day religiously. However, I'm a little nervous that I may become pregnant because my boyfriend didn't pull out about four times already (once while I was on the inactive pill)! Should I be worried?! Anyone else on the same pill has had any issues? Please let me know! Thanks

xx