Worried

My bf and I had sex yesterday 2 days before ovulation. I am on the birth control pill and don’t miss days and usually take them around the same time give or take a couple hours. We had sex without a condom yesterday but he pulled out before he finished. pregnancy on the pill has happened before in my family. Should I be worried about becoming pregnant?