Worried

So my bf and I had sex on the 5th and early morning today on the 7th. I am on birth control pills and have been for over a year and half taken regularly sometimes a couple hours early or late but usually on time. I know you aren’t supposed to ovulate when on the pill but if I were my predicted ovulation day would be tomorrow. We used a condom both times and this morning he did not finish. Pregnancy on the pill has happened in my family before. Should I be worried about becoming pregnant?