Taking the pill late and having sex

I started birth control this month and I have taken it "late" maybe 3 or 4 times about a week or so ago. The latest I took the pill was like 2 hours late. Online it said that if I take it more than 3 hours late that I should use another form of protection like a condom when having sex for the next 48 hours. Should I use a condom or do you think I would be fine without one if my boyfriend just pulled out? Thank you!