Pill but hole in condom?

I'm on the pill and have been taking it everyday, but not the same time every day. Me and my bf used a condom last night but noticed after that it had a hole in it, should I be worried??