Safe during placebo week?

Is it safe to have sex during your placebo/sugar pill week of your birth control? I had sex on Sunday which was during my placebo week but it was the last day so I started a new pack of birth control. (Hopefully this makes sense?) We used a condom, it was my second time having sex so I’m pretty sure it didn’t break or anything because people say you would feel it and when he pulled out cum was inside the condom so I assume it worked? This may be a dumb question but I get anxious about everything so if someone could put my mind at ease that would be great!

* I take the combo pill, 3 weeks of hormones and 1 placebo week and I haven’t missed any pills but I have taken a few like two hours late maximum, will that make a difference?