Birth control

The last week of my bc pill pack is inactive pills. So does that mean that if I have sex within that week, I won't be protected? And would I be ok if me & my bf used a condom? We try to have the safest sex possible.