Sex or no sex??

My boyfriend and I really want to have sex on an upcoming day. We normally never get the chance to properly have sex in bed or even spend the night, so I really want to have sex this day!! However, that day also happens to be the day RIGHT before my fertilizing period. Do you think it's okay to still have safe sex with a condom? Or should I just be completely safe and opt out of sex? 
THANKS GUYS!