how safe?

I've been on the pill and how safe is it for you to have unprotected sex... my boyfriend says that's the only way he will have sex is without a condom. How safe will I be if we do it with out one?