ONLY USING BIRTH-CONTROL PILLS

I'm going to be getting on birth control pills within the next couple months. I'm going to be using the pill and condoms. If I wanted to not use a condom (not all the time but occasionally) could I? Or could we not use a condom and then when he's about to cum put a condom on?