Condoms Dilemma

I'm currently not on any form of birth control. I was for a year and a half,but I want to go the all natural route. My boyfriend and I discussed about using condoms,but he's not too pleased about the idea of having a condom on for the whole duration we're having sex.

We were wondering,how safe (not trying to get pregnant) is it to allow him to penetrate for a couple minutes ( say 5-10 mins max ) and then put on a condom? Would you guys say its okay or just use the condom for the whole time?