non hormonal birth control

I am not a fan of hormonal birth control.. so all my fiancée and I do is pull out and wear a condom while I am ovulating and when I am not only using a condom. I'm not stupid, I know there is a chance I can get pregnant but it wouldn't be the end of the world because he will always be the only one for me. My question is, how many ladies do non hormonal use of preventing pregnancy? What do you use? Also, when you aren't ovulating (or anywhere close to ovulating) will you let your man finish inside you?