my bf is a man and clearly they have no common sense ..

i’m on the pill but I told him I feel more comfortable with a condom too (we don’t use them all the time) he said he’s

fine with that but he doesn’t want to all the time because it doesn’t feel as good.. I already freak myself out that i’m pregnant every time we don’t use them (aka like now) so how do I go about this without starting a fight?