Lube Question

I know regular lubes are bad for sperm, but just how bad are they? I got coconut oil after reading about it on here and love it! But my husband likes the warming lube we already had. I've told him I like the coconut oil better and its better for the sperm, but I don't think he gets it. He still pulls out the other lube sometimes. It kinda throws me off and I don't enjoy sex because I know if I'm about to ovulate, the sperm are getting killed. I guess basically I'm asking is this something I need to continue to try to get across to him? Can I still conceive using ordinary lube? Has anybody done it? I just feel like it's wasted sex when we use the wrong lube. Am I being crazy?