Oil as Lubricant

This may be a crazy question, but as a lubricant I use olive oil or coconut oil prior to sex. Will this have any effect on the sperm being able to travel to get to the egg and fertilize like its suppose to? Should I stop using these oils and go to a ph balanced lube like KY? Not sure if the oils hinder sperm travel or not?