Oral Sex

Should I be edament about him wearing a condom during oral sex? I just personally find it hard cause I'm not letting him go all the way.  Therefore I compensate and give head without a condom. Someone please knock some sense into me.