Husband Cheated and Now Pissed

He cheated on me with another girl. He is now pissed off I don’t trust him. There is rumor at his work he is sleeping with this girl. Now this girl wants him to pick her up for work. I told him I didn’t think that was a good idea. It will just encourage the rumors. Am I such a bad person for saying that? He went off on me and told me to not talk to him about it. I am just done with his attitude. I should of left his ass a long time ago.