Ultimatums

My boyfriend's friends are complete douche bags. They treat him and I like shit. He lets them off the hook every time and I've grown sick of it. I told him that the next time they do this he has to do something about it or its either he gets rid of them or I'm leaving. It's only 2 guys that I don't like they other ones are all fine! I actually love when the others are around and wouldn't ever ask him to stop seeing them. its just 2 of them that are self absorbed and disrespectful. One even frabriacted a lie saying him and I hooked up. Is my ultimatum fair? This has been going on our entire relationship.