should i just deal with my bfs friend?

my ex boyfriend and i are in a complicated situation right now but in that time he has become close with an old friend of his. i don’t like this friend, i think he’s a bad person and o bad influence but it’s not my decision so i don’t care. a while ago, he thought he might have feelings for this friend and was going through a moment with that. it’s been talked about a lot and we’ve had really open conversations about this. he’s now very sure he doesn’t have feelings for this friend, but since then i’ve been even more uncomfortable with his friend. i told him that if we got back together i would not want them hanging out more than once or twice a week (they hang out a LOT.) and he’s been really pissed about it. i’m trying to compromise because i know i can’t make him drop his friends, but if i don’t want him around at all and he wants him around all the time there has to be a middle i feel like. am i wrong for this?