Husband wants to sleep with someone else alone

The existing boundries between my husband are that we are okay with having a 3way with another woman as long as we use protection. I'm bi, my husband's straight, we've had one before and we had a short time of being upset at each other. We got over it set boundaries for the next time and it's now been over 3 years since. We have a girl that's willing to sleep with us and that's great! I'm so excited but then this stupid man of mine comes home talking about how he'd like it to sleep with her alone, and that if he had had my permission he would have done it TODAY when he stopped by her house to sell her our old rock band set... like... no... not at all gunna happen... I'm fine with it if im there and apart of the action but absolutely not if im not there. I told him that it would only be fair if I got to sleep with a guy or girl alone and there's only one guy that i would be at all interested in and it's only bc he's my ex, we've already had sex, and he's a swinger. (I said this thinking that he'd be like, "absolutely not" "nvm", nope he goes "well for her I'd do it". I dont actually wanna sleep with my ex so ew. But I tried to explain to him that I have my boundries and he has his. I dont touch his butthole, he doesnt touch her when I'm not there and not okay with it.