Friends with benefits

So me and my ex became friends with benefits, we have a laugh together and everything great because we know each other and are comfortable with each other

But I went to a party the other night and he got really annoyed at me because he thought I was going to get with someone else which I didn’t, and then when he found out I was going to meet another guy and that I talk to other guys he hates it

But we’re just friends with benefits and he hasn’t said that he wants anything more or anything like that so what am I supposed to do?

I can’t change something I’m doing wrong if I don’t know what it is