Friends with benefits

So me and this boy are very casual and have sex fairly often but we've both said we can do things with other people. I just don't know if I would feel comfortable with him sleeping with someone else because I would feel like I was second best and someone he could always rely to be there. I don't want to bring it up with him because we've both said many times we're very casual and I don't know what to do?!