No Judgement please

So I have been talking to this guy for about a month now. He is not 100% ready for a full on relationship, something happened 3 years ago that would be hard for anyone to get over, so I respect that. We have an open relationship with another girl, which he asked and I was all good with it. He has told me times he cares for me and has shown it as well. I don't doubt that. There were times where his friends called to hang out and said let me ask my girl. He even asked if I wanted to come and if I didn't we would just stay home n chill. You can't help who u like, and I like him a lot and he likes me a lot. Me and him both know there is a different type of connection between us two girls with him. I don't think I want to keep this open relationship going, but I am not sure how to say anything, and anyone get mad or hurt. Advice?