What should i do?

So in this situation me and this guy we’re talking and we have grown to really like each other, it was kind of like we were in a relationship, but we weren’t. Anyways he was always wary of other guys talking to me even though we weren’t together, but i would just verify him it was nothing to worry about. While we were talking i started to think about my sexuality and started questioning if i was bi. So i started talking to this female that wanted to help me experiment my sexuality. Me and her kissed and flirty but she ended up having a fiancé so i stopped talking to her, but mean while i’m talking to this guy😭☠️. Recently he found out about the situation, and he doesn’t wanna talk to me anymore. I have really grown to like him and i feel so bad for doing what i did and i just want him back. How can I get him back, and fix everything?