ADVICE PLEASE

Soo my long distance boyfriend and I agreed it was okay for us to have sex with other people while he was gone, before he left. We later asked each other about it (at this point we haven’t had sex with anyone else) and he said that he knows I’d tell him if I did, because I can’t keep things from him and I said yes. He said he hasn’t thought about doing it once. So recently about a week ago, we took a short break (2 days) and I slept with another guy. I told him about it and he got extremely upset and said that hearing that broke his heart a little. He then said that during our break all he thought about was me, and I go out and fuck some guy. By the way, he took my virginity, and he’s the one who brought up the whole having sex with other people so that i could experience sex with other guys. I did just that. Then told him because I couldn’t keep it from him, and he said that he would talk to me tomorrow and that he doesn’t want to talk to me right now. And he couldn’t say I love you. I’m super conflicted because he wanted me to and he knew I would tell him about it. Any words would be much appreciated