problems?

Me and my current boyfriend broke up a few days ago, (we are off and on we are both hot heads )  had sex with someone else yesterday. He called me crying afterwords but didn't tell me later on that day. He cried when he told me and he called me on his breaks and cried to me trying to apologize. He says it didn't last long at all because it felt wrong so he stopped and kicked her out. I am upset and mad that he really did this but he sounds so sincere and I don't know what I should do. Should I take him back?