Sex with his best friend during a break

My boyfriend and I took a break and during that time he slept with his best friend. I wouldn't care so much if it was some one night stand but it bothers me that it was his closest friend. Their relationship made me feel uncomfortable when we first started dating and now they still are staying in contact while we are back together. I know I can't get mad because we took a break but seeing her being touchy and coming around makes me uncomfortable. I can't get visuals out of my head. He doesn't think he's in the wrong by staying close with her even now. I am not telling him what to do, but he is aware it hurts me. Am I wrong for being upset ?