need advice!!

Okay so my boyfriend and I have been together for a year now we met in college. I was a freshman and I was experiencing college for the first time so did I go a little crazy at first. yes. I was messing around with my boyfriend and with other guys as well, but I was not dating him yet we were just hooking up. Well when him and I got together I stopped talking to those guys and our relationship has been really good. but now he's just like I don't trust you. you have a track record with guys. and now he has me mad because he slept with half of the soccer team, half of the cheer team and I did cheer so he hooked up with my teammates. but yet here I am still the bad guy. I'm tired of him holding my past against me I know what I did was wrong but he isn't innocent either