Verbal abuse?

Me and my boyfriend of two years hit a really rough patch last year and we went out separate ways for about 6 months he left the state and I started dating someone else who really fucked my head up I was always angry with them and yelling even sometimes hitting .. I've gotten over a lot of tension I had towards him when he left but I get scared it will happen again I was okay with waiting for him cause it felt like true love but then I met someone else which I didn't want and it happen .. I wasn't attracted to them . They were funny and cool to talk to but I know I wanted him back and he came back and we hit it off like he never left but now sometimes when he does something I don't like like any partner I'm not as calm . The previous guy annoyed the fuck outta me but I kept my mouth shut cause I was settling because I thought I lost the love of my life... I don't want to yell and scream or push or shove when things get really heated it's like my head Feds  things that aren't true "yeah he's a liar a cheater " think about that time he this or said that when that's not how I really feel about him? I want it to stop before it goes to far what should I do?