Is he the bad guy even if I hit him too?

My husband and I can get in some pretty nasty fights sometimes. We have known each other for 3 years.. married for 5 months. It started out small, but the physical fighting between us gets a little worse each time. When we make up we apologize and know we need to change it, but how? I feel at fault cuz I hit or push him too.. And that makes him do it back to me. I've had bruises on me so many times. but it's hard to think of him as purposely abusing me or even an abusive person. cuz it's only happening when I provoke him or hit him myself. He tells me to walk away, and I dont.. And then the fighting gets worse. I just have a realllly hard time walking away mid fight.