Am I wrong?

So my husband and I have been married 11 months. Before we got married we lived together for almost a year..Even then when he got mad he would put holes in the wall..I've asked for counseling, anger management but he won't go. Well nothing's changed since we've been married. We are currently living with family due to unforeseen circumstances and he has put a whole in their wall....it's fixed now but tonight he got mad and threw the remote. Am I wrong to want to leave? I've tried everything to help him but his temper is not changing. It's not every day but it's bad when it comes out... the past couple of weeks I've learned that I'll have to see a fertility specialist to conceive but I'm beginning to not want kids with him, and I want to be a mom more than anything....I don't want my future kids living with a dad who hits walls or throws things when they get mad or don't get their way or doesn't like what people say...am I wrong?