he wont let me visit my family?

last year, both my hub & i did a lot of things w my fam. we visit them once a week, living an hr drive away. in jan, my hub was drinking w my dad, he got buzzed. before we were gonna go home, both my hub and i got into an argument due to his behavior when he drinks. he gets mad easily and he just always say mean things to me only whenever he drinks. which caused my mom to be involved, and the argument is now both my mom and him. it caused us to separate, but i went back the next day. i was 32wks preg at that time. after this, my hub no longer wanted to have anything to do w them, & cuts them out of our life. my parents were disappointed that i went back and no longer wanted to have anything to do w us too. now my parents wants to do things w us and just let the past stay in the past. but my hub refused. he says im just going to make him and my fam have problems again. he says its best we not go to save our marriage. he blames everything on me, that everything was my fault. he doesnt want to go thru it again. but i miss them and i want us to be the same again.