Am I overreacting

So me and my boyfriend recently moved in together due to a dcf situation with my kids I have 3. He has none but I’m pregnant we have known each other for 2 years we been dating for a year now. He is a great step dad very patient and great with the kids he has stepped up in a major way. The only problem is that he loves drinking once or twice a week with his friend and I don’t have an issue with that as I know he also needs me time and specially after taking in us and the kids. They’re a handsful anyways everything is great he isn’t working right now because his car broke down and he is working on fixing it and so he stays at home. We only have a week living together and I got beyond angry and moved out because he had his friends come over and drink with him they were being sooo loud and the music was on blast. Yes I understand they’re gonna laugh and have music but to blast it when he knows I’m trying to rest and he isn’t mindful of that he says he can’t do anything and I ask how would you feel if it was the other way around and he said if I were you I would leave and that set me off and so I took it as him telling me to leave. He says that’s not what he meant and it be better if I went to my place for the night so he can drink. He has never lived with anyone before but I been previously married. I don’t know if I’m overreacting by leaving but I’m so pissed I work 12 hr shifts 5x a week and on my days off I wanna rest! Please help