Going out with your significant other

Today me (27)and my bf (29) went out for lunch and did a little clothes shopping . We haven’t really seen each other in a few weeks so it was a nice two hours. He’s family oriented so he spends almost every off day with them . After going out to eat he was like do you want to get a few beers from the store and we can go back to his house because his cousins and friends want to come over and I’m like sure I don’t mind. Then ten minutes later he says I should stay home because we don’t have the best time drinking together (last time I did get upset because of the way his mom was treating me and other people pointed out how she was treating me but we didn’t talk about that till after everyone left and that was almost four months ago.) then he proceeds to say we can still drink at my house until his cousin gets off work in a hour and he’s going to meet his cousin at his own house. I honestly feel really offended and hurt because our biggest problem is not being able to spend enough quality time together and after a year and a half I wish he would see that. We even just talked about it during lunch. Are my feeling valid? I want to break up with him but it feels like I’m wrong for a reason like that.

* thank you ladies you gave me so much insight and I really do appreciate your honest opinions even if the truth hurt ❤️

*i broke up with him but all he has to say is that he didn’t realize how bad he was messing up and I told him why does it take me to say I’m done after so many times I already it’s enough .why does it take now to be serious