Vacation in a week

So my boyfriend and I got into an argument about me leaving on a trip with my family because of the fact that I didn’t consult with him. I don’t see why I need to consult with him because he is my boyfriend not my dad or anything. We live with his parents and I just don’t see it as a problem. He claims he doesn’t want me to go because he will miss me. Simply two weeks on vacation with my family is too long. I had let him know about this around April and now it’s July in which I leave a week from now. I don’t know how to express my feelings because it’s like I’m scared or something. I’m hesitating to talk to him about this because if he starts with his mood I’m going to lose it. Any suggestions? Please.