Help me out!!!!!! DILEMMA

Okay so my siblings,mom, step dad is going on a trip for the 4th I will be gone from July 2nd till July 5th. I told my boyfriend and he's been kinda bummed about because he wanted to spend the weekend with me. But get this he is going somewhere on the 4th during the day time but will be with me at night, an addition we will spend thurs, Friday and sunday together . I just feel kinda bad because for the past 2 years July 4th was "our holiday" anyway he wants me to stay but he tells me to go if I want....whatever makes me happy. I really wanna go cuhz were renting a boat and everything at Lake Mead. But I do love him and I know I would have just as much fun. What should I do???