Boyfriend advice

Okay, so today is my 19th birthday. My Mom and Dad invited my boyfriend and I over to their house, which is 2 hours away from me, 3 hours away from him. He agreed, and we drove all the way up to their house. My parents and I (he knew this) agreed that I would be staying the weekend. Well, my boyfriend decided he didn't want to stay the night, giving me an excuse that he hates staying at other people's houses. He and I argued about it till I finally told him to do whatever he wanted. My parents wanted him to stay the night, since he was tired. Since both my parents and I wanted him to stay, he texted his mom to text him to say he had to come home , because he knew we wouldn't argue with that. But since he was my ride, my parents made me go back with him, so I only spent 2 hours with my family, when I was supposed to spend the weekend with them. My parents said that I may should break up with him since he wasn't willing to even try staying the night, but I don't know. What should I do?