Hiking trip with my family

My bf and I are ldr at the moment. He is upset because I didnt mention my mom and her husband were going up north with me to hike. It was last minute and I was driving so I didnt really have a moment to tell him. He is always referring to these types of situations as me lying. Am I in the wrong. Or is this something he is taking out of proportion?