Advice

My husband recently told me that one of his friends wanted to plan a trip to California. I’m from California so I was like cool, expecting their partners and kids to come too. They all have babies 18 months and younger so I figured it would be a cool thing to experience together. Well I just found out it would just be his guy friends going, not their families. So just a guy trip and me and our baby. Is it weird that now I don’t want to go? My husband is upset because I said I don’t want to go on a guys trip and he said we could make the trip anything we wanted it to be. But I just think about everything that it would take to travel with a baby and keep somewhat of a nap routine/sleep routine going away from home and I just don’t want to do it. It’s not worth it to me and I would feel like I was just tagging along and not really having a good time. Does that make sense? Am I just being a Debbie downer??