Am I wrong?

My husband & I are currently not working. We are relying on our life savings to get by. My husband insists that we should take the time to visit both of our families in Oregon. I mentioned to him that I don't think it's wise to do so since we really don't have money coming in right now. He says that once he starts working we won't be able to visit our families because he'll be caught up with work. I say it's true, but at least we'll have a roof over our heads. Plus we have already made reservations for a Florida trip for a family vacation with his family. Am I wrong for not wanting to spend more money for us to go to Oregon?