In Need of Some Advice

So awhile back we lost our apartment and moved in with my grandpa just temporarily since my husband lost his job. He got hired at a job that pays $17 and hour which is super good and we are about to get our tax return. We were trying to decide what would be the better option.. at first he just wanted to stay a little longer at my grandpa's until we get our debt paid off so we won't have to worry about it but I wanted to try and get a cheaper apartment while we work on paying it off. I've found a cheap one and with the amount he's going to be getting paid I feel pretty confident we will be able to have our own place again and be able to afford making payments on our debt.. but I still feel kinda like maybe he was right about paying off debt first but after I told him all the reasons why I want to move he said he wants to (the reasons are just a bunch of things like our stuff clutters my grandpa's she'd thing and it makes him a little angry but he was completely open to us moving in with him, I can't keep track of anything paper wise because idk where half of the stuff is from moving in such a rush, our little girl is getting big enough that I want to put her in the crib so she doesn't roll out of bed but we can fit the crib anywhere, and plenty of other reason..) I just don't know what to do i feel like I should just trust the way I feel about moving out and just go for it but I still have the thought of losing everything again and having even more debt.. is there some advice or opinions on this situation?.. I really just don't know and it's super stressful and 10 more stressful having to worry about the baby at the same time..