Setting up nursery late

Okay so lately I've been freaking out and crying. My husband and I are moving back into his parents house because our apartment is too small for us and a newborn. We have to wait til they get caret installed into the house before we can move back in. I am 30 weeks pregnant and have nothing set up for the baby yet. It will probably be another 4 to 5 weeks before we can even start to move out stuff back in. I am freaking out because I wanna start working on the nursery as soon as possible. Do you think we are waiting too long to set up the nursery? I will be 35 weeks.