Feeling really sad

So my husband and I have been married almost three years, to be honest we are pretty happy but we Forsure have our ups and downs, we have been through hell and back but with time an communication our relationship has grown. We recently moved back to where I’m from and currently living with my sister and Mom to save money, until then we are in my brothers small room, with limited space my husband has to sleep on the ground and I co sleep with my baby, I know its tough but we have no other choice. My husband and I have been both busy and don’t have much time for eachother during the week, but I try to get in some time at night before bed to cuddle with him, I just noticed he doesn’t seem to want to have sex an lately I want to but he’s not interested, he says of course I wanna have sex but he never initiates it, I’m always having too, his excuse is “I’m tired or we have no space or it’s weird with family in the house” I understand all that but I think it’s important to have some sort of physical interaction. I want him to want it and start things up but I can’t force him, I’ve had a talk with him but he doesn’t get it. Anyone else in the same boat? Any advice would be greatly appreciated