Gym/family time

I’m going to try to word this as best as i can. So I am a stay at home mom and my husband works 5 days a week. We don’t get much help with our kids and we also can’t afford childcare. My husband likes to go to the gym every day, he used to go at the most inconvenient times so we made a deal that he go at bedtime that way he wasn’t missing out on family time. Lately my anxiety of being alone at night has been ridiculous (not sure why because he has been deployed and also worked night shift so this isn’t new to me) and while I’m aware that’s not his problem, I don’t know how to balance his gym time and family time if he doesn’t go at night. I should also add that he isn’t the best at spending quality time either, that’s been a huge problem that he’s trying to get better at.

Any other SAHM’s maybe that have a better balance than we do? I get 0 time to myself so while I support him and his time.. I’m struggling.