Ways to deal with couple’s conflicting schedules?

I work 8-5. I Wake up at 6am, Leave house at 7 to drop off my son at school. Leave work at 5 and I’m home just before 6. Fiancée works 12-10pm. So after I leave he goes back to sleep til 11:45 he works a mile from our house. Gets home between 10 and 11 if closes the restaurant. Comes home eats, showers, and wants to hang out and watch shows together or just hang out. By this time it’s close to midnight if not later, and I’m exhausted. I try going to sleep but he gets upset says it’s the only time we can hang out. Idk what to do but I’m exhausted and cranky all the time. He tells me to just take a nap when I get home from work. No I can’t do that. I’d love to if I had no one to tend to but I have my kids to cook for and be there for if they need help with homework or anything. Am I being ignorant ?