Going out - warning LONG

Me and this guy are in a long term situation let's call it, we're not a couple but like each other. Anyway he goes out loadsss like every Friday night at least which I don't mind cause he's young he should have fun but sometimes he goes out and doesn't come home until 5am which means we don't get to talk the whole of the Friday early evening, then he sleeps late on Saturday cause he's hungover then goes out to do football or something. Anyway he's generally a busy person at work and hanging out with friends whereas I'm just finishing a qualification and not the type to go out like he does. Basically I just feel he's too busy for me sometimes, I was going to invite him to my city for the fair but never asked him after hearing how busy his week off was🙈 what should I do?