Is this normal?

Babe and I have been together 5 years I'm 21 he's 23 and most of the time we only see each other when I come to his house to pick him up for the gym and so on his days off from work (works full time) I want to come over after class when I get out at 3:45 and he usually lets me but tonight I asked him if I could and he said no and I asked why and he said he just doesn't feel like it and wants to be alone tomorrow. Should I be worried? He works so much we only get time for just US about once a week bc I don't count working out every night bc we don't talk much. Help ladies 😭😭