post-sex breakup? could it work?

After sex last night my man and I were just in bed cuddling and talking and he brought up that he was thinking it may not be the best time for him to be in a relationship since he's always so busy & just doesn't have time for it. He says it's not fair to me and he doesn't want me to feel neglected. He wants to go out and unwind with his friends every time he's free and gets mad if I ask him to stay with me. I can't tell if this is just a temporary thing or not since we just moved and he's had so much to stress about lately. There isn't a thing I wouldn't do for this man. Things feel like they're starting to fizzle out sometimes but I don't want to let go...