my boyfriend never wants to spend time with me

So my boyfriend works 5-6 days a week from 5-8 I barely get to spend time with him because he comes home showers and then he'll probably just go straight to bed. Today is his only day off and I just wanted him to spend time with my son and I and he just flips out and says that he doesn't want to spend time with us because he lives with us and he goes to bed with me every night... but he wants to go out with his co workers that he sees all day everyday.. how is that fair to me? Am I asking for to much? All I wanted to do was spend a couple hours together before he left to his game and I went to go do my own thing..