need advice

Hey ladies so I need some advice..before our son was born my boyfriend would always go on Saturday's to play basketball at the gym. But recently he hasent or I've asked him not too..I'm home with my son (thankfully) and the mornings are harder as moms we all know that..so whenever I can have some help in the mornings I take advantage of it..I also haven't been feeling well the last few weeks just getting over colds and whatever else. He gets mad at me when he can't go play basketball...it kinda upsets, I know that's something he was used too but we have a baby now and things are different..he knows how mornings are harder for our son (he has reflux and has gas issues right now so mornings are tough because he hasent gotten his meds yet!) anyway what do you all ladies think? What should I tell him? I've explained this to him before but you know how men are....