tell me if I'm being unreasonable!

So I'm 11 weeks pregnant and working full time. My partner also works full time and has a two year old that stays over Monday, Tuesday and Wednesday. This week, I thought it would be nice to have my two little brothers (3+8) stay over and play with my step son. My partner has made a huge issue, stating he's not happy having anyone stay over because he's been at work all day and he just wants an evening to himself. What gets me is that I also work full time and I arrange my days off around caring for his child.. I bath him, feed him, dress him, read to him, play with him, put him to bed, get up in the morning with him, change his nappies whilst my partner does next to nothing. I've stood my ground and said my brothers are staying because I hardly get to see them and I've said it will be me cooking, putting hem to bed, getting them ready for school and taking them in the morning. I also do most of the housework whilst looking after his son..  Am I being unreasonable in saying i want my little brothers to stay over?