Baby shower issues

I’m a first time mum currently 24 weeks 4 days. I’ve started planing my baby shower and I’m only planing on having really close friends and family come. But my partner has turned around and now wants to invite his Aunty and her family we hasn’t seen in years. I’ve been with him for 5 Years and have only met her and her husband twice and that was at a wedding and engagement party. So I don’t want to invite them cause we never ever see them and the plan was to only have really really close family and friends come. All we have done the past couple of days is fight over it and has gotten to the point I don’t want to hold this baby shower. His mum isn’t happy over my choice but it has nothing to do with her being our baby shower and I’ll be the main one go plan all this. what do you think?