am I being irrational about my husband and his family visiting?

hubby, myself and our 2 young boys are moving out of state this week. His mom and grown sister are planning to come visit not even 10 days after we get our things into the new house as everything is being shipped. Already they have requested time off from work to come to our new house to stay for over a week and I just found out that his sister invited her fiance to come too, unbeknownst to me..

today I told my husband that I was not comfortable with this, as by the time they get there we will have barely had a chance to unpack and get completely settled before they come in, not to mention having another male in the house (SIL's fiance) and probably have him sleeping on the couch since my MIL will be in our spare room, is quite unsettling because A: I'm nursing a 5 month old every hour (human pacifier here) so now I have no choice but to be in my room at all times when nursing which is not always convenient or fun leaving the room to nurse and B: I think it's rude to just invite your fiance on a trip to our home without running it by us and we find out during general conversation about how they both requested time off from work.. so basically now my husband is angry with me because he said I'm making it all about me just because I think they should wait a while before coming.. I know they won't come to help us unpack or keep the boys busy while we do it. it's just so they can see a new city, be touristy and hang out (they're coming for SIL's bday) and it will just be more work having them around. opinions please!