Need your opinion

Today my husband and my kids and I went to visit my sister in law and her kids and my mother in law, my kids enjoy playing with their cousins, and vice versa, while the kids were playing there was a knock on the door, and it was my sil friend with her kids, they told my sil if she will let her kids to go to the park and she said yes, my kids came to me and asked me if they can go and I said they can’t because we’re about to go home, well her kids left to go to the park and my husband got pissed and told her why in the world did she let her kids go to the park when we brought our kids to play with her kids, and she reply with “she’s my friend and wanted to take my kids to the park and I said ok” but my husband said it is not okay, we are busy it’s and my kids came to play with your kids, what if she comes at my house and my friend takes my kids to her place and they leave her kids at our home, wouldn’t she be mad and she said no because they’re your friends and my husband said “look at my kids they are crying over your kids, couldn’t you have told your friend that your brother came to visit and that your kids can’t go because their cousins are here?” And my sil said “but I don’t see nothing wrong with it”. My husband storm our the door and texted me to go home. And my question is, do you think this is okay? Or would you be mad too if your sister let her kids play and leave yours home.