Am I the a**hole?

My dh’s parents asked if they could come visit for a few days. I’m cautious with things like this because we have a toddler and a newborn. Now, they’re generally pretty good about following COVID protocols and do what they can to stay safe. But, last weekend they attended a graduation party. I saw pictures of the party and there was a large group of people and no one was wearing a mask. I’ve expressed to my dh that I’m really not comfortable with them coming to see us after being at the party. His response was, “so I’m just supposed to tell them they can’t come?!”. To which I said yes, I’m just not comfortable with it. I even offered to be the bad guy and tell them this. But, he’s acting like I’m being totally unreasonable. Am I the asshole here?