visiting family

I have no idea where to go for advice on this so here we go...

I have a 2 year old daughter with my “boyfriend” if you want to call him that. We live in a small town in upstate NY where there are currently 10 active cases of covid. His family is from NYC where it is obviously horrible. His mom even had covid & has recovered, his grandfather passed away from it. My parents live in the same town we do, are older & have health conditions, I stayed away from them for 2 months but now we do visit. His parents came to visit a couple weeks ago & I said that I didn’t want them to visit, the weekend was hell for it, but we did not visit. They are again coming for Father’s Day weekend AND 4th of July, under normal circumstances they never come up here like this. His grandmother lives here so they stay with her. Am I being completely unreasonable to not want them visiting right now ?! I don’t have a relationship with them to be able to talk to them about it, I’ve just been made out to be an anxiety ridden monster. I’m torn up over this 🥺