Newborn and nursing home

I have a 2 week old baby and my 98 year old grandpa is in a nursing home. He's pretty healthy but of course at 98 years old you never know when they could be gone. He wants to meet my son so badly and I was going to take him there the other day but someone told me I shouldn't because nursing homes are dirty? This is a newer (within the last few years) nursing home. There's two levels, one is more of a traditional nursing home and one is a rehab for walking/etc. My grandpa is in the rehab section so no one is sick on that floor. Would you bring your baby to a nursing home? I was thinking I could bring him and we could hang out outside but it's been chilly and windy lately so I'd rather bring him in.