Not yet vaccinated newborn and holiday visitors?

I think there are a few late Sept and early Oct mommys on a similar vaccine schedule as we are. My newborn is just 3 weeks old. He isn't ready for his vaccines until his 2 months peds visit in Dec.
We are planning to visit baby's grandparents for thanksgiving. That's where all of my husband's extended family lives too. So I am antipicating a lot of random relatives coming over to meet him. 
How are you suppose to handle that and an unvaccinated baby? Also I'm worried about whooping cough too. Everyone in my household has received the shot but I can't say the same for the random relatives that would be visiting. Do we limit the visitors or just not let them touch or hold our baby?