Family and Friends around newborn...

So I'm due November 7 and that it's right in the middle of flu season...we live 3+ hours away from family. I'm curious to know your guys' thoughts on delaying family and friends from seeing baby, I'm a FTM and I do not want the baby getting sick. However I don't want to upset or hurt anyone's feelings by telling them to stay away until we feel like it's the right time to bring him around people. What are your thoughts on this? Am I wrong for feeling this way? And how would o go about telling family & friends how we feel?