Father's Sacrifice

So, my husband and I are due to have our first baby any time now. Due January 7th. We live with his parents and his brother. They all refuse to get their flu and whooping cough vaccinations. My husband and I have ours. The vaccines are recommended by my doctor and our baby's pediatrician because I have an autoimmune disease and our baby is supposed to be born in the middle of flu/covid season. Is it wrong that he wants me to take our baby to live with my family while he finishes his apprenticeship (about 3 months)? He's terrified that our baby or I will get sick or they'll taunt me while he's at work because we told them they aren't allowed in our room or to hold her. He's upset that he has to miss such a big part of her life but he doesn't believe that we are safe here... What are your thoughts guys? I don't know how to feel.