Does seasonal viral infection affect baby

Meelien

I'm 20+6 weeks and coming down with cold. Others in my family also had it before me and their symptoms subsided in 4 to 5 days with no fever. Now I've started having symptoms of sore throat and coughing. I'm very concerned about baby's safety. Haven't got a flu shot yet as it is given at 27weeks here. If I develop fever, Will it affect baby?