Help!!

So I have been running a fever of 100 for 24 hours, coughing up green mucus, body aches, and head to toe chills. I went to the dr this morning and was told its viral to fight it on my own. Now my fever is 101.3 and I'm 4 weeks pregnant. I'm worried something is going to happen to the baby. Should I go to the er or wait it out?