I have a Cold! :(

Amber
I caught a cold from my toddler a few days ago and now I have a stuffy/runny nose, sore throat and I'm fatigued!  I'm scared b/c I don't want my sickness to harm the baby!  I'm 4weeks and 6 days today and my first appt isn't until October 29th. Should I be concerned and should I call my doctor?