Sick and really need advice

Champaine
I am 24 weeks pregnant and I have been battling a sinus infection for a little over a week. The doctor said it was safe to take sudafed, because I'm nervous that it may cause problems with my baby I have been taking it once or twice a day or sometimes not at all. I have not been able to smell or taste for about 5 days and my hearing gets vague every once in awhile. So far I feel like I may be getting worse, I need to go to the doctor and see if I need antibiotics but I'm afraid that taking antibiotics may harm my daughter. Should I just try to wait things out or go see a doctor? Have you taken antibiotics while pregnant? Has it harmed your child?