HELP, 4.5 month old has fever

An

Someone needs to PLEASE tell me if I should take my baby to the hospital. She has a fever of 101.4. It was at 101.7 about 15 min ago but I gave her some Tylenol. It seems like she caught a cold/flu which is what her big brother had/has. It's 3am and idk who to call. Doctor office is closed. She's congested and has a dry cough but sleeping and nursing.