When to take baby to hospital ?

My son has a fever of 104.4 and I don’t know if I should take him to the hospital or make him a dr appt in the early morning. I’m so worried here 😢 FTM.