Baby fever

My 11 month old baby has been having fever past two days. Past two days it was 37.5c, but today it spiked up to 38.9, I gave him doctor prescribed medicine and it went down 38.6. It’s been half an hour since the medicine but it still 38.6. Should I bring him to the hospital now? And I’m not sure if it’s because of his teeth growing or because of an infection.