Fever but has goosebumps

FTM so new to all this

11 month old has a fever. 38.5 hes on antibiotics for a bacterial infection but today he has goosebumps all over but a hot head . . .

Any thoughts?