Should I take my husband to the ER or wait it out?

He went to the urgent care 3 days ago with symptoms and they said it was because he has diabetes.. next day, I told him something wasn’t right, he goes to the hospital because he had been running fever + pain when using the restroom…they said he had a UTI. He just started his antibiotics yesterday morning & he is still running high temps (102) plus super lethargic still. I read online it says it takes about 2 days to start feeling better but he also said he had some chest pain.