Fever 100.4

Ya

My five year old brought a cold home, we all had a piece of it. Yesterday my 15 week old has a runny nose. At 3 am I took his temperature and it was 100.4. Retook it this morning and it was 99.6. Should I take him to his pediatrician or should we just wait the 48 hours?