10.5 week old and fever

Both my four year old and 10.5 week old appear to have colds. My daughter (4) has a stuffy nose and a temp of 99. She's been feeling this way since Monday night or Tuesday.

My son just started to have a stuffy nose last night. He has not other symptoms but has been a little fussier than normal. We've been doing saline drips, chest rub, and a humidifier. I've been taking his temp rectally and the first time was 101. I did it again and said 100.9. I'm not sure if his temp is high due to wearing fleece pj's. But I'm wondering if I should call the doctor. Google gave me mixed answers. He seems fine otherwise and doesn't "feel" warm.