4mo old fever

So my husband, 2yr old and myself have all been sick for a week. Cough, congestion, fever, the works. We're just starting to get over it, but even being breastfed my 4mo old ended up with a fever today. 101.5 was the highest so far.

When do I reach out to the pediatrician? I'm hoping it goes down, but I'm not sure how much Tylenol he actually got since he spit a lot out. My 2yr old was never sick as a baby so I'm unfamiliar with this. Vaccines were weeks ago so not likely to be from that.