Anyone get sick while doing stims for IVF?

Terra • Married to my Mr. Right. Mom to my IVF heart warrior daughter born November 16, 2017.
Oh no ladies! I'm starting to get a cold!!! I have a sore throat headache. I am a little achey. Dr said I can take Tylenol but I'd prefer to take nothing. I hope I caught this early enough to shake it I am on day 6 of stims. No fever thank god. Just gonna try sleep and get fluids in me. Anyone else have this happen?!?!? Should I be worried?!?