Is this considered a fever? Should I be worried?

I am 8 weeks pregnant today. I am a first time mom. I checked my temperature at 8pm and it was 99 F. It’s now 8:50pm and my temperature is 99.4 F. I don’t really check my temperature that often, I just checked it tonight because we had the central heat on and I was under covers (in just a shirt and panties nothing super heavy) and I felt hot. Since my temperature was 99, my husband turned the heat off and I didn’t get back under the covers but my temperature rose. My husband has went to get Tylenol from the store since we were out to hopefully lower my temperature. Is this something to be concerned about?