Feeling sensitive?

B
Hi there!
I'm 6weeks5days today with my first ☺️ We are SO excited, but not ready to tell anyone until after the first appointment at 8weeks and some change. Probably will wait to announce to friends until 12 weeks. Anywhoo...
I went to a friend's yesterday for her son's birthday party. After dodging the offer of wine (3 times...) she said to me "you know there is a rumor at work that people think you are pregnant. After you were sick last week people called to ask me. I told them there's no way you are getting pregnant this year!"
I got a little, ok very, upset and said something about the rumor mill and how it would be great if people could mind their own business. I woke up this morning still a little upset about the whole conversation and I'm trying to decide if it's just my hormones making me feel hyper sensitive to things or... 
Just thought I'd see if anyone has some friendly thoughts on this.  Thanks!