A little rant... I'm not pregnant yet, but apparently i look like i am

I'm overweight with PCOS and TTC#1, but I've been working really hard on healthy lifestyle changes to my diet and exercise, and over the last two months I've lost 13 pounds. I've been feeling excited with my progress and was just starting to see results. I went to my friend's 30th. I ran into a coworker who I haven't seen since I switched departments a couple years ago. In the middle of a conversation she asked if I was pregnant. I kinda tried to laugh it off, but I was obviously mortified. I said no, I'm not, and she responded "I'm not sure if your kidding or not... The curve of your stomach looks like you are." So I tried again to play it down, changed the conversation, and after a few minutes excused myself. I've tried to tell myself that maybe it's just the way I was standing, it was an honest mistake, etc, but it's really hard not to be hurt by comments like that, especially since ironically, I'm having trouble conceiving. Has anybody else had a similar struggle? How do you react to emotional setbacks like that?