I'm not pregnant..I'm just fat.

I live and work in a small community and I have been asked for the last 2.5 years if I am pregnant as people touch my stomach. I found out I had PCOS last year around this time after assuming that I had it for awhile. I have gained quite a bit of weight and it sits low on my belly..making it look like I'm pregnant...does anyone else get asked if their pregnant or gain weight like this with PCOS. How do you handle it?? I feel so bad telling them that I'm not pregnant because I know they will be embarrassed that they asked me. Sometimes I just smile and nod and say nothing, hoping that they will forget. Please tell me that I am not the only one!!