Drinking in TWW

Jill • Happily married, had my first son 12/31/16 (conceived via IVF), ready to expand my family!
Ok I need opinions... It's Labor Day weekend and my 2 week wait. I have been trying to cut back on drinking but if I don't drink everyone asks if I pregnant which is annoying. Is not drinking during the TWW really worth it?