Drinking while doing stims

What are you thoughts on drinking while taking your fertility meds? I am only asking because we are invited to a party and of course drinking will be involved and my husband just had surgery and I'm doing stims. No one knows about either and I just know people will be like what both of you aren't drinking! It's common that I don't drink just every blue moon. Think I could just have one and drink it slow just so we won't get questioned about it?