Does drinking a few alcoholic drinks a day affect fertility?

I know that once you are pregnant you stop drinking, but what about for all those months while you are trying?