Drinking while TTC

My SO other and i have been TTC since may of 2015. We've kind of obtained the mindset of not trying but not using protection hoping that one day it'll work. Recently we've been drinking a little more than usual and it terrifies me to know that drinking while pregnant is worse for the child than doing drugs which is very bad. So my question is does drinking from the time of your fertility window to your missed period mess the baby up?