Pregnancy and alcohol

So I just discovered I'm 4 weeks pregnant. In the past my I've been drinking so much alcohol with my boyfriend. I had no idea I was pregnant. Could I have hurt the baby . I read that this is the stage where brain development happens . I'm soo damn worried.