Heavy drinking by male and birth defects

Work stress for the last 6 months has led my husband to drink quite a bit to cope. I had discussed my concerns about that but it hadn't done much in the way of making him ease up on the habit. 
​He drinks every evening, at least a pack of beer and a few mixed drinks or glasses of wine. He doesn't get drunk most of the time but does get a buzz.
​So, fast forward to me getting a faint positive. I suddenly recalled reading that men's heavy drinking could cause birth defects. I am freaking out, worried sick that if I am indeed pregnant, something could be wrong with the baby because of deformed sperm. 
​I told him what I had read and he cried, absolutely devastated at the thought that this habit could harm our baby. He hasn't had a drop since, pouring everything down the sink, but that doesn't ease my concerns for the current situation at hand. 
​So I'm wondering if you can lend any insight? Did your partner drink heavily prior to conception and if so, was your baby okay?