Drink effecting fertility ?

I have been TTC for around 5 months now-I'm 29 and partner 32.
I have binge drank from the age of 17 really... most weekends and still do. Don't touch a glass in the week. But will have perhaps a bottle of wine most weekends. 
Does anyone else worry that drinking has, or will affect their chances of TTC? 
Would be interested to know other people's thoughts on this? 
After nothing having happened after 5 months I'm starting to look at all options as to why we've not conceived yet. 
All my friends around me seem to have conceived so quickly 😔