he hurt me while he was drunk

my ex boyfriend was aggressive and very sexually driven when he was drunk. when people drink around me or i hear about people drinking around my current boyfriend i start having a panic attack. is it wrong for me to get so anxious?