Struggling with fear of alcoholism

My mom is an alcoholic and would verbally abuse me when she would get drunk. Last year she got a DWI and now can’t drink at all for the next 3 years. I’m in college now and my boyfriend likes to casually party with his friends. I want to hang out with them at the parties but whenever he gets drunk it gives me so much anxiety and I’m scared he’s going to break my trust like my mom did. He is 100% not that type of person and I know he would never intentionally hurt me but I don’t know how to overcome this fear. I feel like our relationship is going to start to suffer because I just can’t understand why people want to drink every weekend but I don’t want him to miss out on fun events with his friends. We have talked about it and he says that I don’t have to come over when they’re drinking but then I don’t get to see my boyfriend for a week since we don’t live as close as we wish. Can anyone give me advice on how I should handle this