Am I wrong for asking this?

My husband and I were invited to his families annual Halloween party. This is 110% a drinking party and his entire family is also huge pot heads (not saying that in a mean way cause I was as well before I got pregnant). Every year, for the last 9 years, we’ve gone and it’s the same thing. Drink till we’re wasted and smoke a wholeeeeee lotta pot. Kids are actually not allowed because of the craziness lol. It usually lasts till 12-1AM.

I told my husband I really didn’t wanna go this year. I can’t drink, smoke, I’m tired all of the time.. he said okay then he will just go without me. I asked him if he would just stay home with me cause I didn’t want him spending the night out there without me. Especially because there will be an ex of his there who I just don’t feel comfortable with. When we were teens in highschool, he actually cheated on me with her. Yeah, she’s with her new boyfriend now but still. I have been diagnosed with severe anxiety disorder and panic disorder. When it comes to things that trigger me (such as her) I get sick, I shake, I get heart palpitations, light headed. If I was able to go with, I wouldn’t mind it as much. It still makes me anxious but Atleast I’m with him and don’t have to worry about the what ifs. But if I was home all night; the whole time I’d wonder- what if they talk? What if she tries something stupid? Who knows what will happen when everyone is plastered. Her boyfriend is my husbands friend and so I know they’d be around each other all night. Her boyfriend is literally dumb and will walk away sometimes for hours. Not even care what’s going on. She has been left alone with just me and my husband many times cause he literally just leaves and goes and does his own thing. I’m not interested in that. So now my question..

Am I wrong for asking him not to go? My family is actually going to a water park for the night that same night and invited us to go. I asked him if he would go with me to that. He wants to go to this party and me to the water park. I asked him please don’t go to the party. It’s just this year I ask him not to go. pregnancy is temporary. We’ve gone every year before this, and will go next year. Am I wrong for asking that of him?