Very conflicted pls help 😩

My ex boyfriend never allowed me to go out with friends or party like drink or anything which is something I used to do before I got together with him. I wasn’t ratchet or like a party hoe, I’d just chill with friends and we’d drink or smoke and it was fine. He used to be like that too but then he stopped and when we got together he didn’t let me do those things anymore. Obvi I know this is wrong he was very controlling and emotionally abusive I was with him for a year and a half and I broke up with him. I’ve been with my new bf for 9 months and he used to smoke weed with his friends pretty regularly but he pretty much stopped and I figured once I broke up with my ex I’d be able to hang with my friends and do all the shit I used to but some friends invited me to hang out next week sometime and they’re gonna be drinking and stuff and I asked if it’d be okay if I went and at first he said I don’t need his permission to do anything but now he’s acting all weird saying like “if you want to go then go” but in a passive way? Cause then I ask if he’s mad or whatever and he’s like “I’m just whatever right now, I’ll be okay I guess” or whatever so idk wtf to do