Am I being crazy.

Ok so me & my boyfriend barley had 3 months dating & we got pregnant. We would argue A LOT & he would just leave & go hangout with his friends & drink/smoke. A year went by & we’ve worked through our differences. But I’ve never really let him go out again because it would remind me of how he would leave me every time we would argue . & I knew I couldn’t hold that against him forever so he went out again & he told me he would be back at a certain time & would only drink a beer or two. So time came & I messaged him what time he’ll be home & he says he’s trying to sober up!? Like I thought we had an agreement. & I just lost it because it just takes me back to how irresponsible he was . Like I was already letting my guard down & not trying to be crazy. But I feel like he just pushes me to get there . & I’ve told him how I felt about him going out & how it affects me.