Leaving my husband.. maybe..

Sorry this is going to be long and probably a bit confusing but I need to vent...

My husband and I recently moved 2 hours away from my hometown with our 3 month old daughter. I was looking forward to it. We were moving to the town we met in and were finally moving out of my parents house after over a year. Well during this whole process his mom expressed the interest in moving down here with her 8 year old son. She lives in Minnesota and we live in Georgia. We were looking at a 3 bedroom house so we agreed to let her stay until she got on her feet( 2 months tops). The place we were looking at fell through and we ended up with a 2 bedroom townhouse. I expressed concern in having two extra people moving into an already small place. My husband assured me it would be and I kinda went along with it. Two days before we moved I got to the point were I just wanted to tell him to move without me. I was done. But we talked and I chalked it up to not taking my medicine for the last couple days. For the last two weeks things have been better until today... his mom will be here in the next hour or so. Ive been crying since I’ve woke up. I’m filled so much anxiety it’s not even funny. I want to take my daughter and leave. Or even wait until tonight and pack while he’s asleep and just go. And yes I’ve been taking my meds. I can’t keep acting like everything’s okay. He keeps asking me over and over if I plan on leaving him because I’m scaring him and my answer is always no. Why is it so hard to say yes... why am I so scared to start over..

Edit: we’ve been married for almost a year and a half. Most days I question why I married him. He’s not very supportive, emotionally. He can be very manipulative and emotionally abusive if he doesn’t get what he want or things don’t go his way. I’ve lost myself in trying to love him.