I’m going crazy

So my husband have a house that his parents live in(his dad went back to other country his mom is in the house and they just pay mortgage to bank we don’t rent house them and house is on my husband name on papers).We live in apartment because we didn’t want to live with his parents.Now my husband wants to pay off for house (we did save money for it).And wants to take another loan to build another house.Now the problem is he wants me to live with his mom in new house.And I told him before I don’t want to I left my mom in my home country I don’t want to live with his.He is truck driver so he isn’t home often am sahm and we have 15 month old and other one on the way.His mom stayed with me when I was pregnant for two month and anything I did was not good enough for her and her standards food,cleaning.She was sitting and watching tv all the time and expecting me to do everything while being in 8 months pregnant.Now she would expect the same like she is guest in the house and I’m maid.I told him I don’t want to live with her and we can bring my mom so we all can live together then.And if he wants to live with his mom he can find job in our city and can be with her all the time.

He was like well go back to our home country if you don’t like it.

Idk what to do anymore I don’t want to live with her and idk how to let him understand that