what to do

So yesterday my husband and I got in a fight and he said a lot of mean things that I just don't know what to do anymore. Last night when we were arguing he left he said to his moms but I really don't know where he goes bcs he turns off his phone when he leaves. He was gone all day and didn't come until 9 pm and didn't try and talk to me or nothing when he came back. I asked him what didn't he want us to do and he said to leave him alone or he was going to leave again. Last night he said he was tired of me and didn't love me anymore more. And so I asked him if that's what he wants to be honest with me he said he's tired of my shit and meant everything he said. I don't know why he's being so cold. He said he's done with me hates me. I don't know what to do if I should just pack my stuff and leave. Or try and talk to him. But I can't ever talk to him. I told him if he's sure of what he wants then if he can just give me money so I can get on my feet I've been a stay a home mom since we got married 5 yrs ago and have 3 kids 4,3 and a 7 month old. We've had a lot of issues bcs he works so much and is not a present husband dad. I try and tell him he needs to make time for us but it goes threw one ear and gets out threw the other. He puts no effort in our marriage doesn't help me with the kids and just seems to not care about me anymore. It's hurtful I've given him everything I have I know I'm not perfect but if he doesn't want to hear what I have to say how are we going to improve our marriage. He acts like he doesn't care the only thing he ever says is he has a responsibility at work I don't. But how can he saw that I'm home 24/7 with the kids never have time to my self and I'm exhausted too. Being a stay at home mom is not easy. And he thinks I stay home and don nothing all day. Well I told him then what we should do of he want to end this to give me money so I can move out and money for a car. He said to get a job. And he'll give me some money but not enough to get by that I need to get a job. He's been divorced before so I feel like it's not a big deal for him and he might just not care about me anymore. When I meet him he was in the process of getting divorced. So I feel to him it easy to just move on and find some one else Just like he did with me. Ive been feeling very self conscious lately he doesn't compliment me always looks for things I did wrong to bring up. I know when we become moms we change are body's change we start to age and maybe he's just not into me anymore. I don't know what to think but I'm at a very low point in my life I have no job money, low self esteem and just feel lost. I don't know how we ended up here. We use to be so happy. He blames me for everything he says it's my attitude and my constant nagging that has pushed him away. And maybe he is right. I need some advice. I feel lost I have no one to talk to. What should I do. I've brought up that we should go to counseling but he said no that I need it not him.  Could he be having an affair is that why he's changed so much? I don't know but I need advise what would you do in my shoes?