Advice on Marriage!

So recently my husband told me we fight to much and he wasn't happy I was devasted being 15 weeks pregnant with baby #2 ,he been staying at his friends and then I said okay I need to go back home (which is another state) to be with my family and he said okay I'm going to come and he can watch our son, well when he came we agued not yelled but jus talked about everything that led up to this and white feels were never going to work and. I'm crying hestericaly I'm like okay I packed all my stuff and as I'm getting my last few stuff he starts crying my husband never cried like this and j been with him5 years in like please stop don't make this hard then it allready is and I tell him ok I'm ready you can start putting the suitcase in the car and then he said can I last kiss and so I do and he basically breaks and is like I don't want you to leave and kept repeating we're not going to a divorce idc we're not getting and divorce I love you so much , I say okay we talk about how we're going to make things better and the day goes on good but then that he stars acting distant again ,and he says can I ask you a question , you think we're gunna work and I say and I feel like he is regretting his choose to have me stay even this morning he is sleeping and like he isn't being rude or anything but still acting like something is wrong but he is sleeping and really tired so that could be why , what should I do to try to save this marriage