Relationship coming to an end.. Help:(

My fiancée and I have gone through a lot this past year. We just had our son, he has a problem with pornography(which caused us to almost break up and it ruined our sex life) him constantly lying and now we are working on getting through this all. He is the only guy I could picture a future with. He's the only one I want a future with. I love this man to death, and I want us to be a happy family. Lately, I've noticed he doesn't want to cuddle, he gets annoyed when I kiss him and hug him and doesn't really want to spend time with me. He leaves as soon as he wakes up, and goes to his moms house until he has to go to work. He just called me on lunch break and I told him how I feel like he's been distant lately and how he won't be affectionate anymore and I asked him if he's losing feelings for me. He didn't say anything. Then I asked "are all feelings gone or a little bit?" And he said a little bit. My heart dropped. I feel like our relationship is coming to an end soon and I'm devastated. And no he's not cheating. Just to make that clear. But I'm so devastated I don't know what to do.. Any advice please? 😔💔