Feeling helpless! 💔

I've been with this guy for a little over two years we started dating October 7, 2013 anyways I had gotten pregnant November 2,2013 and had a miscarriage April 14, 2014 it sent us both in a really bad place in life but we managed to get out of it! Anyways, we are now ttc and it's like it's never gonna happen.. We recenty got into a bad fight and didn't talk for about 2 weeks! We finally started talking and these past few days I have been staying at his house! He's been telling me he wants to go different ways now and that we don't deserve each other...  But then he will randomly tell me he loves me! I feel like I am going crazy because I am just so sad even when I hear him say I love you I know he's pushing away... I love him more than I have ever loved anything and I don't want to just walk away... Help?? What should I do? Let him go or hang on?