Maybe I am falling out of love

This has been hovering on my mind for many months and the closer to our anniversary we get I can’t help but to think I’m not in love with this man anymore. Now I know when love is neglected in a relationship it can take on a shade of hate or anger but with how long I’ve felt like this I’m not sure if that’s the case. My SO is a very religious man and about 9 months ago while living together we came home one night and he told me he was leaving that God’s been telling him that he needs to separate himself and he left telling me he needs to figure out why God wanted him to go. We stayed together just not living together, well a few months pass and I find out we are pregnant. He didn’t have the rush back I wanna be with you have a family action that I thought he would because prior to him leaving we were trying to conceive. Many weeks go by and he still is away we spend time together but shortly before Christmas my lease was up and I had to move, at the time I didn’t have the money to move into a complete new place and he said he wasn’t ready to move back yet that God hasn’t shown him his path. So I moved in with my mother and now sleep on the couch and it bothers me a lot more than it bothers him the situation currently. The past few months I’ve been doing all I can to keep the relationship “alive” when I felt like it was fading I started going out of the way to make sure we go on dates I always pay now. We were still actively intimate until recently he’s been very uninterested in me even touching him it seems. I’ve had to work a lot of OT at work because I’m the only one putting money aside for an apartment and baby stuff, and he never tells me that he appreciates anything I do working the overtime, buying all the baby stuff, he thanks me for lunch when we go that’s about it. I’m currently 28 weeks and I don’t think I’m in love with him anymore it seems like everything is a huge game, I’ve tried to be respectful of giving him the space to follow God and his plan. But when I bring up my concerns I get told I need to be patient that god will work his path for us, and I need to stop seeing things from a worldly perspective. But I can’t do it, i feel like I want nothing to do with this man and that the best option for me is to walk away. But I’m scared at one point we were developing a home together and happy, then he left and we were blessed with the child that we were trying for and he didn’t come back, and now when I try to tell him how stressful this is on me planning everything alone he tells me to just give the baby to him if I think it’s so hard and too much. I just don’t know what to do anymore I’m so unhappy in this relationship, but I feel like I can’t walk away( we are not married btw).