Am I wrong for this??

I am currently 34 weeks pregnant with my second child I have a 5 year old son also. I just recently moved back into my grandmother's home 4 days ago because for the last 9/10 months I've been staying with my fiance which doesn't sound so bad. But we were staying in a 10 foot trailer with my son in the middle of the desert, OFF GRID. like off the paved road & everything , limit solar power & had to drive to bring water & shower in buckets. & I did it for so long because #1 it's my fiance I love him to death & I understand that was the best we could do at the moment but I initially had to idea that we would work towards getting in a better situation before the baby was born. & threw out the months he would go back n forth between, not wanting to leave saying he would never rent an apartment or live that way & some days he would break down & say we deserve better & we would talk about possibly renting & what areas we would consider. But eventually I knew that getting out of that situation wouldn't happen before our baby was born & he was getting hired onto a job hours away so he would have to sleep in his truck & leave me & my son in the desert alone. While I am 34 weeks pregnant & been having severe back pain & depression over the whole situation. We came to terms that I wasn't ohk with being out there alone under these circumstances & wanted to have somewhere safe to be & bring our baby home too & have my son in a better situation & if anything where to go wrong I have my family to help me & I am not 40 minutes from town & the nearest hospital. So we backed up our things & me & my son came to my grandparents & my fiance is working. But he is now saying I took the easy way out & that I left him & i should be struggling like him & that i am spoiled & dont care etc etc. Am i wrong for coming home to my family? Or should i of stayed in the desert to make him happy?

Also during these 4 days of being away from him hes deleted me & all of our photos off social media including our babys ultrasound. Has broken up with me twice , all out of anger. I love him & we been together for a little over 4 years but this is a lot of stress & anxiety & heartbreak for me right now. When all I wanted was comfort & security during this time.