I need advice

Backstory-

My fiancé and I met in November of 2018

In February of 2019 he proposed and in March of 2019 we moved 5 hours away from home. My dad had already moved so we followed for work.

Saturday he left and went back home. He wants me to come back there to be with him. My dad is going to be pissed if I go and just walk away from everything I’ve worked so hard for. My life here has been nothing but long work days and stress. My dad already threatened to call cps and tell them I’m living with “meth heads” with my 6 year old child if I go. It’s my fiancé and his mom and they’re not meth heads so he’s just trying to cause problems. I love my dad and I don’t want to fight with him and I don’t want him to hate me, but I feel like my happiness should be more important than any job or any amount of money.

So I guess my question is should I go or should I just forget about my fiancé and move on?