Lost and scared

My daughters father is unsupportive and so is his family. He's 24 doesn't have a job or even a place to stay. His mom calls me nasty names because of what he tells her and tells me that me raising that baby by myself is my problem and she doesn't care . I'm so scared for not only my future but for my daughter . Should I just cut him off and not stress about it anymore . I don't kno what to do