Is moving closer a good idea?

My boyfriend has been driving two hours to me for a year and a half. He stays with majority of the week. I live in a town by myself no family or friends. I was strongly considering moving closer to him (not moving in, his house needs to be fixed up ) but I don’t know anymore because he’s always giving me smack when I need him to watch my 2 children for a day (they aren’t his). He even does that with the baby we have together. I told him that if I were to move back to my hometown I wouldn’t depend on him so much but if I move there with him then I will depend on him because I won’t be near my family. My children fathers aren’t in their lives he has no problem getting his son (my step son ) every other week.