Advice! moving to another location same state

Hello Mommas. I’m a mother of 4 children and 1 on the way. I remarried and we currently live in GA. Well times are hard and my husband is having a really hard time finding a job. We have decided we are going to move to ATL which is about 3 hours from where we live now because he has a better opportunity of working out there at a place he worked before. With my baby father things have up and down a lot. He was in prison a few months and all and basically I have put so much of my life on hold to acomódate him and his parents. His mother helps alot with my children. But yesterday I told him we have decided on the move and he didn’t take it so well. It’s very hard for us to get along. Do y’all recommend I take this to a more legal custody agreement or what would y’all do? I’m so stressed😞