Moving to another state.

Me and My childs father are not together, and never married. Does any one know if i need his permission to move out of state? We have never went to court for custody or visitation... so i dont know if i have full physical custody or what.. and no visitation has been set. He just pays child support. And I bring my child to see him 1-2 times a month. I live in Minnesota. I'm not sure how all this works. .

Oh and he is on the birth certificate.