Moving?

I had to move with my family a few months before giving birth, my boyfriend couldn’t find a place that we could afford at the time. Our son is now almost four months old and he got us a place. He wants to come get us before thanksgiving. I really want to be with him, I’m just not sure how to bring it up because so much has been going on with my family and I’m afraid they’ll get mad we are leaving before thanksgiving or leaving at all. Even though my dad told my boyfriend he doesn’t care if I stay or leave. ( my dad has always had a temper and can be an asshole that’s why I’m nervous to say anything.