boyfriend/parent problems

So I'm 24 and my parents hate my boyfriend- and vise versa. They were very controlling, reaching out to my boyfriends family/ex girlfriend to dig up dirt about him. It was a smear campaign, lying to my friends and family that he was abusive (even knowing that I was in an abusive relationship previously and that destroyed my self worth). They contacted my employer and said she was stressing me out and should fire me, they took my apartment away, and they didn't pay for my last quarter at college which my boyfriends mother gratefully paid for. After all this happening, I went and traveled for 3 months, and have a new job. I've just started contacting my family again and allowing them to be involved in my life. They still HATE him. My boyfriend and I just want to move along as a collective so we don't have to have this stressor anymore.

The kicker: I'm moving to Denver in February and they are furious that I'm leaving with him! We have been together for 3 years, what did they expect?

My question is: what can I do to make things run smoothly? Or at least work, where I have my boyfriend and my family in my life? ... And where things are moving in a positive direction (he can no longer be the "silent" or "invisible" boyfriend).