I'm being forced to be with him

I'm not sure what to do. Yes I do love him, but we are just too different now and I wanted to call things off. We have been together for 2 years. But now I don't think I can do this anymore. he said I don't have an option to leave him. And if I did, he would follow me forever. He also said that he would kill the next guy I'm with if he finds him. I'm 20, in college, and I just want to move on. People have said to involve the police with this, but if there is SOME WAY for this to go down more peacefully, I would love suggestions. I love him and I do want the best for him.. Is there a way to leave without getting him or me in trouble?