My husband hates me

My husband and I have been married for one year. The beginning of our first year wasn't easy but for the past few months it's has been good. I've stopped doing everything that was making him angry or annoyed. Before getting married, we both had cheated on one another and ended us calling off our wedding. We moved forward by getting married, moved to another state, and just began fresh. Well that's what I thought. If we get into one argument he is quick to threatened me to divorce me, quite often too. I know I'm not perfect but I know he is not either. I really do love home and still in love with him. Lately I just feel as if he doesn't love me anymore. He is very quick to say is going to leave and divorce me. I never done that to him. Even when he left me for my birthday, the Christmas holiday, and New Years to go to our home city, Chicago, to spend time with his ex fiancé. I forgave home and moved on. He can't leave my mistakes in the past.  Sometimes I feel so stupid for marrying him. Any advice anyone ? Thanks.