How do I break up with my fiancé?

I have been with him for almost 4 years. We have been through a lot including a miscarriage and a chemical pregnancy, from being broke to having money to travel around. I have endured a lot with him and so has he. But our relationship is coming to an end and it hurts me more and more. We are on vacation right now and everyday since we got here with his extended family I have cried every night. The way he has treated me is insane and he does this all the time at home but since we never see each other at home i haven’t noticed till now that it’s not what i want anymore. He proposed to me 2 years ago and it’s about to be 3 and he still hasn’t said anything about getting married or having a wedding i have tried and planned I’ve called and even had a date set he has managed to convince me to wait and wait. I am done waiting I just don’t know how to do it because i am scared and i know it’s gonna hurt like hell. We live together and the only time I feel his love or affection is during sex. I don’t have sex anymore we only do it when he wants to and it’s only once or twice a month. I have tried and tried but I’m tired.... I also have tried to talk to him about how I feel but he doesn’t care to listen.

Edit: I cried and spoke to him calmly about how I felt being in this relationship he said I always have something to complain about and turned around and fell asleep.