How would you feel?

So my fiancé and I were suppose to get married soon. Well we were arguing a lot we have two kids and life has just kind of put a lot of stress on us both. I did freak out a few times thinking he was cheating just my mind getting to me. He said he doesn’t feel it’s the right time for the both of us to get married. At first I freaked out feeling rejected but every part of me wants to work it out. Everyone keeps telling me I’m dumb for still being with him and that I’m obviously not the one for him if he won’t marry me. That people have problems but they don’t just call of a wedding over some arguments. I feel partly that’s true but I also feel stuck? What would you do? Like am I really dumb for staying even though we were arguing like crazy. I feel hurt over the wedding but honestly not sure it was a bad call I want us to be both happy that day. Do you think you can do something like that and down the road get married? I mean what is the right time? I’m so stuck and confused?