How do I stop arguing with him?

This is such a shitty habit that I need to break, but how do I stop starting arguments with my boyfriend? He's so lovely and I just start arguments for the most stupid reasons and I'm worried that one day he'll turn around and leave, even though he says he's not going to...