He gets upset

I am so lost right now, I hold my boyfriend in the highest regard but he gets upset over things that usually wouldn't even warrant a conversation.

And if I get upset for something, he gets even more upset and ignores me and I end up apologizing first because I can't stand being ignored and he knows that.

I don't know how to bring this up to him but I am so tired and reaching the end of my rope, any tips on how to talk about this without getting into an argument?