Trouble in Paradise

I need some help/advise. My fiancé and I have been together just over 3 years and I love him more then I can express but, every single day we fight about something and it's my fault these fights start. I get easily frustrated with him over the stupidest of things. I know I'm pushing him away but I don't want to lose him. Can someone give me any advice pointers on how to save my relationship