Should you tell someone you want to leave because you are unhappy?

Been in a relationship for 2 years, very unstable relationship, left home at 19, moved miles away from family, have been disconnected from them due to partner not feeling that family visits are important, have been carrying house responsibilities all by myself with some help here and there but I work literally all the time to pay bills and then spend weekends cleaning and sleeping to recover mental health. My mental health is ridiculously awful at the moment, family is worried asking me to come home of fears I'm not being cared for mentally and emotionally. Have a ton of stress most of the time, feel alone, sex has become a way to release tension and sometimes doesn't help. He makes me feel small at times . But don't get me wrong we have good days, I won't lie and say it's always bad, we have good moments, but my pros and cons list, the cons outweigh the pros. I've come to a decision that I would like to go back home to my mother, but whenever this is mentioned I'm told I'm selfish, I'm leaving him in a bad spot (since he depends on me to carry the household, I'm so dumb I've realized this now) , that I'm just like every other girl who has given up on him so on and so forth. Many people would say "should have stick with him until he got on his feet" I've been with him for 2 years! He has had 2 years to figure something out while I've cared for the house, and I would say this and his response would be "if you care for it why are we bad and bills high" and this irritates me because I work minimum wage and pay for bills that's being used by more than 1 person. And yeah sometimes I would want to use the money I work for to buy myself things and then I'm called selfish again. My family wants to buy me a ticket next month to go home and just leave without saying a word since everytime I try talking about it I'm told a bunch of things that makes me stay . (I'm easily muniplated and I know that now as well) I love him, I really do, but this life is always a struggle and I'm always forced to go work to fix things when I'm not mentally okay and really need my mother. He tells me I'll always be on my mother's titties and will never grow up . But truth is I was 19 , only 3 years after being diagnosed with bipolar disorder (even though I don't believe that) but I do know there's something wrong , and I left in midst of an episode that influenced me to make an impulsive decision. And now I'm in a life I don't want anymore. I think I'm just asking for advice. My friend said leave and leave him a note but I feel that's wrong. I feel paying this house next rent and telling him I'm leaving due to my own personal reasons . But I'm scared of how that will go. I've been so depressed this past few days that I don't know what to do. Sorry for the long post