Help I need an opinion

Okay my boyfriend and I have been together for two years. But after the first while there’s been a lot that’s stopped us from hanging out so often, school, work, and my mom didn’t want us hanging out more than once a week (literally a whole other issue) anyway lately things have been a mess and I don’t know if I’m wrong cause it’s my fault we never hang out or if I’m ignoring bigger problems.

So every time we hang out he always wants the whole day which I try to give him but hell be upset if something holds me up and I can’t be there till like 1 or 2 and when I leave he’ll get really upset not like cute upset like actually upset. A couple weeks ago we were supposed to hang out but something happened and he was depressed for like 2 weeks and I got us back on track but he was like “if you bail on me tomorrow I can’t promise I won’t get back to how I was before” which makes me feel like he knows the emotional impact that had on me to try and make him happy and idk and he even when I end a phone convo short or even just end the convo he gets upset.

Basically it’s to the point where I’m constantly worried how he’s feeling like if we barely talked that day I scramble cause I don’t want him to be upset. I don’t really feel like I want to talk to him or see him but it’s more like I have to or he’ll go into some depressed spiral and I told him to see a therapist but he absolutely refuses.

Please help I don’t know am I in the wrong because it’s my fault we barely see each other or is this relationship not healthy. More importantly we’ve been together 2 years Should I try to patch things up or should I break things off?