Am I crazy or being an asshole??

So to focus more on my mental health, I decided to take a break from my relationship with my partner. A lot has been going on, and my mental health has only been deteriorating more and more as time goes on. The relationship hasn’t helped very much and it’s honestly been a part of my stress. When I spoke to my partner I did my best to be open and honest about why I want this break. I also did my best to make sure they were on the same page as me in terms of what a “break” means. The break meant cutting down on the romantic gestures and flirting. So about a week ago my partner sent me pics of them shirtless and I made it clear I wasn’t exactly appreciative of them, considering we’re on a break. It wound up turning into a conversation about our relationship and wether or not I still love him(his pronouns are they/him/he/them). I blew up. I was upset because it feels like despite expressing what our break is and making every effort possible to be sure we’re on the same page, it still feels likes we’re not. Another situation like last weeks happened again today. I decided on this break about a month ago and he agreed on it for the sake of my mental health. Tomorrow I’ve decided to meet with them and talk face to face about the terms of what’s going on again. I’ve been doing my best to get therapy, and each day is a struggle. It’s hard to give someone love you barely have for yourself, or anything else for that matter. My family is aware of my mental health dipping but they aren’t aware of how severe it really is. I can admit I have problems with avoiding confrontation, but I’ve done my best to remedy this issue. I honestly have no idea how else I can get the point across now, I want to be friends with him but honestly right now I can’t do this. I can’t keep pushing myself for the sake of a relationship. There is a lot of love and caring for them, but I need to love me too.