Should I break up w/ him?

Aight, back story:

Me & my man have been dating for 7 months now, off and on. If we never broke up in the first place, it would've been a year already. I broke up with him for huge reasons. (Twisting my best friend's arm, and she's a lady.. Loss of trust, for sending my vent messages to the guy I was venting about.. like who does that? I thought I could vent to him safely.) I almost broke up with him in May for threatening to replace me with a pornstar if I didn't send a picture of myself. Also, for looking at his FRIEND'S underwear, even telling me it was tight on HER.. The fact that she is close to being his sister does not put me at ease because he called her hot and claimed she was his girlfriend in the summer last year before a few weeks before we began dating as a prank. She's also a cheerleader. Who's looks I am jealous of.

Moving on:

So for the past two weeks, he's been leaving me feeling extremely anxious because he RARELY texts back. He reads, but usually doesn't reply. He tells me he's busy, but when I call he's just playing video games. Now, when I call he tells me that I'm just annoying his family and I should stop being clingy. (So now I've stopped calling.. and don't text him as often because I feel like shit worrying about causing problems between him and his family because of me.) I tell him how anxious he's making me feel, but half the time he clicks on it and doesn't even read it and doesn't mention anything until I bring it up. His replies are the same things, like routine. Me and my family have a history of anxiety disorders, so maybe I'm just overreacting. Our conversations are literally only a few minutes. I feel like I'm the only one putting in effort. I ALWAYS initialize conversation. I told him if we broke up again, it'd be the last because I don't want to be wasting my time on one boy who isn't even going to meet my needs when there's other guys trying to hook u time to time. I love this boy too much. I have his hoodie, a skeleton plush he gave me in 7th grade, (my fave mob from minecraft) and a $72 REAL pearl necklace and bracelet. He's been my best guy friend since 4th grade. He spent so much on this relationship a long time ago, and I feel bad thinking about how that money, and friendship goes to waste.