Boyfriend issues??????? Help need advice!!!!!!

Ok so at the current moment I'm in a relationship  . I love my boyfriend but I know he is not "the one". I'm very unsure of what to do. And our relationship is very complicated because of parents and other issues, and he's not good at communicating at all. When something goes wrong in his life or his mom says something to him about me, he literally will ignore and only text me back once in a while and give me excuses. I'm not sure if I should stay with him. I love him so much but I know for sure he's not "the one" and he's very complicated and stresses me out so much. Also I feel like if I break up with him. Nobody will want to date me. So I feel like I should stay with him because he's probably the only one out there that is going to like. I'm very insecure by the way. And I really don't want to break his heart but he puts so much stress on me and makes me have a lot of anxiety all the time. I know he doesn't mean to but it's not good for me. I'd like your opinions and ideas of what I should do 
UPDATE: 
So i didn't break up with him I wanted to work it out with him but after a couple of weeks he started completely ignoring I hadn't heard from him in a week. Well he finally texted me and we had a conversation and I broke up with him. I was really tired of the way he was treating me.... I've been single for 3 weeks now