Frustrated all the time

I've been feeling frustrated with my SO a lot lately. Sometimes when we talk on ph he doesn't seem like I got his attention. Sometimes I feel like I was so lonely and unwanted. I don't know if it's just me or he didn't really want to talk to me that much. I tried to talk to him about that but then after a day or two he just returned to his ignorant self. This is my second serious relationship. The first one lasted for 4 years. I left my ex becuz he lied a lot to me to everybody else. When I met my SO I was really glad that he's not that type of person and I was grateful for that. He has other good qualities but the problem is he doesn't care about me that much. At least that's how I feel like most of the time. Am I being too needy? Sometimes I got so lonely I even tried to call it quit but again I'm afraid if he's the best I can find. I am so confused whether to quit or change my attitude.