Should I stop talking to him?

So I'm talking to this guy and I really like him he's perfect in a lot of ways but I don't really feel he can give me the time I want. Not to say I don't understand he works and has things to do but I've always been told that if someone really wants to spend time with you they make time for you and he hasn't done that. He's come to see me once and I feel like he only did that because he wanted sex even though he denies that. My question is knowing that I don't think he has time for me and that it will most likely cause arguments or hurt should I just stop talking to him now? I know even seeing him once a week won't be enough for me and if that's all he can give me I'd rather he just keep his time and invest it elsewhere. All it does is make me upset and honestly hurt that he couldn't manage to see me once in the 3 days off he had in a row like I don't feel as if he will even try to make time for me. So keep talking to him? Or waste my time and his trying to see if I will be happy with the scraps he's willing to toss my way?