How would you respond?

I'm friends with this guy to whom I've told before that I liked a different guy. Well he keeps asking me to dinner. But I don't want him to get the idea that it's a date and that he has a chance because I don't like him like that. We live in different cities so I've told him that I was busy doing stuff in my area and don't wanna drive anywhere far hoping that he'd get that I'm not available for dinner this weekend. And then he responded by implying that he can come closer to me so I won't have to drive far. So should I just be blunt with him and tell him I'm busy, since he can't get the hint? Ugh men.