relationship advice

So I'm currently talking to two different guys; one I've been talking to for 3 months now and the other just barely a month. The first guy I actually went on a date with (it was really awkward but he was really cute about it) and the other I've never met up with yet. The first guy I've only ever really drunk texted and called meanwhile the other I have actual conversations with. My problem is the first guy somehow got the impression that we're a thing and has drunkenly admitted that he has real feelings for me. I've already told him a few times now that I don't want anything serious but he insists we continue talking as friends but I don't think that's the case. Would it be bad if I ghosted on him??