"Not looking for a relationship"

I've been hanging out with a guy recently. We talk for hours, cuddle, and do couple-ly things (he's bought me lunch, given me rides home from work, replies to my messages -- sounds small but for him it's something big, he's comforted me through panic attacks, and we had sex once.). He's new in my life, but we have several mutual friends who've known him for over 10 years. They all say he's a really great guy, not a fuck boy, and not "just the hookup" type. And, they've all seen us together and have said that they really think he has strong feelings for me based on the way he acts around me.

We had a talk a few weeks ago where I opened up about my feelings for him and he didn't say much other than that he wanted a relationship, but was scared -- his last breakup was a really, really, bad one. And, then, last night I asked him to kiss me goodnight and he said no. I confronted him about the mixed signals -- just a few minutes early he'd been cuddling with me, and just a few hours before that we'd been the most public we'd ever been and it was all initiated by him. And, he told me he wasn't looking for a relationship because he was still hurt from his last one.

I'm struggling with the decision of whether to stay and give him time, or whether to just leave. This decision would be made a lot easier if I knew for certain if he did have feelings for me or not, but he's never stated either way.