Mixed Signals?

So I went on a date earlier this evening. I thought things were going really well, and I thought there was a mutual attraction. During a lull I said, "Can I kiss you?" I was surprised when he said "no". I didn't push it after that, but we're both adults, and I know that he isn't conservative. Did I just read his signals wrong? He said he wanted to see me again. I'm a little confused.