What do I do?!

So I've been seeing this guy for a couple of months who is a few years older then me. We only see each other at night because I have school and he has Uni, I really like him and we have talked about touching each other (which I have never done) but every time it comes to it I back out. I want to do it though. Should I wait? Should I be worried that we only see each other at night?