Should I leave?

I know it's only been about 8 days since we officially got together but I've known him for him for ages and he is a great guy, on the outside.

We are both super into film and photography (I study film, he majors in photography) and he runs his own film festival. We are both really into adventure sports and have been seeing each other twice weekly for months to go rock climbing or to go on some other adventure. He is really into sustainability and is going to talk at an international conference about sustainability and his volunteer work. I'm really into sustainability as well.

Long story short we have very similar interests and humour.

However he doesn't seem to want to commit to anything, when we talked about his feelings he said things like "I don't know what's going to happen in two or three weeks" - I told him that I will not sleep with him until I feel comfortable and he came back with something along the lines of "does that mean that we won't get to third base before then?". There have been other things along this line of thought. I end up feeling sad and like a have to protect myself as he doesn't want to move slowly, which I would like to do. He is also a relatively flirty person and hasn't really stopped flirting with other people yet.

He doesn't want to hold hands, but I suppose we have only been together for a short time.

I'm not sure how I feel. I feel like I'm making very big decisions way too early on and I kind want to start again but that's probably not an option. What do you think?