Guy won't have sex

I have been seeing this guy for a few months and he wanted to wait to have sex for a while til we knew each other better because he's not a one night stand kind of guy which is great, but now he's starting to talk about sex in general constantly and I don't know what to think. He's acting super horny but won't make any moves. We have great chemistry and our physical relationship that does exist is wonderful, but He won't even have me over to his house because he's afraid we would go too far to fast. I don't know if I should talk to him about it or just pursue things and see how it goes? Any thoughts would be appreciated.