Too early for sex?

How soon is too soon to have sex with a guy? I have been seeing this guy for a couple of weeks and  want to take it to the next level but I don't want to ruin anything that we have. We've talked about sex and he says it won't ruin anything but I highly doubt that. I need some advice ladies.. like now.. I'm horny lol! Btw, I'm 23.