How early is too early

Okay so I recently just met a guy about two weeks ago we went on a really wonderful date. We already openly had a conversation about sex and he's expressed that as far as that goes it's up to me. I know two weeks is virtually nothing and I don't plan on having sex with him anytime soon. I'm still a woman with needs but I fear having sex too early ( a month or two in ) could complicate the relationship. I haven't had to many serious relationships and it's way too soon to tell in this one. But id like to hear from women that have been in my predicament. I'm sure if you guys are both ready the time will be right but I've been with so many guys that just skip out as soon as we get intimate I guess I'm just in experienced as far as the whole inimatcy thing goes. He's willing to be patient with me. Just want some advice.