how soon is too soon

I have just gotten out of a horrible 9 yr relationship and I've been broken up for about 6 months, I have met this guy and we have been friends for awhile and we just now have expressed more than friend feelings towards each other, and so far everything is great. But we are not officially dating yet.... hopefully one day we will be. But we have slept together for the past 2 weeks but haven't had sex. Me and him want to but I'm scared it's too soon. Plus I've only had one partner my whole life and I'm scared of putting myself out there, he is a lot older(which doesn't matter to me) but he has had a lot more experiences than me. When things get hot and heavy I want to but I hold back because I think it's too soon. So my question is how soon is too soon? lol