Too soon?

So I lost my virginity over a year ago. I dated the guy for a month, and was with him officially for two months when it happened. After it happened, he broke up with him. That has made me really nervous and insecure to have sex again. Now, I'm with a new guy. We've dated for three months and have only been official for a week. I want to have sex with him, but I'm scared it might be too early. Any advice?