Virginity

Well I been knowing this guy for two years and we recently just started dating. He's done had sex already but I'm still a virgin, I feel that we might be moving to fast. He's done fingered me and stuff like that now he's talking bout having sex. But since we are young I don't want to be dumb and regret losing my virginity to someone I don't know will be in my life forever. I'm not sure what to do at this point....