Lose virginity too soon?

I'm dating a boy 3 years older than me. A lot of people give me shit for it. But I truly love him. He's my bestfriend and the person I want to spend the rest of my life with. I'm 15 and I lost my virginity to him after only dating for a month. At first I thought I didn't want to because I was scared. I told myself I'd wait till marriage. But I thought about it and how could I possibly not be happy with losing it to someone I love so much. So I went through the with it. I lost my virginity to him. I'm still scared though... I know that when you lose your virginity you get attached to that person. And I'm so scared to have my heart broken by him... I'll be completely ruined if I lose him..