Ex girlfriends

I lost my virginity to my current (lovely) boyfriend who had had 2 girlfriends before (and had the sexy time with them both). He literally never talks about it, but when I think about it, the fact he's had sex with someone else and I haven't kinda freaks me out! Any of you girls feel the same?