My first not his

My boyfriend and I have been together almost 2 years. He was my first. I wasn't his first. He has had many partners in the past. I try not to let it get to me because I know he loves me. But I just feel like he will always be more special to me than I am to him. Anyone else feel this way?