losing confidence

my so and so were arguing I called him a name out of anger (i really didn't mean it) and he got mad and said "I have a lot of fucked up shit to say about you but I would never do that to you" that made me feel like he has a list of negative things he thinks about me and that really made me lose confidence being the fact that he took my virginity, so his opinion about me matters. I can't get his words out of my head.