HELP! SEX GIRL CODE!

im currently 17, and my birthday just passed, my boyfriend and i were on the phone and he was in the mood ( you know what i mean) and I was super tired because of school and college classes, ( we are both virgins) so he kinda like told me in a rude matter 'you can keep your virginity to yourself' through the phone before my birthday, ever since I've been acting awkward and quiet and he simply keeps telling me it was a joke. I'm very self conscious about myself and when he said something like that it made me think all over the place and I don't feel good about my body as much anymore. I was listening to like soothing sad music and I told my boyfriend and he's like 'you're not ever going to drop it.' He's really sweet and family oriented he's turning 19, and we've been together since 2016. I need answers and feedback!