Underwear sniffer??

Starting off with saying I lived with this guy as my roommate for about a year and half. I had a boyfriend at the time. We later moved to different places and then reunited later. We just started dating a few months ago but I recently found out that when we used to live together he would go in my room while I was gone and smell my underwear and then wrap them around his penis and jerk off with them.. I love this guy, but I’m not really sure how I’m supposed to feel about this..