Would you be annoyed?

So I’ve been with my boyfriend for almost two years now and within that time I’ve lost almost 45 pounds. EVERYONE who’s ever met me and sees me now comments on my weight loss being that I went from a size 12 to a size 2 but my boyfriend swears he doesn’t see a difference. Whenever it’s talked about he says he’s always loved my body and that’s probably why he doesn’t see a difference but if he loved my body then wouldn’t he have noticed? Am I the only one who finds this annoying?