Being told constantly my son looks like my brother:/

Ok so me and my older brother are Irish twins born exactly 11 months apart. My bday is February 14 and his is March 14. So we look like twins basically... When I don't wear makeup that is.  Well ever since my son was born in May everyone... And I mean EVERYONE has been telling me he looks like my brother. It makes me upset because I look like my brother, so that would mean my son looks like ME. Anyone else have this happen to them and feel the same way about it? Here are some pics of me and my son and my brother and his daughter to show what I mean.