Anyone else have a IUGR baby?

My LO was born at 36 weeks 6 days and I had IUGR, gestational diabetes and preeclampsia during my pregnancy which is why I was induced a bit early. Because of the complications I had and him being born slightly early he was 4 lbs 4 oz at birth. At his two month check up he was 8 lbs 2 oz. I constantly get the "OMG your baby is so small!!" comments and while I know the person saying it is not intending to offend me or hurt my feelings, I can't help getting upset. I feel like he's always going to be smaller than other babies and then kids his age, and it's my fault. Don't get me wrong I'm so thankful he's healthy but I don't know how to get over feeling a bit sad when people constantly remind me how small he is. Anyone else with a IUGR baby and felt a similar way?