Am I being too stingy?

My son is not 2m and everyone seems to want to give him things like ice cream. My grandma, mother in law, and even my husband doesn’t seem to have a problem with it. My oldest sister was fed chocolate ice cream when she was two weeks old (much to my mother’s dismay) but she loved it and didn’t have any negative reactions. I just don’t want to give him something that could make him sick since he already has way too much acid reflux. Am I just being too overprotective and stingy? I don’t mind being wrong I’m just so scared of messing something up, being a first time mom.

Edit: thank you all for your support! I know my family don’t have malicious intent, but they did back off when I told them I don’t want him having anything but milk until he’s old enough. We still love to visit grandmas and grandpas with that renewed understanding!