baby acne

Steph 🇦🇺
I am a breastfeeding FTM to a 3 week old. He currently has baby acne and people keep telling me I am causing it by eating too much sugar. I really don't think I have been having a lot of sugar but now I am worried that I am causing issues for my son :( I have googled baby acne and can't find anything that says it is linked to my diet.... Is anyone else having this issue or have any information on the topic? I personally think he looks adorable and I am sick of people making comments.