Toddlers and cold weather

I have lived in Miami most of my life, and recently moved to North Carolina. While the winter and fall are mild here. I’m not used to the cold at all. I shiver instantly. So I feel like my toddler is feeling what I’m feeling, and I always want to dress him in the same amount of layers... but he seems to HATE sweaters/jackets/warmth.

Like today, it’s 50 degrees out. I am in a cami, a long sleeve shirt, and a jacket with jeans. He’s in a thin long sleeve shirt and pants, he FREAKED OUT at the idea of a jacket - and I am watching him here at the playground hating the idea that he may be cold. I feel like I should have forced the jacket; but then again, his dad is this way too. Hates being too warm. Is this normal? Do some kids just tolerate the cold better?