Help! heat rash?

bailey
For the last couple days my baby has had bumps on his arms, and random spots on his stomach. I'm a first time mom and i have no idea what to do. I'm not too sure if it's bad heat rash or something else. I've been dressing him in a short sleeve onsie and a thin swaddle since it's chilly in the house at times.