Baby hot fast ..

Are you guys swaddling with hat or without hat when it's sleep nap time for new borns? I been swaddling with hot and when I go to get him he is hot to touch ... but with no hat can he catch a cold keep the house 69-72 ish