Neck propped up or not?

My son will be a week old tomorrow and I have his head propped up when he sleeps. He actually got chocked on his milk this morning and started spitting it up after I layed him down. Who else props their babies head up?