Traveling long distance with baby?!?!

So my fiancé just got news that a family member of his passed away. We live in North Carolina and our family is in N.Y. that's about a 10hrs drive or a 2hr plane ride. He wants to go but I'm nervous about going with our 6months old. The weather over there is colder than where we live. It's in the 20's there during the day but in the 40's, 50's and even 60's over here. She has a little cold right now and I'm one of those paranoid first time moms. Can anyone tell me their experiences with their infants. My stomach turns just thinking about traveling.