Car seat staying in car??

My baby is due in 3 weeks. The car seat base is in my car. Is it okay if I have the car seat in my car too? It’s very cold where I live.