do you exfoliate your face? what would happen if you stopped?

I never exfoliate, but it's because my skin is dry and sensitive.  I am wondering if exfoliating will help, or just make it worse?