Nipple differences

My left nipple has recently become wrinkly and rough while my right has stayed firm and smooth. Should I be worried?