Dry skin on outer labia

I only wash the outer labia parts when I shower, with a tiny bit of no fragrance soap and water. Lately I’ve been itchy down there, everything looks normal but the skin feels dry/irritated. I’ve also been wearing a pad for the last few days and I think that might be contributing to the itchiness. Is this a problem? Is there anything I should do about it?