Itchy inner labia

So between my lips, right next to the hood of my clit, sometimes it will be so intensely itchy. I've been scared before that it was something but this has been going on forever, since I was a young teenager (I'm 20 now). I told my lady doctor about it and she's looked at it and summed it up that it's probably just from sweat and a yeast like build up (not a full blown yeast infection). There's no sores, it's not painful. It just itches, especially after I try to shave the hair that grows there. Anyone else have this?