Smell down there

Ok even when I shower and wash down there (never with scented soap, sometimes just water), when I’m drying it I smelt the towel and it smelt really bad. It’s been like this for the the longest I can remember (maybe 3 years?) should I be concerned? Should I go to the doctor? Does everyone’s smell like fish?