How do you clean smegma around the labias and clit?

I have it and I can't clean it unless I use a bit of soap but I've heard that using soap is bad down there so how do you clean it without soap?

Btw it's not an infection.. Ive been checked out and my gyno said it was build up of discharge but didn't say how do i clean it....