Tongue

How do you get rid of patches of white or other colors (pretty sure it's caused by food) on your tongue? I've tried scrubbing my tongue with a toothbrush but it won't come off. And it's not thrush or anything.