Mold in washer

I have a front-loading washing machine and over time, the plastic rim has formed mold. I've tried cleaning it but it won't come out. It's like the mold that forms in shower grout. I'm washing all my baby clothes, blankets, etc and they end up touching the mold spots when I pull them out of the wash. It's hard to avoid it.

Do you think this will be harmful for the baby to wear clothes and use blankets that have touched those mold spots?