Soy and fertility ?

Michelle • 33 year old from Australia , currently pregnant with baby #4 a boy..miss 7 mr 5 miss 1 and prince due 26/01/17
So I read on another app that to much soy is not good for fertility . Has anyone heard this ? I'm a soy milk drinker only by choice though I don't have any intolerance. I only started when I was pregnant with my youngest who is 8 months . But wondering if I need to stop in order to conceive easier?