Soy milk can cause lower sperm count...

My husband is lactose intolerant. He use to drink Lactaid but changed to Soy milk almost a year ago. He said he read an article today saying Soy milk can produce amounts of estrogen which can lower testosterone intern lowering sperm count! I don't know if the affect is minimal or major but I am not risking it! I will b dumping out the soy and getting Almond milk for him tomorrow!