Ovulation low fat milk consumption

Just read a article here in Glow about a study linking low fat dairy consumption to anovulatory infertility. Has anyone had their doctor, gynecologist or fertility specialist recommend not eating non-fat dairy while TTC? What have you heard? My doctor told me to continue eating low-fat dairy.