Milk... HELP!

Vanessa
I'm currently on my 4th month TTC with no luck. I've been reading up on things but the one thing I'm confused on is whether or not to have dairy. Especially milk. I keep reading things that say a small amount of whole milk is encouraged for fertility, other things say stay away from dairy COMPLETELY. Anybody know anything about this???