Acne ?!

Would drinking milk break my skin out ?!

I stopped drinking milk and I drank some and noticed my skin started to break out the only thing I changed. And I know dairy can be a problem with acne