This is a very complex topic and you wont get a definative answer. Its like asking "is global warming man-made?". You'll get compelling arguments both ways.
On a personal level, I drink milk, but not as much as I used to. Me and my old housemate used to drink shitloads when we were hard core weight training. I used to chug milk on the way to work, and throw the carton over my shoulder into the back seat of my holden commodore. I got pulled over by cops once for an unrelated matter, and they said "excuse me, but why do you have so many empty milk cartons in the back seat of your car?"
My response "Err, I drink a lot of milk???????" DICKHEAD what do your think??????????
Anyway I digress,
I know that Chinese Medicine says excessive dairy can contribute to the concept of "dampness". After all, why in nature are we drinking the "milk" of another species???
I started to get big signs of dampness, have cut down the milk and now the dampness is subsiding somewhat. I'm sure its like anything, food is medicine or poison, depending on the quantities you take.