Well, if a player has some sort of combo deck, getting milled can be bad if it discards all the copies of a key component of the combo (unless he has a way to get them back from his graveyard). So even if on average it has no effect, in any single game it can be an instant loss for that player.
Granted, milling only because you are hoping for that seems like a pretty terrible idea.