The Ladder: A Reliable Leaderboard for Machine Learning Competitions

The organizer of a machine learning competition faces the problem of maintaining an accurate leaderboard that faithfully represents the quality of the best submission of each competing team. What make