Interactively Optimizing Information Retrieval Systems as a Dueling Bandits Problem

We present an online learning framework tailored towards real-time learning from observed user behavior in search engines and other information retrieval systems. In particular, we only require pairwi