Optimal and Adaptive Non-Stationary Dueling Bandits Under a Generalized Borda Criterion

arXiv:2403.12950v1 Announce Type: new
Abstract: In dueling bandits, the learner receives preference feedback between arms, and the regret of an arm is defined in terms of its suboptimality to a winner arm. The more challenging and practically motivated non-stationary variant of dueling bandits, where preferences change over time, has been the focus of several recent works (Saha and Gupta, 2022; Buening and Saha, 2023; Suk and Agarwal, 2023). The goal is to design algorithms without foreknowledge of the amount of …

abstract arm arxiv change criterion cs.lg feedback generalized stat.ml terms type