Phase Transitions in Bandits with Switching Constraints: every policy with at most S switches has regret at least the phase-dependent rate up to a logarithmic factorResearch Paper
In many sequential decision problems, changing the action is costly or administratively limited: a retailer can revise a posted price only a few times per season, a clinical trial can change its treatment allocation only a few times, and a firm can reconfigure its production line only so often. The multi-armed bandit with switching constraints (BwSC)…