Unit-ball linear bandit hypercube regret-sum lower bound
ProvedBanditAlgorithm.linear_bandit_unit_ball_hypercube_regret_sum_lower_boundLet be positive integers with , let
and let be any stochastic linear-bandit policy supported on . Put
For each sign vector , let , and denote by the expected regret of after rounds in the unit-variance Gaussian linear bandit with parameter . Then the sum of the regrets over the whole parameter hypercube satisfies
Equivalently, the average regret over the hypercube is at least . This is the quantitative hypercube-averaging core of the unit-ball minimax lower bound and is reusable independently of the final finite-averaging and constant calculation.
Formalization Note Sign vectors are indexed by Boolean-valued functions on Fin d; false represents and true represents . The factor is written as the cardinality of that finite Boolean function space.
import Definitions.Def_LinearBanditProtocol open Matrix MeasureTheory
theorem BanditAlgorithm.linear_bandit_unit_ball_hypercube_regret_sum_lower_bound
{d n : ℕ} (hd : 0 < d) (hdn : d ≤ 2 * n)
(π : LinearBanditPolicy d)
(hsupp : IsSupportedLinearPolicy
{a : Fin d → ℝ | a ⬝ᵥ a ≤ 1} π) :
let Δ := Real.sqrt ((d : ℝ) / (48 * n))
(Fintype.card (Fin d → Bool) : ℝ) *
(n * Δ * Real.sqrt d / 4) ≤
∑ σ : Fin d → Bool,
linearBanditExpectedRegret
{a : Fin d → ℝ | a ⬝ᵥ a ≤ 1}
(fun i ↦ Δ * if σ i then 1 else -1) π n := by
sorry