Proof of Theorem 3.14, p. 283 — ‖x*_k‖² = Σᵢ (i/(k+1))² ≤ (k+1)/3
OpenConvexOptAlg.LowerBounds.thm_3_14_norm_boundconvex-optimizationlower-boundsp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-bookp2o-v1
Let and let have coordinates for and beyond. Then
The bound controls the distance from the starting point to the minimizer in Theorem 3.14.
Preamble
import Mathlib import Definitions.Def_ConvexOptAlg_LowerBounds_Defs open scoped InnerProductSpace
Formal statement
namespace ConvexOptAlg.LowerBounds
/-- Bubeck, arXiv:1405.4980v2, proof of Theorem 3.14, p. 283: for `k ≤ n`,
`‖x*_k‖² = Σ_{i=1}^{k} (1 − i/(k+1))² = Σ_{i=1}^{k} (i/(k+1))² ≤ (k+1)/3`. -/
theorem thm_3_14_norm_bound (n k : ℕ) (hkn : k ≤ n) :
‖xstarK n k‖ ^ 2 = ∑ i ∈ Finset.Icc 1 k, (1 - (i : ℝ) / ((k : ℝ) + 1)) ^ 2 ∧
∑ i ∈ Finset.Icc 1 k, (1 - (i : ℝ) / ((k : ℝ) + 1)) ^ 2 =
∑ i ∈ Finset.Icc 1 k, ((i : ℝ) / ((k : ℝ) + 1)) ^ 2 ∧
∑ i ∈ Finset.Icc 1 k, ((i : ℝ) / ((k : ℝ) + 1)) ^ 2 ≤ ((k : ℝ) + 1) / 3 := by sorry
end ConvexOptAlg.LowerBounds
Source
Bubeck, arXiv:1405.4980v2, proof of Theorem 3.14, p. 283