Equation (17.7) / Exercise 17.4: the permutation induced by sorting y maximizes ∑ᵢ vᵢyᵢ over permutation vectors v
ProvedUnderstandingML.induced_permutation_maximizesrankingrearrangement-inequality
Equation (17.7). Let be the set of all permutations of encoded as vectors. Then .
Formally (the rearrangement inequality): for every permutation that orders the indices as does (monovariance) and every permutation , .
Preamble
import Definitions.Def_UnderstandingML_Multiclass open MeasureTheory open scoped InnerProductSpace
Formal statement
namespace UnderstandingML
/-- **Equation (17.7)** (p. 241, Exercise 17.4). The permutation `π(y)` induced by sorting `y`
maximizes `∑ᵢ vᵢ yᵢ` over all permutation vectors `v`: for every permutation `σ` that orders
the indices as `y` does (`σ` monovaries with `y`) and every permutation `τ`,
`∑ᵢ τ(i) yᵢ ≤ ∑ᵢ σ(i) yᵢ` (the rearrangement inequality). -/
theorem induced_permutation_maximizes {r : ℕ} (y : Fin r → ℝ) (σ : Equiv.Perm (Fin r))
(hσ : Monovary (fun i ↦ ((σ i : ℕ) : ℝ)) y) (τ : Equiv.Perm (Fin r)) :
∑ i, ((τ i : ℕ) : ℝ) * y i ≤ ∑ i, ((σ i : ℕ) : ℝ) * y i := by sorry
end UnderstandingML
Source
Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press 2014, doi:10.1017/CBO9781107298019, §17.4.1 p. 241, Equation (17.7) and Exercise 17.4 p. 247
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.