Jensen.
ProvedRLHF.one_le_tiltNormaether-catalogalgebra
Jensen. The centred partition function is at least 1.
theorem RLHF.one_le_tiltNorm{β : ℝ} {r p : Ω → ℝ} (hp : IsDist p) : 1 ≤ tiltNorm β r p := by sorry
Formalization Note Transplanted verbatim from the Aether Catalog source Algebra/RLHFMeanAbsoluteDeviation.lean; the statement is byte-identical to the source declaration, elaborated with autoImplicit disabled in the platform environment.
Preamble
-- Thm stub generated from Algebra/RLHFMeanAbsoluteDeviation.lean
import Mathlib
import Definitions.Def_Algebra_RLHFDriftCore
import Definitions.Def_Algebra_RLHFMeanAbsoluteDeviation
/-!
# The sharp alignment-drift constant is the mean absolute deviation
Domain: Algebra (convex analysis × information theory × alignment theory).
Conjecture **C1** of the drift thread said that the constant in the `Θ(β⁻¹)` alignment
drift law `‖π_β − p‖₁ ≲ c/β` is the reward *standard deviation* `σ_p(r)`, refining the
earlier reward-*range* constant; the catalogue proves
`‖π_β − p‖₁ ≤ √(2 e^{range r/β} Var_p r)/β` and sandwiches an explicit family between
`σ/(2β)` and `3σ/β`. What was left open was **the absolute constant**.
This file settles it, and the answer is *not* `σ_p(r)`. The exact first-order drift
constant is the **mean absolute deviation**
`MAD_p(r) = 𝔼_p |r − 𝔼_p r| ≤ σ_p(r)`,
with a *quantitative, non-asymptotic* two-sided estimate valid as soon as the
temperature exceeds the reward range:
* `RLHF.l1_drift_upper_mad` — `‖π_β − p‖₁ ≤ MAD_p(r)/β + 2 Var_p(r)/β²`;
* `RLHF.l1_drift_lower_mad` — `‖π_β − p‖₁ ≥ MAD_p(r)/β − 3 Var_p(r)/β²`;
* `RLHF.l1_drift_tendsto_mad` — hence `β·‖π_β − p‖₁ → MAD_p(r)` as `β → ∞`, so the
constant `1` is attained by `MAD` and by no smaller functional.
The comparison with C1 is exact, via the *deviation defect identity*
`Var_p(r) − MAD_p(r)² = 𝔼_p(|r − 𝔼r| − MAD)²`:
* `RLHF.mad_le_sqrt_variance` — `MAD_p(r) ≤ σ_p(r)` always, so the σ-law of C1 is
never violated;
* `RLHF.mad_eq_sqrt_variance_iff` — equality holds **iff** `|r − 𝔼_p r|` is constant,
i.e. exactly for the balanced two-valued rewards. This explains why the two-point
family of `RLHF.variance_constant_optimal` saturated the σ-law: it is the unique
saturating shape.
* `RLHF.mad_sq_spike_eq` — on the rare-spike family `p(true) = ε`, `r = 1_{true}`,
`MAD² = 4ε(1−ε)·Var`, so the σ-constant is off by the unbounded factor
`1/(2√(ε(1−ε)))`: the MAD law is *strictly*, and unboundedly, sharper.
The proof is a centred second-order expansion of the exponential tilt: writing
`u = r − 𝔼_p r`, `s = u/β` and `W = 𝔼_p e^{s}`, one has `π_β = p e^{s}/W`, `W ≥ 1` by
Jensen, `W ≤ 1 + Var/β²` by the quadratic Taylor bound `|e^x − 1 − x| ≤ x²` for
`|x| ≤ 1`, and the triangle inequality transfers `|e^{s} − W| ≈ |s|` termwise.
-/
open RLHF
open Finset
variable {Ω : Type*} [Fintype Ω]
/-! ## 1. The deviation defect identity: `MAD ≤ σ` and its equality case -/
variable [Nonempty Ω]
/-! ## 2. The centred tilt normaliser -/
omit [Nonempty Ω] inFormal statement
theorem RLHF.one_le_tiltNorm{β : ℝ} {r p : Ω → ℝ} (hp : IsDist p) : 1 ≤ tiltNorm β r p := by sorrySource