Appendix E.1 — coefficient energy and empirical statistics
ProvedDAREx.CoefficientEnergyIdentityNotation. The fixed-cardinality coordinate set is , with ; are real coefficients, their squared energy, and their empirical statistics. For and any deterministic real coefficient vector , define , , and . Then
These are statistics over coordinates, not moments over random pruning. Formalization note: direct algebraic identity used in the source; no coefficient sign assumption.
Source: Deng et al., DARE the Extreme: Revisiting Delta-Parameter Pruning For Fine-Tuned Models, ICLR 2025, arXiv:2410.09344v2, https://arxiv.org/pdf/2410.09344v2, Appendix E.1, PDF p. 31, unnumbered identity immediately after the Berend–Kontorovich paragraph; Section 3.2, PDF p. 5, Theorem 3.1 definitions.
import Definitions.Def_DAREx_Model
namespace DAREx
theorem CoefficientEnergyIdentity :
∀ (n : ℕ) (c : Fin n → ℝ), 0 < n →
energy c = (n : ℝ) * (empiricalMean c ^ 2 + empiricalVariance c) := by sorry
end DAREx
Read-back
What the Lean code literally says, in plain math · inherited model (exact model identifier unavailable)
This open theorem asserts that, for every natural number and every real coefficient family , where , if , then , where and , and in real arithmetic is the corresponding real number. The empirical variance has denominator , not . There is no sign, nonzero, normalization, or probabilistic hypothesis on the coefficients. The case is excluded by the positive-size hypothesis; and the identically zero coefficient family are included, with variance in the singleton case. The supplied proof slot is a placeholder; no completed proof is supplied.
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.