Entropy lower bound from a scaled atom bound
Provedmme_entropy_lower_of_scaled_atom_boundregional-extractiontensor-complexity
For a nonnegative finite probability distribution whose atoms are at most b and any positive a, the natural-log entropy is at least log(a)+1-ab. The proof applies log(ap) <= a*p-1 and sums the weighted inequalities.
Preamble
import Theorems.Thm_mme_regional_mass_entropy_algebra import Theorems.Thm_mme_released_116_regional_split_mass import Definitions.Def_mme_regional_split_entropy_data open BigOperators MME MME.RegionRate MME.RecursiveThinSplit set_option autoImplicit false universe u
Formal statement
theorem mme_entropy_lower_of_scaled_atom_bound {W : Type*} [Fintype W]
(p : W → ℝ) (a b : ℝ) (ha : 0 < a) (hp : ∀ w, 0 ≤ p w)
(hmass : ∑ w, p w = 1) (hbound : ∀ w, p w ≤ b) :
Real.log a + 1 - a * b ≤ entropy p := by sorrySource
Exact integer histograms of the released 116 profile, the elementary logarithm tangent bound, and the pinned mathlib certified logarithm-of-two estimate.