Rational dyadic bounds for finite entropy
Provedmme_entropy_dyadic_boundsmatrix-multiplicationregional-extraction
For any nonnegative finite function, dyadic logarithm bounds give upper and lower entropy estimates, including zero atoms. The full matrix exponent bound remains a separate obligation.
Preamble
import Theorems.Thm_mme_dyadic_neg_log_bounds import Definitions.Def_mme_regional_entropy_rate_data open scoped BigOperators open MME.RegionRate
Formal statement
theorem mme_entropy_dyadic_bounds {W : Type*} [Fintype W]
(p : W → ℝ) (hp : ∀ w, 0 ≤ p w) (k : W → ℕ) :
(∑ w, p w * ((k w : ℝ) * (693147180 / 1000000000 : ℝ) + 1 -
2 ^ k w * p w)) ≤ entropy p ∧
entropy p ≤ ∑ w, p w * ((k w : ℝ) * (693147181 / 1000000000 : ℝ) - 1 +
(2 ^ k w * p w)⁻¹) := by sorrySource
Kernel-checked regional count identities and exact extraction with empty regions.