Two positive coordinate probabilities bound the entropy penalty
Provedmme_entropy_penalty_le_pair_referencematrix-multiplicationregional-extraction
Any two strictly positive coordinate probability distributions bound the maximum-entropy split penalty by their cross entropies minus the original joint entropy. Product-mass feasibility follows structurally and is no longer a separate certificate obligation. The full matrix exponent bound remains a separate obligation.
Preamble
import Theorems.Thm_mme_split_pair_product_mass_le import Theorems.Thm_mme_entropy_penalty_le_product_dual open scoped BigOperators open MME.RegionRate MME.RecursiveThinSplit
Formal statement
theorem mme_entropy_penalty_le_pair_reference
{half : ℕ} {parent : Fin 3 → ℕ} (alpha : Split half parent → ℝ)
(ha : ∀ c, 0 ≤ alpha c) (hprob : ∑ c, alpha c = 1)
(i j : Fin 3) (hij : i ≠ j) (p q : Fin (half + 1) → ℝ)
(hp : ∀ a, 0 < p a) (hq : ∀ b, 0 < q b)
(hpmass : ∑ a, p a = 1) (hqmass : ∑ b, q b = 1) :
Real.log 2 * entropyPenalty alpha ≤
-(∑ a, mme_modern_marginal (fun c : Split half parent => c.val i) alpha a *
Real.log (p a)) -
(∑ b, mme_modern_marginal (fun c : Split half parent => c.val j) alpha b *
Real.log (q b)) - entropy alpha := by sorrySource
Kernel-checked regional count identities and exact extraction with empty regions.