Corollary 10.7.1 — for
ProvedWildeQIT.PinskerRefined.corollary_10_7_1data-processingentropy-inequalitiesinformation-theoryp2o-gran-per-chapterp2o-plan-bookp2o-v1
Let be discrete random variables on finite alphabets forming a Markov chain . Then
For a Markov chain, conditioning on the processed variable can only decrease the information carries about .
Formalization Note Alphabets are finite types, as throughout the book; a random variable is represented by its distribution, and a triple by its joint distribution on . Entropies, mutual informations and relative entropies are the published WildeQIT definitions, in bits. The Markov chain is the published IsMarkovChain: for all .
Differences from the source:
- encoding: X → Y → Z, p_{Z|Y,X}(z|y,x) = p_{Z|Y}(z|y) (10.55) → IsMarkovChain: p(x,y,z) p_Y(y) = p_XY(x,y) p_YZ(y,z) for all x, y, z; reason: division-free form; conditionals are undefined where p_XY(x,y) = 0 and both forms agree wherever defined
Preamble
import Definitions.Def_WildeQIT_mutualInfo import Definitions.Def_WildeQIT_condMutualInfo import Definitions.Def_WildeQIT_IsMarkovChain
Formal statement
namespace WildeQIT.PinskerRefined
open WildeQIT
/-- **Corollary 10.7.1**, Wilde, *From Classical to Quantum Shannon Theory*, arXiv:1106.1445v8, p. 302: for a Markov chain `X → Y → Z`,
`I(X;Y) ≥ I(X;Y|Z)` (10.62).
**Formalization Note** Alphabets are finite types (`Fintype`), as throughout the book; a random variable is represented by its distribution (`FinDist`), a triple `(X, Y, Z)` by its joint law on `α × β × γ` = `α × (β × γ)`. Entropies, mutual informations and relative entropies are the published `WildeQIT` definitions, in bits (`Real.logb 2`, `0 log 0 = 0`). The Markov chain is the published `IsMarkovChain`; `I(X;Y)` is
`mutualInfo` of the marginal `p_{XY}` and `I(X;Y|Z)` is `condMutualInfo p`. -/
theorem corollary_10_7_1 {α β γ : Type} [Fintype α] [Fintype β] [Fintype γ]
(p : FinDist (α × β × γ)) (hp : p.IsMarkovChain) :
condMutualInfo p ≤ mutualInfo p.margXY := by sorry
end WildeQIT.PinskerRefined
Source
Wilde, From Classical to Quantum Shannon Theory, arXiv:1106.1445v8, Corollary 10.7.1, p. 302, Eq. (10.62)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.