Corollary 3.6: IID covering
OpenQAlgorithms.Papers.Independent.Intakethird100.P42.iidCoveringLet be a probability law on finite nonempty alphabets , with marginal . Independently sample a book from , for an arbitrary integer . Put .
There is an absolute constant and a constant depending only on this joint law such that for every , all sufficiently large positive admit a book-dependent selection of normalized encoders satisfying
where and . Entropies are in bits. The threshold is independent of and the error is the full joint norm on .
This is the IID joint-covering statement used to construct the stochastic encoder for channel simulation.
import Definitions.Def_QAlgorithms_Papers_Independent_Intakethird100_P42
noncomputable section
namespace QAlgorithms.Papers.Independent.Intakethird100.P42
open scoped BigOperators ComplexConjugate ENNReal
open Filter
open QAlgorithms.Papers.Independent.Dependency50.P07
open QAlgorithms.Papers.Independent.Gap48.P20
open QAlgorithms.Papers.Independent.Information100.P27 (IsProbability shannon)
attribute [local instance] Classical.decEq Classical.propDecidable
/-- PDF pp.9--10, Corollary 3.6: IID covering for every positive M. Constants
precede accuracy, blocklength and book size; alpha and beta use opposite signs. -/
theorem iidCovering :
∃ kappa : ℝ, 0 < kappa ∧
∀ (X Y : Type) [Fintype X] [Fintype Y] [Nonempty X] [Nonempty Y]
(q : Y → ℝ) (P : Y → X → ℝ),
IsProbability q → (∀ y, IsProbability (P y)) →
∃ c : ℝ, 0 < c ∧ ∀ eps > (0 : ℝ), ∀ delta > (0 : ℝ), ∃ N : ℕ,
∀ n ≥ N, 1 ≤ n → ∀ M : ℕ, 1 ≤ M →
let alpha := (2 : ℝ) ^ ((n : ℝ) *
(shannon (coveringMarginal q P) + c * delta))
let beta := (2 : ℝ) ^ ((n : ℝ) *
((∑ y, q y * shannon (P y)) - c * delta))
∃ select : (Fin M → Copies Y n) → CoverEncoder (Copies X n) M,
bookProbability q n M (fun book => 5 * eps ≤
coveringError (wordProb q n) (productConditional P n) M book (select book)) ≤
2 * alpha * Real.exp (-kappa * M * eps ^ 3 * beta / alpha) := by sorry
end QAlgorithms.Papers.Independent.Intakethird100.P42
end
Read-back
What the Lean code literally says, in plain math · gpt-6.1-sol
There exists a real constant such that for every pair of finite nonempty types , every probability function on , and every family of probability functions on , there exists such that for every there is a natural number with the following property. For every with and every natural number , write , ,
There exists a selection assigning to each book an encoder on , normalized by for every , such that, on defining
one has
Here are the respective length- word spaces. The constant precedes all choices of types and distributions, precedes , and the encoder selection may depend on ; zero probabilities are allowed, with , and no upper bounds on are assumed.
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.