Theorem 3.11, proof (p. 12) — for private useful mechanisms on databases of size
ProvedPrivateRelease.VCLowerBound.theorem_3_11_explicitLet be a class of predicates on a data universe , and let satisfy . Let be a mechanism that maps each input database to a probability distribution on an output space , and let be a readout such that is measurable for every . Suppose that
- is -differentially private: for every measurable and all inputs that differ in exactly one entry;
- is -useful for , with .
Then
Equivalently , a positive lower bound on the error whenever . This is the inequality that the final display of the paper's proof derives; Theorem 3.11 follows from it.
Formalization Note The paper's display reads : it counts under the neighbour relation , and it drops the failure probability of the two reconstructions. Here neighbours are databases differing in one entry (replace-one), under which and are neighbours, so the factor is ; and is kept. VC-dimension is the -valued supremum of the sizes of shattered sets, so also covers infinite VC-dimension. The measurability of the readouts is needed: without it a mechanism into a trivial -algebra is -private and the bound fails.
import Mathlib import Definitions.Def_PrivLearn_Generic_Privacy import Definitions.Def_HighDimProb_Chaining_VcDim import Definitions.Def_PrivateRelease_VCLowerBound_Queries
namespace PrivateRelease.VCLowerBound
open MeasureTheory
/-- Theorem 3.11, proof (p. 12), with `δ` kept. Let `C` be a class of predicates on `X` and `n ≥ 1`
with `2n ≤ VCDIM(C)`. Let `M` be a mechanism on input databases of size `n` whose outputs are
probability measures on `O`, with a readout `ans` that is measurable in the output for each query of
`C`. If `M` is `ε`-differentially private (replace-one neighbours) and `(α, δ)`-useful for `C` with
`0 < δ < 1`, then `(1 − δ)(1 − 2α) ≤ e^ε (δ + 2α)`. -/
theorem theorem_3_11_explicit {X O : Type} [MeasurableSpace O] (C : Set (X → Bool)) (n : ℕ)
(M : (Fin n → X) → Measure O) (ans : O → (X → Bool) → ℝ) (ε α δ : ℝ)
(hn : 1 ≤ n) (hvc : ((2 * n : ℕ) : ℕ∞) ≤ HighDimProb.Chaining.vcDim C)
(hδ0 : 0 < δ) (hδ1 : δ < 1)
(hprob : ∀ z, IsProbabilityMeasure (M z))
(hans : ∀ φ ∈ C, Measurable fun o => ans o φ)
(hdp : PrivLearn.Generic.IsDP M ε) (huse : IsUseful C α δ M ans) :
(1 - δ) * (1 - 2 * α) ≤ Real.exp ε * (δ + 2 * α) := by sorry
end PrivateRelease.VCLowerBound
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.