(16) — the transport map satisfies ‖T(θ₁; z) − T(θ₂; z)‖ ≤ L_zθ/(γ − L_zz) ‖θ₁ − θ₂‖
ProvedCertDRO.Conc.eq_16_transport_lipschitzlipschitzp2o-batch-pfp2bp2o-gran-per-chapterp2o-plan-paperp2o-v1strong-concavitytransport-map
Let be convex and , let the cost satisfy Assumption A and the loss satisfy Assumption B on with constants , and let . Let be a transportation map, for all and . Then for every and all ,
This smoothness of the worst-case perturbation in the parameter is the starting point of the uniform concentration argument for the robustness level.
Formalization Note The paper writes ; under the hypothesis (p. 43: "our strong concavity assumption that ") this is . The norm is on both spaces.
Preamble
import Definitions.Def_CertDRO_Conc_model
Formal statement
namespace CertDRO.Conc
/-- §3.2, (16), p. 10: under Assumptions A and B on `Θ × Z` with `γ > Lzz`, the transportation map
is Lipschitz in the parameter: for every `z ∈ Z` and all `θ₁, θ₂ ∈ Θ`,
`‖T(θ₁; z) − T(θ₂; z)‖ ≤ Lzθ / (γ − Lzz) · ‖θ₁ − θ₂‖`. -/
theorem eq_16_transport_lipschitz {d m : ℕ} (Z : Set (CertDRO.SGD.Data m)) (hZ : Convex ℝ Z)
(Θ : Set (CertDRO.SGD.Param d))
(ℓ : CertDRO.SGD.Param d → CertDRO.SGD.Data m → ℝ) (gθ : CertDRO.SGD.Param d → CertDRO.SGD.Data m → CertDRO.SGD.Param d)
(gz : CertDRO.SGD.Param d → CertDRO.SGD.Data m → CertDRO.SGD.Data m) (c : CertDRO.SGD.Data m → CertDRO.SGD.Data m → ℝ) (T : CertDRO.SGD.Param d → CertDRO.SGD.Data m → CertDRO.SGD.Data m)
(Lθθ Lzz Lθz Lzθ γ : ℝ)
(hA : CertDRO.SGD.AssumptionA Z c) (hB : AssumptionB Θ Z ℓ gθ gz Lθθ Lzz Lθz Lzθ)
(hγ : Lzz < γ) (hT : IsTransportMap Θ Z ℓ c γ T) :
∀ z ∈ Z, ∀ θ₁ ∈ Θ, ∀ θ₂ ∈ Θ, ‖T θ₁ z - T θ₂ z‖ ≤ Lzθ / (γ - Lzz) * ‖θ₁ - θ₂‖ := by sorry
end CertDRO.Conc
Source
Sinha, Namkoong, Volpi, Duchi, Certifying Some Distributional Robustness with Principled Adversarial Training, arXiv:1710.10571v5, p. 10, §3.2, (16)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.