Motivation
In distributionally robust modelling, a baseline probability model μ on a space S is distrusted, and the analyst reports the largest expected loss over every model within a budget of μ. Blanchet and Murthy (arXiv:1604.01446; Math. Oper. Res. 44(2), 2019, doi:10.1287/moor.2018.0936) measure the budget with an optimal transport cost and prove strong duality for the resulting worst-case expectation on an arbitrary Polish space, with a lower semicontinuous cost and an upper semicontinuous performance function. Duality computes the worst-case value. A risk manager also wants the worst-case model: a distribution that attains the value, whose structure explains which perturbation of μ is most harmful.
Such a model need not exist. Unlike the Kantorovich problem, where the set of couplings with two fixed marginals is weakly compact, the feasible set here fixes only one marginal and is not compact in general. Section 5 of the paper gives an example on R where the supremum is not attained, then gives abstract conditions under which it is (Proposition 9), and growth conditions on a locally compact normed space that imply them (Corollary 1). Related existence results in Rd were obtained by Gao and Kleywegt (arXiv:1604.02199, 2016) and, for empirical baselines and norm costs, by Mohajerin Esfahani and Kuhn (arXiv:1505.05116, 2018).
Setting
Let S be a Polish space with its Borel σ-algebra, μ a probability measure on S, δ>0 a budget, c:S×S→[0,∞) a cost and f:S→R a performance function. The standing assumptions are:
- (A1) c is lower semicontinuous and c(x,y)=0 iff x=y;
- (A2) f is upper semicontinuous and μ-integrable.
The primal feasible set Φμ,δ consists of the probability measures π on S×S with first marginal μ and ∫cdπ≤δ (transport plans out of μ of cost at most δ). The primal objective is I(π)=∫f(y)dπ(x,y) and the primal value is I=sup{I(π):π∈Φμ,δ}. The dual feasible set Λc,f consists of pairs (λ,φ) with λ≥0, φ:S→[−∞,∞] universally measurable and φ(x)+λc(x,y)≥f(y) for all x,y. The dual objective is J(λ,φ)=λδ+∫φdμ and the dual value is J=infJ(λ,φ). For λ≥0 put φλ(x)=supy{f(y)−λc(x,y)}.
Section 5 assumes throughout that (λ∗,φλ∗)∈Λc,f is a dual optimal pair with I=J=J(λ∗,φλ∗)<∞. Write Φμ,δ′ for the plans in Φμ,δ concentrated on {f(x)≤f(y)}.
(P-Compactness): for every ε>0 there are a compact Kε with μ(Kε)>1−ε and γ>0 such that {(x,y)∈Kε×S:f(y)−λ∗c(x,y)≥φλ∗(x)−γ} has compact closure. (P-USC): limsupnI(πn)≤I(π∗) whenever πn∈Φμ,δ′ converge weakly to π∗∈Φμ,δ.
On a normed space E: (A3) c(x,y)≥g(∥x−y∥) for ∥x−y∥>C, with g nondecreasing and g(t)↑∞. (A4) (f(y)−f(x))/(1+h(∥x−y∥))≤K for an increasing h with h(t)↑∞; and for every ε>0, f(y)−f(x)≤ε(1+c(x,y)) once ∥x−y∥>Cε.
Formalization targets
Goal: Corollary 1 (p. 27)
Let E be a real normed space that is locally compact, and let c,f satisfy (A1)–(A4). Under the standing assumption, if λ∗>0 there is π∗∈Φμ,δ with
I(π∗)=I=J=J(λ∗,φλ∗).
Milestones
- Remark 4, (10)–(11) (p. 8): for π∈Φμ,δ, I−I(π) is the sum of two nonnegative gaps, ∫(φλ∗(x)−f(y)+λ∗c(x,y))dπ and λ∗(δ−∫cdπ); so an ε-optimal plan has both gaps at most ε.
- Lemma 17 (p. 43): every plan in Φμ,δ can be replaced by one in Φμ,δ′ with at least the same value.
- §5 display (p. 26): I=sup{I(π):π∈Φμ,δ′}.
- Proposition 9 (p. 26): on a Polish space, (P-Compactness) and (P-USC) give a primal optimizer.
- Corollary 1, Step 1 (p. 28): (A1)–(A4) and λ∗>0 give (P-Compactness).
- Corollary 1, Step 2 (pp. 28–29): (A1), (A2), (A4) and I<∞ give (P-USC):
nlimsup∫f(y)dπn≤∫f(y)dπ∗.
Significance
The result. An attained worst case turns duality into a structural statement. By Theorem 1(b) of the paper, an optimizer moves mass from x only to maximizers of f(y)−λ∗c(x,y) and, when λ∗>0, uses the full budget. When those maximizers are unique (Remark 8: c convex in y, f concave) the worst-case model is unique and is the image of μ under a transport map. That map is what stress tests and robust estimators are built from. Without existence, these statements describe an object that may not be there.
Formalizing it. The paper's proofs are complete; nothing here is open. No machine-checked version of this result is known: the worst-case optimal transport literature, including the strong duality of this paper, is unformalized. The mission produces the transport objects of §2 in a form that keeps the paper's generality (Polish space, lower semicontinuous real cost, universally measurable dual variables, the ∞−∞ convention), a tightness argument for nearly optimal one-marginal plans, and an upper semicontinuity argument for unbounded upper semicontinuous integrands under uniform integrability.
Difficulty
The obvious argument takes a maximizing sequence and extracts a weak limit. Both steps fail without more structure. First, Φμ,δ is not tight: only the first marginal is fixed, and a sequence may push mass to infinity at bounded cost. That is exactly what happens in Example 2 (p. 26), where λ∗=0 and the value 1 is approached but never reached. Tightness has to come from the dual: nearly optimal plans concentrate near maximizers of f(y)−λ∗c(x,y), and (A3)–(A4) with λ∗>0 confine those maximizers. Second, f is only upper semicontinuous and unbounded, so weak convergence alone does not give limsup∫fdπn≤∫fdπ∗. A uniform integrability bound is needed, and it uses the restriction to Φμ,δ′ in an essential way. A third, Lean-specific difficulty is measure-theoretic: φλ∗ is only universally measurable, and the gaps of Remark 4 are integrals against completions.
Formalization scope
All declarations sit in the namespace ModelRiskOT.PrimalOpt. Values of I(π), I, J(λ,φ), J and φλ are in EReal. I(π) is ∫f+(y)dπ−∫f−(y)dπ with lower integrals, and Mathlib's ⊤−⊤=⊥ realises the paper's reading of the supremum (footnote 2, p. 5). Integrals of nonnegative or extended-real functions are lower integrals (lintegral), never Bochner integrals. Universal measurability is the published BertsekasShreve.AnalyticSelection.IsUniversallyMeasurable. Weak convergence is the topology of ProbabilityMeasure (S × S). Measures on S×S use the product σ-algebra.
The following readings are fixed:
- The standing assumption of §5 ((λ∗,φλ∗)∈Λc,f, I=J, J=J(λ∗,φλ∗), finiteness) consists of hypotheses of Proposition 9 and Corollary 1. I=J is Theorem 1(a), the goal of the companion mission on strong duality, and is not assumed proved here.
- In (P-Compactness) the constant γ may depend on ε.
- "Increasing" in (A4) is strict.
- Remark 4's second conclusion in (11) is also stated as λ∗(δ−∫cdπ)≤ε, which covers λ∗=0.
- Lemma 17's last inequality is stated for every plan, which is equivalent under the
EReal convention.
- Corollary 1's space is a real normed space with
LocallyCompactSpace. It also carries PolishSpace, which is redundant, since a locally compact real normed space is finite-dimensional.
The goal cannot be satisfied by a junk value: I and J are EReal suprema and infima, not real sSup, and the hypothesis λ∗>0 is kept because Example 2 shows the conclusion fails without it. A sorry-free check that c(x,y)=(x−y)2, f(y)=y on R satisfy (A1), (A3) and (A4) accompanies the drafts.
A complete development needs Prokhorov's theorem (in Mathlib), a Fatou lemma for weakly converging measures with a lower semicontinuous integrand, an upper semicontinuity theorem for uniformly integrable upper semicontinuous integrands, and the change of variables ∫φ(x)dπ=∫φdμ for universally measurable φ. The last three are reusable well beyond this mission. Proofs of any milestone, and these general lemmas as separate contributions, are welcome.
Selected references
- J. Blanchet and K. Murthy, Quantifying Distributional Model Risk via Optimal Transport, Math. Oper. Res. 44(2):565–600, 2019. arXiv:1604.01446v2, doi:10.1287/moor.2018.0936
- R. Gao and A. Kleywegt, Distributionally Robust Stochastic Optimization with Wasserstein Distance, 2016. arXiv:1604.02199
- P. Mohajerin Esfahani and D. Kuhn, Data-driven distributionally robust optimization using the Wasserstein metric, Math. Program. 171:115–166, 2018. arXiv:1505.05116
- A. M. Zapała, Unbounded mappings and weak convergence of measures, Statist. Probab. Lett. 78(6):698–706, 2008. doi:10.1016/j.spl.2007.09.033
- C. Villani, Optimal Transport: Old and New, Springer, 2009. doi:10.1007/978-3-540-71050-9