Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Optimization

1,681 missions · 910 completed

Missions

Open771Completed910All1681
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

On the Value of Mix Flexibility and Dual Sourcing in Unreliable Newsvendor Networks 1: The Risk-Neutral Flexibility Premium Is Nonnegative for Every ReliabilityResearch Paper

Motivation

A firm that sells several products must decide, before demand is known, how much production capacity to build and of what kind. Dedicated capacity makes one product; flexible capacity makes any of them. The classic argument for flexibility is demand pooling: capacity that can follow demand to whichever product needs it wastes less than capacity locked to one product (Fine and Freund 1990; Van Mieghem 1998).

When capacity itself is unreliable, as with a supplier that may fail to deliver, a plant that may be disrupted, or a batch that may be rejected, flexibility has a second face. A single flexible resource concentrates the firm's supply in one place, so one failure removes all of it, whereas several dedicated resources rarely fail together. This resource-aggregation effect works against flexibility. Tomlin and Wang (2005) set up a newsvendor network in which both effects are present and ask when a firm should pay more for flexible capacity than for dedicated capacity. Their first answer (Proposition 1) is that a risk-neutral firm facing equal reliabilities and costs never loses by choosing flexibility, whatever the joint distribution of demand. This mission formalizes that answer.

Setting

There are NNN products with a common unit contribution margin p>0p>0p>0. The demand vector X~=(X~1,…,X~N)\tilde X=(\tilde X_1,\dots,\tilde X_N)X~=(X~1​,…,X~N​) is random, nonnegative and integrable; its total is X~N+1=X~1+⋯+X~N\tilde X_{N+1}=\tilde X_1+\dots+\tilde X_NX~N+1​=X~1​+⋯+X~N​.

Two networks are compared. In the dedicated network SD, resource n∈{1,…,N}n\in\{1,\dots,N\}n∈{1,…,N} makes only product nnn and has marginal total cost c>0c>0c>0. In the flexible network SF, a single resource, labelled N+1N+1N+1, makes every product and has marginal total cost cN+1c_{N+1}cN+1​.

Every resource jjj is unreliable with a Bernoulli yield Y~j∈{0,1}\tilde Y_j\in\{0,1\}Y~j​∈{0,1}, P(Y~j=1)=θ\mathbb P(\tilde Y_j=1)=\thetaP(Y~j​=1)=θ. The common reliability is θ∈[0,1]\theta\in[0,1]θ∈[0,1], the yields are mutually independent, and they are independent of demand. Investing Kj≥0K_j\ge 0Kj​≥0 in resource jjj delivers capacity Y~jKj\tilde Y_jK_jY~j​Kj​ and costs (λ+(1−λ)Y~j)cjKj(\lambda+(1-\lambda)\tilde Y_j)c_jK_j(λ+(1−λ)Y~j​)cj​Kj​: the firm pays the committed cost λcj\lambda c_jλcj​ per unit ordered and a further (1−λ)cj(1-\lambda)c_j(1−λ)cj​ per unit delivered, with λ∈[0,1]\lambda\in[0,1]λ∈[0,1].

The realized profits are

WSD(K)=∑n=1N(−(λ+(1−λ)Y~n)cKn+pmin⁡{X~n,Y~nKn}),W^{SD}(K)=\sum_{n=1}^N\Big(-(\lambda+(1-\lambda)\tilde Y_n)cK_n+p\min\{\tilde X_n,\tilde Y_nK_n\}\Big),WSD(K)=n=1∑N​(−(λ+(1−λ)Y~n​)cKn​+pmin{X~n​,Y~n​Kn​}), WSF(KN+1)=−(λ+(1−λ)Y~N+1)cN+1KN+1+pmin⁡{X~N+1,Y~N+1KN+1},W^{SF}(K_{N+1})=-(\lambda+(1-\lambda)\tilde Y_{N+1})c_{N+1}K_{N+1}+p\min\{\tilde X_{N+1},\tilde Y_{N+1}K_{N+1}\},WSF(KN+1​)=−(λ+(1−λ)Y~N+1​)cN+1​KN+1​+pmin{X~N+1​,Y~N+1​KN+1​},

and a risk-neutral firm maximizes the expected profit VRNSD(K)=E[WSD(K)]V^{SD}_{RN}(K)=\mathbb E[W^{SD}(K)]VRNSD​(K)=E[WSD(K)] or VRNSF(KN+1)=E[WSF(KN+1)]V^{SF}_{RN}(K_{N+1})=\mathbb E[W^{SF}(K_{N+1})]VRNSF​(KN+1​)=E[WSF(KN+1​)] over nonnegative investments. Let VSD,∗V^{SD,*}VSD,∗ and VSF,∗V^{SF,*}VSF,∗ be the optimal values. SF is (weakly) preferred if VSF,∗≥VSD,∗V^{SF,*}\ge V^{SD,*}VSF,∗≥VSD,∗.

The indifference cost cN+1Ic^I_{N+1}cN+1I​ is a value of cN+1c_{N+1}cN+1​ at which VSF,∗=VSD,∗V^{SF,*}=V^{SD,*}VSF,∗=VSD,∗, and the flexibility premium is Δ=(cN+1I−c)/c\Delta=(c^I_{N+1}-c)/cΔ=(cN+1I​−c)/c. The firm prefers SF as long as cN+1≤(1+Δ)cc_{N+1}\le(1+\Delta)ccN+1​≤(1+Δ)c.

The α\alphaα-expected shortfall of a random variable ZZZ is, for α∈(0,1)\alpha\in(0,1)α∈(0,1) and the lower quantile x(α)=inf⁡{x:P(Z≤x)≥α}x_{(\alpha)}=\inf\{x:\mathbb P(Z\le x)\ge\alpha\}x(α)​=inf{x:P(Z≤x)≥α},

ESα(Z)=−1α(E[Z1{Z≤x(α)}]+x(α)(α−P(Z≤x(α)))).ES_\alpha(Z)=-\frac1\alpha\Big(\mathbb E\big[Z\mathbf 1\{Z\le x_{(\alpha)}\}\big]+x_{(\alpha)}\big(\alpha-\mathbb P(Z\le x_{(\alpha)})\big)\Big).ESα​(Z)=−α1​(E[Z1{Z≤x(α)​}]+x(α)​(α−P(Z≤x(α)​))).

Formalization targets

Goal: Proposition 1

For any demand random vector X~\tilde XX~:

  1. ΔRN≥0\Delta_{RN}\ge 0ΔRN​≥0 for all 0≤θ≤10\le\theta\le 10≤θ≤1, that is, SF is preferred whenever cN+1≤cc_{N+1}\le ccN+1​≤c;
0≤θ≤λcp−(1−λ)c ⟹ ΔRN=0;0\le\theta\le\frac{\lambda c}{p-(1-\lambda)c}\ \Longrightarrow\ \Delta_{RN}=0;0≤θ≤p−(1−λ)cλc​ ⟹ ΔRN​=0;
  1. ΔRN=0\Delta_{RN}=0ΔRN​=0 if ρX=1\rho_X=\mathbf 1ρX​=1, i.e. all pairwise demand correlations equal 111.

No distributional form of demand is fixed and no constant is hard-coded beyond the paper's threshold.

Milestones

  • (9): the closed form of VRNSFV^{SF}_{RN}VRNSF​.
  • (10)–(11), (12)–(13): the optimal investments are critical fractiles
FXN+1(KN+1∗)=1−(λ+(1−λ)θ)cN+1θp,FXn(Kn∗)=1−(λ+(1−λ)θ)cθp,F_{X_{N+1}}(K^*_{N+1})=1-\frac{(\lambda+(1-\lambda)\theta)c_{N+1}}{\theta p},\qquad F_{X_n}(K^*_n)=1-\frac{(\lambda+(1-\lambda)\theta)c}{\theta p},FXN+1​​(KN+1∗​)=1−θp(λ+(1−λ)θ)cN+1​​,FXn​​(Kn∗​)=1−θp(λ+(1−λ)θ)c​,

and the optimal values are θp\theta pθp times partial expectations of demand.

  • (A-1) in expected-shortfall form: with α=1−(λ+(1−λ)θ)c/(θp)∈(0,1)\alpha=1-(\lambda+(1-\lambda)\theta)c/(\theta p)\in(0,1)α=1−(λ+(1−λ)θ)c/(θp)∈(0,1),
VSF,∗≥VSD,∗ at cN+1=c  ⟺  α(∑nESα(X~n)−ESα(∑nX~n))≥0.V^{SF,*}\ge V^{SD,*}\ \text{at}\ c_{N+1}=c\iff \alpha\Big(\sum_n ES_\alpha(\tilde X_n)-ES_\alpha\Big(\sum_n\tilde X_n\Big)\Big)\ge 0 .VSF,∗≥VSD,∗ at cN+1​=c⟺α(n∑​ESα​(X~n​)−ESα​(n∑​X~n​))≥0.
  • Subadditivity of ESαES_\alphaESα​ (Acerbi and Tasche 2002).
  • The positivity threshold of part 2: investing is worthwhile iff θ>λc/(p−(1−λ)c)\theta>\lambda c/(p-(1-\lambda)c)θ>λc/(p−(1−λ)c).
  • Correlation 111 implies X~n=aX~1+b\tilde X_n=a\tilde X_1+bX~n​=aX~1​+b with a>0a>0a>0, and ESα(aX+b)=aESα(X)−bES_\alpha(aX+b)=aES_\alpha(X)-bESα​(aX+b)=aESα​(X)−b.

Significance

Proposition 1 separates the two effects of flexibility under unreliable supply. It shows that for a risk-neutral firm the demand-pooling benefit together with an upside effect of aggregation (one flexible resource succeeds more often than all dedicated ones together) always outweighs the downside aggregation risk. Even with no pooling benefit at all (perfectly correlated demand) the firm is indifferent, not averse. The later results of the paper (loss aversion, CVaR, dual sourcing) are measured against this baseline: a negative premium can appear only once the firm is risk-averse. The expected-shortfall form links newsvendor optimal values to a coherent risk measure, a connection that recurs in inventory risk analysis.

The result is proved in the paper, with a proof that cites Acerbi and Tasche (2002) for two properties of expected shortfall. No machine-checked version exists. A formalization adds three things: a proof for general demand distributions (the paper assumes a joint density and uses the continuous form of expected shortfall); a Lean development of Acerbi–Tasche expected shortfall for general integrable random variables, including subadditivity and affine equivariance; and a reusable model of newsvendor networks with Bernoulli yields and committed costs.

Difficulty

The newsvendor steps (9)–(13) are single-variable concave optimization, but they must be done without a density: the distribution function of total demand may have atoms and flat pieces, so the critical fractile need not be attained or may be attained on an interval, and optimal values must be expressed through lower quantiles. Subadditivity of expected shortfall is the heart of part 1 and is not elementary in the general (atomic) case, which is exactly why the correction term x(α)(α−P(Z≤x(α)))x_{(\alpha)}(\alpha-\mathbb P(Z\le x_{(\alpha)}))x(α)​(α−P(Z≤x(α)​)) appears. Part 3 requires identifying correlation 111 with almost-sure positive affine dependence, which rests on the equality case of the Cauchy–Schwarz inequality in L2L^2L2, and then handling nonnegativity constraints on the investments that the affine change of variables may violate. The obvious shortcut of computing everything from densities is not available, because the goal is stated for every demand vector and part 3 is incompatible with a joint density when N≥2N\ge 2N≥2.

Formalization scope

Randomness lives on one probability space (Ω,μ)(\Omega,\mu)(Ω,μ); demand is X : Ω → Fin N → ℝ and yields are Y : Ω → Fin (N + 1) → ℝ, where dedicated resource nnn is Fin.castSucc n and the flexible resource N+1N+1N+1 is Fin.last N. Expectations are Bochner integrals and probabilities are μ.real. The standing assumptions are: p>0p>0p>0, c>0c>0c>0, λ,θ∈[0,1]\lambda,\theta\in[0,1]λ,θ∈[0,1]; demands measurable, almost surely nonnegative and integrable (integrability is needed for expected shortfall and makes every profit integrable); yields measurable, {0,1}\{0,1\}{0,1}-valued almost surely with P(Y~j=1)=θ\mathbb P(\tilde Y_j=1)=\thetaP(Y~j​=1)=θ, mutually independent, and independent of demand (the paper states the last in Appendix E). The paper's joint density of demand is deliberately not assumed.

The premium Δ\DeltaΔ and the indifference cost are not defined as real numbers, because Definition 1's indifference cost need not exist or be unique (for θ\thetaθ below the threshold both optimal values are 000 for every cN+1c_{N+1}cN+1​ near ccc). "Δ≥0\Delta\ge 0Δ≥0" is encoded as "SF is weakly preferred for every cN+1≤cc_{N+1}\le ccN+1​≤c", and "Δ=0\Delta=0Δ=0" as "SF and SD are each weakly preferred to the other at cN+1=cc_{N+1}=ccN+1​=c". Weak preference VSF,∗≥VSD,∗V^{SF,*}\ge V^{SD,*}VSF,∗≥VSD,∗ is stated as: every nonnegative SD investment is matched by some nonnegative SF investment; no real supremum is taken. Quantiles F−1F^{-1}F−1 in (10) and (12) appear only as parameters with the hypothesis F(K∗)=F(K^*)=F(K∗)= fractile. Part 3 adds square integrability and positive variances, the conditions under which correlation coefficients exist; the threshold milestone adds almost surely positive demand and N≥1N\ge 1N≥1 for its "if" direction. When p≤(1−λ)cp\le(1-\lambda)cp≤(1−λ)c the Lean value of the threshold is ≤0\le 0≤0, so part 2 then covers only θ=0\theta=0θ=0, where it is true.

A formalization that assumed a joint density, took Δ\DeltaΔ as a free real satisfying Definition 1, or defined optimal values as real suprema over all of RN\mathbb R^NRN would make parts of the goal vacuous or trivial; each is ruled out above.

Needed infrastructure: single-variable newsvendor optimality for general distributions; the Acerbi–Tasche expected shortfall with subadditivity and affine equivariance; the equality case of Cauchy–Schwarz for correlation. The expected-shortfall and correlation lemmas are reusable well beyond this mission, and contributions of them are especially welcome. Out of scope: the loss-averse and CVaR analyses (Propositions 2–3, §3.2–3.3), the perfect-reliability result (Proposition 4, a separate mission), the dual-sourcing networks (§4) and all numerical results.

Selected references

  • B. Tomlin and Y. Wang, On the value of mix flexibility and dual sourcing in unreliable newsvendor networks, Manufacturing & Service Operations Management 7(1):37–57, 2005. https://doi.org/10.1287/msom.1040.0063
  • C. Acerbi and D. Tasche, On the coherence of expected shortfall, Journal of Banking & Finance 26(7):1487–1503, 2002. https://doi.org/10.1016/S0378-4266(02)00283-2
  • C. H. Fine and R. M. Freund, Optimal investment in product-flexible manufacturing capacity, Management Science 36(4):449–466, 1990. https://doi.org/10.1287/mnsc.36.4.449
  • J. A. Van Mieghem, Investment strategies for flexible resources, Management Science 44(8):1071–1078, 1998. https://doi.org/10.1287/mnsc.44.8.1071
10 thms2 active usersReviewed
🏆Completed
Convex OptimizationLinear OptimizationOperations Research·Captain: Shuze Chen

Discrete Convex Analysis II: Local Optimality for Integrally Convex FunctionsTextbook

Motivation

For a convex function on Rn\mathbb R^nRn, a point is a global minimizer as soon as it is a local minimizer — this is one of the earliest and most consequential facts of convex analysis, and it underlies why local-search and gradient methods can certify global optimality in convex programs. The discrete analogue is not automatic: a function on the integer lattice Zn\mathbb Z^nZn can be "locally optimal" with respect to any fixed finite neighborhood system and still fail to be a global minimizer, unless the function's discrete structure is compatible with that neighborhood in the right way. Identifying exactly which classes of lattice functions admit a local-to-global optimality principle, and with respect to which neighborhood, is one of the organizing questions of discrete convex analysis.

Integrally convex functions, introduced by Favati and Tardella (1990) and developed systematically by Murota, are the most general class of Zn\mathbb Z^nZn-valued functions for which such a principle holds. They are defined purely in terms of the classical convex closure of a real relaxation, which lets one import theorems from ordinary convex analysis, but the resulting notion of local optimality — checking only the 3n−13^n - 13n−1 neighbors obtained by independently nudging each coordinate by −1-1−1, 000, or +1+1+1 (excluding the trivial no-change case) — is a genuinely discrete, dimension-independent statement about functions whose domain can be arbitrarily large. Almost every discrete convex function class studied later in the book, including M-convex and L-convex functions, is a special case of integral convexity, and this mission's goal theorem is the direct ancestor of the optimality criteria (Theorems 6.26 and 7.14) that drive the algorithms in the rest of the book.

Setting

Let f:Zn→R∪{+∞}f : \mathbb Z^n \to \mathbb R \cup \{+\infty\}f:Zn→R∪{+∞} be a function with nonempty effective domain dom⁡Zf={x∈Zn:f(x)≠+∞}\operatorname{dom}_{\mathbb Z} f = \{x \in \mathbb Z^n : f(x) \ne +\infty\}domZ​f={x∈Zn:f(x)=+∞}. The convex closure of fff is

fˉ(x)=sup⁡p∈Rn, α∈R{⟨p,x⟩+α:⟨p,y⟩+α≤f(y) ∀y∈Zn}(x∈Rn),\bar f(x) = \sup_{p \in \mathbb R^n,\, \alpha \in \mathbb R} \{\langle p,x\rangle + \alpha : \langle p,y\rangle + \alpha \le f(y)\ \forall y \in \mathbb Z^n\} \qquad (x \in \mathbb R^n),fˉ​(x)=p∈Rn,α∈Rsup​{⟨p,x⟩+α:⟨p,y⟩+α≤f(y) ∀y∈Zn}(x∈Rn),

the pointwise supremum of every affine function minorizing fff on all of Zn\mathbb Z^nZn. If fˉ\bar ffˉ​ agrees with fff on integer points, fff is convex extensible. The integral neighborhood of x∈Rnx \in \mathbb R^nx∈Rn is

N(x)={y∈Zn:⌊xi⌋≤yi≤⌈xi⌉, 1≤i≤n},N(x) = \{y \in \mathbb Z^n : \lfloor x_i \rfloor \le y_i \le \lceil x_i \rceil,\ 1 \le i \le n\},N(x)={y∈Zn:⌊xi​⌋≤yi​≤⌈xi​⌉, 1≤i≤n},

and the local convex extension f~\tilde ff~​ relaxes fˉ\bar ffˉ​'s definition by requiring the affine minorant condition only on N(x)N(x)N(x) rather than on all of Zn\mathbb Z^nZn. Always f~≥fˉ\tilde f \ge \bar ff~​≥fˉ​ pointwise, and the two agree on Zn\mathbb Z^nZn. A function fff is integrally convex if f~=fˉ\tilde f = \bar ff~​=fˉ​ everywhere on Rn\mathbb R^nRn — equivalently, if f~\tilde ff~​ is a convex function on all of Rn\mathbb R^nRn (it is automatically convex on every unit cube [z,z+1]n[z, z+1]^n[z,z+1]n with z∈Znz \in \mathbb Z^nz∈Zn, but need not be convex globally without this extra condition).

A discrete set S⊆ZnS \subseteq \mathbb Z^nS⊆Zn is hole free if SSS equals the set of integer points in its own real convex hull, and arg⁡min⁡f[−p]\arg\min f[-p]argminf[−p] denotes the minimizer set, over Zn\mathbb Z^nZn, of the linearly perturbed function f[−p](x)=f(x)−⟨p,x⟩f[-p](x) = f(x) - \langle p,x\ranglef[−p](x)=f(x)−⟨p,x⟩.

Formalization targets

Goal: Theorem 3.21 (local optimality characterizes global optimality)

For integrally convex fff and x∈dom⁡Zfx \in \operatorname{dom}_{\mathbb Z} fx∈domZ​f:

f(x)≤f(y) (∀y∈Zn)  ⟺  f(x)≤f(x+χY−χZ) (∀ Y,Z⊆{1,…,n}),f(x) \le f(y)\ (\forall y \in \mathbb Z^n) \iff f(x) \le f(x + \chi_Y - \chi_Z)\ (\forall\, Y, Z \subseteq \{1,\dots,n\}),f(x)≤f(y) (∀y∈Zn)⟺f(x)≤f(x+χY​−χZ​) (∀Y,Z⊆{1,…,n}),

where χY∈{0,1}n\chi_Y \in \{0,1\}^nχY​∈{0,1}n is the indicator vector of YYY. The right-hand side is a check over at most 3n−13^n - 13n−1 points (each coordinate independently unchanged, incremented, or decremented), regardless of how large dom⁡Zf\operatorname{dom}_{\mathbb Z} fdomZ​f is; this uniform, dimension-only bound is the entire content of the theorem, and is the weakest correct formulation — restricting to a single (Y,Z)(Y,Z)(Y,Z) or letting the right-hand side range over all of Zn\mathbb Z^nZn would trivialize or falsify the equivalence.

Milestones: Propositions 3.18 and 3.19

Proposition 3.18: fff convex extensible   ⟹  \implies⟹ arg⁡min⁡f[−p]\arg\min f[-p]argminf[−p] hole free for every ppp (and conversely, when dom⁡Zf\operatorname{dom}_{\mathbb Z} fdomZ​f is bounded). Proposition 3.19: fff is integrally convex if and only if every restriction f[a,b]f_{[a,b]}f[a,b]​ to a finite integer interval is integrally convex — integral convexity is detectable by looking at bounded pieces of fff one at a time.

Significance

The result itself. Theorem 3.21 is what makes integrally convex functions tractable: without it, verifying global optimality on an infinite or exponentially large integer domain would require checking every point. The theorem reduces this to a check whose size depends only on the dimension nnn, not on the size of the domain, and it does so for the widest class of lattice functions for which such a reduction is possible — the class is defined precisely so that this property holds and no wider natural class enjoys it. Every specialized local-optimality theorem later in the book (for M-convex, M♮^\natural♮-convex, L-convex, and L♮^\natural♮-convex functions) restricts this same neighborhood-checking principle to a class where the local check can be made even smaller (a single-element exchange rather than a full sign pattern) precisely because those classes are integrally convex plus more.

Formalizing it. No matching item exists on the platform: a direct search for "integrally convex" returns no results, and the theorem's own proof leans on results (Theorem 1.1's local-to-global principle for ordinary convex functions on Rn\mathbb R^nRn, and an LP-duality-based alternate formula for f~\tilde ff~​) that are either classical convex analysis or belong to a different chapter of this same book. The remaining work is therefore to give a complete, correct account of the definitional chain — convex closure, local convex extension, integral convexity — in a form a solver can build a proof from directly, and to state the finite local-check equivalence itself exactly at the strength the book proves it, not a plausible-looking weakening of it.

Difficulty

The natural first attempt is to try to prove the "⇐\Leftarrow⇐" direction of Theorem 3.21 by a direct induction on the ℓ1\ell^1ℓ1-distance to a global minimizer, moving one coordinate at a time. This fails in general lattice functions (a function that is only "coordinatewise convex" can have strict local minima that are not global), and the theorem's actual proof instead routes through the real relaxation: it shows the neighborhood-check hypothesis forces xxx to be a local minimizer of the local convex extension f~\tilde ff~​ restricted to the unit ball around xxx, then invokes ordinary convex analysis (local minimality implies global minimality for a convex function on Rn\mathbb R^nRn) to conclude xxx globally minimizes fˉ\bar ffˉ​, and finally uses integral convexity (f~=fˉ\tilde f = \bar ff~​=fˉ​) to transfer this back to fff on Zn\mathbb Z^nZn. The identification of fff's local behavior with f~\tilde ff~​'s convexity on a single unit cube — rather than any coordinatewise or separable argument — is the step that makes the class of integrally convex functions exactly the right one for this theorem, and is where a naive combinatorial argument breaks down.

Formalization scope

The ground set is Zn\mathbb Z^nZn, represented as Fin n → ℤ; fff's codomain is WithTop ℝ (exactly R∪{+∞}\mathbb R \cup \{+\infty\}R∪{+∞}), while the convex closure fˉ\bar ffˉ​ and local convex extension f~\tilde ff~​ take values in EReal (exactly R∪{±∞}\mathbb R \cup \{\pm\infty\}R∪{±∞}, a complete lattice, so their defining suprema are total functions with no side conditions). A trivializing formalization of the goal would quantify the right-hand side over a single fixed (Y,Z)(Y,Z)(Y,Z) pair, or over all of Zn\mathbb Z^nZn instead of the sign-pattern neighbors; both are excluded by keeping Y,ZY, ZY,Z universally quantified Finset (Fin n) ranging over the full 3n3^n3n sign-pattern space (minus the trivial case, which the equivalence still holds through vacuously).

Checked against the platform (GET /theorems?q=integrally convex, 0 hits) and against Mathlib's Analysis/Convex/ for the classical facts this chapter's proof would eventually need (ordinary convex-function local-to-global optimality, LP duality): these are broadly available in Mathlib's convex-analysis library in some form, but none of them is imported here, since none appears in the statement of any item this mission drafts — they belong to a proof this pass does not attempt. Contributions to a shared DiscreteConvex.IntegralConvexity definitions layer are welcome from chunks 06–09, which specialize integral convexity to M-convex and L-convex functions and will need the same convex-closure/local-extension vocabulary.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • P. Favati, F. Tardella, "Convexity in nonlinear integer programming," Ricerca Operativa, 53, 1990, pp. 3–44.
14 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

An Interactive Weighted Tchebycheff Procedure for Multiple Objective Programming II: The Lexicographic Weighted Tchebycheff Program Characterizes the Nondominated SetResearch Paper

Motivation

A multiple objective program asks to maximize kkk objectives f1(x),…,fk(x)f_1(x),\dots,f_k(x)f1​(x),…,fk​(x) simultaneously over a feasible set SSS. There is usually no point that is best in every objective, so the object of interest is the set of nondominated criterion vectors: those that cannot be improved in one objective without being worsened in another. Interactive procedures for multiple criteria decision making work by computing nondominated vectors one at a time, by solving a single-objective scalarization, and presenting them to a decision maker.

A scalarization is useful for this purpose only if it is complete (every nondominated vector is the solution of some instance of it) and sound (every solution is nondominated). The weighted-sum scalarization is sound for positive weights but not complete when the feasible region is nonconvex. R. E. Steuer and E.-U. Choo (Math. Programming 26 (1983) 326–344) built their interactive procedure on weighted Tchebycheff distances to an ideal point, following Bowman (1976) and Choo and Atkins (1983). In §3 they treat finite feasible regions with an augmented metric, which requires choosing a small parameter ρ>0\rho>0ρ>0. In §4 (pp. 334–336) they show that a lexicographic version of the weighted Tchebycheff program is complete and sound for any feasible region, including nonconvex continuous ones, with no parameter to estimate. This mission formalizes that result, Theorems 4.5 and 4.6.

Setting

Let Z⊆RkZ\subseteq\mathbb R^kZ⊆Rk, k≥1k\ge1k≥1, be the set of feasible criterion vectors (the image of SSS under f=(f1,…,fk)f=(f_1,\dots,f_k)f=(f1​,…,fk​)). A vector zzz dominates zˉ\bar zzˉ if zi≥zˉiz_i\ge\bar z_izi​≥zˉi​ for all iii and zi>zˉiz_i>\bar z_izi​>zˉi​ for at least one iii. The nondominated set N⊆ZN\subseteq ZN⊆Z consists of the zˉ∈Z\bar z\in Zzˉ∈Z dominated by no z∈Zz\in Zz∈Z.

An ideal criterion vector is a z∗∈Rkz^*\in\mathbb R^kz∗∈Rk with

zi∗=max⁡{zi∣z∈Z}+εi,z^*_i=\max\{z_i\mid z\in Z\}+\varepsilon_i,zi∗​=max{zi​∣z∈Z}+εi​,

where εi≥0\varepsilon_i\ge0εi​≥0, and εi>0\varepsilon_i>0εi​>0 is required whenever (i) more than one nondominated vector maximizes objective iii, or (ii) the only nondominated vector maximizing objective iii also maximizes another objective. So z∗z^*z∗ may touch ZZZ in coordinate iii only in a controlled way.

The weight set is the simplex Λˉ={λ∈Rk∣λi≥0, ∑iλi=1}\bar\Lambda=\{\lambda\in\mathbb R^k\mid\lambda_i\ge0,\ \sum_i\lambda_i=1\}Λˉ={λ∈Rk∣λi​≥0, ∑i​λi​=1}. For λ∈Λˉ\lambda\in\bar\Lambdaλ∈Λˉ the weighted Tchebycheff program minimizes α\alphaα subject to α≥λi(zi∗−zi)\alpha\ge\lambda_i(z^*_i-z_i)α≥λi​(zi∗​−zi​) for all iii and z∈Zz\in Zz∈Z; its value at a fixed zzz is

tλ(z)=max⁡1≤i≤kλi(zi∗−zi).t_\lambda(z)=\max_{1\le i\le k}\lambda_i(z^*_i-z_i).tλ​(z)=1≤i≤kmax​λi​(zi∗​−zi​).

The lexicographic weighted Tchebycheff program first minimizes tλt_\lambdatλ​ over ZZZ and then, among the first-stage minimizers, minimizes eT(z∗−z)=∑i(zi∗−zi)e^{\mathsf T}(z^*-z)=\sum_i(z^*_i-z_i)eT(z∗−z)=∑i​(zi∗​−zi​). The paper writes it as min⁡{P1α+P2eT(z∗−z)}\min\{P_1\alpha+P_2e^{\mathsf T}(z^*-z)\}min{P1​α+P2​eT(z∗−z)} with pre-emptive priority factors. Finally, for zˉ∈Rk\bar z\in\mathbb R^kzˉ∈Rk the weights λˉ\bar\lambdaλˉ of eq. (4.3) are λˉi∝1/(zi∗−zˉi)\bar\lambda_i\propto1/(z^*_i-\bar z_i)λˉi​∝1/(zi∗​−zˉi​), normalized to sum to one, when zˉj≠zj∗\bar z_j\ne z^*_jzˉj​=zj∗​ for all jjj. When some zˉj=zj∗\bar z_j=z^*_jzˉj​=zj∗​, λˉi\bar\lambda_iλˉi​ is 111 on the coordinates with zˉi=zi∗\bar z_i=z^*_izˉi​=zi∗​ and 000 elsewhere.

Formalization targets

Goal: Theorem 4.6 (p. 336)

For compact ZZZ, an ideal vector z∗z^*z∗ and zˉ∈Z\bar z\in Zzˉ∈Z,

zˉ∈N  ⟺  ∃ λ∈Λˉ such that zˉ minimizes the lexicographic weighted Tchebycheff program with weights λ.\bar z\in N\iff\exists\,\lambda\in\bar\Lambda\ \text{such that}\ \bar z\ \text{minimizes the lexicographic weighted Tchebycheff program with weights }\lambda .zˉ∈N⟺∃λ∈Λˉ such that zˉ minimizes the lexicographic weighted Tchebycheff program with weights λ.

Milestones

  1. Proof of Theorem 4.5 (pp. 335–336). For zˉ∈N\bar z\in Nzˉ∈N, λˉ\bar\lambdaλˉ as in (4.3) and α^\hat\alphaα^ the minimal first-stage value,
zˉ∈Φ(α^),N∩Φ(α^)={zˉ},Φ(α^)={z∣zi≥zi∗−α^/λˉi when λˉi>0}.\bar z\in\Phi(\hat\alpha),\qquad N\cap\Phi(\hat\alpha)=\{\bar z\},\qquad \Phi(\hat\alpha)=\{z\mid z_i\ge z^*_i-\hat\alpha/\bar\lambda_i\ \text{when}\ \bar\lambda_i>0\}.zˉ∈Φ(α^),N∩Φ(α^)={zˉ},Φ(α^)={z∣zi​≥zi∗​−α^/λˉi​ when λˉi​>0}.
  1. Theorem 4.5 (p. 335). For zˉ∈N\bar z\in Nzˉ∈N: λˉ∈Λˉ\bar\lambda\in\bar\Lambdaλˉ∈Λˉ, and zˉ\bar zzˉ is the unique minimizer of the lexicographic program with weights λˉ\bar\lambdaλˉ.
  2. Remark after Theorem 4.6 (p. 336). For every λ∈Λˉ\lambda\in\bar\Lambdaλ∈Λˉ the lexicographic program has a minimizer when ZZZ is compact and nonempty, and every minimizer is nondominated.

The goal is the characterization; Theorem 4.5 is the stronger half with uniqueness and an explicit weight.

Significance

Theorem 4.6 says that, as λ\lambdaλ ranges over the simplex, the lexicographic weighted Tchebycheff program returns exactly the nondominated set, for any feasible region: no convexity, no finiteness, no polyhedral structure. Theorem 4.5 adds that each nondominated vector is the unique output for a weight vector computable from the vector itself, which is what an interactive procedure needs to sample NNN reliably. The price, as the paper notes, is two optimization stages instead of one; the gain is that no augmentation parameter ρ\rhoρ must be estimated. The result is a standard entry in the textbook treatment of Tchebycheff scalarizations (Steuer, Multiple Criteria Optimization, 1986; Ehrgott, Multicriteria Optimization, 2005).

The result is proved on paper. To our knowledge no machine-checked version exists in Lean or Mathlib, which has no material on Tchebycheff scalarization of multiple objective programs. The formal statements below also pin down two points the printed text leaves loose: the direction of the priority factors, and a closedness assumption that the proof uses without stating it.

Difficulty

The ⇐ direction and the soundness remark are short: a dominating vector is at least as good in the first stage and strictly better in the second. The work is in Theorem 4.5. The obvious argument is that zˉ\bar zzˉ is the unique minimizer of the first stage with weights λˉ\bar\lambdaλˉ; the paper says so. That is true when zˉ<z∗\bar z<z^*zˉ<z∗ in every coordinate, but false when zˉj=zj∗\bar z_j=z^*_jzˉj​=zj∗​ for some jjj: then λˉ=ej\bar\lambda=e_jλˉ=ej​, and every z∈Zz\in Zz∈Z with zj=zj∗z_j=z^*_jzj​=zj∗​ ties with zˉ\bar zzˉ, dominated vectors included. For example, with Z={(5,3),(5,1),(1,10)}Z=\{(5,3),(5,1),(1,10)\}Z={(5,3),(5,1),(1,10)} and z∗=(5,10)z^*=(5,10)z∗=(5,10), the vectors (5,3)(5,3)(5,3) and (5,1)(5,1)(5,1) tie. Only the second stage separates them. Showing that it always selects zˉ\bar zzˉ requires every tied vector to lie below a nondominated vector attaining zj∗z^*_jzj∗​, which by the ideal-vector rule must be zˉ\bar zzˉ. That existence step fails for sets that are not closed.

Formalization scope

Criterion vectors are Fin k → ℝ with [NeZero k] (k≥1k\ge1k≥1); objectives are indexed from 000. SSS, the objectives fif_ifi​ and the program's variable α\alphaα are eliminated: ZZZ is a Set (Fin k → ℝ) and the first-stage value is tλ(z)t_\lambda(z)tλ​(z) above (the paper's metric uses ∣zi∗−zi∣|z^*_i-z_i|∣zi∗​−zi​∣, which agrees with zi∗−ziz^*_i-z_izi∗​−zi​ on ZZZ). Λˉ\bar\LambdaΛˉ is Mathlib's stdSimplex ℝ (Fin k). "Minimizes" is global minimization over ZZZ; "uniquely minimizes" means every lexicographic minimizer equals zˉ\bar zzˉ as a criterion vector.

Conventions and added hypotheses:

  • The lexicographic program is encoded as the two-stage minimization IsLexMin. The printed "P1<<<P2P_1<<<P_2P1​<<<P2​" read literally gives the second stage priority; the paper's text on p. 336 and the goal-programming convention it cites give α\alphaα priority. The two-stage reading is encoded, and the program is not replaced by a weighted sum P1α+P2eT(z∗−z)P_1\alpha+P_2e^{\mathsf T}(z^*-z)P1​α+P2​eT(z∗−z) with fixed numbers, which would be the augmented program of §3.
  • ZZZ compact is an added hypothesis in Theorem 4.5, in the goal, and in the existence half of milestone 3. The paper assumes only that SSS is bounded, and its "max" in the ideal vector presupposes attainment. Without closedness the weight (4.3) can fail: for Z={(5,3,0),(0,10,0),(0,0,6)}∪{(5,0,4+t):0≤t<1}Z=\{(5,3,0),(0,10,0),(0,0,6)\}\cup\{(5,0,4+t):0\le t<1\}Z={(5,3,0),(0,10,0),(0,0,6)}∪{(5,0,4+t):0≤t<1}, z∗=(5,10,6)z^*=(5,10,6)z∗=(5,10,6) and zˉ=(5,3,0)∈N\bar z=(5,3,0)\in Nzˉ=(5,3,0)∈N, the program with λˉ=(1,0,0)\bar\lambda=(1,0,0)λˉ=(1,0,0) has no lexicographic minimizer. Closedness is needed by the theorem itself, not only by this proof: adding the points (5−s2, 3+s, 0)(5-s^2,\,3+s,\,0)(5−s2,3+s,0), 0<s≤10<s\le10<s≤1, to that ZZZ (still bounded, ε=0\varepsilon=0ε=0 still admissible) leaves zˉ=(5,3,0)∈N\bar z=(5,3,0)\in Nzˉ=(5,3,0)∈N a lexicographic minimizer for no λ∈Λˉ\lambda\in\bar\Lambdaλ∈Λˉ, so Theorems 4.5 and 4.6 are false for a bounded, non-closed ZZZ. The ⇐ direction, soundness and milestone 1 hold without compactness and are stated without it.
  • The ideal vector keeps the paper's ε\varepsilonε-rule exactly. Replacing it with a strictly dominating z∗z^*z∗ (ε>0\varepsilon>0ε>0 in every coordinate) would remove the case zˉj=zj∗\bar z_j=z^*_jzˉj​=zj∗​ and weaken both theorems; such a formalization does not count.
  • In (4.3) and in Φ\PhiΦ, division occurs only where the denominator is nonzero. That λˉ∈Λˉ\bar\lambda\in\bar\Lambdaλˉ∈Λˉ for zˉ∈N\bar z\in Nzˉ∈N is part of Theorem 4.5's conclusion, not an assumption.
  • The paper's sentence "the associated weighted Tchebycheff program has a unique solution" (p. 336) is not formalized, since it fails in the tie described above.

Infrastructure needed: dominance and nondominated sets, the ideal vector, the weighted Tchebycheff value, the weights (4.3), and the lexicographic minimizer, all provided as definitions. Proofs will need existence of minimizers of continuous functions on compact sets and a maximal-element argument in the product order on a compact set. Both are reusable for other multiobjective results. Proofs of any item, and faithful statements of Corollaries 4.1 and 4.4 (polyhedral SSS), are welcome.

Selected references

  • R. E. Steuer and E.-U. Choo, An interactive weighted Tchebycheff procedure for multiple objective programming, Mathematical Programming 26 (1983) 326–344. https://doi.org/10.1007/BF02591870
  • V. J. Bowman, On the relationship of the Tchebycheff norm and the efficient frontier of multiple-criteria objectives, in: Multiple Criteria Decision Making (Jouy-en-Josas 1975), Lecture Notes in Economics and Mathematical Systems 130, Springer, 1976, 76–86. https://doi.org/10.1007/978-3-642-87563-2_5
  • E.-U. Choo and D. R. Atkins, Proper efficiency in nonconvex multicriteria programming, Mathematics of Operations Research 8 (1983) 467–470. https://doi.org/10.1287/moor.8.3.467
  • A. M. Geoffrion, Proper efficiency and the theory of vector maximization, Journal of Mathematical Analysis and Applications 22 (1968) 618–630. https://doi.org/10.1016/0022-247X(68)90201-1
  • M. Ehrgott, Multicriteria Optimization, 2nd ed., Springer, 2005. https://doi.org/10.1007/3-540-27659-9
10 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchProbability·Captain: Shuze Chen

Markov Decision Processes V: No-Arbitrage in Discrete-Time Financial MarketsTextbook

Motivation

Every financial application in the rest of this book — terminal wealth maximization, portfolio choice with consumption, index tracking, hedging — takes as given that the underlying market admits no risk-free profit: an arbitrage opportunity. Ruling this out is not a modeling nicety but a structural necessity, since a market with arbitrage has no sensible notion of a fair price at all. Bäuerle and Rieder's Chapter 3 fixes the discrete- and continuous-time market vocabulary the rest of the book builds on, and proves the one structural fact about no-arbitrage that the later chapters actually invoke: that the whole-horizon, global absence of arbitrage is equivalent to a much simpler one-period condition, checked separately at each stage. This reduction — not the deeper fundamental theorem of asset pricing (existence of an equivalent martingale measure), which the book does not prove in this section — is what turns a statement about strategies over the whole time horizon into something checkable stage by stage, exactly the form needed to embed a no-arbitrage assumption into a dynamic-programming argument.

Setting

An NNN-period financial market with ddd risky assets consists of a probability space (Ω,F,P)(\Omega,\mathcal{F},\mathbb{P})(Ω,F,P) with filtration (Fn)n=0N(\mathcal{F}_n)_{n=0}^N(Fn​)n=0N​, F0\mathcal{F}_0F0​ trivial; a riskless bond with deterministic interest rate ini_nin​ on [n−1,n)[n-1,n)[n−1,n) (so Sn0=Sn−10(1+in)S^0_n = S^0_{n-1}(1+i_n)Sn0​=Sn−10​(1+in​)); and ddd risky assets with relative price changes R~n=(R~n1,…,R~nd)\tilde R_n = (\tilde R^1_n,\dots,\tilde R^d_n)R~n​=(R~n1​,…,R~nd​), Fn\mathcal{F}_nFn​-measurable and a.s. strictly positive (Snk=Sn−1kR~nkS^k_n = S^k_{n-1}\tilde R^k_nSnk​=Sn−1k​R~nk​). A portfolio (trading strategy) is an (Fn)(\mathcal{F}_n)(Fn​)-adapted process φ=(φn0,φn)\varphi = (\varphi^0_n,\varphi_n)φ=(φn0​,φn​), φn0∈R\varphi^0_n \in \mathbb{R}φn0​∈R, φn∈Rd\varphi_n \in \mathbb{R}^dφn​∈Rd; φnk\varphi^k_nφnk​ is the money invested in asset kkk on [n,n+1)[n,n+1)[n,n+1). Its value before/after trading at time nnn is Xn−:=φn−10(1+in)+φn−1⋅R~nX_n^- := \varphi^0_{n-1}(1+i_n) + \varphi_{n-1}\cdot\tilde R_nXn−​:=φn−10​(1+in​)+φn−1​⋅R~n​, Xn+:=φn0+φn⋅eX_n^+ := \varphi^0_n + \varphi_n\cdot eXn+​:=φn0​+φn​⋅e; φ\varphiφ is self-financing if Xn−=Xn+X_n^- = X_n^+Xn−​=Xn+​ a.s. for every interior nnn. An arbitrage opportunity is a self-financing φ\varphiφ with X0φ=0X_0^\varphi = 0X0φ​=0, XNφ≥0X_N^\varphi \geq 0XNφ​≥0 a.s., XNφ>0X_N^\varphi > 0XNφ​>0 with positive probability. The relative risk process Rnk:=R~nk/(1+in)−1R_n^k := \tilde R_n^k/(1+i_n) - 1Rnk​:=R~nk​/(1+in​)−1 is the excess return of asset kkk over the riskless rate.

Formalization targets

Goal — Theorem 3.1.5

No arbitrage  ⟺  ∀ n<N, ∀ Fn-measurable φn∈Rd:φn⋅Rn+1≥0 a.s.  ⟹  φn⋅Rn+1=0 a.s.\text{No arbitrage} \iff \forall\, n < N,\ \forall\, \mathcal{F}_n\text{-measurable } \varphi_n \in \mathbb{R}^d: \quad \varphi_n \cdot R_{n+1} \geq 0 \text{ a.s.} \implies \varphi_n \cdot R_{n+1} = 0 \text{ a.s.}No arbitrage⟺∀n<N, ∀Fn​-measurable φn​∈Rd:φn​⋅Rn+1​≥0 a.s.⟹φn​⋅Rn+1​=0 a.s.

This is the weakest stable statement that captures the reduction: it asserts the equivalence of the global, whole-horizon absence of arbitrage strategies with a one-period static condition on the relative risk vector, without asserting the stronger (and here unproved) existence of a martingale measure.

No further milestone is formalized in this mission: this chapter's only other theorem, Theorem 3.3.1 (binomial-tree weak convergence to Black-Scholes), needs the Skorokhod topology on the space of càdlàg paths, absent from Mathlib and out of scope to construct here — see the Formalization scope section and HARD.md.

Significance

Theorem 3.1.5 is the tool that lets every later chapter's "assume the market has no arbitrage" hypothesis be checked and used one period at a time rather than as a global existential statement over an intractably large space of strategies. It is also the precise, minimal claim this section proves: contrasted with the full fundamental theorem of asset pricing (no arbitrage   ⟺  \iff⟺ existence of an equivalent martingale measure, due to Harrison–Kreps 1979 and Dalang–Morton–Willinger 1990 in this discrete-time generality), Theorem 3.1.5 is a strictly weaker, purely measure-theoretic reduction that requires no separating-hyperplane or martingale-measure construction to state (only to prove). The definitions this chunk formalizes alongside it — portfolios, self-financing, arbitrage, and utility functions with the Arrow-Pratt risk-aversion coefficient — are the vocabulary every financial mission of this book (Chapters 4, 6, 9, 11) is built from.

Formalizing it contributes the exact discrete-time, filtration-indexed statement of the reduction — a result absent from the platform (searched "arbitrage", "self-financing", "martingale measure", "utility function"; the one related hit, LinearOptimization.no_arbitrage_iff_state_prices, is a static single-period linear-programming duality statement — no-arbitrage iff nonnegative state prices exist for a fixed return matrix — a different equivalence for a different, non-stochastic model, not reused here).

Difficulty

The direction "local no-free-lunch at every stage ⇒\Rightarrow⇒ no arbitrage" is the easy one: an arbitrage strategy, unwound via the recursive wealth formula, forces a violation of the local condition at some stage by a stopping-time argument on the first period where the wealth increment is a.s. nonnegative and not a.s. zero. The converse, "an arbitrage opportunity forces the local condition to fail somewhere," is the direction that needs the reduction of the whole-horizon problem to a single period: the natural first attempt (induct forward from n=0n=0n=0) does not directly work, because whether a strategy is an arbitrage is a statement about the terminal wealth XNX_NXN​, and a violation at an early stage does not obviously propagate; the book's proof instead identifies, from an arbitrage strategy, the last stage at which the one-period condition fails and constructs a genuinely one-period arbitrage there — an argument that needs care with the a.s.-qualifiers at every step (the difference between "X≥0X \geq 0X≥0 a.s." failing to imply "X<0X < 0X<0 with positive probability" only up to null sets is exactly where the measure-theoretic bookkeeping matters).

Formalization scope

The market is represented via DiscreteFinancialMarket, bundling the probability space, filtration, and the two primitives (iii, R~\tilde RR~) actually used; price processes S0,SkS^0, S^kS0,Sk are not separately represented, since they would only be running products of these two primitives with no further role once the relative risk process RRR is derived. Filtration is represented directly as a monotone family of sub-σ\sigmaσ-algebras with a trivial Fam 0, not via Mathlib's Filtration structure, to avoid instance-juggling that would add no content here. Adaptedness/predictability and the a.s. conditions of every definition are exactly the book's own. Definitions 3.2.1-3.2.2 (the continuous-time portfolio and its self-financing condition, needed by chunk 09b's jump-market model) use an abstract StochasticIntegral operator taken as given data, since Mathlib has no general theory of integration against an arbitrary càdlàg semimartingale (only specific constructions such as Itô integration against Brownian motion); this is a deliberate infrastructure gap flagged for whoever eventually needs to instantiate it, not a hidden simplification of the definition's own content, which states the self-financing equation exactly as the book writes it.

Theorem 3.3.1 is not formalized in this mission and is recorded in HARD.md. The theorem asserts weak convergence of the whole path of the binomial-tree price process to the Black-Scholes-Merton stock price on the Skorokhod space D[0,T]D[0,T]D[0,T] of càdlàg functions with the Skorokhod topology — a materially stronger and more setup-heavy claim than finite-dimensional convergence in distribution, and the book explicitly names this topology (it is not left implicit). Mathlib has no formalization of D[0,T]D[0,T]D[0,T] or the Skorokhod topology, and building either from scratch (the space of càdlàg functions, the Skorokhod metric via time-warpings, the tightness criteria needed for Donsker-type invariance principles) is a substantial undertaking outside the scope of a single milestone; weakening the claim to convergence of finite-dimensional distributions, or silently substituting an unnamed alternative topology (e.g. uniform convergence, under which the claim would in fact be false, since the discretized paths have jumps the limit does not), would misstate the theorem rather than state a smaller piece of it faithfully. A general-purpose Skorokhod-space/Skorokhod-topology formalization in Mathlib — reusable well beyond this book — is the prerequisite contribution that would unlock this result.

No trivializing formalization: NoArbitrage quantifies over all self-financing portfolios (Portfolio M, an unrestricted adapted process, not a finite or parametrized family), and the one-period condition of part b) quantifies over all Fn\mathcal{F}_nFn​-measurable φn∈Rd\varphi_n \in \mathbb{R}^dφn​∈Rd — narrowing either quantifier (e.g. to strategies with bounded positions) would state a weaker, easier claim than the book's own theorem.

Selected references

  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Universitext, Springer, 2011. https://doi.org/10.1007/978-3-642-18324-9
  • J. M. Harrison and D. M. Kreps, "Martingales and arbitrage in multiperiod securities markets", Journal of Economic Theory, 1979 (the discrete-time fundamental theorem of asset pricing this chapter's Theorem 3.1.5 is a structural lemma toward, not itself proved in this section).
6 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchProbability·Captain: Shuze Chen

Markov Decision Processes IV: Stationary Markov Decision Models and Three Worked ExamplesTextbook

Motivation

Most concrete applications of Markov Decision Theory — inventory control, cash management, linear-quadratic regulation, sequential games — have data that does not change from one period to the next: the same state space, action space, transition mechanism and reward apply at every stage, only discounted by a fixed factor β\betaβ per period. Bäuerle and Rieder's Chapter 2, §2.5 specializes the general finite-horizon theory of the previous sections to this stationary case, and §2.6 shows the specialization at work on three classical models: a card game with a famously boring answer, a firm's cash-management problem, and stochastic linear-quadratic control. Together they demonstrate the payoff of the abstract theory: once the Structure Assumption is checked for a stationary model, the general machinery (the Forward Induction Algorithm) produces the concrete optimal policy — a critical-level (s,S)(s,S)(s,S)-type control for cash management, a linear feedback law for LQ control — with no further case-specific argument.

Setting

A stationary Markov Decision Model is a Markov Decision Model (E,A,D,Q,r,g)(E,A,D,Q,r,g)(E,A,D,Q,r,g) (Definition 2.1.1) whose data does not depend on the stage: the reward at absolute time nnn is βnr\beta^n rβnr and the terminal reward at time NNN is βNg\beta^N gβNg, for a fixed discount β∈(0,1]\beta \in (0,1]β∈(0,1]. For a policy sequence π=(f0,…,fn−1)∈Fn\pi = (f_0,\dots,f_{n-1}) \in F^nπ=(f0​,…,fn−1​)∈Fn (each fkf_kfk​ a decision rule E→AE \to AE→A with fk(x)∈D(x)f_k(x) \in D(x)fk​(x)∈D(x)), the reward-to-go is Jnπ(x):=Exπ[∑k=0n−1βkr(Xk,fk(Xk))+βng(Xn)]J_n^\pi(x) := \mathbb{E}^\pi_x\bigl[\sum_{k=0}^{n-1} \beta^k r(X_k,f_k(X_k)) + \beta^n g(X_n)\bigr]Jnπ​(x):=Exπ​[∑k=0n−1​βkr(Xk​,fk​(Xk​))+βng(Xn​)] and the value function is Jn(x):=sup⁡π∈FnJnπ(x)J_n(x) := \sup_{\pi \in F^n} J_n^\pi(x)Jn​(x):=supπ∈Fn​Jnπ​(x). The operators (Lv)(x,a):=r(x,a)+β∫v(x′) Q(dx′∣x,a)(Lv)(x,a) := r(x,a) + \beta\int v(x')\,Q(dx'\mid x,a)(Lv)(x,a):=r(x,a)+β∫v(x′)Q(dx′∣x,a), (Tv)(x):=sup⁡a∈D(x)(Lv)(x,a)(Tv)(x) := \sup_{a \in D(x)} (Lv)(x,a)(Tv)(x):=supa∈D(x)​(Lv)(x,a), (Tfv)(x):=(Lv)(x,f(x))(T^f v)(x) := (Lv)(x,f(x))(Tfv)(x):=(Lv)(x,f(x)) are the stationary counterparts of §2.3's non-stationary operators. The (stationary) Structure Assumption (SAN) asks for sets I ⁣M⊆I ⁣M(E)\mathrm{I\!M} \subseteq \mathrm{I\!M}(E)IM⊆IM(E), Δ⊆F\Delta \subseteq FΔ⊆F with g∈I ⁣Mg \in \mathrm{I\!M}g∈IM, v∈I ⁣M⇒Tv∈I ⁣Mv \in \mathrm{I\!M} \Rightarrow Tv \in \mathrm{I\!M}v∈IM⇒Tv∈IM, and every v∈I ⁣Mv \in \mathrm{I\!M}v∈IM having a maximizer in Δ\DeltaΔ.

Formalization targets

Goal — Theorem 2.6.2 (the cash balance problem)

A firm's cash level x∈Rx \in \mathbb{R}x∈R moves under i.i.d. shocks; each period the firm transfers to a new level aaa at linear cost c(a−x)=cu(a−x)++cd(a−x)−c(a-x) = c_u(a-x)^+ + c_d(a-x)^-c(a−x)=cu​(a−x)++cd​(a−x)−, pays a convex, coercive holding cost L(a)L(a)L(a) (L(0)=0L(0)=0L(0)=0), and the level becomes a−Zn+1a - Z_{n+1}a−Zn+1​. Modeled as a stationary MDM with E=A=RE=A=\mathbb{R}E=A=R, r(x,a)=−c(a−x)−L(a)r(x,a) = -c(a-x) - L(a)r(x,a)=−c(a−x)−L(a), g≡0g \equiv 0g≡0:

∃ Sn−≤Sn+ (depending on n):Jn(x)={(Sn−−x)cu+L(Sn−)+β E[Jn−1(Sn−−Z)]x<Sn−L(x)+β E[Jn−1(x−Z)]Sn−≤x≤Sn+(x−Sn+)cd+L(Sn+)+β E[Jn−1(Sn+−Z)]x>Sn+,\exists\, S_n^- \le S_n^+ \ \text{(depending on $n$)}: \quad J_n(x) = \begin{cases} (S_n^- - x)c_u + L(S_n^-) + \beta\,\mathbb{E}[J_{n-1}(S_n^- - Z)] & x < S_n^- \\ L(x) + \beta\,\mathbb{E}[J_{n-1}(x-Z)] & S_n^- \le x \le S_n^+ \\ (x-S_n^+)c_d + L(S_n^+) + \beta\,\mathbb{E}[J_{n-1}(S_n^+ - Z)] & x > S_n^+, \end{cases}∃Sn−​≤Sn+​ (depending on n):Jn​(x)=⎩⎨⎧​(Sn−​−x)cu​+L(Sn−​)+βE[Jn−1​(Sn−​−Z)]L(x)+βE[Jn−1​(x−Z)](x−Sn+​)cd​+L(Sn+​)+βE[Jn−1​(Sn+​−Z)]​x<Sn−​Sn−​≤x≤Sn+​x>Sn+​,​

with J0≡0J_0 \equiv 0J0​≡0, and the optimal policy transfers up to Sn−S_n^-Sn−​ below it, down to Sn+S_n^+Sn+​ above it, and does nothing in between. This is the weakest stable statement: it asserts the existence of critical levels with the stated recursive characterization, not any closed form for Sn±S_n^\pmSn±​ itself (which depends on LLL's exact shape and is not computable in general).

Three milestones build toward and alongside it: the Reward Iteration theorem and stationary Structure Theorem (Theorems 2.5.3-2.5.4, the general machinery instantiated), the trivial-but- sharp red-and-black card game (Theorem 2.6.1), and the stochastic linear-quadratic problem (Theorem 2.6.3, a Riccati-type recursion with random coefficients).

Significance

Theorem 2.6.2 is the textbook derivation of (s,S)(s,S)(s,S)-type control, the dominant policy structure in inventory theory and cash management: a firm should act only when its state leaves a band, and should act to bring it exactly to the band's edge, never further. Its proof pattern — verify (SAN) with I ⁣M\mathrm{I\!M}IM the convex functions of at most linear growth, extract the critical levels from the derivative conditions of a one-stage minimization — is the template used across the inventory-control literature for essentially every variant of this problem. Theorem 2.6.1's answer ("no strategy beats stopping immediately") is a genuine, if minimal, comparative-statics fact: a positive-content instance of I ⁣M\mathrm{I\!M}IM collapsing to functions constant on the game's absorbing set, forcing every action to be a maximizer. Theorem 2.6.3's Riccati-type recursion, with random transition coefficients, generalizes the classical deterministic-coefficient LQR (linear-quadratic regulator) of control theory; the recursion governs mean-variance and quadratic-hedging problems return to in later chapters of this book (Chapters 4 and 6).

None of the three examples' specific results were found on the platform (searched for "comparative statics", "convex Markov decision", the exact model names, and "bang-bang"/"LQR" adjacent terms). BertsekasDP.riccati_completion_of_square is the platform's one close relative to Theorem 2.6.3: it solves the deterministic-coefficient LQR by a completion-of-squares argument, not the random-coefficient recursion here, so it is cited as related work rather than reused. The proofs themselves are complete and self-contained in the book (a few pages each, using only single-variable convex analysis and elementary linear algebra); this mission contributes the formal statement of each, in its full generality (general convex LLL, general random (A,B)(A,B)(A,B) coefficient pairs), as the task for a sorry-free proof.

Difficulty

The cash-balance proof's central step is showing the minimizer of the one-stage problem is of critical-level form for every vvv in the candidate class I ⁣M\mathrm{I\!M}IM — not just for the particular sequence J0,J1,…J_0, J_1, \dotsJ0​,J1​,… that eventually arises. The obvious shortcut, guessing the form of JnJ_nJn​ directly and verifying it solves the Bellman equation by substitution, fails because Sn−,Sn+S_n^-, S_n^+Sn−​,Sn+​ are themselves defined only implicitly, via one-sided derivative conditions on L(x)+βE[v(x−Z)]L(x) + \beta\mathbb{E}[v(x-Z)]L(x)+βE[v(x−Z)]; there is no closed form to substitute except in degenerate special cases (e.g. LLL quadratic). The genuine content is the general argument (convexity of the one-stage objective forces a unique critical-level minimizer structure, and this structure is preserved under TTT) that lets the induction go through for an arbitrary convex, coercive LLL. For Theorem 2.6.3, the natural first attempt — solve the deterministic LQR recursion and substitute expected coefficient matrices for the random ones — is not obviously valid, since E[B⊤QB]≠(E[B])⊤Q E[B]\mathbb{E}[B^\top Q B] \ne (\mathbb{E}[B])^\top Q\,\mathbb{E}[B]E[B⊤QB]=(E[B])⊤QE[B] in general; the correct recursion genuinely involves the joint second moments of (A,B)(A,B)(A,B), which is exactly what the standing positive-definiteness assumption on E[B⊤QB]\mathbb{E}[B^\top Q B]E[B⊤QB] (not on E[B]\mathbb{E}[B]E[B] itself) is there to make precise.

Formalization scope

The stationary vocabulary (StationaryMarkovDecisionModel, its operators, J, (SAN)) is restated independently of chunk 02a's non-stationary vocabulary — drafts in this series cannot import one another, and the book itself keeps the two notationally separate (JnJ_nJn​ vs. VnV_nVn​, related by Vn(x)=βnJN−n(x)V_n(x) = \beta^n J_{N-n}(x)Vn​(x)=βnJN−n​(x), a relation this mission does not separately formalize since no listed result needs it). Theorem 2.6.3's stochastic LQ problem is explicitly non-stationary in the book's own text, so a second, NS-prefixed restatement of the non- stationary model and value function (via the Bellman recursion established as Theorem 2.3.8, not the sup-over-policies primitive — the same simplification chunk 02c makes for its own V) is introduced solely for that one theorem. The card game (Theorem 2.6.1) is formalized on the concrete state space N×N\mathbb{N} \times \mathbb{N}N×N and action space Bool, with the model's exact transition density, reward and terminal reward given as hypotheses on an abstract StationaryMarkovDecisionModel, matching the book's own discrete-density notation q(x′∣x,a):=Q({x′}∣x,a)q(x'\mid x,a) := Q(\{x'\}\mid x,a)q(x′∣x,a):=Q({x′}∣x,a) (introduced in the text following Theorem 2.5.4) rather than built from an explicit PMF/Kernel construction — a lighter-weight but equally precise formalization, since the density equations pin the kernel exactly. The stochastic LQ problem uses Matrix (Fin m) (Fin m) ℝ and needs a MeasurableSpace (Matrix m n α) instance Mathlib does not provide (Matrix is a non-reducible def for m → n → α); this mission supplies it by transport across the definitional equality. Random matrix moments E[F(A,B)]\mathbb{E}[F(A,B)]E[F(A,B)] are computed entrywise as ordinary Bochner integrals against the joint law of (A,B)(A,B)(A,B).

A trivializing formalization is ruled out on two fronts: the cash-balance critical levels Sn−,Sn+S_n^-, S_n^+Sn−​,Sn+​ are existentially quantified as functions of nnn, not fixed constants (dropping the index would silently claim a single band works for every horizon length, which is false in general); and the card game's "every strategy is optimal" is stated as a universally-quantified claim over all policy sequences, not weakened to mere existence of an optimal one. Reusable infrastructure: the jointMatMean/xQx helpers and the MeasurableSpace (Matrix m n α) instance are generic and available to any later chunk needing random-matrix moments (none of the remaining chunks' briefs currently list one, but Chapter 4's mean-variance and LQ-flavored missions may). sorry-free proofs of all five items are welcome contributions; Theorem 2.5.3's short inductive proof (unwinding the accumulator definition against the operator-composition recursion) is likely the easiest entry point.

Selected references

  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Universitext, Springer, 2011. https://doi.org/10.1007/978-3-642-18324-9
  • D. P. Bertsekas, Dynamic Programming and Optimal Control, Vol. I, 3rd ed., Athena Scientific, 2005 (the classical deterministic-coefficient LQR, BertsekasDP.riccati_completion_of_square on the platform).
13 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs II: The Due-Date Schedule at the Least Feasible Cost Level Minimizes the Maximum Deferral CostResearch Paper

Motivation

Single-machine sequencing with deferral costs asks how to order jobs when the price of finishing a job depends on when it finishes. A job completed at time sss incurs the cost Pi(s)P_i(s)Pi​(s); lateness penalties, holding costs and service-level penalties are special cases. Two objectives are standard: the sum of the costs, studied by McNaughton (Management Science 6(1), 1959) and Lawler (Management Science 11(2), 1964), and the maximum cost, the bottleneck objective, which asks that no single job be charged too much.

At the end of his 1968 paper on minimizing the number of late jobs (Moore, Management Science 15(1)), J. M. Moore added a short section, suggested by E. L. Lawler, showing that the maximum-cost problem reduces to a family of feasibility problems with due-dates. Each such problem is settled by one sort, by Jackson's earliest-due-date rule (J. R. Jackson, Scheduling a Production Line to Minimize Maximum Tardiness, UCLA Research Report 43, 1955). This reduction is the unconstrained case of what later became Lawler's algorithm for 1∣prec∣fmax⁡1|\mathrm{prec}|f_{\max}1∣prec∣fmax​ (Lawler, Management Science 19(5), 1973).

Timeline:

  • 1955: Jackson shows that ordering jobs by due-date minimizes the maximum tardiness, so a schedule with no late jobs exists iff the due-date order has none.
  • 1959, 1964: McNaughton and Lawler study the sum of deferral costs.
  • 1968: Moore (this paper) reduces the maximum deferral cost to Jackson's lemma through the generalized inverses Pi∗P_i^*Pi∗​.
  • 1973: Lawler's backward rule handles general non-decreasing costs with precedence constraints.

Setting

A finite nonempty set JJJ of jobs is processed on one machine that starts at time 000 and runs without idle time or preemption. Job jjj has processing time tj≥0t_j \ge 0tj​≥0. A schedule SSS is an ordering of JJJ with each job appearing exactly once, and CjSC_j^SCjS​ is the completion time of jjj in SSS: the sum of the processing times of jjj and of every job before it.

Each job has a deferral cost Pj:R→RP_j : \mathbb R \to \mathbb RPj​:R→R, which is continuous, bounded and non-decreasing. The maximum deferral cost of SSS is

maxCost(S)=max⁡j∈JPj(CjS).\mathrm{maxCost}(S) = \max_{j \in J} P_j(C_j^S).maxCost(S)=j∈Jmax​Pj​(CjS​).

For a cost level yyy, the generalized inverse Pj∗(y)∈R∪{+∞}P_j^*(y) \in \mathbb R \cup \{+\infty\}Pj∗​(y)∈R∪{+∞} is the latest time at which job jjj can be completed at cost at most yyy. Following the paper's definition (p. 108), with times s≥0s \ge 0s≥0:

  • Pj∗(y)=max⁡{s≥0:Pj(s)=y}P_j^*(y) = \max\{s \ge 0 : P_j(s) = y\}Pj∗​(y)=max{s≥0:Pj​(s)=y} if that level set is nonempty (this includes the paper's case of an existing inverse);
  • Pj∗(y)=0P_j^*(y) = 0Pj∗​(y)=0 if Pj(s)>yP_j(s) > yPj​(s)>y for all s≥0s \ge 0s≥0;
  • Pj∗(y)=+∞P_j^*(y) = +\inftyPj∗​(y)=+∞ if Pj(s)<yP_j(s) < yPj​(s)<y for all s≥0s \ge 0s≥0.

For each y>0y > 0y>0, SD(y)S_D(y)SD​(y) is a schedule ordered by the "due-dates" Dj=Pj∗(y)D_j = P_j^*(y)Dj​=Pj∗​(y), with ties broken arbitrarily. SD(y)S_D(y)SD​(y) has no late jobs if CjSD(y)≤Pj∗(y)C_j^{S_D(y)} \le P_j^*(y)CjSD​(y)​≤Pj∗​(y) for every jjj.

In Lean these are IsSchedule, completionTime, Pstar, NoLateAt and maxCost in the namespace MooreLateJobs.MaxDeferral.

Formalization targets

Goal: SD(y∗)S_D(y^*)SD​(y∗) is optimal

Let y∗>0y^* > 0y∗>0 satisfy: (1) SD(y∗)S_D(y^*)SD​(y∗) has no late jobs; (2) for every 0<y<y∗0 < y < y^*0<y<y∗, SD(y)S_D(y)SD​(y) has at least one late job. Then for every schedule SSS of JJJ,

maxCost(SD(y∗))≤maxCost(S).\mathrm{maxCost}\bigl(S_D(y^*)\bigr) \le \mathrm{maxCost}(S).maxCost(SD​(y∗))≤maxCost(S).

This is the last sentence of the section (p. 109). The goal takes y∗y^*y∗ with its two properties as given, so it needs no hypothesis beyond the model.

Milestones

  1. Lemma (Jackson), p. 105: a schedule with no late jobs exists iff every due-date ordering has none. It is stated for extended-real due-dates, which is how the section uses it.
  2. Monotonicity of Pj∗P_j^*Pj∗​, p. 109: y1≤y2⇒Pj∗(y1)≤Pj∗(y2)y_1 \le y_2 \Rightarrow P_j^*(y_1) \le P_j^*(y_2)y1​≤y2​⇒Pj∗​(y1​)≤Pj∗​(y2​).
  3. A feasible level exists, pp. 108–109: for bounded costs there is y>0y > 0y>0 with SD(y)S_D(y)SD​(y) on time.
  4. Existence of y∗y^*y∗, p. 109 with footnote 3. If some SD(y1)S_D(y_1)SD​(y1​) is on time and some SD(y0)S_D(y_0)SD​(y0​) is not, a level y∗y^*y∗ with properties (1) and (2) exists.

Significance

The result. The theorem turns a min–max problem over all n!n!n! schedules into a monotone one-parameter feasibility question. Each value of yyy is checked by a single sort, and the optimal level is the threshold where feasibility switches on. The same threshold structure underlies bottleneck scheduling and the backward rule for 1∣prec∣fmax⁡1|\mathrm{prec}|f_{\max}1∣prec∣fmax​. Special cases include minimizing the maximum lateness, Pj(s)=s−djP_j(s) = s - d_jPj​(s)=s−dj​, clipped to be bounded, and minimizing the maximum weighted tardiness.

Formalizing it. The result is classical and proved on paper, but no machine-checked proof of it, or of Jackson's lemma, is known to exist. The mission would produce a checked Jackson lemma for extended-real due-dates, a verified generalized inverse of a monotone continuous function with the paper's case analysis, and the threshold argument connecting them. Jackson's lemma is shared with part I of this series (minimizing the number of late jobs).

Difficulty

The reduction is short on paper. The work is in the edge cases that the paper passes over:

  • The generalized inverse. The comparison Cj≤Pj∗(y)C_j \le P_j^*(y)Cj​≤Pj∗​(y) agrees with Pj(Cj)≤yP_j(C_j) \le yPj​(Cj​)≤y only away from the corner case Cj=0C_j = 0Cj​=0 with Pj(0)>yP_j(0) > yPj​(0)>y. That job is never "late", yet its cost exceeds yyy. The goal must still hold when such jobs exist.
  • Monotonicity. The monotonicity of Pj∗P_j^*Pj∗​ needs continuity. It fails if times range over all of R\mathbb RR instead of s≥0s \ge 0s≥0.
  • Attainment. The feasible levels form an up-set of (0,∞)(0,\infty)(0,∞). That its infimum is attained, so that y∗y^*y∗ exists, needs right-continuity in yyy of the feasibility of each of the finitely many schedules.
  • Jackson's lemma. The exchange argument must handle due-dates equal to 000 or +∞+\infty+∞ and zero processing times.

Formalization scope

Conventions committed to in Lean:

  • Jobs form a type ι with decidable equality, and the job set is J : Finset ι, assumed nonempty in the goal. Processing times are t : ι → ℝ with 0 ≤ t i: this is added, because the page never states it but processing times are durations.
  • Costs are P : ι → ℝ → ℝ, each continuous, bounded (∃ M, ∀ s, |P i s| ≤ M) and monotone, as on p. 108. The Introduction's assumption ti≤Dit_i \le D_iti​≤Di​ has no counterpart, since the problem has no given due-dates, and it is not assumed.
  • A schedule is a duplicate-free list whose elements are exactly JJJ. Completion times are prefix sums of processing times, starting at 000.
  • Pstar f y : EReal, with every time in the definition ranging over s≥0s \ge 0s≥0. If the level set {s≥0:f(s)=y}\{s \ge 0 : f(s) = y\}{s≥0:f(s)=y} is unbounded, its "max" does not exist, and the value is fixed to +∞+\infty+∞. The final case is "otherwise", which for continuous monotone fff is the paper's case (c).
  • The family SDS_DSD​ is any SD : ℝ → List ι such that SD y is a due-date-ordered schedule for every y>0y > 0y>0. Theorems hold for every such family, so every tie-break is covered.
  • "For all y<y∗y < y^*y<y∗" is read as 0<y<y∗0 < y < y^*0<y<y∗, because SD(y)S_D(y)SD​(y) is defined only for y>0y > 0y>0.
  • The existence milestone takes footnote 3's hypothesis (some feasible level) in place of boundedness. It also takes the added hypothesis that some level y0>0y_0 > 0y0​>0 is infeasible: with all costs identically 000, every SD(y)S_D(y)SD​(y) is on time and no y∗>0y^* > 0y∗>0 has property (2).

The goal is not the trivializing statement "every on-time SD(y)S_D(y)SD​(y) is optimal", which is false for large yyy. It concerns exactly the threshold level y∗y^*y∗. The minimum is over all schedules of JJJ, not over the SD(y)S_D(y)SD​(y) only.

The needed infrastructure is list permutations, prefix sums and Finset.sup', plus basic facts about sSup of closed sets bounded above in ℝ, and the intermediate value theorem. The Jackson lemma and the generalized inverse are reusable beyond this mission. Contributions are welcome on any milestone, in any order. The goal depends only on the Jackson lemma and on properties of Pstar.

Not in scope: the remark that y∗y^*y∗ "can be found to whatever accuracy is desired by a binary search technique" (computational), and the sum-of-costs problem the section contrasts itself with.

Selected references

  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs, Management Science 15(1):102–109, 1968. https://doi.org/10.1287/mnsc.15.1.102
  • J. R. Jackson, Scheduling a Production Line to Minimize Maximum Tardiness, Research Report 43, Management Sciences Research Project, UCLA, 1955.
  • E. L. Lawler, On Scheduling Problems with Deferral Costs, Management Science 11(2):280–288, 1964. https://doi.org/10.1287/mnsc.11.2.280
  • R. McNaughton, Scheduling with Deadlines and Loss Functions, Management Science 6(1):1–12, 1959. https://doi.org/10.1287/mnsc.6.1.1
  • E. L. Lawler, Optimal Sequencing of a Single Machine Subject to Precedence Constraints, Management Science 19(5):544–546, 1973. https://doi.org/10.1287/mnsc.19.5.544
9 thms2 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research·Captain: Shuze Chen

Discrete Convex Analysis XV: Conjugacy of Quadratic Forms and Symmetric M-MatricesTextbook

Motivation

Quadratic minimization problems with a combinatorial sign pattern in their Hessian arise throughout applied mathematics: discretizations of elliptic boundary-value problems such as the Poisson equation, resistor-network energy functionals, and the Dirichlet forms of Markov-process potential theory all produce a symmetric matrix whose off-diagonal entries are nonpositive and whose rows are diagonally dominant (Fukushima, Oshima, and Takeda, Dirichlet Forms and Symmetric Markov Processes, De Gruyter, 1994). Such matrices are exactly the diagonally dominant symmetric M-matrices of classical numerical linear algebra (Berman and Plemmons, Nonnegative Matrices in the Mathematical Sciences, SIAM, 1994). Murota's Discrete Convex Analysis (SIAM, 2003) identifies the combinatorial content of this sign pattern with a discrete convexity property — submodularity, and its strengthening translation submodularity — of the associated quadratic form, and shows that passing to the Legendre-Fenchel conjugate of such a quadratic form (i.e., inverting the matrix) transports this property to a dual combinatorial property, an exchange axiom, on the conjugate side. This mission formalizes that correspondence for the special, matrix-algebraic case of quadratic forms — the case in which Murota's book gives a self-contained proof using only the classical Farkas lemma, before generalizing the same conjugacy to a much broader class of functions in Chapter 8.

Setting

Let VVV be a finite ground set (identified with {1,…,n}\{1,\dots,n\}{1,…,n} in the book) and let L=(ℓij)i,j∈VL = (\ell_{ij})_{i,j\in V}L=(ℓij​)i,j∈V​ be a symmetric real matrix. LLL has off-diagonal nonpositivity if ℓij≤0\ell_{ij}\le 0ℓij​≤0 for all i≠ji\ne ji=j, and diagonal dominance if ∑jℓij≥0\sum_{j} \ell_{ij}\ge 0∑j​ℓij​≥0 for every row iii. The associated quadratic form is g(p)=12p⊤Lpg(p) = \tfrac12 p^\top L pg(p)=21​p⊤Lp for p∈RVp \in \mathbb R^Vp∈RV. For p,q∈RVp,q\in\mathbb R^Vp,q∈RV write p∨qp\vee qp∨q, p∧qp\wedge qp∧q for the componentwise maximum and minimum. A function g:RV→Rg:\mathbb R^V\to\mathbb Rg:RV→R is submodular if g(p)+g(q)≥g(p∨q)+g(p∧q)g(p)+g(q)\ge g(p\vee q)+g(p\wedge q)g(p)+g(q)≥g(p∨q)+g(p∧q) for all p,qp,qp,q, and has translation submodularity if the stronger inequality g(p)+g(q)≥g((p−α1)∨q)+g(p∧(q+α1))g(p)+g(q)\ge g((p-\alpha\mathbf 1)\vee q)+g(p\wedge(q+\alpha\mathbf 1))g(p)+g(q)≥g((p−α1)∨q)+g(p∧(q+α1)) holds for every α≥0\alpha \ge 0α≥0, where 1\mathbf 11 is the all-ones vector (ordinary submodularity is the case α=0\alpha=0α=0).

On the conjugate side, for x∈RVx\in\mathbb R^Vx∈RV write supp⁡+(x)={i:xi>0}\operatorname{supp}^+(x)=\{i : x_i>0\}supp+(x)={i:xi​>0}, supp⁡−(x)={i:xi<0}\operatorname{supp}^-(x)=\{i:x_i<0\}supp−(x)={i:xi​<0}, and let χi\chi_iχi​ denote the iii-th unit vector (χ0\chi_0χ0​ denotes the zero vector). A function f:RV→Rf:\mathbb R^V\to\mathbb Rf:RV→R has the exchange property if for all x,y∈RVx,y\in\mathbb R^Vx,y∈RV and i∈supp⁡+(x−y)i\in\operatorname{supp}^+(x-y)i∈supp+(x−y) there exist j∈supp⁡−(x−y)∪{0}j \in \operatorname{supp}^-(x-y)\cup\{0\}j∈supp−(x−y)∪{0} and α0>0\alpha_0>0α0​>0 such that f(x)+f(y)≥f(x−α(χi−χj))+f(y+α(χi−χj))f(x)+f(y)\ge f(x-\alpha(\chi_i-\chi_j))+f(y+\alpha(\chi_i-\chi_j))f(x)+f(y)≥f(x−α(χi​−χj​))+f(y+α(χi​−χj​)) for every α∈[0,α0]\alpha\in[0,\alpha_0]α∈[0,α0​]. The Legendre-Fenchel conjugate of fff is f∙(p)=sup⁡x{⟨p,x⟩−f(x)}f^\bullet(p) = \sup_x\{\langle p,x\rangle - f(x)\}f∙(p)=supx​{⟨p,x⟩−f(x)}; two functions g,fg,fg,f are conjugate to each other when g=f∙g=f^\bulletg=f∙ and f=g∙f=g^\bulletf=g∙. For positive-definite symmetric M,LM,LM,L, the quadratic forms f(x)=12x⊤Mxf(x)=\tfrac12x^\top Mxf(x)=21​x⊤Mx and g(p)=12p⊤Lpg(p)=\tfrac12p^\top Lpg(p)=21​p⊤Lp are conjugate to each other exactly when MMM and LLL are matrix inverses of one another.

Formalization targets

Goal (Theorem 2.11). For conjugate strictly convex quadratic forms ggg and fff as above,

g has translation submodularity  ⟺  f has the exchange property.g \text{ has translation submodularity} \iff f \text{ has the exchange property.}g has translation submodularity⟺f has the exchange property.

This is the mission's capstone: the statement leaves the correspondence at the level of the two named combinatorial properties, without hard-coding which of the two properties is verified in a given application, so it survives exactly as strongly as the underlying conjugacy fact does.

Supporting milestones, in the order the book develops them: Proposition 2.4 (off-diagonal nonpositivity plus diagonal dominance implies positive semidefiniteness); Proposition 2.6 (off-diagonal nonpositivity is equivalent to plain submodularity of ggg); Theorem 2.7 (the full sign pattern is equivalent to translation submodularity of ggg); Proposition 2.9 (conjugate quadratic forms correspond exactly to inverse matrix pairs); Theorem 2.12 (a nine-way equivalence, for a nonsingular symmetric MMM, among membership in the matrix class L−1\mathcal L^{-1}L−1, two sign-consistency inequalities on the columns of MMM together with their strict forms, two directional-derivative reformulations of the exchange property together with their strict forms, and the exchange property itself together with its strict form); Proposition 2.13 (the Farkas lemma in equality form, together with the strict variant valid for a nonsingular coefficient matrix); and Proposition 2.14 (the class L−1\mathcal L^{-1}L−1 is closed under taking principal submatrices).

Significance

The M-natural exchange property is the function-level analogue of the base-exchange axiom for matroids, and translation submodularity is the analogue, on the "primal" side, of ordinary submodularity for set functions; Chapter 2's quadratic-form case is the historical and pedagogical entry point for the general conjugacy Chapter 8 proves for the full M-convex/ L-convex function classes. Establishing it here, in the self-contained matrix-algebraic setting, isolates exactly which properties of a quadratic form are combinatorial (tied to the coordinate axes) rather than purely convex-analytic (rotation-invariant): submodularity and the exchange property are not preserved by an orthogonal change of variables, in contrast to ordinary convexity, which Proposition 2.4 shows the same sign pattern also implies.

Formalizing this mission produces the first Lean statement, in this project's namespace, of a genuine conjugacy theorem between a primal-side and a dual-side combinatorial convexity property for a concrete function class; nothing of this kind is yet proved (or, so far as the platform's own search shows, formalized at all) elsewhere on the platform. The nine-way equivalence of Theorem 2.12 is a substantial independent contribution beyond the goal itself, since it is what makes the goal's proof possible via elementary linear algebra rather than the general convex-analytic machinery Chapter 8 needs.

Difficulty

The naive approach to Theorem 2.11 tries to derive the exchange property for fff directly from the defining supremum in the conjugate relation f=g∙f = g^\bulletf=g∙, differentiating under the sup; this fails because the exchange property compares fff along a specific combinatorial direction χi−χj\chi_i - \chi_jχi​−χj​ tied to two coordinates, not along an arbitrary direction, and no naive first-order argument isolates the right pair (i,j)(i,j)(i,j) without already knowing the sign pattern of M=L−1M = L^{-1}M=L−1. The book's actual route is Theorem 2.12: it reduces the exchange property to a column-wise sign-consistency statement on MMM itself (conditions (b)/(c)) via the identity f′(x;d)=x⊤Mdf'(x;d) = x^\top Mdf′(x;d)=x⊤Md, and closes the loop back to membership in L−1\mathcal L^{-1}L−1 using the Farkas lemma applied to the linear system ML=IML = IML=I — a genuinely matrix-algebraic argument that does not generalize verbatim to non-quadratic M-/L-convex functions, which is exactly why Chapter 8 needs a different (convex-analytic) proof for the general case.

Formalization scope

Vectors and matrices are indexed by a general finite type V ([Fintype V] [DecidableEq V]) rather than a fixed Fin n, matching this project's convention elsewhere and letting Proposition 2.14's principal-submatrix statement reuse the class predicate at the restricted index type directly. Quadratic forms are real-valued ((V → ℝ) → ℝ, using Matrix.mulVec and dotProduct) since this chapter's functions are always finite everywhere; the Legendre-Fenchel conjugate is EReal-valued via sSup, since a supremum over an infinite domain need not be finite in general even though it is finite here. Every min(0, \dots)-based condition in Theorem 2.12 and the exchange axioms is unfolded as the logically equivalent disjunction over the finitely many terms achieving the minimum, rather than reified via Finset.inf/WithTop machinery — a faithful, checked-equivalent simplification, not a narrowing (see MODERATION_NOTES.md). "Nonsingular" is Matrix.det ≠ 0. No numeric constant needs instantiation anywhere in this mission. The formalization does not trivialize: the goal's exchange property is stated for the specific combinatorial direction χi−χj\chi_i - \chi_jχi​−χj​ with i∈supp⁡+(x−y)i\in \operatorname{supp}^+(x-y)i∈supp+(x−y), j∈supp⁡−(x−y)∪{0}j \in \operatorname{supp}^-(x-y)\cup\{0\}j∈supp−(x−y)∪{0} — not an arbitrary direction, which would reduce the exchange property to a restatement of ordinary convexity and discard the entire combinatorial content the mission is about.

Infrastructure needed: Matrix.PosDef/Matrix.PosSemidef/Matrix.IsSymm (present in Mathlib); everything else (submodularity, translation submodularity, the exchange axioms, the sign-consistency conditions) is defined fresh in DiscreteConvex.CombinatorialB. A solution to the goal will likely want Proposition 2.9, Theorem 2.12, and the Farkas lemma (Proposition 2.13) as lemmas; contributions completing any of the seven milestones independently, or supplying the Schur-complement induction behind Proposition 2.4, are welcome.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003, DOI 10.1137/1.9780898718508, Chapter 2.
  • A. Berman, R. J. Plemmons, Nonnegative Matrices in the Mathematical Sciences, SIAM, 1994.
  • M. Fukushima, Y. Oshima, M. Takeda, Dirichlet Forms and Symmetric Markov Processes, De Gruyter, 1994.
  • J. Farkas, Theorie der einfachen Ungleichungen, J. Reine Angew. Math. 124 (1902), 1–27.
28 thms2 active usersReviewed
🏆Completed
Convex OptimizationNumerical AnalysisOperations Research·Captain: mikedeng1

Golden Ratio Algorithms for Variational Inequalities II: The Explicit Golden Ratio Algorithm Converges for Locally Lipschitz Monotone OperatorsResearch Paper

Motivation

Monotone variational inequalities cover convex minimisation, convex–concave saddle-point problems, Nash equilibria of monotone games and complementarity problems, and they are the standard model for these in optimization and operations research. First-order methods for them (extragradient, forward–backward–forward, reflected and projected gradient methods) need a stepsize below 1/L1/L1/L, where LLL is a global Lipschitz constant of the operator. That constant is often unknown, too pessimistic, or nonexistent: in composite minimisation with a locally smooth term, or in saddle-point problems with bilinear-plus-nonlinear couplings, the operator is only locally Lipschitz. The usual remedy is a linesearch, which costs extra operator or prox evaluations per iteration and complicates the complexity accounting.

Y. Malitsky, Golden Ratio Algorithms for Variational Inequalities (preprint 2018, Optimization Online 6598; published in Mathematical Programming, 2020, doi:10.1007/s10107-019-01416-w) proposes the Explicit Golden Ratio Algorithm (EGRAAL): its stepsizes are computed in closed form from the last two iterates, it uses one evaluation of FFF and one proximal step per iteration, and it needs neither a Lipschitz constant nor a linesearch. This mission formalizes its main convergence theorem, Theorem 2 of the preprint.

Setting

Let E\mathcal EE be a finite-dimensional real inner product space with norm ∥⋅∥=⟨⋅,⋅⟩\|\cdot\|=\sqrt{\langle\cdot,\cdot\rangle}∥⋅∥=⟨⋅,⋅⟩​. Let g:E→(−∞,+∞]g:\mathcal E\to(-\infty,+\infty]g:E→(−∞,+∞] with domain dom⁡g={x:g(x)<+∞}\operatorname{dom} g=\{x: g(x)<+\infty\}domg={x:g(x)<+∞}, and F:dom⁡g→EF:\operatorname{dom} g\to\mathcal EF:domg→E. The variational inequality (1) asks for

z∗∈Ewith⟨F(z∗),z−z∗⟩+g(z)−g(z∗)≥0∀z∈E.(1)z^*\in\mathcal E\quad\text{with}\quad \langle F(z^*),z-z^*\rangle+g(z)-g(z^*)\ge0\quad\forall z\in\mathcal E. \tag{1}z∗∈Ewith⟨F(z∗),z−z∗⟩+g(z)−g(z∗)≥0∀z∈E.(1)

Its solution set is SSS. The standing assumptions are: (C1) S≠∅S\ne\emptysetS=∅; (C2) ggg is proper, convex and lower semicontinuous; (C3) FFF is monotone on dom⁡g\operatorname{dom} gdomg, ⟨F(u)−F(v),u−v⟩≥0\langle F(u)-F(v),u-v\rangle\ge0⟨F(u)−F(v),u−v⟩≥0 for u,v∈dom⁡gu,v\in\operatorname{dom}gu,v∈domg.

The proximal operator is prox⁡g(w)=argmin⁡x{g(x)+12∥x−w∥2}\operatorname{prox}_g(w)=\operatorname{argmin}_x\{g(x)+\tfrac12\|x-w\|^2\}proxg​(w)=argminx​{g(x)+21​∥x−w∥2}. Write φ=5+12\varphi=\frac{\sqrt5+1}{2}φ=25​+1​ for the golden ratio. Algorithm 1 (EGRAAL) takes z0,z1∈Ez^0,z^1\in\mathcal Ez0,z1∈E, λ0>0\lambda_0>0λ0​>0, a parameter ϕ∈(1,φ]\phi\in(1,\varphi]ϕ∈(1,φ] and a cap λˉ>0\bar\lambda>0λˉ>0, sets zˉ0=z1\bar z^0=z^1zˉ0=z1, θ0=1\theta_0=1θ0​=1, ρ=1ϕ+1ϕ2\rho=\frac1\phi+\frac1{\phi^2}ρ=ϕ1​+ϕ21​, and for k≥1k\ge1k≥1 computes

λk=min⁡{ρλk−1, ϕθk−14λk−1∥zk−zk−1∥2∥F(zk)−F(zk−1)∥2, λˉ},zˉk=(ϕ−1)zk+zˉk−1ϕ,\lambda_k=\min\Big\{\rho\lambda_{k-1},\ \frac{\phi\theta_{k-1}}{4\lambda_{k-1}}\frac{\|z^k-z^{k-1}\|^2}{\|F(z^k)-F(z^{k-1})\|^2},\ \bar\lambda\Big\},\qquad \bar z^k=\frac{(\phi-1)z^k+\bar z^{k-1}}{\phi},λk​=min{ρλk−1​, 4λk−1​ϕθk−1​​∥F(zk)−F(zk−1)∥2∥zk−zk−1∥2​, λˉ},zˉk=ϕ(ϕ−1)zk+zˉk−1​, zk+1=prox⁡λkg(zˉk−λkF(zk)),θk=λkλk−1ϕ,z^{k+1}=\operatorname{prox}_{\lambda_k g}\big(\bar z^k-\lambda_kF(z^k)\big),\qquad \theta_k=\frac{\lambda_k}{\lambda_{k-1}}\phi,zk+1=proxλk​g​(zˉk−λk​F(zk)),θk​=λk−1​λk​​ϕ,

with the convention 0/0=+∞0/0=+\infty0/0=+∞ in the middle term. The paper uses the bifunction Ψ(u,v)=⟨F(u),v−u⟩+g(v)−g(u)\Psi(u,v)=\langle F(u),v-u\rangle+g(v)-g(u)Ψ(u,v)=⟨F(u),v−u⟩+g(v)−g(u).

Formalization targets

Goal: Theorem 2

If FFF is locally Lipschitz continuous and (C1)–(C3) hold, then for every run of Algorithm 1 there is z∗∈Sz^*\in Sz∗∈S with

zk→z∗andzˉk→z∗.z^k\to z^*\qquad\text{and}\qquad \bar z^k\to z^*.zk→z∗andzˉk→z∗.

Nothing is fixed beyond the paper's parameter ranges: ϕ∈(1,φ]\phi\in(1,\varphi]ϕ∈(1,φ], λˉ>0\bar\lambda>0λˉ>0, λ0>0\lambda_0>0λ0​>0 and the starting points are arbitrary. The two sequences share one limit.

Milestones

  1. Eq. (4), the prox-inequality: xˉ=prox⁡gw  ⟺  ⟨xˉ−w,x−xˉ⟩≥g(xˉ)−g(x)\bar x=\operatorname{prox}_g w\iff\langle\bar x-w,x-\bar x\rangle\ge g(\bar x)-g(x)xˉ=proxg​w⟺⟨xˉ−w,x−xˉ⟩≥g(xˉ)−g(x) for all xxx.
  2. Eq. (18), the estimates the step rule gives: λk≤ρλk−1\lambda_k\le\rho\lambda_{k-1}λk​≤ρλk−1​, θk≤1+1ϕ\theta_k\le1+\frac1\phiθk​≤1+ϕ1​, and λk2∥F(zk)−F(zk−1)∥2≤θkθk−14∥zk−zk−1∥2\lambda_k^2\|F(z^k)-F(z^{k-1})\|^2\le\frac{\theta_k\theta_{k-1}}4\|z^k-z^{k-1}\|^2λk2​∥F(zk)−F(zk−1)∥2≤4θk​θk−1​​∥zk−zk−1∥2.
  3. Eq. (24), an identity that follows from the averaging step: ∥zk+1−z∥2=ϕϕ−1∥zˉk+1−z∥2−1ϕ−1∥zˉk−z∥2+1ϕ∥zk+1−zˉk∥2\|z^{k+1}-z\|^2=\frac\phi{\phi-1}\|\bar z^{k+1}-z\|^2-\frac1{\phi-1}\|\bar z^k-z\|^2+\frac1\phi\|z^{k+1}-\bar z^k\|^2∥zk+1−z∥2=ϕ−1ϕ​∥zˉk+1−z∥2−ϕ−11​∥zˉk−z∥2+ϕ1​∥zk+1−zˉk∥2.
  4. Eq. (27), the energy inequality, for z∈dom⁡gz\in\operatorname{dom}gz∈domg and k≥2k\ge2k≥2.
  5. Lemma 2: along bounded runs, (λk)(\lambda_k)(λk​) and (θk)(\theta_k)(θk​) are bounded and bounded away from 000.
  6. Lemma 1 (Bauschke–Combettes, Theorem 5.5): a Fejér monotone sequence whose cluster points lie in a nonempty set CCC converges to a point of CCC.

Significance

The result. Theorem 2 shows that a monotone variational inequality with a locally Lipschitz operator can be solved by a method whose stepsizes adapt to the local curvature of FFF at no extra cost: one FFF evaluation and one prox step per iteration, and no global constant and no backtracking. Because FFF is only ever evaluated at the prox outputs zk∈dom⁡gz^k\in\operatorname{dom}gzk∈domg, the method also applies when FFF is undefined or badly behaved outside the feasible set, where reflected-gradient methods can fail. The same analysis gives an ergodic O(1/k)O(1/k)O(1/k) rate and, under an error bound, an RRR-linear rate (§2.2 of the preprint; not part of this mission). The paper also derives fixed-point algorithms for demi-contractive operators from it.

Formalizing it. The theorem has a published proof; to our knowledge no machine-checked version exists, and Mathlib has no proximal operator, no theory of monotone variational inequalities and no Fejér-monotonicity lemma. This mission produces a formal convergence proof for an adaptive first-order method with a nonsmooth convex term, together with reusable pieces: the prox-inequality for extended-real-valued convex functions, a finite-dimensional Fejér convergence lemma, and a formal model of an adaptive-step algorithm with the 0/0=+∞0/0=+\infty0/0=+∞ rule.

Difficulty

The usual convergence argument for projected or extragradient methods bounds the cross term ⟨F(zk)−F(zk−1),zk−zk+1⟩\langle F(z^k)-F(z^{k-1}),z^k-z^{k+1}\rangle⟨F(zk)−F(zk−1),zk−zk+1⟩ using a global Lipschitz constant and a fixed stepsize. Here neither exists. The stepsize at iteration kkk depends on the iterates, and the energy that decreases changes from step to step, since it involves θk−1\theta_{k-1}θk−1​. Local Lipschitz continuity gives a usable constant only once the iterates are known to be bounded, and boundedness has to come from the energy inequality. Stepsizes that tend to 000 would also break the argument (Lemma 2 excludes this for bounded runs). The last step, identifying cluster points as solutions, needs lower semicontinuity of ggg and a limit in the prox-inequality along a subsequence with convergent stepsizes.

Formalization scope

E\mathcal EE is a real InnerProductSpace with FiniteDimensional ℝ E. ggg is a map E → EReal; (C2) is a structure: ggg never takes the value ⊥\bot⊥, is finite somewhere, has a convex epigraph in E×RE\times\mathbb RE×R, and is LowerSemicontinuous on EEE. FFF is a total map E → E, and every hypothesis on it (monotonicity, Lipschitz bounds) is restricted to dom⁡g\operatorname{dom}gdomg. The variational inequality is stored as g(z∗)≤⟨F(z∗),z−z∗⟩+g(z)g(z^*)\le\langle F(z^*),z-z^*\rangle+g(z)g(z∗)≤⟨F(z∗),z−z∗⟩+g(z), with z∗∈dom⁡gz^*\in\operatorname{dom}gz∗∈domg, which avoids extended-real subtraction. prox⁡λg\operatorname{prox}_{\lambda g}proxλg​ is an argmin predicate, so it never produces a junk value. The algorithm is a predicate on the four sequences, written for index k+1k+1k+1. The rule 0/0=+∞0/0=+\infty0/0=+∞ is a case split: if F(zk)=F(zk−1)F(z^k)=F(z^{k-1})F(zk)=F(zk−1) the step is min⁡{ρλk−1,λˉ}\min\{\rho\lambda_{k-1},\bar\lambda\}min{ρλk−1​,λˉ}. No condition such as F(z1)≠F(z0)F(z^1)\ne F(z^0)F(z1)=F(z0) or λ0≤λˉ\lambda_0\le\bar\lambdaλ0​≤λˉ is imposed.

"Locally Lipschitz" is formalized as Lipschitz on every bounded subset of dom⁡g\operatorname{dom}gdomg. This is the property the proof of Lemma 2 uses. It agrees with local Lipschitz continuity when dom⁡g\operatorname{dom}gdomg is closed (for example g=δCg=\delta_Cg=δC​ for a closed convex CCC, or ggg finite everywhere) and is stronger otherwise. Eq. (27) is stated for z∈dom⁡gz\in\operatorname{dom}gz∈domg, where F(z)F(z)F(z) and Ψ(z,zk)\Psi(z,z^k)Ψ(z,zk) are defined. Lemma 1 carries the hypothesis C≠∅C\ne\emptysetC=∅ of its cited source, without which it is false.

The statements are not vacuous: g≡0g\equiv0g≡0, F≡0F\equiv0F≡0 satisfy (C1)–(C3) and the Lipschitz hypothesis, and admit a run of Algorithm 1 with λk=min⁡{ρλk−1,λˉ}\lambda_k=\min\{\rho\lambda_{k-1},\bar\lambda\}λk​=min{ρλk−1​,λˉ}. A proof of Theorem 2 must hold for every run with the paper's parameters, not only for such degenerate data.

Contributions welcome: the prox-inequality and the existence of the prox for proper convex lsc ggg (both reusable beyond this mission), the Fejér lemma, the algebraic estimates (18) and (24), and the energy inequality (27). Once these are in place, Lemma 2 and the cluster-point argument complete Theorem 2.

Selected references

  • Y. Malitsky, Golden Ratio Algorithms for Variational Inequalities, preprint, Optimization Online 6598, 2018. https://optimization-online.org/wp-content/uploads/2018/05/6598.pdf ; published in Mathematical Programming 184 (2020), 383–410. https://doi.org/10.1007/s10107-019-01416-w
  • H. H. Bauschke, P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, Springer, 2011 (Theorem 5.5). https://doi.org/10.1007/978-1-4419-9467-7
  • G. M. Korpelevich, The extragradient method for finding saddle points and other problems, Ekonomika i Matematicheskie Metody 12 (1976), 747–756.
  • Y. Malitsky, Projected reflected gradient methods for monotone variational inequalities, SIAM Journal on Optimization 25 (2015), 502–520. https://doi.org/10.1137/14097238X
10 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

Cubic Regularization of Newton Method and Its Global Performance III: Linear-Then-Superlinear Rate on Gradient-Dominated Functions of Degree TwoResearch Paper

Motivation

Newton's method converges quadratically near a non-degenerate minimum, but on its own it has no global guarantee: far from a minimizer the Newton step may increase the objective, and at points where the Hessian is indefinite it may not even be a descent direction. For most of the method's history, the global behaviour of second-order methods was controlled by line searches or trust regions whose worst-case complexity was not quantified.

Nesterov and Polyak (Math. Program. Ser. A 108 (2006) 177–205) proposed regularizing the Newton model by a cubic term and proved global worst-case rates for the resulting method on several problem classes. This mission is the third in a series formalizing that paper. It concerns the class of gradient dominated functions of degree two, for which the gap to the optimal value is bounded by a multiple of the squared gradient norm. For this class the paper shows that the method first converges linearly and then superlinearly, with explicit constants and without convexity.

The class itself predates the paper by four decades. Polyak (USSR Comput. Math. Math. Phys. 3 (1963)) introduced the inequality f(x)−f∗≤τ∥f′(x)∥2f(x) - f^* \le \tau\|f'(x)\|^2f(x)−f∗≤τ∥f′(x)∥2 to prove linear convergence of gradient descent without convexity; related inequalities are due to Łojasiewicz. Under the name Polyak–Łojasiewicz condition it has become a standard assumption in the analysis of first-order methods, for example in Karimi, Nutini and Schmidt (2016). Theorem 7 of Nesterov and Polyak is the corresponding result for a second-order method.

Setting

Let F⊆RnF \subseteq \mathbb{R}^nF⊆Rn be a closed convex set, and let fff be twice differentiable on FFF with gradient f′(x)f'(x)f′(x) and Hessian f′′(x)f''(x)f′′(x). The Euclidean norm is ∥⋅∥\|\cdot\|∥⋅∥, and on matrices it is the spectral norm. The standing assumptions of the paper are:

  1. Lipschitz Hessian. For some L>0L > 0L>0, ∥f′′(x)−f′′(y)∥≤L∥x−y∥\|f''(x) - f''(y)\| \le L\|x - y\|∥f′′(x)−f′′(y)∥≤L∥x−y∥ for all x,y∈Fx, y \in Fx,y∈F.
  2. Starting point. x0x_0x0​ lies in the interior of FFF, and so does the whole level set {x:f(x)≤f(x0)}\{x : f(x) \le f(x_0)\}{x:f(x)≤f(x0​)}.

For M>0M > 0M>0 the cubic model of fff at xxx is

mM,x(y)=⟨f′(x),y−x⟩+12⟨f′′(x)(y−x),y−x⟩+M6∥y−x∥3.m_{M,x}(y) = \langle f'(x), y - x\rangle + \tfrac12\langle f''(x)(y-x), y-x\rangle + \tfrac M6\|y - x\|^3 .mM,x​(y)=⟨f′(x),y−x⟩+21​⟨f′′(x)(y−x),y−x⟩+6M​∥y−x∥3.

A cubic-regularized Newton step TM(x)T_M(x)TM​(x) is any global minimizer of mM,xm_{M,x}mM,x​ over Rn\mathbb{R}^nRn. Write rM(x)=∥x−TM(x)∥r_M(x) = \|x - T_M(x)\|rM​(x)=∥x−TM​(x)∥ and fˉM(x)=f(x)+min⁡ymM,x(y)\bar f_M(x) = f(x) + \min_y m_{M,x}(y)fˉ​M​(x)=f(x)+miny​mM,x​(y).

Method (3.3). Fix L0∈(0,L]L_0 \in (0, L]L0​∈(0,L]. At iteration k≥0k \ge 0k≥0, choose Mk∈[L0,2L]M_k \in [L_0, 2L]Mk​∈[L0​,2L] such that f(TMk(xk))≤fˉMk(xk)f(T_{M_k}(x_k)) \le \bar f_{M_k}(x_k)f(TMk​​(xk​))≤fˉ​Mk​​(xk​), and set xk+1=TMk(xk)x_{k+1} = T_{M_k}(x_k)xk+1​=TMk​​(xk​). The choice Mk=LM_k = LMk​=L always passes this test.

Gradient domination of degree two (Definition 3 with p=2p = 2p=2). The function fff attains its minimum over FFF at some x∗∈Fx^* \in Fx∗∈F, and for a constant τf>0\tau_f > 0τf​>0

f(x)−f(x∗)≤τf ∥f′(x)∥2for all x∈F.f(x) - f(x^*) \le \tau_f\,\|f'(x)\|^2 \qquad \text{for all } x \in F .f(x)−f(x∗)≤τf​∥f′(x)∥2for all x∈F.

The minimizer need not be unique. Two examples:

  • Every γ\gammaγ-strongly convex function is in the class, with τf=1/(2γ)\tau_f = 1/(2\gamma)τf​=1/(2γ).
  • So is 12∑igi(x)2\frac12\sum_i g_i(x)^221​∑i​gi​(x)2 when the system g(x)=0g(x) = 0g(x)=0 with m≤nm \le nm≤n equations has a solution and a uniformly non-degenerate Jacobian on FFF. Its minima form a manifold, and the Hessian is singular there.

Two quantities appear in the targets. With Δk=f(xk)−f(x∗)\Delta_k = f(x_k) - f(x^*)Δk​=f(xk​)−f(x∗), they are

ω~=L04324 (L+L0)6 τf3,σ=ω~1/4ω~1/4+Δ01/4.\tilde\omega = \frac{L_0^4}{324\,(L + L_0)^6\,\tau_f^3}, \qquad \sigma = \frac{\tilde\omega^{1/4}}{\tilde\omega^{1/4} + \Delta_0^{1/4}} .ω~=324(L+L0​)6τf3​L04​​,σ=ω~1/4+Δ01/4​ω~1/4​.

Formalization targets

Goal: Theorem 7

For every run of method (3.3) on a gradient dominated function of degree two, both of the following hold.

  1. If Δ0≥ω~\Delta_0 \ge \tilde\omegaΔ0​≥ω~ (4.14), then during the first phase, meaning every kkk with Δj≥ω~\Delta_j \ge \tilde\omegaΔj​≥ω~ for all j<kj < kj<k,
Δk≤Δ0 e−kσ.(4.15)\Delta_k \le \Delta_0\, e^{-k\sigma} . \tag{4.15}Δk​≤Δ0​e−kσ.(4.15)
  1. From any iteration k0k_0k0​ with Δk0<ω~\Delta_{k_0} < \tilde\omegaΔk0​​<ω~ on,
Δk+1≤ω~ (Δkω~)4/3.(4.16)\Delta_{k+1} \le \tilde\omega\,\Big(\frac{\Delta_k}{\tilde\omega}\Big)^{4/3} . \tag{4.16}Δk+1​≤ω~(ω~Δk​​)4/3.(4.16)

The constants 324324324, L04L_0^4L04​, (L+L0)6(L+L_0)^6(L+L0​)6 and τf3\tau_f^3τf3​ are the paper's, and neither weakened nor improved.

Milestones

In the order a proof would use them:

  1. The Taylor bound for the gradient, Lemma 1 (2.2).
  2. The stationarity equation (2.5) of TM(x)T_M(x)TM​(x).
  3. The second-order condition of Proposition 1.
  4. Lemma 2 (2.8).
  5. The model decrease, Lemma 4 (2.11).
  6. The gradient bound at the new point, Lemma 3 (2.9).
  7. The per-step decrease along a run, Lemma 7 (4.10):
f(xk)−f(xk+1)≥L0 ∥f′(xk+1)∥3/232 (L+L0)3/2.f(x_k) - f(x_{k+1}) \ge \frac{L_0\,\|f'(x_{k+1})\|^{3/2}}{3\sqrt2\,(L + L_0)^{3/2}} .f(xk​)−f(xk+1​)≥32​(L+L0​)3/2L0​∥f′(xk+1​)∥3/2​.
  1. The scalar recursion (4.17). With δk=Δk/ω~\delta_k = \Delta_k/\tilde\omegaδk​=Δk​/ω~, it reads δk≥δk+1+δk+13/4\delta_k \ge \delta_{k+1} + \delta_{k+1}^{3/4}δk​≥δk+1​+δk+13/4​.

Significance

The result shows that on the Polyak–Łojasiewicz class, cubic regularization has two properties at once.

  • Globally, it converges linearly with no convexity assumption.
  • Once the gap falls below ω~\tilde\omegaω~, it converges superlinearly, of order 4/34/34/3. This holds even when the minimizers are not isolated and the Hessian is singular at them, which is exactly the situation of Example 3, where the classical local quadratic convergence of Newton's method does not apply.

As the authors note, this is the only class in the paper where the initial gap Δ0\Delta_0Δ0​ enters the complexity of the first phase polynomially, through σ\sigmaσ.

The result has been proved on paper since 2006. As far as the platform's catalog shows, none of the paper's statements has a machine-checked proof. This mission produces:

  • a checked version of the Section 2 toolkit for the cubic step (Lemmas 1–4 and Proposition 1), which is shared by every theorem of the paper;
  • the per-step decrease of Lemma 7;
  • the two-phase rate itself.

Difficulty

Once Lemma 7 and the recursion (4.17) are in hand, deriving the two rates is elementary scalar analysis. The difficulty sits upstream.

The second-order condition. Proposition 1 is a statement about the global minimizer of a nonconvex function of nnn variables. The first-order condition (2.5) alone does not give it: a stationary point of the cubic model that is not a global minimizer can violate it. The inequality (2.11) on which every rate rests needs Proposition 1.

Lemma 7 needs two facts. First, the new iterate stays in FFF, where the Lipschitz bound applies. Second, the monotonicity of M↦M/(L+M)3/2M \mapsto M/(L+M)^{3/2}M↦M/(L+M)3/2 on (0,2L](0, 2L](0,2L], which lets the unknown MkM_kMk​ be replaced by L0L_0L0​.

The phases. Both need bookkeeping with nonnegative quantities under fractional powers. Along a run, the gap Δk\Delta_kΔk​ must be shown to be nonnegative and non-increasing before any power of it is taken.

Formalization scope

The following conventions are fixed:

  • Space and derivatives. The space is EuclideanSpace ℝ (Fin n) with arbitrary nnn. The gradient and Hessian are maps g and H, with HasGradientAt f (g x) x and HasFDerivAt g (H x) x at every x∈Fx \in Fx∈F. At boundary points these are two-sided derivatives. The Lipschitz condition uses the operator norm on E →L[ℝ] E, which is the spectral norm.
  • The step and the model value. TM(x)T_M(x)TM​(x) is represented by the predicate "T is a global minimizer of the cubic model", and every lemma about TM(x)T_M(x)TM​(x) is stated for every such T. The value fˉM(x)\bar f_M(x)fˉ​M​(x) is written as f(x)f(x)f(x) plus the model at that minimizer, with no infimum over an expression.
  • Runs. A run is a structure recording, for each kkk: x0x_0x0​, Mk∈[L0,2L]M_k \in [L_0, 2L]Mk​∈[L0​,2L], the global-minimizer property of xk+1x_{k+1}xk+1​, and the acceptance test. Indices start at 000.
  • Gradient domination. It is required on FFF, with τf>0\tau_f > 0τf​>0, and with x∗∈Fx^* \in Fx∗∈F minimizing fff over FFF. Under the level-set assumption this is the same as minimizing over Rn\mathbb{R}^nRn.
  • Phases. They are encoded literally. Item 2 is asserted from every k0k_0k0​ with Δk0<ω~\Delta_{k_0} < \tilde\omegaΔk0​​<ω~, which is equivalent to asserting it from the first such k0k_0k0​ because Δk\Delta_kΔk​ is non-increasing.
  • Fractional powers. They are Real.rpow of nonnegative numbers.

Trivializing formalizations are ruled out. Using a stationary point in place of a global minimizer of the model, allowing τf≤0\tau_f \le 0τf​≤0, or requiring the domination inequality on all of Rn\mathbb{R}^nRn rather than on FFF would each change the theorem. None of these is done. A worked instance (f(x)=∥x∥2f(x) = \|x\|^2f(x)=∥x∥2, τf=1/4\tau_f = 1/4τf​=1/4) checks that the hypotheses are satisfiable.

A complete development needs Taylor estimates for a map with Lipschitz derivative on a convex set, the optimality conditions of the cubic subproblem (Section 5 of the paper characterizes its global minimizers through a one-dimensional dual problem), and some real-power arithmetic. The Section 2 lemmas are reusable for every other mission in the series and for any analysis of cubic-regularized or trust-region methods. Contributions are welcome at every level:

  • proofs of individual milestones;
  • alternative proofs of Proposition 1;
  • general Mathlib-style lemmas on second-order Taylor bounds.

Selected references

  • Yu. Nesterov and B. T. Polyak, Cubic regularization of Newton method and its global performance, Mathematical Programming Ser. A 108 (2006) 177–205. https://doi.org/10.1007/s10107-006-0706-8
  • B. T. Polyak, Gradient methods for minimizing functionals, USSR Computational Mathematics and Mathematical Physics 3 (1963) 864–878. https://doi.org/10.1016/0041-5553(63)90382-3
  • H. Karimi, J. Nutini and M. Schmidt, Linear convergence of gradient and proximal-gradient methods under the Polyak–Łojasiewicz condition, ECML PKDD 2016. https://arxiv.org/abs/1608.04636
  • C. Cartis, N. I. M. Gould and Ph. L. Toint, Adaptive cubic regularisation methods for unconstrained optimization. Part I: motivation, convergence and numerical results, Mathematical Programming 127 (2011) 245–295. https://doi.org/10.1007/s10107-009-0286-5
14 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations Research·Captain: mikedeng1

Cubic Regularization of Newton Method and Its Global Performance II: The Global Rate on Star-Convex FunctionsResearch Paper

Motivation

Newton's method converges quadratically near a non-degenerate minimizer, but classical theory says little about its behaviour far from one: the pure Newton step can move uphill, diverge, or be undefined when the Hessian is singular. For decades the global analysis of Newton-type methods consisted of convergence statements without rates. Nesterov and Polyak (Math. Program. 108, 2006) replaced the quadratic model of Newton's method by a cubic-regularized model and proved, for the first time, global worst-case complexity bounds for a second-order method on several problem classes, including classes of non-convex functions.

This mission covers one of these results: on star-convex functions, the method reduces the optimality gap at the rate O(1/k2)O(1/k^2)O(1/k2) (Theorem 4 of the paper). Star-convexity is a weakening of convexity that only asks for convexity along segments towards the global minimizers. It includes non-convex functions such as f(x)=∣x∣(1−e−∣x∣)f(x)=|x|(1-e^{-|x|})f(x)=∣x∣(1−e−∣x∣) on R\mathbb RR, and, as the paper notes, it arises in sum-of-squares problems such as f(x,y)=x2y2+x2+y2f(x,y)=x^2y^2+x^2+y^2f(x,y)=x2y2+x2+y2.

Timeline.

  • 1981: Griewank studies Newton's method modified by bounding cubic terms (Cambridge DAMTP technical report NA/12), without complexity bounds.
  • 2006: Nesterov and Polyak introduce method (3.3) and prove global rates: O(k−2/3)O(k^{-2/3})O(k−2/3) for a second-order stationarity measure on general functions with Lipschitz Hessian, O(1/k2)O(1/k^2)O(1/k2) on star-convex functions, and linear-then-superlinear rates on gradient-dominated functions.
  • 2008: Nesterov accelerates the method on convex functions to O(1/k3)O(1/k^3)O(1/k3) (Math. Program. 112).
  • 2011: Cartis, Gould and Toint develop adaptive cubic regularization (ARC), with inexact subproblem solves and adaptive regularization parameters (Math. Program. 127).
  • 2020: Hinder, Sidford and Sohoni give near-optimal first-order methods for star-convex and quasar-convex functions (arXiv:1906.11985).

Setting

Let F⊆RnF\subseteq\mathbb R^nF⊆Rn be a closed convex set with nonempty interior, and let f:Rn→Rf:\mathbb R^n\to\mathbb Rf:Rn→R be twice differentiable on FFF, with gradient f′(x)f'(x)f′(x) and Hessian f′′(x)f''(x)f′′(x). A starting point x0∈int⁡Fx_0\in\operatorname{int}Fx0​∈intF is fixed, and FFF is assumed large enough to contain the level set {x:f(x)≤f(x0)}\{x: f(x)\le f(x_0)\}{x:f(x)≤f(x0​)} in its interior. Assumption 1 is that the Hessian is Lipschitz continuous on FFF with constant L>0L>0L>0:

∥f′′(x)−f′′(y)∥≤L∥x−y∥for all x,y∈F,\|f''(x)-f''(y)\|\le L\|x-y\|\qquad\text{for all }x,y\in F,∥f′′(x)−f′′(y)∥≤L∥x−y∥for all x,y∈F,

where the matrix norm is the spectral norm.

For a parameter M>0M>0M>0 and a point xxx, the cubic model is

mM,x(y)=⟨f′(x),y−x⟩+12⟨f′′(x)(y−x),y−x⟩+M6∥y−x∥3.m_{M,x}(y)=\langle f'(x),y-x\rangle+\tfrac12\langle f''(x)(y-x),y-x\rangle+\tfrac M6\|y-x\|^3 .mM,x​(y)=⟨f′(x),y−x⟩+21​⟨f′′(x)(y−x),y−x⟩+6M​∥y−x∥3.

The cubic step TM(x)T_M(x)TM​(x) is any global minimizer of mM,xm_{M,x}mM,x​ over Rn\mathbb R^nRn (Eq. (2.4)), and fˉM(x)=f(x)+min⁡ymM,x(y)\bar f_M(x)=f(x)+\min_y m_{M,x}(y)fˉ​M​(x)=f(x)+miny​mM,x​(y) is the model value.

Method (3.3) takes parameters 0<L0≤L0<L_0\le L0<L0​≤L. At iteration k≥0k\ge0k≥0 it finds Mk∈[L0,2L]M_k\in[L_0,2L]Mk​∈[L0​,2L] such that f(TMk(xk))≤fˉMk(xk)f(T_{M_k}(x_k))\le\bar f_{M_k}(x_k)f(TMk​​(xk​))≤fˉ​Mk​​(xk​), and sets xk+1=TMk(xk)x_{k+1}=T_{M_k}(x_k)xk+1​=TMk​​(xk​). The choice Mk≡LM_k\equiv LMk​≡L always passes the test.

A function fff is star-convex (Definition 1) if its set X∗X^*X∗ of global minimizers is nonempty and, for every x∗∈X∗x^*\in X^*x∗∈X∗, every x∈Fx\in Fx∈F and every α∈[0,1]\alpha\in[0,1]α∈[0,1],

f(αx∗+(1−α)x)≤αf(x∗)+(1−α)f(x).f(\alpha x^*+(1-\alpha)x)\le\alpha f(x^*)+(1-\alpha)f(x).f(αx∗+(1−α)x)≤αf(x∗)+(1−α)f(x).

Write f∗=f(x∗)f^*=f(x^*)f∗=f(x∗) for the optimal value, and D=diam⁡FD=\operatorname{diam}FD=diamF when FFF is bounded.

Formalization targets

Goal: Theorem 4, item 2, inequality (4.2)

Assume fff is star-convex, FFF is bounded with diam⁡F=D\operatorname{diam}F=DdiamF=D, and f(x0)−f∗≤32LD3f(x_0)-f^*\le\tfrac32LD^3f(x0​)−f∗≤23​LD3. Then every run of method (3.3) satisfies

f(xk)−f(x∗)≤3LD32(1+13k)2,k≥0.f(x_k)-f(x^*)\le\frac{3LD^3}{2\left(1+\tfrac13k\right)^2},\qquad k\ge0 .f(xk​)−f(x∗)≤2(1+31​k)23LD3​,k≥0.

The constants are those printed on p. 189. The bound depends on the problem only through LLL and DDD; the lower parameter L0L_0L0​ and the choice of MkM_kMk​ within [L0,2L][L_0,2L][L0​,2L] are free.

Milestones

  1. Lemma 1, (2.3): the cubic Taylor bound ∣f(y)−f(x)−⟨f′(x),y−x⟩−12⟨f′′(x)(y−x),y−x⟩∣≤L6∥y−x∥3|f(y)-f(x)-\langle f'(x),y-x\rangle-\tfrac12\langle f''(x)(y-x),y-x\rangle|\le\tfrac L6\|y-x\|^3∣f(y)−f(x)−⟨f′(x),y−x⟩−21​⟨f′′(x)(y−x),y−x⟩∣≤6L​∥y−x∥3 for x,y∈Fx,y\in Fx,y∈F.
  2. Lemma 4, (2.10): fˉM(x)≤min⁡y∈F[f(y)+L+M6∥y−x∥3]\bar f_M(x)\le\min_{y\in F}\big[f(y)+\tfrac{L+M}{6}\|y-x\|^3\big]fˉ​M​(x)≤miny∈F​[f(y)+6L+M​∥y−x∥3] for x∈Fx\in Fx∈F.
  3. Monotonicity of (3.3) (Section 3, p. 184): f(xk+1)≤f(xk)f(x_{k+1})\le f(x_k)f(xk+1​)≤f(xk​).
  4. Theorem 4, item 1: if f(x0)−f∗≥32LD3f(x_0)-f^*\ge\tfrac32LD^3f(x0​)−f∗≥23​LD3, then f(x1)−f∗≤12LD3f(x_1)-f^*\le\tfrac12LD^3f(x1​)−f∗≤21​LD3.

Significance

The result. Theorem 4 gives a global function-value rate for a second-order method on a class that contains non-convex functions, with no assumption on the Hessian at the minimizer. The method needs no knowledge of the class: the same iteration (3.3) that yields second-order stationarity rates on general functions yields O(1/k2)O(1/k^2)O(1/k2) on star-convex ones. This adaptivity is the paper's main message for Section 4. The analysis also serves as the template for Theorems 5, 8 and 9 of the paper (star-convex with a non-degenerate minimum, and the convex case).

Formalizing it. The theorem has been proved in the paper, and to our knowledge it has not been machine-checked. A complete formalization produces:

  • a reusable Lean statement of the cubic-regularized Newton step and of method (3.3);
  • the Taylor estimates under a Lipschitz Hessian in Rn\mathbb R^nRn;
  • a verified O(1/k2)O(1/k^2)O(1/k2) recursion argument.

These are the pieces needed for the paper's other rates and for later variants (accelerated and adaptive cubic regularization).

Difficulty

The argument has three parts, and each needs some care.

The first is the Taylor bound (2.3) on a convex set FFF, under a Hessian that is Lipschitz only on FFF. The Hessian is given as the derivative of a gradient map, not as a smooth function on all of Rn\mathbb R^nRn.

The second is keeping the iterates inside FFF. Lemma 4 and the diameter bound ∥x∗−xk∥≤D\|x^*-x_k\|\le D∥x∗−xk​∥≤D apply only to points of FFF. So the iterates must be shown to stay in the level set, and the points αx∗+(1−α)xk\alpha x^*+(1-\alpha)x_kαx∗+(1−α)xk​ used in the estimate must also lie in FFF.

The third is the passage from the one-step inequality to the explicit constant in (4.2). The one-step inequality is a minimum over α∈[0,1]\alpha\in[0,1]α∈[0,1] of a cubic in α\alphaα. It has two regimes (the unconstrained minimizer αk\alpha_kαk​ lies inside [0,1][0,1][0,1] or beyond it), and the recursion for αk\alpha_kαk​ must be carried through without losing the constant 3LD3/23LD^3/23LD3/2 or the factor 13\tfrac1331​. A generic "sublinear recursion" lemma gives the rate only up to a constant, which is not the printed theorem.

Formalization scope

  • Space and derivatives. The space is EuclideanSpace ℝ (Fin n) with nnn arbitrary. The gradient and Hessian are maps g and H with HasGradientAt f (g x) x and HasFDerivAt g (H x) x at every x∈Fx\in Fx∈F. These are two-sided derivatives, also at boundary points of FFF; the iterates lie in int⁡F\operatorname{int}FintF. The Hessian norm is the operator norm.
  • The cubic step. TM(x)T_M(x)TM​(x) is any global minimizer of the cubic model (IsCubicStep). Every statement about it holds for every such minimizer.
  • The model value. fˉM(x)\bar f_M(x)fˉ​M​(x) is written as f(x)+mM,x(T)f(x)+m_{M,x}(T)f(x)+mM,x​(T) at the chosen minimizer TTT.
  • The run. A run of (3.3) is the predicate IsCubicNewtonRun, with a 0-based index.
  • Star-convexity. IsStarConvexFn quantifies xxx over FFF, as in display (4.1). It requires X∗≠∅X^*\neq\emptysetX∗=∅ and the inequality for every global minimizer.
  • The diameter. DDD is Metric.diam F, with Bornology.IsBounded F as a hypothesis. It is the diameter of FFF itself, not of the level set.
  • The optimal value. f∗f^*f∗ is f(x∗)f(x^*)f(x∗) for a global minimizer x∗x^*x∗, not an arbitrary lower bound.

Ruling out trivial formalizations. Without the boundedness hypothesis, Metric.diam F is 000, and the goal would assert f(xk)=f∗f(x_k)=f^*f(xk​)=f∗ outright. The formalization keeps boundedness, the nonemptiness of X∗X^*X∗ and the global-minimizer reading of TM(x)T_M(x)TM​(x), so that the hypotheses describe the paper's class and not a degenerate one. The hypotheses are satisfiable: for example, f(y)=12∥y∥2f(y)=\tfrac12\|y\|^2f(y)=21​∥y∥2 on R1\mathbb R^1R1 with FFF the closed unit ball, x0=0x_0=0x0​=0 and Mk≡L=1M_k\equiv L=1Mk​≡L=1.

Contributions are welcome at every level: proofs of the milestones, and general-purpose lemmas on Taylor bounds with a Lipschitz Hessian on convex sets. Those lemmas are reusable for missions I, III and IV of this series, which formalize the paper's other rates.

Selected references

  • Yu. Nesterov and B. T. Polyak, Cubic regularization of Newton method and its global performance, Mathematical Programming Ser. A 108 (2006) 177–205. https://doi.org/10.1007/s10107-006-0706-8
  • Yu. Nesterov, Accelerating the cubic regularization of Newton's method on convex problems, Mathematical Programming Ser. B 112 (2008) 159–181. https://doi.org/10.1007/s10107-006-0089-x
  • C. Cartis, N. I. M. Gould and Ph. L. Toint, Adaptive cubic regularisation methods for unconstrained optimization. Part I: motivation, convergence and numerical results, Mathematical Programming 127 (2011) 245–295. https://doi.org/10.1007/s10107-009-0286-5
  • O. Hinder, A. Sidford and N. Sohoni, Near-optimal methods for minimizing star-convex functions and beyond, COLT 2020. https://arxiv.org/abs/1906.11985
9 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Maximizing Non-Monotone Submodular Functions III: Guarantees of Deterministic Local SearchResearch Paper

Motivation

Many optimization problems ask for a subset of a finite ground set that maximizes a function with diminishing returns: the cut of a graph or a directed graph, the value of a facility-location configuration, the entropy of a set of random variables, or a welfare function in combinatorial auctions. These functions are submodular but typically non-monotone: adding elements can decrease the value. Max Cut and Max Directed Cut are the textbook special cases. Unconstrained maximization of a nonnegative non-monotone submodular function is NP-hard, and before Feige, Mirrokni and Vondrák (SIAM J. Comput. 40(4), 2011) no constant-factor approximation was known for general such functions in the value-oracle model.

The paper gives several algorithms. A uniformly random set achieves 1/41/41/4 of the optimum (a separate mission of this series). This mission concerns the paper's first deterministic algorithm: a local search that repeatedly adds or removes a single element while the value improves by a factor larger than 1+ϵ/n21 + \epsilon/n^21+ϵ/n2, and returns the better of the final set and its complement. The key structural fact behind it, that a local optimum of a submodular function dominates all its subsets and supersets, goes back to Cherenin (1962) and Goldengorin, Tijssen and Tso (1999).

Timeline. Cherenin (1962) and Goldengorin–Tijssen–Tso (1999): local optima dominate comparable sets. Schäffer and Yannakakis (SIAM J. Comput. 1991): finding an exact local optimum of Max Cut is PLS-complete, which is why the algorithm here uses an approximate improvement threshold. Feige–Mirrokni–Vondrák (FOCS 2007; SIAM J. Comput. 2011): the 1/31/31/3 and 1/21/21/2 guarantees of this mission, and 2/52/52/5 for a randomized "smooth" local search. Buchbinder, Feldman, Naor and Schwartz (SIAM J. Comput. 2015): a randomized double-greedy 1/21/21/2-approximation, which is optimal in the value-oracle model by the lower bound of the same 2011 paper.

Setting

Let XXX be a finite ground set with n=∣X∣n = |X|n=∣X∣ elements. A set function assigns a real number f(S)f(S)f(S) to every S⊆XS \subseteq XS⊆X. It is submodular (Definition 1.1) if

f(S∪T)+f(S∩T)≤f(S)+f(T)for all S,T⊆X,f(S \cup T) + f(S \cap T) \le f(S) + f(T) \qquad \text{for all } S, T \subseteq X,f(S∪T)+f(S∩T)≤f(S)+f(T)for all S,T⊆X,

and symmetric if f(X∖S)=f(S)f(X \setminus S) = f(S)f(X∖S)=f(S) for all SSS. Throughout the section of the paper formalized here, fff is nonnegative. The algorithm may query f(S)f(S)f(S) for any SSS (a value oracle). The optimum is OPT=max⁡S⊆Xf(S)\mathrm{OPT} = \max_{S \subseteq X} f(S)OPT=maxS⊆X​f(S).

A set SSS is a local optimum if f(S∪{a})≤f(S)f(S \cup \{a\}) \le f(S)f(S∪{a})≤f(S) for every a∉Sa \notin Sa∈/S and f(S∖{a})≤f(S)f(S \setminus \{a\}) \le f(S)f(S∖{a})≤f(S) for every a∈Sa \in Sa∈S. It is a (1+α)(1+\alpha)(1+α)-approximate local optimum (Definition 3.2) if (1+α)f(S)≥f(S∖{v})(1+\alpha)f(S) \ge f(S \setminus \{v\})(1+α)f(S)≥f(S∖{v}) for v∈Sv \in Sv∈S and (1+α)f(S)≥f(S∪{v})(1+\alpha)f(S) \ge f(S \cup \{v\})(1+α)f(S)≥f(S∪{v}) for v∉Sv \notin Sv∈/S.

Algorithm LS with parameter ϵ>0\epsilon > 0ϵ>0 and c=1+ϵ/n2c = 1 + \epsilon/n^2c=1+ϵ/n2:

  1. Let S:={v}S := \{v\}S:={v}, where f({v})f(\{v\})f({v}) is the maximum over all singletons.
  2. If some a∈X∖Sa \in X \setminus Sa∈X∖S has f(S∪{a})>c f(S)f(S \cup \{a\}) > c\,f(S)f(S∪{a})>cf(S), let S:=S∪{a}S := S \cup \{a\}S:=S∪{a} and repeat step 2.
  3. If some a∈Sa \in Sa∈S has f(S∖{a})>c f(S)f(S \setminus \{a\}) > c\,f(S)f(S∖{a})>cf(S), let S:=S∖{a}S := S \setminus \{a\}S:=S∖{a} and go back to step 2.
  4. Return max⁡{f(S),f(X∖S)}\max\{f(S), f(X \setminus S)\}max{f(S),f(X∖S)}.

In Lean these are Submodular, SymmetricSetFun, OPT, IsLocalOptimum, IsApproxLocalOptimum, lsStep, IsLSRun, IsLSTerminal and lsOutput in NonmonotoneSubmod.LocalSearch.

Formalization targets

Goal: Theorem 3.4 (p. 1141)

For nonnegative submodular fff on a nonempty XXX and ϵ>0\epsilon > 0ϵ>0, every run of Algorithm LS, with any choice of starting singleton and of improving elements, satisfies:

at termination at S:max⁡{f(S),f(X∖S)}≥(13−ϵn)OPT;\text{at termination at } S:\qquad \max\{f(S), f(X\setminus S)\} \ge \Big(\frac13 - \frac{\epsilon}{n}\Big)\mathrm{OPT};at termination at S:max{f(S),f(X∖S)}≥(31​−nϵ​)OPT; if f is symmetric, at termination at S:f(S)≥(12−ϵn)OPT;\text{if } f \text{ is symmetric, at termination at } S:\qquad f(S) \ge \Big(\frac12 - \frac{\epsilon}{n}\Big)\mathrm{OPT};if f is symmetric, at termination at S:f(S)≥(21​−nϵ​)OPT; if n≥2, after any k steps:(1+ϵn2)k≤n.\text{if } n \ge 2, \text{ after any } k \text{ steps}:\qquad \Big(1 + \frac{\epsilon}{n^2}\Big)^k \le n.if n≥2, after any k steps:(1+n2ϵ​)k≤n.

The last line is the explicit content of the printed bound of O(1ϵn3log⁡n)O(\frac1\epsilon n^3 \log n)O(ϵ1​n3logn) oracle calls: it gives k=O(1ϵn2log⁡n)k = O(\frac1\epsilon n^2 \log n)k=O(ϵ1​n2logn) steps of at most 2n2n2n queries each, and in particular termination.

Milestones, in attack order

  1. Lemma 3.1: a local optimum SSS of a submodular fff satisfies f(T)≤f(S)f(T) \le f(S)f(T)≤f(S) whenever T⊆ST \subseteq ST⊆S or T⊇ST \supseteq ST⊇S.
  2. Lemma 3.3: for a (1+α)(1+\alpha)(1+α)-approximate local optimum, f(T)≤(1+nα)f(S)f(T) \le (1 + n\alpha) f(S)f(T)≤(1+nα)f(S) for such TTT.
  3. Termination bridge (sentence after Algorithm LS): a set at which LS has terminated is a (1+ϵ/n2)(1+\epsilon/n^2)(1+ϵ/n2)-approximate local optimum.
  4. First display of the proof: 2(1+nα)f(S)+f(X∖S)≥f(C)2(1+n\alpha)f(S) + f(X\setminus S) \ge f(C)2(1+nα)f(S)+f(X∖S)≥f(C) for every CCC.
  5. Second display, symmetric case: 2(1+nα)f(S)≥f(C)2(1+n\alpha)f(S) \ge f(C)2(1+nα)f(S)≥f(C) for every CCC.
  6. OPT≤nf({v})\mathrm{OPT} \le n f(\{v\})OPT≤nf({v}) for a maximum-value singleton, when n≥2n \ge 2n≥2.
  7. Growth along a run: f(Sk)≥(1+ϵ/n2)kf({v})f(S_k) \ge (1+\epsilon/n^2)^k f(\{v\})f(Sk​)≥(1+ϵ/n2)kf({v}).

Significance

The result. Theorem 3.4 is the deterministic constant-factor approximation of the paper that first gave guaranteed approximation factors for maximizing general nonnegative submodular functions ("Prior to our work, to the best of our knowledge, no guaranteed approximation factor was known", p. 1135), and the 1/21/21/2 bound for symmetric functions matches the value-oracle lower bound proved in the same paper (so it is optimal for symmetric functions among algorithms using polynomially many queries). Local search with a multiplicative acceptance threshold was subsequently used for constrained non-monotone submodular maximization (matroid and knapsack constraints, Lee–Mirrokni–Nagarajan–Sviridenko 2010).

Formalizing it. The result is proved; to our knowledge neither the theorem nor Lemmas 3.1 and 3.3 has a machine-checked proof. The mission produces a reusable finite model of set functions and single-element local search over Finset, with the algorithm stated as a nondeterministic step relation, so that the guarantee is proved for every tie-breaking rule. The same model is the starting point for formalizing other local-search guarantees.

Difficulty

The natural first idea, to argue from an exact local optimum via Lemma 3.1, does not apply: LS stops at an approximate local optimum, and the error α\alphaα per element must be accumulated along a chain of up to nnn single-element changes between SSS and S∩CS \cap CS∩C or S∪CS \cup CS∪C. This accumulation is where the nonnegativity of fff enters (the lemma fails for negative-valued fff), and where the factor nα=ϵ/nn\alpha = \epsilon/nnα=ϵ/n in the final ratio comes from. The running-time bound requires relating OPT\mathrm{OPT}OPT to the best singleton, which uses submodularity on sets of all sizes and breaks down on a one-element ground set. A further bookkeeping difficulty is the algorithm itself: its steps are ordered (removals only when no addition applies), and the termination bridge must use that order.

Formalization scope

  • Ground set: X : Type with [Fintype X] [DecidableEq X]; subsets are Finset X; fff is Finset X → ℝ; complements are Sᶜ. nnn is (Fintype.card X : ℝ).
  • Nonnegativity is the hypothesis ∀ S, 0 ≤ f S (standing assumption of §3); Lemma 3.1 and the termination bridge are stated without it, as they need none.
  • OPT\mathrm{OPT}OPT is the maximum over all subsets (Finset.sup'), never a supremum with a default value.
  • The algorithm is a relation: a run is a sequence S : ℕ → Finset X with S 0 = {v} for any maximum-value singleton v and consecutive sets related by an LS step; the theorems quantify over all runs. Steps use strict inequalities, termination their negation, exactly as printed.
  • Added hypotheses, each disclosed in the item statements: ϵ>0\epsilon > 0ϵ>0 (implicit in the paper); X≠∅X \neq \emptysetX=∅ for the goal; α≥0\alpha \ge 0α≥0 and f≥0f \ge 0f≥0 for Lemma 3.3 and the displays; n≥2n \ge 2n≥2 for OPT≤nf({v})\mathrm{OPT} \le n f(\{v\})OPT≤nf({v}) and the step bound (both false for n=1n = 1n=1: f(∅)=5f(\emptyset) = 5f(∅)=5, f({v})=0f(\{v\}) = 0f({v})=0). The displays are stated for every set CCC, not only an optimal one.
  • The printed O(1ϵn3log⁡n)O(\frac1\epsilon n^3 \log n)O(ϵ1​n3logn) oracle-call bound, an asymptotic statement with an unquantified constant, is replaced by the explicit step bound (1+ϵ/n2)k≤n(1+\epsilon/n^2)^k \le n(1+ϵ/n2)k≤n that its proof establishes.
  • Ruling out trivialization: the goal names the algorithm (its start at a maximum singleton, its ordered step rules, termination, and the returned maximum). A statement "for every (1+α)(1+\alpha)(1+α)-approximate local optimum" is a milestone, not the theorem; an exact local optimum (α=0\alpha = 0α=0) is a different algorithm.
  • Not in scope: the tight example of pp. 1141–1142, the randomized local search of §3.2, and the hardness results of §4.

Contributions welcome: proofs of the milestones, general lemmas about chains of single-element changes in Finset, and the derivation of the goal from them.

Selected references

  • U. Feige, V. S. Mirrokni, J. Vondrák, Maximizing Non-Monotone Submodular Functions, SIAM J. Comput. 40(4):1133–1153, 2011. https://doi.org/10.1137/090779346
  • V. Cherenin, Solving some combinatorial problems of optimal planning by the method of successive calculations, Novosibirsk, 1962 (in Russian).
  • B. Goldengorin, G. Tijssen, M. Tso, The Maximization of Submodular Functions: Old and New Proofs for the Correctness of the Dichotomy Algorithm, SOM report, University of Groningen, 1999.
  • A. A. Schäffer, M. Yannakakis, Simple local search problems that are hard to solve, SIAM J. Comput. 20(1):56–87, 1991. https://doi.org/10.1137/0220004
  • J. Lee, V. S. Mirrokni, V. Nagarajan, M. Sviridenko, Maximizing nonmonotone submodular functions under matroid or knapsack constraints, SIAM J. Discrete Math. 23(4):2053–2078, 2010. https://doi.org/10.1137/090750020
  • N. Buchbinder, M. Feldman, J. Naor, R. Schwartz, A tight linear time (1/2)-approximation for unconstrained submodular maximization, SIAM J. Comput. 44(5):1384–1402, 2015. https://doi.org/10.1137/130929205
14 thms2 active usersReviewed
🏆Completed
Convex OptimizationNumerical AnalysisOperations Research·Captain: mikedeng1

The Generalized Quasi-Variational Inequality Problem III: The Projection Map Is a Contraction and Its Iterates Converge to a SolutionResearch Paper

Motivation

A variational inequality asks for a point xxx of a set K⊆RnK\subseteq\mathbb R^nK⊆Rn at which a vector field fff points "into" KKK: (x′−x)Tf(x)≥0(x'-x)^T f(x)\ge 0(x′−x)Tf(x)≥0 for every x′∈Kx'\in Kx′∈K. It is the common form of the first-order optimality conditions of constrained optimization, of complementarity problems, and of equilibrium models in economics and traffic networks. In many of these models the feasible set itself depends on the decision: the admissible actions of one agent are restricted by the current state, as in the impulse-control problems of Bensoussan and Lions that motivated quasi-variational inequalities, where K=K(x)K=K(x)K=K(x).

D. Chan and J. S. Pang, The generalized quasi-variational inequality problem (Math. Oper. Res. 7 (1982) 211–222), unify the quasi-variational inequality with the generalized (set-valued) variational inequality of Fang and Peterson (JOTA 1982). Their §§3–4 prove existence by fixed-point theorems for set-valued maps; §5 takes a different route and characterizes solutions as fixed points of a composite projection map. Theorem 5.3, the subject of this mission, gives conditions under which that map is a contraction, so that its fixed point exists, is unique, solves the problem, and is computed by plain fixed-point iteration from any starting point. It is the algorithmic result of the paper, and an early instance of the projection methods for strongly monotone quasi-variational inequalities studied since (e.g. Nesterov and Scrimali 2011).

Setting

Throughout, Rn\mathbb R^nRn carries the Euclidean inner product xTyx^T yxTy and norm ∥x∥\|x\|∥x∥.

Given point-to-set mappings KKK and fff of Rn\mathbb R^nRn into itself, the generalized quasi-variational inequality problem GQVI(K,f)\mathrm{GQVI}(K,f)GQVI(K,f) is to find vectors xxx and yyy with

x∈K(x),y∈f(x),(x′−x)Ty≥0for all x′∈K(x).x\in K(x),\qquad y\in f(x),\qquad (x'-x)^T y\ge 0\quad\text{for all }x'\in K(x).x∈K(x),y∈f(x),(x′−x)Ty≥0for all x′∈K(x).

When fff is point-to-point, f(x)f(x)f(x) is read as the singleton {f(x)}\{f(x)\}{f(x)}.

For a set SSS and a point zzz, the projection PS(z)P_S(z)PS​(z) is the point of SSS nearest to zzz, PS(z)=sol⁡min⁡x∈S∥x−z∥P_S(z)=\operatorname{sol}\min_{x\in S}\|x-z\|PS​(z)=solminx∈S​∥x−z∥; it exists and is unique when SSS is nonempty, closed and convex.

Theorem 5.3 concerns the special structure in which the feasible set moves by translation: fix a nonempty closed convex set K~\tilde KK~ and a point-to-point mapping mmm, and put

K(x)=m(x)+K~={m(x)+k:k∈K~}.K(x)=m(x)+\tilde K=\{m(x)+k : k\in\tilde K\}.K(x)=m(x)+K~={m(x)+k:k∈K~}.

For a step length λ>0\lambda>0λ>0 and a point-to-point fff, the projection map is

Fλ(x)=PK(x)(x−λf(x)).F_\lambda(x)=P_{K(x)}\bigl(x-\lambda f(x)\bigr).Fλ​(x)=PK(x)​(x−λf(x)).

The mappings mmm and fff are assumed Lipschitz continuous with constants α\alphaα, β\betaβ (∥m(x)−m(y)∥≤α∥x−y∥\|m(x)-m(y)\|\le\alpha\|x-y\|∥m(x)−m(y)∥≤α∥x−y∥, ∥f(x)−f(y)∥≤β∥x−y∥\|f(x)-f(y)\|\le\beta\|x-y\|∥f(x)−f(y)∥≤β∥x−y∥) and strongly monotone with constants γ\gammaγ, δ\deltaδ ((x−y)T(m(x)−m(y))≥γ∥x−y∥2(x-y)^T(m(x)-m(y))\ge\gamma\|x-y\|^2(x−y)T(m(x)−m(y))≥γ∥x−y∥2, (x−y)T(f(x)−f(y))≥δ∥x−y∥2(x-y)^T(f(x)-f(y))\ge\delta\|x-y\|^2(x−y)T(f(x)−f(y))≥δ∥x−y∥2).

Formalization targets

Goal: Theorem 5.3 (p. 221)

For each λ>0\lambda>0λ>0 with

λ2β2+2λ(αβ−δ)−2(γ−α)<0,\lambda^2\beta^2+2\lambda(\alpha\beta-\delta)-2(\gamma-\alpha)<0,λ2β2+2λ(αβ−δ)−2(γ−α)<0,

the map FλF_\lambdaFλ​ is a contraction (Lipschitz with a constant c<1c<1c<1 independent of the points), it has a fixed point x~λ\tilde x_\lambdax~λ​, the point x~λ\tilde x_\lambdax~λ​ solves GQVI(K,f)\mathrm{GQVI}(K,f)GQVI(K,f), and the iterates xk+1=Fλ(xk)x^{k+1}=F_\lambda(x^k)xk+1=Fλ​(xk) converge to x~λ\tilde x_\lambdax~λ​ from every initial vector x0∈Rnx^0\in\mathbb R^nx0∈Rn. All four conclusions are stated together.

Milestones

  1. Projection onto a translate (§5, proof of Theorem 5.3, first display, p. 221): PK(x)(y)=m(x)+PK~(y−m(x))P_{K(x)}(y)=m(x)+P_{\tilde K}(y-m(x))PK(x)​(y)=m(x)+PK~​(y−m(x)) for all x,yx,yx,y.
  2. Lipschitz estimate (§5, proof of Theorem 5.3, last display, p. 221): for every λ>0\lambda>0λ>0,
∥Fλ(y1)−Fλ(y2)∥≤[α+(λ2β2+2λ(αβ−δ)+(1+α2−2γ))1/2]∥y1−y2∥.\|F_\lambda(y^1)-F_\lambda(y^2)\|\le\Bigl[\alpha+\bigl(\lambda^2\beta^2+2\lambda(\alpha\beta-\delta)+(1+\alpha^2-2\gamma)\bigr)^{1/2}\Bigr]\|y^1-y^2\|.∥Fλ​(y1)−Fλ​(y2)∥≤[α+(λ2β2+2λ(αβ−δ)+(1+α2−2γ))1/2]∥y1−y2∥.
  1. Theorem 5.1 (p. 220): if every K(x)K(x)K(x) is closed and convex, (x∗,y∗)(x^*,y^*)(x∗,y∗) solves GQVI(K,f)\mathrm{GQVI}(K,f)GQVI(K,f) if and only if x∗=PK(x∗)(x∗−y∗)x^*=P_{K(x^*)}(x^*-y^*)x∗=PK(x∗)​(x∗−y∗) and y∗∈f(x∗)y^*\in f(x^*)y∗∈f(x∗).

Significance

The result. Theorem 5.3 turns an existence question into a computation: under Lipschitz and strong monotonicity assumptions, a quasi-variational inequality with translated feasible sets has exactly one solution reachable by projection iterations, each of which is a projection on the fixed set K~\tilde KK~ (a convex quadratic program when K~\tilde KK~ is polyhedral). The step-size window it gives is explicit in α,β,γ,δ\alpha,\beta,\gamma,\deltaα,β,γ,δ, so it certifies a convergent method before any iteration is run. The closing remark of the paper (p. 222) reads each step as solving the GQVI under a zero-th order approximation of KKK, the viewpoint behind later splitting methods.

Formalizing it. The result is proved in the paper; the proof is short, but its constants and the equivalence of the two contraction conditions are easy to get wrong. A machine-checked version fixes the exact hypotheses (no sign conditions on the constants, Euclidean geometry), and produces reusable pieces: the translation identity for projections, nonexpansiveness of the Euclidean projection on a closed convex set, and the projection characterization of quasi-variational inequalities (Theorem 5.1).

Difficulty

Banach's fixed-point theorem does the last step; the work is the estimate. The naive bound, projection nonexpansiveness applied directly to FλF_\lambdaFλ​, fails because the sets K(y1)K(y^1)K(y1) and K(y2)K(y^2)K(y2) differ: two projections on different sets are not controlled by the distance of the projected points alone. The translation identity separates the moving part m(y1)−m(y2)m(y^1)-m(y^2)m(y1)−m(y2) from a projection on the one set K~\tilde KK~, at the cost of the additive term α\alphaα in the constant. The remaining square must be expanded with the inner-product cross terms bounded by the monotonicity constants in the right directions, including the cross term between fff and mmm. Finally, the condition "bracket <1<1<1" is equivalent to the stated λ\lambdaλ-condition only when α<1\alpha<1α<1, which must be derived from the hypotheses rather than assumed.

Formalization scope

  • The space is EuclideanSpace ℝ (Fin n), with Mathlib's Euclidean norm and inner product; Fin n → ℝ (sup norm) would change every constant. No assumption n≥1n\ge1n≥1 is made; at n=0n=0n=0 all statements hold trivially.
  • The constants α,β,γ,δ\alpha,\beta,\gamma,\deltaα,β,γ,δ are real numbers with no sign conditions, as in the paper; the Lipschitz and monotonicity hypotheses are the displayed inequalities for all x,yx,yx,y. For n≥1n\ge1n≥1 they force α,β≥0\alpha,\beta\ge0α,β≥0, γ≤α\gamma\le\alphaγ≤α, δ≤β\delta\le\betaδ≤β, and the λ\lambdaλ-condition then forces α<1\alpha<1α<1 and δ>αβ\delta>\alpha\betaδ>αβ.
  • K(x)K(x)K(x) is the translate {m(x)+k:k∈K~}\{m(x)+k : k\in\tilde K\}{m(x)+k:k∈K~} of a fixed set K~\tilde KK~, assumed nonempty, closed and convex. The projection is a nearest-point function proj that returns a junk value only when no nearest point exists; under the hypotheses of every statement using it, the nearest point exists and is unique, so proj is the paper's PPP. Theorem 5.1 is stated relationally (nearest-point predicate IsProj) to avoid junk values altogether.
  • "Contraction" is Mathlib's ContractingWith c F with c : ℝ≥0: c < 1 and a Lipschitz bound with that single constant. A constant allowed to depend on the points, or a Lipschitz bound without c < 1, is not a contraction and would trivialize the goal; so would a projection whose junk value is reachable (e.g. with K~\tilde KK~ empty), which makes FλF_\lambdaFλ​ unrelated to the paper's map. The fixed point must be linked to the GQVI and to the iteration from every starting point.
  • The square root in the Lipschitz estimate is Real.sqrt; its radicand is nonnegative under the hypotheses when n≥1n\ge1n≥1.
  • Useful infrastructure: Mathlib's ContractingWith.fixedPoint and ContractingWith.tendsto_iterate_fixedPoint (Banach), exists_norm_eq_iInf_of_complete_convex and norm_eq_iInf_iff_real_inner_le_zero (projection on convex sets), and the platform theorem VectorSpaceOpt.min_distance_convex_set. A general lemma that the Euclidean nearest-point map of a closed convex set is 1-Lipschitz is reusable well beyond this mission and is welcome as a separate contribution.

Selected references

  • D. Chan and J. S. Pang, The generalized quasi-variational inequality problem, Mathematics of Operations Research 7(2) (1982) 211–222. https://doi.org/10.1287/moor.7.2.211
  • S. C. Fang and E. L. Peterson, Generalized variational inequalities, Journal of Optimization Theory and Applications 38 (1982) 363–383. https://doi.org/10.1007/BF00935344
  • Y. Nesterov and L. Scrimali, Solving strongly monotone variational and quasi-variational inequalities, Discrete and Continuous Dynamical Systems 31(4) (2011) 1383–1396. https://doi.org/10.3934/dcds.2011.31.1383
7 thms2 active usersReviewed
🏆Completed
Numerical AnalysisOperations Research·Captain: mikedeng1

Projected Gradient Methods for Linearly Constrained Problems III: Finite Termination of a Gradient Projection Algorithm for Quadratic ProgrammingResearch Paper

Motivation

Quadratic programming, the minimisation of a quadratic function subject to linear inequality constraints, is a basic subproblem of nonlinear optimisation (sequential quadratic programming, trust-region methods) and a model in its own right in portfolio selection, least-squares estimation and control. The classical solution methods are active-set methods: they keep a set of constraints treated as equalities, minimise over the resulting affine set, and then decide which constraint to drop or add (Gill, Murray and Wright, Practical Optimization, 1981; Fletcher, Practical Methods of Optimization, Vol. 2, 1981). Their finite-termination proofs need either a nondegeneracy assumption (linearly independent active constraints) or an anti-cycling rule, because under degeneracy the choice of the constraint to drop, made from Lagrange multiplier estimates, can cycle.

Calamai and Moré (Mathematical Programming 39, 1987) showed that the gradient projection method can take over the step that leaves a working set. Their Algorithm 6.1 alternates two kinds of step: an arbitrary non-increasing step that adds constraints to the working set until the equality-constrained subproblem is solved, and a single projected-gradient step once it is solved. Theorem 6.2 states that this algorithm terminates at a stationary point for every quadratic that is bounded below on the feasible polyhedron, with no nondegeneracy assumption and no anti-cycling rule. The same paper's Sections 2–4 (the subject of the first two missions of this series) supply the properties of the gradient projection step that the argument uses.

Timeline of the ingredients:

  • 1964, 1966: Goldstein and Levitin–Polyak introduce the gradient projection method xk+1=P(xk−αk∇f(xk))x_{k+1} = P(x_k - \alpha_k\nabla f(x_k))xk+1​=P(xk​−αk​∇f(xk​)) for convex constraint sets.
  • 1976: Bertsekas proves finite identification of the active constraints for bound constraints and the Armijo rule.
  • 1981: Dunn uses the descent inequalities (2.4)–(2.5) in the analysis of the method.
  • 1987: Calamai and Moré generalise the step rule to (2.1)–(2.2), prove convergence of projected gradients, identification of active constraints for general polyhedra, and finite termination of Algorithm 6.1.

Setting

Let EEE be a finite-dimensional real inner product space (the paper's Rn\mathbb{R}^nRn with a general inner product). The feasible set is a polyhedron

Ω={x∈E:⟨cj,x⟩≥δj, j=1,…,m},\Omega = \{x \in E : \langle c_j, x\rangle \ge \delta_j,\ j = 1, \dots, m\},Ω={x∈E:⟨cj​,x⟩≥δj​, j=1,…,m},

with active set A(x)={j:⟨cj,x⟩=δj}A(x) = \{j : \langle c_j, x\rangle = \delta_j\}A(x)={j:⟨cj​,x⟩=δj​}. The objective is a quadratic function f(x)=12⟨x,Qx⟩+⟨b,x⟩+c0f(x) = \tfrac12\langle x, Qx\rangle + \langle b, x\rangle + c_0f(x)=21​⟨x,Qx⟩+⟨b,x⟩+c0​ with QQQ self-adjoint but not necessarily positive semidefinite, so fff may be nonconvex. Its gradient ∇f\nabla f∇f is taken with respect to the inner product of EEE.

The projection into Ω\OmegaΩ is P(x)=argmin⁡{∥z−x∥:z∈Ω}P(x) = \operatorname{argmin}\{\|z - x\| : z \in \Omega\}P(x)=argmin{∥z−x∥:z∈Ω}, and a point x∗∈Ωx^* \in \Omegax∗∈Ω is stationary if ⟨∇f(x∗),x−x∗⟩≥0\langle\nabla f(x^*), x - x^*\rangle \ge 0⟨∇f(x∗),x−x∗⟩≥0 for every x∈Ωx \in \Omegax∈Ω.

A gradient projection step from xkx_kxk​ is xk+1=P(xk−αk∇f(xk))x_{k+1} = P(x_k - \alpha_k\nabla f(x_k))xk+1​=P(xk​−αk​∇f(xk​)) with αk>0\alpha_k > 0αk​>0 satisfying the sufficient decrease condition (2.1) with a constant μ1∈(0,1)\mu_1 \in (0,1)μ1​∈(0,1), the condition (2.2) that αk≥γ1\alpha_k \ge \gamma_1αk​≥γ1​ or αk≥γ2αˉk>0\alpha_k \ge \gamma_2\bar\alpha_k > 0αk​≥γ2​αˉk​>0 for some αˉk\bar\alpha_kαˉk​ at which the decrease test (2.3) with constant μ2∈(0,1)\mu_2 \in (0,1)μ2​∈(0,1) fails, and the upper bound αk≤γ3\alpha_k \le \gamma_3αk​≤γ3​ (3.2).

A working set is a set W⊆{1,…,m}W \subseteq \{1, \dots, m\}W⊆{1,…,m}; problem (6.2) is min⁡{f(y):⟨cj,y⟩=δj, j∈W}\min\{f(y) : \langle c_j, y\rangle = \delta_j,\ j \in W\}min{f(y):⟨cj​,y⟩=δj​, j∈W}, over an affine set that ignores the inequality constraints outside WWW.

Algorithm 6.1 produces iterates xk∈Ωx_k \in \Omegaxk​∈Ω and working sets Wk⊆A(xk)W_k \subseteq A(x_k)Wk​⊆A(xk​) from x0∈Ωx_0 \in \Omegax0​∈Ω:

  • (a) if xkx_kxk​ is a global minimiser of (6.2) for WkW_kWk​, then xk+1x_{k+1}xk+1​ is a gradient projection step from xkx_kxk​;
  • (b) otherwise xk+1∈Ωx_{k+1} \in \Omegaxk+1​∈Ω, f(xk+1)≤f(xk)f(x_{k+1}) \le f(x_k)f(xk+1​)≤f(xk​), Wk⊆Wk+1W_k \subseteq W_{k+1}Wk​⊆Wk+1​, and if Wk+1=WkW_{k+1} = W_kWk+1​=Wk​ then xk+1x_{k+1}xk+1​ is a global minimiser of (6.2).

Formalization targets

Goal: Theorem 6.2

For every quadratic fff bounded below on Ω\OmegaΩ, all constants γ1,γ2>0\gamma_1, \gamma_2 > 0γ1​,γ2​>0, μ1,μ2∈(0,1)\mu_1, \mu_2 \in (0,1)μ1​,μ2​∈(0,1), γ3∈R\gamma_3 \in \mathbb{R}γ3​∈R, and every run (xk,Wk,αk)k≥0(x_k, W_k, \alpha_k)_{k\ge0}(xk​,Wk​,αk​)k≥0​ of Algorithm 6.1,

∃ l≥0:⟨∇f(xl),x−xl⟩≥0for all x∈Ω.\exists\, l \ge 0 :\quad \langle \nabla f(x_l), x - x_l\rangle \ge 0 \quad \text{for all } x \in \Omega.∃l≥0:⟨∇f(xl​),x−xl​⟩≥0for all x∈Ω.

The theorem makes no assumption on the boundedness of the iterates and none on the linear independence of the constraints.

Milestones

  • Lemma 2.1(a): for nonempty closed convex Ω\OmegaΩ, z∈Ωz \in \Omegaz∈Ω and any xxx, ⟨P(x)−x,z−P(x)⟩≥0\langle P(x) - x, z - P(x)\rangle \ge 0⟨P(x)−x,z−P(x)⟩≥0.
  • Eq. (2.5): for xk∈Ωx_k \in \Omegaxk​∈Ω, αk>0\alpha_k > 0αk​>0 and xk+1=P(xk−αk∇f(xk))x_{k+1} = P(x_k - \alpha_k\nabla f(x_k))xk+1​=P(xk​−αk​∇f(xk​)),
⟨∇f(xk),xk−xk+1⟩≥∥xk+1−xk∥2αk.\langle\nabla f(x_k), x_k - x_{k+1}\rangle \ge \frac{\|x_{k+1} - x_k\|^2}{\alpha_k}.⟨∇f(xk​),xk​−xk+1​⟩≥αk​∥xk+1​−xk​∥2​.

Significance

Theorem 6.2 separates the two roles an active-set method plays: solving equality-constrained subproblems, for which any method that does not increase fff may be used, and choosing the next working set, which the gradient projection step does. The consequence is a finitely terminating quadratic programming algorithm for nonconvex quadratics that needs neither nondegeneracy nor an anti-cycling rule, and a template for large-scale bound-constrained and linearly constrained solvers that combine projection steps with subspace minimisation.

The result is proved in the paper and is classical; no machine-checked version is known. A formalization produces a checked finite-termination theorem for an active-set method on degenerate problems, together with reusable pieces: the projection onto a polyhedron as a total function with its variational inequality, the descent estimate of a projected step, and a predicate describing active-set runs with working sets, which other active-set algorithms can reuse.

Difficulty

The obvious argument — each step decreases fff and there are finitely many working sets — fails on two counts. First, step (b) only guarantees f(xk+1)≤f(xk)f(x_{k+1}) \le f(x_k)f(xk+1​)≤f(xk​), so fff values alone do not rule out infinitely many iterations; the nesting of working sets and the final clause of step (b) are what bound consecutive (b)-steps. Second, a gradient projection step taken at a solution of (6.2) can in principle leave fff unchanged, and nothing in the algorithm's rules says directly that it makes progress; that it does so at every non-stationary iterate is a property of the projection and of the step conditions (2.1)–(2.2), not of the algorithm. A further point is that the minimum of (6.2) is taken over an affine set, not over Ω\OmegaΩ, and the link between the value at a step-(a) iterate and later iterates runs through the requirement Wk⊆A(xk)W_k \subseteq A(x_k)Wk​⊆A(xk​).

Formalization scope

The space is a finite-dimensional real inner product space E; ∇f\nabla f∇f is Mathlib's gradient. Constraints are indexed by Fin m, working and active sets are Finset (Fin m), and a run is a predicate IsAlgorithm61Run on three sequences x:N→Ex : \mathbb{N} \to Ex:N→E, WWW, α\alphaα indexed from 000. The run does not stop by itself; "the algorithm terminates at a stationary iterate" is rendered as the existence of an index lll with xlx_lxl​ stationary. The projection is argmin made total by a junk value 000 that is unreachable when Ω\OmegaΩ is nonempty, closed and convex. The paper's "⊂\subset⊂" between working sets is inclusion. A quadratic function is 12⟨x,Qx⟩+⟨b,x⟩+c0\tfrac12\langle x, Qx\rangle + \langle b, x\rangle + c_021​⟨x,Qx⟩+⟨b,x⟩+c0​ with QQQ symmetric and no definiteness assumption.

A trivializing formalization — a run predicate that forces x0x_0x0​ to be stationary, or that no sequence satisfies — would make the goal empty; the step rules here are the paper's verbatim, and a run on Ω=[0,∞)⊂R\Omega = [0,\infty) \subset \mathbb{R}Ω=[0,∞)⊂R with f(x)=xf(x) = xf(x)=x starting at the non-stationary point x0=1x_0 = 1x0​=1 satisfies the predicate. Replacing step (a) by "any step that strictly decreases fff" would assume the central fact and is not acceptable.

A complete development needs: the variational inequality of the projection (Lemma 2.1(a)), the descent estimate (2.5), the characterisation of stationary points as fixed points of the projected step, and a finiteness argument over the finitely many subsets of Fin m. Proofs of the milestones, of these auxiliary facts, and of the goal are all welcome.

Selected references

  • P. H. Calamai and J. J. Moré, Projected gradient methods for linearly constrained problems, Mathematical Programming 39 (1987) 93–116. https://doi.org/10.1007/BF02592073
  • A. A. Goldstein, Convex programming in Hilbert space, Bulletin of the AMS 70 (1964) 709–710. https://doi.org/10.1090/S0002-9904-1964-11178-2
  • E. S. Levitin and B. T. Polyak, Constrained minimization methods, USSR Computational Mathematics and Mathematical Physics 6 (1966) 1–50. https://doi.org/10.1016/0041-5553(66)90114-5
  • D. P. Bertsekas, On the Goldstein–Levitin–Polyak gradient projection method, IEEE Transactions on Automatic Control 21 (1976) 174–184. https://doi.org/10.1109/TAC.1976.1101194
  • J. C. Dunn, Global and asymptotic convergence rate estimates for a class of projected gradient processes, SIAM Journal on Control and Optimization 19 (1981) 368–400. https://doi.org/10.1137/0319022
  • P. E. Gill, W. Murray and M. H. Wright, Practical Optimization, Academic Press, 1981. https://doi.org/10.1137/1.9781611975604
8 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations Research·Captain: mikedeng1

Projected Gradient Methods for Linearly Constrained Problems II: Finite Identification of the Active Constraints at a Nondegenerate PointResearch Paper

Motivation

Minimizing a smooth function subject to linear inequality constraints is the core subproblem of much of nonlinear optimization: bound-constrained problems, quadratic programs, and the subproblems of sequential quadratic programming and augmented Lagrangian methods all have this form. Methods for these problems are usually built from two parts, one that decides which constraints hold with equality at the solution and one that solves the resulting equality-constrained problem quickly. The first part only pays off if the decision stabilizes after finitely many iterations; otherwise the fast local method never gets to run.

Calamai and Moré (Math. Programming 39, 1987) proved that this stabilization is a property of the limit point, not of the algorithm. Any feasible sequence that converges and whose projected gradients tend to zero identifies the active constraints of a nondegenerate limit in finitely many steps. This is the result that later active-set and gradient-projection methods for bound-constrained and linearly constrained problems invoke to justify switching to a fast local phase.

Timeline.

  • 1976: Bertsekas proves finite identification of the active set for the gradient projection method with an Armijo step on bound constraints, at a local minimizer satisfying strict complementarity and second-order sufficiency.
  • 1984: Gafni and Bertsekas (SIAM J. Control Optim. 22) prove a similar result for two-metric projection methods, under an assumption that excludes the choice of the gradient as search direction.
  • 1987: Calamai and Moré remove the second-order condition, allow a general polyhedral feasible set and a general inner product, and make the result independent of the method generating the sequence (Theorem 4.1); they extend it to binding sets defined by multiplier estimates (Theorem 4.2).

Setting

Let EEE be a finite-dimensional real inner product space (the paper's Rn\mathbb{R}^nRn with a general inner product) and let f:E→Rf : E \to \mathbb{R}f:E→R be continuously differentiable on the feasible set, with gradient ∇f\nabla f∇f taken with respect to the inner product of EEE.

The feasible set is a polyhedral set

Ω={x∈E:⟨cj,x⟩≥δj, j=1,…,m}\Omega = \{x \in E : \langle c_j, x\rangle \ge \delta_j,\ j = 1, \dots, m\}Ω={x∈E:⟨cj​,x⟩≥δj​, j=1,…,m}

for constraint normals cj∈Ec_j \in Ecj​∈E and scalars δj\delta_jδj​. The active set at xxx is A(x)={j:⟨cj,x⟩=δj}A(x) = \{j : \langle c_j, x\rangle = \delta_j\}A(x)={j:⟨cj​,x⟩=δj​}.

A direction vvv is feasible at x∈Ωx \in \Omegax∈Ω if x+τv∈Ωx + \tau v \in \Omegax+τv∈Ω for all sufficiently small τ>0\tau > 0τ>0. The tangent cone T(x)T(x)T(x) is the closure of the set of feasible directions. The projected gradient is the point of T(x)T(x)T(x) closest to −∇f(x)-\nabla f(x)−∇f(x):

∇Ωf(x)=argmin⁡{∥v+∇f(x)∥:v∈T(x)}.\nabla_\Omega f(x) = \operatorname{argmin}\{\|v + \nabla f(x)\| : v \in T(x)\}.∇Ω​f(x)=argmin{∥v+∇f(x)∥:v∈T(x)}.

A point x∗∈Ωx^* \in \Omegax∗∈Ω is stationary if ⟨∇f(x∗),x−x∗⟩≥0\langle \nabla f(x^*), x - x^*\rangle \ge 0⟨∇f(x∗),x−x∗⟩≥0 for all x∈Ωx \in \Omegax∈Ω. It is a Kuhn–Tucker point if ∇f(x∗)=∑j∈A(x∗)λj∗cj\nabla f(x^*) = \sum_{j \in A(x^*)} \lambda^*_j c_j∇f(x∗)=∑j∈A(x∗)​λj∗​cj​ with λj∗≥0\lambda^*_j \ge 0λj∗​≥0. It is nondegenerate if the active normals {cj:j∈A(x∗)}\{c_j : j \in A(x^*)\}{cj​:j∈A(x∗)} are linearly independent and the multipliers satisfy λj∗>0\lambda^*_j > 0λj∗​>0 for every j∈A(x∗)j \in A(x^*)j∈A(x∗).

A Lagrange multiplier estimate is a map x↦λ(x)∈Rmx \mapsto \lambda(x) \in \mathbb{R}^mx↦λ(x)∈Rm. It defines the binding set B(x)={j∈A(x):λj(x)≥0}B(x) = \{j \in A(x) : \lambda_j(x) \ge 0\}B(x)={j∈A(x):λj​(x)≥0}. The estimate is consistent if λj(xk)→λj(x∗)\lambda_j(x_k) \to \lambda_j(x^*)λj​(xk​)→λj​(x∗) whenever xk→x∗x_k \to x^*xk​→x∗, the point x∗x^*x∗ is a nondegenerate Kuhn–Tucker point, and A(xk)=A(x∗)A(x_k) = A(x^*)A(xk​)=A(x∗) for every kkk.

Formalization targets

Goal: Theorem 4.1 (finite identification of the active set)

Let {xk}\{x_k\}{xk​} be an arbitrary sequence in Ω\OmegaΩ converging to x∗x^*x∗. If ∥∇Ωf(xk)∥→0\|\nabla_\Omega f(x_k)\| \to 0∥∇Ω​f(xk​)∥→0 and x∗x^*x∗ is nondegenerate, then

A(xk)=A(x∗)for all sufficiently large k.A(x_k) = A(x^*) \quad \text{for all sufficiently large } k.A(xk​)=A(x∗)for all sufficiently large k.

The sequence need not come from any particular algorithm. The goal asserts eventual equality of the index sets, not inclusion.

Milestones

  • Lemma 3.1. At x∈Ωx \in \Omegax∈Ω: −⟨∇f(x),∇Ωf(x)⟩=∥∇Ωf(x)∥2-\langle\nabla f(x), \nabla_\Omega f(x)\rangle = \|\nabla_\Omega f(x)\|^2−⟨∇f(x),∇Ω​f(x)⟩=∥∇Ω​f(x)∥2; min⁡{⟨∇f(x),v⟩:v∈T(x),∥v∥≤1}=−∥∇Ωf(x)∥\min\{\langle \nabla f(x), v\rangle : v \in T(x), \|v\| \le 1\} = -\|\nabla_\Omega f(x)\|min{⟨∇f(x),v⟩:v∈T(x),∥v∥≤1}=−∥∇Ω​f(x)∥; and xxx is stationary if and only if ∇Ωf(x)=0\nabla_\Omega f(x) = 0∇Ω​f(x)=0.
  • Lemma 3.3. The map x↦∥∇Ωf(x)∥x \mapsto \|\nabla_\Omega f(x)\|x↦∥∇Ω​f(x)∥ is lower semicontinuous on Ω\OmegaΩ.
  • Tangent cone of a polyhedron (p. 105). For x∈Ωx \in \Omegax∈Ω, T(x)={v:⟨cj,v⟩≥0, j∈A(x)}T(x) = \{v : \langle c_j, v\rangle \ge 0,\ j \in A(x)\}T(x)={v:⟨cj​,v⟩≥0, j∈A(x)}.
  • Eq. (4.3). For polyhedral Ω\OmegaΩ, a point x∗∈Ωx^* \in \Omegax∗∈Ω is stationary if and only if it is a Kuhn–Tucker point.
  • Theorem 4.2. Assume the binding sets come from a consistent estimate whose value at x∗x^*x∗ is the Kuhn–Tucker multiplier vector, and assume the hypotheses of Theorem 4.1. Then B(xk)=B(x∗)B(x_k) = B(x^*)B(xk​)=B(x∗) for all sufficiently large kkk.

Significance

The result. Theorem 4.1 separates identification from convergence. Any method that keeps its iterates feasible and drives the projected gradient to zero inherits finite identification, whatever its step-size rule or search direction. After identification the constrained problem is locally an unconstrained problem on the affine subspace {x:⟨cj,x⟩=δj, j∈A(x∗)}\{x : \langle c_j, x\rangle = \delta_j,\ j \in A(x^*)\}{x:⟨cj​,x⟩=δj​, j∈A(x∗)}, so Newton-type or conjugate-gradient methods can take over. Theorem 4.2 carries the same conclusion to methods that drop constraints according to the signs of multiplier estimates. The companion missions of this series use the result: the gradient projection method drives the projected gradients to zero (mission I), and a gradient projection algorithm for quadratic programs terminates finitely (mission III).

Formalizing it. The theorems are proved in the paper. No machine-checked version of the projected gradient, of tangent cones of polyhedra with their active-set description, or of finite active-set identification is known to exist. Formalization adds a reusable account of tangent cones and polar cones of polyhedral sets and of the equivalence between stationarity and the Kuhn–Tucker conditions for linear constraints, together with a method-independent identification theorem stated at the level of generality of the paper.

Difficulty

Two different limits are involved. Convergence xk→x∗x_k \to x^*xk​→x∗ is enough to show that no inactive constraint of x∗x^*x∗ is active at xkx_kxk​ for large kkk. The hard direction is the converse: a constraint active at x∗x^*x∗ might be inactive at infinitely many xkx_kxk​, approached from the interior. Convergence of the points alone cannot rule this out. The projected gradient is also not continuous, because the tangent cone changes when a new constraint becomes active. So the hypothesis ∥∇Ωf(xk)∥→0\|\nabla_\Omega f(x_k)\| \to 0∥∇Ω​f(xk​)∥→0 cannot be passed to the limit naively. Both nondegeneracy conditions matter: without linear independence, or with a zero multiplier, the statement fails.

Formalization scope

The space is a real inner product space E with [FiniteDimensional ℝ E], and ∇f\nabla f∇f is Mathlib's gradient. "Continuously differentiable on Ω\OmegaΩ" means DifferentiableAt ℝ f x for every x∈Ωx \in \Omegax∈Ω together with ContinuousOn (gradient f) Ω. The constraints are indexed by Fin m. Ω\OmegaΩ is polyhedron c δ, and A(x)A(x)A(x) is activeSet c δ x : Finset (Fin m).

The tangent cone is defined as the closure of the feasible directions, not by the polyhedral formula, which is a milestone. The projected gradient is the nearest point of T(x)T(x)T(x) to −∇f(x)-\nabla f(x)−∇f(x), chosen by a choice function that returns 000 only when no nearest point exists. That never happens at a point of a polyhedral set.

Nondegeneracy is bundled as IsNondegenerate c δ f x*: x∗∈Ωx^* \in \Omegax∗∈Ω, the family (cj)j∈A(x∗)(c_j)_{j \in A(x^*)}(cj​)j∈A(x∗)​ is linearly independent, and positive multipliers represent ∇f(x∗)\nabla f(x^*)∇f(x∗). "For all sufficiently large kkk" is ∀ᶠ k in Filter.atTop.

In Theorem 4.2 the paper leaves one condition implicit: the estimate at x∗x^*x∗ must be the Kuhn–Tucker multiplier vector, ∇f(x∗)=∑j∈A(x∗)λj(x∗)cj\nabla f(x^*) = \sum_{j \in A(x^*)} \lambda_j(x^*) c_j∇f(x∗)=∑j∈A(x∗)​λj​(x∗)cj​. Without it the statement is false, so it is an explicit hypothesis. Consistency is required only along feasible sequences and only in the coordinates j∈A(x∗)j \in A(x^*)j∈A(x∗).

A formalization that assumes A(xk)⊆A(x∗)A(x_k) \subseteq A(x^*)A(xk​)⊆A(x∗), assumes the active sets are eventually constant, weakens nondegeneracy to nonnegative multipliers, or concludes only inclusion is not the paper's theorem and does not satisfy this mission.

Needed infrastructure: tangent cones of convex sets, the Moreau decomposition into a closed convex cone and its polar, Farkas' lemma in a general inner product space, and orthogonal projections onto subspaces spanned by linearly independent vectors. The polyhedral tangent-cone and Kuhn–Tucker results are reusable beyond this mission. Proofs of any milestone are welcome, as are auxiliary lemmas on polyhedral cones.

Selected references

  • P. H. Calamai and J. J. Moré, Projected gradient methods for linearly constrained problems, Mathematical Programming 39 (1987) 93–116. https://doi.org/10.1007/BF02592073
  • D. P. Bertsekas, On the Goldstein–Levitin–Polyak gradient projection method, IEEE Transactions on Automatic Control 21 (1976) 174–184. https://doi.org/10.1109/TAC.1976.1101194
  • E. M. Gafni and D. P. Bertsekas, Two-metric projection methods for constrained optimization, SIAM Journal on Control and Optimization 22 (1984) 936–964. https://doi.org/10.1137/0322061
  • E. H. Zarantonello, Projections on convex sets in Hilbert space and spectral theory, in: Contributions to Nonlinear Functional Analysis, Academic Press, 1971, 237–424.
12 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations Research·Captain: mikedeng1

Nonmonotone Spectral Projected Gradient Methods on Convex Sets II: SPG1 Is Well Defined and Its Accumulation Points Are StationaryResearch Paper

Motivation

Minimizing a smooth function over a closed convex set Ω⊆Rn\Omega\subseteq\mathbb R^nΩ⊆Rn on which projection is cheap (a box, a ball, a simplex) is a routine subproblem in large-scale optimization. Box-constrained minimization is the inner solver of augmented Lagrangian methods, and bound-constrained least squares, image restoration and density estimation all have this form. The classical gradient projection method of Goldstein and of Levitin and Polyak needs only gradients and projections, but with constant or monotone Armijo step lengths it is slow.

Spectral projected gradient (SPG) methods, introduced by Birgin, Martínez and Raydan (paper), combine three ingredients. The first is the projection. The second is the Barzilai–Borwein (spectral) step length αk+1=⟨sk,sk⟩/⟨sk,yk⟩\alpha_{k+1}=\langle s_k,s_k\rangle/\langle s_k,y_k\rangleαk+1​=⟨sk​,sk​⟩/⟨sk​,yk​⟩, an inverse Rayleigh quotient of the average Hessian along the last step. The third is the nonmonotone line search of Grippo, Lampariello and Lucidi, which compares a trial value with the worst of the last MMM objective values instead of the current one. The paper defines two variants. This mission concerns SPG1, which backtracks along the projection arc λ↦P(xk−λg(xk))\lambda\mapsto P(x_k-\lambda g(x_k))λ↦P(xk​−λg(xk​)), as in Bertsekas's analysis of the Armijo rule for gradient projection. The companion mission concerns SPG2, which backtracks along a fixed feasible direction.

Timeline:

  • 1964–1966: Goldstein; Levitin and Polyak introduce gradient projection.
  • 1976: Bertsekas analyses the Armijo rule along the projection arc (IEEE TAC).
  • 1986: Grippo, Lampariello and Lucidi introduce the nonmonotone line search for unconstrained problems.
  • 1988: Barzilai and Borwein propose the two-point step size. Raydan (1997) combines it with nonmonotone search in the unconstrained case.
  • 2000: Birgin, Martínez and Raydan define SPG1 and SPG2 for convex constraints (SIAM J. Optim. 10(4)).
  • 2003: the same authors publish the convergence analysis that the proof of Theorem 2.2 adapts, in the inexact setting (IMA J. Numer. Anal. 23).

Setting

Let Ω⊆Rn\Omega\subseteq\mathbb R^nΩ⊆Rn be nonempty, closed and convex, with the Euclidean inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥\|\cdot\|∥⋅∥. Let fff have continuous partial derivatives on an open set U⊇ΩU\supseteq\OmegaU⊇Ω, and write g(x)=∇f(x)g(x)=\nabla f(x)g(x)=∇f(x). The orthogonal projection P(z)P(z)P(z) is the unique point of Ω\OmegaΩ nearest to zzz. The scaled projected gradient is gt(x)=P(x−t g(x))−xg_t(x)=P(x-t\,g(x))-xgt​(x)=P(x−tg(x))−x for x∈Ωx\in\Omegax∈Ω and t>0t>0t>0. A point xˉ\bar xxˉ is a constrained stationary point if ⟨g(xˉ),x−xˉ⟩≥0\langle g(\bar x),x-\bar x\rangle\ge0⟨g(xˉ),x−xˉ⟩≥0 for all x∈Ωx\in\Omegax∈Ω.

The parameters are an integer M≥1M\ge1M≥1, reals 0<αmin⁡<αmax⁡0<\alpha_{\min}<\alpha_{\max}0<αmin​<αmax​, a sufficient-decrease constant γ∈(0,1)\gamma\in(0,1)γ∈(0,1) and safeguards 0<σ1<σ2<10<\sigma_1<\sigma_2<10<σ1​<σ2​<1. Algorithm SPG1 (Algorithm 2.1) starts from x0∈Ωx_0\in\Omegax0​∈Ω and α0∈[αmin⁡,αmax⁡]\alpha_0\in[\alpha_{\min},\alpha_{\max}]α0​∈[αmin​,αmax​]. At iteration k=0,1,…k=0,1,\dotsk=0,1,… it does the following.

  1. Stop test. If ∥P(xk−g(xk))−xk∥=0\|P(x_k-g(x_k))-x_k\|=0∥P(xk​−g(xk​))−xk​∥=0, stop: xkx_kxk​ is stationary.
  2. Backtracking along the projection arc. Set λ=αk\lambda=\alpha_kλ=αk​. While the trial point x+=P(xk−λg(xk))x_+=P(x_k-\lambda g(x_k))x+​=P(xk​−λg(xk​)) fails
f(x+)≤max⁡0≤j≤min⁡{k,M−1}f(xk−j)+γ⟨x+−xk,g(xk)⟩,(1)f(x_+)\le\max_{0\le j\le\min\{k,M-1\}}f(x_{k-j})+\gamma\langle x_+-x_k,g(x_k)\rangle,\qquad(1)f(x+​)≤0≤j≤min{k,M−1}max​f(xk−j​)+γ⟨x+​−xk​,g(xk​)⟩,(1)

replace λ\lambdaλ by any λnew∈[σ1λ,σ2λ]\lambda_{\rm new}\in[\sigma_1\lambda,\sigma_2\lambda]λnew​∈[σ1​λ,σ2​λ]. When (1) holds, set λk=λ\lambda_k=\lambdaλk​=λ and xk+1=x+x_{k+1}=x_+xk+1​=x+​. 3. Spectral step. With sk=xk+1−xks_k=x_{k+1}-x_ksk​=xk+1​−xk​, yk=g(xk+1)−g(xk)y_k=g(x_{k+1})-g(x_k)yk​=g(xk+1​)−g(xk​) and bk=⟨sk,yk⟩b_k=\langle s_k,y_k\ranglebk​=⟨sk​,yk​⟩, set αk+1=αmax⁡\alpha_{k+1}=\alpha_{\max}αk+1​=αmax​ if bk≤0b_k\le0bk​≤0, and otherwise αk+1=min⁡{αmax⁡,max⁡{αmin⁡,⟨sk,sk⟩/bk}}\alpha_{k+1}=\min\{\alpha_{\max},\max\{\alpha_{\min},\langle s_k,s_k\rangle/b_k\}\}αk+1​=min{αmax​,max{αmin​,⟨sk​,sk​⟩/bk​}}.

The first trial of each backtracking is the spectral step αk\alpha_kαk​, not 111. The sufficient-decrease term in (1) is γ⟨x+−xk,g(xk)⟩=γ⟨g(xk),gλ(xk)⟩\gamma\langle x_+-x_k,g(x_k)\rangle=\gamma\langle g(x_k),g_\lambda(x_k)\rangleγ⟨x+​−xk​,g(xk​)⟩=γ⟨g(xk​),gλ​(xk​)⟩, with no factor λ\lambdaλ.

In Lean these objects are written as follows:

  • the projection is a function P with the predicate IsProjOnto Ω P;
  • gtg_tgt​ is scaledProjGrad P f t;
  • stationarity is IsConstrainedStationary Ω f;
  • the maximum in (1) is nonmonotoneRef f x M k;
  • test (1) is SPG1Test;
  • an infinite run is IsSPG1Run Ω f P M αmin αmax γ σ₁ σ₂ x α.

Formalization targets

Goal: Theorem 2.2, accumulation points are stationary

For every infinite run (xk,αk)(x_k,\alpha_k)(xk​,αk​) of SPG1 and every accumulation point xˉ\bar xxˉ of (xk)(x_k)(xk​),

⟨g(xˉ),x−xˉ⟩≥0for all x∈Ω.\langle g(\bar x),x-\bar x\rangle\ge0\qquad\text{for all }x\in\Omega.⟨g(xˉ),x−xˉ⟩≥0for all x∈Ω.

The statement fixes no parameter values, and it assumes neither convexity of fff nor a bounded level set.

Milestones

  • Lemma 2.1 (ii). For xˉ∈Ω\bar x\in\Omegaxˉ∈Ω and t∈(0,αmax⁡]t\in(0,\alpha_{\max}]t∈(0,αmax​], gt(xˉ)=0g_t(\bar x)=0gt​(xˉ)=0 if and only if xˉ\bar xxˉ is a constrained stationary point.
  • Lemma 2.1 (i). For x∈Ωx\in\Omegax∈Ω and t∈(0,αmax⁡]t\in(0,\alpha_{\max}]t∈(0,αmax​],
⟨g(x),gt(x)⟩≤−1t∥gt(x)∥22≤−1αmax⁡∥gt(x)∥22.\langle g(x),g_t(x)\rangle\le-\tfrac1t\|g_t(x)\|_2^2\le-\tfrac1{\alpha_{\max}}\|g_t(x)\|_2^2.⟨g(x),gt​(x)⟩≤−t1​∥gt​(x)∥22​≤−αmax​1​∥gt​(x)∥22​.
  • Lemma 2.2 (i). For x∈Ωx\in\Omegax∈Ω and z∈Rnz\in\mathbb R^nz∈Rn, the map s↦∥P(x+sz)−x∥/ss\mapsto\|P(x+sz)-x\|/ss↦∥P(x+sz)−x∥/s is nonincreasing on s>0s>0s>0.
  • Lemma 2.2 (ii). For every x∈Ωx\in\Omegax∈Ω there is sx>0s_x>0sx​>0 such that f(P(x−tg(x)))−f(x)≤γ⟨g(x),gt(x)⟩f(P(x-tg(x)))-f(x)\le\gamma\langle g(x),g_t(x)\ranglef(P(x−tg(x)))−f(x)≤γ⟨g(x),gt​(x)⟩ for all t∈[0,sx]t\in[0,s_x]t∈[0,sx​].
  • Theorem 2.2, first clause (SPG1 is well defined). At a point where Step 1 does not stop, every admissible backtracking sequence starting at α∈[αmin⁡,αmax⁡]\alpha\in[\alpha_{\min},\alpha_{\max}]α∈[αmin​,αmax​] reaches a trial point satisfying (1). The statement is for an arbitrary reference value R≥f(x)R\ge f(x)R≥f(x), which covers the maximum in (1).

Significance

Theorem 2.2 is the global convergence guarantee for SPG1. It holds without monotone decrease of fff and with no restriction on the spectral step beyond the safeguards. Lemma 2.2 carries Bertsekas's curvilinear Armijo analysis, stated for monotone gradient projection, over to the nonmonotone spectral setting. The projection-arc search is the natural one when Ω\OmegaΩ is a box or a polyhedron: there the arc is piecewise linear and each trial point is feasible by construction.

Status: the theorem is proved in the literature. This paper's proof reads "Use Lemma 2.2 with the proof technique of [7]", and Lemma 2.2 is quoted from Bertsekas's Nonlinear Programming (Lemma 2.3.1 and Theorem 2.3.3 (a)). No Lean formalization of this theorem, of the Armijo analysis along the projection arc, or of the monotonicity of ∥P(x+sz)−x∥/s\|P(x+sz)-x\|/s∥P(x+sz)−x∥/s is known. The mission produces a formal proof and a reusable Lean interface for projection-based first-order methods on convex sets.

Difficulty

For monotone descent methods, the usual argument shows that f(xk)f(x_k)f(xk​) decreases, so the total decrease is finite and the per-iteration decrease tends to zero. That argument fails here, because f(xk)f(x_k)f(xk​) need not decrease. Only the window maximum max⁡0≤j≤min⁡{k,M−1}f(xk−j)\max_{0\le j\le\min\{k,M-1\}}f(x_{k-j})max0≤j≤min{k,M−1}​f(xk−j​) is nonincreasing, and a small decrease of this maximum does not by itself give a small decrease at the iterates that approach a given accumulation point xˉ\bar xxˉ.

Along the projection arc there is a second obstacle. The decrease predicted by (1) is γ⟨g(xk),gλk(xk)⟩\gamma\langle g(x_k),g_{\lambda_k}(x_k)\rangleγ⟨g(xk​),gλk​​(xk​)⟩, and gλ(xk)g_\lambda(x_k)gλ​(xk​) depends nonlinearly on λ\lambdaλ: for λ<αk\lambda<\alpha_kλ<αk​ the trial point is not a rescaling of the first one. So small accepted steps do not translate into small multiples of a fixed direction, as they do for SPG2. The step lengths λk\lambda_kλk​ may also tend to zero, fff is C1C^1C1 only on a neighbourhood of Ω\OmegaΩ, and no Lipschitz constant for ggg is available.

Formalization scope

  • Space and data. The space is EuclideanSpace ℝ (Fin n) with inner ℝ and the 2-norm. fff is a total function EuclideanSpace ℝ (Fin n) → ℝ with ContDiffOn ℝ 1 f U on an open U ⊇ Ω, and ggg is Mathlib's gradient f. Every trial point is a projection, so the algorithm evaluates fff and ggg only at points of Ω\OmegaΩ.

  • Iteration and trials. Iterations are indexed from 000. The backtracking choice (2) is universally quantified. At each iteration, a run carries a finite trial list with λ(0)=αk\lambda^{(0)}=\alpha_kλ(0)=αk​ and λ(i+1)∈[σ1λ(i),σ2λ(i)]\lambda^{(i+1)}\in[\sigma_1\lambda^{(i)},\sigma_2\lambda^{(i)}]λ(i+1)∈[σ1​λ(i),σ2​λ(i)]; test (1) fails at every trial but the last and holds at the last.

  • Step size. αk+1\alpha_{k+1}αk+1​ is given by Step 3 exactly.

  • Accumulation point. An accumulation point is MapClusterPt x̄ atTop x.

  • Lemma 2.2 (i). The paper names the domain [0,∞)[0,\infty)[0,∞) but defines hhh only for s>0s>0s>0, so the milestone is stated on (0,∞)(0,\infty)(0,∞).

  • Excluded simplifications. None of the following is SPG1:

    • a run predicate that accepts any positive step;
    • a run predicate that starts backtracking at 111;
    • a run predicate that uses SPG2's test γλ⟨dk,g(xk)⟩\gamma\lambda\langle d_k,g(x_k)\rangleγλ⟨dk​,g(xk​)⟩;
    • a run predicate that lets αk+1\alpha_{k+1}αk+1​ range freely over [αmin⁡,αmax⁡][\alpha_{\min},\alpha_{\max}][αmin​,αmax​].

    Nor is a goal that states gt(xˉ)=0g_t(\bar x)=0gt​(xˉ)=0 instead of the variational inequality, or one that adds convexity of fff, a Lipschitz gradient or a bounded level set.

  • Non-vacuity. The hypotheses of the goal are satisfiable. Take f(x)=∥x∥2f(x)=\|x\|^2f(x)=∥x∥2, Ω=Rn\Omega=\mathbb R^nΩ=Rn, M=1M=1M=1, αmin⁡=1/8\alpha_{\min}=1/8αmin​=1/8, αmax⁡=1/4\alpha_{\max}=1/4αmax​=1/4, γ=1/2\gamma=1/2γ=1/2, σ1=1/10\sigma_1=1/10σ1​=1/10, σ2=9/10\sigma_2=9/10σ2​=9/10 and v≠0v\ne0v=0. Then the iterates xk=2−kvx_k=2^{-k}vxk​=2−kv with αk=1/4\alpha_k=1/4αk​=1/4 form an infinite run with accumulation point 000.

  • Infrastructure. A complete development needs:

    • the variational characterization of the projection (Mathlib has it in the iInf form, norm_eq_iInf_iff_real_inner_le_zero) and the nonexpansiveness of the projection;
    • a first-order expansion of a C1C^1C1 function along curves in Ω\OmegaΩ;
    • the bookkeeping of the nonmonotone reference value.

    The projection lemmas, including Lemma 2.2 (i), are reusable for any gradient projection method and are welcome as separate contributions.

Selected references

  • E. G. Birgin, J. M. Martínez, M. Raydan, Nonmonotone spectral projected gradient methods on convex sets, SIAM J. Optim. 10(4) (2000) 1196–1211; authors' updated version, July 2004. https://doi.org/10.1137/S1052623497330963, https://www.ime.unicamp.br/~martinez/bmr.pdf
  • E. G. Birgin, J. M. Martínez, M. Raydan, Inexact spectral projected gradient methods on convex sets, IMA J. Numer. Anal. 23 (2003) 539–559. https://doi.org/10.1093/imanum/23.4.539
  • D. P. Bertsekas, Nonlinear Programming, Athena Scientific, 1995, Section 2.3.
  • D. P. Bertsekas, On the Goldstein–Levitin–Polyak gradient projection method, IEEE Trans. Automat. Control 21 (1976) 174–184. https://doi.org/10.1109/TAC.1976.1101194
  • J. Barzilai, J. M. Borwein, Two-point step size gradient methods, IMA J. Numer. Anal. 8 (1988) 141–148. https://doi.org/10.1093/imanum/8.1.141
  • L. Grippo, F. Lampariello, S. Lucidi, A nonmonotone line search technique for Newton's method, SIAM J. Numer. Anal. 23 (1986) 707–716. https://doi.org/10.1137/0723046
  • M. Raydan, The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem, SIAM J. Optim. 7 (1997) 26–33. https://doi.org/10.1137/S1052623494266365
11 thms2 active usersReviewed
🏆Completed
Convex OptimizationLinear OptimizationOperations Research·Captain: mikedeng1

Generalization Bounds in the Predict-then-Optimize Framework IV: Distance to Degeneracy and the Strength Property for PolytopesResearch Paper

Motivation

Many decision problems in operations research are solved in two stages: a model predicts the unknown cost vector of a linear optimization problem from features, and the predicted costs are then passed to a solver. The smart predict-then-optimize (SPO) loss of Elmachtoub and Grigas measures the quality of a prediction by the excess true cost of the decision it induces, rather than by the prediction error itself. El Balghiti, Elmachtoub, Grigas and Tewari study how well the empirical SPO loss generalizes. Their margin-based bounds (Theorems 4 and 5 of the paper) require a geometric condition on the feasible region, the strength property, and a way to compute the distance to degeneracy that enters the margin loss.

Section 5 of the paper verifies this condition in the two cases that matter in practice. For strongly convex regions it is Theorem 7 (mission III of this series). This mission covers the other case, §5.2: feasible regions that are polytopes given by a list of points, which includes the unit simplex of multiclass classification and the feasible regions of shortest-path, assignment and other combinatorial problems written as convex hulls.

Setting

Let EEE be a finite-dimensional real vector space (the paper's Rd\mathbb R^dRd) with a norm ∥⋅∥\|\cdot\|∥⋅∥. A cost vector c^\hat cc^ is a linear functional on EEE; its value at www is written c^⊤w\hat c^\top wc^⊤w, and its dual norm is ∥c^∥∗=max⁡∥w∥≤1c^⊤w\|\hat c\|_*=\max_{\|w\|\le1}\hat c^\top w∥c^∥∗​=max∥w∥≤1​c^⊤w.

The feasible region is a polytope with a known convex hull representation: pairwise distinct points v1,…,vK∈Ev_1,\dots,v_K\in Ev1​,…,vK​∈E and

S=conv{v1,…,vK}.S=\mathrm{conv}\{v_1,\dots,v_K\}.S=conv{v1​,…,vK​}.

Redundant points (points that are convex combinations of the others) are allowed. For a cost vector c^\hat cc^, P(c^)P(\hat c)P(c^) is the problem min⁡w∈Sc^⊤w\min_{w\in S}\hat c^\top wminw∈S​c^⊤w, and an optimization oracle w∗w^*w∗ is any map with w∗(c^)∈arg⁡min⁡w∈Sc^⊤ww^*(\hat c)\in\arg\min_{w\in S}\hat c^\top ww∗(c^)∈argminw∈S​c^⊤w for every c^\hat cc^.

  • The degenerate set C∘\mathcal C^\circC∘ is the set of cost vectors c^\hat cc^ for which P(c^)P(\hat c)P(c^) has more than one optimal solution.
  • The distance to degeneracy is νS(c^)=inf⁡c∈C∘∥c−c^∥∗\nu_S(\hat c)=\inf_{c\in\mathcal C^\circ}\|c-\hat c\|_*νS​(c^)=infc∈C∘​∥c−c^∥∗​.
  • SSS has the strength property with parameter μ>0\mu>0μ>0 if
c^⊤(w−w∗(c^)) ≥ μ νS(c^)2 ∥w−w∗(c^)∥2for all w∈S and all c^.\hat c^\top\big(w-w^*(\hat c)\big)\ \ge\ \frac{\mu\,\nu_S(\hat c)}{2}\,\|w-w^*(\hat c)\|^2\qquad\text{for all } w\in S\text{ and all }\hat c.c^⊤(w−w∗(c^)) ≥ 2μνS​(c^)​∥w−w∗(c^)∥2for all w∈S and all c^.
  • The negative normal cone at vjv_jvj​ is Kj=−NS(vj)={c^:c^⊤(w−vj)≥0 for all w∈S}\mathcal K_j=-N_S(v_j)=\{\hat c:\hat c^\top(w-v_j)\ge0\ \text{for all } w\in S\}Kj​=−NS​(vj​)={c^:c^⊤(w−vj​)≥0 for all w∈S}, the cost vectors for which vjv_jvj​ is optimal.
  • The diameter is Δ(S)=sup⁡w1,w2∈S∥w1−w2∥\Delta(S)=\sup_{w_1,w_2\in S}\|w_1-w_2\|Δ(S)=supw1​,w2​∈S​∥w1​−w2​∥.

Formalization targets

Goal: Theorem 8, strength claim (p. 25)

If S=conv{v1,…,vK}S=\mathrm{conv}\{v_1,\dots,v_K\}S=conv{v1​,…,vK​} is not a singleton, then for every oracle w∗w^*w∗, SSS has the strength property with parameter

μ=2Δ(S)>0.\mu=\frac{2}{\Delta(S)}>0 .μ=Δ(S)2​>0.

Milestones, in attack order

  1. Eq. (9) (p. 24): each cone is described by finitely many inequalities,
Kj={c^:c^⊤(vi−vj)≥0 for all i=1,…,K}.\mathcal K_j=\{\hat c:\hat c^\top(v_i-v_j)\ge0\ \text{for all } i=1,\dots,K\}.Kj​={c^:c^⊤(vi​−vj​)≥0 for all i=1,…,K}.
  1. Proposition 2 (p. 25): P(c^)P(\hat c)P(c^) has a unique optimal solution if and only if c^∈int(Kj)\hat c\in\mathrm{int}(\mathcal K_j)c^∈int(Kj​) for some jjj; hence
C∘=Rd∖⋃j=1Kint(Kj).\mathcal C^\circ=\mathbb R^d\setminus\bigcup_{j=1}^K\mathrm{int}(\mathcal K_j).C∘=Rd∖j=1⋃K​int(Kj​).
  1. Diameter (p. 25, the sentence before Theorem 8): Δ(S)=max⁡i,j∥vi−vj∥\Delta(S)=\max_{i,j}\|v_i-v_j\|Δ(S)=maxi,j​∥vi​−vj​∥.
  2. Theorem 8, eq. (10) (p. 25): for every oracle and every c^\hat cc^,
νS(c^)=min⁡j: vj≠w∗(c^)c^⊤(vj−w∗(c^))∥vj−w∗(c^)∥.\nu_S(\hat c)=\min_{j:\,v_j\ne w^*(\hat c)}\frac{\hat c^\top(v_j-w^*(\hat c))}{\|v_j-w^*(\hat c)\|}.νS​(c^)=j:vj​=w∗(c^)min​∥vj​−w∗(c^)∥c^⊤(vj​−w∗(c^))​.

Significance

The result. Formula (10) turns the distance to degeneracy, defined as an infimum over an infinite non-convex set, into a minimum of KKK explicit ratios that needs one oracle call. This makes the margin SPO loss of the paper computable for polytopes. The strength claim, combined with the paper's Theorems 4 and 5, yields margin-based generalization bounds for the SPO loss over any polytope with a known vertex list, with a dependence on the hypothesis class through its multivariate Rademacher complexity rather than through a Natarajan dimension. For the unit simplex it recovers known margin bounds for multiclass classification (Example 8).

Formalizing it. The results are proved in the paper; to our knowledge none of them is machine-checked. A formalization produces, beyond the four statements, a Lean account of the normal fan of a polytope presented by a point list, its interplay with uniqueness of linear-optimization solutions, and distances to its boundary measured in a dual norm. These are standard facts of polyhedral theory that Mathlib does not yet state in this form.

Difficulty

The obstacle is that νS\nu_SνS​ is a distance to the degenerate set, and that set is neither convex nor given by inequalities: it is a union of lower-dimensional pieces of the normal fan, so no projection formula applies, and its description depends on which points of the representation are redundant. Relating a dual-norm ball around c^\hat cc^ to the finitely many inequalities of eq. (9) is where the argument needs care. A Euclidean shortcut is not available: the norm is arbitrary, and the numerator of (10) and the distance νS\nu_SνS​ are measured in different norms. A second trap is the oracle: at a degenerate c^\hat cc^ it may return a point that is not among the vjv_jvj​, and (10) must still hold.

Formalization scope

  • EEE is a finite-dimensional real normed space; cost vectors are elements of StrongDual ℝ E, whose operator norm is the dual norm. Interiors and distances in the cost space use that norm.
  • The polytope is v : Fin K → E, injective, with SSS = convexHull ℝ (Set.range v). Nonemptiness, compactness and convexity of SSS (the paper's §2 standing assumptions) follow from this representation; Proposition 2 and the diameter identity add K≥1K\ge1K≥1, which is that nonemptiness.
  • "Not a singleton" is S.Nontrivial. Without it C∘=∅\mathcal C^\circ=\emptysetC∘=∅, νS≡0\nu_S\equiv0νS​≡0 and the strength property holds for free; with it, 0∈C∘0\in\mathcal C^\circ0∈C∘ and νS\nu_SνS​ is a genuine distance. The goal's parameter 2/Δ(S)2/\Delta(S)2/Δ(S) is stated to be positive, so the Lean conventions diam=0\mathrm{diam}=0diam=0 on unbounded or one-point sets and 2/0=02/0=02/0=0 cannot trivialize it.
  • The oracle is arbitrary: every theorem quantifies over all maps www with w(c^)∈arg⁡min⁡Sc^w(\hat c)\in\arg\min_S\hat cw(c^)∈argminS​c^, never a fixed selection.
  • νS\nu_SνS​ is Metric.infDist to C∘\mathcal C^\circC∘; Δ(S)\Delta(S)Δ(S) is Metric.diam, correct here because SSS is bounded. Minima and maxima over finite index sets are stated with IsLeast/IsGreatest, so no junk value of min' or sInf enters.
  • Reusable infrastructure: the negative normal cones and normal fan of a point-list polytope, the characterization of unique optima of linear optimization over a polytope, and the dual-norm distance to the boundary of a polyhedral cone. Contributions of any of these as standalone lemmas are welcome.

Selected references

  • O. El Balghiti, A. N. Elmachtoub, P. Grigas, A. Tewari, Generalization Bounds in the Predict-then-Optimize Framework, arXiv:1905.11488v3, 2022 (Mathematics of Operations Research, 2023). https://arxiv.org/abs/1905.11488
  • A. N. Elmachtoub, P. Grigas, Smart "Predict, then Optimize", Management Science 68(1), 2022. https://doi.org/10.1287/mnsc.2020.3922
  • G. M. Ziegler, Lectures on Polytopes, Graduate Texts in Mathematics 152, Springer, 1995. https://doi.org/10.1007/978-1-4613-8431-1
  • R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 2009. https://doi.org/10.1007/978-3-642-02431-3
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Local Search Heuristics for k-Median and Facility Location Problems II: p-Swap Local Search for k-Median Has Locality Gap 3 + 2/pResearch Paper

Motivation

The k-median problem asks to open kkk facilities among a set of candidate sites so that the total distance from clients to their nearest open facility is as small as possible. It is a basic model of facility location and of clustering, and it is NP-hard, so the question studied in approximation algorithms is how close a polynomial-time method can get to the optimum.

Local search is the method most used in practice: start from any kkk facilities and repeatedly replace a few of them by others whenever this lowers the cost. Arya, Garg, Khandekar, Meyerson, Munagala and Pandit (SIAM J. Comput. 33(3), 2004) gave the first analysis of a local search for k-median with a bounded performance guarantee using only kkk medians. For single swaps they proved a locality gap of 555 (Theorem 3.2, the subject of the first mission of this series); allowing up to ppp facilities to be exchanged at once improves the gap to 3+2/p3 + 2/p3+2/p, which the paper notes improves on the 444-approximation of Charikar and Guha. That ppp-swap bound is the result this mission formalizes.

Timeline (as recounted in §1 of the paper):

  • Shmoys, Tardos and Aardal, and Charikar, Guha, Tardos and Shmoys: LP rounding gives a 6236\tfrac23632​-approximation for k-median.
  • Jain and Vazirani: primal–dual schema and Lagrangian relaxation give a 666-approximation; Charikar and Guha improve it to 444.
  • Korupolu, Plaxton and Rajaraman: local search with add, delete and swap moves gives a solution with k(1+ϵ)k(1+\epsilon)k(1+ϵ) facilities and service cost at most 3+5/ϵ3 + 5/\epsilon3+5/ϵ times the optimum.
  • Arya et al.: locality gap 555 for single swaps and 3+2/p3 + 2/p3+2/p for ppp-swaps with exactly kkk facilities, with a tight example.
  • Later work (Li and Svensson, 2013/2016) goes below 333 with methods other than local search.

Setting

A metric instance consists of a finite set CCC of clients, a finite set FFF of facilities and a distance ddd on C∪FC \cup FC∪F that is nonnegative, symmetric and satisfies the triangle inequality; cji=d(j,i)c_{ji} = d(j,i)cji​=d(j,i) is the cost of serving client jjj by facility iii.

For a nonempty set S⊆FS \subseteq FS⊆F of open facilities, each client is served by its nearest open facility, and

cost(S)=∑j∈Cmin⁡i∈Scji.\mathrm{cost}(S) = \sum_{j \in C} \min_{i \in S} c_{ji}.cost(S)=j∈C∑​i∈Smin​cji​.

Fix an integer p≥1p \ge 1p≥1. A ppp-swap ⟨A,B⟩\langle A, B\rangle⟨A,B⟩ deletes a set A⊆SA \subseteq SA⊆S of at most ppp facilities and adds a set B⊆FB \subseteq FB⊆F of the same size. The ppp-swap neighbourhood of SSS is

B(S)={(S∖A)∪B∣A⊆S, B⊆F, ∣A∣=∣B∣≤p},\mathcal B(S) = \{(S \setminus A) \cup B \mid A \subseteq S,\ B \subseteq F,\ |A| = |B| \le p\},B(S)={(S∖A)∪B∣A⊆S, B⊆F, ∣A∣=∣B∣≤p},

and SSS is locally optimum when cost(S)≤cost(S′)\mathrm{cost}(S) \le \mathrm{cost}(S')cost(S)≤cost(S′) for every S′∈B(S)S' \in \mathcal B(S)S′∈B(S). The locality gap is the supremum, over instances, of the ratio between the cost of a locally optimum solution and the cost of a global optimum.

In Lean the instance is MetricInstance Cl Fa with the distance on Cl ⊕ Fa, the cost is kmCost I S hS (defined only for nonempty S), and local optimality is IsPSwapLocalOpt I p S hS, all in the namespace LocalSearchFL.MultiSwap.

Formalization targets

Goal: locality gap at most 3+2/p3 + 2/p3+2/p

For every metric instance, every integer p≥1p \ge 1p≥1, every k≥1k \ge 1k≥1, every locally optimum SSS with ∣S∣=k|S| = k∣S∣=k, and every nonempty O⊆FO \subseteq FO⊆F with ∣O∣≤k|O| \le k∣O∣≤k,

cost(S)≤(3+2p)cost(O).\mathrm{cost}(S) \le \left(3 + \frac{2}{p}\right)\mathrm{cost}(O).cost(S)≤(3+p2​)cost(O).

This is the bound concluded at the end of §3.4 (p. 553, announced p. 551). The comparison solution OOO is arbitrary, not only an optimum, which is the strongest form printed.

Milestones

  1. §3.4, p. 551: for sets X,Y⊆SX, Y \subseteq SX,Y⊆S, disjoint sets have disjoint captures, and X⊆YX \subseteq YX⊆Y implies capture(X)⊆capture(Y)\mathrm{capture}(X) \subseteq \mathrm{capture}(Y)capture(X)⊆capture(Y), where capture(A)={o∈O∣∣NS(A)∩NO(o)∣>∣NO(o)∣/2}\mathrm{capture}(A) = \{o \in O \mid |N_S(A) \cap N_O(o)| > |N_O(o)|/2\}capture(A)={o∈O∣∣NS​(A)∩NO​(o)∣>∣NO​(o)∣/2}.
  2. Claim 3.1, p. 552: when ∣S∣=∣O∣|S| = |O|∣S∣=∣O∣, there are partitions A1,…,ArA_1,\dots,A_rA1​,…,Ar​ of SSS and B1,…,BrB_1,\dots,B_rB1​,…,Br​ of OOO with ∣Ai∣=∣Bi∣|A_i| = |B_i|∣Ai​∣=∣Bi​∣, Bi=capture(Ai)B_i = \mathrm{capture}(A_i)Bi​=capture(Ai​) and exactly one bad facility in AiA_iAi​ for i<ri < ri<r, and only good facilities in ArA_rAr​.
  3. §3.4, pp. 552–553: a family of swaps of size at most ppp with positive weights, such that each o∈Oo \in Oo∈O is swapped in with total weight exactly 111, each s∈Ss \in Ss∈S is swapped out with total weight at most (p+1)/p(p+1)/p(p+1)/p, and capture(A)⊆B\mathrm{capture}(A) \subseteq Bcapture(A)⊆B for every swap ⟨A,B⟩\langle A, B\rangle⟨A,B⟩.
  4. Property 3.2, p. 553: a bijection π\piπ of NO(o)N_O(o)NO​(o) with π(P)∩P=∅\pi(P) \cap P = \emptysetπ(P)∩P=∅ for every class PPP of a partition of NO(o)N_O(o)NO​(o) with ∣P∣≤12∣NO(o)∣|P| \le \tfrac12|N_O(o)|∣P∣≤21​∣NO​(o)∣.

Significance

The bound shows that the simplest optimization heuristic, stopped at any local optimum, is within a constant factor of optimal for metric k-median, and that the factor tends to 333 as the neighbourhood grows; the paper's tight example (§3.5, given for p=2p = 2p=2 and stated to generalize to every ppp) shows that the analysis cannot be improved for this neighbourhood. Combined with the standard ε\varepsilonε-improvement rule (p. 548), it yields a polynomial-time (3+2/p+ε)(3 + 2/p + \varepsilon)(3+2/p+ε)-approximation. The analysis template (charging each client's reassignment through a bijection of NO(o)N_O(o)NO​(o), and averaging the local-optimality inequalities of carefully chosen swaps) was reused for facility location, capacitated variants and k-means.

The result has been proved since 2001. What this mission adds is a machine-checked proof: no formalization of the k-median problem or of any locality-gap bound is known to exist in Mathlib or on this platform. The combinatorial milestones (capture, the partition of Claim 3.1, the weighted swaps, the bijection of Property 3.2) are independent of the metric and are reusable in any local-search analysis of clustering objectives.

Difficulty

For single swaps each facility of OOO is paired with one facility of SSS and a direct counting argument suffices. With ppp-swaps, a facility of SSS may capture several facilities of OOO at once, and a group of facilities of SSS may jointly capture a facility of OOO that none of them captures alone. Pairing facilities one by one then fails: the clients of a captured facility cannot be reassigned cheaply unless the capturing set is swapped out together with everything it captures. Swapping whole groups is only allowed when a group has at most ppp members; larger groups must be split into single swaps, and the weights must be chosen so that every facility of OOO is counted exactly once while no facility of SSS is counted more than (p+1)/p(p+1)/p(p+1)/p times. Getting the constant 3+2/p3 + 2/p3+2/p (rather than a weaker one) depends on this exact accounting.

Formalization scope

  • Clients and facilities are types Cl, Fa with Fintype and DecidableEq; solutions are Finset Fa. The distance is real-valued on Cl ⊕ Fa; d x x = 0 is not assumed (the paper neither states nor uses it).
  • The cost is the nearest-facility cost of a nonempty set; the empty set has no cost, so no junk value enters. The bound is stated multiplied out, kmCost I S hS ≤ (3 + 2 / (p : ℝ)) * kmCost I O hO, with the constant computed in R\mathbb RR.
  • ∣S∣=k|S| = k∣S∣=k is required; OOO ranges over all nonempty sets with ∣O∣≤k|O| \le k∣O∣≤k. §3.3 introduces multiswaps with p>1p > 1p>1; the statement takes p≥1p \ge 1p≥1, where p=1p = 1p=1 is Theorem 3.2 (bound 555).
  • Local optimality is over the whole neighbourhood (3), including sets BBB that meet SSS, not only over the swaps used in the analysis. Restricting it to those swaps would state a theorem with a stronger hypothesis.
  • The milestones state Claim 3.1, the swap construction and Property 3.2 in existence form; the procedure of Figure 8 is not formalized. Capture, good and bad are computed against the original SSS and OOO. The client assignments in the milestones are arbitrary functions; nearest-facility assignments are a special case. Milestone 3 also records that the deleted sets of two swaps are equal or disjoint, which is immediate from the construction and is what makes Property 3.2 applicable.
  • The per-swap reassignment inequality is not a milestone: the paper describes it only as "similar to the one presented for the single-swap heuristic" and prints no inequality.
  • Out of scope: the tight example (§3.5), the polynomial-time wrapper, and arbitrary client demands.

Needed infrastructure: finite sums over clients, Finset.inf', permutations (Equiv.Perm), and a weighted double-counting argument over the swaps. Proofs of the combinatorial milestones and alternative routes to the goal are welcome.

Selected references

  • V. Arya, N. Garg, R. Khandekar, A. Meyerson, K. Munagala, V. Pandit, Local Search Heuristics for k-Median and Facility Location Problems, SIAM J. Comput. 33(3):544–562, 2004. https://doi.org/10.1137/S0097539702416402
  • M. Charikar, S. Guha, É. Tardos, D. Shmoys, A Constant-Factor Approximation Algorithm for the k-Median Problem, J. Comput. System Sci. 65(1):129–149, 2002. https://doi.org/10.1006/jcss.2002.1882
  • K. Jain, V. Vazirani, Approximation Algorithms for Metric Facility Location and k-Median Problems Using the Primal-Dual Schema and Lagrangian Relaxation, J. ACM 48(2):274–296, 2001. https://doi.org/10.1145/375827.375845
  • M. Korupolu, C. Plaxton, R. Rajaraman, Analysis of a Local Search Heuristic for Facility Location Problems, J. Algorithms 37(1):146–188, 2000. https://doi.org/10.1006/jagm.2000.1100
  • S. Li, O. Svensson, Approximating k-Median via Pseudo-Approximation, SIAM J. Comput. 45(2):530–547, 2016. https://doi.org/10.1137/130938645
8 thms2 active usersReviewed
🏆Completed
Numerical AnalysisOperations Research·Captain: mikedeng1

A Nonmonotone Line Search Technique and Its Application to Unconstrained Optimization I: Global Convergence to Stationary PointsResearch Paper

Motivation

Line searches are the step-size rules inside most methods for smooth unconstrained minimization min⁡x∈Rnf(x)\min_{x \in \mathbb{R}^n} f(x)minx∈Rn​f(x): steepest descent, conjugate gradient, quasi-Newton and limited-memory methods all choose a direction dkd_kdk​ and then a step αk\alpha_kαk​ along it. Classical Armijo and Wolfe rules are monotone: they require f(xk+1)<f(xk)f(x_{k+1}) < f(x_k)f(xk+1​)<f(xk​). Grippo, Lampariello and Lucidi (SIAM J. Numer. Anal., 1986) observed that insisting on monotone decrease can slow a method down, and proposed comparing f(xk+1)f(x_{k+1})f(xk+1​) with the maximum of the last MMM function values instead. That max-based rule discards good function values and depends strongly on MMM, and Dai showed that R-linearly convergent iterates can violate it for every fixed memory MMM.

Zhang and Hager (SIAM J. Optim., 2004) replaced the maximum by a weighted average of all previous function values. Their averaged nonmonotone line search is used in practical codes, for example with L-BFGS and in later nonmonotone spectral and conjugate-gradient methods. This mission formalizes the paper's first main result: global convergence to stationary points for nonconvex fff.

Setting

Let f:Rn→Rf : \mathbb{R}^n \to \mathbb{R}f:Rn→R be continuously differentiable, with gradient gk=∇f(xk)g_k = \nabla f(x_k)gk​=∇f(xk​) at the kkk-th iterate. The Nonmonotone Line Search Algorithm (NLSA) has parameters

0≤ηmin⁡≤ηmax⁡≤1,0<δ<σ<1<ρ,μ>0.0 \le \eta_{\min} \le \eta_{\max} \le 1, \qquad 0 < \delta < \sigma < 1 < \rho, \qquad \mu > 0.0≤ηmin​≤ηmax​≤1,0<δ<σ<1<ρ,μ>0.

It maintains weights QkQ_kQk​ and reference values CkC_kCk​:

Q0=1, C0=f(x0),Qk+1=ηkQk+1,Ck+1=ηkQkCk+f(xk+1)Qk+1,(1.6)Q_0 = 1,\ C_0 = f(x_0), \qquad Q_{k+1} = \eta_k Q_k + 1, \qquad C_{k+1} = \frac{\eta_k Q_k C_k + f(x_{k+1})}{Q_{k+1}}, \qquad (1.6)Q0​=1, C0​=f(x0​),Qk+1​=ηk​Qk​+1,Ck+1​=Qk+1​ηk​Qk​Ck​+f(xk+1​)​,(1.6)

with ηk∈[ηmin⁡,ηmax⁡]\eta_k \in [\eta_{\min}, \eta_{\max}]ηk​∈[ηmin​,ηmax​] chosen at each step. The iterates are xk+1=xk+αkdkx_{k+1} = x_k + \alpha_k d_kxk+1​=xk​+αk​dk​, where the step αk>0\alpha_k > 0αk​>0 satisfies one of two rules, fixed for the whole run:

  • the nonmonotone Wolfe conditions
f(xk+αkdk)≤Ck+δαkgkTdk(1.4),∇f(xk+αkdk)dk≥σgkTdk(1.5);f(x_k + \alpha_k d_k) \le C_k + \delta \alpha_k g_k^{\mathsf T} d_k \quad (1.4), \qquad \nabla f(x_k + \alpha_k d_k) d_k \ge \sigma g_k^{\mathsf T} d_k \quad (1.5);f(xk​+αk​dk​)≤Ck​+δαk​gkT​dk​(1.4),∇f(xk​+αk​dk​)dk​≥σgkT​dk​(1.5);
  • the nonmonotone Armijo conditions: αk=αˉkρhk\alpha_k = \bar\alpha_k \rho^{h_k}αk​=αˉk​ρhk​, where αˉk>0\bar\alpha_k > 0αˉk​>0 is a trial step and hkh_khk​ is the largest integer such that (1.4) holds and αk≤μ\alpha_k \le \muαk​≤μ.

The choice ηk=0\eta_k = 0ηk​=0 gives Ck=f(xk)C_k = f(x_k)Ck​=f(xk​), the monotone line search; ηk=1\eta_k = 1ηk​=1 gives Ck=Ak=1k+1∑i≤kf(xi)C_k = A_k = \frac{1}{k+1}\sum_{i \le k} f(x_i)Ck​=Ak​=k+11​∑i≤k​f(xi​).

The direction assumption asks for constants c1,c2>0c_1, c_2 > 0c1​,c2​>0 with gkTdk≤−c1∥gk∥2g_k^{\mathsf T} d_k \le -c_1\|g_k\|^2gkT​dk​≤−c1​∥gk​∥2 (2.4) and ∥dk∥≤c2∥gk∥\|d_k\| \le c_2\|g_k\|∥dk​∥≤c2​∥gk​∥ (2.5) for all sufficiently large kkk. The level set is L={x:f(x)≤f(x0)}\mathcal L = \{x : f(x) \le f(x_0)\}L={x:f(x)≤f(x0​)}, and Lˉ\bar{\mathcal L}Lˉ is the set of points whose distance to L\mathcal LL is at most μdmax⁡\mu d_{\max}μdmax​, where dmax⁡=sup⁡k∥dk∥d_{\max} = \sup_k \|d_k\|dmax​=supk​∥dk​∥.

Formalization targets

Goal: Theorem 2.2

Suppose fff is bounded from below, gkTdk≤0g_k^{\mathsf T} d_k \le 0gkT​dk​≤0 for every kkk, the direction assumption holds, and ∇f\nabla f∇f is Lipschitz continuous on L\mathcal LL (Wolfe rule) or on Lˉ\bar{\mathcal L}Lˉ (Armijo rule). Then

lim inf⁡k→∞∥∇f(xk)∥=0,(2.6)\liminf_{k \to \infty} \|\nabla f(x_k)\| = 0, \qquad (2.6)k→∞liminf​∥∇f(xk​)∥=0,(2.6)

and if ηmax⁡<1\eta_{\max} < 1ηmax​<1,

lim⁡k→∞∇f(xk)=0,(2.7)\lim_{k \to \infty} \nabla f(x_k) = 0, \qquad (2.7)k→∞lim​∇f(xk​)=0,(2.7)

so every limit of a convergent subsequence of iterates is a stationary point. No convexity is assumed.

Milestones

  • Lemma 1.1: fk≤Ck≤Akf_k \le C_k \le A_kfk​≤Ck​≤Ak​ along the run, and a Wolfe step and a largest Armijo exponent exist whenever gkTdk<0g_k^{\mathsf T} d_k < 0gkT​dk​<0 and fff is bounded below.
  • Eq. (1.8): Qj+1=1+∑i=0j∏m=0iηj−m≤j+2Q_{j+1} = 1 + \sum_{i=0}^{j} \prod_{m=0}^{i} \eta_{j-m} \le j+2Qj+1​=1+∑i=0j​∏m=0i​ηj−m​≤j+2.
  • Lemma 2.1: the lower bounds (2.1) and (2.2) on accepted Wolfe and Armijo steps.
  • Eqs. (2.8)–(2.9): fk+1≤Ck−β∥gk∥2f_{k+1} \le C_k - \beta\|g_k\|^2fk+1​≤Ck​−β∥gk​∥2 with the explicit constant
β=min⁡{δμc1ρ,2δ(1−δ)c12Lρc22,δ(1−σ)c12Lc22}.\beta = \min\left\{\frac{\delta\mu c_1}{\rho}, \frac{2\delta(1-\delta)c_1^2}{L\rho c_2^2}, \frac{\delta(1-\sigma)c_1^2}{Lc_2^2}\right\}.β=min{ρδμc1​​,Lρc22​2δ(1−δ)c12​​,Lc22​δ(1−σ)c12​​}.
  • Eq. (2.14): ∑k∥gk∥2/Qk+1<∞\sum_k \|g_k\|^2 / Q_{k+1} < \infty∑k​∥gk​∥2/Qk+1​<∞.
  • Eq. (2.15): Qk+1≤1/(1−ηmax⁡)Q_{k+1} \le 1/(1-\eta_{\max})Qk+1​≤1/(1−ηmax​) when ηmax⁡<1\eta_{\max} < 1ηmax​<1.
  • Corollary 2.3: the analogue of Theorem 2.2 when (2.5) is replaced by the growth condition ∥dk∥2≤τ1+τ2k\|d_k\|^2 \le \tau_1 + \tau_2 k∥dk​∥2≤τ1​+τ2​k (2.16).

Significance

Theorem 2.2 is the convergence guarantee that makes the averaged reference value CkC_kCk​ usable in practice: any direction method whose directions are uniformly gradient-related (for example L-BFGS with bounded Hessian approximations) inherits stationarity of its limit points when combined with this line search, for every choice of the weights ηk\eta_kηk​. The monotone Wolfe and Armijo results are the special case ηk≡0\eta_k \equiv 0ηk​≡0. The same estimates, (2.8) and (2.15), are the input to the paper's second main result, R-linear convergence for strongly convex fff (Theorem 3.1, a separate mission in this series).

The result is proved in the paper. It has no machine-checked proof that this mission is aware of: the platform has monotone backtracking statements for convex problems, but no nonmonotone line search, no Wolfe conditions and no Zoutendijk-type global convergence theorem for nonconvex fff. A complete development also provides reusable Lean statements of the Wolfe and Armijo conditions and of step-size lower bounds under local Lipschitz continuity of the gradient.

Difficulty

Each step is elementary, but the argument has several places where a naive formalization fails. The Lipschitz hypothesis is only local: on L\mathcal LL for the Wolfe rule, on the μdmax⁡\mu d_{\max}μdmax​-neighbourhood Lˉ\bar{\mathcal L}Lˉ for the Armijo rule. So the proof must first show that every iterate stays in L\mathcal LL even though f(xk)f(x_k)f(xk​) is not monotone. This needs fk≤Ckf_k \le C_kfk​≤Ck​ and the monotonicity of CkC_kCk​, and then that the Armijo rule's rejected trial point xk+ραkdkx_k + \rho\alpha_k d_kxk​+ραk​dk​ lies in Lˉ\bar{\mathcal L}Lˉ. The Armijo lower bound uses the maximality of the integer exponent hkh_khk​ and a first-order Taylor bound along a segment. The passage from (2.14) to (2.6) and (2.7) uses the two growth bounds on Qk+1Q_{k+1}Qk+1​. The first gives only lim inf⁡\liminfliminf, since ∑∥gk∥2/(k+2)<∞\sum \|g_k\|^2/(k+2) < \infty∑∥gk​∥2/(k+2)<∞ does not force gk→0g_k \to 0gk​→0.

Formalization scope

The space is EuclideanSpace ℝ (Fin n) with the Euclidean norm, fff is ContDiff ℝ 1, and the paper's row vector ∇f(x)\nabla f(x)∇f(x) acting on ddd is the inner product of Mathlib's gradient f x with ddd. QkQ_kQk​, CkC_kCk​ and AkA_kAk​ are defined by recursion from the run. A run is an infinite sequence (xk,dk,αk,ηk)(x_k, d_k, \alpha_k, \eta_k)(xk​,dk​,αk​,ηk​) satisfying the update, ηk∈[ηmin⁡,ηmax⁡]\eta_k \in [\eta_{\min}, \eta_{\max}]ηk​∈[ηmin​,ηmax​], and the chosen rule at every kkk. The stopping test is not modelled. The Armijo exponent ranges over Z\mathbb{Z}Z (it may be negative since ρ>1\rho > 1ρ>1), and "largest" is IsGreatest. dmax⁡d_{\max}dmax​ and the distance to L\mathcal LL are computed in [0,∞][0, \infty][0,∞], so unbounded directions give Lˉ=Rn\bar{\mathcal L} = \mathbb{R}^nLˉ=Rn.

The following repairs and readings of the printed statements are made:

  1. Theorem 2.2 and Corollary 2.3 assume ∇f(xk)dk≤0\nabla f(x_k) d_k \le 0∇f(xk​)dk​≤0 for every kkk. The printed theorem constrains dkd_kdk​ only for large kkk, but its proof needs f(xk+1)≤Ckf(x_{k+1}) \le C_kf(xk+1​)≤Ck​ at every step, which is the hypothesis of Lemma 1.1. Without it an early ascent step could leave L\mathcal LL, where nothing is assumed. The direction assumption itself stays "for all sufficiently large kkk".
  2. lim inf⁡k∥∇f(xk)∥=0\liminf_k \|\nabla f(x_k)\| = 0liminfk​∥∇f(xk​)∥=0 is stated as "for every ε>0\varepsilon > 0ε>0, ∥∇f(xk)∥<ε\|\nabla f(x_k)\| < \varepsilon∥∇f(xk​)∥<ε for infinitely many kkk".
  3. The final "Hence" sentence of Theorem 2.2 is stated under ηmax⁡<1\eta_{\max} < 1ηmax​<1, from which it is derived.
  4. In Corollary 2.3, "positive constants τ1,τ2\tau_1, \tau_2τ1​,τ2​" is read as τ1>0\tau_1 > 0τ1​>0, τ2≥0\tau_2 \ge 0τ2​≥0, since the corollary itself treats τ2=0\tau_2 = 0τ2​=0.
  5. Lemma 2.1 is stated pointwise for one iteration. Its Armijo case makes explicit the fact f(xk)≤Ckf(x_k) \le C_kf(xk​)≤Ck​ that the paper's proof invokes.

The following formalizations would make the goal trivial or empty and are ruled out:

  • a (2.6) written with Lean's real liminf, which is 000 for a divergent sequence;
  • a run class in which the step rule does not constrain αk\alpha_kαk​ (Wolfe without (1.4), Armijo without maximality of hkh_khk​), or which no sequence satisfies. The constant run f≡0f \equiv 0f≡0, dk=0d_k = 0dk​=0 satisfies both rules, so the class is nonempty;
  • assuming ∇f\nabla f∇f globally Lipschitz or the directions bounded.

Welcome contributions: proofs of the milestones in the listed order, and general lemmas on Wolfe and Armijo steps under local gradient Lipschitz continuity, which are reusable for other line-search methods.

Selected references

  • H. Zhang, W. W. Hager, A Nonmonotone Line Search Technique and Its Application to Unconstrained Optimization, SIAM J. Optim. 14(4):1043–1056, 2004. https://doi.org/10.1137/S1052623403428208
  • L. Grippo, F. Lampariello, S. Lucidi, A Nonmonotone Line Search Technique for Newton's Method, SIAM J. Numer. Anal. 23(4):707–716, 1986. https://doi.org/10.1137/0723046
  • Y.-H. Dai, On the Nonmonotone Line Search, J. Optim. Theory Appl. 112(2):315–330, 2002. https://doi.org/10.1023/A:1013653923062
15 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Optimal Pricing of Seasonal Products in the Presence of Forward-Looking Consumers 4: Optimal Prices and Discount Time with Myopic Customers and Identical Declining ValuationsResearch Paper

Motivation

Retailers of fashion and seasonal goods sell a fixed stock over a short season and routinely cut the price part-way through it. The markdown trades off two effects: a late discount keeps early, high-valuation customers paying the full price, while an early discount reaches customers whose interest in the product fades as the season goes on. Aviv and Pazgal (MSOM 2008) build a two-price model of this trade-off with Poisson arrivals and valuations that decline exponentially over the season, and compare sellers facing myopic customers, who buy as soon as the current price is acceptable, with sellers facing strategic customers, who may wait for the discount.

This mission formalizes the benchmark of that comparison in which the problem can be solved in closed form: myopic customers who all share the same base valuation, so that the only source of price discrimination is the decline of valuations over time. Proposition 4 of the paper identifies the optimal premium price, discount price and discount time, and the paper's Proposition 5 and Example 1 then measure how much strategic behaviour costs the seller against it.

Setting

The season is [0,1][0, 1][0,1]. Customers arrive as a Poisson process with rate λ>0\lambda > 0λ>0, so λ\lambdaλ is the expected number of arrivals in the season. Every customer has base valuation 111, and a customer's valuation at time ttt is ρt\rho^tρt for a fixed decline parameter 0<ρ<10 < \rho < 10<ρ<1 (equivalently e−αte^{-\alpha t}e−αt with α=−ln⁡ρ\alpha = -\ln\rhoα=−lnρ; ρ\rhoρ is the fraction of the valuation left at the end of the season). In the paper's notation this is the case c=0c = 0c=0, μ=1\mu = 1μ=1, H=1H = 1H=1 of a family of Gamma-distributed base valuations with mean μ\muμ and coefficient of variation ccc; the tail of the base valuation is Fˉ(x)=1\bar F(x) = 1Fˉ(x)=1 for x≤1x \le 1x≤1 and 000 otherwise.

The seller posts a premium price p1p_1p1​ on [0,T)[0, T)[0,T) and a discount price p2≤p1p_2 \le p_1p2​≤p1​ from the discount time T∈[0,1]T \in [0, 1]T∈[0,1] on, and has unlimited inventory. A myopic customer arriving at t<Tt < Tt<T buys at once iff ρt≥p1\rho^t \ge p_1ρt≥p1​; otherwise the customer waits and buys at TTT iff ρT≥p2\rho^T \ge p_2ρT≥p2​. A customer arriving after TTT buys iff the current valuation is at least p2p_2p2​. The expected numbers of buyers in the three groups are the segment rates ΛI(p1)=λ∫0TFˉ(p1eαt) dt\Lambda_I(p_1) = \lambda\int_0^T \bar F(p_1e^{\alpha t})\,dtΛI​(p1​)=λ∫0T​Fˉ(p1​eαt)dt, ΛW(p1,p2)=λ∫0T[Fˉ(min⁡{p1eαt,p2eαT})−Fˉ(p1eαt)] dt\Lambda_W(p_1, p_2) = \lambda\int_0^T[\bar F(\min\{p_1e^{\alpha t}, p_2e^{\alpha T}\}) - \bar F(p_1 e^{\alpha t})]\,dtΛW​(p1​,p2​)=λ∫0T​[Fˉ(min{p1​eαt,p2​eαT})−Fˉ(p1​eαt)]dt and ΛL(p2)=λ∫T1Fˉ(p2eαt) dt\Lambda_L(p_2) = \lambda\int_T^1 \bar F(p_2 e^{\alpha t})\,dtΛL​(p2​)=λ∫T1​Fˉ(p2​eαt)dt, and the expected revenue is

Rρ(p1,p2;T)=p1 ΛI(p1)+p2 (ΛW(p1,p2)+ΛL(p2)).R_\rho(p_1, p_2; T) = p_1\,\Lambda_I(p_1) + p_2\,\big(\Lambda_W(p_1, p_2) + \Lambda_L(p_2)\big).Rρ​(p1​,p2​;T)=p1​ΛI​(p1​)+p2​(ΛW​(p1​,p2​)+ΛL​(p2​)).

For a price p∈[ρ,1]p \in [\rho, 1]p∈[ρ,1] let τ(p)=ln⁡p/ln⁡ρ\tau(p) = \ln p/\ln\rhoτ(p)=lnp/lnρ, the time at which the valuation has fallen to ppp, and write τ1=τ(p1)\tau_1 = \tau(p_1)τ1​=τ(p1​), τ2=τ(p2)\tau_2 = \tau(p_2)τ2​=τ(p2​). The reduced objective is

G(p1,p2)=(p1−p2) ln⁡p1ln⁡ρ+p2 ln⁡p2ln⁡ρ,ρ≤p2≤p1≤1.G(p_1, p_2) = (p_1 - p_2)\,\frac{\ln p_1}{\ln\rho} + p_2\,\frac{\ln p_2}{\ln\rho}, \qquad \rho \le p_2 \le p_1 \le 1 .G(p1​,p2​)=(p1​−p2​)lnρlnp1​​+p2​lnρlnp2​​,ρ≤p2​≤p1​≤1.

Formalization targets

Goal: Proposition 4 (p. 351)

πC/N∗=λ⋅max⁡ρ≤p2≤p1≤1G(p1,p2)=max⁡0<p2≤p1, 0≤T≤1Rρ(p1,p2;T),\pi^*_{C/N} = \lambda\cdot\max_{\rho \le p_2 \le p_1 \le 1} G(p_1, p_2) = \max_{0 < p_2 \le p_1,\ 0 \le T \le 1} R_\rho(p_1, p_2; T),πC/N∗​=λ⋅ρ≤p2​≤p1​≤1max​G(p1​,p2​)=0<p2​≤p1​, 0≤T≤1max​Rρ​(p1​,p2​;T),

every maximizer (p1∗,p2∗)(p_1^*, p_2^*)(p1∗​,p2∗​) of GGG together with every TTT with p2∗≤ρT≤p1∗p_2^* \le \rho^T \le p_1^*p2∗​≤ρT≤p1∗​ attains πC/N∗\pi^*_{C/N}πC/N∗​, and, if ρ≤e−2+e−1\rho \le e^{-2+e^{-1}}ρ≤e−2+e−1, the maximizer is unique,

p1∗=e−1+e−1,p2∗=p1∗/e,πC/N∗=−λ e−1+e−1ln⁡ρ,p_1^* = e^{-1+e^{-1}}, \qquad p_2^* = p_1^*/e, \qquad \pi^*_{C/N} = -\frac{\lambda\, e^{-1+e^{-1}}}{\ln\rho},p1∗​=e−1+e−1,p2∗​=p1∗​/e,πC/N∗​=−lnρλe−1+e−1​,

and every TTT with ρT∈[e−2+e−1,e−1+e−1]\rho^T \in [e^{-2+e^{-1}}, e^{-1+e^{-1}}]ρT∈[e−2+e−1,e−1+e−1] is optimal.

Milestones (Proof of Proposition 4, p. 359)

For ρ≤p2≤p1≤1\rho \le p_2 \le p_1 \le 1ρ≤p2​≤p1​≤1:

  1. Rρ(p1,p2;T)≤Rρ(p1,p2;τ1)R_\rho(p_1, p_2; T) \le R_\rho(p_1, p_2; \tau_1)Rρ​(p1​,p2​;T)≤Rρ​(p1​,p2​;τ1​) for T∈[0,τ1]T \in [0, \tau_1]T∈[0,τ1​];
  2. Rρ(p1,p2;T)≤Rρ(p1,p2;τ2)R_\rho(p_1, p_2; T) \le R_\rho(p_1, p_2; \tau_2)Rρ​(p1​,p2​;T)≤Rρ​(p1​,p2​;τ2​) for T∈[τ2,1]T \in [\tau_2, 1]T∈[τ2​,1];
  3. Rρ(p1,p2;T)=λ G(p1,p2)R_\rho(p_1, p_2; T) = \lambda\, G(p_1, p_2)Rρ​(p1​,p2​;T)=λG(p1​,p2​) for T∈[τ1,τ2]T \in [\tau_1, \tau_2]T∈[τ1​,τ2​];
  4. for ρ≤e−2+e−1\rho \le e^{-2+e^{-1}}ρ≤e−2+e−1, max⁡G=−e−1+e−1/ln⁡ρ\max G = -e^{-1+e^{-1}}/\ln\rhomaxG=−e−1+e−1/lnρ, attained only at (e−1+e−1,e−2+e−1)(e^{-1+e^{-1}}, e^{-2+e^{-1}})(e−1+e−1,e−2+e−1).

Significance

Proposition 4 gives an explicit optimal markdown policy in a model where segmentation happens purely by arrival time: it shows that the discount time is not pinned down but can be placed anywhere in the interval in which the valuation lies between the two prices, and that for strongly declining valuations the optimal prices do not depend on ρ\rhoρ at all. The paper uses it as the benchmark πC/N∗\pi^*_{C/N}πC/N∗​ against which the strategic-customer equilibrium of Proposition 5 and the losses of Example 1 are measured.

The result is proved in the paper by a short argument; nothing in it has been machine-checked. A formal development makes the three observations of the proof precise (in particular, that prices outside [ρ,1][\rho, 1][ρ,1] are dominated, which the paper leaves implicit) and supplies the omitted calculus for the special case.

Difficulty

The revenue is defined through integrals of a step function of time, and the reduction to GGG needs these integrals evaluated in every configuration of p1p_1p1​, p2p_2p2​ and TTT, including prices above 111 (nobody buys) and below ρ\rhoρ (everyone buys, at a needlessly low price). The paper's proof covers only ρ≤p2≤p1≤1\rho \le p_2 \le p_1 \le 1ρ≤p2​≤p1​≤1 and asserts the domination of the remaining prices without argument. The special case is a constrained two-variable maximization of a function that is not jointly concave; the unconstrained critical point must be shown to be feasible exactly when ρ≤e−2+e−1\rho \le e^{-2+e^{-1}}ρ≤e−2+e−1, and boundary points of the region must be excluded.

Formalization scope

Everything is over R\mathbb RR. Logarithms are Real.log, powers ρT\rho^TρT are real powers, the segment rates are interval integrals ∫ t in a..b of the tail Fˉ(x)=1{x≤1}\bar F(x) = \mathbf 1\{x \le 1\}Fˉ(x)=1{x≤1}, and α=−ln⁡ρ\alpha = -\ln\rhoα=−lnρ with H=1H = 1H=1. The model definitions (ΛI\Lambda_IΛI​, ΛW\Lambda_WΛW​, ΛL\Lambda_LΛL​ and the revenue) are stated for a general tail Fˉ\bar FFˉ, decline factor, season length and discount time and then specialized.

The following readings of the paper's words are fixed:

  • "c=0c = 0c=0": every base valuation equals μ=1\mu = 1μ=1 (the degenerate end of the paper's Gamma family, outside §3's "continuous distribution").
  • "Q/λ→∞Q/\lambda \to \inftyQ/λ→∞": unlimited inventory; the truncated Poisson mean N(q,Λ)N(q, \Lambda)N(q,Λ) is replaced by Λ\LambdaΛ. With unlimited inventory, choosing the contingent discount at time TTT and choosing both prices in advance give the same optimum.
  • Myopic waiting customers buy at TTT iff their valuation at TTT is at least p2p_2p2​, as in ΛW\Lambda_WΛW​.
  • "TTT could be optimally selected": T∈[0,1]T \in [0, 1]T∈[0,1] is a decision variable together with the prices, which range over all 0<p2≤p10 < p_2 \le p_10<p2​≤p1​, not only over [ρ,1][\rho, 1][ρ,1].
  • "Maximize his expected revenues": IsGreatest of the set of attainable revenues.
  • "Setting TTT to any value within the range p2∗≤ρT≤p1∗p_2^* \le \rho^T \le p_1^*p2∗​≤ρT≤p1∗​", and "it would be optimal to select TTT so that ρT∈[e−2+e−1,e−1+e−1]\rho^T \in [e^{-2+e^{-1}}, e^{-1+e^{-1}}]ρT∈[e−2+e−1,e−1+e−1]": every such TTT is optimal; it is not claimed that no other TTT is.
  • "The prices p1∗p_1^*p1∗​ and p2∗p_2^*p2∗​ that solve the problem" in the special case: the maximizer of GGG is unique.
  • "Never optimal" in the first two observations: a weak inequality between revenues.

The decimals 0.1960.1960.196 and 0.5320.5320.532 are not stated. A formalization that restricted prices to [ρ,1][\rho, 1][ρ,1] in the revenue maximization, or that fixed TTT in advance, would assume half of what the proposition proves and is ruled out. Welcome contributions include general lemmas evaluating interval integrals of indicator functions of intervals, and the domination argument for prices outside [ρ,1][\rho, 1][ρ,1].

Selected references

  • Y. Aviv and A. Pazgal, Optimal Pricing of Seasonal Products in the Presence of Forward-Looking Consumers, Manufacturing & Service Operations Management 10(3):339–359, 2008. https://doi.org/10.1287/msom.1070.0183
  • N. Stokey, Intertemporal Price Discrimination, Quarterly Journal of Economics 93(3):355–371, 1979. https://doi.org/10.2307/1883163
  • D. Besanko and W. L. Winston, Optimal Price Skimming by a Monopolist Facing Rational Consumers, Management Science 36(5):555–567, 1990. https://doi.org/10.1287/mnsc.36.5.555
9 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

A Distributional Interpretation of Robust Optimization III: Uncertainty Set Shrinkage Approximates a Two-Scenario Distributionally Robust ProblemResearch Paper

Why shrink an uncertainty set

Robust optimization (RO) protects a decision against every parameter value in an uncertainty set. For a decision vvv and a parameter x∈Rmx \in \mathbb{R}^mx∈Rm with objective f(v,x)f(v, x)f(v,x) to be maximized, the robust problem around a nominal parameter x0x_0x0​ with a deviation set Δ\DeltaΔ is

max⁡vmin⁡xδ∈Δf(v,x0+xδ).\max_{v} \min_{x_\delta \in \Delta} f(v, x_0 + x_\delta).vmax​xδ​∈Δmin​f(v,x0​+xδ​).

When deviations are not adversarial, this formulation is known to be conservative (Delage and Mannor, 2010; Xu and Mannor, NIPS 2006). A common remedy in practice is uncertainty set shrinkage: fix α∈(0,1)\alpha \in (0,1)α∈(0,1) and solve the same problem over the shrunken set αΔ={αx:x∈Δ}\alpha\Delta = \{\alpha x : x \in \Delta\}αΔ={αx:x∈Δ}. The heuristic is easy to implement, but the meaning of the set αΔ\alpha\DeltaαΔ is unclear, and it has lacked a justification.

Section 4.2 of Xu, Caramanis and Mannor (2012) supplies one, using the paper's distributional interpretation of RO: the shrunken problem approximately solves a distributionally robust stochastic program (DRSP) with two scenarios. This mission formalizes that result, Theorem 4.1, and its two corollaries.

Setting

Let Rm\mathbb{R}^mRm carry the Euclidean norm ∥⋅∥2\|\cdot\|_2∥⋅∥2​ and its Borel σ\sigmaσ-algebra, and let P\mathcal PP be the set of Borel probability measures on Rm\mathbb{R}^mRm. Let VVV be any set of decisions and f:V×Rm→Rf : V \times \mathbb{R}^m \to \mathbb{R}f:V×Rm→R. Fix x0∈Rmx_0 \in \mathbb{R}^mx0​∈Rm, a deviation set Δ⊆Rm\Delta \subseteq \mathbb{R}^mΔ⊆Rm, and α∈(0,1)\alpha \in (0,1)α∈(0,1). Write x0+Δ={x0+x:x∈Δ}x_0 + \Delta = \{x_0 + x : x \in \Delta\}x0​+Δ={x0​+x:x∈Δ}.

The two-scenario set is

P^′={μ∈P∣μ({x0})≥1−α, μ(x0+Δ)=1}.\hat{\mathcal P}' = \{\mu \in \mathcal P \mid \mu(\{x_0\}) \ge 1-\alpha,\ \mu(x_0 + \Delta) = 1\}.P^′={μ∈P∣μ({x0​})≥1−α, μ(x0​+Δ)=1}.

A distribution in P^′\hat{\mathcal P}'P^′ describes a system that is, with probability at least 1−α1-\alpha1−α, in a normal state where the parameter equals x0x_0x0​, and otherwise in an abnormal state where the parameter deviates by an element of Δ\DeltaΔ. The DRSP value of a decision vvv is inf⁡μ∈P^′∫f(v,x) dμ(x)\inf_{\mu \in \hat{\mathcal P}'} \int f(v, x)\, d\mu(x)infμ∈P^′​∫f(v,x)dμ(x).

Two further quantities enter. The radius of the deviation set is D=max⁡x∈Δ∥x∥2D = \max_{x \in \Delta} \|x\|_2D=maxx∈Δ​∥x∥2​. The curvature bound is a constant h≥0h \ge 0h≥0 with

−hI⪯Hv(x)⪯hIfor all v,x,-hI \preceq H_v(x) \preceq hI \quad \text{for all } v, x,−hI⪯Hv​(x)⪯hIfor all v,x,

where Hv(x)H_v(x)Hv​(x) is the Hessian of f(v,⋅)f(v, \cdot)f(v,⋅) at xxx and ⪯\preceq⪯ is the positive-semidefinite order. In the Lean development these are scenarioSet x₀ Δ (1 - α), drspValue, devRadius Δ and HasBoundedHessian (f v) h, all in the namespace DistInterpRO.Shrinkage.

Formalization targets

Goal: Theorem 4.1 (p. 104)

If f(v,⋅)f(v,\cdot)f(v,⋅) is twice differentiable with −hI⪯Hv(x)⪯hI-hI \preceq H_v(x) \preceq hI−hI⪯Hv​(x)⪯hI for all v,xv, xv,x, then for all vvv

inf⁡μ∈P^′∫f(v,x) dμ(x)−αD2h  ≤  min⁡xδ∈αΔf(v,x0+xδ)  ≤  inf⁡μ∈P^′∫f(v,x) dμ(x)+αD2h.\inf_{\mu \in \hat{\mathcal P}'} \int f(v,x)\,d\mu(x) - \alpha D^2 h \;\le\; \min_{x_\delta \in \alpha\Delta} f(v, x_0 + x_\delta) \;\le\; \inf_{\mu \in \hat{\mathcal P}'} \int f(v,x)\,d\mu(x) + \alpha D^2 h.μ∈P^′inf​∫f(v,x)dμ(x)−αD2h≤xδ​∈αΔmin​f(v,x0​+xδ​)≤μ∈P^′inf​∫f(v,x)dμ(x)+αD2h.

Milestones (the displays of the proof on p. 105)

  1. The mean-value step f(v,x0+x1)=f(v,x0)+gv(x0+βx1)x1f(v, x_0 + x_1) = f(v, x_0) + g_v(x_0 + \beta x_1)x_1f(v,x0​+x1​)=f(v,x0​)+gv​(x0​+βx1​)x1​ for some β∈[0,1]\beta \in [0,1]β∈[0,1], where gvg_vgv​ is the gradient of f(v,⋅)f(v,\cdot)f(v,⋅).
  2. The gradient bound ∥gv(x0+βx1)−gv(x0+αβ′x1)∥≤h∥βx1−αβ′x1∥≤h∥x1∥≤hD\|g_v(x_0 + \beta x_1) - g_v(x_0 + \alpha\beta' x_1)\| \le h\|\beta x_1 - \alpha\beta' x_1\| \le h\|x_1\| \le hD∥gv​(x0​+βx1​)−gv​(x0​+αβ′x1​)∥≤h∥βx1​−αβ′x1​∥≤h∥x1​∥≤hD, stated together with the general fact that the Hessian bound makes gvg_vgv​ hhh-Lipschitz.
  3. The pointwise sandwich: for x1∈Δx_1 \in \Deltax1​∈Δ, f(v,x0+αx1)f(v, x_0 + \alpha x_1)f(v,x0​+αx1​) lies within αD2h\alpha D^2 hαD2h of (1−α)f(v,x0)+αf(v,x0+x1)(1-\alpha) f(v, x_0) + \alpha f(v, x_0 + x_1)(1−α)f(v,x0​)+αf(v,x0​+x1​).
  4. The min sandwich: min⁡αΔf(v,x0+⋅)\min_{\alpha\Delta} f(v, x_0 + \cdot)minαΔ​f(v,x0​+⋅) lies within αD2h\alpha D^2 hαD2h of (1−α)f(v,x0)+αmin⁡Δf(v,x0+⋅)(1-\alpha) f(v, x_0) + \alpha \min_{\Delta} f(v, x_0 + \cdot)(1−α)f(v,x0​)+αminΔ​f(v,x0​+⋅).
  5. The two-scenario value: (1−α)f(v,x0)+αmin⁡xδ∈Δf(v,x0+xδ)=inf⁡μ∈P^′∫f(v,x) dμ(x)(1-\alpha) f(v, x_0) + \alpha \min_{x_\delta\in\Delta} f(v, x_0 + x_\delta) = \inf_{\mu \in \hat{\mathcal P}'} \int f(v,x)\,d\mu(x)(1−α)f(v,x0​)+αminxδ​∈Δ​f(v,x0​+xδ​)=infμ∈P^′​∫f(v,x)dμ(x), which the paper derives from its Corollary 5.2 (p. 107).

Further results

Corollary 4.2 (p. 104): if every f(v,⋅)f(v,\cdot)f(v,⋅) is linear, the shrunken value equals the DRSP value exactly. Corollary 4.3 (p. 105): if Δ\DeltaΔ is star shaped, every f(v,⋅)f(v,\cdot)f(v,⋅) is convex with f(v,x0)−min⁡Δf(v,x0+⋅)≥1f(v, x_0) - \min_{\Delta} f(v, x_0 + \cdot) \ge 1f(v,x0​)−minΔ​f(v,x0​+⋅)≥1 and has Hessian bounded by hhh, then the shrunken value lies between the DRSP values over P^′′\hat{\mathcal P}''P^′′ and P^′\hat{\mathcal P}'P^′, where P^′′\hat{\mathcal P}''P^′′ requires only μ({x0})≥max⁡(0,1−α−αD2h)\mu(\{x_0\}) \ge \max(0, 1-\alpha-\alpha D^2 h)μ({x0​})≥max(0,1−α−αD2h).

Significance

The result gives a physical meaning to the parameter α\alphaα of the shrinkage heuristic: 1−α1-\alpha1−α is a lower bound on the probability that the system is in its nominal state. The error αD2h\alpha D^2 hαD2h vanishes when the objective is linear in the parameter (Corollary 4.2), which covers linear programs with uncertain costs and Markov decision processes with uncertain rewards; in that case shrinkage is exactly a two-scenario DRSP. The paper also shows by example (p. 104) that without a curvature condition the two problems can differ, so the Hessian bound is the operative hypothesis.

The result is proved in the paper; to our knowledge it has no machine-checked proof. Formalizing it adds a checked link between the discrete two-point structure of the DRSP value and the smooth analysis of the shrunken minimum, with every standing hypothesis written out (see below). The mean-value and gradient-Lipschitz steps are general facts about functions on Euclidean space with bounded Hessian and are reusable elsewhere.

Difficulty

Two points need care. First, the step from the Hessian bound −hI⪯Hv⪯hI-hI \preceq H_v \preceq hI−hI⪯Hv​⪯hI, a bound on a quadratic form, to the Lipschitz bound on the gradient requires the operator norm of the Hessian, which equals the largest absolute value of its quadratic form only because the Hessian is symmetric; symmetry of second derivatives must be invoked for a function that is merely twice (Fréchet) differentiable, not twice continuously differentiable. Second, the DRSP value is an infimum over an infinite-dimensional set of measures; identifying it with the two-point value requires both a construction of a near-optimal measure and a lower bound valid for every admissible measure, including measures that spread their abnormal mass over all of x0+Δx_0 + \Deltax0​+Δ.

Formalization scope

Rm\mathbb{R}^mRm is EuclideanSpace ℝ (Fin m) with its Borel σ\sigmaσ-algebra. Measures are Measures, and membership in P^′\hat{\mathcal P}'P^′ includes IsProbabilityMeasure. Infima are real infima over subtypes; integrals are Bochner integrals.

The formalization makes the following readings explicit:

  1. Δ\DeltaΔ is compact. The page writes min over αΔ\alpha\DeltaαΔ and max over Δ\DeltaΔ, which presuppose attainment. Compactness together with continuity of f(v,⋅)f(v,\cdot)f(v,⋅) gives attainment, a finite DDD, finite integrals and measurability of x0+Δx_0 + \Deltax0​+Δ. The goal additionally states that the minimum over αΔ\alpha\DeltaαΔ is attained.
  2. 0∈Δ0 \in \Delta0∈Δ. Without it P^′\hat{\mathcal P}'P^′ is empty, since μ({x0})≥1−α>0\mu(\{x_0\}) \ge 1-\alpha > 0μ({x0​})≥1−α>0 and μ(x0+Δ)=1\mu(x_0+\Delta)=1μ(x0​+Δ)=1 force x0∈x0+Δx_0 \in x_0 + \Deltax0​∈x0​+Δ. The page's two-scenario reading presupposes it. In Corollary 4.3 it follows from star-shapedness once Δ\DeltaΔ is nonempty, and nonemptiness is added there.
  3. Twice differentiable with bounded Hessian means that f(v,⋅)f(v,\cdot)f(v,⋅) and its derivative are differentiable everywhere and ∣D2f(v,⋅)(x)[y,y]∣≤h∥y∥22|D^2 f(v,\cdot)(x)[y,y]| \le h\|y\|_2^2∣D2f(v,⋅)(x)[y,y]∣≤h∥y∥22​ for all x,yx, yx,y. The constant hhh is one constant for all vvv.
  4. The minima over Δ\DeltaΔ and αΔ\alpha\DeltaαΔ are written as infima, which equal the minima under the hypotheses above.

The Lean functions drspValue and devRadius return 000 on an empty or unbounded input; the hypotheses above exclude those inputs, so no statement holds through a junk value. A formalization that dropped 0∈Δ0 \in \Delta0∈Δ would make the inequalities hold or fail for the wrong reason and is ruled out.

Contributions welcome: the Lipschitz-gradient lemma for bounded Hessians in Euclidean space, the evaluation of the two-scenario DRSP value, and the combination into Theorem 4.1 and its corollaries.

Selected references

  • H. Xu, C. Caramanis, S. Mannor, A Distributional Interpretation of Robust Optimization, Mathematics of Operations Research 37(1):95–110, 2012. https://doi.org/10.1287/moor.1110.0531
  • E. Delage, S. Mannor, Percentile Optimization for Markov Decision Processes with Parameter Uncertainty, Operations Research 58(1):203–213, 2010. https://doi.org/10.1287/opre.1080.0685
  • E. Delage, Y. Ye, Distributionally Robust Optimization under Moment Uncertainty with Applications to Data-Driven Problems, Operations Research 58(3):595–612, 2010. https://doi.org/10.1287/opre.1090.0741
  • D. Bertsimas, D. B. Brown, C. Caramanis, Theory and Applications of Robust Optimization, SIAM Review 53(3):464–501, 2011. https://doi.org/10.1137/080734510
7 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

A Distributional Interpretation of Robust Optimization I: Robust Optimization over Overlapping Uncertainty Sets Equals a Distributionally Robust Stochastic ProgramResearch Paper

Motivation

Robust optimization (RO) protects a decision against every realisation of an uncertain parameter in a prescribed uncertainty set; distributionally robust stochastic programming (DRSP) protects it against every probability distribution in a prescribed distribution set. The two paradigms are usually treated separately. When the n uncertain parameters live in different spaces, it is folklore that RO over a product of sets is DRSP over the distributions supported on that product (Delage and Ye, Operations Research 2010).

In data-driven problems the situation is different: the parameters x1,…,xnx_1,\dots,x_nx1​,…,xn​ are samples, and all of them lie in the same space Rm\mathbb R^mRm. Robustifying each sample by its own uncertainty set Zi\mathcal Z_iZi​ gives the objective ∑iciinf⁡xi∈Zif(xi)\sum_i c_i\inf_{x_i\in\mathcal Z_i}f(x_i)∑i​ci​infxi​∈Zi​​f(xi​), and the sets Zi\mathcal Z_iZi​ typically overlap. Xu, Caramanis and Mannor (Math. Oper. Res. 2012) show that this objective is again a worst-case expectation, now over distributions on Rm\mathbb R^mRm itself rather than on Rm×n\mathbb R^{m\times n}Rm×n. This equivalence is what the same paper uses to prove that box-robust sample average optimisation is statistically consistent, and to explain the shrinkage heuristic of RO.

Setting

Let m,n≥1m,n\ge1m,n≥1 and write [1:n]={1,…,n}[1:n]=\{1,\dots,n\}[1:n]={1,…,n}. Let P\mathcal PP be the set of Borel probability measures on Rm\mathbb R^mRm. The data are:

  • a measurable utility f:Rm→Rf:\mathbb R^m\to\mathbb Rf:Rm→R (the decision variable is suppressed);
  • weights c1,…,cn>0c_1,\dots,c_n>0c1​,…,cn​>0 with ∑i=1nci=1\sum_{i=1}^n c_i=1∑i=1n​ci​=1;
  • nonempty Borel uncertainty sets Z1,…,Zn⊆Rm\mathcal Z_1,\dots,\mathcal Z_n\subseteq\mathbb R^mZ1​,…,Zn​⊆Rm, which may intersect or coincide.

For S⊆[1:n]S\subseteq[1:n]S⊆[1:n] write ZS=⋃i∈SZi\mathcal Z_S=\bigcup_{i\in S}\mathcal Z_iZS​=⋃i∈S​Zi​ and N=[1:n]N=[1:n]N=[1:n]. The distribution set is

Pn={μ∈P ∣ ∀S⊆[1:n]: μ(ZS)≥∑i∈Sci}.\mathcal P_n=\Big\{\mu\in\mathcal P\ \Big|\ \forall S\subseteq[1:n]:\ \mu(\mathcal Z_S)\ge\sum_{i\in S}c_i\Big\}.Pn​={μ∈P ​ ∀S⊆[1:n]: μ(ZS​)≥i∈S∑​ci​}.

Each μ∈Pn\mu\in\mathcal P_nμ∈Pn​ must give every union of uncertainty sets at least the total weight of its indices. For μ∈P\mu\in\mathcal Pμ∈P the expectation ∫f dμ\int f\,d\mu∫fdμ is the extended integral ∫f+dμ−∫f−dμ∈[−∞,+∞]\int f^+d\mu-\int f^-d\mu\in[-\infty,+\infty]∫f+dμ−∫f−dμ∈[−∞,+∞].

Formalization targets

Goal: Theorem 2.1 (Eq. (4), pp. 96–97)

∑i=1n[ciinf⁡xi∈Zif(xi)]=inf⁡μ∈Pn∫Rmf(x) dμ(x),\sum_{i=1}^n\Big[c_i\inf_{x_i\in\mathcal Z_i}f(x_i)\Big]=\inf_{\mu\in\mathcal P_n}\int_{\mathbb R^m}f(x)\,d\mu(x),i=1∑n​[ci​xi​∈Zi​inf​f(xi​)]=μ∈Pn​inf​∫Rm​f(x)dμ(x),

as an identity in [−∞,+∞][-\infty,+\infty][−∞,+∞], with no boundedness assumption on fff and no disjointness assumption on the Zi\mathcal Z_iZi​.

Milestones (proof of Theorem 2.1, p. 97)

  1. Every μ∈Pn\mu\in\mathcal P_nμ∈Pn​ satisfies μ(Rm∖ZN)=0\mu(\mathbb R^m\setminus\mathcal Z_N)=0μ(Rm∖ZN​)=0, hence ∫Rmf dμ=∫ZNf dμ\int_{\mathbb R^m}f\,d\mu=\int_{\mathcal Z_N}f\,d\mu∫Rm​fdμ=∫ZN​​fdμ.
  2. Weak duality. With fi=inf⁡Ziff_i=\inf_{\mathcal Z_i}ffi​=infZi​​f finite, every α∈R2n\alpha\in\mathbb R^{2^n}α∈R2n satisfying ∑SαS1(x∈ZS)≤f(x)\sum_S\alpha_S\mathbf 1(x\in\mathcal Z_S)\le f(x)∑S​αS​1(x∈ZS​)≤f(x) on ZN\mathcal Z_NZN​ and αS≥0\alpha_S\ge0αS​≥0 for S≠NS\ne NS=N obeys ∑ici∑SαS1(i∈S)≤∑icifi\sum_i c_i\sum_S\alpha_S\mathbf 1(i\in S)\le\sum_i c_if_i∑i​ci​∑S​αS​1(i∈S)≤∑i​ci​fi​.
  3. The nested dual solution. If f1≥⋯≥fnf_1\ge\dots\ge f_nf1​≥⋯≥fn​, the vector with α{1,…,i}=fi−fi+1\alpha_{\{1,\dots,i\}}=f_i-f_{i+1}α{1,…,i}​=fi​−fi+1​, αN=fn\alpha_N=f_nαN​=fn​ and all other coordinates 000 is feasible and has objective ∑icifi\sum_i c_if_i∑i​ci​fi​.

Further statements

  • For pairwise disjoint Zi\mathcal Z_iZi​: Pn={μ∈P∣μ(Zi)=ci, i=1,…,n}\mathcal P_n=\{\mu\in\mathcal P\mid\mu(\mathcal Z_i)=c_i,\ i=1,\dots,n\}Pn​={μ∈P∣μ(Zi​)=ci​, i=1,…,n} (p. 97).
  • Corollary 2.1 (Eq. (5)): inf⁡x′∈Zf(x′)=inf⁡μ∈P, μ(Z)=1∫f dμ\inf_{x'\in\mathcal Z}f(x')=\inf_{\mu\in\mathcal P,\ \mu(\mathcal Z)=1}\int f\,d\muinfx′∈Z​f(x′)=infμ∈P, μ(Z)=1​∫fdμ.
  • Corollary 5.2 (nested distributions, p. 107): for Z1⊆⋯⊆Zn\mathcal Z_1\subseteq\dots\subseteq\mathcal Z_nZ1​⊆⋯⊆Zn​ and 0=p0<p1<⋯<pn=10=p_0<p_1<\dots<p_n=10=p0​<p1​<⋯<pn​=1,
inf⁡μ∈P, μ(Zi)≥pi ∀i∫f dμ=∑i=1n(pi−pi−1)inf⁡xi∈Zif(xi).\inf_{\mu\in\mathcal P,\ \mu(\mathcal Z_i)\ge p_i\ \forall i}\int f\,d\mu=\sum_{i=1}^n(p_i-p_{i-1})\inf_{x_i\in\mathcal Z_i}f(x_i).μ∈P, μ(Zi​)≥pi​ ∀iinf​∫fdμ=i=1∑n​(pi​−pi−1​)xi​∈Zi​inf​f(xi​).

Significance

The result. Theorem 2.1 turns a robust problem with overlapping uncertainty sets into a distributionally robust one on the original space Rm\mathbb R^mRm. This is what allows distributions in Pn\mathcal P_nPn​ to be compared with the true data-generating distribution as nnn grows: in §3 of the paper a kernel density estimator is shown to lie in Pn\mathcal P_nPn​ for box uncertainty sets, which yields consistency of box-robust sample average optimisation (Theorem 3.1); in §4.2 the nested-distribution form (Corollary 5.2) explains why shrinking an uncertainty set approximates a two-scenario DRSP (Theorem 4.1). The disjoint case recovers the classical product-space equivalence.

Formalizing it. The result is proved in the paper, through the strong duality of a semi-infinite linear program (Isii 1962). It has no machine-checked proof. The mission produces the equivalence as an identity of extended reals, together with a reusable definition of the union-mass distribution set. A proof need not follow the paper's duality route; any correct argument is welcome.

Difficulty

The inequality ≥\ge≥ from the left side is the easy half: point masses ∑iciδxi\sum_ic_i\delta_{x_i}∑i​ci​δxi​​ with xi∈Zix_i\in\mathcal Z_ixi​∈Zi​ belong to Pn\mathcal P_nPn​. The substance is the reverse bound, that no μ∈Pn\mu\in\mathcal P_nμ∈Pn​ can do better than ∑icifi\sum_ic_if_i∑i​ci​fi​. For disjoint sets this is immediate, since μ(Zi)=ci\mu(\mathcal Z_i)=c_iμ(Zi​)=ci​. For overlapping sets a measure may place mass in intersections, and a single point of Zi∩Zj\mathcal Z_i\cap\mathcal Z_jZi​∩Zj​ can serve several indices at once; the constraint family over all 2n2^n2n subsets is what prevents this, and the bound has to exploit the whole family, not the singleton constraints. The paper does this by appeal to semi-infinite LP duality, a theorem that Mathlib does not contain. Measure-theoretic side conditions (unbounded Zi\mathcal Z_iZi​, infinite integrals, infima equal to −∞-\infty−∞) must also be handled rather than assumed away.

Formalization scope

  • Rm\mathbb R^mRm is Fin m → ℝ with its Borel σ\sigmaσ-algebra; no norm is used. Indices 1,…,n1,\dots,n1,…,n are Fin n, subsets are Finset (Fin n), and {1,…,i}\{1,\dots,i\}{1,…,i} is Finset.Iic i.
  • Pn\mathcal P_nPn​ is a Set (Measure (Fin m → ℝ)) whose membership includes IsProbabilityMeasure; the constraint is imposed for every subset, ∅\emptyset∅ and [1:n][1:n][1:n] included.
  • ∫f dμ\int f\,d\mu∫fdμ is expect μ f, defined in EReal as the difference of two lower Lebesgue integrals, ∫f+−∫f−\int f^+-\int f^-∫f+−∫f−. The Bochner integral is not used, because its value 000 on non-integrable functions would falsify Eq. (4). Both sides of Eq. (4) are EReal infima; the left infimum ranges over the nonempty set Zi\mathcal Z_iZi​.
  • Readings of the printed statements. (i) The paper allows fff to take the value −∞-\infty−∞; here fff is real-valued. The excluded case is the one the proof disposes of in its first sentence, where both sides are −∞-\infty−∞. (ii) No boundedness hypothesis is added: when some inf⁡Zif=−∞\inf_{\mathcal Z_i}f=-\inftyinfZi​​f=−∞ both sides are −∞-\infty−∞, and otherwise every μ∈Pn\mu\in\mathcal P_nμ∈Pn​ has a finite negative part. (iii) Corollary 2.1 prints "f:R∪{−∞}f:\mathbb R\cup\{-\infty\}f:R∪{−∞}" without a domain; it is read as f:Rm→Rf:\mathbb R^m\to\mathbb Rf:Rm→R. (iv) Corollary 5.2 is corrected: the paper prints the coefficient (pn−pn−1)(p_n-p_{n-1})(pn​−pn−1​), while its proof sets ci=pi−pi−1c_i=p_i-p_{i-1}ci​=pi​−pi−1​; the printed version is false (for Z1={a}⊆Z2={a,b}\mathcal Z_1=\{a\}\subseteq\mathcal Z_2=\{a,b\}Z1​={a}⊆Z2​={a,b}, f(a)=1f(a)=1f(a)=1, f(b)=0f(b)=0f(b)=0, p1=1/4p_1=1/4p1​=1/4, the left side is 1/41/41/4 and the printed right side 3/43/43/4). The mission states (pi−pi−1)(p_i-p_{i-1})(pi​−pi−1​). (v) The standing hypotheses of Theorem 2.1 (fff measurable, Zi\mathcal Z_iZi​ nonempty Borel) are made explicit in Corollary 5.2.
  • The ordering f1≥⋯≥fnf_1\ge\dots\ge f_nf1​≥⋯≥fn​ is a hypothesis of the nested-dual milestone only, as the proof's "without loss of generality"; the goal does not assume it. Milestones 2 and 3 assume fff bounded below on each Zi\mathcal Z_iZi​ (the proof's first reduction), so that fif_ifi​ is a real number.
  • Ruled out. A Bochner-integral formulation, a restriction to disjoint sets, a distribution set containing non-probability measures, or a set Pn\mathcal P_nPn​ defined by the singleton constraints μ(Zi)≥ci\mu(\mathcal Z_i)\ge c_iμ(Zi​)≥ci​ alone would each change or trivialise the theorem; none is used.
  • Definitions (file Model): the set Pn\mathcal P_nPn​, the extended expectation, dual feasibility, and the nested dual vector. The extended expectation and the union-mass distribution set are reusable beyond this mission. Welcome contributions: a proof through semi-infinite LP duality, a direct measure-theoretic proof (for instance a layer-cake argument for the lower bound), and proofs of the corollaries from the goal.

Selected references

  • H. Xu, C. Caramanis, S. Mannor, A Distributional Interpretation of Robust Optimization, Mathematics of Operations Research 37(1):95–110, 2012. https://doi.org/10.1287/moor.1110.0531
  • E. Delage, Y. Ye, Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems, Operations Research 58(3):595–612, 2010. https://doi.org/10.1287/opre.1090.0741
  • K. Isii, On sharpness of Tchebycheff-type inequalities, Annals of the Institute of Statistical Mathematics 14:185–197, 1962. https://doi.org/10.1007/BF02868641
  • A. Ben-Tal, L. El Ghaoui, A. Nemirovski, Robust Optimization, Princeton University Press, 2009. https://doi.org/10.1515/9781400831050
5 thms2 active usersReviewed
🏆Completed
Discrete GeometryLinear OptimizationOperations Research·Captain: mikedeng1

Maximal Lattice-Free Convex Sets in Linear Subspaces II: Minimal Valid Inequalities Come from Maximal Lattice-Free Convex SetsResearch Paper

Cutting planes from lattice-free convex sets

Cutting planes for mixed-integer linear programs are often derived from a few rows of an optimal simplex tableau. Keeping qqq rows for basic integer variables x1,…,xqx_1,\dots,x_qx1​,…,xq​, dropping the nonnegativity of xxx (Gomory's corner polyhedron, Gomory 1969) and then the integrality of the nonbasic variables leaves the set of s≥0s\ge0s≥0 with f+∑jrjsj∈Zqf+\sum_j r^js_j\in\mathbb Z^qf+∑j​rjsj​∈Zq. Balas observed in 1971 that convex sets with no integral point in their interior give valid inequalities for such sets (Balas 1971). Andersen, Louveaux, Weismantel and Wolsey (2007) for two rows, and Borozan and Cornuéjols (2009) for any number of rows, showed that for rational data the irredundant valid inequalities correspond to maximal lattice-free convex sets. Basu, Conforti, Cornuéjols and Zambelli (arXiv:1701.06543; Math. Oper. Res. 35(3), 2010) removed the rationality assumption. This mission formalizes that result, Theorem 3 of their paper.

Setting

Fix q≥0q\ge0q≥0, a point f∈Rqf\in\mathbb R^qf∈Rq and a linear subspace W⊆RqW\subseteq\mathbb R^qW⊆Rq, and assume that the affine space f+Wf+Wf+W contains an integral point. Products such as ryryry are standard inner products.

  • W\mathcal WW is the space of real functions s=(sr)r∈Ws=(s_r)_{r\in W}s=(sr​)r∈W​ with finite support. The semi-infinite relaxation is
Rf(W)={s∈W ∣ f+∑r∈Wrsr∈Zq, sr≥0 (r∈W)}.R_f(W)=\Big\{s\in\mathcal W \ \Big|\ f+\sum_{r\in W}rs_r\in\mathbb Z^q,\ s_r\ge0\ (r\in W)\Big\}.Rf​(W)={s∈W ​ f+r∈W∑​rsr​∈Zq, sr​≥0 (r∈W)}.
  • A linear inequality is a pair (ψ,α)(\psi,\alpha)(ψ,α) with ψ:W→R\psi:W\to\mathbb Rψ:W→R an arbitrary function and α∈R\alpha\in\mathbb Rα∈R, read as Ψ(s)=∑r∈Wψ(r)sr≥α\Psi(s)=\sum_{r\in W}\psi(r)s_r\ge\alphaΨ(s)=∑r∈W​ψ(r)sr​≥α. It is valid if every s∈Rf(W)s\in R_f(W)s∈Rf​(W) satisfies it.
  • VVV is the affine hull of (f+W)∩Zq(f+W)\cap\mathbb Z^q(f+W)∩Zq, and V={s∈W∣f+∑rrsr∈V}\mathcal V=\{s\in\mathcal W\mid f+\sum_r rs_r\in V\}V={s∈W∣f+∑r​rsr​∈V}. A linear inequality is trivial if every s∈Vs\in\mathcal Vs∈V with s≥0s\ge0s≥0 satisfies it. When WWW is irrational (not spanned by the integral points it contains, up to translation), VVV is a proper affine subspace of f+Wf+Wf+W.
  • ∑ψ(r)sr≥α\sum\psi(r)s_r\ge\alpha∑ψ(r)sr​≥α dominates ∑ψ′(r)sr≥α\sum\psi'(r)s_r\ge\alpha∑ψ′(r)sr​≥α if ψ≤ψ′\psi\le\psi'ψ≤ψ′ pointwise. A valid inequality is minimal if no valid inequality with the same α\alphaα and a different ψ′≤ψ\psi'\le\psiψ′≤ψ exists.
  • Choose C∈Rℓ×qC\in\mathbb R^{\ell\times q}C∈Rℓ×q and d∈Rℓd\in\mathbb R^\elld∈Rℓ with V={x∈f+W∣Cx=d}V=\{x\in f+W\mid Cx=d\}V={x∈f+W∣Cx=d}. Two valid inequalities are equivalent if ψ(r)=ρψ′(r)+λTCr\psi(r)=\rho\psi'(r)+\lambda^TCrψ(r)=ρψ′(r)+λTCr for all r∈Wr\in Wr∈W and α=ρα′+λT(d−Cf)\alpha=\rho\alpha'+\lambda^T(d-Cf)α=ρα′+λT(d−Cf), for some ρ>0\rho>0ρ>0, λ∈Rℓ\lambda\in\mathbb R^\ellλ∈Rℓ.
  • A maximal lattice-free convex set in f+Wf+Wf+W is a convex B⊆f+WB\subseteq f+WB⊆f+W with no integral point in its interior relative to f+Wf+Wf+W, inclusionwise maximal with these properties.
  • For K⊆WK\subseteq WK⊆W closed, convex, with 000 in its interior relative to WWW: the polar K∗={y∈W∣ry≤1 ∀r∈K}K^*=\{y\in W\mid ry\le1\ \forall r\in K\}K∗={y∈W∣ry≤1 ∀r∈K}, K^={y∈K∗∣∃x∈K, xy=1}\hat K=\{y\in K^*\mid\exists x\in K,\ xy=1\}K^={y∈K∗∣∃x∈K, xy=1}, and ρK(r)=sup⁡y∈K^ry\rho_K(r)=\sup_{y\in\hat K}ryρK​(r)=supy∈K^​ry. For such a BBB with fff in its interior, ψB=ρB−f\psi_B=\rho_{B-f}ψB​=ρB−f​; for a polyhedral B={x∈f+W∣ai(x−f)≤1}B=\{x\in f+W\mid a_i(x-f)\le1\}B={x∈f+W∣ai​(x−f)≤1} with tight rows this is ψB(r)=max⁡iair\psi_B(r)=\max_ia_irψB​(r)=maxi​ai​r.

A function σ:W→R\sigma:W\to\mathbb Rσ:W→R is sublinear if σ(λr)=λσ(r)\sigma(\lambda r)=\lambda\sigma(r)σ(λr)=λσ(r) for λ≥0\lambda\ge0λ≥0 and σ(r+r′)≤σ(r)+σ(r′)\sigma(r+r')\le\sigma(r)+\sigma(r')σ(r+r′)≤σ(r)+σ(r′).

Formalization targets

Goal: Theorem 3 (p. 6)

  1. Every nontrivial valid linear inequality for Rf(W)R_f(W)Rf​(W) is dominated by a nontrivial minimal valid linear inequality for Rf(W)R_f(W)Rf​(W).
  2. Every nontrivial minimal valid linear inequality for Rf(W)R_f(W)Rf​(W) is equivalent to one of the form
∑r∈WψB(r)sr ≥ 1\sum_{r\in W}\psi_B(r)s_r\ \ge\ 1r∈W∑​ψB​(r)sr​ ≥ 1

with ψB≥0\psi_B\ge0ψB​≥0 on WWW and BBB a maximal lattice-free convex set in f+Wf+Wf+W with fff in its interior.

The goal is stated as one conjunction. It fixes no constants and makes no rationality assumption on fff or WWW.

Milestones

In the order in which the proof on pp. 15–21 uses them:

  • Lemma 23 (a sublinear valid inequality below any valid one)
  • Lemma 26 (invariance under equivalence)
  • Claims 1 and 2 in the proof of Theorem 3
  • Theorem 28 (Basu–Cornuéjols–Zambelli: ρK\rho_KρK​ is the smallest sublinear function with 111-sublevel set KKK)
  • Remark 30 and Claim 4 (the inequality ∑ρK(r)sr≥1\sum\rho_K(r)s_r\ge1∑ρK​(r)sr​≥1)
  • Remark 29 (ρK=max⁡iair\rho_K=\max_ia_irρK​=maxi​ai​r for tight rows)
  • Claim 6 (a shift by λTC\lambda^TCλTC making ψ\psiψ nonnegative)
  • Claim 7 (ψB\psi_BψB​ below a nonnegative sublinear ψ′′\psi''ψ′′)
  • Lemma 31 (maximal lattice-free sets give minimal inequalities)

Significance

Theorem 3 says that the minimal valid inequalities of Rf(W)R_f(W)Rf​(W) are exactly those produced by maximal lattice-free convex sets, up to the equivalence forced by the affine hull V\mathcal VV. It also says that for irrational WWW, where valid inequalities can have negative coefficients, some equivalent form always has nonnegative coefficients. The paper derives two further results from it: a description of the closure of conv⁡(Rf(W))\operatorname{conv}(R_f(W))conv(Rf​(W)) in a suitable norm (Theorem 4), and a reduction of extreme inequalities of the infinite model to finite ones (Theorem 5). Both results remain unproved without it.

The result has a complete proof in the paper, which relies on the cited Theorem 28 from Basu, Cornuéjols, Zambelli. To our knowledge none of it is machine-checked. A formalization would provide a definitional layer for corner relaxations, lattice-free sets and valid inequalities, which is currently absent from Mathlib. It would also expose where the page is imprecise; see the scope section.

Difficulty

For rational data every valid inequality can be written with right-hand side 111 and nonnegative coefficients, and ψ\psiψ is then the gauge of BψB_\psiBψ​. For irrational WWW this fails. Since Rf(W)⊆VR_f(W)\subseteq\mathcal VRf​(W)⊆V, adding λTCr\lambda^TCrλTCr to ψ\psiψ changes nothing on Rf(W)R_f(W)Rf​(W), so coefficients can be negative, and Bψ={x∈f+W∣ψ(x−f)≤α}B_\psi=\{x\in f+W\mid\psi(x-f)\le\alpha\}Bψ​={x∈f+W∣ψ(x−f)≤α} may have a full-dimensional recession cone. A maximal lattice-free set containing BψB_\psiBψ​ then yields a ψB\psi_BψB​ that need not lie below ψ\psiψ (the example on pp. 21–22 shows this). One must first pass to an equivalent inequality whose set has no full-dimensional recession cone within VVV. This step combines the structure theorem for maximal lattice-free sets in irrational subspaces (Theorem 9 of the paper) with a duality argument. A second obstacle is that ψ\psiψ is an arbitrary function: validity alone gives no convexity or continuity, and Lemma 23 is needed to recover them.

Formalization scope

  • Ambient space. Rq\mathbb R^qRq is EuclideanSpace ℝ (Fin q), WWW is a Submodule, and W\mathcal WW is W →₀ ℝ. The printed phrase "the set {r∣sr>0}\{r\mid s_r>0\}{r∣sr​>0} has finite cardinality" is read as ordinary finite support.
  • Standing hypothesis. Every statement assumes that f+Wf+Wf+W contains an integral point. Without it Rf(W)=∅R_f(W)=\emptysetRf​(W)=∅ and every inequality is valid, so this hypothesis rules out the trivializing formalization. The equivalence predicate carries the hypothesis V={x∈f+W∣Cx=d}V=\{x\in f+W\mid Cx=d\}V={x∈f+W∣Cx=d} together with validity of both inequalities. With C,dC,dC,d unconstrained, equivalence would be rescaling only, and part 2 of the goal would be false for irrational WWW.
  • Interiors. All interiors are relative: to f+Wf+Wf+W for BBB and BψB_\psiBψ​, to WWW for KKK.
  • ψB\psi_BψB​. It is defined as ρB−f\rho_{B-f}ρB−f​, independent of any description of BBB.

The paper is imprecise in three places, and the formalization departs from the page in each:

  1. Remark 29 is false without tight rows: for K=(−∞,1]⊆RK=(-\infty,1]\subseteq\mathbb RK=(−∞,1]⊆R written with a1=1a_1=1a1​=1, a2=1/2a_2=1/2a2​=1/2, ρK(r)=r≠max⁡(r,r/2)\rho_K(r)=r\ne\max(r,r/2)ρK​(r)=r=max(r,r/2) for r<0r<0r<0. It is stated with the tightness the paper arranges before using it.
  2. The identity int⁡(Bψ)={x∣ψ(x−f)<α}\operatorname{int}(B_\psi)=\{x\mid\psi(x-f)<\alpha\}int(Bψ​)={x∣ψ(x−f)<α} on p. 17 fails at α=0\alpha=0α=0, for example for ψ≡0\psi\equiv0ψ≡0. Claims 1 and 2 use the strict sublevel set, and Claim 2 is false for the topological interior.
  3. Claims 5 and 7 invoke Corollary 20 in f+Wf+Wf+W, although it is proved only for a lattice of a linear space. Corollary 20 and Claim 5 are therefore not milestones.

Two kinds of contributions are especially welcome: reusable infrastructure for polars of convex sets relative to a subspace and for sublinear functions on submodules, and a proof of Theorem 28.

Selected references

  • A. Basu, M. Conforti, G. Cornuéjols, G. Zambelli, Maximal lattice-free convex sets in linear subspaces, Math. Oper. Res. 35(3), 2010; arXiv:1701.06543v1. https://arxiv.org/abs/1701.06543v1
  • A. Basu, G. Cornuéjols, G. Zambelli, Convex sets and minimal sublinear functions, J. Convex Anal. 18(2), 2011 (reference [9]).
  • V. Borozan, G. Cornuéjols, Minimal valid inequalities for integer constraints, Math. Oper. Res. 34(3), 2009. https://doi.org/10.1287/moor.1090.0400
  • K. Andersen, Q. Louveaux, R. Weismantel, L. Wolsey, Inequalities from two rows of a simplex tableau, IPCO 2007. https://doi.org/10.1007/978-3-540-72792-7_1
  • E. Balas, Intersection cuts — a new type of cutting planes for integer programming, Oper. Res. 19, 1971. https://doi.org/10.1287/opre.19.1.19
  • R. E. Gomory, Some polyhedra related to combinatorial problems, Linear Algebra Appl. 2, 1969. https://doi.org/10.1016/0024-3795(69)90017-2
16 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryConvex OptimizationOperations Research·Captain: mikedeng1

Existence of an Equilibrium for a Competitive Economy I: Equilibrium Exists When Every Consumer Can Trade Every GoodResearch Paper

Motivation

Walras (1874) described an economy as a system of simultaneous equations, one per market, and argued that a set of prices clearing all markets exists because the number of equations equals the number of unknowns. Counting equations proves nothing, and the question of whether competitive equilibrium exists at all remained open for eighty years. Wald (1935–36) proved existence in special production models under restrictive assumptions on demand. In 1954 Kenneth Arrow and Gérard Debreu gave the first existence proof for a general model with production, many consumers, convex technologies and preferences given by utility indicators (Econometrica 22 (1954) 265–290); McKenzie published an independent proof for a trade model in the same year (Econometrica 22 (1954) 147–161). The resulting Arrow–Debreu model is the reference model of general equilibrium theory and the starting point of market-equilibrium problems in operations research and algorithmic game theory.

The paper proves two existence theorems. This mission is the first, Theorem I, whose key assumption is that every consumer initially holds a positive amount of every commodity. A second mission treats Theorem II, which replaces that assumption by a weaker condition on labour supply.

Setting

There are l≥1l \ge 1l≥1 commodities; a commodity vector is an element of Rl\mathbb R^lRl, compared componentwise (x≧yx \geqq yx≧y means xh≥yhx_h \ge y_hxh​≥yh​ for all hhh; x>yx > yx>y means xh>yhx_h > y_hxh​>yh​ for all hhh). The inner product is p⋅x=∑hphxhp\cdot x = \sum_h p_h x_hp⋅x=∑h​ph​xh​.

  • Producers j=1,…,nj = 1, \dots, nj=1,…,n each have a production set Yj⊆RlY_j \subseteq \mathbb R^lYj​⊆Rl (outputs positive, inputs negative). The aggregate production set is Y=∑jYjY = \sum_j Y_jY=∑j​Yj​.
  • Consumers i=1,…,mi = 1, \dots, mi=1,…,m each have a consumption set Xi⊆RlX_i \subseteq \mathbb R^lXi​⊆Rl, a utility indicator uiu_iui​ on XiX_iXi​, initial holdings ζi∈Rl\zeta_i \in \mathbb R^lζi​∈Rl, and a share αij\alpha_{ij}αij​ of the profit of producer jjj.

Assumptions I–IV are: (I.a) each YjY_jYj​ is closed, convex and contains 000; (I.b) Y∩Ω={0}Y \cap \Omega = \{0\}Y∩Ω={0} with Ω={x≧0}\Omega = \{x \geqq 0\}Ω={x≧0}; (I.c) Y∩(−Y)={0}Y \cap (-Y) = \{0\}Y∩(−Y)={0}; (II) each XiX_iXi​ is closed, convex and bounded from below; (III.a) uiu_iui​ is continuous on XiX_iXi​; (III.b) no xi∈Xix_i \in X_ixi​∈Xi​ is a satiation point; (III.c) if ui(xi)>ui(xi′)u_i(x_i) > u_i(x_i')ui​(xi​)>ui​(xi′​) and 0<t<10 < t < 10<t<1 then ui[txi+(1−t)xi′]>ui(xi′)u_i[t x_i + (1-t) x_i'] > u_i(x_i')ui​[txi​+(1−t)xi′​]>ui​(xi′​); (IV.a) some xi∈Xix_i \in X_ixi​∈Xi​ satisfies xi<ζix_i < \zeta_ixi​<ζi​; (IV.b) αij≥0\alpha_{ij} \ge 0αij​≥0 and ∑iαij=1\sum_i \alpha_{ij} = 1∑i​αij​=1.

A competitive equilibrium is a tuple (x1∗,…,xm∗,y1∗,…,yn∗,p∗)(x_1^*, \dots, x_m^*, y_1^*, \dots, y_n^*, p^*)(x1∗​,…,xm∗​,y1∗​,…,yn∗​,p∗) such that

  1. each yj∗y_j^*yj∗​ maximizes p∗⋅yjp^*\cdot y_jp∗⋅yj​ over YjY_jYj​;
  2. each xi∗x_i^*xi∗​ maximizes uiu_iui​ over {xi∈Xi:p∗⋅xi≦p∗⋅ζi+∑jαij p∗⋅yj∗}\{x_i \in X_i : p^*\cdot x_i \leqq p^*\cdot\zeta_i + \sum_j \alpha_{ij}\, p^*\cdot y_j^*\}{xi​∈Xi​:p∗⋅xi​≦p∗⋅ζi​+∑j​αij​p∗⋅yj∗​};
  3. p∗∈P={p≧0:∑hph=1}p^* \in P = \{p \geqq 0 : \sum_h p_h = 1\}p∗∈P={p≧0:∑h​ph​=1};
  4. z∗=∑ixi∗−∑jyj∗−∑iζiz^* = \sum_i x_i^* - \sum_j y_j^* - \sum_i \zeta_iz∗=∑i​xi∗​−∑j​yj∗​−∑i​ζi​ satisfies z∗≦0z^* \leqq 0z∗≦0 and p∗⋅z∗=0p^*\cdot z^* = 0p∗⋅z∗=0.

An abstract economy (§2) is a game in which each player's feasible set Aι(aˉι)A_\iota(\bar a_\iota)Aι​(aˉι​) depends on the other players' actions aˉι\bar a_\iotaaˉι​; an equilibrium point is a profile at which every player maximizes its pay-off over its feasible set. The proof builds an abstract economy EEE with the consumers, the producers and a fictitious market participant who chooses p∈Pp \in Pp∈P and receives p⋅zp\cdot zp⋅z, and a truncated version E~\tilde EE~ in which all choices are restricted to a large cube CCC.

Formalization targets

Goal: Theorem I

Assumptions I–IV  ⟹  ∃ (x∗,y∗,p∗) satisfying Conditions 1–4.\text{Assumptions I–IV} \implies \exists\, (x^*, y^*, p^*) \text{ satisfying Conditions 1–4.}Assumptions I–IV⟹∃(x∗,y∗,p∗) satisfying Conditions 1–4.

The statement fixes no constants; its only added hypothesis is l≥1l \ge 1l≥1.

Milestones

In the order of the paper's argument:

  1. §1.3.1: under II, III.a and III.c, each uiu_iui​ is quasi-concave on XiX_iXi​.
  2. §1.4.2 (1): Condition 2 together with II, III.b and III.c gives p∗⋅xi∗=p∗⋅ζi+∑jαij p∗⋅yj∗p^*\cdot x_i^* = p^*\cdot\zeta_i + \sum_j \alpha_{ij}\, p^*\cdot y_j^*p∗⋅xi∗​=p∗⋅ζi​+∑j​αij​p∗⋅yj∗​.
  3. Lemma 2.5: an abstract economy with compact convex action sets, continuous pay-offs that are quasi-concave in the player's own action, and continuous constraint correspondences with closed graphs and nonempty convex values has an equilibrium point.
  4. §3.1.2 (2): at an equilibrium point of EEE, Condition 2 holds.
  5. §3.2: every equilibrium point of EEE is a competitive equilibrium.
  6. §3.3.1 (7) and §3.3.2 (2): the attainable sets Y^j\hat Y_jY^j​ and X^i\hat X_iX^i​ (choices compatible with z≦0z \leqq 0z≦0) are bounded.
  7. Remark §3.3.5: if p⋅ζi>min⁡X~ip⋅xip\cdot\zeta_i > \min_{\tilde X_i} p\cdot x_ip⋅ζi​>minX~i​​p⋅xi​, the truncated budget correspondence A~i\tilde A_iA~i​ is continuous at that point.
  8. §3.4.0: for a cube CCC containing every X^i\hat X_iX^i​ and Y^j\hat Y_jY^j​ in its interior, E~\tilde EE~ has an equilibrium point.
  9. §3.4.1: every equilibrium point of E~\tilde EE~ is an equilibrium point of EEE.

Significance

Theorem I shows that the competitive model is consistent: under convexity, continuity, non-satiation and survival assumptions, prices exist at which profit maximization, utility maximization and market clearing hold simultaneously. The welfare theorems, comparative statics, and algorithms that compute equilibria (Scarf's method, market-equilibrium algorithms) presuppose it. Lemma 2.5, Debreu's social-equilibrium theorem (PNAS 38 (1952) 886–893), is also used on its own for generalized Nash equilibrium problems with coupled constraints.

The theorem is proved and textbook material (Debreu, Theory of Value, 1959). To the best of the catalog search, no proof assistant library contains Theorem I, Lemma 2.5, or a Kakutani-type fixed-point theorem for correspondences; on this platform the only related results are Brouwer's fixed-point theorem (AGT.brouwer_fixed_point, proved) and Nash's theorem for finite games (AGT.nash_existence), a special case of Lemma 2.5 with constant constraint sets. The mission produces a machine-checked proof of the paper's argument and, along the way, reusable statements about abstract economies and their equilibria.

Difficulty

The central difficulty is Lemma 2.5. The paper does not prove it but cites Debreu (1952), whose proof uses the Eilenberg–Montgomery fixed-point theorem for correspondences with contractible values. Brouwer's theorem alone does not suffice: the best-response correspondence of an abstract economy is set-valued, and its closed graph must be established from the continuity of the feasible-set correspondences, which is a maximum-theorem argument that Mathlib does not contain. A Kakutani-type fixed-point theorem, or an approximation argument reducing to Brouwer, is needed.

A second difficulty is non-compactness. The economy EEE has unbounded action sets, so the Lemma does not apply to it directly. The boundedness of the attainable sets (§3.3.1) is an asymptotic argument using the irreversibility and no-free-production assumptions I.b and I.c, and the passage from E~\tilde EE~ back to EEE (§3.4.1) needs the attainable choices to lie in the interior of the cube, so that local optimality implies global optimality through III.c. A fixed-point argument on an excess-demand function does not apply directly: demand need not be single-valued or even defined at every price.

Formalization scope

Commodity space is Fin l → ℝ with its componentwise order; the paper's strict vector inequality is written coordinatewise (∀ h, x h < ζ i h), not with the order-theoretic strict inequality on functions. Consumers are Fin m, producers Fin n, and the players of EEE are Fin m ⊕ Fin n ⊕ Unit. Utilities are total functions, and every assumption on them quantifies over XiX_iXi​ only. "Maximizes" is always written as membership plus an inequality against every feasible alternative, never through a supremum. Continuity of a constraint correspondence is the paper's sequential definition (§2.4), a lower-hemicontinuity condition, required at every point of the other players' action space; convergence is asked only in the other players' coordinates.

Two hypotheses are made explicit because the formal statements would otherwise be false: Theorem I and §3.4.0 assume l≥1l \ge 1l≥1 (for l=0l = 0l=0 the price simplex is empty), and Lemma 2.5 assumes every action set nonempty (otherwise, with two or more players and all action sets empty, every hypothesis holds vacuously). The Remark of §3.3.5 carries, as a hypothesis, the nonemptiness of A~i\tilde A_iA~i​ established in §3.3.4. A formalization that makes Theorem I trivial, for instance by taking PPP to contain 000, by reading IV.a with the order-theoretic strict inequality, or by allowing an empty commodity space, is ruled out by these definitions.

A complete development needs: Kakutani's fixed-point theorem (or a Brouwer-based substitute) for compact convex subsets of Rl\mathbb R^lRl; Berge's maximum theorem for the best-response correspondence; the asymptotic-cone argument for §3.3.1; and elementary convex analysis for the budget sets. The abstract-economy definitions and Lemma 2.5 are reusable beyond this mission, including by the Theorem II mission. Contributions of any of these components are welcome, as are alternative proofs of Lemma 2.5.

Selected references

  • K. J. Arrow and G. Debreu, Existence of an Equilibrium for a Competitive Economy, Econometrica 22(3) (1954) 265–290. https://doi.org/10.2307/1907353
  • G. Debreu, A Social Equilibrium Existence Theorem, Proceedings of the National Academy of Sciences 38(10) (1952) 886–893. https://doi.org/10.1073/pnas.38.10.886
  • L. W. McKenzie, On Equilibrium in Graham's Model of World Trade and Other Competitive Systems, Econometrica 22(2) (1954) 147–161. https://doi.org/10.2307/1907539
  • J. Nash, Equilibrium Points in n-Person Games, Proceedings of the National Academy of Sciences 36(1) (1950) 48–49. https://doi.org/10.1073/pnas.36.1.48
  • S. Kakutani, A Generalization of Brouwer's Fixed Point Theorem, Duke Mathematical Journal 8(3) (1941) 457–459. https://doi.org/10.1215/S0012-7094-41-00838-4
  • G. Debreu, Theory of Value: An Axiomatic Analysis of Economic Equilibrium, Wiley, 1959 (Cowles Foundation Monograph 17).
16 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchProbability·Captain: mikedeng1

Dual Stochastic Dominance and Related Mean-Risk Models 1: Second-Degree Stochastic Dominance Is Dominance of Absolute Lorenz CurvesResearch Paper

Motivation

Comparing uncertain outcomes is the basic problem of decision making under risk. Second-degree stochastic dominance (SSD) is the comparison that every risk-averse decision maker who prefers larger outcomes agrees with: XXX dominates YYY in this sense exactly when E U(X)≥E U(Y)\mathbb E\,U(X)\ge\mathbb E\,U(Y)EU(X)≥EU(Y) for every nondecreasing concave utility UUU for which the expectations are finite. The relation grew out of majorization theory for finite distributions (Hardy, Littlewood and Pólya) and was extended to general distributions by Rothschild and Stiglitz and by Hadar and Russell around 1970; it is the standard consistency requirement for portfolio models and for risk measures in operations research and finance.

SSD is defined through the distribution function, which is awkward in optimization: portfolio returns are linear in the decision variables, but their distribution functions are not. Ogryczak and Ruszczyński (SIAM J. Optim. 13 (2002) 60–78) showed that SSD has an equivalent dual description through the integrated quantile function, the absolute Lorenz curve, and that the two descriptions are related by Fenchel conjugation. That dual description underlies the later theory of SSD-constrained optimization (Dentcheva and Ruszczyński, SIAM J. Optim. 14 (2003)) and the use of conditional value-at-risk as an SSD-consistent risk measure.

Setting

Fix a probability space (Ω,B,P)(\Omega,\mathcal B,\mathbb P)(Ω,B,P) and real random variables X,Y:Ω→RX,Y:\Omega\to\mathbb RX,Y:Ω→R with E∣X∣<∞\mathbb E|X|<\inftyE∣X∣<∞, E∣Y∣<∞\mathbb E|Y|<\inftyE∣Y∣<∞.

  • The distribution function is FX(η)=P{X≤η}F_X(\eta)=\mathbb P\{X\le\eta\}FX​(η)=P{X≤η} (Lean: distFun P X).
  • The second performance function is the area below it, FX(2)(η)=∫−∞ηFX(ξ) dξF_X^{(2)}(\eta)=\int_{-\infty}^{\eta}F_X(\xi)\,d\xiFX(2)​(η)=∫−∞η​FX​(ξ)dξ (secondPerformance P X, eq. (2.1)).
  • SSD: X⪰SSDYX\succeq_{SSD}YX⪰SSD​Y iff FX(2)(η)≤FY(2)(η)F_X^{(2)}(\eta)\le F_Y^{(2)}(\eta)FX(2)​(η)≤FY(2)​(η) for every η∈R\eta\in\mathbb Rη∈R (SSD P X Y, eq. (2.2)). The dominating variable has the smaller curve.
  • The first quantile function is the left-continuous inverse FX(−1)(p)=inf⁡{η:FX(η)≥p}F_X^{(-1)}(p)=\inf\{\eta:F_X(\eta)\ge p\}FX(−1)​(p)=inf{η:FX​(η)≥p}, 0<p≤10<p\le10<p≤1 (leftQuantile P X). A number qqq is a ppp-quantile if P{X<q}≤p≤P{X≤q}\mathbb P\{X<q\}\le p\le\mathbb P\{X\le q\}P{X<q}≤p≤P{X≤q} (IsPQuantile P X p q).
  • The second quantile function (absolute Lorenz curve) FX(−2):R→R‾F_X^{(-2)}:\mathbb R\to\overline{\mathbb R}FX(−2)​:R→R is FX(−2)(p)=∫0pFX(−1)(α) dαF_X^{(-2)}(p)=\int_0^pF_X^{(-1)}(\alpha)\,d\alphaFX(−2)​(p)=∫0p​FX(−1)​(α)dα for 0≤p≤10\le p\le10≤p≤1 and +∞+\infty+∞ otherwise (secondQuantile P X, eq. (3.2)).
  • The convex conjugate of F:R→R‾F:\mathbb R\to\overline{\mathbb R}F:R→R is F∗(p)=sup⁡ξ{pξ−F(ξ)}F^*(p)=\sup_\xi\{p\xi-F(\xi)\}F∗(p)=supξ​{pξ−F(ξ)} (conj F), and ∂f(η)\partial f(\eta)∂f(η) is the subdifferential of a real function fff at η\etaη (subdiff f η).

Formalization targets

Goal: Theorem 3.2

X⪰SSDY  ⟺  FX(−2)(p)≥FY(−2)(p)for all 0≤p≤1.X\succeq_{SSD}Y\iff F_X^{(-2)}(p)\ge F_Y^{(-2)}(p)\quad\text{for all }0\le p\le1.X⪰SSD​Y⟺FX(−2)​(p)≥FY(−2)​(p)for all 0≤p≤1.

Both directions are required, and the range of ppp includes both endpoints (at p=1p=1p=1 the right-hand side contains EX≥EY\mathbb EX\ge\mathbb EYEX≥EY).

Milestones, in the order the argument uses them

  1. (2.4): FX(2)(η)=∫−∞η(η−ξ) PX(dξ)=Emax⁡(η−X,0)F_X^{(2)}(\eta)=\int_{-\infty}^{\eta}(\eta-\xi)\,P_X(d\xi)=\mathbb E\max(\eta-X,0)FX(2)​(η)=∫−∞η​(η−ξ)PX​(dξ)=Emax(η−X,0).
  2. §2, p. 62: FX(2)F_X^{(2)}FX(2)​ is continuous, convex, nonnegative and nondecreasing.
  3. §3, p. 64: for p∈(0,1)p\in(0,1)p∈(0,1) the ppp-quantiles form a closed interval with left end FX(−1)(p)F_X^{(-1)}(p)FX(−1)​(p).
  4. (3.3): ∂FX(2)(η)=[P{X<η},P{X≤η}]\partial F_X^{(2)}(\eta)=[\mathbb P\{X<\eta\},\mathbb P\{X\le\eta\}]∂FX(2)​(η)=[P{X<η},P{X≤η}] for every η\etaη.
  5. Theorem 3.1(i): FX(−2)=[FX(2)]∗F_X^{(-2)}=[F_X^{(2)}]^*FX(−2)​=[FX(2)​]∗ on all of R\mathbb RR.
  6. Theorem 3.1(ii): FX(2)=[FX(−2)]∗F_X^{(2)}=[F_X^{(-2)}]^*FX(2)​=[FX(−2)​]∗ on all of R\mathbb RR.

A companion item, Corollary 3.3, states the four equivalent characterizations of a ppp-quantile (quantile condition, attainment in either conjugate, and the Fenchel–Young equality FX(−2)(p)+FX(2)(η)=pηF_X^{(-2)}(p)+F_X^{(2)}(\eta)=p\etaFX(−2)​(p)+FX(2)​(η)=pη).

Significance

Theorem 3.2 converts a condition on distribution functions into a condition on integrated quantiles. Its consequences in the paper include the SSD consistency of the mean–risk models built on tail means (conditional value-at-risk), on the Gini mean difference and on the mean absolute deviation from a quantile, and the linear-programming representations of those models for finitely many scenarios; the companion mission Dual Stochastic Dominance and Related Mean-Risk Models 2 builds on the same objects. Theorem 3.1 is the precise statement that FX(2)F_X^{(2)}FX(2)​ and FX(−2)F_X^{(-2)}FX(−2)​ form a conjugate pair; Corollary 3.3 identifies the subgradients of each with the quantiles of XXX.

All results here are proved in the paper, and the quantile characterization of the increasing concave order also appears in the stochastic-orders literature. None of them is formalized: Mathlib at the pinned revision has ProbabilityTheory.cdf but no convex conjugate on the extended reals, no subdifferential of a real function, no quantile function and no stochastic dominance. The mission produces a machine-checked account of the quantile side of SSD, with the conjugacy stated exactly, including the value +∞+\infty+∞ off [0,1][0,1][0,1].

Difficulty

The naive route to Theorem 3.2 compares FX(2)F_X^{(2)}FX(2)​ and FY(2)F_Y^{(2)}FY(2)​ through the quantile functions directly, but the first quantiles F(−1)F^{(-1)}F(−1) need not be ordered when X⪰SSDYX\succeq_{SSD}YX⪰SSD​Y (the paper notes this on p. 65), so no pointwise argument on quantiles works. The equivalence rests on Theorem 3.1, and there the hard part is computing the conjugate of FX(2)F_X^{(2)}FX(2)​ for a general distribution: atoms of XXX make FX(2)F_X^{(2)}FX(2)​ nondifferentiable and flat pieces of FXF_XFX​ make the maximizer non-unique, so the subdifferential (3.3) and the interval of ppp-quantiles must be handled as sets, and the endpoints p=0,1p=0,1p=0,1 (where the supremum need not be attained) and p∉[0,1]p\notin[0,1]p∈/[0,1] (where it is +∞+\infty+∞) must be treated separately. Part (ii) is a biconjugation statement for a closed convex function, whose general form is not in Mathlib.

Formalization scope

  • One probability space (Ω, P) with [IsProbabilityMeasure P] carries both XXX and YYY; nothing depends on anything but the laws, and no independence is assumed.
  • FX(η)F_X(\eta)FX​(η) is P.real {ω | X ω ≤ η}; FX(2)F_X^{(2)}FX(2)​ is a Bochner integral over Set.Iic η; FX(−2)F_X^{(-2)}FX(−2)​ is an interval integral over (0,p](0,p](0,p], placed in EReal, with ⊤ off [0,1][0,1][0,1].
  • The conjugate is ⨆ ξ, ((p * ξ : ℝ) : EReal) - F ξ in the complete lattice EReal, so terms where F=+∞F=+\inftyF=+∞ contribute −∞-\infty−∞, exactly the paper's convention.
  • Standing assumption. Every item using F(2)F^{(2)}F(2) or F(−2)F^{(-2)}F(−2) assumes Integrable X P (and Integrable Y P in the goal). This is the paper's own hypothesis E∣X∣<∞\mathbb E|X|<\inftyE∣X∣<∞ (p. 65, and the hypothesis of Theorem 3.1), not a repair. The ppp-quantile milestone assumes only AEMeasurable X P.
  • Quantile at p=1p=1p=1. FX(−1)F_X^{(-1)}FX(−1)​ is a real sInf. It is the true infimum for 0<p<10<p<10<p<1; at p=1p=1p=1 the paper's value can be +∞+\infty+∞ while sInf ∅ = 0. This one point does not affect (3.2), and no item states anything about FX(−1)(1)F_X^{(-1)}(1)FX(−1)​(1).
  • Omitted. The conditional-expectation form P{X≤η} E{η−X∣X≤η}\mathbb P\{X\le\eta\}\,\mathbb E\{\eta-X\mid X\le\eta\}P{X≤η}E{η−X∣X≤η} in (2.4) is not stated, since it is undefined when P{X≤η}=0\mathbb P\{X\le\eta\}=0P{X≤η}=0.
  • Trivializing encodings are ruled out. F(2)F^{(2)}F(2) is defined by (2.1), not as Emax⁡(η−X,0)\mathbb E\max(\eta-X,0)Emax(η−X,0), and F(−2)F^{(-2)}F(−2) by (3.2), not as a conjugate; either shortcut would make a milestone or Theorem 3.1 true by definition.
  • Infrastructure and reuse. Welcome contributions: the extended-real conjugate and Fenchel–Young inequality on R\mathbb RR, biconjugation of closed convex functions of one variable, subdifferentials of integrals of monotone functions, and the basic theory of left quantiles (the quantile transform FX(−1)(U)∼XF_X^{(-1)}(U)\sim XFX(−1)​(U)∼X). These are reusable beyond this mission, in particular by mission 2 of this series and by any formalization of conditional value-at-risk. The platform's VectorSpaceOpt.fenchel_biconjugate_on and ConvexOptimization.fenchelConjugate concern real-valued conjugates on other spaces and are related but not reused.

Selected references

  • W. Ogryczak, A. Ruszczyński, Dual stochastic dominance and related mean-risk models, SIAM J. Optim. 13(1) (2002) 60–78. https://doi.org/10.1137/S1052623400375075
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970 (Theorems 12.2 and 23.5 are used in the paper's proofs). https://doi.org/10.1515/9781400873173
  • M. Rothschild, J. E. Stiglitz, Increasing risk: I. A definition, J. Econom. Theory 2 (1970) 225–243. https://doi.org/10.1016/0022-0531(70)90038-4
  • J. Hadar, W. R. Russell, Rules for ordering uncertain prospects, Amer. Econom. Rev. 59 (1969) 25–34. https://www.jstor.org/stable/1811090
  • D. Dentcheva, A. Ruszczyński, Optimization with stochastic dominance constraints, SIAM J. Optim. 14(2) (2003) 548–566. https://doi.org/10.1137/S1052623402420528
  • M. Shaked, J. G. Shanthikumar, Stochastic Orders, Springer, 2007. https://doi.org/10.1007/978-0-387-34675-5
10 thms2 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

An Interactive Weighted Tchebycheff Procedure for Multiple Objective Programming I: In the Finite Case the Augmented Weighted Tchebycheff Program Characterizes the Nondominated SetResearch Paper

Motivation

A decision problem with several conflicting objectives, such as cost, risk and service level, has no single optimum. What it has is a set of nondominated outcomes: those that cannot be improved in one objective without being worsened in another. Interactive methods of multiple objective programming search this set with a decision-maker, and at each step they need a computational device that returns nondominated outcomes and can return any of them.

The classical device, maximizing a weighted sum of the objectives, fails the second requirement. On a nonconvex or discrete outcome set it only reaches the supported nondominated points, those on the boundary of the convex hull, and misses the rest (see, e.g., Boyd and Vandenberghe, Convex Optimization, §4.7.4, where the weighted-sum approach is shown to be sufficient but not necessary for Pareto optimality). Steuer and Choo (Math. Programming 26 (1983) 326–344) replaced the weighted sum by a weighted Tchebycheff distance to an ideal point, augmented by a small linear term. Their procedure became one of the standard interactive methods of the field, and the augmented Tchebycheff scalarization is now a standard tool in multiobjective integer programming and in the generation of nondominated sets.

Timeline, as recorded in the paper's own references. Dinkelbach and Dürr (1972) showed, in the linear case, that among the minimizers of a weighted Tchebycheff program there is always a nondominated one (the paper's Theorem 3.1 extends this to the discrete case). Bowman (Lecture Notes in Economics and Mathematical Systems, as cited by the paper) related the Tchebycheff norm to the efficient frontier of multiple-criteria problems. Choo and Atkins (Computers and Operations Research 7, 1980) and Choo's dissertation (1980) developed interactive weighted Tchebycheff algorithms. Steuer and Choo (1983) added the augmentation term ρ eT(z∗−z)\rho\,e^{\mathsf T}(z^*-z)ρeT(z∗−z), gave an explicit choice of the weights and of ρ\rhoρ in the discrete case, and proved that the resulting program characterizes the nondominated set exactly (Theorem 3.7).

Setting

There are k≥1k \ge 1k≥1 objectives to be maximized. The set of attainable criterion vectors is a finite set Z⊂RkZ \subset \mathbb R^kZ⊂Rk (in the paper, ZZZ is the image of a discrete feasible set SSS under the objectives f1,…,fkf_1,\dots,f_kf1​,…,fk​). A vector zzz dominates zˉ\bar zzˉ if zi≥zˉiz_i \ge \bar z_izi​≥zˉi​ for all iii and zi>zˉiz_i > \bar z_izi​>zˉi​ for at least one iii. The nondominated set N⊆ZN \subseteq ZN⊆Z consists of the zˉ∈Z\bar z \in Zzˉ∈Z that no z∈Zz \in Zz∈Z dominates.

An ideal criterion vector z∗∈Rkz^* \in \mathbb R^kz∗∈Rk has coordinates zi∗=max⁡z∈Zzi+εiz^*_i = \max_{z\in Z} z_i + \varepsilon_izi∗​=maxz∈Z​zi​+εi​ with εi≥0\varepsilon_i \ge 0εi​≥0, where εi\varepsilon_iεi​ must be strictly positive if (i) more than one nondominated vector maximizes objective iii, or (ii) the only nondominated vector maximizing objective iii also maximizes another objective.

Weights range over the simplex Λˉ={λ∈Rk∣λi≥0, ∑iλi=1}\bar\Lambda = \{\lambda \in \mathbb R^k \mid \lambda_i \ge 0,\ \sum_i \lambda_i = 1\}Λˉ={λ∈Rk∣λi​≥0, ∑i​λi​=1}. For a scalar ρ\rhoρ the augmented weighted Tchebycheff program is

min⁡ α+ρ eT(z∗−z)s.t.α≥λi(zi∗−zi), 1≤i≤k,z∈Z,\min\ \alpha + \rho\, e^{\mathsf T}(z^* - z) \quad\text{s.t.}\quad \alpha \ge \lambda_i (z^*_i - z_i),\ 1 \le i \le k,\quad z \in Z,min α+ρeT(z∗−z)s.t.α≥λi​(zi∗​−zi​), 1≤i≤k,z∈Z,

where eee is the vector of ones; at a fixed zzz its value is max⁡iλi(zi∗−zi)+ρ eT(z∗−z)\max_i \lambda_i(z^*_i - z_i) + \rho\,e^{\mathsf T}(z^*-z)maxi​λi​(zi∗​−zi​)+ρeT(z∗−z).

For zp∈Zz^p \in Zzp∈Z the paper defines weights λp\lambda^pλp by (b): λip∝1/(zi∗−zip)\lambda^p_i \propto 1/(z^*_i - z^p_i)λip​∝1/(zi∗​−zip​), normalized to sum to one, when zip≠zi∗z^p_i \ne z^*_izip​=zi∗​ for all iii; otherwise λp\lambda^pλp puts weight 111 on the coordinates where zip=zi∗z^p_i = z^*_izip​=zi∗​ and 000 elsewhere. With αpq=max⁡iλip(zi∗−ziq)\alpha_{pq} = \max_i \lambda^p_i (z^*_i - z^q_i)αpq​=maxi​λip​(zi∗​−ziq​) it sets

ρ=12min⁡zi∈N, zj∈Z{αij−αiieT(zj−zi)  ∣  eT(zj−zi)>0}.(3.8)\rho = \tfrac12 \min_{z^i \in N,\ z^j \in Z}\Big\{\frac{\alpha_{ij} - \alpha_{ii}}{e^{\mathsf T}(z^j - z^i)} \;\Big|\; e^{\mathsf T}(z^j - z^i) > 0\Big\}. \tag{3.8}ρ=21​zi∈N, zj∈Zmin​{eT(zj−zi)αij​−αii​​​eT(zj−zi)>0}.(3.8)

Formalization targets

Goal: Theorem 3.7

For every zp∈Zz^p \in Zzp∈Z,

zp∈N  ⟺  ∃λ∈Λˉ  ∀z∈Z: max⁡iλi(zi∗−zip)+ρ eT(z∗−zp)≤max⁡iλi(zi∗−zi)+ρ eT(z∗−z),z^p \in N \iff \exists \lambda \in \bar\Lambda\ \ \forall z \in Z:\ \max_i \lambda_i(z^*_i - z^p_i) + \rho\, e^{\mathsf T}(z^*-z^p) \le \max_i \lambda_i(z^*_i - z_i) + \rho\, e^{\mathsf T}(z^*-z),zp∈N⟺∃λ∈Λˉ  ∀z∈Z: imax​λi​(zi∗​−zip​)+ρeT(z∗−zp)≤imax​λi​(zi∗​−zi​)+ρeT(z∗−z),

with ρ\rhoρ from (3.8). One coefficient ρ\rhoρ, computed from ZZZ and z∗z^*z∗ alone, works for the whole nondominated set.

Milestones, in the order of the paper

  1. Theorem 3.1. For any λ∈Λˉ\lambda \in \bar\Lambdaλ∈Λˉ, some minimizer of the (unaugmented) weighted Tchebycheff program over ZZZ is nondominated.
  2. Lemma 3.2 (corrected). For zp∈Nz^p \in Nzp∈N and zq∈Zz^q \in Zzq∈Z with zq≠zpz^q \ne z^pzq=zp and zq≰zpz^q \not\le z^pzq≤zp, zqz^qzq lies outside the level set Φ(αpp)\Phi(\alpha_{pp})Φ(αpp​).
  3. Lemma 3.3 (corrected). Under the same hypotheses, αpp<αpq\alpha_{pp} < \alpha_{pq}αpp​<αpq​.
  4. ρp>0\rho_p > 0ρp​>0, the first step of the proof of Theorem 3.4, for the single-vector coefficient ρp\rho_pρp​ of (3.6).
  5. Theorem 3.4. Each zp∈Nz^p \in Nzp∈N is the unique minimizer of the augmented program with weights λp\lambda^pλp and coefficient ρp\rho_pρp​.
  6. Corollary 3.9. The same with the common ρ\rhoρ of (3.8), and λp∈Λˉ\lambda^p \in \bar\Lambdaλp∈Λˉ.

Printed Lemmas 3.2 and 3.3 are false. For Z={(5,3),(5,1),(1,10)}Z = \{(5,3), (5,1), (1,10)\}Z={(5,3),(5,1),(1,10)} and z∗=(5,10)z^* = (5,10)z∗=(5,10), which is ideal with ε=0\varepsilon = 0ε=0, the nondominated vector zp=(5,3)z^p = (5,3)zp=(5,3) has λp=(1,0)\lambda^p = (1,0)λp=(1,0) and αpp=0\alpha_{pp} = 0αpp​=0, while the dominated vector zq=(5,1)z^q = (5,1)zq=(5,1) lies in Φ(0)={z∣z1≥5}\Phi(0) = \{z \mid z_1 \ge 5\}Φ(0)={z∣z1​≥5} and has αpq=0\alpha_{pq} = 0αpq​=0. The proof's second case assumes that only zpz^pzp reaches zj∗z^*_jzj∗​ in coordinate jjj, but the ε\varepsilonε-rule constrains nondominated vectors only. The mission states both lemmas with the added hypothesis zq≰zpz^q \not\le z^pzq≤zp, under which they hold; the milestone texts are the printed ones. Theorems 3.4, 3.7 and Corollary 3.9 are unaffected, since for zq≤zpz^q \le z^pzq≤zp, zq≠zpz^q \ne z^pzq=zp the augmentation term separates zqz^qzq from zpz^pzp on its own. Hypothesis (a) of the paper also contains the misprint "zq≠zqz^q \ne z^qzq=zq" for zq≠zpz^q \ne z^pzq=zp.

Significance

Theorem 3.7 says that the augmented weighted Tchebycheff program, with a computable ρ\rhoρ, is an exact scalarization of the discrete multiple objective program. It returns only nondominated vectors (unlike the plain Tchebycheff program, whose optima can be weakly dominated) and it can return every nondominated vector, including unsupported ones (unlike weighted sums). Corollary 3.9 adds that each nondominated vector is the unique optimum for a suitable weight, so it is found even by a solver that stops at the first optimum. These facts underlie the interactive Tchebycheff procedure of the paper's §5 and a large body of later work on generating nondominated sets of multiobjective integer programs.

The results are proved in the paper; to our knowledge none has been machine-checked. The mission produces a checked version with the two lemmas of the paper's proof chain corrected, a precise treatment of the ideal-vector rule, and an explicit ρ\rhoρ. Alternative proofs, for instance one for the goal that avoids the explicit ρ\rhoρ of (3.8), are welcome.

Difficulty

The ⇐ direction is short. The work is in ⇒: the explicit weights λp\lambda^pλp must be shown to lie in Λˉ\bar\LambdaΛˉ and to make zpz^pzp strictly better than every competitor that is not below it. Both depend on the ε\varepsilonε-rule for z∗z^*z∗, whose role is subtle: it forbids two coordinates of a nondominated vector from reaching z∗z^*z∗, and forbids two nondominated vectors from sharing a coordinate equal to zj∗z^*_jzj∗​, but it says nothing about dominated vectors. The paper's own argument overlooks exactly those dominated vectors, so a proof that follows the printed Lemma 3.2 literally will fail; the gap is closed only by combining the corrected lemma with the augmentation term. Choosing a single ρ\rhoρ for all of NNN also requires that every quotient in (3.8) be strictly positive.

Formalization scope

Criterion vectors are Fin k → ℝ (objective indices 0,…,k−10,\dots,k-10,…,k−1), ZZZ is a Finset, and k≥1k \ge 1k≥1 is imposed as [NeZero k]. The decision set SSS, the objectives fif_ifi​ and the program variable α\alphaα are eliminated: the programs are stated over ZZZ, and α\alphaα is replaced by its minimal value max⁡iλi(zi∗−zi)\max_i \lambda_i(z^*_i - z_i)maxi​λi​(zi∗​−zi​). The programs use zi∗−ziz^*_i - z_izi∗​−zi​ without absolute values, as printed; on ZZZ this equals the metric's ∣zi∗−zi∣|z^*_i - z_i|∣zi∗​−zi​∣ when z∗z^*z∗ is ideal. "zzz minimizes the program" means that zzz minimizes the value over ZZZ, and "uniquely minimizes" means that every other element of ZZZ has a strictly larger value. Λˉ\bar\LambdaΛˉ is Mathlib's stdSimplex ℝ (Fin k).

The ideal vector is encoded with its full ε\varepsilonε-rule, not as "z∗>zz^* > zz∗>z for all z∈Zz \in Zz∈Z"; the latter would exclude the paper's case where zpz^pzp touches z∗z^*z∗ in one coordinate. The minima in (3.6) and (3.8) can range over empty sets (e.g. Z=N={zp}Z = N = \{z^p\}Z=N={zp}); the paper assigns them no value, and the formalization sets ρp\rho_pρp​, ρ\rhoρ to 111 then. A value of 000 would make the goal's ⇒ direction false, so no formalization may rely on Lean's default for an empty minimum. Theorem 3.1 is stated for an arbitrary reference vector z∗z^*z∗, since it needs no ideal-vector hypothesis. The paper's "Let NNN be finite" in Theorem 3.7 is taken as "ZZZ finite", which is what (3.8) and the proof require.

A trivializing formalization would take ρ=0\rho = 0ρ=0 or leave λ\lambdaλ unconstrained; both are excluded, since ρ\rhoρ is the specific value (3.8) and λ\lambdaλ ranges over Λˉ\bar\LambdaΛˉ.

The definitions (dominance, NNN, ideal vector, Tchebycheff values, Φ\PhiΦ, the weights and coefficients of §3) are reusable for the continuous and polyhedral cases of the paper's §4 and for other scalarization results. Contributions of proofs of any milestone are welcome.

Selected references

  • R. E. Steuer and E.-U. Choo, An Interactive Weighted Tchebycheff Procedure for Multiple Objective Programming, Mathematical Programming 26 (1983) 326–344. https://doi.org/10.1007/BF02591870
  • W. Dinkelbach and W. Dürr, Effizienzaussagen bei Ersatzprogrammen zum Vektormaximumproblem, in: R. Henn, H. P. Künzi and H. Schubert (eds.), Operations Research Verfahren XII, Anton Hain, Meisenheim, 1972, 117–123 (reference [4] of the paper; no online version known).
  • V. J. Bowman, On the Relationship of the Tchebycheff Norm and the Efficient Frontier of Multiple-Criteria Objectives, Lecture Notes in Economics and Mathematical Systems, Springer (reference [1] of the paper).
  • E.-U. Choo and D. R. Atkins, An Interactive Algorithm for Multicriteria Programming, Computers and Operations Research 7 (1980) 81–87 (reference [3] of the paper).
  • S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004, §4.7.4. https://web.stanford.edu/~boyd/cvxbook/
11 thms2 active usersReviewed
PreviousPage 33 of 37Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me