Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Optimization

1,800 missions · 1,054 completed

Missions

Open746Completed1054All1800
Operations ResearchProbability·Captain: mikedeng1

Mitigating Supply Risk: Dual Sourcing or Process Improvement? 3: Late Commitment Strictly Beats Early Commitment When the Costlier Supplier's Improved Gain Exceeds mz/(θ(1−θ))Research Paper

Motivation

Firms that buy from unreliable suppliers can protect themselves in two ways: they can spread orders across several suppliers, or they can invest in improving a supplier's reliability, for example through supplier-development programmes or joint process-improvement projects. Wang, Gilland and Tomlin (MSOM 12(3):489–510, 2010) compare the two strategies in a newsvendor model with random supplier capacity.

This mission formalizes one part of that comparison: single sourcing with improvement, in which improvement efforts may fail. The firm must then decide when to choose its supplier. Under early commitment it picks one supplier, invests in it, and buys from it whatever the outcome. Under late commitment it invests in both suppliers, observes which efforts succeeded, and only then buys from the better one. Empirical work on supplier development documents both practices and the reluctance of suppliers whose improvement efforts previously failed (Handfield et al. 2000, as cited by Wang et al. 2010, p. 496; Krause et al. 2007). The question is how much the option to postpone the choice is worth.

Setting

A firm sells a single product over one season. It earns a unit revenue r≥0r\ge 0r≥0, salvages leftovers at vvv, and pays a penalty p≥0p\ge 0p≥0 per unit of unmet demand, with v<r+pv<r+pv<r+p. Demand XXX is nonnegative with finite mean.

Supplier i∈{1,2}i\in\{1,2\}i∈{1,2} has design capacity Ki>0K_i>0Ki​>0, unit cost ci≥0c_i\ge 0ci​≥0 and committed-cost fraction ηi∈[0,1]\eta_i\in[0,1]ηi​∈[0,1]. Its capacity loss ξi≥0\xi_i\ge 0ξi​≥0 has a continuous distribution Gi(⋅,ai)G_i(\cdot,a_i)Gi​(⋅,ai​) that depends on a reliability index aia_iai​; a higher index means a stochastically smaller loss. An order qi≥0q_i\ge 0qi​≥0 delivers yi=min⁡{qi,(Ki−ξi)+}y_i=\min\{q_i,(K_i-\xi_i)^+\}yi​=min{qi​,(Ki​−ξi​)+}. The firm pays (ηiqi+(1−ηi)yi)ci(\eta_iq_i+(1-\eta_i)y_i)c_i(ηi​qi​+(1−ηi​)yi​)ci​, and the realized profit of single sourcing from iii is

π(qi)=−(ηiqi+(1−ηi)yi)ci+rmin⁡{x,yi}+v(yi−x)+−p(x−yi)+.\pi(q_i)=-(\eta_iq_i+(1-\eta_i)y_i)c_i+r\min\{x,y_i\}+v(y_i-x)^+-p(x-y_i)^+ .π(qi​)=−(ηi​qi​+(1−ηi​)yi​)ci​+rmin{x,yi​}+v(yi​−x)+−p(x−yi​)+.

The second-stage expected profit is Π2(qi;ai)=E[π(qi)]\Pi_2(q_i;a_i)=\mathsf E[\pi(q_i)]Π2​(qi​;ai​)=E[π(qi​)], and Pi(ai)=Π2∗(ai)=sup⁡qi≥0Π2(qi;ai)P_i(a_i)=\Pi_2^*(a_i)=\sup_{q_i\ge 0}\Pi_2(q_i;a_i)Pi​(ai​)=Π2∗​(ai​)=supqi​≥0​Π2​(qi​;ai​) is its optimal value.

Improvement. Supplier iii starts at index ai0a_i^0ai0​. Effort to reach index ai≥ai0a_i\ge a_i^0ai​≥ai0​ costs mizi(ai)m_iz_i(a_i)mi​zi​(ai​), where ziz_izi​ is convex and increasing with zi(ai0)=0z_i(a_i^0)=0zi​(ai0​)=0. The effort succeeds with probability θi\theta_iθi​; on failure the index stays at ai0a_i^0ai0​.

  • Early commitment to supplier iii yields
Π1iE(ai)=−mizi(ai)+θiPi(ai)+(1−θi)Pi(ai0),\Pi_{1i}^E(a_i)=-m_iz_i(a_i)+\theta_iP_i(a_i)+(1-\theta_i)P_i(a_i^0),Π1iE​(ai​)=−mi​zi​(ai​)+θi​Pi​(ai​)+(1−θi​)Pi​(ai0​),

and Π1∗E=max⁡isup⁡ai≥ai0Π1iE(ai)\Pi_1^{*E}=\max_i\sup_{a_i\ge a_i^0}\Pi_{1i}^E(a_i)Π1∗E​=maxi​supai​≥ai0​​Π1iE​(ai​).

  • Late commitment yields Π1L(a1,a2)\Pi_1^L(a_1,a_2)Π1L​(a1​,a2​): the improvement costs, plus, for each of the four success/failure outcomes, its probability times max⁡{P1(⋅),P2(⋅)}\max\{P_1(\cdot),P_2(\cdot)\}max{P1​(⋅),P2​(⋅)} at the realized indices (Eq. (9)). Π1∗L\Pi_1^{*L}Π1∗L​ is its supremum over a1≥a10a_1\ge a_1^0a1​≥a10​, a2≥a20a_2\ge a_2^0a2​≥a20​.

Formalization targets

Goal: Theorem 5

Let the suppliers be identical except for their unit costs, c1≤c2c_1\le c_2c1​≤c2​, with common θ∈(0,1)\theta\in(0,1)θ∈(0,1), mmm, zzz and a0a^0a0, and let a2∗Ea_2^{*E}a2∗E​ be an optimal early-commitment index of supplier 2. Then

[P2(a2∗E)−P1(a10)]+>m z(a2∗E)θ(1−θ)⟹Π1∗L>Π1∗E.\bigl[P_2(a_2^{*E})-P_1(a_1^0)\bigr]^+>\frac{m\,z(a_2^{*E})}{\theta(1-\theta)}\quad\Longrightarrow\quad\Pi_1^{*L}>\Pi_1^{*E}.[P2​(a2∗E​)−P1​(a10​)]+>θ(1−θ)mz(a2∗E​)​⟹Π1∗L​>Π1∗E​.

Milestones, in the paper's order

  1. Lemma 2(b), single-supplier instance: PiP_iPi​ is increasing in the index.
  2. Theorem 4(a), cost-only instance: if the suppliers differ only in unit cost, the cheaper one is preferred with and without improvement, so i∗=j∗i^*=j^*i∗=j∗.
  3. §4.2.2: late commitment weakly dominates early commitment, Π1∗E≤Π1∗L\Pi_1^{*E}\le\Pi_1^{*L}Π1∗E​≤Π1∗L​.
  4. Lemma 4: ai∗L≤ai∗Ea_i^{*L}\le a_i^{*E}ai∗L​≤ai∗E​, in the form valid for non-unique optimizers.
  5. §4.2.2: Π1∗L=Π1∗E\Pi_1^{*L}=\Pi_1^{*E}Π1∗L​=Π1∗E​ if Pi(ai∗E)<Pj(aj0)P_i(a_i^{*E})<P_j(a_j^0)Pi​(ai∗E​)<Pj​(aj0​) for some iii.
  6. Corollary 3(a): strict superiority of late commitment at c1=c^1c_1=\hat c_1c1​=c^1​ persists for every c1∈[c^1,c2]c_1\in[\hat c_1,c_2]c1​∈[c^1​,c2​].

Significance

The results identify when the flexibility of postponing supplier selection has value. Late commitment never hurts. It has no value when one supplier dominates the other, even after the other's improvement. For suppliers that differ only in cost, Theorem 5 gives a checkable sufficient condition for strict value. The condition weighs the gain from switching in the outcome "the costlier supplier improves, the cheaper one does not", which has probability θ(1−θ)\theta(1-\theta)θ(1−θ), against the cost of improving the costlier supplier. Together with Lemma 4 the results say that keeping the choice open lowers the reliability target but can raise expected profit. Corollary 3(a) says this value is easiest to obtain when costs are close.

The paper's proofs are in an online appendix that is not used here, and none of these statements has a machine-checked proof. The mission produces formal versions of the statements, with the hypotheses that the printed versions leave implicit made explicit (see Formalization scope), and invites proofs of them.

Difficulty

The late-commitment profit (9) is a probability-weighted sum of maxima of two optimal-value functions. It is "neither concave nor unimodal" (p. 498), so first-order conditions do not characterize its optimum, and optimizers need not be unique.

  • Order of the arguments. The comparison results rest on the monotonicity of PiP_iPi​ (Lemma 2(b)). That is a statement about a supremum of expectations under a stochastically ordered family of capacity-loss laws, and must be established before the first-stage results can use it.
  • Theorem 5 and Corollary 3(a) compare two suprema, neither of which is assumed to be attained. Strictness has to survive passing to the supremum.
  • Corollary 3(a) is a comparative-statics statement in c1c_1c1​. Both Π1∗L\Pi_1^{*L}Π1∗L​ and Π1∗E\Pi_1^{*E}Π1∗E​ decrease as c1c_1c1​ grows, so nothing pointwise orders their difference.

Formalization scope

Everything is in the namespace MitigateSupplyRisk.LateCommit, with one definition module Model.

  • Model. The demand law is a probability measure μ\muμ on R\mathbb RR with μ(−∞,0)=0\mu(-\infty,0)=0μ(−∞,0)=0 and finite mean; no density is assumed. Capacity losses are a family a↦νaa\mapsto\nu_aa↦νa​ of atomless probability measures on [0,∞)[0,\infty)[0,∞), ordered by νa(−∞,t]≤νa′(−∞,t]\nu_a(-\infty,t]\le\nu_{a'}(-\infty,t]νa​(−∞,t]≤νa′​(−∞,t] for a≤a′a\le a'a≤a′. Loss and demand are independent (a product measure).
  • Optimal values. Π2\Pi_2Π2​ is the Bochner integral of the realized profit (1). Every optimal value is a sSup over the feasible set. The sign conventions r,p,ci≥0r,p,c_i\ge 0r,p,ci​≥0, v<r+pv<r+pv<r+p make these sets bounded above, so no supremum is a junk value, and no optimum is assumed to be attained.
  • Effort. The effort function zzz is taken as the primitive on [a0,∞)[a^0,\infty)[a0,∞), which presumes that every index is reachable.
  • Identical suppliers. "Identical except for unit costs" means that the two suppliers share the same Supplier record (committed cost, capacity, loss family) and the same Improvement record (a0,θ,m,za^0,\theta,m,za0,θ,m,z).
  • Notation in (9). The paper writes Π2∗\Pi_2^*Π2∗​ for both suppliers in (9); the Lean writes P1P_1P1​ and P2P_2P2​.
  • Added or reread hypotheses:
    • Theorem 5 assumes 0<θ<10<\theta<10<θ<1. The printed condition divides by θ(1−θ)\theta(1-\theta)θ(1−θ), and Lean's x/0=0x/0=0x/0=0 would otherwise turn it into [⋅]+>0[\cdot]^+>0[⋅]+>0, under which the conclusion is false at θ=1\theta=1θ=1.
    • Lemma 4 is stated for arbitrary maximizers: max⁡{aiL,aiE}\max\{a_i^L,a_i^E\}max{aiL​,aiE​} is again an early maximizer. This reduces to the printed inequality when the early optimizer is unique.
    • Lemma 2(b) and Theorem 4(a) are the single-supplier and cost-only instances of the paper's statements.
    • Optimizers ai∗Ea_i^{*E}ai∗E​ appear as hypotheses (IsMaxOn), never as claims.
  • Not trivially true. A statement in which Π1∗L\Pi_1^{*L}Π1∗L​ or Π1∗E\Pi_1^{*E}Π1∗E​ is a junk supremum, or in which Theorem 5's condition degenerates at θ∈{0,1}\theta\in\{0,1\}θ∈{0,1}, would be trivially true or false; the bounded feasible sets and the hypothesis 0<θ<10<\theta<10<θ<1 exclude both.
  • Not formalized: Theorem 4 for other attributes and Theorem 4(b), Lemma 3, and Corollary 3(b), whose printed form needs hypotheses the page does not pin.

Proofs of the milestones are welcome. A reusable lemma, that the supremum of expectations is monotone under first-order stochastic dominance of the loss, would serve the other missions of this series too.

Selected references

  • Y. Wang, W. Gilland, B. Tomlin, Mitigating Supply Risk: Dual Sourcing or Process Improvement?, Manufacturing & Service Operations Management 12(3):489–510, 2010. https://doi.org/10.1287/msom.1090.0279
  • R. B. Handfield, D. R. Krause, T. V. Scannell, R. M. Monczka, Avoid the pitfalls in supplier development, Sloan Management Review, 2000, pp. 37–49 (cited from the reference list of Wang et al. 2010, https://doi.org/10.1287/msom.1090.0279).
  • D. R. Krause, R. B. Handfield, B. B. Tyler, The relationships between supplier development, commitment, social capital accumulation and performance improvement, Journal of Operations Management 25(2):528–545, 2007. https://doi.org/10.1016/j.jom.2006.05.007
  • B. Tomlin, On the value of mitigation and contingency strategies for managing supply chain disruption risks, Management Science 52(5):639–657, 2006. https://doi.org/10.1287/mnsc.1060.0515
8 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Mitigating Supply Risk: Dual Sourcing or Process Improvement? 2: With No Committed Cost, Expected Profit Is Concave in the Supplier's Reliability Index, with an Explicit First-Order ConditionResearch Paper

Motivation

Supply disruptions — fires, quality failures, capacity shortfalls at a supplier — are a first-order risk in manufacturing supply chains. A buying firm has two broad responses. It can dual source, splitting orders between suppliers so that one supplier's shortfall is partly covered by the other, or it can invest in process improvement at a single supplier (kaizen events, supplier development programmes) to make that supplier more reliable. Wang, Gilland and Tomlin, Mitigating Supply Risk: Dual Sourcing or Process Improvement? (M&SOM 12(3):489–510, 2010), build a two-stage newsvendor model that captures both levers and compare them analytically.

This mission formalizes the paper's analysis of the improvement lever on its own: the firm commits early to one supplier, decides how much effort to spend improving it, and then orders. The paper's Theorem 3 shows that, without committed costs, this improvement problem is a concave program with an explicit first-order condition, and its Corollary 2 derives how the optimal effort responds to costs, revenue and the chance that improvement succeeds. These are the facts the paper's later comparisons between improvement and dual sourcing rest on.

Setting

A firm sells one product over one season at unit revenue rrr, salvage value vvv and unit penalty ppp for unmet demand. Demand X≥0X \ge 0X≥0 has distribution function FFF and finite mean. The firm orders q≥0q \ge 0q≥0 units from a supplier with design capacity K>0K > 0K>0, unit cost ccc and committed cost η∈[0,1]\eta \in [0,1]η∈[0,1]: the firm pays (ηq+(1−η)y)c(\eta q + (1-\eta)y)c(ηq+(1−η)y)c when yyy units are delivered.

The supplier suffers a random capacity loss ξ≥0\xi \ge 0ξ≥0 and delivers y=min⁡{q,(K−ξ)+}y = \min\{q, (K-\xi)^+\}y=min{q,(K−ξ)+}. The law of ξ\xiξ has a continuous distribution function G(⋅,a)G(\cdot, a)G(⋅,a) that depends on the supplier's reliability index aaa; a larger index means a stochastically smaller loss, G(⋅,a)≤G(⋅,a′)G(\cdot, a) \le G(\cdot, a')G(⋅,a)≤G(⋅,a′) for a≤a′a \le a'a≤a′. Demand and losses are independent.

With ψ=−ηc/(r+p−v)\psi = -\eta c/(r+p-v)ψ=−ηc/(r+p−v) and φ=(r+p−(1−η)c)/(r+p−v)\varphi = (r+p-(1-\eta)c)/(r+p-v)φ=(r+p−(1−η)c)/(r+p−v), the second-stage expected profit at index aaa is

Π2(q;a)=(r+p−v)(ψq+φ E[y]−E[(y−X)+])−p E[X],\Pi_2(q; a) = (r+p-v)\big(\psi q + \varphi\,\mathsf E[y] - \mathsf E[(y-X)^+]\big) - p\,\mathsf E[X],Π2​(q;a)=(r+p−v)(ψq+φE[y]−E[(y−X)+])−pE[X],

and Π2∗(a)=sup⁡q≥0Π2(q;a)\Pi_2^*(a) = \sup_{q \ge 0}\Pi_2(q; a)Π2∗​(a)=supq≥0​Π2​(q;a) is its optimal value.

In the first stage the firm may improve the supplier from its initial index a0a^0a0. The paper reparametrizes effort by the target index: reaching index a≥a0a \ge a^0a≥a0 needs effort z(a)z(a)z(a), where zzz is convex and nondecreasing with z(a0)=0z(a^0) = 0z(a0)=0. Effort costs mmm per unit and succeeds with probability θ\thetaθ. The first-stage profit of early commitment is Eq. (7):

Π1(a)=−m z(a)+θ Π2∗(a)+(1−θ) Π2∗(a0),a≥a0.\Pi_1(a) = -m\,z(a) + \theta\,\Pi_2^*(a) + (1-\theta)\,\Pi_2^*(a^0), \qquad a \ge a^0 .Π1​(a)=−mz(a)+θΠ2∗​(a)+(1−θ)Π2∗​(a0),a≥a0.

Formalization targets

Goal: Theorem 3

Assume η=0\eta = 0η=0 and that a↦G(ξ,a)a \mapsto G(\xi, a)a↦G(ξ,a) is concave on [a0,∞)[a^0,\infty)[a0,∞) for every ξ\xiξ (decreasing marginal reliability improvement). Then Π1\Pi_1Π1​ is concave on [a0,∞)[a^0, \infty)[a0,∞), and an optimal index a∗>a0a^* > a^0a∗>a0, with an optimal order q∗q^*q∗ at a∗a^*a∗, satisfies

mθ z′(a∗)=(r+p−v)∫K−q∗K(φ−F(K−ξ)) ∂G(ξ,a∗)∂a dξ.(8)\frac{m}{\theta}\,z'(a^*) = (r+p-v)\int_{K-q^*}^{K}\big(\varphi - F(K-\xi)\big)\,\frac{\partial G(\xi, a^*)}{\partial a}\,d\xi. \tag{8}θm​z′(a∗)=(r+p−v)∫K−q∗K​(φ−F(K−ξ))∂a∂G(ξ,a∗)​dξ.(8)

Milestones

  1. Eq. (6), single-supplier instance with η=0\eta = 0η=0. For 0<φ<10 < \varphi < 10<φ<1 the critical fractile q^=inf⁡{t:F(t)≥φ}\hat q = \inf\{t : F(t) \ge \varphi\}q^​=inf{t:F(t)≥φ} maximizes Π2(⋅ ;a)\Pi_2(\cdot\,; a)Π2​(⋅;a) for every index aaa, and (with atomless demand) every positive optimal order satisfies the η=0\eta = 0η=0 instance of (6), G(K−q∗,a)(φ−F(q∗))=0G(K-q^*,a)(\varphi - F(q^*)) = 0G(K−q∗,a)(φ−F(q∗))=0.
  2. Lemma 2(b), single-supplier instance. Π2∗(a)\Pi_2^*(a)Π2∗​(a) is increasing in aaa.
  3. Corollary 2 (a), (b), (c), (e). The optimal reliability index, and so the optimal effort z∗=z(a∗)z^* = z(a^*)z∗=z(a∗), is decreasing in mmm, increasing in θ\thetaθ, decreasing in ccc and increasing in rrr, each in the strong set order on the set of maximizers.

Significance

Theorem 3 turns the firm's improvement decision into a one-dimensional concave program, so that the first-order condition (8) characterizes the optimum and comparative statics are available. Corollary 2 is the managerial content: cheaper or more reliable improvement, a cheaper supplier and a more valuable product all justify more improvement effort. The paper's later results — when late commitment beats early commitment (§4.2.2) and when single sourcing with improvement beats dual sourcing (§5) — compare the optimal values these results describe.

The results are proved in the paper's online appendix; none of them has a machine-checked proof. A complete development provides formal proofs of the layer-cake representation of the random-capacity newsvendor profit, of its critical-fractile solution, and of the concavity and envelope arguments on top of it.

Difficulty

Π2∗\Pi_2^*Π2∗​ is an optimal value, a supremum over order quantities, and suprema of concave functions are not concave in general. The obvious route — "Π2(q;a)\Pi_2(q; a)Π2​(q;a) is concave in aaa for each qqq, hence so is the supremum" — fails, because Π2(q;a)\Pi_2(q;a)Π2​(q;a) is not concave in aaa for a fixed qqq beyond the critical fractile. Any argument has to control how the optimal order moves with aaa under random capacity, where the delivered quantity is a minimum of the order and a random effective capacity. The first-order condition then requires differentiating an expectation of a non-smooth function of (ξ,X)(\xi, X)(ξ,X) in the parameter of ξ\xiξ's law. Corollary 2 must be argued on the set of maximizers, since Π1\Pi_1Π1​ is concave but not strictly concave.

Formalization scope

The Lean development lives in the namespace MitigateSupplyRisk.Improvement. Model bundles r,v,p,c,η,Kr, v, p, c, \eta, Kr,v,p,c,η,K, a demand law μ\muμ and the family ν(a)\nu(a)ν(a) of loss laws; FFF and G(⋅,a)G(\cdot,a)G(⋅,a) are their cdf. Expectations are Bochner integrals over ν(a)\nu(a)ν(a) and over the product ν(a)⊗μ\nu(a)\otimes\muν(a)⊗μ. Model.Assumptions collects the standing assumptions of §3: 0≤η≤10 \le \eta \le 10≤η≤1, K>0K > 0K>0, v<r+pv < r+pv<r+p (implicit in the paper's division by r+p−vr+p-vr+p−v), a nonnegative integrable demand, nonnegative atomless losses, and the stochastic order in aaa. Demand needs no density. Effort bundles θ,m,a0,z\theta, m, a^0, zθ,m,a0,z with θ∈[0,1]\theta \in [0,1]θ∈[0,1], m≥0m \ge 0m≥0 and zzz convex, nondecreasing on [a0,∞)[a^0,\infty)[a0,∞), z(a0)=0z(a^0) = 0z(a0)=0; taking zzz as primitive assumes every index a≥a0a \ge a^0a≥a0 is reachable. Π2∗\Pi_2^*Π2∗​ is a real supremum and Π1\Pi_1Π1​ is built from it, never from the critical fractile. Every statement about Π2∗\Pi_2^*Π2∗​ carries η=0\eta = 0η=0 or c≥0c \ge 0c≥0, which makes the supremum finite. "Optimal" always means a maximizer over the whole feasible set, and "increasing" is weak throughout, as on p. 492 of the paper.

The paper's proofs are in an online appendix that was not used here. Deviations from the page, each disclosed in the item's Formalization Note:

  • Eq. (8) omits the factor r+p−vr+p-vr+p−v on its right side; it is correct as printed only when r+p−v=1r+p-v = 1r+p−v=1, which holds in all of the paper's numerical examples. The goal states the corrected identity, multiplied by θ\thetaθ.
  • ∂2G/∂a2≤0\partial^2 G/\partial a^2 \le 0∂2G/∂a2≤0 is read as concavity of G(ξ,⋅)G(\xi,\cdot)G(ξ,⋅) on [a0,∞)[a^0,\infty)[a0,∞).
  • (8) is the first-order condition at an interior optimum a∗>a0a^* > a^0a∗>a0; differentiability of zzz and of G(ξ,⋅)G(\xi,\cdot)G(ξ,⋅) at a∗a^*a∗ is assumed explicitly.
  • Corollary 2 is stated in the strong set order on the argmax, (c) and (e) in the setting η=0\eta = 0η=0 of Theorem 3, and (b) with c≥0c \ge 0c≥0. Corollary 2(d), on the committed cost η\etaη, is not stated, because Theorem 3's setting fixes η=0\eta = 0η=0.
  • Lemma 2(b) and Eq. (6) are the single-supplier instances of the paper's dual-sourcing statements, which the paper applies to single sourcing on p. 496.

A trivializing formalization is ruled out: Π1\Pi_1Π1​ is built from the supremum Π2∗\Pi_2^*Π2∗​ (not from Π2\Pi_2Π2​ at a fixed order), the supremum is finite under the stated hypotheses, and every expectation is of an integrable function, so no statement holds through a junk value.

Reusable beyond this mission: the random-capacity newsvendor objects (delivered quantity, expected profit, layer-cake representation) and a Topkis-type monotone comparative statics lemma on a chain. Contributions of either, and proofs of the milestones in any order, are welcome.

Selected references

  • Y. Wang, W. Gilland, B. Tomlin, Mitigating Supply Risk: Dual Sourcing or Process Improvement?, Manufacturing & Service Operations Management 12(3):489–510, 2010. https://doi.org/10.1287/msom.1090.0279
  • D. M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998. https://doi.org/10.1515/9781400822539
  • R. B. Handfield, D. R. Krause, T. V. Scannell, R. M. Monczka, Avoid the Pitfalls in Supplier Development, Sloan Management Review 41(2):37–49, 2000.
9 thms1 active userReviewed
Convex OptimizationOperations Research·Captain: mikedeng1

Prox-Method with Rate of Convergence O(1/t) for Variational Inequalities with Lipschitz Continuous Monotone Operators and Smooth Convex-Concave Saddle Point Problems: Error √2ΘL/(αN) After N StepsResearch Paper

Motivation

Monotone variational inequalities (v.i.) cover convex minimization, convex–concave saddle-point problems, Nash equilibria of convex games and complementarity problems. Matrix games and other large saddle-point problems are typical cases. At large scale, first-order methods that use only values of the operator and simple auxiliary minimizations are the practical tool. The paper's introduction (pp. 229–231) contrasts this with the black-box lower bound of order 1/ϵ21/\epsilon^21/ϵ2 evaluations for nonsmooth Lipschitz minimization, and with Nesterov's smoothing method (2005), which reaches O(1/t)O(1/t)O(1/t) for structured saddle-point objectives. The paper states that its O(1/t)O(1/t)O(1/t) complexity estimate is new, to the author's knowledge, even in the Euclidean case, where the scheme is Korpelevich's extragradient method of 1976.

A. Nemirovski, Prox-Method with Rate of Convergence O(1/t) for Variational Inequalities with Lipschitz Continuous Monotone Operators and Smooth Convex-Concave Saddle Point Problems, SIAM J. Optim. 15(1):229–251, 2004 (doi:10.1137/S1052623403425629), introduced what is now called the mirror-prox method. It showed that two prox steps per iteration give an ergodic error of order 1/N1/N1/N when the operator is Lipschitz continuous, and that the bound holds in an arbitrary norm, adapted to the geometry of the feasible set by a distance-generating function. The method and its analysis underlie later work on smooth saddle-point problems, including Nesterov's dual extrapolation and Juditsky–Nemirovski–Tauvel's stochastic mirror-prox (2011).

Setting

Let EEE be a finite-dimensional real vector space with an arbitrary norm ∥⋅∥\|\cdot\|∥⋅∥, not necessarily Euclidean. Dual vectors ξ\xiξ act on z∈Ez\in Ez∈E by ⟨ξ,z⟩\langle\xi,z\rangle⟨ξ,z⟩, and the conjugate norm is ∥ξ∥∗=max⁡∥z∥≤1⟨ξ,z⟩\|\xi\|_*=\max_{\|z\|\le1}\langle\xi,z\rangle∥ξ∥∗​=max∥z∥≤1​⟨ξ,z⟩. Let Z⊆EZ\subseteq EZ⊆E be nonempty, convex and compact.

The operator FFF maps ZZZ to dual vectors and satisfies (2.1): it is LLL-Lipschitz, ∥F(z)−F(z′)∥∗≤L∥z−z′∥\|F(z)-F(z')\|_*\le L\|z-z'\|∥F(z)−F(z′)∥∗​≤L∥z−z′∥, and monotone, ⟨F(z)−F(z′),z−z′⟩≥0\langle F(z)-F(z'),z-z'\rangle\ge0⟨F(z)−F(z′),z−z′⟩≥0, for all z,z′∈Zz,z'\in Zz,z′∈Z. A solution of the v.i. is a point z∗∈Zz_*\in Zz∗​∈Z with ⟨F(z),z∗−z⟩≤0\langle F(z),z_*-z\rangle\le0⟨F(z),z∗​−z⟩≤0 for all z∈Zz\in Zz∈Z. The accuracy of a candidate zˉ∈Z\bar z\in Zzˉ∈Z is

ϵ(zˉ)=max⁡u∈Z⟨F(u),zˉ−u⟩.\epsilon(\bar z)=\max_{u\in Z}\langle F(u),\bar z-u\rangle .ϵ(zˉ)=u∈Zmax​⟨F(u),zˉ−u⟩.

The distance-generating function ω:Z→R\omega:Z\to\mathbb Rω:Z→R is continuously differentiable on ZZZ and strongly convex with modulus α>0\alpha>0α>0 in the form (2.2): ⟨ω′(z)−ω′(w),z−w⟩≥α∥z−w∥2\langle\omega'(z)-\omega'(w),z-w\rangle\ge\alpha\|z-w\|^2⟨ω′(z)−ω′(w),z−w⟩≥α∥z−w∥2. The prox-mapping is

Pz(ξ)=argmin⁡w∈Z[ω(w)+⟨ξ−ω′(z),w⟩],P_z(\xi)=\operatorname*{argmin}_{w\in Z}\big[\omega(w)+\langle\xi-\omega'(z),w\rangle\big],Pz​(ξ)=w∈Zargmin​[ω(w)+⟨ξ−ω′(z),w⟩],

and the constant Θ(z0)=max⁡z∈Z[ω(z)−ω(z0)−⟨ω′(z0),z−z0⟩]\Theta(z_0)=\max_{z\in Z}[\omega(z)-\omega(z_0)-\langle\omega'(z_0),z-z_0\rangle]Θ(z0​)=maxz∈Z​[ω(z)−ω(z0​)−⟨ω′(z0​),z−z0​⟩] measures how far ZZZ extends from the starting point z0z_0z0​ in the geometry of ω\omegaω.

The basic implementation fixes the stepsize γ=α/(2L)\gamma=\alpha/(\sqrt2L)γ=α/(2​L) (3.2). At step ttt it computes wt,1=Pzt−1(γF(zt−1))w_{t,1}=P_{z_{t-1}}(\gamma F(z_{t-1}))wt,1​=Pzt−1​​(γF(zt−1​)) and checks the test (3.4),

⟨γF(a),a−b⟩+ω(zt−1)+⟨ω′(zt−1),b−zt−1⟩−ω(b)≤0,\langle\gamma F(a),a-b\rangle+\omega(z_{t-1})+\langle\omega'(z_{t-1}),b-z_{t-1}\rangle-\omega(b)\le0,⟨γF(a),a−b⟩+ω(zt−1​)+⟨ω′(zt−1​),b−zt−1​⟩−ω(b)≤0,

for (a,b)=(zt−1,wt,1)(a,b)=(z_{t-1},w_{t,1})(a,b)=(zt−1​,wt,1​). If the test passes, wt=zt−1w_t=z_{t-1}wt​=zt−1​ and zt=wt,1z_t=w_{t,1}zt​=wt,1​. Otherwise wt=wt,1w_t=w_{t,1}wt​=wt,1​ and zt=Pzt−1(γF(wt,1))z_t=P_{z_{t-1}}(\gamma F(w_{t,1}))zt​=Pzt−1​​(γF(wt,1​)). The output after NNN steps is the average zN=1N∑t=1Nwtz^N=\frac1N\sum_{t=1}^Nw_tzN=N1​∑t=1N​wt​ of the points wtw_twt​.

Formalization targets

Goal: Theorem 3.2 (p. 239), variational-inequality form

For every run of the basic implementation, (3.4) holds at every step, so two inner iterations always suffice, and for every N≥1N\ge1N≥1

ϵ(zN)≤2 Θ(z0) LαN.(3.9)\epsilon(z^N)\le\frac{\sqrt2\,\Theta(z_0)\,L}{\alpha N}.\tag{3.9}ϵ(zN)≤αN2​Θ(z0​)L​.(3.9)

Milestones, in the order of the proof

  1. Lemma 2.1 (2.5), p. 232: Hu(Pz(ξ))−Hu(z)≤⟨ξ,u−Pz(ξ)⟩+[ω(z)+⟨ω′(z),Pz(ξ)−z⟩−ω(Pz(ξ))]H_u(P_z(\xi))-H_u(z)\le\langle\xi,u-P_z(\xi)\rangle+[\omega(z)+\langle\omega'(z),P_z(\xi)-z\rangle-\omega(P_z(\xi))]Hu​(Pz​(ξ))−Hu​(z)≤⟨ξ,u−Pz​(ξ)⟩+[ω(z)+⟨ω′(z),Pz​(ξ)−z⟩−ω(Pz​(ξ))], and the bracket is ≤0\le0≤0. Here Hu(z)=Ω(ω′(z))−⟨ω′(z),u⟩H_u(z)=\Omega(\omega'(z))-\langle\omega'(z),u\rangleHu​(z)=Ω(ω′(z))−⟨ω′(z),u⟩ and Ω\OmegaΩ is the Legendre transform of ω∣Z\omega|_Zω∣Z​.
  2. (2.15), p. 235: one step of the relaxed conceptual prox-method satisfies ⟨γtF(wt),wt−u⟩≤Hu(zt−1)−Hu(zt)+ϵt\langle\gamma_tF(w_t),w_t-u\rangle\le H_u(z_{t-1})-H_u(z_t)+\epsilon_t⟨γt​F(wt​),wt​−u⟩≤Hu​(zt−1​)−Hu​(zt​)+ϵt​.
  3. Proposition 2.2(ii), p. 234: ϵ(zN)≤(Θ(z0)+∑tϵt)/∑tγt\epsilon(z^N)\le(\Theta(z_0)+\sum_t\epsilon_t)/\sum_t\gamma_tϵ(zN)≤(Θ(z0​)+∑t​ϵt​)/∑t​γt​ for the relaxed method (2.11).
  4. Lemma 3.1 (3.7.a), p. 238: ∥w−z+∥≤α−1γ∥ξ−η∥∗\|w-z_+\|\le\alpha^{-1}\gamma\|\xi-\eta\|_*∥w−z+​∥≤α−1γ∥ξ−η∥∗​.
  5. Lemma 3.1 (3.7.c), p. 238: δ≤ϵ\delta\le\epsilonδ≤ϵ.
  6. Lemma 3.1 (3.7.d), p. 238: ϵ≤α−1γ2∥ξ−η∥∗2−α2[∥w−z∥2+∥w−z+∥2]\epsilon\le\alpha^{-1}\gamma^2\|\xi-\eta\|_*^2-\frac\alpha2[\|w-z\|^2+\|w-z_+\|^2]ϵ≤α−1γ2∥ξ−η∥∗2​−2α​[∥w−z∥2+∥w−z+​∥2].
  7. The display of the proof of Theorem 3.2, p. 239: with γ=α/(2L)\gamma=\alpha/(\sqrt2L)γ=α/(2​L), the second inner iterate always passes (3.4).

Lemma 2.1 (2.4), Lemma 3.1 (3.7.b) and Remark 2.3 are also stated as companion theorems.

Significance

The theorem gives an O(1/N)O(1/N)O(1/N) bound for monotone Lipschitz v.i. and for smooth convex–concave saddle points at a cost of two operator evaluations and two prox problems per step. With a distance-generating function adapted to ZZZ, the paper derives rates that are, in its words, nearly dimension-independent under favorable circumstances, for matrix games, eigenvalue minimization and the Lovász capacity number (§5). In the Euclidean case ω=12∥⋅∥22\omega=\frac12\|\cdot\|_2^2ω=21​∥⋅∥22​ the method is Korpelevich's extragradient method, so the theorem also gives an ergodic O(1/N)O(1/N)O(1/N) rate for that method.

The result is proved in the paper; no machine-checked proof of it is known. The platform has a formalized statement of mirror prox for minimization of a smooth convex function (Bubeck's Theorem 4.4), which uses a mirror map on an open set and a function-value gap. It does not cover operators, the v.i. accuracy measure or a prox-mapping over a compact set. This mission produces the general v.i. version, with an arbitrary norm and a distance-generating function defined only on ZZZ.

Difficulty

The algebra of each step is short. The work is in three places. First, the first-order optimality conditions of the constrained prox problems, (2.6) and (3.8), must be derived when ω′\omega'ω′ is only a derivative within ZZZ, and ZZZ may have empty interior. Second, (3.7.d) needs the function-value form of strong convexity, ω(w)≥ω(z)+⟨ω′(z),w−z⟩+α2∥w−z∥2\omega(w)\ge\omega(z)+\langle\omega'(z),w-z\rangle+\frac\alpha2\|w-z\|^2ω(w)≥ω(z)+⟨ω′(z),w−z⟩+2α​∥w−z∥2, which must be derived from the monotonicity form (2.2) along segments of ZZZ. Third, the telescoping of (2.15) uses the identity Ω(ω′(z))=⟨ω′(z),z⟩−ω(z)\Omega(\omega'(z))=\langle\omega'(z),z\rangle-\omega(z)Ω(ω′(z))=⟨ω′(z),z⟩−ω(z) for z∈Zz\in Zz∈Z, and the passage from the weighted sum to the average uses monotonicity of FFF.

The natural first idea is to prove that the inner map w↦Pz(γF(w))w\mapsto P_z(\gamma F(w))w↦Pz​(γF(w)) is a contraction, observation (3.1), and iterate it to a fixed point. That gives only a geometric number of inner steps, not two. The two-step bound comes from Lemma 3.1, which decouples the two prox steps and compares them through strong convexity.

Formalization scope

Dual vectors are continuous linear functionals E →L[ℝ] ℝ on a finite-dimensional normed space E, and ∥⋅∥∗\|\cdot\|_*∥⋅∥∗​ is the operator norm. This is equivalent to the paper's Euclidean space with a second norm. ZZZ is assumed convex, compact and nonempty in every item. ω\omegaω has a derivative within ZZZ that is continuous on ZZZ, and (2.2) is assumed in the monotonicity form. The prox-mapping is the relation "v∈Uv\in Uv∈U minimizes ω(y)+⟨ξ−ω′(z),y⟩\omega(y)+\langle\xi-\omega'(z),y\rangleω(y)+⟨ξ−ω′(z),y⟩ over UUU". Ω\OmegaΩ and Θ\ThetaΘ are suprema over the image of ZZZ, which are maxima under these assumptions. The paper's indices are kept: z 0 is z0z_0z0​, and step t+1t+1t+1 goes from z t to w (t+1) and z (t+1).

Disclosed choices: L>0L>0L>0 and N≥1N\ge1N≥1 are hypotheses, because (3.2) and (3.9) divide by them. The termination test (2.8) is not modelled, so runs never stop; this only adds runs. The basic implementation's inner loop is cut at s=2s=2s=2, which is what the goal's first claim justifies. The bound on ϵ(zN)\epsilon(z^N)ϵ(zN) is stated for every u∈Zu\in Zu∈Z, which is equivalent to the bound on the maximum. Items that use only monotonicity of FFF, or no property of FFF, do not assume the rest of (2.1).

The goal quantifies over every run, and a sorry-free sanity file exhibits a run on Z=[0,1]Z=[0,1]Z=[0,1], so the run relation is not empty. The average is over the wtw_twt​, not the ztz_tzt​. The suprema are taken over compact nonempty ZZZ with continuous ω\omegaω, so they are not junk values. The saddle-point form (3.10), the bound (2.14) and Theorems 4.1–4.2 are not posed.

Useful contributions: optimality conditions for minimizers of functions differentiable within a convex set; the function-value form of strong convexity derived from (2.2); and the Legendre-transform identity. All three are reusable for other mirror-descent and prox-method analyses.

Selected references

  • A. Nemirovski, Prox-Method with Rate of Convergence O(1/t) for Variational Inequalities with Lipschitz Continuous Monotone Operators and Smooth Convex-Concave Saddle Point Problems, SIAM J. Optim. 15(1):229–251, 2004. https://doi.org/10.1137/S1052623403425629
  • G. M. Korpelevich, The extragradient method for finding saddle points and other problems, Ekonomika i Matematicheskie Metody 12:747–756, 1976.
  • Yu. Nesterov, Dual extrapolation and its applications to solving variational inequalities and related problems, Math. Program. 109:319–344, 2007. https://doi.org/10.1007/s10107-006-0034-z
  • A. Juditsky, A. Nemirovski, C. Tauvel, Solving variational inequalities with stochastic mirror-prox algorithm, Stochastic Systems 1(1):17–58, 2011. https://doi.org/10.1214/10-SSY011
  • S. Bubeck, Convex Optimization: Algorithms and Complexity, Found. Trends Mach. Learn. 8(3–4):231–357, 2015, §4.5. https://doi.org/10.1561/2200000050
9 thms1 active userReviewed
Linear algebraNumerical Analysis·Captain: mikedeng1

The Primal-Dual Active Set Strategy as a Semismooth Newton Method III: Global Convergence under the Norm and Cone ConditionsResearch Paper

Motivation

Obstacle problems, contact problems and control-constrained optimal control problems lead, after discretization, to complementarity systems of the form "find y≤ψy \le \psiy≤ψ and λ≥0\lambda \ge 0λ≥0 with Ay+λ=fAy + \lambda = fAy+λ=f and λi(yi−ψi)=0\lambda_i(y_i - \psi_i) = 0λi​(yi​−ψi​)=0". The primal-dual active set strategy solves such systems by guessing which constraints are active, solving one linear system, and updating the guess. It is widely used because each iteration is a single linear solve and, in practice, it terminates after few iterations.

Hintermüller, Ito and Kunisch (SIAM J. Optim. 13(3), 2002; authors' version hal-01660511v1) showed that the strategy is a semismooth Newton method applied to a reformulation of the complementarity system with a max-function. This gives local superlinear convergence. For global convergence, from arbitrary initial data, the paper gives three sufficient conditions on the matrix AAA: the M-matrix case (Theorem 3.2), the condition of Theorem 3.3 treated in this mission, and small perturbations of M-matrices (Theorem 3.4). Theorem 3.3 is the one that goes beyond sign patterns: it covers P-matrices whose blocks satisfy a norm bound and a cone condition, with the sum of the components of yyy serving as a merit function.

Setting

Fix n≥0n \ge 0n≥0, a matrix A∈Rn×nA \in \mathbb{R}^{n \times n}A∈Rn×n, vectors f,ψ∈Rnf, \psi \in \mathbb{R}^nf,ψ∈Rn and a parameter c>0c > 0c>0. Vectors are ordered componentwise. The problem is

Ay+λ=f,λ−max⁡(0,λ+c(y−ψ))=0,(3.1)Ay + \lambda = f, \qquad \lambda - \max\big(0, \lambda + c(y - \psi)\big) = 0, \tag{3.1}Ay+λ=f,λ−max(0,λ+c(y−ψ))=0,(3.1)

with the maximum taken componentwise. In the paper's notation the matrix is AAA and the index sets are calligraphic: A\mathcal{A}A (active) and I\mathcal{I}I (inactive).

A P-matrix is a square matrix all of whose principal minors are positive. For an index set I⊆{1,…,n}\mathcal{I} \subseteq \{1,\dots,n\}I⊆{1,…,n} with complement A\mathcal{A}A, AIA_{\mathcal{I}}AI​ is the principal submatrix of AAA on I\mathcal{I}I, and AIAA_{\mathcal{I}\mathcal{A}}AIA​ is the submatrix with rows in I\mathcal{I}I and columns in A\mathcal{A}A. For a P-matrix every AIA_{\mathcal{I}}AI​ is invertible.

The primal-dual active set algorithm starts from an arbitrary pair (y0,λ0)(y^0, \lambda^0)(y0,λ0). Given (yk,λk)(y^k, \lambda^k)(yk,λk) it sets

Ak={i:λik+c(yik−ψi)>0},Ik={i:λik+c(yik−ψi)≤0},\mathcal{A}_k = \{ i : \lambda^k_i + c(y^k_i - \psi_i) > 0 \}, \qquad \mathcal{I}_k = \{ i : \lambda^k_i + c(y^k_i - \psi_i) \le 0 \},Ak​={i:λik​+c(yik​−ψi​)>0},Ik​={i:λik​+c(yik​−ψi​)≤0},

and determines (yk+1,λk+1)(y^{k+1}, \lambda^{k+1})(yk+1,λk+1) from

Ayk+1+λk+1=f,yk+1=ψ on Ak,λk+1=0 on Ik.Ay^{k+1} + \lambda^{k+1} = f, \qquad y^{k+1} = \psi \text{ on } \mathcal{A}_k, \qquad \lambda^{k+1} = 0 \text{ on } \mathcal{I}_k .Ayk+1+λk+1=f,yk+1=ψ on Ak​,λk+1=0 on Ik​.

For a rectangular matrix BBB, B+B_+B+​ is the matrix of the positive parts max⁡(0,bij)\max(0, b_{ij})max(0,bij​) of its entries, and ∥⋅∥1\|\cdot\|_1∥⋅∥1​ is the matrix norm subordinate to the one-norms, i.e. the maximal absolute column sum. Thus ∥B+∥1=max⁡j∑imax⁡(0,bij)\|B_+\|_1 = \max_j \sum_i \max(0, b_{ij})∥B+​∥1​=maxj​∑i​max(0,bij​).

Formalization targets

Goal: Theorem 3.3

If AAA is a P-matrix and for every partition of {1,…,n}\{1, \dots, n\}{1,…,n} into disjoint sets I\mathcal{I}I and A\mathcal{A}A

∥(AI−1AIA)+∥1<1and∑i∈I(AI−1v)i≥0  for all v≥0,\big\|(A_{\mathcal{I}}^{-1} A_{\mathcal{I}\mathcal{A}})_+\big\|_1 < 1 \qquad\text{and}\qquad \sum_{i \in \mathcal{I}} (A_{\mathcal{I}}^{-1} v)_i \ge 0 \ \text{ for all } v \ge 0,​(AI−1​AIA​)+​​1​<1andi∈I∑​(AI−1​v)i​≥0  for all v≥0,

then for every solution x∗=(y∗,λ∗)x^* = (y^*, \lambda^*)x∗=(y∗,λ∗) of (3.1) and every run of the algorithm, xk=(yk,λk)→x∗x^k = (y^k, \lambda^k) \to x^*xk=(yk,λk)→x∗.

Milestones

The proof in the paper passes through the following claims, in order: the sign facts λIkk≤0\lambda^k_{\mathcal{I}_k} \le 0λIk​k​≤0 and yAkk≥ψAky^k_{\mathcal{A}_k} \ge \psi_{\mathcal{A}_k}yAk​k​≥ψAk​​ for k≥1k \ge 1k≥1; the update formula on the inactive set derived from the Newton system (3.3); inequality (3.6); inequality (3.7),

∑i=1n(yik+1−yik)≤−∥yk−ψ∥1,Ak+∥(AIk−1AIkAk)+∥1 ∥yk−ψ∥1,Ak;\sum_{i=1}^n (y^{k+1}_i - y^k_i) \le -\|y^k - \psi\|_{1,\mathcal{A}_k} + \big\|(A_{\mathcal{I}_k}^{-1} A_{\mathcal{I}_k\mathcal{A}_k})_+\big\|_1 \, \|y^k - \psi\|_{1,\mathcal{A}_k};i=1∑n​(yik+1​−yik​)≤−∥yk−ψ∥1,Ak​​+​(AIk​−1​AIk​Ak​​)+​​1​∥yk−ψ∥1,Ak​​;

and the fact that a repeated active set yields a solution of (3.1).

Companion statements

Existence of a run from every initial pair when AAA is a P-matrix; Remark 3.3 (an M-matrix satisfies the conditions of Theorem 3.3); and the stronger conclusion of the proof, that every run reaches x∗x^*x∗ after finitely many steps.

Significance

Theorem 3.3 gives global convergence of the primal-dual active set strategy for a class of matrices that is not restricted to M-matrices, and identifies M(y)=∑iyi\mathcal{M}(y) = \sum_i y_iM(y)=∑i​yi​ as a merit function under its two conditions. The paper points out that the result applies to discretizations of control-constrained optimal control problems, where the system matrix is generally not an M-matrix, and Remark 3.3 shows that the M-matrix case falls under it.

The result is proved on paper; none of it has been machine-checked. A formal development would produce a checked global convergence theorem for a semismooth Newton method, together with reusable statements about principal blocks of P-matrices and the subordinate one-norm of a positive part. The step from "the merit function does not increase" to convergence is the part of the paper's argument that a formal proof has to make fully precise (see below).

Difficulty

The obvious route is the paper's: show that ∑iyik\sum_i y^k_i∑i​yik​ decreases strictly until the active set repeats, conclude that no active set can recur, and use finiteness of the set of possible active sets. The inequalities (3.6) and (3.7) give only a non-strict decrease. The paper's assertion "<0< 0<0, unless yk+1=yky^{k+1} = y^kyk+1=yk" does not follow from them as written: the right-hand side of (3.7) vanishes when yk=ψy^k = \psiyk=ψ on Ak\mathcal{A}_kAk​, and the cone condition permits ∑i∈I(AI−1λIk)i=0\sum_{i \in \mathcal{I}} (A_{\mathcal{I}}^{-1}\lambda^k_{\mathcal{I}})_i = 0∑i∈I​(AI−1​λIk​)i​=0 with λIk≠0\lambda^k_{\mathcal{I}} \neq 0λIk​=0. A complete proof has to exclude cycling among active sets at equal merit value by a further argument. That is the central difficulty of this mission, and the reason the strict part of (3.7) is not stated as a milestone.

Formalization scope

Vectors are Fin n → ℝ and matrices Matrix (Fin n) (Fin n) ℝ; index sets are Finset (Fin n) and blocks are submatrices along the subtype inclusion. The P-matrix predicate is the published definition RobinsonSR.Schur.IsPMatrix (every nonempty principal minor is positive). The algorithm is encoded as a relation between consecutive iterates, and a run is an infinite sequence related step by step with arbitrary initial data; the stopping option of the algorithm is not modelled. The solution of (3.1) enters as a hypothesis: for a P-matrix it exists and is unique, so no assumption beyond the paper is made. Convergence is convergence of (yk,λk)(y^k, \lambda^k)(yk,λk) in Rn×Rn\mathbb{R}^n \times \mathbb{R}^nRn×Rn. The parameter c>0c > 0c>0 is the paper's standing assumption.

Conventions committed to:

  • both conditions of Theorem 3.3 range over every index set, including I=∅\mathcal{I} = \emptysetI=∅ and I={1,…,n}\mathcal{I} = \{1,\dots,n\}I={1,…,n};
  • ∥B+∥1\|B_+\|_1∥B+​∥1​ is the maximal column sum of the positive part, computed as a supremum in R≥0\mathbb{R}_{\ge 0}R≥0​, and equals 000 for a matrix with no columns;
  • the cone condition is ∑i∈I(AI−1v)i≥0\sum_{i\in\mathcal{I}}(A_{\mathcal{I}}^{-1}v)_i \ge 0∑i∈I​(AI−1​v)i​≥0 for v≥0v \ge 0v≥0, not entrywise nonnegativity of AI−1A_{\mathcal{I}}^{-1}AI−1​;
  • the milestones on the iterates hold from k=1k = 1k=1 on, as in the paper.

The goal does not assume a decrease of the merit function or finite termination; a formalization that adds either as a hypothesis would be trivial and is ruled out. The run-existence companion shows that the hypothesis "let (yk,λk)(y^k,\lambda^k)(yk,λk) be a run" can be met, so the goal is not vacuous.

A complete development needs: invertibility of principal blocks of a P-matrix, the block form of one step, the elementary estimate of ∑i(Bx)i\sum_i (B x)_i∑i​(Bx)i​ by ∥B+∥1∑jxj\|B_+\|_1 \sum_j x_j∥B+​∥1​∑j​xj​ for x≥0x \ge 0x≥0, and an argument that excludes cycling. Proofs of any milestone, of the companion statements, or of the goal through an argument other than the paper's are welcome.

Selected references

  • M. Hintermüller, K. Ito, K. Kunisch, The primal-dual active set strategy as a semismooth Newton method, SIAM J. Optim. 13(3):865–888, 2002. https://doi.org/10.1137/S1052623401383558 ; authors' version https://hal.science/hal-01660511v1
  • A. Berman, R. J. Plemmons, Nonnegative Matrices in the Mathematical Sciences, Academic Press, 1979 (SIAM Classics reprint 1994). https://doi.org/10.1137/1.9781611971262
10 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Supply Chain Coordination Under Channel Rebates with Sales Effort Effects III: Returns Alone, Linear Rebates Alone or Target Rebates Alone Cannot Coordinate Effort and QuantityResearch Paper

Motivation

Manufacturers of computer hardware, software and automobiles routinely pay channel rebates to their retailers: a payment for each unit the retailer sells to end customers, either for every unit (a linear rebate) or only for units beyond a target (a target rebate). In the same industries manufacturers also accept returns, crediting the retailer for unsold stock. Both instruments are meant to make the retailer act in the interest of the whole supply chain. When the retailer's sales effort drives demand and cannot be written into a contract, the question is which of these instruments, alone or combined, can make the retailer choose the effort and the stock that maximize total chain profit.

T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8) (2002) (DOI 10.1287/mnsc.48.8.992.168), answers this in a newsvendor model with multiplicative effort. Its Theorem 2 shows that a target rebate combined with returns can coordinate. This mission formalizes the complementary negative result, the paper's Proposition 2: no single instrument suffices. It is related to the impossibility shown by Cachon and Lariviere for revenue sharing with retailer effort (Management Science 51(1), 2005), but concerns different instruments.

Setting

A retailer orders a quantity Q≥0Q \ge 0Q≥0 and exerts a sales effort e≥0e \ge 0e≥0 before demand is observed. Demand is eξe\xieξ, where ξ\xiξ is a random variable with a density φ\varphiφ on R\mathbb RR that vanishes on (−∞,0)(-\infty, 0)(−∞,0) and is strictly positive on [0,∞)[0, \infty)[0,∞) (Assumption A4), with finite mean. Write

Φ(Q)=∫0Qφ(ξ) dξ,Γ(Q)=∫0Qξ dΦ(ξ).\Phi(Q) = \int_0^Q \varphi(\xi)\,d\xi, \qquad \Gamma(Q) = \int_0^Q \xi\,d\Phi(\xi).Φ(Q)=∫0Q​φ(ξ)dξ,Γ(Q)=∫0Q​ξdΦ(ξ).

Effort costs V(e)V(e)V(e), where V(0)=0V(0) = 0V(0)=0 and VVV is strictly increasing and strictly convex on [0,∞)[0, \infty)[0,∞) (Assumption A5; the paper declares all such properties strict). The retail price ppp, the manufacturer's unit cost ccc, the wholesale price www and the salvage value sss satisfy 0<c<w<p0 < c < w < p0<c<w<p and s<cs < cs<c (Assumption A1); sss may be negative.

The integrated channel earns

Π(Q,e)=−cQ+pEmin⁡(Q,eξ)+sE(Q−eξ)+−V(e),\Pi(Q, e) = -cQ + pE\min(Q, e\xi) + sE(Q - e\xi)^+ - V(e),Π(Q,e)=−cQ+pEmin(Q,eξ)+sE(Q−eξ)+−V(e),

and (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ) denotes a maximizer of Π\PiΠ over Q≥0Q \ge 0Q≥0, e≥0e \ge 0e≥0. Under a contract with wholesale price www, rebate uuu per unit sold beyond the target TTT, and return credit bbb per unsold unit, the retailer earns

R(Q,e∣T)=−wQ+pEmin⁡(Q,eξ)+uE(min⁡(Q,eξ)−T)++bE(Q−eξ)+−V(e).R(Q, e \mid T) = -wQ + pE\min(Q, e\xi) + uE(\min(Q, e\xi) - T)^+ + bE(Q - e\xi)^+ - V(e).R(Q,e∣T)=−wQ+pEmin(Q,eξ)+uE(min(Q,eξ)−T)++bE(Q−eξ)+−V(e).

Returns alone is u=0u = 0u=0 with b∈[s,w)b \in [s, w)b∈[s,w); a target rebate alone is u>0u > 0u>0, T≥0T \ge 0T≥0 with no returns, b=sb = sb=s (the retailer salvages leftovers herself); a linear rebate alone is the case T=0T = 0T=0 of the latter. Channel coordination means that the retailer's optimal decisions under the contract are the integrated channel's (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ).

Formalization targets

Goal: Proposition 2 (p. 1003)

For every b∈[s,w)b \in [s, w)b∈[s,w), every u>0u > 0u>0 and every T≥0T \ge 0T≥0,

(Qˉ,eˉ)∉arg⁡max⁡Q,e≥0R(⋅,⋅∣T)  under (u,b,T)=(0,b,0), (u,s,0), (u,s,T).(\bar Q, \bar e) \notin \arg\max_{Q, e \ge 0} R(\cdot, \cdot \mid T)\ \text{ under } (u, b, T) = (0, b, 0),\ (u, s, 0),\ (u, s, T).(Qˉ​,eˉ)∈/argQ,e≥0max​R(⋅,⋅∣T)  under (u,b,T)=(0,b,0), (u,s,0), (u,s,T).

The three clauses are returns alone, a linear rebate alone, and a target rebate alone. The statement asserts that (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ) is not among the retailer's maximizers at all, which is stronger than saying that the retailer's optimum is not exactly {(Qˉ,eˉ)}\{(\bar Q, \bar e)\}{(Qˉ​,eˉ)}.

Milestones

  1. §4.1, p. 999. An integrated optimum with eˉ>0\bar e > 0eˉ>0 satisfies Qˉ=eˉ Qˉ0\bar Q = \bar e\,\bar Q_0Qˉ​=eˉQˉ​0​ with Φ(Qˉ0)=(p−c)/(p−s)\Phi(\bar Q_0) = (p - c)/(p - s)Φ(Qˉ​0​)=(p−c)/(p−s), V′(eˉ)=(p−s)Γ(Qˉ0)V'(\bar e) = (p - s)\Gamma(\bar Q_0)V′(eˉ)=(p−s)Γ(Qˉ​0​), and Π(Qˉ,eˉ)=eˉV′(eˉ)−V(eˉ)\Pi(\bar Q, \bar e) = \bar e V'(\bar e) - V(\bar e)Π(Qˉ​,eˉ)=eˉV′(eˉ)−V(eˉ).
  2. Lemma 2, p. 1000. For every effort e≥0e \ge 0e≥0, the retailer's optimal orders under (w,u,b,T)(w, u, b, T)(w,u,b,T) are {eQ‾0}\{e\underline Q_0\}{eQ​0​}, {eQ‾1}\{e\underline Q_1\}{eQ​1​} or {eQ‾0,eQ‾1}\{e\underline Q_0, e\underline Q_1\}{eQ​0​,eQ​1​} as e<,>,=T/τe <, >, = T/\taue<,>,=T/τ, where Φ(Q‾0)=(p−w)/(p−b)\Phi(\underline Q_0) = (p - w)/(p - b)Φ(Q​0​)=(p−w)/(p−b), Φ(Q‾1)=(p+u−w)/(p+u−b)\Phi(\underline Q_1) = (p + u - w)/(p + u - b)Φ(Q​1​)=(p+u−w)/(p+u−b) and τ\tauτ is the indifference target of the quantity-only problem.
  3. §4.3, p. 1001. For T>0T > 0T>0, no optimal pair of the retailer has effort exactly T/τT/\tauT/τ.

Significance

Proposition 2 is the converse half of the paper's main message. Together with Theorem 2 it says that the combination of a target rebate with returns is the minimal coordinating scheme among those considered: each ingredient alone fails, under general demand and general effort cost, not only in a parametric example. The proposition also frames the paper's remark that a linear rebate combined with returns coordinates only at u=w−cu = w - cu=w−c and b=s+w−cb = s + w - cb=s+w−c, which leaves the manufacturer no profit.

The result is proved in the paper; nothing in this mission is open mathematics. No part of it has been machine-checked before. The formal development adds a precise account of what the paper's argument needs: the existence and interiority of the integrated optimum, the differentiability of the effort cost, and a full characterization of the retailer's optimal order for a general positive density, which the paper states but proves only for the quantity-only case.

Difficulty

The obvious route compares first-order conditions, but neither problem is globally smooth. The retailer's profit in QQQ has an upward kink at Q=TQ = TQ=T, so it is concave only piecewise and its maximizer is decided by a comparison of two local maxima, not by a first-order condition. Consequently the retailer's value as a function of effort, A(e∣T)=max⁡QR(Q,e∣T)A(e \mid T) = \max_Q R(Q, e \mid T)A(e∣T)=maxQ​R(Q,e∣T), switches branch at e=T/τe = T/\taue=T/τ and is neither concave nor differentiable there. Showing that (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ) is not a retailer optimum therefore requires the global order characterization (Lemma 2) in place of a local condition, a separate argument for the knife-edge effort T/τT/\tauT/τ, and differentiability of expectations such as Emin⁡(Q,eξ)E\min(Q, e\xi)Emin(Q,eξ) in the effort level under only a finite-mean assumption. The paper's own proof cites Lemma 1 where Lemma 2 with b=sb = sb=s is needed.

Formalization scope

The density form of A4 is literal: a measurable φ\varphiφ, zero on negatives, positive on [0,∞)[0, \infty)[0,∞), integrating to one, with ξφ(ξ)\xi\varphi(\xi)ξφ(ξ) integrable. The law of ξ\xiξ is Lebesgue measure with density φ\varphiφ; the law of eξe\xieξ is its image under x↦exx \mapsto exx↦ex. The expectations Emin⁡(Q,eξ)E\min(Q, e\xi)Emin(Q,eξ) and E(Q−eξ)+E(Q - e\xi)^+E(Q−eξ)+ are the published CachonCoord.Newsvendor.expSales and expLeftover of that image law; the rebate term is the integral of max⁡(min⁡(Q,x)−T,0)\max(\min(Q, x) - T, 0)max(min(Q,x)−T,0). Critical fractiles Φ−1(⋅)\Phi^{-1}(\cdot)Φ−1(⋅) and the threshold τ\tauτ are stated by their defining equations, never as inverse functions. "Optimal" means a maximizer over Q≥0Q \ge 0Q≥0 (and e≥0e \ge 0e≥0).

Two hypotheses are pinned relative to the page and disclosed in each statement. The effort cost carries a derivative V′V'V′ with VVV differentiable at every e>0e > 0e>0: the paper writes (∂/∂e)V(\partial/\partial e)V(∂/∂e)V in every first-order condition without stating it, and without it a kink of VVV at eˉ\bar eeˉ could let both the channel and the retailer stop at eˉ\bar eeˉ. The integrated optimum is a hypothesis, as the paper assumes its existence in words, and it is required to have eˉ>0\bar e > 0eˉ>0, as the paper's optimum is interior. Without eˉ>0\bar e > 0eˉ>0 the channel would sell nothing, and a degenerate statement would follow.

A trivializing reading is ruled out: the goal does not say that the retailer's first-order conditions fail at (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ), nor that her optimum is not unique; it says that (Qˉ,eˉ)(\bar Q, \bar e)(Qˉ​,eˉ) is not a retailer maximizer.

Needed infrastructure: differentiation under the integral of Emin⁡(Q,eξ)E\min(Q, e\xi)Emin(Q,eξ) and E(min⁡(Q,eξ)−T)+E(\min(Q, e\xi) - T)^+E(min(Q,eξ)−T)+ in eee, strict monotonicity of Φ\PhiΦ and Γ\GammaΓ on [0,∞)[0, \infty)[0,∞), and the piecewise-concavity analysis of the newsvendor with a target rebate. These pieces are reusable for the sibling missions of this paper and for other effort-dependent newsvendor models. Proofs of the milestones and of supporting lemmas on these expectations are welcome.

Selected references

  • T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8):992–1007, 2002. https://doi.org/10.1287/mnsc.48.8.992.168
  • G. P. Cachon, M. A. Lariviere, Supply Chain Coordination with Revenue-Sharing Contracts: Strengths and Limitations, Management Science 51(1):30–44, 2005. https://doi.org/10.1287/mnsc.1040.0215
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science 11, 2003. https://doi.org/10.1016/S0927-0507(03)11006-7
7 thms1 active userReviewed
Convex OptimizationOperations ResearchProbability·Captain: mikedeng1

Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion 4: With Random Right-Hand Side and Known Dual Extreme Points, a Distribution in 𝒫 Attains Ẑ(x) = Ẑ_DD(x)Research Paper

Motivation

Two-stage stochastic linear programs model decisions taken before uncertainty is revealed (a first-stage plan xxx) followed by a corrective recourse action once it is. The classical model needs the full probability distribution of the uncertain data. In practice usually only estimates of a few moments are available, and the computed plan can be sensitive to the distribution that is assumed. The minimax (distributionally robust) approach replaces the single distribution by a class of distributions sharing given moments and optimizes against the worst member of the class. Bertsimas, Doan, Natarajan and Teo (Math. Oper. Res. 35(3), 2010) combine this with risk aversion, through a piecewise-linear disutility of the second-stage cost, and show which instances become semidefinite programs.

Besides the optimal value, the worst-case distribution itself is of practical interest: the paper proposes it as a natural distribution for stress-testing a first-stage solution (§4). This mission concerns the case where the right-hand side of the second stage is random, and formalizes the paper's construction of a worst-case distribution that is a genuine member of the moment class.

Setting

A first-stage decision x∈Rnx\in\mathbb R^nx∈Rn is feasible if x∈X={x:Ax=b, x≥0}x\in X=\{x : Ax=b,\ x\ge 0\}x∈X={x:Ax=b, x≥0}. Given a recourse matrix W∈Rr×dW\in\mathbb R^{r\times d}W∈Rr×d, a technology matrix T∈Rr×nT\in\mathbb R^{r\times n}T∈Rr×n, a constant cost vector q∈Rdq\in\mathbb R^dq∈Rd and a realized right-hand side h∈Rrh\in\mathbb R^rh∈Rr, the second-stage cost is the optimal value of the dual of the recourse linear program,

Q(h,x)=max⁡p (h−Tx)′ps.t.W′p≤q.\mathcal Q(h,x)=\max_{p}\ (h-Tx)'p\quad\text{s.t.}\quad W'p\le q .Q(h,x)=pmax​ (h−Tx)′ps.t.W′p≤q.

Risk aversion enters through the disutility U(t)=max⁡k=1,…,K(αkt+βk)\mathbb U(t)=\max_{k=1,\dots,K}(\alpha_k t+\beta_k)U(t)=maxk=1,…,K​(αk​t+βk​) with αk≥0\alpha_k\ge 0αk​≥0. The right-hand side h~\tilde hh~ is random; its distribution is only known to lie in the moment class

P={P:EP[h~]=μ, EP[h~h~′]=Q},\mathcal P=\{P : \mathbb E_P[\tilde h]=\mu,\ \mathbb E_P[\tilde h\tilde h']=Q\},P={P:EP​[h~]=μ, EP​[h~h~′]=Q},

and the worst-case expected disutility is Z^(x)=sup⁡P∈PEP[U(Q(h~,x))]\hat Z(x)=\sup_{P\in\mathcal P}\mathbb E_P[\mathbb U(\mathcal Q(\tilde h,x))]Z^(x)=supP∈P​EP​[U(Q(h~,x))].

The standing assumptions are: complete recourse, {Ww:w≥0}=Rr\{Ww : w\ge 0\}=\mathbb R^r{Ww:w≥0}=Rr; a nonempty dual polyhedron {p:W′p≤q}\{p : W'p\le q\}{p:W′p≤q}; Q≻μμ′Q\succ\mu\mu'Q≻μμ′; and (Assumption 5) the extreme points p1,…,pNp_1,\dots,p_Np1​,…,pN​ of the dual polyhedron are known. Under these, the paper introduces the semidefinite program (16): over symmetric blocks indexed by pairs (k,i)(k,i)(k,i),

Z^DD(x)=max⁡ ∑k=1K∑i=1N(αkpi′vki+vk0i(βk−αkpi′Tx))  s.t.  ∑k,i(Vkivki(vki)′vk0i)=(Qμμ′1),  (Vkivki(vki)′vk0i)⪰0.\hat Z_{DD}(x)=\max\ \sum_{k=1}^K\sum_{i=1}^N\big(\alpha_k p_i'v_k^i+v_{k0}^i(\beta_k-\alpha_k p_i'Tx)\big) \ \ \text{s.t.}\ \ \sum_{k,i}\begin{pmatrix}V_k^i & v_k^i\\ (v_k^i)' & v_{k0}^i\end{pmatrix}=\begin{pmatrix}Q&\mu\\ \mu'&1\end{pmatrix},\ \ \begin{pmatrix}V_k^i & v_k^i\\ (v_k^i)' & v_{k0}^i\end{pmatrix}\succeq 0 .Z^DD​(x)=max k=1∑K​i=1∑N​(αk​pi′​vki​+vk0i​(βk​−αk​pi′​Tx))  s.t.  k,i∑​(Vki​(vki​)′​vki​vk0i​​)=(Qμ′​μ1​),  (Vki​(vki​)′​vki​vk0i​​)⪰0.

From a point of (16) the paper builds the mixed distribution Pm(x)P_m(x)Pm​(x), which with probability vk0iv_{k0}^ivk0i​ draws a normal vector with mean vki/vk0iv_k^i/v_{k0}^ivki​/vk0i​ and covariance (Vkivk0i−vki(vki)′)/(vk0i)2(V_k^iv_{k0}^i-v_k^i(v_k^i)')/(v_{k0}^i)^2(Vki​vk0i​−vki​(vki​)′)/(vk0i​)2.

Formalization targets

Goal: Theorem 3.3 (p. 590)

For every x∈Xx\in Xx∈X there is P∈PP\in\mathcal PP∈P with

EP′[U(Q(h~,x))]≤EP[U(Q(h~,x))]=Z^(x)=Z^DD(x)∀P′∈P,\mathbb E_{P'}\big[\mathbb U(\mathcal Q(\tilde h,x))\big]\le \mathbb E_{P}\big[\mathbb U(\mathcal Q(\tilde h,x))\big]=\hat Z(x)=\hat Z_{DD}(x)\qquad\forall P'\in\mathcal P,EP′​[U(Q(h~,x))]≤EP​[U(Q(h~,x))]=Z^(x)=Z^DD​(x)∀P′∈P,

where the common value is the attained maximum of (16), and the expected disutility is integrable under every member of P\mathcal PP.

Milestones (proof of Theorem 3.3, pp. 590–591)

  1. U(Q(h,x))=max⁡k,i(αk(h−Tx)′pi+βk)\mathbb U(\mathcal Q(h,x))=\max_{k,i}\big(\alpha_k(h-Tx)'p_i+\beta_k\big)U(Q(h,x))=maxk,i​(αk​(h−Tx)′pi​+βk​) for every hhh.
  2. Every P∈PP\in\mathcal PP∈P yields a feasible point of (16) of equal value; hence Z^(x)≤Z^DD(x)\hat Z(x)\le\hat Z_{DD}(x)Z^(x)≤Z^DD​(x).
  3. (16) has an optimal solution whose blocks have vk0i>0v_{k0}^i>0vk0i​>0 or vanish.
  4. For such a feasible point, Pm(x)∈PP_m(x)\in\mathcal PPm​(x)∈P.
  5. EPm(x)[U(Q(h~,x))]\mathbb E_{P_m(x)}[\mathbb U(\mathcal Q(\tilde h,x))]EPm​(x)​[U(Q(h~,x))] is at least the objective value of (16) at that point.

Significance

The result. Theorem 3.3 shows that, once the dual extreme points are known, the worst case over the moment class is attained, and by an explicit finite mixture of normal distributions read off an optimal solution of a semidefinite program. This contrasts with the random-objective case of the same paper (Theorem 2.2), where the bound is in general only approached by a sequence of distributions. The extremal distribution gives a concrete stress-test scenario for a candidate first-stage plan, and the identity Z^(x)=Z^DD(x)\hat Z(x)=\hat Z_{DD}(x)Z^(x)=Z^DD​(x) certifies the value of the inner worst-case problem without appeal to strong duality for the moment problem.

Formalizing it. The result is proved in the paper; to our knowledge no machine-checked version exists. A formal proof needs a measure-theoretic treatment of conditional moments on the cells of a piecewise-linear maximum, the existence of optima of a bounded semidefinite program, and moment computations for multivariate normal mixtures. These pieces are reusable well beyond this paper, for instance in other moment-based distributionally robust models.

Difficulty

The obvious route goes through moment-problem duality: dualize sup⁡P∈P\sup_{P\in\mathcal P}supP∈P​, reformulate the semi-infinite constraint as linear matrix inequalities, and dualize again. That route only gives the inequality chain up to a duality gap and says nothing about attainment over P\mathcal PP. The proof here avoids strong duality, but it must show two separate things: every distribution in P\mathcal PP maps to a feasible point of (16) without loss of value (this needs a measurable choice of the maximizing pair and the conditional moments on each cell), and the optimal point of (16) maps back to a distribution in P\mathcal PP whose value is at least the optimum. The second step fails on blocks with zero weight vk0i=0v_{k0}^i=0vk0i​=0, where no normal component can be formed; those blocks have to be removed from an optimal solution first.

Formalization scope

The Lean development works on Rr\mathbb R^rRr as Fin r → ℝ, with measures in place of the paper's densities. The moment class reuses the published definitions MomentDRO.Conf.HasSecondMoments, meanVec and secondMomentAbout P 0 (uncentred second moment). Q(h,x)\mathcal Q(h,x)Q(h,x), Z^(x)\hat Z(x)Z^(x) and Z^DD(x)\hat Z_{DD}(x)Z^DD​(x) are real sSups; every theorem that uses them states the relevant maximum or bound explicitly, so no statement depends on the junk value of an empty or unbounded supremum. Bordered matrices are Matrix.fromBlocks over Fin r ⊕ Fin 1 and ⪰0\succeq 0⪰0 is Matrix.PosSemidef. The normal components are Mathlib's multivariateGaussian, transported from EuclideanSpace ℝ (Fin r); the mixture weights are ENNReal.ofReal vk0iv_{k0}^ivk0i​.

Readings of the page:

  • As printed, Assumption 2 (complete recourse) and Assumption 3 "for all qqq" are mutually inconsistent when r≥1r\ge 1r≥1. The formalization uses complete recourse and nonemptiness of {p:W′p≤q}\{p : W'p\le q\}{p:W′p≤q} at the one constant qqq of §3.
  • Assumption 1 is not used and is dropped; x∈Xx\in Xx∈X is kept as in the statement.
  • "Without loss of generality vk0i>0v_{k0}^i>0vk0i​>0" is read as: some optimal solution has every block either with vk0i>0v_{k0}^i>0vk0i​>0 or zero.
  • The printed "Vkivk0V_k^iv_{k0}Vki​vk0​", "vk02v_{k0}^2vk02​" and "with probability vk0v_{k0}vk0​" are read with the superscript iii.

The goal asserts that a maximizer over P\mathcal PP exists, not only an equation between suprema: an equation such as EP[⋅]=Z^(x)\mathbb E_P[\cdot]=\hat Z(x)EP​[⋅]=Z^(x) alone could hold through a junk value and is ruled out as the target. No strong-duality hypothesis is assumed, since the proof does not need one. Contributions welcome: the measurable argmax selection, compactness of the feasible set of (16), and second-moment computations for Gaussian mixtures.

Selected references

  • D. Bertsimas, X. V. Doan, K. Natarajan, C.-P. Teo, Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion, Mathematics of Operations Research 35(3):580–602, 2010. https://doi.org/10.1287/moor.1100.0445
  • E. Delage, Y. Ye, Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems, Operations Research 58(3):595–612, 2010. https://doi.org/10.1287/opre.1090.0741
  • J. Dupačová, The minimax approach to stochastic programming and an illustrative application, Stochastics 20(1):73–88, 1987. https://doi.org/10.1080/17442508708833436
10 thms1 active userReviewed
Linear algebraProbabilityRandom Matrix Theory·Captain: mikedeng1

Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization 2: Nearly Isometric Random Maps Have δ_r ≤ δ with Probability 1 − e^(−c₁p) Once p ≥ c₀r(m+n)log(mn)Research Paper

Motivation

Many problems in system identification, collaborative filtering, low-dimensional embedding and model reduction ask for the matrix of least rank in an affine space. Affine rank minimization — given a linear map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp and b∈Rpb\in\mathbb R^pb∈Rp, find a matrix of minimum rank with A(X)=b\mathcal A(X)=bA(X)=b — is NP-hard in general. Recht, Fazel and Parrilo (arXiv:0706.4138; SIAM Review 52(3), 2010, doi:10.1137/070697835) showed that the convex relaxation which minimizes the nuclear norm ∥X∥∗\|X\|_*∥X∥∗​ (the sum of the singular values) instead of the rank recovers the minimum-rank solution exactly whenever A\mathcal AA satisfies a restricted isometry property on low-rank matrices. That deterministic theorem is the subject of the companion mission in this series.

A deterministic condition is only useful if maps satisfying it exist and are common. This mission formalizes the paper's second main result: random linear maps from a broad class — including Gaussian, symmetric Bernoulli and sparse random matrices — satisfy the restricted isometry property with overwhelming probability once the number of measurements ppp is of order r(m+n)log⁡(mn)r(m+n)\log(mn)r(m+n)log(mn). This parallels the role of random matrices in compressed sensing (Candès–Tao 2005; Baraniuk, Davenport, DeVore and Wakin 2008), where the vector restricted isometry property is established for random measurement matrices by a concentration and covering argument.

Setting

Write ⟨X,Y⟩=Tr⁡(X⊤Y)\langle X,Y\rangle=\operatorname{Tr}(X^\top Y)⟨X,Y⟩=Tr(X⊤Y) for the trace inner product on Rm×n\mathbb R^{m\times n}Rm×n and ∥X∥F\|X\|_F∥X∥F​ for the Frobenius norm. A linear map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp is given by ppp measurement matrices X1,…,XpX_1,\dots,X_pX1​,…,Xp​ through A(X)i=⟨Xi,X⟩\mathcal A(X)_i=\langle X_i,X\rangleA(X)i​=⟨Xi​,X⟩; ∥A(X)∥\|\mathcal A(X)\|∥A(X)∥ is the Euclidean norm in Rp\mathbb R^pRp, and ∥A∥=sup⁡{∥A(X)∥:∥X∥F≤1}\|\mathcal A\|=\sup\{\|\mathcal A(X)\|:\|X\|_F\le1\}∥A∥=sup{∥A(X)∥:∥X∥F​≤1} is the operator norm.

The rrr-restricted isometry constant δr(A)\delta_r(\mathcal A)δr​(A) (Definition 3.1) is the smallest δ≥0\delta\ge0δ≥0 such that

(1−δ)∥X∥F≤∥A(X)∥≤(1+δ)∥X∥Ffor all X with rank⁡X≤r.(1-\delta)\|X\|_F\le\|\mathcal A(X)\|\le(1+\delta)\|X\|_F\qquad\text{for all }X\text{ with }\operatorname{rank}X\le r.(1−δ)∥X∥F​≤∥A(X)∥≤(1+δ)∥X∥F​for all X with rankX≤r.

A random linear map A\mathcal AA is nearly isometrically distributed (Definition 4.1) if for every XXX, E∥A(X)∥2=∥X∥F2\mathbb E\|\mathcal A(X)\|^2=\|X\|_F^2E∥A(X)∥2=∥X∥F2​; for every X≠0X\ne0X=0 and 0<ϵ<10<\epsilon<10<ϵ<1,

P(∣∥A(X)∥2−∥X∥F2∣≥ϵ∥X∥F2)≤2exp⁡(−p2(ϵ2/2−ϵ3/3));\mathbb P\big(\big|\|\mathcal A(X)\|^2-\|X\|_F^2\big|\ge\epsilon\|X\|_F^2\big)\le2\exp\Big(-\frac p2\big(\epsilon^2/2-\epsilon^3/3\big)\Big);P(​∥A(X)∥2−∥X∥F2​​≥ϵ∥X∥F2​)≤2exp(−2p​(ϵ2/2−ϵ3/3));

and for some γ>0\gamma>0γ>0 and all t>0t>0t>0, P(∥A∥≥1+mn/p+t)≤exp⁡(−γpt2)\mathbb P(\|\mathcal A\|\ge1+\sqrt{mn/p}+t)\le\exp(-\gamma pt^2)P(∥A∥≥1+mn/p​+t)≤exp(−γpt2).

For subspaces T1,T2T_1,T_2T1​,T2​ of a Euclidean space, the projection distance is ρ(T1,T2)=∥PT1−PT2∥\rho(T_1,T_2)=\|P_{T_1}-P_{T_2}\|ρ(T1​,T2​)=∥PT1​​−PT2​​∥, the operator norm of the difference of the orthogonal projections (4.10). For subspaces V⊆RmV\subseteq\mathbb R^mV⊆Rm, W⊆RnW\subseteq\mathbb R^nW⊆Rn, the subspace Σ(V,W)⊆Rm×n\Sigma(V,W)\subseteq\mathbb R^{m\times n}Σ(V,W)⊆Rm×n consists of the matrices whose column space lies in VVV and whose row space lies in WWW.

Formalization targets

Goal: Theorem 4.2

Fix 0<δ<10<\delta<10<δ<1. There are c0,c1>0c_0,c_1>0c0​,c1​>0 depending only on δ\deltaδ such that for all 1≤r≤m≤n1\le r\le m\le n1≤r≤m≤n with mn≥2mn\ge2mn≥2, all p≥c0 r(m+n)log⁡(mn)p\ge c_0\,r(m+n)\log(mn)p≥c0​r(m+n)log(mn), and every nearly isometric random map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp,

P(δr(A)>δ)≤e−c1p.\mathbb P\big(\delta_r(\mathcal A)>\delta\big)\le e^{-c_1p}.P(δr​(A)>δ)≤e−c1​p.

Milestones

  • Lemma 4.3. For a fixed subspace UUU with d=dim⁡U≤pd=\dim U\le pd=dimU≤p and 0<δ<10<\delta<10<δ<1, the map is a δ\deltaδ-isometry on all of UUU except with probability at most 2(12/δ)dexp⁡(−p2(δ2/8−δ3/24))2(12/\delta)^d\exp(-\frac p2(\delta^2/8-\delta^3/24))2(12/δ)dexp(−2p​(δ2/8−δ3/24)).
  • Lemma 4.4. If A\mathcal AA is a δ\deltaδ-isometry on a ddd-dimensional U1U_1U1​, it is a δ′\delta'δ′-isometry on any ddd-dimensional U2U_2U2​, with δ′=δ+(1+∥A∥)ρ(U1,U2)\delta'=\delta+(1+\|\mathcal A\|)\rho(U_1,U_2)δ′=δ+(1+∥A∥)ρ(U1​,U2​).
  • (4.17). ρ(Σ(V1,W1),Σ(V2,W2))≤ρ(V1,V2)+ρ(W1,W2)\rho(\Sigma(V_1,W_1),\Sigma(V_2,W_2))\le\rho(V_1,V_2)+\rho(W_1,W_2)ρ(Σ(V1​,W1​),Σ(V2​,W2​))≤ρ(V1​,V2​)+ρ(W1​,W2​).
  • Lemma 4.5. For 0<ϵ≤10<\epsilon\le10<ϵ≤1, the family {Σ(V,W):dim⁡V=dim⁡W=r}\{\Sigma(V,W):\dim V=\dim W=r\}{Σ(V,W):dimV=dimW=r} has an ϵ\epsilonϵ-net in ρ\rhoρ of size at most (2C0/ϵ)r(m+n−2r)(2C_0/\epsilon)^{r(m+n-2r)}(2C0​/ϵ)r(m+n−2r), with C0C_0C0​ absolute.

Significance

The theorem supplies the hypothesis of the paper's recovery theorem for random measurements: with δ=1/10\delta=1/10δ=1/10 and rank 5r5r5r, it shows that O(r(m+n)log⁡(mn))O(r(m+n)\log(mn))O(r(m+n)log(mn)) random linear measurements suffice for nuclear norm minimization to recover every matrix of rank at most rrr exactly. Since a rank-rrr matrix has r(m+n−r)r(m+n-r)r(m+n−r) degrees of freedom, this is within a logarithmic factor of the information-theoretic count. The result made the nuclear norm heuristic a guaranteed method and seeded the theory of low-rank matrix recovery, including matrix completion.

The result is proved in the paper, though Lemma 4.5 rests on Szarek's covering estimates for the Grassmannian, cited without proof. To the best of the curators' search of the platform, none of these statements is machine-checked: there is no formal treatment of the matrix restricted isometry property, of nets on Grassmannians in the projection metric, or of nearly isometric random maps. A formalization would supply the probabilistic half of a fully verified low-rank recovery guarantee, together with reusable pieces — the projection distance, the stability of near isometry under subspace perturbation, and a covering bound for Grassmannians.

Difficulty

The set of matrices of rank at most rrr is not a subspace, so concentration for one matrix and a union bound over a single net in Rm×n\mathbb R^{m\times n}Rm×n do not suffice: a net of the unit ball of all matrices has size exponential in mnmnmn, which would require ppp of order mnmnmn. The set must instead be covered by finitely many r2r^2r2-dimensional subspaces, which requires a quantitative covering of the Grassmannians G(m,r)G(m,r)G(m,r) and G(n,r)G(n,r)G(n,r) in the projection distance — the content of Lemma 4.5, whose source in the literature (Szarek) does not give the constant explicitly. A second subtlety is that the event "A\mathcal AA is a near-isometry on all of a subspace" involves an uncountable family of matrices, and the bound for the supremum of ∥A(X)∥\|\mathcal A(X)\|∥A(X)∥ over a unit sphere has to be controlled from the finitely many points of a net.

Formalization scope

All statements live in the namespace MinRankRecovery.RandomRIP. Matrices are Matrix (Fin m) (Fin n) ℝ; the Frobenius norm and the trace inner product come from the published module HighDimStat_MatrixRank_Core. A linear map is represented by its ppp measurement matrices Xs : Fin p → Matrix (Fin m) (Fin n) ℝ, which loses no generality. A random map is Xs : Ω → Fin p → Matrix … on a probability space (Ω, μ), with measurable entries.

Conventions committed to:

  • δr\delta_rδr​ is the infimum of the admissible δ≥0\delta\ge0δ≥0 and is defined for every rrr; the paper's 1≤r≤m≤n1\le r\le m\le n1≤r≤m≤n appears as hypotheses of the goal.
  • ∥A∥\|\mathcal A\|∥A∥ is a supremum over the nonempty, bounded Frobenius unit ball.
  • (4.1) includes integrability. (4.2) is imposed for X≠0X\ne0X=0 only, since at X=0X=0X=0 the printed inequality fails for large ppp. γ\gammaγ in (4.3) may depend on the distribution and dimensions.
  • Probability statements bound the (outer) measure of the failure event, since events quantified over all matrices need not be measurable.
  • For ρ\rhoρ and Σ(V,W)\Sigma(V,W)Σ(V,W), matrices are vectorized into EuclideanSpace ℝ (Fin m × Fin n), which carries the Frobenius inner product. Lemma 4.4 is stated on EuclideanSpace ℝ ι for any finite index type.
  • Real.log is the natural logarithm.

Two printed statements are corrected. Theorem 4.2 assumes mn≥2mn\ge2mn≥2: at m=n=r=1m=n=r=1m=n=r=1, log⁡(mn)=0\log(mn)=0log(mn)=0 and a two-point random scalar map is nearly isometric while violating the conclusion. Lemma 4.5 is posed for 0<ϵ≤10<\epsilon\le10<ϵ≤1, since for large ϵ\epsilonϵ the right side drops below 111.

The constants c0,c1c_0,c_1c0​,c1​ of the goal are quantified before the dimensions, the distribution and γ\gammaγ; a formalization in which they may depend on m,n,p,rm,n,p,rm,n,p,r or on the distribution, or in which the near-isometry hypothesis is unsatisfiable, would be trivial and is ruled out by these choices.

A complete development needs: orthogonal projections and operator norms on finite-dimensional inner product spaces (Mathlib), volumetric ϵ\epsilonϵ-nets of spheres in subspaces, covering bounds for real Grassmannians in the projection metric, and the measure-theoretic union bound. The Grassmannian covering bound and the stability lemma are reusable beyond this mission. Contributions of any milestone, including Lemma 4.5 on its own, are welcome.

Selected references

  • B. Recht, M. Fazel, P. A. Parrilo, Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization, SIAM Review 52(3):471–501, 2010. Preprint arXiv:0706.4138v1. https://arxiv.org/abs/0706.4138
  • E. J. Candès, T. Tao, Decoding by Linear Programming, IEEE Trans. Inform. Theory 51(12), 2005. https://doi.org/10.1109/TIT.2005.858979
  • R. Baraniuk, M. Davenport, R. DeVore, M. Wakin, A Simple Proof of the Restricted Isometry Property for Random Matrices, Constructive Approximation 28(3), 2008. https://doi.org/10.1007/s00365-007-9003-x
  • S. J. Szarek, Metric entropy of homogeneous spaces, in Quantum Probability, Banach Center Publ. 43, 1998. https://arxiv.org/abs/math/9701213
  • E. J. Candès, Y. Plan, Tight Oracle Inequalities for Low-Rank Matrix Recovery From a Minimal Number of Noisy Random Measurements, IEEE Trans. Inform. Theory 57(4), 2011. https://arxiv.org/abs/1001.0339
9 thms1 active userReviewed
Control TheoryFunctional AnalysisNumerical Analysis·Captain: mikedeng1

The Primal-Dual Active Set Strategy as a Semismooth Newton Method V: Local Superlinear Convergence in L² under a Norm GapResearch Paper

Motivation

Optimal control problems with pointwise bounds on the control, such as

min⁡u12∥y−z∥L22+β2∥u∥L22subject to −Δy=u in Ω, y=0 on ∂Ω, u≤ψ,\min_u \tfrac12\|y - z\|_{L^2}^2 + \tfrac{\beta}{2}\|u\|_{L^2}^2 \quad\text{subject to } -\Delta y = u \text{ in } \Omega,\ y = 0 \text{ on } \partial\Omega,\ u \le \psi,umin​21​∥y−z∥L22​+2β​∥u∥L22​subject to −Δy=u in Ω, y=0 on ∂Ω, u≤ψ,

reduce, after eliminating the state, to a quadratic program in L2(Ω)L^2(\Omega)L2(Ω) with a pointwise upper bound. The primal-dual active set strategy solves such problems by guessing the set where the bound is active, solving one linear system on that guess, and updating the guess from the new primal and dual values. It is used routinely in PDE-constrained optimization because each iteration costs one linear solve and, in practice, very few iterations are needed.

Hintermüller, Ito and Kunisch (SIAM J. Optim. 13 (2002) 865–888; authors' version hal-01660511) showed that this strategy is a semismooth Newton method for a nonsmooth reformulation of the optimality system, built on the notion of slant differentiability of Chen, Nashed and Qi (SIAM J. Numer. Anal. 38 (2000) 1200–1216). In finite dimension this gives local superlinear convergence (missions I–IV of this series). This mission concerns the paper's function-space result, Theorem 4.1: in L2(Ω)L^2(\Omega)L2(Ω), under a norm gap on the operator, the method still converges locally superlinearly. Ulbrich (SIAM J. Optim. 13 (2003) 805–841) developed a related semismooth Newton theory for superposition operators in function spaces, which also requires a norm gap.

Setting

Let (Ω,μ)(\Omega, \mu)(Ω,μ) be a finite measure space (the paper takes a bounded domain Ω⊂Rn\Omega \subset \mathbb{R}^nΩ⊂Rn with Lebesgue measure) and Lp=Lp(Ω)L^p = L^p(\Omega)Lp=Lp(Ω) the real Lebesgue spaces, with inner product (⋅,⋅)(\cdot,\cdot)(⋅,⋅) on L2L^2L2. The paper writes AAA for an operator and calligraphic A\mathcal{A}A, I\mathcal{I}I for active and inactive sets.

Slant differentiability (Definition 1). For Banach spaces XXX, ZZZ, a map F:X→ZF : X \to ZF:X→Z is slantly differentiable in an open set UUU if there is G:U→L(X,Z)G : U \to \mathcal{L}(X, Z)G:U→L(X,Z), a slanting function, with

lim⁡h→01∥h∥ ∥F(x+h)−F(x)−G(x+h)h∥=0(x∈U).(A)\lim_{h\to 0}\frac{1}{\|h\|}\,\|F(x+h) - F(x) - G(x+h)h\| = 0 \qquad (x \in U). \tag{A}h→0lim​∥h∥1​∥F(x+h)−F(x)−G(x+h)h∥=0(x∈U).(A)

For δ∈R\delta \in \mathbb{R}δ∈R, the candidate slanting function of the pointwise max is Gm(y)(x)=1G_m(y)(x) = 1Gm​(y)(x)=1 if y(x)>0y(x) > 0y(x)>0, 000 if y(x)<0y(x) < 0y(x)<0, δ\deltaδ if y(x)=0y(x) = 0y(x)=0 (4.1).

The problem. Given f,ψ∈L2f, \psi \in L^2f,ψ∈L2 and a self-adjoint A∈L(L2)A \in \mathcal{L}(L^2)A∈L(L2) with

(Ay,y)≥γ∥y∥2(γ>0),(H1)(Ay, y) \ge \gamma\|y\|^2 \quad (\gamma > 0), \tag{H1}(Ay,y)≥γ∥y∥2(γ>0),(H1)

minimize 12(y,Ay)−(f,y)\tfrac12(y, Ay) - (f, y)21​(y,Ay)−(f,y) subject to y≤ψy \le \psiy≤ψ. The solution y∗y^*y∗ and its multiplier λ∗\lambda^*λ∗ are the unique solution of

Ay∗+λ∗=f,λ∗−max⁡(0,λ∗+c(y∗−ψ))=0 a.e.,(4.2)Ay^* + \lambda^* = f, \qquad \lambda^* - \max(0, \lambda^* + c(y^* - \psi)) = 0 \ \text{a.e.}, \tag{4.2}Ay∗+λ∗=f,λ∗−max(0,λ∗+c(y∗−ψ))=0 a.e.,(4.2)

for any fixed c>0c > 0c>0. The norm gap hypothesis is

A=C+βI,C∈L(L2,Lq),β>0,q>2.(H2)A = C + \beta I, \qquad C \in \mathcal{L}(L^2, L^q),\quad \beta > 0,\quad q > 2. \tag{H2}A=C+βI,C∈L(L2,Lq),β>0,q>2.(H2)

The algorithm. From (y0,λ0)∈L2×L2(y^0, \lambda^0) \in L^2 \times L^2(y0,λ0)∈L2×L2, set Ak={x:λk(x)+c(yk(x)−ψ(x))>0}\mathcal{A}_k = \{x : \lambda^k(x) + c(y^k(x) - \psi(x)) > 0\}Ak​={x:λk(x)+c(yk(x)−ψ(x))>0}, Ik=Ω∖Ak\mathcal{I}_k = \Omega\setminus\mathcal{A}_kIk​=Ω∖Ak​, and solve

Ayk+1+λk+1=f,yk+1=ψ on Ak,λk+1=0 on Ik.Ay^{k+1} + \lambda^{k+1} = f, \qquad y^{k+1} = \psi \text{ on } \mathcal{A}_k, \qquad \lambda^{k+1} = 0 \text{ on } \mathcal{I}_k.Ayk+1+λk+1=f,yk+1=ψ on Ak​,λk+1=0 on Ik​.

A sequence obeying this rule for every kkk is a run. Superlinear convergence of xk→x∗x^k \to x^*xk→x∗ means xk→x∗x^k \to x^*xk→x∗ and, for every η>0\eta > 0η>0, eventually ∥xk+1−x∗∥≤η∥xk−x∗∥\|x^{k+1} - x^*\| \le \eta\|x^k - x^*\|∥xk+1−x∗∥≤η∥xk−x∗∥.

Formalization targets

Goal: Theorem 4.1 (p. 15)

The page reads: "Assume that (H1), (H2) hold and that ψ and f are in L^q(Ω). Then the primal-dual active set strategy or, equivalently, the semismooth Newton method converge superlinearly if ‖y⁰ − y*‖ is sufficiently small and λ⁰ = β(y⁰ − ψ)." The formalized goal is the statement the proof establishes: with c=βc = \betac=β, there is ρ>0\rho > 0ρ>0 such that every run with

∥y0−y∗∥L2<ρ,λ0=f−Ay0\|y^0 - y^*\|_{L^2} < \rho, \qquad \lambda^0 = f - Ay^0∥y0−y∗∥L2​<ρ,λ0=f−Ay0

converges superlinearly to (y∗,λ∗)(y^*, \lambda^*)(y∗,λ∗) in L2×L2L^2 \times L^2L2×L2. The initialization differs from the printed one; see Formalization scope.

Milestones

  1. Theorem 1.1 (Chen–Nashed–Qi): slant differentiability near a zero x∗x^*x∗ with uniformly bounded G(x)−1G(x)^{-1}G(x)−1 gives local superlinear convergence of xk+1=xk−G(xk)−1F(xk)x^{k+1} = x^k - G(x^k)^{-1}F(x^k)xk+1=xk−G(xk)−1F(xk).
  2. Proposition 4.1(ii): for 1≤p<q≤∞1 \le p < q \le \infty1≤p<q≤∞, max⁡(0,⋅):Lq→Lp\max(0,\cdot) : L^q \to L^pmax(0,⋅):Lq→Lp is slantly differentiable with slanting function GmG_mGm​.
  3. (4.9)–(4.10): for c=βc = \betac=β, (4.2) is equivalent to βy∗−βψ+max⁡(0,Cy∗−f+βψ)=0\beta y^* - \beta\psi + \max(0, Cy^* - f + \beta\psi) = 0βy∗−βψ+max(0,Cy∗−f+βψ)=0 and λ∗=f−Cy∗−βy∗\lambda^* = f - Cy^* - \beta y^*λ∗=f−Cy∗−βy∗.
  4. Equivalence of the algorithms: along a run with c=βc = \betac=β and λ0=f−Ay0\lambda^0 = f - Ay^0λ0=f−Ay0, λk+β(yk−ψ)=f−Cyk−βψ\lambda^k + \beta(y^k - \psi) = f - Cy^k - \beta\psiλk+β(yk−ψ)=f−Cyk−βψ for all kkk, so the active sets are those of the reduced algorithm.
  5. Slant differentiability of the reduced map F(y)=βy−βψ+max⁡(0,Cy−f+βψ)F(y) = \beta y - \beta\psi + \max(0, Cy - f + \beta\psi)F(y)=βy−βψ+max(0,Cy−f+βψ) on L2L^2L2, with GF(y+h)=βI+Gm(Cy−f+βψ+Ch)CG_F(y+h) = \beta I + G_m(Cy - f + \beta\psi + Ch)CGF​(y+h)=βI+Gm​(Cy−f+βψ+Ch)C, δ=1\delta = 1δ=1.
  6. Bounded inverses: GF(z)G_F(z)GF​(z) is invertible on L2L^2L2, with ∥GF(z)−1∥\|G_F(z)^{-1}\|∥GF​(z)−1∥ bounded uniformly in zzz.

Two companion items accompany the goal: existence of a run from every y0y^0y0, and Proposition 4.1(i), the paper's counterexamples showing that GmG_mGm​ fails to be a slanting function from LpL^pLp to LpL^pLp.

Significance

Theorem 4.1 is the infinite-dimensional justification of a method used throughout control-constrained optimal control: it shows that the method converges locally superlinearly for the continuous problem itself, not only for each discretization. Example 1 of the paper shows that distributed control of the Poisson equation, and boundary control with Sobolev embeddings, satisfy (H2). Proposition 4.1 isolates the structural reason: the pointwise max is a Newton-differentiable map only between spaces with a norm gap.

None of these results is known to be machine-checked. A complete development would provide slant differentiability in Banach spaces, the Chen–Nashed–Qi local convergence theorem, the norm-gap differentiability of max⁡(0,⋅)\max(0,\cdot)max(0,⋅) between Lebesgue spaces, and invertibility of block operators on L2L^2L2 of a measurable partition. Each of these is reusable for other semismooth Newton analyses in function space.

Difficulty

The obvious argument fails at the max. In finite dimension, max⁡(0,⋅)\max(0,\cdot)max(0,⋅) is slantly differentiable with GmG_mGm​ because a small perturbation does not change the sign of any nonzero component. In L2L^2L2, a perturbation hhh of small norm can flip the sign of yyy on a set of positive measure, and on that set the error max⁡(0,y+h)−max⁡(0,y)−Gm(y+h)h\max(0, y+h) - \max(0, y) - G_m(y+h)hmax(0,y+h)−max(0,y)−Gm​(y+h)h is as large as ∣y∣|y|∣y∣. Proposition 4.1(i) shows that this error is not o(∥h∥Lp)o(\|h\|_{L^p})o(∥h∥Lp​) in LpL^pLp for any ppp. Superlinear convergence in L2L^2L2 therefore needs the argument of the max to be controlled in a stronger norm than the error is measured in, which is what (H2) and f,ψ∈Lqf, \psi \in L^qf,ψ∈Lq provide. A second difficulty is that the two-variable algorithm is not literally a Newton method for a map of yyy alone; it must be identified with the reduced algorithm, and that identification depends on the initialization.

Formalization scope

  • Spaces. LpL^pLp is Mathlib's Lp ℝ p μ on an arbitrary finite measure space; q∈(2,∞]q \in (2, \infty]q∈(2,∞] is an extended real with 2 < q. The paper's bounded Lipschitz domain is replaced by a finite measure space: the proofs use only ∣Ω∣<∞|\Omega| < \infty∣Ω∣<∞, and Mathlib has no notion of Lipschitz boundary.
  • Pointwise statements on LpL^pLp classes are almost everywhere statements about representatives. (H2) is stated as Ay=Cy+βyAy = Cy + \beta yAy=Cy+βy a.e. for every y∈L2y \in L^2y∈L2, which avoids building the inclusion Lq⊆L2L^q \subseteq L^2Lq⊆L2.
  • Hypotheses kept: self-adjointness of AAA, (H1) with explicit γ>0\gamma > 0γ>0, (H2) with β>0\beta > 0β>0 and q>2q > 2q>2, f,ψ∈Lqf, \psi \in L^qf,ψ∈Lq. The solution (y∗,λ∗)(y^*, \lambda^*)(y∗,λ∗) of (4.2) is a hypothesis; it exists and is unique under (H1), as the paper states on p. 12.
  • The initialization. The printed λ0=β(y0−ψ)\lambda^0 = \beta(y^0 - \psi)λ0=β(y0−ψ) does not support the proof, which uses "λ0+β(y0−ψ)=f−Cy0−βψ\lambda^0 + \beta(y^0 - \psi) = f - Cy^0 - \beta\psiλ0+β(y0−ψ)=f−Cy0−βψ" and c=βc = \betac=β. That identity holds exactly for λ0=f−Ay0\lambda^0 = f - Ay^0λ0=f−Ay0. The goal uses λ0=f−Ay0\lambda^0 = f - Ay^0λ0=f−Ay0 and c=βc = \betac=β. With the printed initialization the first active set is {y0>ψ}\{y^0 > \psi\}{y0>ψ}, and for y0y^0y0 slightly below y∗y^*y∗ the first iterate solves the unconstrained problem, which can be far from y∗y^*y∗.
  • Superlinear convergence is stated for the pair (yk,λk)(y^k, \lambda^k)(yk,λk) in the product norm max⁡(∥y∥,∥λ∥)\max(\|y\|, \|\lambda\|)max(∥y∥,∥λ∥), without dividing by ∥xk−x∗∥\|x^k - x^*\|∥xk−x∗∥, so finite termination qualifies. "Sufficiently small" is an ∃ρ>0\exists\rho > 0∃ρ>0 chosen before the run, on ∥y0−y∗∥\|y^0 - y^*\|∥y0−y∗∥ only.
  • No trivialization. The goal mentions neither the reduced algorithm, nor GFG_FGF​, nor Proposition 4.1; the norm gap q>2q > 2q>2 is not weakened to C∈L(L2)C \in \mathcal{L}(L^2)C∈L(L2), under which Proposition 4.1(i) shows that GmG_mGm​ need not be a slanting function; and the companion run_exists shows that the runs the goal quantifies over exist.
  • Definitions (PDASNewton.FunSpace.Setting): slanting functions, superlinear convergence, GmG_mGm​, property (A) for max⁡(0,⋅):Lq→Lp\max(0,\cdot) : L^q \to L^pmax(0,⋅):Lq→Lp, system (4.2), one step and runs of the algorithm. These duplicate the finite-dimensional definitions of the other missions of the series in a separate namespace.

Proofs of any milestone are welcome, as are reusable lemmas on Lebesgue spaces (Hölder on sets of small measure, multiplication operators, Lax–Milgram on L2L^2L2 of a measurable subset).

Selected references

  • M. Hintermüller, K. Ito, K. Kunisch, The primal-dual active set strategy as a semismooth Newton method, SIAM J. Optim. 13(3) (2002) 865–888. https://doi.org/10.1137/S1052623401383558 ; authors' version https://hal.science/hal-01660511
  • X. Chen, Z. Nashed, L. Qi, Smoothing methods and semismooth methods for nondifferentiable operator equations, SIAM J. Numer. Anal. 38 (2000) 1200–1216. https://doi.org/10.1137/S0036142999356719
  • M. Ulbrich, Semismooth Newton methods for operator equations in function spaces, SIAM J. Optim. 13 (2003) 805–841. https://doi.org/10.1137/S1052623400371569
  • L. Qi, J. Sun, A nonsmooth version of Newton's method, Math. Programming 58 (1993) 353–367. https://doi.org/10.1007/BF01581275
9 thms1 active userReviewed
Dynamic ProgrammingMachine LearningReinforcement Learning·Captain: mikedeng1

On the Sample Complexity of Reinforcement Learning I: Approximate Policy Iteration with Max-Norm Evaluation Error ε Is Eventually Within 2ε/(1−γ)² of OptimalTextbook

Motivation

Most practical reinforcement-learning methods do not compute value functions exactly. They alternate between estimating a value function from data, usually with a parametric approximator, and acting greedily with respect to that estimate. Approximate value iteration and approximate policy iteration are the two classical schemes of this kind, and their error analysis decides how accuracy in the estimation step translates into quality of the policies produced. Chapter 3 of S. M. Kakade's thesis On the Sample Complexity of Reinforcement Learning (University College London, 2003) collects the basic guarantees, developed from Bertsekas (Dynamic Programming: Deterministic and Stochastic Models, 1987) for greedy policies, Singh and Yee (1994), and Bertsekas and Tsitsiklis, Neuro-Dynamic Programming (Athena Scientific, 1996). The bounds are stated in terms of the worst-case (max-norm) error of the evaluation step, and the thesis uses them to argue that max-norm error is the obstacle to state-space-independent sample complexity results for these methods, which motivates the later chapters of the thesis.

Setting

A finite discounted Markov decision process consists of a finite set of states SSS, a finite nonempty set of actions AAA, a transition kernel P(s′∣s,a)P(s'\mid s,a)P(s′∣s,a) (for every (s,a)(s,a)(s,a) a probability distribution over SSS), a deterministic reward r(s,a)∈[0,1]r(s,a)\in[0,1]r(s,a)∈[0,1], and a discount factor 0≤γ<10\le\gamma<10≤γ<1. A policy π(a∣s)\pi(a\mid s)π(a∣s) is a probability distribution over actions for every state; a deterministic policy is a map f:S→Af:S\to Af:S→A, identified with the policy that plays f(s)f(s)f(s) with probability one.

Values are normalized: the value of π\piπ at sss is

Vπ(s)=(1−γ) E[∑t≥0γtr(st,at) ∣ π, s0=s],V_\pi(s)=(1-\gamma)\,\mathbb E\Big[\sum_{t\ge0}\gamma^t r(s_t,a_t)\,\Big|\,\pi,\ s_0=s\Big],Vπ​(s)=(1−γ)E[t≥0∑​γtr(st​,at​)​π, s0​=s],

and the state-action value is Qπ(s,a)=(1−γ)r(s,a)+γ Es′∼P(⋅∣s,a)[Vπ(s′)]Q_\pi(s,a)=(1-\gamma)r(s,a)+\gamma\,\mathbb E_{s'\sim P(\cdot\mid s,a)}[V_\pi(s')]Qπ​(s,a)=(1−γ)r(s,a)+γEs′∼P(⋅∣s,a)​[Vπ​(s′)]. With rewards in [0,1][0,1][0,1], every value lies in [0,1][0,1][0,1]. An optimal policy π∗\pi^*π∗ has Vπ∗(s)≥Vπ(s)V_{\pi^*}(s)\ge V_\pi(s)Vπ∗​(s)≥Vπ​(s) for every policy π\piπ and state sss; write V∗=Vπ∗V^*=V_{\pi^*}V∗=Vπ∗​ and Q∗=Qπ∗Q^*=Q_{\pi^*}Q∗=Qπ∗​. The max norm is ∥x∥∞=max⁡s∣x(s)∣\|x\|_\infty=\max_s|x(s)|∥x∥∞​=maxs​∣x(s)∣ on state vectors and max⁡s,a∣x(s,a)∣\max_{s,a}|x(s,a)|maxs,a​∣x(s,a)∣ on state-action arrays.

The backup operator is [BJ](s)=max⁡a((1−γ)r(s,a)+γ Es′∼P(⋅∣s,a)[J(s′)])[BJ](s)=\max_a\big((1-\gamma)r(s,a)+\gamma\,\mathbb E_{s'\sim P(\cdot\mid s,a)}[J(s')]\big)[BJ](s)=maxa​((1−γ)r(s,a)+γEs′∼P(⋅∣s,a)​[J(s′)]). A deterministic policy fff is greedy with respect to QQQ if f(s)∈arg⁡max⁡aQ(s,a)f(s)\in\arg\max_a Q(s,a)f(s)∈argmaxa​Q(s,a) for every sss.

  • γ\gammaγ-approximate value iteration produces vectors J0=0,J1,J2,…J_0=0,J_1,J_2,\dotsJ0​=0,J1​,J2​,… with ∥Jt−BJt−1∥∞≤ε\|J_t-BJ_{t-1}\|_\infty\le\varepsilon∥Jt​−BJt−1​∥∞​≤ε, and greedy policies πt\pi_tπt​ for the lookahead (1−γ)r(s,a)+γ Es′[Jt(s′)](1-\gamma)r(s,a)+\gamma\,\mathbb E_{s'}[J_t(s')](1−γ)r(s,a)+γEs′​[Jt​(s′)].
  • γ\gammaγ-approximate policy iteration starts from any deterministic π0\pi_0π0​, forms an estimate Q~t\tilde Q_tQ~​t​ of QπtQ_{\pi_t}Qπt​​ with ∥Q~t−Qπt∥∞≤ε\|\tilde Q_t-Q_{\pi_t}\|_\infty\le\varepsilon∥Q~​t​−Qπt​​∥∞​≤ε, and takes πt+1\pi_{t+1}πt+1​ greedy with respect to Q~t\tilde Q_tQ~​t​.

Formalization targets

Goal: Theorem 3.2.2 (approximate policy iteration)

lim sup⁡t→∞∥V∗−Vπt∥∞≤2ε(1−γ)2.\limsup_{t\to\infty}\|V^*-V_{\pi_t}\|_\infty\le\frac{2\varepsilon}{(1-\gamma)^2}.t→∞limsup​∥V∗−Vπt​​∥∞​≤(1−γ)22ε​.

The policies need not converge; the statement bounds where they end up.

Milestones

  • Theorem 3.1.1: if ∥Q~−Q∗∥∞≤ε\|\tilde Q-Q^*\|_\infty\le\varepsilon∥Q~​−Q∗∥∞​≤ε and π\piπ is greedy for Q~\tilde QQ~​, then Vπ(s)≥V∗(s)−2ε1−γV_\pi(s)\ge V^*(s)-\frac{2\varepsilon}{1-\gamma}Vπ​(s)≥V∗(s)−1−γ2ε​ for all sss.
  • Lemma 3.2.3: ∥V∗−Vπt+1∥∞≤γ∥V∗−Vπt∥∞+2ε1−γ\|V^*-V_{\pi_{t+1}}\|_\infty\le\gamma\|V^*-V_{\pi_t}\|_\infty+\frac{2\varepsilon}{1-\gamma}∥V∗−Vπt+1​​∥∞​≤γ∥V∗−Vπt​​∥∞​+1−γ2ε​.
  • Rate of approximate policy iteration (p. 41): ∥V∗−Vπt∥∞≤γt+2ε(1−γ)2\|V^*-V_{\pi_t}\|_\infty\le\gamma^t+\frac{2\varepsilon}{(1-\gamma)^2}∥V∗−Vπt​​∥∞​≤γt+(1−γ)22ε​.
  • Contraction of the backup (p. 26): ∥BJ−BJ′∥∞≤γ∥J−J′∥∞\|BJ-BJ'\|_\infty\le\gamma\|J-J'\|_\infty∥BJ−BJ′∥∞​≤γ∥J−J′∥∞​.
  • Approximate value iteration (p. 40): ∥V∗−Jt∥∞≤γt+ε1−γ\|V^*-J_t\|_\infty\le\gamma^t+\frac{\varepsilon}{1-\gamma}∥V∗−Jt​∥∞​≤γt+1−γε​.
  • Rate of approximate value iteration (p. 41): ∥V∗−Vπt∥∞≤2γt1−γ+2ε(1−γ)2\|V^*-V_{\pi_t}\|_\infty\le\frac{2\gamma^t}{1-\gamma}+\frac{2\varepsilon}{(1-\gamma)^2}∥V∗−Vπt​​∥∞​≤1−γ2γt​+(1−γ)22ε​.
  • Theorem 3.2.1: the same lim sup bound 2ε(1−γ)2\frac{2\varepsilon}{(1-\gamma)^2}(1−γ)22ε​ for approximate value iteration.

Significance

The results give the standard performance guarantee for greedy approximate dynamic programming: an evaluation error of ε\varepsilonε in max norm costs at most 2ε/(1−γ)22\varepsilon/(1-\gamma)^22ε/(1−γ)2 in max-norm suboptimality, uniformly over the asymptotic set of policies, with a geometric rate of approach. Example 3.1.2 of the thesis shows that the factor 2ε/(1−γ)2\varepsilon/(1-\gamma)2ε/(1−γ) of Theorem 3.1.1 is attained, so the greedy step itself cannot be improved; the two factors of the horizon 1/(1−γ)1/(1-\gamma)1/(1−γ) in the limit bound are the reason the thesis turns to other error measures in later chapters.

All the statements are classical and proved in the literature (Bertsekas–Tsitsiklis 1996, Chapter 6, in the unnormalized model and with a factor γ\gammaγ to spare in the limit bounds); Lemma 3.2.3 and Theorem 3.2.2 are stated in the thesis without proof. To our knowledge none has a machine-checked proof. The mission produces formal proofs in the normalized model shared with the formalization of Kakade–Langford (2002) on this platform, so later chapters of the series (conservative policy iteration, policy search) can compare against them.

Difficulty

Approximate policy iteration is not monotone: with evaluation errors, Vπt+1V_{\pi_{t+1}}Vπt+1​​ can be worse than VπtV_{\pi_t}Vπt​​ at some states, so the argument of exact policy iteration, which uses Vπt+1≥VπtV_{\pi_{t+1}}\ge V_{\pi_t}Vπt+1​​≥Vπt​​ everywhere, does not apply. The difficulty of Lemma 3.2.3 is to control the distance to optimality without improvement at each step, combining the greedy step with the lack of monotonicity of the new policy's value; the thesis calls the proof of Theorem 3.2.2 "somewhat technical" and omits it. A second, mechanical difficulty is that the normalized value VπV_\piVπ​ is defined as an infinite series, so its Bellman equation Vπ(s)=Qπ(s,π(s))V_\pi(s)=Q_\pi(s,\pi(s))Vπ​(s)=Qπ​(s,π(s)), the optimality equation V∗=BV∗V^*=BV^*V∗=BV∗ and the bound 0≤Vπ≤10\le V_\pi\le10≤Vπ​≤1 have to be derived from that definition before any of the recursions can be run.

Formalization scope

  • The model is the published normalized model ApproxOptRL.Shared.Model: value P r γ π is VπV_\piVπ​ (defined as (1−γ)(1-\gamma)(1−γ) times a tsum), qValue is QπQ_\piQπ​. SSS and AAA are finite types, AAA nonempty; PPP satisfies IsTransitionKernel; every statement assumes 0≤r≤10\le r\le10≤r≤1 and 0≤γ<10\le\gamma<10≤γ<1.
  • The optimal policy is a binder π∗\pi^*π∗ with IsOptimalPolicy P r γ πstar (a stationary stochastic policy dominating every stationary stochastic policy at every state). Such a policy exists for every finite MDP (p. 26 of the thesis), and for finite MDPs it is optimal among all policies.
  • Policies of the runs are deterministic, S → A, and are evaluated through the indicator policy detPolicy. "Greedy" is the relation ∀ s a, Q s a ≤ Q s (f s): every tie-breaking rule is covered.
  • The runs are sequences indexed by ℕ, with the greedy and accuracy conditions as hypotheses at every index; the value-iteration condition is written for indices t+1t+1t+1 and ttt.
  • ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ is Mathlib's sup norm on S → ℝ and S → A → ℝ.
  • The lim sup statements are in ε\varepsilonε–NNN form: for every δ>0\delta>0δ>0 the bound plus δ\deltaδ holds eventually.
  • Ruled out: the accuracy hypothesis is stated against QπtQ_{\pi_t}Qπt​​, the value of the current policy, not against Q∗Q^*Q∗, and the greedy relation genuinely constrains πt+1\pi_{t+1}πt+1​; with either changed, the hypotheses would be unsatisfiable or the policies unconstrained and the theorem empty.
  • Infrastructure needed and reusable beyond this mission: the Bellman equation of the normalized value for indicator policies, V∗=BV∗V^*=BV^*V∗=BV∗, monotonicity and contraction of policy-evaluation and backup operators in the normalized model, and the bound 0≤Vπ≤10\le V_\pi\le10≤Vπ​≤1. Contributions of these lemmas are welcome.

Selected references

  • S. M. Kakade, On the Sample Complexity of Reinforcement Learning, PhD thesis, Gatsby Computational Neuroscience Unit, University College London, 2003. https://discovery.ucl.ac.uk/id/eprint/10100726/
  • D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming, Athena Scientific, 1996. ISBN 1-886529-10-8.
  • S. P. Singh and R. C. Yee, An upper bound on the loss from approximate optimal-value functions, Machine Learning 16 (1994), 227–233. https://doi.org/10.1007/BF00993104
  • S. M. Kakade and J. Langford, Approximately optimal approximate reinforcement learning, ICML 2002. https://dl.acm.org/doi/10.5555/645531.656005
13 thms1 active userReviewed
Convex OptimizationOperations ResearchProbability·Captain: mikedeng1

Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion 2: With Random Objective, Z(x) = Z_D(x) = Z_DD(x) and Moment-Matching Distributions Attain Z(x) AsymptoticallyResearch Paper

Motivation

Two-stage stochastic linear programming chooses a first-stage decision xxx before a random parameter is revealed and pays an optimal second-stage (recourse) cost afterwards. The classical model fixes the distribution of the random parameter. In practice it is rarely known beyond a few moments, and a decision maker who is averse to risk does not evaluate the recourse cost by its plain expectation. Bertsimas, Doan, Natarajan and Teo (Math. Oper. Res. 35(3), 2010) take both points seriously: the distribution is only known to belong to the class of all distributions with given mean and second-moment matrix, the cost is passed through a convex piecewise-linear disutility, and the decision is evaluated against the worst distribution in the class.

Moment-based worst-case bounds go back to Scarf's newsvendor and to the Chebyshev-type bounds of the moment problem (Isii 1962; Bertsimas and Popescu 2005). Delage and Ye (Oper. Res. 58(3), 2010) showed that a broad class of such minimax problems is solvable in polynomial time by the ellipsoid method. For the case in which the uncertainty sits in the objective of the second-stage linear program, this paper gives a single semidefinite program (its Theorem 2.1, the subject of a companion mission) and, in §2.2, identifies the distributions that come arbitrarily close to the worst case. This mission is about the second result.

Setting

The first-stage region is X={x∈Rn:Ax=b, x≥0}X=\{x\in\mathbb R^n : Ax=b,\ x\ge0\}X={x∈Rn:Ax=b, x≥0}. For x∈Xx\in Xx∈X the recourse set is X(x)={w∈Rd:Ww=h−Tx, w≥0}X(x)=\{w\in\mathbb R^d : Ww=h-Tx,\ w\ge0\}X(x)={w∈Rd:Ww=h−Tx, w≥0} and the second-stage cost of an objective vector q∈Rdq\in\mathbb R^dq∈Rd is

Q(q,x)=min⁡w∈X(x)q′w.\mathcal Q(q,x)=\min_{w\in X(x)} q'w .Q(q,x)=w∈X(x)min​q′w.

The disutility is U(t)=max⁡k=1,…,K(αkt+βk)\mathbb U(t)=\max_{k=1,\dots,K}(\alpha_k t+\beta_k)U(t)=maxk=1,…,K​(αk​t+βk​) with αk≥0\alpha_k\ge0αk​≥0. The moment class P\mathcal PP consists of the distributions PPP of a random vector q~∈Rd\tilde q\in\mathbb R^dq~​∈Rd with EP[q~]=μ\mathbb E_P[\tilde q]=\muEP​[q~​]=μ and EP[q~q~′]=Q\mathbb E_P[\tilde q\tilde q']=QEP​[q~​q~​′]=Q. The worst-case value at xxx is

Z(x)=sup⁡P∈PEP[U(Q(q~,x))].Z(x)=\sup_{P\in\mathcal P}\mathbb E_P\big[\mathbb U(\mathcal Q(\tilde q,x))\big].Z(x)=P∈Psup​EP​[U(Q(q~​,x))].

Its dual (6) is

ZD(x)=min⁡Y,y,y0 Q⋅Y+μ′y+y0s.t.q′Yq+q′y+y0≥U(Q(q,x))  ∀q∈Rd,Z_D(x)=\min_{Y,y,y_0}\ Q\cdot Y+\mu'y+y_0\quad\text{s.t.}\quad q'Yq+q'y+y_0\ge\mathbb U(\mathcal Q(q,x))\ \ \forall q\in\mathbb R^d ,ZD​(x)=Y,y,y0​min​ Q⋅Y+μ′y+y0​s.t.q′Yq+q′y+y0​≥U(Q(q,x))  ∀q∈Rd,

with YYY symmetric and Q⋅Y=∑ijQijYijQ\cdot Y=\sum_{ij}Q_{ij}Y_{ij}Q⋅Y=∑ij​Qij​Yij​. Its semidefinite reformulation (8) has the dual (9):

ZDD(x)=max⁡ ∑k=1K(h−Tx)′pk+βkvk0s.t.∑k=1K(Vkvkvk′vk0)=(Qμμ′1), (Vkvkvk′vk0)⪰0, W′pk≤αkvk.Z_{DD}(x)=\max\ \sum_{k=1}^K (h-Tx)'p_k+\beta_kv_{k0}\quad\text{s.t.}\quad \sum_{k=1}^K\begin{pmatrix}V_k&v_k\\ v_k'&v_{k0}\end{pmatrix}=\begin{pmatrix}Q&\mu\\ \mu'&1\end{pmatrix},\ \begin{pmatrix}V_k&v_k\\ v_k'&v_{k0}\end{pmatrix}\succeq0,\ W'p_k\le\alpha_kv_k .ZDD​(x)=max k=1∑K​(h−Tx)′pk​+βk​vk0​s.t.k=1∑K​(Vk​vk′​​vk​vk0​​)=(Qμ′​μ1​), (Vk​vk′​​vk​vk0​​)⪰0, W′pk​≤αk​vk​.

Its variables are scaled conditional moments: vk0v_{k0}vk0​ is the probability that the kkkth piece of U\mathbb UU is active, and vkv_kvk​, VkV_kVk​ are the first and second moments of q~\tilde qq~​ on that event, multiplied by vk0v_{k0}vk0​.

The standing assumptions are Assumption 3, {p∈Rr:W′p≤q}≠∅\{p\in\mathbb R^r : W'p\le q\}\ne\emptyset{p∈Rr:W′p≤q}=∅ for every qqq, so that Q(q,x)\mathcal Q(q,x)Q(q,x) is finite, and Assumption 4, Q−μμ′≻0Q-\mu\mu'\succ0Q−μμ′≻0. Recourse sets are assumed nonempty.

Formalization targets

Goal: Theorem 2.2

For every x∈Xx\in Xx∈X there is a sequence Pj∈PP_j\in\mathcal PPj​∈P with EPj[U(Q(q~,x))]→Z(x)\mathbb E_{P_j}[\mathbb U(\mathcal Q(\tilde q,x))]\to Z(x)EPj​​[U(Q(q~​,x))]→Z(x), and

Z(x)=ZD(x)=ZDD(x),Z(x)=Z_D(x)=Z_{DD}(x),Z(x)=ZD​(x)=ZDD​(x),

where all three are finite optimal values: a supremum over a nonempty bounded-above set, an infimum over a nonempty bounded-below set, and a supremum over a nonempty bounded-above set.

Milestones

  1. Lemma 2.1: ZDD(x)≥Z(x)Z_{DD}(x)\ge Z(x)ZDD​(x)≥Z(x), in the form "each P∈PP\in\mathcal PP∈P gives a feasible point of (9) whose objective equals EP[U(Q)]\mathbb E_P[\mathbb U(\mathcal Q)]EP​[U(Q)]".
  2. (9) has an optimal solution.
  3. Q(⋅,x)\mathcal Q(\cdot,x)Q(⋅,x) is positively homogeneous and superadditive.
  4. If W′p≤αvW'p\le\alpha vW′p≤αv with α≥0\alpha\ge0α≥0 then αQ(v,x)≥(h−Tx)′p\alpha\mathcal Q(v,x)\ge(h-Tx)'pαQ(v,x)≥(h−Tx)′p.
  5. Jensen: E[Q(r~,x)]≤Q(Er~,x)\mathbb E[\mathcal Q(\tilde r,x)]\le\mathcal Q(\mathbb E\tilde r,x)E[Q(r~,x)]≤Q(Er~,x), with Q(r~,x)\mathcal Q(\tilde r,x)Q(r~,x) integrable.
  6. An optimal solution of (9) can be chosen so that every block has vk0>0v_{k0}>0vk0​>0 or vanishes.
  7. Strong duality Z(x)=ZD(x)Z(x)=Z_D(x)Z(x)=ZD​(x) (§2.1).

Significance

Theorem 2.2 says that the semidefinite bound is tight and that the worst case is approached by explicit mixtures. With probability vk0v_{k0}vk0​ the cost vector sits at the conditional mean vk/vk0v_k/v_{k0}vk​/vk0​, and with a small probability it is perturbed by a large Gaussian. The construction tells which scenarios a minimax solution guards against. The paper's numerical section uses it to stress-test solutions computed under other distributional assumptions. For the risk-neutral case (K=1K=1K=1) the bound collapses to Jensen's bound min⁡w∈X(x)μ′w\min_{w\in X(x)}\mu'wminw∈X(x)​μ′w. For K>1K>1K>1 it is a combination of Jensen bounds, one per piece of the disutility.

Theorem 2.2 is proved in the paper; no part of it, nor the strong duality of the moment problem that it relies on, is formalized on the platform or, to our knowledge, elsewhere. The mission asks for machine-checked proofs of the identity Z=ZD=ZDDZ=Z_D=Z_{DD}Z=ZD​=ZDD​ and of the steps of the extremal construction. Several of these are reusable beyond this paper: weak and strong duality of moment problems, the existence of optimal solutions of moment-type semidefinite programs, and Jensen's inequality for the value function of a linear program.

Difficulty

Most of the argument is linear programming and bookkeeping. The step Z(x)=ZD(x)Z(x)=Z_D(x)Z(x)=ZD​(x) is a strong-duality theorem for an infinite-dimensional linear program over measures. The paper cites it from Isii's theory of the moment problem, and none of that theory exists in Mathlib. The construction of near-extremal distributions also needs care. A single distribution in P\mathcal PP generally cannot attain Z(x)Z(x)Z(x), so the bound is reached only along a family whose second moments are matched by rare, large perturbations. Lemma 2.1 needs measurable selections of an active piece of U\mathbb UU and of a dual optimal solution of the second-stage program as functions of qqq. When the optimal solution of (9) has zero-weight blocks, the mixture is undefined until the solution is first rearranged.

Formalization scope

Vectors are Fin d → ℝ, matrices Matrix (Fin r) (Fin d) ℝ, and distributions are probability measures on Fin d → ℝ with square-integrable coordinates. They are not densities as in the paper's (5). The moment class uses the published MomentDRO.Conf definitions, and E[q~q~′]\mathbb E[\tilde q\tilde q']E[q~​q~​′] is the uncentred second moment. The paper writes ppp both for the dimension of qqq and for dual vectors. Here the dimension is ddd and dual vectors are named π. Indices kkk are zero-based. Bordered matrices are Matrix.fromBlocks on Fin d ⊕ Fin 1 and ⪰0\succeq0⪰0 is Matrix.PosSemidef. Q\mathcal QQ is a real infimum and the optimal values are real sSup/sInf of value sets. Every statement that uses an optimal value also asserts IsLUB/IsGLB, so junk values cannot make a statement true.

As printed, Assumption 2 (complete recourse) and Assumption 3 for all qqq contradict each other whenever WWW has a row. The formalization keeps Assumption 3 for all qqq and replaces complete recourse by nonemptiness of X(x)X(x)X(x), which is what §2's proofs use. Assumption 1 is not used and is omitted. The hypotheses are jointly satisfiable, for example by W=IW=IW=I, T=0T=0T=0, h=0h=0h=0, μ=0\mu=0μ=0 and Q=IQ=IQ=I.

The sequence clause of Theorem 2.2 alone holds for every finite supremum, so it does not capture the theorem. The goal therefore also asserts the equalities Z=ZD=ZDDZ=Z_D=Z_{DD}Z=ZD​=ZDD​, with all three values genuine, and these carry the content. A formalization that drops them, or states them only through junk values, is ruled out.

A complete development needs the duality theory of the moment problem, Jensen's inequality for concave functions on Rd\mathbb R^dRd, compactness arguments for semidefinite feasible sets, and multivariate Gaussian mixtures (ProbabilityTheory.multivariateGaussian in Mathlib). Proofs of individual milestones are welcome. So is a general moment-problem duality theorem from which strong_duality follows.

Selected references

  • D. Bertsimas, X. V. Doan, K. Natarajan, C.-P. Teo, Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion, Mathematics of Operations Research 35(3):580–602, 2010. https://doi.org/10.1287/moor.1100.0445
  • E. Delage, Y. Ye, Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems, Operations Research 58(3):595–612, 2010. https://doi.org/10.1287/opre.1090.0741
  • K. Isii, On sharpness of Tchebycheff-type inequalities, Annals of the Institute of Statistical Mathematics 14:185–197, 1962. https://doi.org/10.1007/BF02868641
  • D. Bertsimas, I. Popescu, Optimal Inequalities in Probability Theory: A Convex Optimization Approach, SIAM Journal on Optimization 15(3):780–804, 2005. https://doi.org/10.1137/S1052623401399903
11 thms1 active userReviewed
Operations Research·Captain: mikedeng1

Reliable Facility Location Design Under the Risk of Disruptions 3: The Relaxed Subproblem's Set Function Φ_i Is SupermodularResearch Paper

Motivation

Facilities fail: plants close, warehouses flood, suppliers strike. Reliable facility location models choose facility sites knowing that each opened site may be unavailable, and they assign every customer a primary facility and an ordered list of backups. Snyder and Daskin (Transportation Science, 2005) introduced the level-assignment formulation with a common failure probability. Cui, Ouyang and Shen (Operations Research 58(4), 2010; working paper UCTC-FR-2010-02, February 2010) let every site jjj have its own failure probability qjq_jqj​, with failures independent. With site-dependent probabilities, even for fixed open sites, the best backup list for one customer is no longer simply the nearest sites in order of distance (their Example 1, p. 11).

The paper solves the model by Lagrangian relaxation. Relaxing the constraints that link assignments to open sites splits the problem into one relaxed subproblem (RSPi_ii​) per customer iii, solved at every subgradient iteration. The authors show that (RSPi_ii​) is the minimization of a set function Φi\Phi_iΦi​ over sets of at most RRR sites, and their Proposition 3 asserts that Φi\Phi_iΦi​ is supermodular, which makes the branch-and-bound algorithm of Goldengorin et al. for supermodular minimization applicable. This mission formalizes Proposition 3 and the steps of its proof (Appendix A.3).

Setting

Fix a customer iii with demand rate λi≥0\lambda_i \ge 0λi​≥0 and unserved-demand penalty φi\varphi_iφi​. There are JJJ regular sites j=0,…,J−1j = 0, \dots, J-1j=0,…,J−1 with unit costs dijd_{ij}dij​, failure probabilities 0≤qj<10 \le q_j < 10≤qj​<1 and Lagrange multipliers μij\mu_{ij}μij​. An emergency facility with index JJJ never fails (qJ=0q_J = 0qJ​=0) and costs diJ=φid_{iJ} = \varphi_idiJ​=φi​ per unit: being served by it means not being served. The customer is assigned at levels r=0,1,…,Rr = 0, 1, \dots, Rr=0,1,…,R with R≥1R \ge 1R≥1. A level-rrr facility serves the customer exactly when the facilities at levels 0,…,r−10, \dots, r-10,…,r−1 have all failed.

The variables are Yjr∈{0,1}Y_{jr} \in \{0,1\}Yjr​∈{0,1} (site jjj is the level-rrr facility), PjrP_{jr}Pjr​ (the probability that jjj serves at level rrr, given the earlier levels) and WjrW_{jr}Wjr​, which the linearization constraints force to equal PjrYjrP_{jr} Y_{jr}Pjr​Yjr​. The constraints of (RSPi_ii​) say that every level is filled by one regular site or comes after the emergency facility, that each regular site is used at most once, that the emergency facility appears exactly once, and that

Pj0=1−qj,Pjr=(1−qj)∑k=0J−1qk1−qkWk,r−1(1≤r≤R).P_{j0} = 1 - q_j, \qquad P_{jr} = (1-q_j) \sum_{k=0}^{J-1} \frac{q_k}{1-q_k} W_{k,r-1} \quad (1 \le r \le R).Pj0​=1−qj​,Pjr​=(1−qj​)k=0∑J−1​1−qk​qk​​Wk,r−1​(1≤r≤R).

For a set S⊆{0,…,J−1}S \subseteq \{0, \dots, J-1\}S⊆{0,…,J−1}, Φi(S)\Phi_i(S)Φi​(S) is the minimum of

∑j=0J∑r=0RλidijWjr+∑j∈Sμij\sum_{j=0}^{J} \sum_{r=0}^{R} \lambda_i d_{ij} W_{jr} + \sum_{j \in S} \mu_{ij}j=0∑J​r=0∑R​λi​dij​Wjr​+j∈S∑​μij​

over the feasible points that use no regular site outside SSS. The customer's subproblem is min⁡{Φi(S):∣S∣≤R}\min\{\Phi_i(S) : |S| \le R\}min{Φi​(S):∣S∣≤R}.

Formalization targets

Goal: Proposition 3 in the form (18)

For every customer iii, every S⊆{0,…,J−1}S \subseteq \{0, \dots, J-1\}S⊆{0,…,J−1} and all regular sites u≠vu \ne vu=v outside SSS with ∣S∣+2≤R|S| + 2 \le R∣S∣+2≤R,

Φi(S∪{u,v})−Φi(S∪{u}) ≥ Φi(S∪{v})−Φi(S).\Phi_i(S \cup \{u,v\}) - \Phi_i(S \cup \{u\}) \ \ge\ \Phi_i(S \cup \{v\}) - \Phi_i(S).Φi​(S∪{u,v})−Φi​(S∪{u}) ≥ Φi​(S∪{v})−Φi​(S).

The paper states "Φi\Phi_iΦi​ is supermodular" without restriction. That statement is false: for sets larger than RRR the inequality can fail (an instance with J=5J = 5J=5, R=3R = 3R=3 is recorded in the goal's statement). The cardinality bound covers all the sets the subproblem ranges over, and the paper's proof uses it implicitly.

Milestones (Appendix A.3)

  1. Closed form. If ∣S∣≤R|S| \le R∣S∣≤R and S={j1,…,jn}S = \{j_1, \dots, j_n\}S={j1​,…,jn​} is listed by nondecreasing distance, then Φi(S)=λi∑k=1nˉ+1Ck+∑j∈Sμij\Phi_i(S) = \lambda_i \sum_{k=1}^{\bar n+1} C_k + \sum_{j \in S} \mu_{ij}Φi​(S)=λi​∑k=1nˉ+1​Ck​+∑j∈S​μij​, where nˉ\bar nnˉ counts the elements of SSS with dij≤φid_{ij} \le \varphi_idij​≤φi​, Pk=∏ℓ≤kqjℓP_k = \prod_{\ell \le k} q_{j_\ell}Pk​=∏ℓ≤k​qjℓ​​, Ck=Pk−1(1−qjk)dijkC_k = P_{k-1}(1-q_{j_k}) d_{ij_k}Ck​=Pk−1​(1−qjk​​)dijk​​ for k≤nˉk \le \bar nk≤nˉ and Cnˉ+1=PnˉφiC_{\bar n+1} = P_{\bar n}\varphi_iCnˉ+1​=Pnˉ​φi​.
  2. Marginal cost. For v∉Sv \notin Sv∈/S with ∣S∣+1≤R|S| + 1 \le R∣S∣+1≤R and div≤φid_{iv} \le \varphi_idiv​≤φi​: Φi(S∪{v})−Φi(S)=λi(1−qv)[Ptdiv−∑k=t+1nˉ+1Ck]+μiv\Phi_i(S\cup\{v\}) - \Phi_i(S) = \lambda_i(1-q_v)\big[P_t d_{iv} - \sum_{k=t+1}^{\bar n+1} C_k\big] + \mu_{iv}Φi​(S∪{v})−Φi​(S)=λi​(1−qv​)[Pt​div​−∑k=t+1nˉ+1​Ck​]+μiv​, with ttt the number of elements of SSS no farther than vvv. If div≥φid_{iv} \ge \varphi_idiv​≥φi​ the marginal cost is μiv\mu_{iv}μiv​.
  3. Sign. Ptdiv−∑k=t+1nˉ+1Ck≤0P_t d_{iv} - \sum_{k=t+1}^{\bar n+1} C_k \le 0Pt​div​−∑k=t+1nˉ+1​Ck​≤0 when div≤φid_{iv} \le \varphi_idiv​≤φi​.
  4. Case 1 (diu≤divd_{iu} \le d_{iv}diu​≤div​) and Case 2 (diu>divd_{iu} > d_{iv}diu​>div​): explicit formulas for Φi(S∪{u,v})−Φi(S∪{u})\Phi_i(S\cup\{u,v\}) - \Phi_i(S\cup\{u\})Φi​(S∪{u,v})−Φi​(S∪{u}) in terms of the CkC_kCk​ of SSS.

Significance

Supermodularity of Φi\Phi_iΦi​ is what the paper's exact algorithm for (RSPi_ii​) rests on: the branch-and-bound method of Goldengorin et al. prunes by comparing marginal costs, and its correctness requires them to be monotone. Each Lagrangian iteration solves III such subproblems, so this property sits inside the paper's whole solution method. The closed form (milestone 1) is also a self-contained statement about the optimal backup order with site-dependent failure probabilities: once the set of sites is fixed, nearest-first is optimal, and sites beyond the penalty distance are never used.

Formally, nothing in this mission is machine-checked yet. The paper's argument has gaps that a formalization has to repair: the missing cardinality hypothesis; a "strict" sign claim (milestone 3) that is only weak when some qj=0q_j = 0qj​=0 or div=φid_{iv} = \varphi_idiv​=φi​; counts printed as infima; and an intermediate inequality in Case 2 that does not hold as printed, although the case's conclusion does. A checked proof settles which version of Proposition 3 is true.

Difficulty

The algebra of the cases is routine once the closed form is available. The hard step is the closed form itself: Φi(S)\Phi_i(S)Φi​(S) is defined as the minimum of a mixed-integer program, and the paper justifies the closed form only by "a similar argument as in the proof of Proposition 2", an exchange argument. One has to show that every feasible point is a nearest-first chain truncated at the emergency facility, that PPP and WWW are then determined by YYY, that reordering a chain by distance never increases the cost, and that adding a site within the penalty distance never hurts. With at most RRR regular levels, the exchange must respect the level budget. This is exactly where the cardinality hypothesis enters.

A tempting shortcut is to define Φi\Phi_iΦi​ by its closed form. That makes milestone 1 true by definition and detaches the goal from the optimization problem; the definition here is the program (5).

Formalization scope

Lean conventions: one customer at a time, with the index iii dropped in the definition. Regular sites are Fin J; all sites are Fin (J+1), with Fin.last J the emergency facility, whose cost φi\varphi_iφi​ and probability 000 are built into the extended data. Levels are Fin (R+1). Variables are real-valued, with Yjr∈{0,1}Y_{jr} \in \{0,1\}Yjr​∈{0,1} as a constraint. Φi(S)\Phi_i(S)Φi​(S) is the infimum of the set of feasible objective values. This set is nonempty and bounded below, and in fact finite, so the infimum is the minimum. Data hypotheses: λi≥0\lambda_i \ge 0λi​≥0, 0≤qj<10 \le q_j < 10≤qj​<1, R≥1R \ge 1R≥1; costs, penalties and multipliers carry no sign assumption. The list j1,…,jnj_1, \dots, j_nj1​,…,jn​ is any duplicate-free list of SSS sorted by distance. Ties are allowed.

Printed typos corrected in the definitions: the level constraint (4b) counts the emergency facility in its first sum; (5b) includes the linearization constraints (4h); (5c) covers regular site 000; (5a) has λi\lambda_iλi​ for the undefined hih_ihi​.

Excluding the configurations with ∣S∪{u,v}∣>R|S \cup \{u, v\}| > R∣S∪{u,v}∣>R from the goal is deliberate. Weakening the goal further, for example to λi=0\lambda_i = 0λi​=0 or to sets on which Φi\Phi_iΦi​ is modular, would trivialize it.

Contributions welcome: a proof of the closed form (an exchange argument on level chains, reusable for the other propositions of the paper), then the marginal-cost algebra and the two cases.

Selected references

  • T. Cui, Y. Ouyang, Z.-J. M. Shen, Reliable Facility Location Design under the Risk of Disruptions, UCTC-FR-2010-02 (working paper, Feb. 2010); published in Operations Research 58(4):998–1011, 2010. https://doi.org/10.1287/opre.1090.0801
  • L. V. Snyder, M. S. Daskin, Reliability Models for Facility Location: The Expected Failure Cost Case, Transportation Science 39(3):400–416, 2005. https://doi.org/10.1287/trsc.1040.0107
  • B. Goldengorin, G. Sierksma, G. A. Tijssen, M. Tso, The Data-Correcting Algorithm for the Minimization of Supermodular Functions, Management Science 45(11):1539–1551, 1999. https://doi.org/10.1287/mnsc.45.11.1539
8 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Supply Chain Coordination Under Channel Rebates with Sales Effort Effects IV: A Larger Return Credit Strictly Increases the Retailer's Sales EffortResearch Paper

Returns and the retailer's incentive for sales effort

A manufacturer that sells through a retailer can accept returns: it pays a return credit bbb for every unit the retailer has not sold at the end of the season. Returns policies are common in publishing, software and computer hardware, and since Pasternack (Marketing Science, 1985) they have been studied as a way to make the retailer order more. Retailers also raise demand through sales effort: merchandising, shelf space, point-of-sale advertising. A recurring view in the marketing and operations literature is that returns weaken this incentive. Padmanabhan and Png (1995, p. 70) write that "by reducing the risk of losses due to excess inventory, a returns policy lessens some of the retailer's incentive to invest in such efforts", and Kandel (1996, p. 348) makes the same argument for consignment.

T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects (Management Science 48(8), 2002), studies a newsvendor retailer who chooses an order quantity and a sales effort level before demand is observed. Its Proposition 4 shows that in this model the conventional view is reversed: a larger return credit makes the retailer exert strictly more effort. This mission formalizes that proposition and the solution of the retailer's problem it rests on.

Setting

Prices satisfy 0<c<w<p0<c<w<p0<c<w<p and s<cs<cs<c (Assumption A1): ppp is the retail price, www the wholesale price, ccc the manufacturing cost and sss the salvage value, which may be negative. A demand factor ξ≥0\xi\ge 0ξ≥0 has a density φ\varphiφ with φ(ξ)>0\varphi(\xi)>0φ(ξ)>0 for every ξ≥0\xi\ge0ξ≥0 (Assumption A4), distribution function Φ(Q)=∫0Qφ\Phi(Q)=\int_0^Q\varphiΦ(Q)=∫0Q​φ and partial mean Γ(Q)=∫0Qξ dΦ(ξ)\Gamma(Q)=\int_0^Q\xi\,d\Phi(\xi)Γ(Q)=∫0Q​ξdΦ(ξ).

The retailer chooses an effort level e≥0e\ge0e≥0, and demand is eξe\xieξ. Effort costs V(e)V(e)V(e), where VVV is strictly convex and strictly increasing with V(0)=0V(0)=0V(0)=0 (Assumption A5; the paper declares every convexity and monotonicity statement strict). Write Λ(γ)=γV′(γ)−V(γ)\Lambda(\gamma)=\gamma V'(\gamma)-V(\gamma)Λ(γ)=γV′(γ)−V(γ).

Under a returns-only contract (w,b)(w,b)(w,b) with b∈[s,w)b\in[s,w)b∈[s,w), the retailer orders Q≥0Q\ge0Q≥0, exerts effort e≥0e\ge 0e≥0, and earns the expected profit

R‾b(Q,e)=−wQ+p Emin⁡(Q,eξ)+b E(Q−eξ)+−V(e).\underline R_b(Q,e)=-wQ+p\,E\min(Q,e\xi)+b\,E(Q-e\xi)^+-V(e).R​b​(Q,e)=−wQ+pEmin(Q,eξ)+bE(Q−eξ)+−V(e).

This is the integrated channel's profit Π(Q,e)=−cQ+pEmin⁡(Q,eξ)+sE(Q−eξ)+−V(e)\Pi(Q,e)=-cQ+pE\min(Q,e\xi)+sE(Q-e\xi)^+-V(e)Π(Q,e)=−cQ+pEmin(Q,eξ)+sE(Q−eξ)+−V(e) with www in place of ccc and bbb in place of sss. An optimal pair is a maximizer of R‾b\underline R_bR​b​ over Q≥0Q\ge0Q≥0, e≥0e\ge0e≥0. The paper's e‾\underline ee​ is the effort of such a pair, and Q‾0\underline Q_0Q​0​ is the critical fractile Φ(Q‾0)=(p−w)/(p−b)\Phi(\underline Q_0)=(p-w)/(p-b)Φ(Q​0​)=(p−w)/(p−b).

Formalization targets

Goal: Proposition 4 (p. 1004)

If s≤b2<b1<ws\le b_2<b_1<ws≤b2​<b1​<w, (Q1,e1)(Q_1,e_1)(Q1​,e1​) is an optimal pair under the credit b1b_1b1​, (Q2,e2)(Q_2,e_2)(Q2​,e2​) is an optimal pair under b2b_2b2​, and e2>0e_2>0e2​>0, then

e2<e1.e_2<e_1 .e2​<e1​.

The paper writes this as ∂e‾/∂b>0\partial\underline e/\partial b>0∂e​/∂b>0. Its proof shows strict monotonicity, and that is the statement here.

Milestone 1: the order for a given effort (§4.2, p. 1000)

For a fixed e>0e>0e>0, the unique maximizer of Q↦R‾b(Q,e)Q\mapsto\underline R_b(Q,e)Q↦R​b​(Q,e) over Q≥0Q\ge0Q≥0 is Q2=e Q‾0Q_2=e\,\underline Q_0Q2​=eQ​0​, and

max⁡Q≥0R‾b(Q,e)=e (p−b) Γ(Q‾0)−V(e).\max_{Q\ge0}\underline R_b(Q,e)=e\,(p-b)\,\Gamma(\underline Q_0)-V(e).Q≥0max​R​b​(Q,e)=e(p−b)Γ(Q​0​)−V(e).

Milestone 2: the optimal effort (§4.2, p. 1000)

An optimal pair (Q,e‾)(Q,\underline e)(Q,e​) with e‾>0\underline e>0e​>0 satisfies

V′(e‾)=(p−b) Γ(Q‾0),Q=e‾ Q‾0,R‾b(Q,e‾)=Λ(e‾),V'(\underline e)=(p-b)\,\Gamma(\underline Q_0),\qquad Q=\underline e\,\underline Q_0,\qquad \underline R_b(Q,\underline e)=\Lambda(\underline e),V′(e​)=(p−b)Γ(Q​0​),Q=e​Q​0​,R​b​(Q,e​)=Λ(e​),

and conversely every e>0e>0e>0 solving this first-order condition gives the optimal pair (eQ‾0,e)(e\underline Q_0,e)(eQ​0​,e).

Significance

The result. Proposition 4 separates two effects of a return credit. For a fixed order quantity, a larger credit lowers the marginal value of effort: it pays the retailer for unsold units, and effort only matters through sold units. This is the fixed-quantity comparison on which the conventional view rests; Cachon's survey states it for buy-backs as Eq. (19) (on Prove2Me as CachonCoord.EffortNewsvendor.sec_6_4_1_effort_coordination, clause 1). Once the order quantity is chosen together with the effort, the larger credit raises the order, and the effort follows. For the multiplicative demand model the net effect is unambiguous for every demand density and every convex effort cost. A manufacturer that wants more retailer effort can therefore use the return credit as a lever, and a model that ignores the quantity response gets the sign wrong.

Formalizing it. The result is proved in the paper, in a four-line appendix argument that relies on the §4.2 solution of the retailer's problem; neither is machine-checked anywhere. The mission produces a checked newsvendor-with-effort solution (the scaling Q2=eQ‾0Q_2=e\underline Q_0Q2​=eQ​0​ and the profit Λ(e‾)\Lambda(\underline e)Λ(e​)), which the other missions of this series and any multiplicative-effort supply-chain model can reuse, and a checked statement of the comparative statics in the return credit.

Difficulty

The obvious argument differentiates the retailer's first-order condition in bbb with the order held fixed, and it gives the wrong sign; the order quantity must be re-optimized. The correct comparison runs through the reduced problem in the effort alone, and it needs the §4.2 solution in full: the scaling of the optimal order with the effort, which turns Emin⁡(Q,eξ)E\min(Q,e\xi)Emin(Q,eξ) and E(Q−eξ)+E(Q-e\xi)^+E(Q−eξ)+ into newsvendor expectations of ξ\xiξ at Q/eQ/eQ/e; the value of the optimal order as a function of eee; and the first-order characterization of the optimal effort. The comparison across credits then involves two objects: the function Λ\LambdaΛ, and the retailer's reduced profits under the two credits at a common effort level. The statement compares maximizers of two different optimization problems, not roots of an equation, so a formal proof must connect optimality of the pair to the first-order condition, which uses the strict convexity of VVV and the positivity of the density.

Formalization scope

Everything lives in the namespace ChannelRebate.ReturnsEffort. The definitions file holds:

  • Demand: a measurable density φ\varphiφ, zero on (−∞,0)(-\infty,0)(−∞,0), positive on [0,∞)[0,\infty)[0,∞), integrating to 111, with finite mean;
  • the law of ξ\xiξ;
  • Φ\PhiΦ and Γ\GammaΓ as interval integrals;
  • EffortCost: A5 with strict convexity and strict monotonicity on [0,∞)[0,\infty)[0,∞) and V(0)=0V(0)=0V(0)=0;
  • Λ\LambdaΛ;
  • the retailer's profit returnsProfit;
  • optimal orders and optimal pairs as maximizers over Q≥0Q\ge0Q≥0 (and e≥0e\ge0e≥0).

The expectations are the published CachonCoord.Newsvendor.expSales and expLeftover applied to the law of eξe\xieξ (the image of the law of ξ\xiξ under x↦exx\mapsto exx↦ex).

The formalization makes the following commitments, each recorded on its item:

  • Φ−1\Phi^{-1}Φ−1 is never an inverse function: Q‾0\underline Q_0Q​0​ is a positive solution of Φ(Q‾0)=(p−w)/(p−b)\Phi(\underline Q_0)=(p-w)/(p-b)Φ(Q​0​)=(p−w)/(p−b).
  • The paper writes (∂/∂e)V(\partial/\partial e)V(∂/∂e)V without stating that VVV is differentiable. Differentiability on (0,∞)(0,\infty)(0,∞), with derivative V′V'V′, is a hypothesis.
  • The paper restricts attention to strictly positive effort (p. 1000). The goal therefore assumes e2>0e_2>0e2​>0; without it both optimal efforts could be 000 when V′(0+)V'(0^+)V′(0+) is large, and the strict inequality would fail.
  • Existence of optimal pairs is a hypothesis, as on p. 999 ("assume the cost of effort function and demand distribution are chosen such that the existence of an optimal solution is assured").
  • The credit satisfies b<wb<wb<w strictly; at b=wb=wb=w the critical fractile is undefined.

The goal is about optimal pairs of the joint problem. Defining e‾\underline ee​ as the root of the first-order condition, or fixing the order quantity and varying bbb, would give a different and, in the second case, false statement; neither is the target.

Contributions are welcome:

  • a proof of the scaling identity Emin⁡(Q,eξ)=e Emin⁡(Q/e,ξ)E\min(Q,e\xi)=e\,E\min(Q/e,\xi)Emin(Q,eξ)=eEmin(Q/e,ξ);
  • a proof of the newsvendor value identity (p−b)Emin⁡(q,ξ)−(w−b)q=(p−b)Γ(q)(p-b)E\min(q,\xi)-(w-b)q=(p-b)\Gamma(q)(p−b)Emin(q,ξ)−(w−b)q=(p−b)Γ(q) at the critical fractile, reusable for any newsvendor with a density;
  • proofs of the two milestones;
  • the goal theorem.

The two facts the paper's proof uses — that Λ\LambdaΛ is strictly increasing on (0,∞)(0,\infty)(0,∞), and that the retailer's reduced profit at a fixed effort increases with the credit — may be posted as supporting theorems.

Selected references

  • T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8):992–1007, 2002. https://doi.org/10.1287/mnsc.48.8.992.168
  • B. A. Pasternack, Optimal Pricing and Return Policies for Perishable Commodities, Marketing Science 4(2):166–176, 1985. https://doi.org/10.1287/mksc.4.2.166
  • V. Padmanabhan, I. P. L. Png, Returns Policies: Make Money by Making Good, Sloan Management Review 37(1):65–72, 1995.
  • E. Kandel, The Right to Return, Journal of Law and Economics 39(1):329–356, 1996. https://doi.org/10.1086/467352
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in OR & MS 11, Elsevier, 2003, §6.4.1. https://doi.org/10.1016/S0927-0507(03)11006-7
5 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Supply Chain Coordination Under Channel Rebates with Sales Effort Effects II: A Target Rebate and Returns Contract Coordinates Effort and Quantity Under Uniform DemandResearch Paper

Motivation

Manufacturers of computer hardware, software and automobiles routinely pay their retailers channel rebates: a payment per unit the retailer sells to end customers. A target rebate pays only for units sold beyond a target level. These industries also commonly offer returns: a credit for each unsold unit. Both instruments are used to change the retailer's behaviour, and the retailer controls two things that matter to the manufacturer: how much stock she orders, and how much sales effort she exerts to raise demand. Effort cannot be observed or written into a contract, but sales can.

T. A. Taylor's paper (Management Science 48(8), 2002) asks whether a contract built on sales and returns can make an independent retailer choose the effort level and the order quantity that maximize the profit of the whole supply chain, while splitting that profit in any desired proportion. Its Proposition 2 shows that returns alone, linear rebates alone, or target rebates alone cannot do this. Its Theorem 2, the goal of this mission, shows that a target rebate combined with returns can, when demand is uniform and effort cost is quadratic.

Setting

A manufacturer with unit production cost ccc sells to a retailer at wholesale price www; the retailer sells at the fixed retail price ppp, and unsold units have salvage value sss. The standing assumption is 0<c<w<p0<c<w<p0<c<w<p and s<cs<cs<c (sss may be negative). Before demand is seen, the retailer chooses an order quantity Q≥0Q\ge0Q≥0 and an effort level e≥0e\ge0e≥0. Demand is eξe\xieξ, where ξ\xiξ is uniform on [0,1][0,1][0,1], with distribution function Φ\PhiΦ and Γ(x)=∫0xξ dΦ(ξ)\Gamma(x)=\int_0^x\xi\,d\Phi(\xi)Γ(x)=∫0x​ξdΦ(ξ). Effort costs V(e)=ae2/2V(e)=ae^2/2V(e)=ae2/2, a>0a>0a>0.

The integrated channel, which owns both firms, earns

Π(Q,e)=−cQ+pEmin⁡(Q,eξ)+sE(Q−eξ)+−V(e).\Pi(Q,e)=-cQ+pE\min(Q,e\xi)+sE(Q-e\xi)^+-V(e).Π(Q,e)=−cQ+pEmin(Q,eξ)+sE(Q−eξ)+−V(e).

Its optimum uses the critical fractile Qˉ0\bar Q_0Qˉ​0​, defined by Φ(Qˉ0)=(p−c)/(p−s)\Phi(\bar Q_0)=(p-c)/(p-s)Φ(Qˉ​0​)=(p−c)/(p−s), the effort eˉ=(p−s)Γ(Qˉ0)/a\bar e=(p-s)\Gamma(\bar Q_0)/aeˉ=(p−s)Γ(Qˉ​0​)/a and the order Qˉ=eˉQˉ0\bar Q=\bar e\bar Q_0Qˉ​=eˉQˉ​0​. Its optimal profit is Π=Λ(eˉ)\Pi=\Lambda(\bar e)Π=Λ(eˉ), where Λ(γ)=γV′(γ)−V(γ)\Lambda(\gamma)=\gamma V'(\gamma)-V(\gamma)Λ(γ)=γV′(γ)−V(γ).

A target rebate and returns contract (w,u,b,T)(w,u,b,T)(w,u,b,T) pays the retailer u>0u>0u>0 for every unit sold beyond the target TTT, and credits her b∈[s,w)b\in[s,w)b∈[s,w) for every unsold unit. Her profit is

R(Q,e∣T)=−wQ+pEmin⁡(Q,eξ)+uE(min⁡(Q,eξ)−T)++bE(Q−eξ)+−V(e).R(Q,e\mid T)=-wQ+pE\min(Q,e\xi)+uE(\min(Q,e\xi)-T)^+ +bE(Q-e\xi)^+-V(e).R(Q,e∣T)=−wQ+pEmin(Q,eξ)+uE(min(Q,eξ)−T)++bE(Q−eξ)+−V(e).

The manufacturer earns M(Q,e∣T)=(w−c)Q−uE(min⁡(Q,eξ)−T)+−(b−s)E(Q−eξ)+M(Q,e\mid T)=(w-c)Q-uE(\min(Q,e\xi)-T)^+-(b-s)E(Q-e\xi)^+M(Q,e∣T)=(w−c)Q−uE(min(Q,eξ)−T)+−(b−s)E(Q−eξ)+. The other quantities the statements use are:

  • the fractiles Q‾0\underline Q_0Q​0​ and Q‾1\underline Q_1Q​1​, with Φ(Q‾0)=(p−w)/(p−b)\Phi(\underline Q_0)=(p-w)/(p-b)Φ(Q​0​)=(p−w)/(p−b) and Φ(Q‾1)=(p+u−w)/(p+u−b)\Phi(\underline Q_1)=(p+u-w)/(p+u-b)Φ(Q​1​)=(p+u−w)/(p+u−b);
  • the returns-only effort e‾=(p−b)Γ(Q‾0)/a\underline e=(p-b)\Gamma(\underline Q_0)/ae​=(p−b)Γ(Q​0​)/a;
  • a threshold τ∈[Q‾0,Q‾1]\tau\in[\underline Q_0,\underline Q_1]τ∈[Q​0​,Q​1​] that separates the retailer's low and high orders;
  • the retailer's best profit at effort eee, A(e∣T)=max⁡Q≥0R(Q,e∣T)A(e\mid T)=\max_{Q\ge0}R(Q,e\mid T)A(e∣T)=maxQ≥0​R(Q,e∣T).

Contract terms of Theorem 2. Put ζ(T)=4a2(p−s)3T2\zeta(T)=4a^2(p-s)^3T^2ζ(T)=4a2(p−s)3T2 and

u(T)=(w−c)(p−c)5(p−c)5−ζ(T),b(T)=s+(w−c)(p−c)6−(p−s)ζ(T)(p−c)6−(p−c)ζ(T),T3=(p−c)32a(p−s)2.u(T)=(w-c)\frac{(p-c)^5}{(p-c)^5-\zeta(T)},\qquad b(T)=s+(w-c)\frac{(p-c)^6-(p-s)\zeta(T)}{(p-c)^6-(p-c)\zeta(T)},\qquad T_3=\frac{(p-c)^3}{2a(p-s)^2}.u(T)=(w−c)(p−c)5−ζ(T)(p−c)5​,b(T)=s+(w−c)(p−c)6−(p−c)ζ(T)(p−c)6−(p−s)ζ(T)​,T3​=2a(p−s)2(p−c)3​.

T1T_1T1​ and T2T_2T2​ are the fixed points on [0,T3][0,T_3][0,T3​] of T↦e‾τT\mapsto\underline e\tauT↦e​τ and T↦eˉτT\mapsto\bar e\tauT↦eˉτ, with e‾\underline ee​ and τ\tauτ evaluated at u(T)u(T)u(T), b(T)b(T)b(T). L‾(T,w)\underline L(T,w)L​(T,w) and Lˉ(T)\bar L(T)Lˉ(T) are the retailer's profits at effort e‾\underline ee​ and at effort eˉ\bar eeˉ.

Formalization targets

Goal: Theorem 2 (p. 1002)

For every κ∈(0,Π)\kappa\in(0,\Pi)κ∈(0,Π) there is ε0>0\varepsilon_0>0ε0​>0 such that for every ε∈(0,min⁡(κ,ε0))\varepsilon\in(0,\min(\kappa,\varepsilon_0))ε∈(0,min(κ,ε0​)) the following holds. Pairs (w∗,T∗)(w^*,T^*)(w∗,T∗) with

w∗∈(c,p),T∗∈(T1,T2),L‾(T∗,w∗)=κ−ε,Lˉ(T∗)=κw^*\in(c,p),\qquad T^*\in(T_1,T_2),\qquad \underline L(T^*,w^*)=\kappa-\varepsilon,\qquad \bar L(T^*)=\kappaw∗∈(c,p),T∗∈(T1​,T2​),L​(T∗,w∗)=κ−ε,Lˉ(T∗)=κ

exist. Every such pair gives u∗=u(T∗)>0u^*=u(T^*)>0u∗=u(T∗)>0, b∗=b(T∗)∈(s,w∗)b^*=b(T^*)\in(s,w^*)b∗=b(T∗)∈(s,w∗) and T∗>0T^*>0T∗>0. The pair (Qˉ,eˉ)(\bar Q,\bar e)(Qˉ​,eˉ) is the retailer's unique optimum under (w∗,u∗,b∗,T∗)(w^*,u^*,b^*,T^*)(w∗,u∗,b∗,T∗), and

R(Qˉ,eˉ∣T∗)=κ,M(Qˉ,eˉ∣T∗)=Π−κ.R(\bar Q,\bar e\mid T^*)=\kappa,\qquad M(\bar Q,\bar e\mid T^*)=\Pi-\kappa.R(Qˉ​,eˉ∣T∗)=κ,M(Qˉ​,eˉ∣T∗)=Π−κ.

Milestones

  1. §4.1: (Qˉ,eˉ)(\bar Q,\bar e)(Qˉ​,eˉ) is the unique maximizer of Π\PiΠ, with value Λ(eˉ)\Lambda(\bar e)Λ(eˉ).
  2. §4.2: under returns alone, (e‾ Q‾0,e‾)(\underline e\,\underline Q_0,\underline e)(e​Q​0​,e​) is the retailer's unique optimum, with value Λ(e‾)\Lambda(\underline e)Λ(e​).
  3. Lemma 2: at effort eee the retailer orders eQ‾0e\underline Q_0eQ​0​ if e<T/τe<T/\taue<T/τ, eQ‾1e\underline Q_1eQ​1​ if e>T/τe>T/\taue>T/τ, and either if e=T/τe=T/\taue=T/τ.
  4. The two-branch formula for A(e∣T)A(e\mid T)A(e∣T). Its derivative jumps up at T/τT/\tauT/τ, so T/τT/\tauT/τ is never optimal.
  5. Lemma 3: A(⋅∣T)A(\cdot\mid T)A(⋅∣T) is concave on [0,T/τ)[0,T/\tau)[0,T/τ), and either convex then concave, or concave, on (T/τ,∞)(T/\tau,\infty)(T/τ,∞).
  6. Lemma 4: a unique threshold Υ\UpsilonΥ decides whether the optimal effort lies above T/τT/\tauT/τ (at e^\hat ee^) or equals e‾\underline ee​.
  7. Lemma 5: the retailer's optimal (Q,e)(Q,e)(Q,e) in the three cases T<ΥT<\UpsilonT<Υ, T>ΥT>\UpsilonT>Υ, T=ΥT=\UpsilonT=Υ.
  8. Lemma 6: T1T_1T1​ and T2T_2T2​ exist, are unique, and 0<T1<T2<T30<T_1<T_2<T_30<T1​<T2​<T3​.

Significance

The result. Theorem 2 shows that two contractible instruments can align two decisions, one of them not contractible. The rebate pushes effort and quantity up when sales are high, and the return credit raises both when demand is low. Together they reproduce the integrated channel's optimum (Qˉ,eˉ)(\bar Q,\bar e)(Qˉ​,eˉ), and the free parameter κ\kappaκ allocates the profit Π\PiΠ between the firms in any proportion. Proposition 2 of the same paper rules out each instrument alone. This makes Theorem 2 the basis for the paper's recommendation that rebates and returns be used together. The uniform instance is the only one in which the paper proves this; for normal demand it gives only numerical evidence.

Formalizing it. The theorem is proved in the paper; it has not been formalized. The printed proof treats the wholesale price as fixed while it varies: u(T)u(T)u(T) and b(T)b(T)b(T) contain www, so T1T_1T1​, T2T_2T2​ and Lˉ\bar LLˉ move with w∗w^*w∗. A machine-checked proof therefore has to repair the argument, not only transcribe it. A numerical check (p = 10, c = 4, s = 1, a = 1; for example κ = 1.2, ε = 0.012 gives w* ≈ 4.889, T* ≈ 1.095) found the statement itself consistent.

Difficulty

The retailer's problem is not concave. For fixed effort, R(⋅,e∣T)R(\cdot,e\mid T)R(⋅,e∣T) has a kink at Q=TQ=TQ=T, and the optimal order jumps from eQ‾0e\underline Q_0eQ​0​ to eQ‾1e\underline Q_1eQ​1​ at e=T/τe=T/\taue=T/τ. After the order is optimized out, the profit in effort, A(⋅∣T)A(\cdot\mid T)A(⋅∣T), has an upward kink at T/τT/\tauT/τ and can be convex and then concave beyond it. Checking the first-order condition at eˉ\bar eeˉ is therefore not enough. Coordination is a statement about the global maximum of a kinked, non-concave function, and comparing the two local candidates is what the threshold Υ\UpsilonΥ and the profits L‾\underline LL​, Lˉ\bar LLˉ do. The contract is then pinned down by two equations in (w,T)(w,T)(w,T) whose coefficients themselves depend on www through u(T)u(T)u(T) and b(T)b(T)b(T).

Formalization scope

Everything is stated for ξ∼Uniform(0,1)\xi\sim\mathrm{Uniform}(0,1)ξ∼Uniform(0,1), taken as Lebesgue measure on [0,1][0,1][0,1], and for V(e)=ae2/2V(e)=ae^2/2V(e)=ae2/2, as in all of Lemmas 3–6 and Theorem 2. Lemma 2 and the §4.1–4.2 solutions, which the paper states for general demand, are specialised to this instance. The uniform law has bounded support, so the paper's Assumption A4 (positive density on [0,∞)[0,\infty)[0,∞)) is not imposed; the paper allows that relaxation on p. 995.

The expectations use the published expSales and expLeftover (Cachon's newsvendor definitions) of the image law of ξ\xiξ under x↦exx\mapsto exx↦ex. Φ\PhiΦ and Γ\GammaΓ are integrals of the uniform density, not hard-coded closed forms. Every inverse (Qˉ0\bar Q_0Qˉ​0​, Q‾0\underline Q_0Q​0​, Q‾1\underline Q_1Q​1​), the threshold τ\tauτ, the function jjj and its root Υ\UpsilonΥ, the fixed points T1T_1T1​, T2T_2T2​ and the profits L‾\underline LL​, Lˉ\bar LLˉ are stated by their defining equations, never by a choice function. "Optimal" means a maximizer over Q≥0Q\ge0Q≥0, e≥0e\ge0e≥0. Channel coordination means that the retailer's set of maximizers is exactly {(Qˉ,eˉ)}\{(\bar Q,\bar e)\}{(Qˉ​,eˉ)}. The manufacturer's profit MMM, which the paper does not display, is written from the contract's cash flows: units bought back at bbb are salvaged at sss.

A trivializing formalization is ruled out: coordination is global optimality of (Qˉ,eˉ)(\bar Q,\bar e)(Qˉ​,eˉ), not a first-order condition at eˉ\bar eeˉ. ε0\varepsilon_0ε0​ may depend on κ\kappaκ but not on ε\varepsilonε. T1T_1T1​ and T2T_2T2​ are tied to their fixed-point equations and are not free variables.

A complete development needs:

  • the closed forms of Φ\PhiΦ, Γ\GammaΓ and the three expectations under the uniform law;
  • scaling identities in eee;
  • maximization of piecewise concave functions with a kink;
  • one-dimensional intermediate value arguments, with the monotonicity needed to repair the proof of Theorem 2.

The uniform newsvendor identities and the kinked-maximization lemmas are reusable beyond this mission. Contributions to any milestone, and alternative proofs of the existence part of Theorem 2, are welcome.

Selected references

  • T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8):992–1007, 2002. https://doi.org/10.1287/mnsc.48.8.992.168
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science, Vol. 11, 2003. https://doi.org/10.1016/S0927-0507(03)11006-7
  • B. A. Pasternack, Optimal Pricing and Return Policies for Perishable Commodities, Marketing Science 4(2):166–176, 1985. https://doi.org/10.1287/mksc.4.2.166
11 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Supply Chain Coordination Under Channel Rebates with Sales Effort Effects I: A Target Rebate Coordinates the Newsvendor Channel and Splits Its Profit in Any ProportionResearch Paper

Motivation

Manufacturers in computer hardware, software and automobiles routinely pay channel rebates to their retailers: a payment per unit the retailer sells to end consumers, as opposed to per unit the retailer buys. A target rebate pays only for units sold beyond a target level, a linear rebate pays for every unit sold. T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8) (2002), doi:10.1287/mnsc.48.8.992.168, asks whether such payments can make an independent retailer act in the interest of the whole supply chain.

The question belongs to the supply-chain contracting literature built on the newsvendor model. A wholesale price above cost makes the retailer under-order relative to the integrated channel (double marginalization, Spengler 1950). Returns contracts (Pasternack 1985) and revenue sharing (Pasternack 1999; Cachon and Lariviere 2000, as cited by Taylor) are known remedies. Cachon's survey, Supply Chain Coordination with Contracts (Handbooks in OR & MS 11, 2003), discusses sales-rebate contracts through a first-order condition. Taylor's Theorem 1 is the global statement for the target rebate, with an explicit contract and an arbitrary profit split, and without any lump-sum side payment.

This mission covers §3 of the paper, the model without sales effort. Missions II–IV of the series cover §4, where the retailer's effort also affects demand.

Setting

A manufacturer sells to a retailer who places one order of size Q≥0Q \ge 0Q≥0 before observing demand ξ\xiξ. Demand has a density φ\varphiφ with φ(x)=0\varphi(x) = 0φ(x)=0 for x<0x < 0x<0 and φ(x)>0\varphi(x) > 0φ(x)>0 for every x≥0x \ge 0x≥0 (Assumption A4), and a finite mean. Write

Φ(Q)=∫0Qφ(x) dx,Γ(Q)=∫0Qx φ(x) dx.\Phi(Q) = \int_0^Q \varphi(x)\,dx, \qquad \Gamma(Q) = \int_0^Q x\,\varphi(x)\,dx .Φ(Q)=∫0Q​φ(x)dx,Γ(Q)=∫0Q​xφ(x)dx.

The retail price ppp, the production cost ccc and the salvage value sss are fixed with 0<c<p0 < c < p0<c<p and s<cs < cs<c; sss may be negative. A contract specifies a wholesale price www, a rebate u>0u > 0u>0 and a target T≥0T \ge 0T≥0 (Assumption A1: 0<c<w<p0 < c < w < p0<c<w<p, s<cs < cs<c, u>0u > 0u>0, T≥0T \ge 0T≥0). No other transfer is allowed (Assumption A3).

  • The integrated channel earns π(Q)=−cQ+pEmin⁡(Q,ξ)+sE(Q−ξ)+\pi(Q) = -cQ + pE\min(Q,\xi) + sE(Q-\xi)^+π(Q)=−cQ+pEmin(Q,ξ)+sE(Q−ξ)+. Its optimal order Qˉ0\bar Q_0Qˉ​0​ solves Φ(Qˉ0)=(p−c)/(p−s)\Phi(\bar Q_0) = (p-c)/(p-s)Φ(Qˉ​0​)=(p−c)/(p−s), and its optimal profit is π=(p−s)Γ(Qˉ0)\pi = (p-s)\Gamma(\bar Q_0)π=(p−s)Γ(Qˉ​0​).
  • Under the target rebate (w,u,T)(w,u,T)(w,u,T) the retailer earns
r(Q∣T)=−wQ+pEmin⁡(Q,ξ)+sE(Q−ξ)++uE(min⁡(Q,ξ)−T)+,r(Q\mid T) = -wQ + pE\min(Q,\xi) + sE(Q-\xi)^+ + uE(\min(Q,\xi)-T)^+,r(Q∣T)=−wQ+pEmin(Q,ξ)+sE(Q−ξ)++uE(min(Q,ξ)−T)+,

and the manufacturer earns m(Q∣T)=(w−c)Q−uE(min⁡(Q,ξ)−T)+m(Q\mid T) = (w-c)Q - uE(\min(Q,\xi)-T)^+m(Q∣T)=(w−c)Q−uE(min(Q,ξ)−T)+.

  • Under the wholesale price-only contract (u=0u = 0u=0) the retailer orders Q0Q_0Q0​ with Φ(Q0)=(p−w)/(p−s)\Phi(Q_0) = (p-w)/(p-s)Φ(Q0​)=(p−w)/(p−s) and earns r‾=(p−s)Γ(Q0)\underline r = (p-s)\Gamma(Q_0)r​=(p−s)Γ(Q0​).

The contract coordinates the channel when Qˉ0\bar Q_0Qˉ​0​ is the retailer's unique optimal order. Finally u^(w)=(w−c)(p−s)/(c−s)\hat u(w) = (w-c)(p-s)/(c-s)u^(w)=(w−c)(p−s)/(c−s).

Formalization targets

Goal: Theorem 1 (p. 996)

Fix κ∈(0,π)\kappa \in (0,\pi)κ∈(0,π). For every sufficiently small ε∈(0,κ)\varepsilon \in (0,\kappa)ε∈(0,κ) there is exactly one triple (w∗,u∗,T∗)(w^*,u^*,T^*)(w∗,u∗,T∗) with r‾(w∗)=κ−ε\underline r(w^*) = \kappa-\varepsilonr​(w∗)=κ−ε, u∗=u^(w∗)u^* = \hat u(w^*)u∗=u^(w∗), T∗≥0T^* \ge 0T∗≥0 and

(p+u∗−s)Γ(Qˉ0)−u∗(Γ(T∗)+T∗[1−Φ(T∗)])=κ,(1)(p+u^*-s)\Gamma(\bar Q_0) - u^*\big(\Gamma(T^*) + T^*[1-\Phi(T^*)]\big) = \kappa, \qquad (1)(p+u∗−s)Γ(Qˉ​0​)−u∗(Γ(T∗)+T∗[1−Φ(T∗)])=κ,(1)

and this triple has w∗∈(c,p)w^* \in (c,p)w∗∈(c,p), u∗>0u^*>0u∗>0, T∗>0T^*>0T∗>0, coordinates the channel, and gives the retailer r∗=κr^* = \kappar∗=κ and the manufacturer m∗=π−κm^* = \pi-\kappam∗=π−κ.

Milestones

  1. §3.1, p. 995. The newsvendor solutions: Qˉ0\bar Q_0Qˉ​0​ and Q0Q_0Q0​ are the unique optimal orders, with values (p−s)Γ(Qˉ0)(p-s)\Gamma(\bar Q_0)(p−s)Γ(Qˉ​0​) and (p−s)Γ(Q0)(p-s)\Gamma(Q_0)(p−s)Γ(Q0​), and Q0<Qˉ0Q_0 < \bar Q_0Q0​<Qˉ​0​.
  2. §3.2, p. 995. The piecewise form of r(⋅∣T)r(\cdot\mid T)r(⋅∣T), its derivative p−w−(p−s)Φ(Q)p-w-(p-s)\Phi(Q)p−w−(p−s)Φ(Q) below TTT and p+u−w−(p+u−s)Φ(Q)p+u-w-(p+u-s)\Phi(Q)p+u−w−(p+u−s)Φ(Q) above, strict concavity on [0,T)[0,T)[0,T) and (T,∞)(T,\infty)(T,∞), and an upward kink of the derivative at TTT.
  3. Lemma 1, p. 995. With Φ(Q1)=(p+u−w)/(p+u−s)\Phi(Q_1) = (p+u-w)/(p+u-s)Φ(Q1​)=(p+u−w)/(p+u−s), the equation r(Q0∣τ0)=r(Q1∣τ0)r(Q_0\mid\tau_0) = r(Q_1\mid\tau_0)r(Q0​∣τ0​)=r(Q1​∣τ0​) has exactly one root τ0∈[Q0,Q1]\tau_0 \in [Q_0,Q_1]τ0​∈[Q0​,Q1​], lying in (Q0,Q1)(Q_0,Q_1)(Q0​,Q1​); the retailer's optimal order set is {Q1}\{Q_1\}{Q1​} for T<τ0T<\tau_0T<τ0​, {Q0}\{Q_0\}{Q0​} for T>τ0T>\tau_0T>τ0​, and {Q0,Q1}\{Q_0,Q_1\}{Q0​,Q1​} for T=τ0T=\tau_0T=τ0​.
  4. §3.2, p. 996. The retailer's optimal profit is (p+u−s)Γ(Q1)−u(Γ(T)+T[1−Φ(T)])(p+u-s)\Gamma(Q_1) - u(\Gamma(T)+T[1-\Phi(T)])(p+u−s)Γ(Q1​)−u(Γ(T)+T[1−Φ(T)]) if T<τ0T<\tau_0T<τ0​ and (p−s)Γ(Q0)(p-s)\Gamma(Q_0)(p−s)Γ(Q0​) if T≥τ0T \ge \tau_0T≥τ0​.
  5. Proposition 1, p. 996. If T=0T = 0T=0, channel coordination requires m∗<0m^* < 0m∗<0.

Significance

Theorem 1 shows that a single sales-based instrument, a target rebate, achieves what a wholesale price alone cannot: the retailer orders the channel-optimal quantity, and the channel profit π\piπ is split in any proportion κ:π−κ\kappa : \pi-\kappaκ:π−κ. The parameter κ\kappaκ can be set to the retailer's opportunity cost, so a manufacturer with all the bargaining power extracts the rest of the channel profit without a side payment. Proposition 1 explains why the target is needed: a linear rebate that coordinates the channel leaves the manufacturer with a loss. The quantity-only analysis is also the base case of §4, where the paper shows that a target rebate combined with returns coordinates effort and quantity as well.

The results are proved in the paper (Appendix, p. 1005). No machine-checked proof of any of them is known to exist. The mission produces a Lean statement of the model and of each result, and invites formal proofs of the newsvendor solution, the shape of the kinked profit, the threshold lemma and the coordination theorem.

Difficulty

The retailer's profit r(⋅∣T)r(\cdot\mid T)r(⋅∣T) is not concave: its derivative jumps up at the target. The usual newsvendor argument, a stationary point of a concave function is a global maximum, therefore fails. A first-order condition at Qˉ0\bar Q_0Qˉ​0​ shows only that Qˉ0\bar Q_0Qˉ​0​ is a local candidate on (T,∞)(T,\infty)(T,∞). The retailer may still prefer the smaller candidate Q0Q_0Q0​ on [0,T][0,T][0,T], and coordination fails exactly when she does. Theorem 1(b) requires comparing the two branches globally, through the threshold τ0\tau_0τ0​ of Lemma 1, and then showing that the contract's target lies strictly below τ0\tau_0τ0​.

The contract itself is defined implicitly. w∗w^*w∗ solves an equation involving the critical fractile Q0(w)Q_0(w)Q0​(w), and T∗T^*T∗ solves (1). Existence and uniqueness of both, and the placement of T∗T^*T∗ relative to τ0\tau_0τ0​, are part of the claim.

Formalization scope

All definitions are in ChannelRebate.Quantity.Setting. Demand is a structure Demand carrying the density φ\varphiφ with the properties listed under Setting; its law is Lebesgue measure with density φ\varphiφ. Emin⁡(Q,ξ)E\min(Q,\xi)Emin(Q,ξ) and E(Q−ξ)+E(Q-\xi)^+E(Q−ξ)+ are expSales and expLeftover of the published definition CachonCoord_Newsvendor_Contracts, applied to this law. E(min⁡(Q,ξ)−T)+E(\min(Q,\xi)-T)^+E(min(Q,ξ)−T)+ is the local rebateUnits. Φ\PhiΦ and Γ\GammaΓ are interval integrals from 000.

Conventions:

  • Φ−1\Phi^{-1}Φ−1 is never a function. Each critical fractile (Qˉ0\bar Q_0Qˉ​0​, Q0Q_0Q0​, Q1Q_1Q1​) is a hypothesis giving its defining equation, and τ0\tau_0τ0​ is any solution of f0(τ0)=0f_0(\tau_0) = 0f0​(τ0​)=0 in [Q0,Q1][Q_0,Q_1][Q0​,Q1​].
  • An optimal order maximizes over Q≥0Q \ge 0Q≥0. "Coordination" and the order sets of Lemma 1 are equalities of the set of maximizers, so a tie with Q0Q_0Q0​ does not count as coordination.
  • "For ε\varepsilonε sufficiently small" is "there exists ε0>0\varepsilon_0 > 0ε0​>0 such that for all ε∈(0,min⁡(ε0,κ))\varepsilon \in (0,\min(\varepsilon_0,\kappa))ε∈(0,min(ε0​,κ))".
  • In Theorem 1 the uniqueness ranges over all real triples satisfying the specification, with www unrestricted; w∗∈(c,p)w^* \in (c,p)w∗∈(c,p) is a conclusion.
  • The manufacturer's profit is its own formula, never channel profit minus retailer profit; m∗=π−κm^* = \pi-\kappam∗=π−κ is a conclusion.
  • The standing assumptions A1, A3 and A4 appear as hypotheses or in Demand; no continuity of φ\varphiφ is assumed.

A formalization that reads coordination as the first-order condition at Qˉ0\bar Q_0Qˉ​0​, or that defines T∗T^*T∗ or w∗w^*w∗ by a choice function, would make Theorem 1 vacuous or weaker, and is ruled out by the statements above.

A complete development needs the newsvendor calculus for a density (derivatives of Emin⁡(Q,ξ)E\min(Q,\xi)Emin(Q,ξ) and E(Q−ξ)+E(Q-\xi)^+E(Q−ξ)+ in QQQ, strict monotonicity of Φ\PhiΦ on [0,∞)[0,\infty)[0,∞)), the intermediate value theorem for the two implicit equations, and the global comparison of the two concave branches. The newsvendor calculus is reusable for missions II–IV of this series and for other newsvendor contracts. Proofs of the milestones in any order are welcome.

Selected references

  • T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8):992–1007, 2002. doi:10.1287/mnsc.48.8.992.168
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science 11, 2003. doi:10.1016/S0927-0507(03)11006-7
  • B. A. Pasternack, Optimal Pricing and Return Policies for Perishable Commodities, Marketing Science 4(2):166–176, 1985. doi:10.1287/mksc.4.2.166
  • J. J. Spengler, Vertical Integration and Antitrust Policy, Journal of Political Economy 58(4):347–352, 1950. doi:10.1086/256964
8 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Quantitative Stability in Stochastic Programming: The Method of Probability Metrics 3: Mixed-Integer Two-Stage Programs Are Hölder Stable in the Polyhedral DiscrepancyResearch Paper

Motivation

Two-stage stochastic programs are solved with an approximation of the true distribution of the random data: an empirical measure, a scenario tree, or a discretization. Whether the computed decisions mean anything depends on how the optimal value and the solution set react when the underlying probability measure is replaced by a nearby one, and on which distance between measures "nearby" refers to. Rachev and Römisch (preprint, edoc.hu-berlin.de; published in Math. Oper. Res. 27 (2002) 792–818, doi:10.1287/moor.27.4.792.304) organize this question in two steps. First, a minimal information distance dFUd_{\mathcal F_{\mathcal U}}dFU​​, built from the integrands of the problem itself, controls optimal values and solution sets (their Theorems 2.2 and 2.3). Second, for a given class of models, dFUd_{\mathcal F_{\mathcal U}}dFU​​ is bounded by a canonical probability metric that depends only on the analytical properties of the integrands.

For linear two-stage programs the integrands are locally Lipschitz in the random parameter and the canonical metric is a Fortet–Mourier metric. When the second stage has integer variables, the recourse function is discontinuous, and metrics of Fortet–Mourier type no longer control the problem. This mission formalizes the paper's answer for that case (§3.2): mixed-integer two-stage programs are Hölder stable with respect to a polyhedral discrepancy d1,phkd_{1,phk}d1,phk​ built from Lipschitz functions restricted to polyhedra. The structure of mixed-integer value functions that makes this possible goes back to Blair and Jeroslow (1977), Bank et al. (1982) and Schultz (1996), all cited in the paper.

Setting

Let c∈Rmc\in\mathbb R^mc∈Rm, let X⊆RmX\subseteq\mathbb R^mX⊆Rm be closed and Ξ⊆Rs\Xi\subseteq\mathbb R^sΞ⊆Rs a polyhedron, i.e. an intersection of finitely many closed half-spaces. The second stage has costs q∈Rm^q\in\mathbb R^{\hat m}q∈Rm^, qˉ∈Rmˉ\bar q\in\mathbb R^{\bar m}qˉ​∈Rmˉ and (r,m^)(r,\hat m)(r,m^)- and (r,mˉ)(r,\bar m)(r,mˉ)-matrices WWW, Wˉ\bar WWˉ. Its value function is

Φ(t)=min⁡{qy+qˉyˉ: Wy+Wˉyˉ=t, y∈Z+m^, yˉ∈R+mˉ}(t∈Rr),\Phi(t)=\min\{qy+\bar q\bar y:\ Wy+\bar W\bar y=t,\ y\in\mathbb Z^{\hat m}_+,\ \bar y\in\mathbb R^{\bar m}_+\}\qquad(t\in\mathbb R^r),Φ(t)=min{qy+qˉ​yˉ​: Wy+Wˉyˉ​=t, y∈Z+m^​, yˉ​∈R+mˉ​}(t∈Rr),

and T\mathcal TT is the set of right-hand sides ttt for which the constraint set is nonempty. The right-hand side h(ξ)∈Rrh(\xi)\in\mathbb R^rh(ξ)∈Rr and the technology matrix T(ξ)T(\xi)T(ξ) depend affinely on ξ∈Rs\xi\in\mathbb R^sξ∈Rs. For a Borel probability measure μ\muμ on Ξ\XiΞ the program is

min⁡{∫Ξf0(ξ,x) μ(dξ): x∈X},f0(ξ,x)=cx+Φ(h(ξ)−T(ξ)x).(9)\min\Big\{\int_\Xi f_0(\xi,x)\,\mu(d\xi):\ x\in X\Big\},\qquad f_0(\xi,x)=cx+\Phi(h(\xi)-T(\xi)x). \tag{9}min{∫Ξ​f0​(ξ,x)μ(dξ): x∈X},f0​(ξ,x)=cx+Φ(h(ξ)−T(ξ)x).(9)

Three conditions make (9) well defined: (B1) WWW and Wˉ\bar WWˉ have rational entries; (B2) h(ξ)−T(ξ)x∈Th(\xi)-T(\xi)x\in\mathcal Th(ξ)−T(ξ)x∈T for all (ξ,x)∈Ξ×X(\xi,x)\in\Xi\times X(ξ,x)∈Ξ×X (relatively complete recourse); (B3) there is uuu with W′u≤qW'u\le qW′u≤q and Wˉ′u≤qˉ\bar W'u\le\bar qWˉ′u≤qˉ​ (dual feasibility).

v(ν)v(\nu)v(ν) and S(ν)S(\nu)S(ν) denote the optimal value and solution set of (9) under ν\nuν; for an open bounded U⊆Rm\mathcal U\subseteq\mathbb R^mU⊆Rm, vU(ν)v_{\mathcal U}(\nu)vU​(ν) and SU(ν)S_{\mathcal U}(\nu)SU​(ν) are the same objects with XXX replaced by X∩cl⁡UX\cap\operatorname{cl}\mathcal UX∩clU. SU(ν)S_{\mathcal U}(\nu)SU​(ν) is a complete local minimizing (CLM) set if it is nonempty and contained in U\mathcal UU. The minimal information distance is dFU(μ,ν)=sup⁡x∈X∩cl⁡U∣∫Ξf0(ξ,x)(μ−ν)(dξ)∣d_{\mathcal F_{\mathcal U}}(\mu,\nu)=\sup_{x\in X\cap\operatorname{cl}\mathcal U}|\int_\Xi f_0(\xi,x)(\mu-\nu)(d\xi)|dFU​​(μ,ν)=supx∈X∩clU​∣∫Ξ​f0​(ξ,x)(μ−ν)(dξ)∣. The moment classes are Pp,K(Ξ)={ν:∫Ξ∥ξ∥pν(dξ)≤K}\mathcal P_{p,K}(\Xi)=\{\nu:\int_\Xi\|\xi\|^p\nu(d\xi)\le K\}Pp,K​(Ξ)={ν:∫Ξ​∥ξ∥pν(dξ)≤K}, and the polyhedral metric is

d1,phk(μ,ν)=sup⁡{∣∫Pf(ξ)(μ−ν)(dξ)∣: P a polyhedron with at most k faces, f 1-Lipschitz on P, ∣f(ξ)∣≤max⁡{1,∥ξ∥}}.d_{1,phk}(\mu,\nu)=\sup\Big\{\Big|\int_P f(\xi)(\mu-\nu)(d\xi)\Big|:\ P \text{ a polyhedron with at most } k \text{ faces},\ f \text{ 1-Lipschitz on } P,\ |f(\xi)|\le\max\{1,\|\xi\|\}\Big\}.d1,phk​(μ,ν)=sup{​∫P​f(ξ)(μ−ν)(dξ)​: P a polyhedron with at most k faces, f 1-Lipschitz on P, ∣f(ξ)∣≤max{1,∥ξ∥}}.

Finally, ψ(τ)=inf⁡{∫Ξf0(ξ,x)μ(dξ)−v(μ):d(x,S(μ))≥τ, x∈X∩cl⁡U}\psi(\tau)=\inf\{\int_\Xi f_0(\xi,x)\mu(d\xi)-v(\mu): d(x,S(\mu))\ge\tau,\ x\in X\cap\operatorname{cl}\mathcal U\}ψ(τ)=inf{∫Ξ​f0​(ξ,x)μ(dξ)−v(μ):d(x,S(μ))≥τ, x∈X∩clU} is the growth function at μ\muμ, ψ−1(t)=sup⁡{τ≥0:ψ(τ)≤t}\psi^{-1}(t)=\sup\{\tau\ge0:\psi(\tau)\le t\}ψ−1(t)=sup{τ≥0:ψ(τ)≤t}, and Ψ(η)=η+ψ−1(2η)\Psi(\eta)=\eta+\psi^{-1}(2\eta)Ψ(η)=η+ψ−1(2η).

Formalization targets

Goal: Theorem 3.6

Under (B1)–(B3), with μ∈Pp,K(Ξ)\mu\in\mathcal P_{p,K}(\Xi)μ∈Pp,K​(Ξ) for some p>1p>1p>1, K>0K>0K>0, S(μ)≠∅S(\mu)\ne\emptysetS(μ)=∅ and U\mathcal UU an open bounded neighbourhood of S(μ)S(\mu)S(μ), there are L>0L>0L>0, δ>0\delta>0δ>0 and k∈Nk\in\mathbb Nk∈N such that for all ν∈Pp,K(Ξ)\nu\in\mathcal P_{p,K}(\Xi)ν∈Pp,K​(Ξ) with d1,phk(μ,ν)<δd_{1,phk}(\mu,\nu)<\deltad1,phk​(μ,ν)<δ

∣v(μ)−vU(ν)∣≤L d1,phk(μ,ν)11+rp−1,∅≠SU(ν)⊆S(μ)+Ψ(L d1,phk(μ,ν)11+rp−1)B,|v(\mu)-v_{\mathcal U}(\nu)|\le L\,d_{1,phk}(\mu,\nu)^{\frac{1}{1+\frac{r}{p-1}}},\qquad \emptyset\ne S_{\mathcal U}(\nu)\subseteq S(\mu)+\Psi\Big(L\,d_{1,phk}(\mu,\nu)^{\frac{1}{1+\frac{r}{p-1}}}\Big)\mathbb B,∣v(μ)−vU​(ν)∣≤Ld1,phk​(μ,ν)1+p−1r​1​,∅=SU​(ν)⊆S(μ)+Ψ(Ld1,phk​(μ,ν)1+p−1r​1​)B,

and SU(ν)S_{\mathcal U}(\nu)SU​(ν) is a CLM set. The constants and the number of faces are existential; only the exponent is fixed.

Milestones

  1. Lemma 3.5 (i)–(ii): a countable, locally finite Borel partition of T\mathcal TT into translates of pos⁡Wˉ\operatorname{pos}\bar WposWˉ minus finitely many translates, on each piece of which Φ\PhiΦ is Lipschitz with a common constant.
  2. Lemma 3.5, last assertion: Φ\PhiΦ is finite and lower semicontinuous on T\mathcal TT, and ∣Φ(t)−Φ(t~)∣≤α∥t−t~∥+β|\Phi(t)-\Phi(\tilde t)|\le\alpha\|t-\tilde t\|+\beta∣Φ(t)−Φ(t~)∣≤α∥t−t~∥+β.
  3. Growth bound (proof of Theorem 3.6): ∣f0(ξ,x)∣≤∥c∥∥x∥+α(∥h(ξ)∥+∥T(ξ)∥∥x∥)+β|f_0(\xi,x)|\le\|c\|\|x\|+\alpha(\|h(\xi)\|+\|T(\xi)\|\|x\|)+\beta∣f0​(ξ,x)∣≤∥c∥∥x∥+α(∥h(ξ)∥+∥T(ξ)∥∥x∥)+β, hence every measure with finite first moment lies in the domain of dFUd_{\mathcal F_{\mathcal U}}dFU​​.
  4. Theorem 2.2 for d=0d=0d=0: ∣v(μ)−vU(ν)∣≤dFU(μ,ν)|v(\mu)-v_{\mathcal U}(\nu)|\le d_{\mathcal F_{\mathcal U}}(\mu,\nu)∣v(μ)−vU​(ν)∣≤dFU​​(μ,ν) for all admissible ν\nuν, Berge upper semicontinuity of SUS_{\mathcal U}SU​, CLM sets near μ\muμ.
  5. Theorem 2.3 for d=0d=0d=0: ∅≠SU(ν)⊆S(μ)+Ψ(L^dFU(μ,ν))B\emptyset\ne S_{\mathcal U}(\nu)\subseteq S(\mu)+\Psi(\hat L d_{\mathcal F_{\mathcal U}}(\mu,\nu))\mathbb B∅=SU​(ν)⊆S(μ)+Ψ(L^dFU​​(μ,ν))B with Ψ(η)=η+ψ−1(η)\Psi(\eta)=\eta+\psi^{-1}(\eta)Ψ(η)=η+ψ−1(η).
  6. Estimate (12): dFU(μ,ν)≤C d1,phk(μ,ν)1/(1+r/(p−1))d_{\mathcal F_{\mathcal U}}(\mu,\nu)\le C\,d_{1,phk}(\mu,\nu)^{1/(1+r/(p-1))}dFU​​(μ,ν)≤Cd1,phk​(μ,ν)1/(1+r/(p−1)) for small d1,phk(μ,ν)d_{1,phk}(\mu,\nu)d1,phk​(μ,ν).

Companion: Corollary 3.7

For bounded Ξ\XiΞ and every μ∈P(Ξ)\mu\in\mathcal P(\Xi)μ∈P(Ξ) the same conclusions hold with the Lipschitz rate L αphk(μ,ν)L\,\alpha_{phk}(\mu,\nu)Lαphk​(μ,ν), where αphk(μ,ν)=sup⁡{∣μ(P)−ν(P)∣}\alpha_{phk}(\mu,\nu)=\sup\{|\mu(P)-\nu(P)|\}αphk​(μ,ν)=sup{∣μ(P)−ν(P)∣} over polyhedra with at most kkk faces.

Significance

Theorem 3.6 says that, for mixed-integer recourse, closeness of the distributions in d1,phkd_{1,phk}d1,phk​ is enough for closeness of optimal values and of localized solution sets, with an explicit Hölder exponent (p−1)/(p−1+r)(p-1)/(p-1+r)(p−1)/(p−1+r) that degrades with the second-stage dimension rrr and improves with the number of moments. Two consequences follow. Scenario reduction and discretization methods for mixed-integer models can be judged by a polyhedral discrepancy; and, through the entropy estimates of §4 of the paper, empirical approximations converge at rates governed by uniform laws for polyhedra. Corollary 3.7 shows that for bounded supports the rate becomes Lipschitz in the polyhedral discrepancy.

The results are proved in the paper, partly by reference: Lemma 3.5 is quoted from Bank et al., Schultz, and Blair–Jeroslow, and the partition argument behind (12) refers to Schultz (1996). None of it has a machine-checked proof. Formalizing the mission produces the first formal treatment of mixed-integer value functions with rational data, a formal version of the minimal-information-distance stability theorems in the objective-only case, and the polyhedral metric itself.

Difficulty

The obvious route to a stability estimate, a Lipschitz bound on ξ↦f0(ξ,x)\xi\mapsto f_0(\xi,x)ξ↦f0​(ξ,x) followed by a Fortet–Mourier or Wasserstein bound, fails at the first step: Φ\PhiΦ jumps across the boundaries of the pieces Bi\mathcal B_iBi​, so f0(⋅,x)f_0(\cdot,x)f0​(⋅,x) is only piecewise Lipschitz, with pieces that move with xxx. Any metric that controls dFUd_{\mathcal F_{\mathcal U}}dFU​​ must therefore see the indicator functions of these pieces, which is why polyhedra enter. The second obstacle is that there are countably many unbounded pieces: a single polyhedral bound covers only a bounded region of T\mathcal TT, and the tail outside it must be paid for with moments, which is the origin of the exponent. Lemma 3.5 itself, in particular the uniform Lipschitz constant and the local finiteness of the partition, rests on rationality of WWW and Wˉ\bar WWˉ; without (B1) the value function need not be lower semicontinuous.

Formalization scope

Rm\mathbb R^mRm, Rs\mathbb R^sRs, Rr\mathbb R^rRr are Euclidean spaces (the paper never fixes its norm, and every constant in the statements is existential). Measures are Borel probability measures on Rs\mathbb R^sRs with ν(Rs∖Ξ)=0\nu(\mathbb R^s\setminus\Xi)=0ν(Rs∖Ξ)=0. The integral of the extended-real integrand f0f_0f0​ is the published DupacovaWets.Consistency.expect (+∞+\infty+∞ when ∫f0+=∞\int f_0^+=\infty∫f0+​=∞). Φ\PhiΦ, optimal values and ψ\psiψ are extended-real infima, +∞+\infty+∞ on empty sets; the paper's "min" is read as an infimum. Distances and Ψ\PsiΨ take values in [0,∞][0,\infty][0,∞], and every estimate between optimal values states explicitly that both are finite, so that no convention for ∞−∞\infty-\infty∞−∞ can make a bound vacuous. T(ξ)T(\xi)T(ξ) is a linear map Rm→Rr\mathbb R^m\to\mathbb R^rRm→Rr and ∥T(ξ)∥\|T(\xi)\|∥T(ξ)∥ its operator norm. Integer vectors are tuples of natural numbers; WWW, Wˉ\bar WWˉ are real matrices with rational entries.

Disclosed reading: a "polyhedron with at most kkk faces" is an intersection of kkk closed half-spaces. Because kkk is existential in Theorem 3.6 and Corollary 3.7, the theorems are equivalent under this reading and under a facet count. The clause "piecewise polyhedral" of Lemma 3.5 is not defined in the paper and is not formalized. The page states "PFU(Ξ)⊆P1(Ξ)\mathcal P_{\mathcal F_{\mathcal U}}(\Xi)\subseteq\mathcal P_1(\Xi)PFU​​(Ξ)⊆P1​(Ξ)"; the argument proves and uses P1(Ξ)⊆PFU(Ξ)\mathcal P_1(\Xi)\subseteq\mathcal P_{\mathcal F_{\mathcal U}}(\Xi)P1​(Ξ)⊆PFU​​(Ξ), and that direction is the one formalized. Theorems 2.2 and 2.3 are stated in their objective-only (d=0d=0d=0) form for a general normal integrand.

The integrals in d1,phkd_{1,phk}d1,phk​ are Bochner integrals over PPP, which are meaningful because measures in Pp,K(Ξ)\mathcal P_{p,K}(\Xi)Pp,K​(Ξ) with p>1p>1p>1 integrate max⁡{1,∥ξ∥}\max\{1,\|\xi\|\}max{1,∥ξ∥}. A formalization that took the supremum over all of Rs\mathbb R^sRs instead of PPP, quantified ν\nuν over all of P(Ξ)\mathcal P(\Xi)P(Ξ), or let a non-integrable function contribute 000 would not state the paper's theorem, and these readings are excluded.

Needed infrastructure: the structure theory of mixed-integer value functions with rational data (the partition of Lemma 3.5 and the attainment of the minimum in (10)), lower semicontinuity of integral functionals of normal integrands via Fatou's lemma, Berge's upper semicontinuity of parametric argmin maps, and approximation of polyhedral pieces by polyhedra. The value-function results and the general d=0d=0d=0 stability theorems are reusable beyond this mission. Proofs of any milestone, and alternative arguments for Lemma 3.5, are welcome.

Selected references

  • S. T. Rachev, W. Römisch, Quantitative stability in stochastic programming: The method of probability metrics, Math. Oper. Res. 27(4) (2002) 792–818. doi:10.1287/moor.27.4.792.304. Preprint used here: edoc.hu-berlin.de.
  • B. Bank, J. Guddat, D. Klatte, B. Kummer, K. Tammer, Non-Linear Parametric Optimization, Akademie-Verlag, Berlin, 1982. doi:10.1007/978-3-0348-6328-5
  • R. Schultz, Rates of convergence in stochastic programs with complete integer recourse, SIAM J. Optim. 6 (1996) 1138–1152. doi:10.1137/S1052623494271655
  • C. E. Blair, R. G. Jeroslow, The value function of a mixed integer program: I, Discrete Math. 19 (1977) 121–138. doi:10.1016/0012-365X(77)90028-0
  • R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 1998. doi:10.1007/978-3-642-02431-3
11 thms1 active userReviewed
Convex OptimizationOperations ResearchProbability·Captain: mikedeng1

Convex Quadratic and Semidefinite Programming Relaxations in Scheduling II: Randomized Rounding of the Time-Slot Convex Quadratic Relaxation (CQP) Is Within 2 for R | rᵢⱼ | Σ wⱼCⱼResearch Paper

Motivation

Scheduling jobs on unrelated parallel machines to minimize the total weighted completion time is a basic model of machine scheduling: each job may take a different time on each machine, and a job becomes available on a machine only at a machine-dependent release date. In the three-field notation the problem is R∣rij∣∑wjCjR \mid r_{ij} \mid \sum w_jC_jR∣rij​∣∑wj​Cj​. Already the sequencing problem on a single machine with release dates is strongly NP-hard, so the question is how well it can be approximated in polynomial time.

Timeline (as surveyed in §1 of the paper):

  • Phillips, Stein and Wein gave a performance guarantee of O(log⁡2n)O(\log^2 n)O(log2n) for a network-scheduling generalization.
  • Hall, Shmoys and Wein (1996/1997) gave the first constant factor, 16/316/316/3, from an interval-indexed linear programming relaxation (Math. Oper. Res. 22, 1997).
  • Schulz and Skutella (1997–1999) gave a randomized (2+ε)(2+\varepsilon)(2+ε)-approximation from a time-indexed linear programming relaxation in intervals of geometrically increasing length; its size depends on pmax⁡p_{\max}pmax​ and on ε\varepsilonε.
  • Skutella (J. ACM 48, 2001) replaced the linear program by a convex quadratic program in assignment variables of strongly polynomial size and showed, in §3, that randomized rounding of it is a 222-approximation.

This mission formalizes that last result.

Setting

There are nnn jobs JJJ and mmm machines. Job jjj has a weight wj≥0w_j \ge 0wj​≥0; on machine iii it has a processing time pij>0p_{ij} > 0pij​>0 and a release date rij≥0r_{ij} \ge 0rij​≥0. A nonpreemptive schedule runs every job without interruption on one machine, starting no earlier than its release date there, and each machine processes at most one job at a time. With completion times CjC_jCj​, the objective is ∑jwjCj\sum_j w_jC_j∑j​wj​Cj​.

Smith's order on machine iii: j≺ikj \prec_i kj≺i​k if wj/pij>wk/pikw_j/p_{ij} > w_k/p_{ik}wj​/pij​>wk​/pik​, or the ratios are equal and j<kj < kj<k.

Time slots. Sort the release dates on machine iii as ρi1≤⋯≤ρin\rho_{i_1} \le \dots \le \rho_{i_n}ρi1​​≤⋯≤ρin​​ and set ρin+1=∞\rho_{i_{n+1}} = \inftyρin+1​​=∞. The kkk-th time slot iki_kik​ holds the jobs started on machine iii within [ρik,ρik+1)[\rho_{i_k}, \rho_{i_{k+1}})[ρik​​,ρik+1​​). An assignment of jobs to slots is feasible if job jjj goes to a slot iki_kik​ with ρik≥rij\rho_{i_k} \ge r_{ij}ρik​​≥rij​. For assignment variables aikja_{i_kj}aik​j​, the slot starts are

si1=ρi1,sik+1=max⁡{ρik+1, sik+∑jaikjpij},s_{i_1} = \rho_{i_1}, \qquad s_{i_{k+1}} = \max\Big\{\rho_{i_{k+1}},\ s_{i_k} + \sum_j a_{i_kj}p_{ij}\Big\},si1​​=ρi1​​,sik+1​​=max{ρik+1​​, sik​​+j∑​aik​j​pij​},

and for a 0/1 assignment the completion time of j∈ikj \in i_kj∈ik​ is Cj=sik+pij+∑j′≺ij, j′∈ikpij′C_j = s_{i_k} + p_{ij} + \sum_{j' \prec_i j,\ j' \in i_k} p_{ij'}Cj​=sik​​+pij​+∑j′≺i​j, j′∈ik​​pij′​ (17).

(CQP). Minimize ZCQP(a)=∑jwjCˉj(a)Z_{CQP}(a) = \sum_j w_j \bar C_j(a)ZCQP​(a)=∑j​wj​Cˉj​(a) with

Cˉj(a)=∑i,kaikj(ρik+1+aikj2 pij+∑j′≺ijaikj′pij′)\bar C_j(a) = \sum_{i,k} a_{i_kj}\Big(\rho_{i_k} + \frac{1 + a_{i_kj}}{2}\,p_{ij} + \sum_{j' \prec_i j} a_{i_kj'}p_{ij'}\Big)Cˉj​(a)=i,k∑​aik​j​(ρik​​+21+aik​j​​pij​+j′≺i​j∑​aik​j′​pij′​)

subject to ∑i,kaikj=1\sum_{i,k} a_{i_kj} = 1∑i,k​aik​j​=1 (14), aikj=0a_{i_kj} = 0aik​j​=0 if ρik<rij\rho_{i_k} < r_{ij}ρik​​<rij​ (18), a≥0a \ge 0a≥0 (20), and ∑jaikjpij≤ρik+1−ρik\sum_j a_{i_kj}p_{ij} \le \rho_{i_{k+1}} - \rho_{i_k}∑j​aik​j​pij​≤ρik+1​​−ρik​​ (21). In matrix form the objective is bTa+12cTa+12aT(D+diag(c))ab^Ta + \tfrac12 c^Ta + \tfrac12 a^T(D + \mathrm{diag}(c))abTa+21​cTa+21​aT(D+diag(c))a, which is convex.

Randomized rounding. Each job jjj is put into exactly one slot iki_kik​, with probability aikja_{i_kj}aik​j​, the choices being pairwise independent across jobs. The resulting slot assignment is turned into a schedule by (15)–(17).

Formalization targets

Goal: Theorem 3.4 (pp. 19–20), formal core

For every instance with p>0p > 0p>0, w≥0w \ge 0w≥0, r≥0r \ge 0r≥0:

  1. every feasible slot assignment yields a feasible schedule with completion times (17);
  2. for every (CQP)-feasible aaa and every pairwise independent rounding μ\muμ of aaa,
Eμ[∑jwjCj]≤2 ZCQP(a);E_\mu\Big[\sum_j w_jC_j\Big] \le 2\,Z_{CQP}(a);Eμ​[j∑​wj​Cj​]≤2ZCQP​(a);
  1. every feasible schedule SSS admits a (CQP)-feasible aaa with ZCQP(a)≤∑jwjCj(S)Z_{CQP}(a) \le \sum_j w_jC_j(S)ZCQP​(a)≤∑j​wj​Cj​(S).

The bound is stated for every feasible aaa, so it needs no optimum of (CQP), and with (3) it gives the positive half of Corollary 3.6.

Milestones

  • Lemma 3.1 (p. 15): an optimal schedule exists whose slots are sequenced by ≺i\prec_i≺i​ without interruption.
  • p. 16: the schedule built from a feasible slot assignment is feasible, with completion times (17).
  • Lemma 3.2 (p. 16): rebuilding such a schedule from its slot assignment gives a feasible schedule with the same property that completes no job later.
  • p. 17: for 0/1 assignments the relaxed completion times (19) equal (17).
  • Lemma 3.3 (p. 18): the quadratic programming relaxation has an optimal solution with sik=ρiks_{i_k} = \rho_{i_k}sik​​=ρik​​ for all i,ki, ki,k.
  • Proof of Lemma 3.5 (p. 20): Ej↦ik[sik]≤2ρikE_{j \mapsto i_k}[s_{i_k}] \le 2\rho_{i_k}Ej↦ik​​[sik​​]≤2ρik​​.
  • Lemma 3.5 (p. 20): E[Cj]≤2Cˉj(a)E[C_j] \le 2\bar C_j(a)E[Cj​]≤2Cˉj​(a) for every job.

Significance

The result gives a 222-approximation for R∣rij∣∑wjCjR \mid r_{ij} \mid \sum w_jC_jR∣rij​∣∑wj​Cj​ from a program of polynomial size, with a short analysis that holds job by job. The relaxation (CQP) is also the basis of §4, where the same rounding compares nonpreemptive with preemptive schedules, and its relaxation property bounds the optimum of (CQP) against the optimal schedule within a factor 222.

The result is proved in the paper; none of it is formalized. A formal development adds a checked model of release-date schedules and time slots on unrelated machines, the exchange argument behind Smith's rule in the presence of release dates, and a measure-free treatment of pairwise independent rounding. These pieces are reusable for other slot-based relaxations.

Difficulty

The analysis of Lemma 3.5 is short; the work lies in the reduction to slot assignments. Lemma 3.1 is an exchange argument, but swapping two jobs can push a job into a different time slot, so the naive bubble sort within a slot does not obviously terminate in a slot-sequenced schedule. Lemma 3.2 needs an induction across slots that accounts for empty slots and ties ρik=ρik+1\rho_{i_k} = \rho_{i_{k+1}}ρik​​=ρik+1​​. Lemma 3.3 is a shifting argument on fractional solutions whose objective change is a quadratic computation, and the step size printed on p. 18 must be divided by piȷ^p_{i\hat\jmath}pi^​​ to land exactly on sik=ρiks_{i_k} = \rho_{i_k}sik​​=ρik​​. The relaxation conjunct of the goal chains Lemmas 3.1, 3.2, 3.3 and the p. 17 identity.

Formalization scope

Jobs are Fin n, machines Fin m, and slots Fin m × Fin n, all 0-based. ≺i\prec_i≺i​ is cross-multiplied, which equals the page's ratio order because p>0p > 0p>0. ρ\rhoρ is the sorted tuple of release dates; ρin+1=∞\rho_{i_{n+1}} = \inftyρin+1​​=∞ is never represented by a real number. Constraint (21) is imposed only for slots before the last, and a job's slot is the largest kkk with ρik≤Sj\rho_{i_k} \le S_jρik​​≤Sj​. Schedules are a machine and a real start time per job; two jobs on one machine must satisfy Cj≤SkC_j \le S_kCj​≤Sk​ or Ck≤SjC_k \le S_jCk​≤Sj​. Randomized rounding is a probability weight on slot assignments with marginals aikja_{i_kj}aik​j​ and product joint probabilities for distinct jobs; full independence is not required, and the product weight is one instance. The standing assumptions pij>0p_{ij} > 0pij​>0, wj≥0w_j \ge 0wj​≥0, rij≥0r_{ij} \ge 0rij​≥0 of p. 2 are hypotheses of every theorem; Lemmas 3.1 and 3.3, which assert existence, also assume m≥1m \ge 1m≥1.

A statement of the bound alone, E≤2ZCQP(a)E \le 2 Z_{CQP}(a)E≤2ZCQP​(a), would say nothing about schedules: conjuncts 1 and 3 of the goal are what tie it to the scheduling problem, and neither may be dropped.

Not formalized: polynomial-time solvability of (CQP), the running time of the algorithm, the tightness half of Corollary 3.6, and the first sentence of Lemma 3.1 as a statement about every optimal schedule (false when some wj=0w_j = 0wj​=0).

Contributions welcome: proofs of any milestone; a general library of time-slot schedules; and the convexity of (22) (positive semidefiniteness of D+diag(c)D + \mathrm{diag}(c)D+diag(c)), which is not a milestone here.

Selected references

  • M. Skutella, Convex quadratic and semidefinite programming relaxations in scheduling, Journal of the ACM 48(2), 2001. https://doi.org/10.1145/375827.375840
  • L. A. Hall, A. S. Schulz, D. B. Shmoys and J. Wein, Scheduling to minimize average completion time: off-line and on-line approximation algorithms, Mathematics of Operations Research 22(3), 1997. https://doi.org/10.1287/moor.22.3.513
  • A. S. Schulz and M. Skutella, Scheduling unrelated machines by randomized rounding, SIAM Journal on Discrete Mathematics 15(4), 2002. https://doi.org/10.1137/S0895480199357078
  • W. E. Smith, Various optimizers for single-stage production, Naval Research Logistics Quarterly 3, 1956. https://doi.org/10.1002/nav.3800030106
9 thms1 active userReviewed
Graph TheoryOperations Research·Captain: mikedeng1

Solving Project Scheduling Problems by Minimum Cut Computations: Finite-Capacity n-Cuts Are Exactly the Feasible Schedules, and a Minimum a-b-Cut Has the Optimal CostResearch Paper

Motivation

Time-indexed formulations are a standard way to model scheduling problems as integer programs: a binary variable xjtx_{jt}xjt​ records whether job jjj starts at time ttt. They were introduced by Pritsker, Watters and Wolfe (1969) and give strong linear relaxations, at the price of many variables. In project scheduling, jobs are linked by time lags: a lag (i,j)(i,j)(i,j) of length dijd_{ij}dij​ requires Sj≥Si+dijS_j \ge S_i + d_{ij}Sj​≥Si​+dij​, and since dijd_{ij}dij​ may be negative, lags express both minimal and maximal distances between start times, i.e. time windows. Many project scheduling objectives (weighted completion times, net present value, earliness–tardiness, and the Lagrangian subproblems of resource-constrained scheduling) reduce to minimizing a sum of start-time dependent costs wjtw_{jt}wjt​ subject to such lags.

Möhring, Schulz, Stork and Uetz showed that this problem, despite being an integer program, is solved by one minimum cut computation in a directed graph built from the time-indexed variables. This makes the Lagrangian relaxation of resource-constrained project scheduling computationally practical, which is the use the paper puts it to.

Timeline.

  • 1969: Pritsker, Watters and Wolfe give a time-indexed 0/1 formulation of multiproject scheduling with the weak form of the precedence constraints.
  • 1970: Rhys and Balinski show that selection / minimum-weight closure problems reduce to minimum cut.
  • 1985: Chang and Edmonds reduce the case of ordinary precedence constraints and unit processing times to minimum-weight closure, hence to minimum cut.
  • 1987: Christofides, Alvarez-Valdés and Tamarit propose the strong (disaggregated) form (3) of the temporal constraints.
  • 2003: Möhring, Schulz, Stork and Uetz give a direct transformation for arbitrary time lags and arbitrary processing times (Management Science 49(3)).

Setting

Jobs form the set J={0,…,n}J = \{0, \dots, n\}J={0,…,n}; job jjj has an integral processing time pj≥0p_j \ge 0pj​≥0. A set L⊆J×JL \subseteq J \times JL⊆J×J of time lags is given, with integral lengths dijd_{ij}dij​. A schedule is an integral vector S=(S0,…,Sn)S = (S_0, \dots, S_n)S=(S0​,…,Sn​) of start times; it is feasible if Sj≥Si+dijS_j \ge S_i + d_{ij}Sj​≥Si​+dij​ for all (i,j)∈L(i,j) \in L(i,j)∈L and it lies within the horizon TTT: 0≤Sj0 \le S_j0≤Sj​ and Sj+pj≤TS_j + p_j \le TSj​+pj​≤T. Starting job jjj at time ttt costs wjt≥0w_{jt} \ge 0wjt​≥0. The earliest and latest feasible start times e(j)e(j)e(j) and ℓ(j)\ell(j)ℓ(j) are the minimum and the maximum of SjS_jSj​ over feasible schedules. Throughout, a feasible schedule is assumed to exist.

The integer program (1)–(5) has variables xjt∈Zx_{jt} \in \mathbb{Z}xjt​∈Z:

min⁡ w(x)=∑j∑t=0Twjtxjts.t.∑t=0Txjt=1,∑s=tTxis+∑s=0t+dij−1xjs≤1,xjt≥0,\min\ w(x) = \sum_{j} \sum_{t=0}^{T} w_{jt} x_{jt} \quad\text{s.t.}\quad \sum_{t=0}^{T} x_{jt} = 1,\qquad \sum_{s=t}^{T} x_{is} + \sum_{s=0}^{t+d_{ij}-1} x_{js} \le 1,\qquad x_{jt} \ge 0,min w(x)=j∑​t=0∑T​wjt​xjt​s.t.t=0∑T​xjt​=1,s=t∑T​xis​+s=0∑t+dij​−1​xjs​≤1,xjt​≥0,

for all j∈Jj \in Jj∈J, (i,j)∈L(i,j) \in L(i,j)∈L, t=0,…,Tt = 0, \dots, Tt=0,…,T, and all variables with ttt outside [e(j),ℓ(j)][e(j), \ell(j)][e(j),ℓ(j)] are zero.

The minimum cut digraph D=(V,A)D = (V, A)D=(V,A) has a source aaa, a sink bbb, and nodes vjtv_{jt}vjt​ for t=e(j),…,ℓ(j)+1t = e(j), \dots, \ell(j)+1t=e(j),…,ℓ(j)+1. Its arcs are the assignment arcs (vjt,vj,t+1)(v_{jt}, v_{j,t+1})(vjt​,vj,t+1​) for t=e(j),…,ℓ(j)t = e(j), \dots, \ell(j)t=e(j),…,ℓ(j), of capacity wjtw_{jt}wjt​; the temporal arcs (vit,vj,t+dij)(v_{it}, v_{j,t+d_{ij}})(vit​,vj,t+dij​​) for (i,j)∈L(i,j) \in L(i,j)∈L and e(i)+1≤t≤ℓ(i)e(i)+1 \le t \le \ell(i)e(i)+1≤t≤ℓ(i), e(j)+1≤t+dij≤ℓ(j)e(j)+1 \le t+d_{ij} \le \ell(j)e(j)+1≤t+dij​≤ℓ(j); and the auxiliary arcs (a,vj,e(j))(a, v_{j,e(j)})(a,vj,e(j)​) and (vj,ℓ(j)+1,b)(v_{j,\ell(j)+1}, b)(vj,ℓ(j)+1​,b). Temporal and auxiliary arcs have infinite capacity. An aaa-bbb-cut (X,Xˉ)(X, \bar X)(X,Xˉ) splits VVV with a∈Xa \in Xa∈X, b∈Xˉb \in \bar Xb∈Xˉ; its capacity c(X,Xˉ)c(X, \bar X)c(X,Xˉ) is the total capacity of the arcs from XXX to Xˉ\bar XXˉ. An nnn-cut is an aaa-bbb-cut containing exactly one assignment arc of every job. The mapping (7) sends a cut to xxx with xjt=1x_{jt} = 1xjt​=1 iff (vjt,vj,t+1)(v_{jt}, v_{j,t+1})(vjt​,vj,t+1​) is in the cut.

Formalization targets

Goal: Theorem 1 (p. 7)

(7) is a bijection {n-cuts with c(X,Xˉ)<∞}→{feasible x of (1)–(5)},c(X,Xˉ)=w(x),\text{(7) is a bijection } \{n\text{-cuts with } c(X,\bar X) < \infty\} \to \{\text{feasible } x \text{ of (1)–(5)}\},\qquad c(X, \bar X) = w(x),(7) is a bijection {n-cuts with c(X,Xˉ)<∞}→{feasible x of (1)–(5)},c(X,Xˉ)=w(x), andc(X,Xˉ)=w(x∗) for every minimum a-b-cut (X,Xˉ) and some optimal x∗.\text{and}\quad c(X, \bar X) = w(x^*) \text{ for every minimum } a\text{-}b\text{-cut } (X, \bar X) \text{ and some optimal } x^*.andc(X,Xˉ)=w(x∗) for every minimum a-b-cut (X,Xˉ) and some optimal x∗.

Milestones (in the paper's order of proof)

  1. Proof of Lemma 1 (p. 7): for every lag (i,j)∈L(i,j) \in L(i,j)∈L, e(i)+dij≤e(j)e(i) + d_{ij} \le e(j)e(i)+dij​≤e(j).
  2. Lemma 1 (p. 6): every minimum aaa-bbb-cut has an nnn-cut of the same capacity.
  3. Lemma 2 (p. 8): every feasible xxx is the image of an nnn-cut (X,Xˉ)(X, \bar X)(X,Xˉ) with w(x)=c(X,Xˉ)w(x) = c(X, \bar X)w(x)=c(X,Xˉ).
  4. p. 8: the mapping (7) is injective on finite-capacity nnn-cuts.
  5. Lemma 3 (p. 8): the image of a finite-capacity nnn-cut is feasible, with w(x)=c(X,Xˉ)w(x) = c(X, \bar X)w(x)=c(X,Xˉ).
  6. Lemma 4 (p. 8): the minimum cut capacity equals the optimal value.

A companion statement (p. 8) covers strictly positive weights: then every minimum aaa-bbb-cut is an nnn-cut, and (7) is a bijection between minimum aaa-bbb-cuts and optimal solutions.

Significance

The result. Theorem 1 shows that the time-indexed integer program with arbitrary (also negative) time lags has an integral linear relaxation in disguise: it is a minimum cut problem, solvable in strongly polynomial time, O(nmT2log⁡(n2T/m))O(nmT^2 \log(n^2T/m))O(nmT2log(n2T/m)) with push-relabel (Corollary 1). This is what allows the paper to compute Lagrangian lower bounds for resource-constrained project scheduling with time windows by repeated minimum cut computations, and to use the resulting dual information for list scheduling heuristics (§§3–4). The construction is a direct reduction, sparser than the closure-based route of Chang and Edmonds.

Formalizing it. The result is proved on paper; no machine-checked proof is known. The mission produces a formal model of the time-indexed project scheduling IP with time lags and of its cut digraph, together with checked versions of the correspondence and of each lemma of its proof. The model of cuts with infinite capacities and tagged parallel arcs is reusable for other cut-based reductions (selection, closure, and image segmentation problems).

Difficulty

The bijection itself is bookkeeping. The substance is in two places. First, Lemma 1: a minimum cut need not be an nnn-cut (a zero-weight assignment arc can be cut twice), and repairing it to the canonical prefix cut must not introduce a temporal arc into the cut. The repair argument shifts a hypothetical violating temporal arc back along the lag, and needs that the lags are consistent with the earliest and latest start times, e(i)+dij≤e(j)e(i) + d_{ij} \le e(j)e(i)+dij​≤e(j) and ℓ(i)+dij≤ℓ(j)\ell(i) + d_{ij} \le \ell(j)ℓ(i)+dij​≤ℓ(j), facts about the feasible schedules rather than about the graph. Second, Lemma 3: temporal arcs exist only for ttt in a restricted window, so a finite-capacity nnn-cut satisfies the temporal constraint (3) only after a boundary case analysis at t=e(i)t = e(i)t=e(i) and t+dij>ℓ(j)t + d_{ij} > \ell(j)t+dij​>ℓ(j). The naive reading "every temporal constraint is an infinite arc" is false at the boundary.

Formalization scope

An instance is a Lean structure with fields p,L,d,T,wp, L, d, T, wp,L,d,T,w; jobs are Fin (n + 1), start times are integers, and xxx is a function J→N→ZJ \to \mathbb{N} \to \mathbb{Z}J→N→Z (integrality by type). The standing assumptions of §2 are hypotheses of every theorem: wjt≥0w_{jt} \ge 0wjt​≥0 (p. 5) and the existence of a feasible schedule (p. 4). The horizon condition 0≤Sj0 \le S_j0≤Sj​, Sj+pj≤TS_j + p_j \le TSj​+pj​≤T is read from "t=0,…,Tt = 0, \dots, Tt=0,…,T", "e(j)≥0e(j) \ge 0e(j)≥0" and "ℓ(j)≤T−pj\ell(j) \le T - p_jℓ(j)≤T−pj​" (p. 5), which the paper never writes as a formula. The paper's artificial jobs 000 and nnn with zero processing time are not assumed: §2.2 never uses them, so the statements are stronger. e(j)e(j)e(j) and ℓ(j)\ell(j)ℓ(j) are defined as the minimum and maximum feasible start times, never taken as parameters. Capacities live in [0,∞][0, \infty][0,∞] with ∞\infty∞ on temporal and auxiliary arcs; arcs are a tagged type, so parallel arcs and self-lags remain distinct. A cut is its source side X⊆VX \subseteq VX⊆V. Running-time claims (the O(nT)O(nT)O(nT) clause of Lemma 1, Corollary 1, the Goldberg–Rao bound) are not formalized.

Trivializing formalizations are ruled out: the integer program is not replaced by schedules, infinite capacities are not big-M constants, the minimum is taken over all aaa-bbb-cuts and not only over nnn-cuts, and e,ℓe, \elle,ℓ are computed from the instance rather than quantified over.

Needed infrastructure: finite sums in [0,∞][0, \infty][0,∞], minimum and maximum of finite sets of integers, and elementary reasoning on integer intervals. Proofs of any milestone, and of the auxiliary fact ℓ(i)+dij≤ℓ(j)\ell(i) + d_{ij} \le \ell(j)ℓ(i)+dij​≤ℓ(j) used in Lemma 3, are welcome.

Selected references

  • R. H. Möhring, A. S. Schulz, F. Stork, M. Uetz, Solving project scheduling problems by minimum cut computations, Management Science 49(3):330–350, 2003. https://doi.org/10.1287/mnsc.49.3.330.12737 (formalized from the authors' manuscript, July 2000, revised April and November 2002).
  • A. A. B. Pritsker, L. J. Watters, P. M. Wolfe, Multiproject scheduling with limited resources: a zero-one programming approach, Management Science 16(1):93–108, 1969. https://doi.org/10.1287/mnsc.16.1.93
  • G. J. Chang, J. Edmonds, The poset scheduling problem, Order 2(2):113–118, 1985. https://doi.org/10.1007/BF00334849
  • N. Christofides, R. Alvarez-Valdés, J. M. Tamarit, Project scheduling with resource constraints: a branch and bound approach, European Journal of Operational Research 29(3):262–273, 1987. https://doi.org/10.1016/0377-2217(87)90240-2
  • J. M. W. Rhys, A selection problem of shared fixed costs and network flows, Management Science 17(3):200–207, 1970. https://doi.org/10.1287/mnsc.17.3.200
  • A. V. Goldberg, R. E. Tarjan, A new approach to the maximum-flow problem, Journal of the ACM 35(4):921–940, 1988. https://doi.org/10.1145/48014.61051
8 thms1 active userReviewed
Numerical Analysis·Captain: mikedeng1

Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Łojasiewicz Inequality: Non-Divergent Iterates Have Finite Length and a Critical LimitResearch Paper

Motivation

Many problems in signal processing, statistics and decision theory have two blocks of variables coupled by a smooth term: matrix factorization, blind deconvolution, feasibility problems for two sets, and models of two agents adjusting their decisions in turn. Minimizing over one block at a time (alternating minimization, or Gauss–Seidel) is the natural method. Without convexity it can oscillate, and its iterates need not converge. Attouch, Bolte, Redont and Soubeyran (Math. Oper. Res. 35(2), 2010; arXiv:0801.1780) regularize each block step by a proximal term. They prove that, when the objective satisfies the Kurdyka–Łojasiewicz (KL) inequality, every sequence of the method that does not run off to infinity has finite length and converges to a critical point.

Timeline:

  • 1963: Łojasiewicz proves the gradient inequality for real-analytic functions, which gives convergence of bounded gradient trajectories.
  • 1998: Kurdyka extends the inequality to differentiable functions definable in an o-minimal structure.
  • 2006–2007: Bolte, Daniilidis, Lewis and Shiota extend it to nonsmooth lower semicontinuous subanalytic and definable functions, with the limiting subdifferential.
  • 2009: Attouch and Bolte use the Łojasiewicz inequality to prove convergence of the proximal point method for nonconvex functions (Math. Program. 116, 2009).
  • 2010: this paper treats the alternating proximal scheme with a general smooth coupling QQQ.
  • 2014: Bolte, Sabach and Teboulle replace the exact block minimizations by linearized proximal steps (PALM, Math. Program. 146, 2014).

Setting

Let f:Rn→R∪{+∞}f:\mathbb R^n\to\mathbb R\cup\{+\infty\}f:Rn→R∪{+∞} and g:Rm→R∪{+∞}g:\mathbb R^m\to\mathbb R\cup\{+\infty\}g:Rm→R∪{+∞} be proper (never −∞-\infty−∞, finite somewhere) and lower semicontinuous. Let Q:Rn×Rm→RQ:\mathbb R^n\times\mathbb R^m\to\mathbb RQ:Rn×Rm→R be continuously differentiable, with ∇Q\nabla Q∇Q Lipschitz on bounded sets. This is assumption (H) for

L(x,y)=f(x)+Q(x,y)+g(y).L(x,y)=f(x)+Q(x,y)+g(y).L(x,y)=f(x)+Q(x,y)+g(y).

The product Rn×Rm\mathbb R^n\times\mathbb R^mRn×Rm carries the Euclidean norm ∥(x,y)∥2=∥x∥2+∥y∥2\|(x,y)\|^2=\|x\|^2+\|y\|^2∥(x,y)∥2=∥x∥2+∥y∥2. Write ∇Q=(∇xQ,∇yQ)\nabla Q=(\nabla_xQ,\nabla_yQ)∇Q=(∇x​Q,∇y​Q).

Given (x0,y0)(x_0,y_0)(x0​,y0​) and step sizes λk,μk>0\lambda_k,\mu_k>0λk​,μk​>0, the proximal alternating scheme is

xk+1∈argmin⁡u{L(u,yk)+12λk∥u−xk∥2},yk+1∈argmin⁡v{L(xk+1,v)+12μk∥v−yk∥2}.(5–6)x_{k+1}\in\operatorname{argmin}_u\Big\{L(u,y_k)+\tfrac1{2\lambda_k}\|u-x_k\|^2\Big\},\qquad y_{k+1}\in\operatorname{argmin}_v\Big\{L(x_{k+1},v)+\tfrac1{2\mu_k}\|v-y_k\|^2\Big\}.\tag{5–6}xk+1​∈argminu​{L(u,yk​)+2λk​1​∥u−xk​∥2},yk+1​∈argminv​{L(xk+1​,v)+2μk​1​∥v−yk​∥2}.(5–6)

Assumption (H1) asks that inf⁡L>−∞\inf L>-\inftyinfL>−∞, that L(⋅,y0)L(\cdot,y_0)L(⋅,y0​) be proper, and that λk,μk∈(r−,r+)\lambda_k,\mu_k\in(r_-,r_+)λk​,μk​∈(r−​,r+​) for all kkk, for some 0<r−<r+0<r_-<r_+0<r−​<r+​.

The Fréchet subdifferential ∂^L(z)\hat\partial L(z)∂^L(z) is the set of vvv with lim inf⁡w→z, w≠z(L(w)−L(z)−⟨v,w−z⟩)/∥w−z∥≥0\liminf_{w\to z,\,w\ne z}\big(L(w)-L(z)-\langle v,w-z\rangle\big)/\|w-z\|\ge0liminfw→z,w=z​(L(w)−L(z)−⟨v,w−z⟩)/∥w−z∥≥0. The limiting subdifferential ∂L(z)\partial L(z)∂L(z) collects the limits of vj∈∂^L(zj)v_j\in\hat\partial L(z_j)vj​∈∂^L(zj​) along zj→zz_j\to zzj​→z with L(zj)→L(z)L(z_j)\to L(z)L(zj​)→L(z). A point zzz is critical if 0∈∂L(z)0\in\partial L(z)0∈∂L(z). LLL has the KL property at zˉ∈dom⁡∂L\bar z\in\operatorname{dom}\partial Lzˉ∈dom∂L if there are η>0\eta>0η>0, a neighbourhood UUU of zˉ\bar zzˉ and a continuous concave φ:[0,η)→R+\varphi:[0,\eta)\to\mathbb R_+φ:[0,η)→R+​ with φ(0)=0\varphi(0)=0φ(0)=0, φ∈C1(0,η)\varphi\in C^1(0,\eta)φ∈C1(0,η), φ′>0\varphi'>0φ′>0, such that

φ′(L(z)−L(zˉ)) dist⁡(0,∂L(z))≥1whenever z∈U, L(zˉ)<L(z)<L(zˉ)+η.\varphi'\big(L(z)-L(\bar z)\big)\,\operatorname{dist}\big(0,\partial L(z)\big)\ge1\quad\text{whenever }z\in U,\ L(\bar z)<L(z)<L(\bar z)+\eta .φ′(L(z)−L(zˉ))dist(0,∂L(z))≥1whenever z∈U, L(zˉ)<L(z)<L(zˉ)+η.

Formalization targets

Goal: Theorem 9 (p. 11)

If LLL satisfies (H), (H1) and has the KL property at every point of dom⁡∂L\operatorname{dom}\partial Ldom∂L, then every sequence of (5–6) satisfies

∥(xk,yk)∥→∞or(∑k∥xk+1−xk∥+∥yk+1−yk∥<∞  and  (xk,yk)→z⋆, 0∈∂L(z⋆)).\|(x_k,y_k)\|\to\infty\qquad\text{or}\qquad\Big(\sum_k\|x_{k+1}-x_k\|+\|y_{k+1}-y_k\|<\infty\ \text{ and }\ (x_k,y_k)\to z^\star,\ 0\in\partial L(z^\star)\Big).∥(xk​,yk​)∥→∞or(k∑​∥xk+1​−xk​∥+∥yk+1​−yk​∥<∞  and  (xk​,yk​)→z⋆, 0∈∂L(z⋆)).

Milestones

  • Proposition 3 (p. 5): ∂L(x,y)={∂f(x)+∇xQ(x,y)}×{∂g(y)+∇yQ(x,y)}=∂xL(x,y)×∂yL(x,y)\partial L(x,y)=\{\partial f(x)+\nabla_xQ(x,y)\}\times\{\partial g(y)+\nabla_yQ(x,y)\}=\partial_xL(x,y)\times\partial_yL(x,y)∂L(x,y)={∂f(x)+∇x​Q(x,y)}×{∂g(y)+∇y​Q(x,y)}=∂x​L(x,y)×∂y​L(x,y) on dom⁡L\operatorname{dom}LdomL.
  • Lemma 5 (p. 6), in four parts: the scheme is well defined; the decrease estimate (7); summability of the squared steps; the explicit subgradient (xk∗,yk∗)∈∂L(xk,yk)(x_k^*,y_k^*)\in\partial L(x_k,y_k)(xk∗​,yk∗​)∈∂L(xk​,yk​) (8), which tends to 000 along bounded subsequences.
  • Proposition 6 (p. 7): limit points are critical, and LLL is finite and constant on them.
  • (19)–(20), (24), (25), (26) from the proof of Theorem 8 (pp. 9–11).
  • Theorem 8 (p. 9): a local convergence result with explicit constants: M=2r+(C+1/r−)M=2r_+(C+1/r_-)M=2r+​(C+1/r−​), the trapping radius (16), and the tail bound (18).

Significance

Theorem 9 makes the KL inequality the single hypothesis behind global convergence of a nonconvex block method. Semi-algebraic, subanalytic and definable data satisfy it, so the theorem covers sparse and low-rank regularizers, indicator functions of semi-algebraic sets, and polynomial couplings. With f=δCf=\delta_Cf=δC​, g=δDg=\delta_Dg=δD​ and Q(x,y)=12∥x−y∥2Q(x,y)=\tfrac12\|x-y\|^2Q(x,y)=21​∥x−y∥2 it yields convergence of an averaged alternating projection method between two closed sets (§3.4 of the paper). The proof pattern of sufficient decrease, a relative-error subgradient bound and the KL inequality was later abstracted for PALM and many other algorithms. A formal proof of this paper's argument therefore covers the template those analyses reuse.

The result has been proved since 2010. To our knowledge it has not been formalized in any proof assistant. Mathlib has the Fréchet derivative and the gradient, but no limiting subdifferential and no KL theory. The published Prove2Me definitions of the limiting subdifferential and of the KL property (from the Li–Pong ADMM series) are reused here, so this mission also tests that infrastructure on a second algorithm.

Difficulty

The decrease estimate (7) gives only ∑∥zk+1−zk∥2<∞\sum\|z_{k+1}-z_k\|^2<\infty∑∥zk+1​−zk​∥2<∞. That makes steps vanish and limit points critical (Proposition 6), but it does not give convergence, because square-summable steps can have infinite total length. Turning square summability into summability needs the KL inequality. That inequality holds only near a critical point and only on a sublevel band, so the iterates must first be shown never to leave a ball B(zˉ,ρ)B(\bar z,\rho)B(zˉ,ρ), by an induction that uses the very finite-length estimate it is trying to establish. The constants in (16) are arranged so that this induction closes. A second difficulty is nonsmooth calculus: the subdifferential sum rule for f(x)+g(y)+Q(x,y)f(x)+g(y)+Q(x,y)f(x)+g(y)+Q(x,y) and the closedness of the graph of ∂L\partial L∂L along sequences with converging function values. Lower semicontinuity alone does not give convergence of the function values; the proximal inequalities do.

Formalization scope

Everything lives in the namespace ProxAltMin.Conv, in Lean 4 with Mathlib. Conventions:

  • Rn\mathbb R^nRn, Rm\mathbb R^mRm are EuclideanSpace ℝ (Fin n) and EuclideanSpace ℝ (Fin m), and the product is the L2L^2L2 product WithLp 2 (… × …), not the sup-norm product.
  • R∪{+∞}\mathbb R\cup\{+\infty\}R∪{+∞} is EReal with "never −∞-\infty−∞" as part of properness.
  • The argmin steps are inequalities quantified over all competitors, so every selection of minimizers is covered.
  • Balls are open.
  • The KL data (η,U,φ)(\eta,U,\varphi)(η,U,φ) of Theorem 8 are explicit parameters, with real η>0\eta>0η>0; this is equivalent to η∈(0,+∞]\eta\in(0,+\infty]η∈(0,+∞].
  • Inside the proof of Theorem 8 the paper normalizes L(zˉ)=0L(\bar z)=0L(zˉ)=0; the milestones taken from that proof carry li−lˉl_i-\bar lli​−lˉ instead.
  • Every infinite sum in a conclusion comes with an explicit summability claim.
  • Theorem 9's "KL property at each point of the domain of fff" is read as "at each point of dom⁡∂L\operatorname{dom}\partial Ldom∂L", the domain on which Definition 7 places the KL property.

Theorem and page numbers are those of arXiv:0801.1780v3 (22 Jan 2013), which is the version read; the published article has the same content.

A trivializing formalization is ruled out: the run predicate is satisfiable (Lemma 5's existence milestone; for f=g=Q=0f=g=Q=0f=g=Q=0 any constant sequence is a run), the constants MMM and CCC are tied to the data rather than chosen by the prover, and no conclusion is a sum or a distance whose library value is 000 on bad input.

Needed infrastructure: the subdifferential calculus behind Proposition 3 (a smooth perturbation and a separable sum), the closedness of the limiting subdifferential, existence of proximal minimizers for coercive lower semicontinuous functions on Rn\mathbb R^nRn, and the elementary but delicate bookkeeping of Theorem 8. The first two are reusable well beyond this mission. Contributions welcome: proofs of any milestone, and general lemmas on limiting subdifferentials stated as separate theorems.

Selected references

  • H. Attouch, J. Bolte, P. Redont, A. Soubeyran, Proximal alternating minimization and projection methods for nonconvex problems: an approach based on the Kurdyka–Łojasiewicz inequality, Mathematics of Operations Research 35(2):438–457, 2010. https://doi.org/10.1287/moor.1100.0449 (arXiv:0801.1780v3, https://arxiv.org/abs/0801.1780v3)
  • H. Attouch, J. Bolte, On the convergence of the proximal algorithm for nonsmooth functions involving analytic features, Mathematical Programming 116:5–16, 2009. https://doi.org/10.1007/s10107-007-0133-5
  • J. Bolte, A. Daniilidis, A. Lewis, The Łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems, SIAM J. Optim. 17(4):1205–1223, 2007. https://doi.org/10.1137/050644641
  • K. Kurdyka, On gradients of functions definable in o-minimal structures, Annales de l'Institut Fourier 48(3):769–783, 1998. https://doi.org/10.5802/aif.1638
  • J. Bolte, S. Sabach, M. Teboulle, Proximal alternating linearized minimization for nonconvex and nonsmooth problems, Mathematical Programming 146:459–494, 2014. https://doi.org/10.1007/s10107-013-0701-9
  • R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 1998. https://doi.org/10.1007/978-3-642-02431-3
16 thms1 active userReviewed
Dynamic ProgrammingOperations Research·Captain: mikedeng1

Algorithms for Scheduling Runway Operations Under Constrained Position Shifting 1: Dynamic Programming on the CPS Network Gives the Minimum MakespanResearch Paper

Motivation

A busy runway is the bottleneck of an airport, and the order in which arriving or departing aircraft use it determines how many operations fit into an hour. Consecutive aircraft must be spaced by minimum separations that depend on both aircraft (a light aircraft behind a heavy one needs a long gap because of wake turbulence), so reordering the first-come-first-served (FCFS) queue can raise throughput considerably. Unrestricted reordering is unacceptable in practice: it makes the controllers' job harder and can push one aircraft to the back of the queue indefinitely. Following Dear (1976), constrained position shifting (CPS) allows each aircraft to move at most kkk positions away from its FCFS position, with kkk between 1 and 3 in practice.

Earlier algorithms for CPS either exploited a small number of aircraft types and ignored time windows and precedence constraints (Psaraftis 1980), or needed exponentially many parallel processors (Trivizas 1998), and Carr (2004) conjectured that runway scheduling under CPS has exponential complexity in general. Balakrishnan and Chandran (Oper. Res. 58(6), 2010) showed that, for fixed kkk, the problem with time windows and precedence constraints is solved by dynamic programming on a network whose size is linear in the number of aircraft. This mission formalizes the core of that result: the network, its precedence pruning, and the dynamic program for the minimum makespan.

Setting

There are n≥1n\ge 1n≥1 aircraft, labelled 0,…,n−10,\dots,n-10,…,n−1 in FCFS order, and the landing positions are also 0,…,n−10,\dots,n-10,…,n−1. An instance consists of

  1. the maximum position shift k∈Nk\in\mathbb Nk∈N;
  2. separations δab≥0\delta_{ab}\ge 0δab​≥0, the minimum time between a leading aircraft aaa and a trailing aircraft bbb, satisfying the triangle inequality δac≤δab+δbc\delta_{ac}\le\delta_{ab}+\delta_{bc}δac​≤δab​+δbc​ (which holds for wake-vortex separations in arrivals-only or departures-only operation);
  3. a time window [e(a),l(a)][e(a),l(a)][e(a),l(a)] for each aircraft;
  4. a finite set of precedence pairs (x,y)(x,y)(x,y) of distinct aircraft, meaning that xxx lands before yyy.

A kkk-CPS sequence is a bijection σ\sigmaσ from positions to aircraft with ∣σ(p)−p∣≤k|\sigma(p)-p|\le k∣σ(p)−p∣≤k for all ppp. A feasible schedule is such a σ\sigmaσ with landing times tpt_ptp​ such that e(σ(p))≤tp≤l(σ(p))e(\sigma(p))\le t_p\le l(\sigma(p))e(σ(p))≤tp​≤l(σ(p)), δσ(p)σ(q)≤tq−tp\delta_{\sigma(p)\sigma(q)}\le t_q-t_pδσ(p)σ(q)​≤tq​−tp​ for all positions p<qp<qp<q, and every precedence pair is respected. The makespan is tn−1t_{n-1}tn−1​, the landing time of the last aircraft.

The CPS network has stages p=1,…,np=1,\dots,np=1,…,n. A node of stage ppp is a list of min⁡{2k+1,p}\min\{2k+1,p\}min{2k+1,p} distinct aircraft occupying the positions that end at p−1p-1p−1, each within kkk of its FCFS position; its last entry is its final aircraft. An arc joins a stage-ppp node iii to a stage-(p+1)(p+1)(p+1) node jjj when the first min⁡{2k,p}\min\{2k,p\}min{2k,p} entries of jjj are the last min⁡{2k,p}\min\{2k,p\}min{2k,p} entries of iii. A source-sink path picks one node per stage, joined by arcs, and its sequence puts the final aircraft of the stage-(q+1)(q+1)(q+1) node at position qqq. The pruned network GGG deletes the nodes that violate a precedence pair (x,y)(x,y)(x,y): those containing yyy before xxx, or yyy at a position less than x−kx-kx−k, or xxx at a position greater than y+ky+ky+k.

On GGG, with e(j),l(j)e(j),l(j)e(j),l(j) the window of the final aircraft of jjj, δi(j)\delta_i(j)δi​(j) the separation between the final aircraft of iii and jjj, and P(j)P(j)P(j) the predecessors of jjj, the dynamic program is T∗(j)=e(j)T^*(j)=e(j)T∗(j)=e(j) at stage 1 and

T∗(j)=max⁡{e(j), min⁡i∈P(j): T∗(i)≤l(i)(T∗(i)+δi(j))}(1)T^*(j)=\max\Big\{e(j),\ \min_{i\in P(j):\,T^*(i)\le l(i)}\big(T^*(i)+\delta_i(j)\big)\Big\}\qquad(1)T∗(j)=max{e(j), i∈P(j):T∗(i)≤l(i)min​(T∗(i)+δi​(j))}(1)

with min⁡∅=+∞\min\emptyset=+\inftymin∅=+∞.

Formalization targets

Goal: §4.1, the minimum makespan rule

∃ feasible schedule  ⟺  ∃ j∈Gn: T∗(j)≤l(j),\exists\ \text{feasible schedule}\iff \exists\, j\in G_n:\ T^*(j)\le l(j),∃ feasible schedule⟺∃j∈Gn​: T∗(j)≤l(j), min⁡{makespan of a feasible schedule}=min⁡{T∗(j):j∈Gn, T∗(j)≤l(j)},\min\{\text{makespan of a feasible schedule}\}=\min\{T^*(j): j\in G_n,\ T^*(j)\le l(j)\},min{makespan of a feasible schedule}=min{T∗(j):j∈Gn​, T∗(j)≤l(j)},

where GnG_nGn​ is stage nnn of GGG; the second identity is stated as "τ\tauτ is the least makespan iff τ\tauτ is the least admissible T∗(j)T^*(j)T∗(j)" for every real τ\tauτ.

Milestones

  1. Theorem 1. σ\sigmaσ is a kkk-CPS sequence iff it is the sequence of a source-sink path of the CPS network.
  2. Lemma 1 (Case I). For a<ba<ba<b, a path whose sequence puts aaa after bbb has a node containing bbb before aaa.
  3. Lemma 2 (Case II). For a<ba<ba<b, in the position-constrained network, a path whose sequence puts aaa before bbb has a node containing aaa before bbb.
  4. §3.1 conclusion. The source-sink paths of GGG are exactly the kkk-CPS sequences respecting all precedence pairs.
  5. Lemma 3. For every node jjj of GGG, T∗(j)T^*(j)T∗(j) is the earliest landing time of the final aircraft of jjj over all partial schedules ending at jjj, and +∞+\infty+∞ exactly when there is none.

Significance

The network turns a search over permutations into a shortest-path-like computation over O(n(2k+1)2k+1)O(n(2k+1)^{2k+1})O(n(2k+1)2k+1) nodes, so for the small values of kkk used in practice the minimum makespan with time windows and precedence constraints is computed in time linear in nnn. The same network underlies the paper's algorithms for total delay (§5.2) and, in a time-expanded form, for arbitrary separable costs without the triangle inequality (§6).

The paper's proofs are short and informal. A formalization pins down exactly what T∗(j)T^*(j)T∗(j) means (the paper describes it only as "arrival time of the final aircraft of node iii in an optimal solution"), makes precise which nodes the precedence pruning removes, and checks the correctness of the stage-nnn rule. The result has not been machine-checked before.

Difficulty

Two features of the model make the correctness of the network nontrivial. First, a node records only a window of at most 2k+12k+12k+1 consecutive positions, so nothing local prevents a path from using the same aircraft twice or omitting one; Theorem 1 asserts that the global sequence is nevertheless a permutation, and Lemmas 1 and 2 assert that precedence, a global property of the sequence, is detected inside single nodes. Second, the recursion (1) adds the separation only between consecutive aircraft, while feasibility constrains every pair of aircraft; the triangle inequality is what reconciles the two, and without it Lemma 3 fails.

The obvious reading of §4.1 also fails: taking the least T∗(j)T^*(j)T∗(j) over all stage-nnn nodes, as the paper prints, can select a node whose final aircraft lands after its latest time. The goal filters stage nnn by T∗(j)≤l(j)T^*(j)\le l(j)T∗(j)≤l(j).

Formalization scope

All data are real numbers; aircraft and positions are Fin n, 0-based; stages are 1-based natural numbers; [NeZero n] encodes n≥1n\ge 1n≥1. Separations are pairwise in the definition of feasibility, never only consecutive. The recursion takes values in WithTop ℝ, with ⊤=+∞\top=+\infty⊤=+∞; optima are stated with IsLeast over sets of makespans, never with a real infimum. Precedence pairs are a Finset of ordered pairs of distinct aircraft, covering both of the paper's cases.

Explicit readings of loose phrases:

  • "corresponding source-sink path" (Theorem 1) is the path whose final aircraft, stage by stage, form the sequence, as defined in the proof;
  • "the values of T∗(⋅)T^*(\cdot)T∗(⋅)" (Lemma 3) are earliest landing times over partial schedules ending at the node: paths in GGG with times satisfying the windows of the earlier aircraft, the earliest time of the last one, and all pairwise separations;
  • "the minimum makespan is the lowest value of T∗(⋅)T^*(\cdot)T∗(⋅) among all nodes in stage nnn" is corrected to the nodes with T∗(j)≤l(j)T^*(j)\le l(j)T∗(j)≤l(j), which is the paper's own feasibility check;
  • the Case II position filter uses the printed rule (<b−k<b-k<b−k, >a+k>a+k>a+k).

Not formalized: running times (Proposition 1 and the O(k)O(k)O(k) preprocessing remark), the predecessor pointers and tie-breaking that reconstruct an optimal sequence, the removal of nodes unreachable from the source or the sink (it does not change the set of source-sink paths), asymmetric shifts (§3.2) and disjoint time windows.

A formalization that defines feasibility with consecutive separations only, defines T∗T^*T∗ by the recursion and states Lemma 3 as an unfolding, or states Theorem 1 as "some CPS sequence exists iff some path exists" would be trivial; the statements here avoid all three.

The definitions (instance, kkk-CPS sequences, the CPS network and its pruning) are shared with the two other missions of this series (total delay, discrete time) and may be consolidated later. Proofs of the milestones, and lemmas about the window structure of the network, are welcome.

Selected references

  • H. Balakrishnan, B. G. Chandran, Algorithms for Scheduling Runway Operations Under Constrained Position Shifting, Operations Research 58(6), 1650–1665, 2010. https://doi.org/10.1287/opre.1100.0869
  • H. N. Psaraftis, A Dynamic Programming Approach for Sequencing Groups of Identical Jobs, Operations Research 28(6), 1347–1359, 1980. https://doi.org/10.1287/opre.28.6.1347
  • R. G. Dear, The Dynamic Scheduling of Aircraft in the Near Terminal Area, MIT Flight Transportation Laboratory Report R76-9, 1976.
  • D. A. Trivizas, Optimal Scheduling with Maximum Position Shift (MPS) Constraints: A Runway Scheduling Application, Journal of Navigation 51(2), 250–266, 1998.
  • F. R. Carr, Robust Decision-Support Tools for Airport Surface Traffic, Ph.D. thesis, Massachusetts Institute of Technology, 2004.
8 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Quantitative Stability in Stochastic Programming: The Method of Probability Metrics 2: Linear Two-Stage Programs Are Lipschitz Stable in the Fortet–Mourier Metric ζ₂Research Paper

Why stability of two-stage programs matters

A linear two-stage stochastic program with fixed recourse chooses a here-and-now decision xxx before a random vector ξ\xiξ is observed, and pays a recourse cost afterwards. It is the basic model of stochastic programming, used in capacity planning, energy and supply-chain models. In practice the distribution μ\muμ of ξ\xiξ is never known exactly: it is estimated from data, replaced by a discrete scenario approximation, or perturbed for robustness. The question is how much the optimal value and the optimal decisions can move when μ\muμ is replaced by a nearby ν\nuν, and in which distance between probability measures "nearby" should be measured.

Rachev and Römisch (Math. Oper. Res. 27(4), 2002, doi:10.1287/moor.27.4.792.304; the mission cites the authors' preprint from edoc.hu-berlin.de) answer this with the method of probability metrics: they derive from the structure of the integrand a canonical distance on measures for each class of models. For linear two-stage programs the canonical distance is the Fortet–Mourier metric of order 2.

Timeline. Robinson and Wets (1987) studied qualitative stability of two-stage programs with respect to weak convergence of measures. Walkup and Wets (1969) had earlier established the piecewise-bilinear structure of the second-stage value function used here. Römisch and Schultz (1991) proved a quantitative stability result for two-stage programs with complete recourse in the Wasserstein metric W2W_2W2​. The present paper (published 2002) replaces complete recourse by relatively complete recourse plus dual feasibility, and W2W_2W2​ by the metric ζ2\zeta_2ζ2​, which it bounds by a multiple of W2W_2W2​ (p. 13).

Setting

Let X⊆RmX\subseteq\mathbb R^mX⊆Rm be a nonempty polyhedron and Ξ⊆Rs\Xi\subseteq\mathbb R^sΞ⊆Rs a polyhedron. Fix c∈Rmc\in\mathbb R^mc∈Rm, an (r,m‾)(r,\overline m)(r,m)-matrix WWW, and data q(ξ)∈Rm‾q(\xi)\in\mathbb R^{\overline m}q(ξ)∈Rm, h(ξ)∈Rrh(\xi)\in\mathbb R^rh(ξ)∈Rr and an (r,m)(r,m)(r,m)-matrix T(ξ)T(\xi)T(ξ) depending affine linearly on ξ\xiξ. The second-stage value is

Φ(u,t)=inf⁡{uy: Wy=t, y≥0},\Phi(u,t)=\inf\{uy:\ Wy=t,\ y\ge0\},Φ(u,t)=inf{uy: Wy=t, y≥0},

with pos⁡W={Wy:y≥0}\operatorname{pos}W=\{Wy:y\ge0\}posW={Wy:y≥0} and D={u:{z:W′z≤u}≠∅}D=\{u:\{z:W'z\le u\}\ne\emptyset\}D={u:{z:W′z≤u}=∅}. The integrand is f0(ξ,x)=cx+Φ(q(ξ),h(ξ)−T(ξ)x)f_0(\xi,x)=cx+\Phi(q(\xi),h(\xi)-T(\xi)x)f0​(ξ,x)=cx+Φ(q(ξ),h(ξ)−T(ξ)x) when h(ξ)−T(ξ)x∈pos⁡Wh(\xi)-T(\xi)x\in\operatorname{pos}Wh(ξ)−T(ξ)x∈posW and q(ξ)∈Dq(\xi)\in Dq(ξ)∈D, and +∞+\infty+∞ otherwise. For a Borel probability measure ν\nuν on Ξ\XiΞ the problem is

min⁡{∫Ξf0(ξ,x) ν(dξ):x∈X},\min\Big\{\int_\Xi f_0(\xi,x)\,\nu(d\xi):x\in X\Big\},min{∫Ξ​f0​(ξ,x)ν(dξ):x∈X},

with optimal value v(ν)v(\nu)v(ν) and solution set S(ν)S(\nu)S(ν). Two assumptions are made: (A1) h(ξ)−T(ξ)x∈pos⁡Wh(\xi)-T(\xi)x\in\operatorname{pos}Wh(ξ)−T(ξ)x∈posW and q(ξ)∈Dq(\xi)\in Dq(ξ)∈D for all (ξ,x)∈Ξ×X(\xi,x)\in\Xi\times X(ξ,x)∈Ξ×X; (A2) μ\muμ has a finite second moment.

The Fortet–Mourier metric ζ2\zeta_2ζ2​ on P2(Ξ)\mathcal P_2(\Xi)P2​(Ξ), the probability measures on Ξ\XiΞ with finite second moment, is

ζ2(μ,ν)=sup⁡f∈F2(Ξ)∣∫Ξf dμ−∫Ξf dν∣,F2(Ξ)={f:∣f(ξ)−f(ξ~)∣≤max⁡{1,∥ξ∥,∥ξ~∥}∥ξ−ξ~∥}.\zeta_2(\mu,\nu)=\sup_{f\in\mathcal F_2(\Xi)}\Big|\int_\Xi f\,d\mu-\int_\Xi f\,d\nu\Big|,\quad \mathcal F_2(\Xi)=\{f:|f(\xi)-f(\tilde\xi)|\le\max\{1,\|\xi\|,\|\tilde\xi\|\}\|\xi-\tilde\xi\|\}.ζ2​(μ,ν)=f∈F2​(Ξ)sup​​∫Ξ​fdμ−∫Ξ​fdν​,F2​(Ξ)={f:∣f(ξ)−f(ξ~​)∣≤max{1,∥ξ∥,∥ξ~​∥}∥ξ−ξ~​∥}.

For an open bounded U⊇S(μ)\mathcal U\supseteq S(\mu)U⊇S(μ), the growth function is ψ(τ)=inf⁡{∫Ξf0(ξ,x) μ(dξ)−v(μ):d(x,S(μ))≥τ, x∈X∩cl⁡U}\psi(\tau)=\inf\{\int_\Xi f_0(\xi,x)\,\mu(d\xi)-v(\mu): d(x,S(\mu))\ge\tau,\ x\in X\cap\operatorname{cl}\mathcal U\}ψ(τ)=inf{∫Ξ​f0​(ξ,x)μ(dξ)−v(μ):d(x,S(μ))≥τ, x∈X∩clU}, and Ψ(η)=η+ψ−1(2η)\Psi(\eta)=\eta+\psi^{-1}(2\eta)Ψ(η)=η+ψ−1(2η) with ψ−1(t)=sup⁡{τ≥0:ψ(τ)≤t}\psi^{-1}(t)=\sup\{\tau\ge0:\psi(\tau)\le t\}ψ−1(t)=sup{τ≥0:ψ(τ)≤t}.

Formalization targets

Goal: Theorem 3.3 (p. 13)

Under (A1), (A2), S(μ)≠∅S(\mu)\ne\emptysetS(μ)=∅ and U\mathcal UU an open bounded neighbourhood of S(μ)S(\mu)S(μ), there are L>0L>0L>0 and δ>0\delta>0δ>0 such that for every ν∈P2(Ξ)\nu\in\mathcal P_2(\Xi)ν∈P2​(Ξ) with ζ2(μ,ν)<δ\zeta_2(\mu,\nu)<\deltaζ2​(μ,ν)<δ:

∣v(μ)−v(ν)∣≤L ζ2(μ,ν),∅≠S(ν)⊆S(μ)+Ψ(L ζ2(μ,ν)) B.|v(\mu)-v(\nu)|\le L\,\zeta_2(\mu,\nu),\qquad \emptyset\ne S(\nu)\subseteq S(\mu)+\Psi(L\,\zeta_2(\mu,\nu))\,\mathbb B.∣v(μ)−v(ν)∣≤Lζ2​(μ,ν),∅=S(ν)⊆S(μ)+Ψ(Lζ2​(μ,ν))B.

The constants are existential, so the goal does not depend on any particular estimate of them.

Milestones

  1. Lemma 3.1 (p. 11): Φ\PhiΦ is finite and continuous on the polyhedral cone D×pos⁡WD\times\operatorname{pos}WD×posW, piecewise of the form Cju⋅tC_ju\cdot tCj​u⋅t on finitely many polyhedral cones with disjoint interiors, convex in ttt and concave in uuu.
  2. Proposition 3.2 (p. 11): f0f_0f0​ is a normal convex integrand, and for ∥x∥≤r\|x\|\le r∥x∥≤r it satisfies ∣f0(ξ,x)−f0(ξ~,x)∣≤Lrmax⁡{1,∥ξ∥,∥ξ~∥}∥ξ−ξ~∥|f_0(\xi,x)-f_0(\tilde\xi,x)|\le Lr\max\{1,\|\xi\|,\|\tilde\xi\|\}\|\xi-\tilde\xi\|∣f0​(ξ,x)−f0​(ξ~​,x)∣≤Lrmax{1,∥ξ∥,∥ξ~​∥}∥ξ−ξ~​∥, a Lipschitz bound in xxx with factor L^max⁡{1,∥ξ∥2}\hat L\max\{1,\|\xi\|^2\}L^max{1,∥ξ∥2}, and ∣f0(ξ,x)∣≤Krmax⁡{1,∥ξ∥2}|f_0(\xi,x)|\le Kr\max\{1,\|\xi\|^2\}∣f0​(ξ,x)∣≤Krmax{1,∥ξ∥2}.
  3. PFU⊇P2(Ξ)\mathcal P_{\mathcal F_{\mathcal U}}\supseteq\mathcal P_2(\Xi)PFU​​⊇P2​(Ξ) (p. 13): every measure with finite second moment satisfies the integrability conditions of the general theory.
  4. Corollary 2.8 (p. 10): the general Lipschitz stability theorem in the metric ζg\zeta_gζg​ for convex models whose integrands lie, up to a factor LLL, in the class Fg\mathcal F_gFg​.

Significance

The theorem says that, under the two natural well-posedness conditions of linear recourse models, optimal values are Lipschitz continuous and solution sets move by at most Ψ(Lζ2)\Psi(L\zeta_2)Ψ(Lζ2​), where ζ2\zeta_2ζ2​ only sees test functions with the local Lipschitz growth of the integrand. Since ζ2≤(1+∫∥ξ∥2dμ+∫∥ξ∥2dν)1/2W2\zeta_2\le(1+\int\|\xi\|^2d\mu+\int\|\xi\|^2d\nu)^{1/2}W_2ζ2​≤(1+∫∥ξ∥2dμ+∫∥ξ∥2dν)1/2W2​, the result contains the earlier W2W_2W2​ stability theorem.

The results are proved in the paper, except Lemma 3.1, which it cites from Walkup and Wets (1969). None of them is formalized in Mathlib or on Prove2Me. A formalization would provide a checked model of the two-stage recourse function, the Fortet–Mourier metrics, and an end-to-end quantitative stability theorem for stochastic programs, none of which exist in Mathlib.

Difficulty

The obvious argument bounds ∣v(μ)−v(ν)∣|v(\mu)-v(\nu)|∣v(μ)−v(ν)∣ by sup⁡x∣∫f0(⋅,x) d(μ−ν)∣\sup_x|\int f_0(\cdot,x)\,d(\mu-\nu)|supx​∣∫f0​(⋅,x)d(μ−ν)∣ and then by Lζ2L\zeta_2Lζ2​. Two steps fail. First, the supremum ranges over all of XXX, which may be unbounded, while f0(⋅,x)/Lf_0(\cdot,x)/Lf0​(⋅,x)/L lies in F2\mathcal F_2F2​ only for xxx in a bounded set; the argument must localize to X∩cl⁡UX\cap\operatorname{cl}\mathcal UX∩clU and then show, using convexity, that for ν\nuν close to μ\muμ the localized and global problems coincide. Second, the Lipschitz estimate in ξ\xiξ for f0f_0f0​ requires the piecewise-bilinear structure of Φ\PhiΦ (Lemma 3.1) and a chaining argument across the polyhedral pieces of Ξ\XiΞ; the integrand is not differentiable.

Formalization scope

  • Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n). The paper never fixes its norm and all its constants are existential, so the Euclidean norm is a faithful instance. Second-stage vectors u,t,y,zu,t,y,zu,t,y,z are coordinate vectors Fin k → ℝ; index sets are 0-based.
  • A polyhedron is a finite intersection of closed half-spaces. The standing assumptions are: XXX a nonempty polyhedron, Ξ\XiΞ a polyhedron, q,h,Tq,h,Tq,h,T affine maps.
  • A measure in P(Ξ)\mathcal P(\Xi)P(Ξ) is a Borel probability measure on Rs\mathbb R^sRs with ν(Ξc)=0\nu(\Xi^c)=0ν(Ξc)=0; ∫Ξf0(ξ,x) ν(dξ)\int_\Xi f_0(\xi,x)\,\nu(d\xi)∫Ξ​f0​(ξ,x)ν(dξ) is the extended-real integral of the published DupacovaWets.Consistency.expect over ν\nuν restricted to Ξ\XiΞ.
  • Φ\PhiΦ, f0f_0f0​, vvv and ψ\psiψ are extended-real infima (+∞+\infty+∞ over an empty set); "min" in ψ\psiψ is read as an infimum. ζ2\zeta_2ζ2​, ζg\zeta_gζg​, ψ−1\psi^{-1}ψ−1 and Ψ\PsiΨ take values in [0,∞][0,\infty][0,∞], and the distance to a set is the extended distance (+∞+\infty+∞ to ∅\emptyset∅).
  • To rule out trivializations: every value bound states that v(μ)v(\mu)v(μ), v(ν)v(\nu)v(ν) are finite before comparing them, so the extended-real arithmetic ∞−∞\infty-\infty∞−∞ cannot make it vacuous; in ζ2\zeta_2ζ2​ a test function that is not integrable for both measures contributes +∞+\infty+∞, never a junk 000.
  • Disclosed readings: Proposition 3.2 leaves its radius rrr unquantified; it is stated with the constants first and then every r≥1r\ge1r≥1. Lemma 3.1's "pos⁡W×D\operatorname{pos}W\times DposW×D" is read as D×pos⁡WD\times\operatorname{pos}WD×posW, in the order of Φ\PhiΦ's arguments. Corollary 2.8 adds μ,ν∈PFU(Ξ)\mu,\nu\in\mathcal P_{\mathcal F_{\mathcal U}}(\Xi)μ,ν∈PFU​​(Ξ), an assumption of Theorem 2.2 that its proof invokes; Theorem 3.3 needs no such addition, because milestone 3 supplies it.
  • Needed infrastructure: LP duality and the Walkup–Wets decomposition of Φ\PhiΦ; normal integrands and measurability of their infima; integrability under moment conditions; the general stability theorems (Theorems 2.2–2.3 of the paper) for d=0d=0d=0. The definitions of ζp\zeta_pζp​, Fg\mathcal F_gFg​ and normal integrands are reusable well beyond this mission. Contributions toward any milestone, and proofs of the auxiliary facts (for example, that every f∈F2(Ξ)f\in\mathcal F_2(\Xi)f∈F2​(Ξ) is integrable for ν∈P2(Ξ)\nu\in\mathcal P_2(\Xi)ν∈P2​(Ξ)), are welcome.

Selected references

  • S. T. Rachev, W. Römisch, Quantitative stability in stochastic programming: The method of probability metrics, Mathematics of Operations Research 27(4) (2002) 792–818. https://doi.org/10.1287/moor.27.4.792.304 (cited here from the authors' preprint, edoc.hu-berlin.de)
  • D. W. Walkup, R. J-B Wets, Lifting projections of convex polyhedra, Pacific Journal of Mathematics 28 (1969) 465–475 (the paper's [55]).
  • S. M. Robinson, R. J-B Wets, Stability in two-stage stochastic programming, SIAM Journal on Control and Optimization 25 (1987) 1409–1416 (the paper's [37]).
  • W. Römisch, R. Schultz, Stability analysis for stochastic programs, Annals of Operations Research 30 (1991) 241–266 (the paper's [40]).
  • R. T. Rockafellar, R. J-B Wets, Variational Analysis, Springer (the paper's [38]; normal integrands, Chapter 14).
  • S. T. Rachev, Probability Metrics and the Stability of Stochastic Models, Wiley, Chichester 1991 (the paper's [32]).
8 thms1 active userReviewed
Dynamic ProgrammingOperations ResearchReinforcement Learning·Captain: mikedeng1

Bounded-parameter Markov Decision Processes 1: The Optimistic and Pessimistic Optimal Interval Value Functions Satisfy Bellman-like EquationsResearch Paper

Motivation

A Markov decision process is specified by numbers: transition probabilities and rewards. In practice these numbers are estimated from data, elicited from experts, or produced by aggregating the states of a larger model, and in each case what is actually known is a range for each parameter rather than its value. Givan, Leach and Dean (Artificial Intelligence, 2000) introduced bounded-parameter MDPs (BMDPs) to reason about a whole family of MDPs at once: every transition probability is only known to lie in a closed interval. Their motivation was state-space aggregation, where grouping states with similar but not identical dynamics yields exactly such interval bounds, and the same object later reappeared as the interval or "box" uncertainty set of robust MDPs (Nilim and El Ghaoui, 2005; Iyengar, 2005) and of optimistic exploration in reinforcement learning (Strehl and Littman, 2008).

Over such a family, the value of a policy is no longer a number but an interval, and "optimal" needs a definition. This mission formalizes the paper's answer: two total orders on intervals, the corresponding optimal policies, and the Bellman-like equations their interval value functions satisfy.

Setting

An exact MDP M=⟨Q,A,F,R⟩M=\langle Q,A,F,R\rangleM=⟨Q,A,F,R⟩ has a finite set QQQ of states, a finite nonempty set AAA of actions, transition probabilities Fpq(α)≥0F_{pq}(\alpha)\ge 0Fpq​(α)≥0 with ∑qFpq(α)=1\sum_{q}F_{pq}(\alpha)=1∑q​Fpq​(α)=1, a reward R(q)∈RR(q)\in\mathbb RR(q)∈R for each state and a discount rate 0≤γ<10\le\gamma<10≤γ<1. A policy is a map π:Q→A\pi:Q\to Aπ:Q→A; Π\PiΠ is the set of all policies. The value function VM,π(p)V_{M,\pi}(p)VM,π​(p) is the expected discounted sum of rewards ∑t≥0γt E[R(Xt)∣X0=p]\sum_{t\ge 0}\gamma^t\,\mathbb E[R(X_t)\mid X_0=p]∑t≥0​γtE[R(Xt​)∣X0​=p] along the Markov chain with transitions Fpq(π(p))F_{pq}(\pi(p))Fpq​(π(p)). The operators

VIM,π(v)(p)=R(p)+γ∑qFpq(π(p)) v(q),VIM,α(v)(p)=R(p)+γ∑qFpq(α) v(q)VI_{M,\pi}(v)(p)=R(p)+\gamma\sum_{q}F_{pq}(\pi(p))\,v(q),\qquad VI_{M,\alpha}(v)(p)=R(p)+\gamma\sum_{q}F_{pq}(\alpha)\,v(q)VIM,π​(v)(p)=R(p)+γq∑​Fpq​(π(p))v(q),VIM,α​(v)(p)=R(p)+γq∑​Fpq​(α)v(q)

act on value functions v:Q→Rv:Q\to\mathbb Rv:Q→R. V1≤domV2V_1\le_{\mathrm{dom}}V_2V1​≤dom​V2​ is the statewise order.

A BMDP M↕M_\updownarrowM↕​ gives for each p,q,αp,q,\alphap,q,α an interval [F↓pq(α),F↑pq(α)]⊆[0,1][F_\downarrow{}_{pq}(\alpha),F_\uparrow{}_{pq}(\alpha)]\subseteq[0,1][F↓​pq​(α),F↑​pq​(α)]⊆[0,1] with ∑qF↓pq(α)≤1≤∑qF↑pq(α)\sum_q F_\downarrow{}_{pq}(\alpha)\le 1\le\sum_q F_\uparrow{}_{pq}(\alpha)∑q​F↓​pq​(α)≤1≤∑q​F↑​pq​(α), a reward RRR and a discount rate γ\gammaγ. Its members M∈M↕M\in M_\updownarrowM∈M↕​ are the exact MDPs with that RRR and γ\gammaγ and with FpqM(α)∈[F↓pq(α),F↑pq(α)]F^M_{pq}(\alpha)\in[F_\downarrow{}_{pq}(\alpha),F_\uparrow{}_{pq}(\alpha)]FpqM​(α)∈[F↓​pq​(α),F↑​pq​(α)]. The interval value of a policy is

V↕π(q)=[min⁡M∈M↕VM,π(q), max⁡M∈M↕VM,π(q)]=[V↓π(q),V↑π(q)].V_\updownarrow{}_\pi(q)=\Big[\min_{M\in M_\updownarrow}V_{M,\pi}(q),\ \max_{M\in M_\updownarrow}V_{M,\pi}(q)\Big]=[V_\downarrow{}_\pi(q),V_\uparrow{}_\pi(q)].V↕​π​(q)=[M∈M↕​min​VM,π​(q), M∈M↕​max​VM,π​(q)]=[V↓​π​(q),V↑​π​(q)].

Intervals are compared by the optimistic order, which compares upper bounds first and breaks ties by lower bounds, and the pessimistic order, which compares lower bounds first:

[l1,u1]≤opt[l2,u2]  ⟺  u1<u2 ∨ (u1=u2∧l1≤l2),[l1,u1]≤pes[l2,u2]  ⟺  l1<l2 ∨ (l1=l2∧u1≤u2).[l_1,u_1]\le_{\mathrm{opt}}[l_2,u_2]\iff u_1<u_2\ \vee\ (u_1=u_2\wedge l_1\le l_2),\qquad [l_1,u_1]\le_{\mathrm{pes}}[l_2,u_2]\iff l_1<l_2\ \vee\ (l_1=l_2\wedge u_1\le u_2).[l1​,u1​]≤opt​[l2​,u2​]⟺u1​<u2​ ∨ (u1​=u2​∧l1​≤l2​),[l1​,u1​]≤pes​[l2​,u2​]⟺l1​<l2​ ∨ (l1​=l2​∧u1​≤u2​).

A policy πopt\pi_{\mathrm{opt}}πopt​ is optimistically optimal if V↕πopt(q)≥optV↕π(q)V_\updownarrow{}_{\pi_{\mathrm{opt}}}(q)\ge_{\mathrm{opt}}V_\updownarrow{}_\pi(q)V↕​πopt​​(q)≥opt​V↕​π​(q) for all π\piπ and qqq; pessimistically optimal is defined with ≥pes\ge_{\mathrm{pes}}≥pes​. The optimal interval value functions are V↕opt=V↕πoptV_\updownarrow{}_{\mathrm{opt}}=V_\updownarrow{}_{\pi_{\mathrm{opt}}}V↕​opt​=V↕​πopt​​ and V↕pes=V↕πpesV_\updownarrow{}_{\mathrm{pes}}=V_\updownarrow{}_{\pi_{\mathrm{pes}}}V↕​pes​=V↕​πpes​​.

Formalization targets

Goal: Theorem 9, equations (25) and (26)

At every state ppp,

V↕opt(p)=max⁡α∈A, ≤opt[min⁡M∈M↕VIM,α(V↓opt)(p), max⁡M∈M↕VIM,α(V↑opt)(p)],V_\updownarrow{}_{\mathrm{opt}}(p)=\max_{\alpha\in A,\ \le_{\mathrm{opt}}}\Big[\min_{M\in M_\updownarrow}VI_{M,\alpha}(V_\downarrow{}_{\mathrm{opt}})(p),\ \max_{M\in M_\updownarrow}VI_{M,\alpha}(V_\uparrow{}_{\mathrm{opt}})(p)\Big],V↕​opt​(p)=α∈A, ≤opt​max​[M∈M↕​min​VIM,α​(V↓​opt​)(p), M∈M↕​max​VIM,α​(V↑​opt​)(p)],

and the same with pes\mathrm{pes}pes in place of opt\mathrm{opt}opt. The maximum over actions is for the total order on intervals: attained by some action and an upper bound for every action.

Milestones

In the order the proof uses them: Theorem 3 (second sentence: VM,πV_{M,\pi}VM,π​ is the unique fixed point of VIM,πVI_{M,\pi}VIM,π​); Theorem 6 (comparison: u≤domVIM,π(u)u\le_{\mathrm{dom}}VI_{M,\pi}(u)u≤dom​VIM,π​(u) implies u≤domVM,πu\le_{\mathrm{dom}}V_{M,\pi}u≤dom​VM,π​, and its three variants); Lemma 1 (every member's values and backups are bracketed by finitely many order-maximizing MDPs); Lemma 2 (statewise composition of member MDPs dominates, or is dominated by, both components); Theorem 7 (π\piπ-maximizing and π\piπ-minimizing MDPs exist among the order-maximizing ones); Corollary 1 (V↓πV_\downarrow{}_\piV↓​π​ and V↑πV_\uparrow{}_\piV↑​π​ are a minimum and a maximum for ≤dom\le_{\mathrm{dom}}≤dom​); Lemma 3 (statewise composition of policies improves the upper, resp. lower, bounds); Theorem 8 (optimistically and pessimistically optimal policies exist).

Significance

Theorem 9 is the interval analogue of the Bellman optimality equation. It is what makes the optimal interval value functions computable: the paper's interval value iteration algorithms IVI↕optIVI_\updownarrow{}_{\mathrm{opt}}IVI↕​opt​ and IVI↕pesIVI_\updownarrow{}_{\mathrm{pes}}IVI↕​pes​ (Section 5) iterate exactly the right-hand sides of (25) and (26). The lower half of (26) is the max-min equation of robust dynamic programming with rectangular box uncertainty, and the upper half of (25) is the max-max equation behind optimistic planning; Theorem 9 states both, together with the tie-breaking second component, in one model. Theorems 7 and 8 are of independent use: a single member MDP is worst (or best) for a policy at all states at once, and the partial orders on interval value functions nevertheless have maxima over policies.

None of these results has a machine-checked proof. The platform has robust Bellman equations in other models (costs, general rectangular sets, a sup over nature) but nothing on BMDPs, interval value functions, or the orders ≤opt\le_{\mathrm{opt}}≤opt​ and ≤pes\le_{\mathrm{pes}}≤pes​. The mission produces the paper's optimality theory end to end, from the comparison principle for exact MDPs to the two Bellman-like equations, on a model shared with the companion mission on interval policy evaluation.

Difficulty

The orders ≤opt\le_{\mathrm{opt}}≤opt​ and ≤pes\le_{\mathrm{pes}}≤pes​ are total on intervals but only partial on interval value functions, and they are lexicographic. The obvious construction of an optimal policy, switching statewise to whichever of two policies has the better interval, fails: the composed policy need not dominate either component in ≤opt\le_{\mathrm{opt}}≤opt​, because lower bounds can get worse at states where the upper bounds do not change (the paper says so explicitly, eq. (20)). Existence therefore needs a two-stage argument. A second obstacle is that V↓πV_\downarrow{}_\piV↓​π​ and V↑πV_\uparrow{}_\piV↑​π​ are defined statewise, as minima over an uncountable family; that one member attains them at every state simultaneously is a theorem (Theorem 7), and the Bellman-like equations rest on it. Finally, the inner minima in (25) act on V↓optV_\downarrow{}_{\mathrm{opt}}V↓​opt​, the lower bound of an optimistically chosen policy, which is not the componentwise best lower bound over policies; the equation couples the two components through the tie-break.

Formalization scope

QQQ and AAA are finite types, AAA is nonempty; QQQ may be empty. An exact MDP is a structure with transition function F p α q =Fpq(α)=F_{pq}(\alpha)=Fpq​(α), stochastic rows, reward R:Q→RR:Q\to\mathbb RR:Q→R and discount 0≤γ<10\le\gamma<10≤γ<1. VM,πV_{M,\pi}VM,π​ is defined as the convergent series ∑tγtPπtR\sum_t\gamma^tP_\pi^tR∑t​γtPπt​R, not as a solution of (2). Rewards of the BMDP are tight, as the paper assumes from footnote 3 on; reward intervals are not formalized. Members of M↕M_\updownarrowM↕​ form a subtype of exact MDPs with the BMDP's RRR and γ\gammaγ. The minima and maxima of Definition 3 and of (25)–(26) are the real infimum and supremum over that subtype, which is nonempty and on which values are bounded, so no junk value enters. Intervals are pairs (lower, upper); the orders (17) are spelled out. Policies are deterministic stationary maps Q→AQ\to AQ→A, the paper's Π\PiΠ. An ordering of QQQ is a bijection Fin |Q| ≃ Q, and the index rrr of Definition 1 is the largest index at which expression (9) does not exceed 1 (the page's phrase admits ties; only the largest index keeps the remaining mass inside its interval). Definition 8 is read as V↕opt=V↕πoptV_\updownarrow{}_{\mathrm{opt}}=V_\updownarrow{}_{\pi_{\mathrm{opt}}}V↕​opt​=V↕​πopt​​ for an optimistically optimal πopt\pi_{\mathrm{opt}}πopt​, so the goal is quantified over all optimistically (pessimistically) optimal policies; Theorem 8 is the milestone that makes this quantification non-vacuous. Lemma 3 is stated as in the Appendix (p. 36): part (d) concerns π4=π1⊕pesπ2\pi_4=\pi_1\oplus_{\mathrm{pes}}\pi_2π4​=π1​⊕pes​π2​, where p. 17 misprints π3\pi_3π3​.

A formalization in which members carry their own discount, rows need not sum to one, the minima range over all functions Q→A→Q→RQ\to A\to Q\to\mathbb RQ→A→Q→R, or V↕optV_\updownarrow{}_{\mathrm{opt}}V↕​opt​ is the componentwise supremum over policies would make several statements false or trivial; each is ruled out above.

Contributions welcome beyond proofs of the milestones: a reusable theory of discounted policy evaluation for finite MDPs (the series representation, the fixed-point characterization, monotonicity of VIM,πVI_{M,\pi}VIM,π​), which other missions on finite MDPs can import.

Selected references

  • R. Givan, S. Leach, T. Dean, Bounded-parameter Markov decision processes, Artificial Intelligence 122 (2000). https://doi.org/10.1016/S0004-3702(00)00047-3
  • A. Nilim, L. El Ghaoui, Robust control of Markov decision processes with uncertain transition matrices, Operations Research 53(5), 2005. https://doi.org/10.1287/opre.1050.0216
  • G. Iyengar, Robust dynamic programming, Mathematics of Operations Research 30(2), 2005. https://doi.org/10.1287/moor.1040.0129
  • A. Strehl, M. Littman, An analysis of model-based interval estimation for Markov decision processes, Journal of Computer and System Sciences 74(8), 2008. https://doi.org/10.1016/j.jcss.2007.08.009
  • M. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
11 thms1 active userReviewed
Convex OptimizationNumerical AnalysisOperations Research·Captain: mikedeng1

A Coordinate Gradient Descent Method for Nonsmooth Separable Minimization 3: The Local Lipschitzian Error Bound Holds for Polyhedral P with Quadratic or Composite f, and for Strongly Convex fResearch Paper

Motivation

Many problems in statistics, signal processing and machine learning minimize the sum of a smooth function and a convex but nonsmooth one: ℓ1\ell_1ℓ1​-regularized least squares (the Lasso), bound-constrained problems, and group-sparse regression are standard examples. Tseng and Yun (Math. Program. Ser. B 117 (2009) 387–423) proposed the coordinate gradient descent (CGD) method for this class and proved that it converges linearly under a local Lipschitzian error bound, Assumption 2(a) of their paper. An assumption is only as useful as the list of problems known to satisfy it. Section 6 of the paper supplies that list, and this mission formalizes it.

Error bounds of this kind have a history in smooth constrained optimization. Luo and Tseng proved them for quadratic objectives over polyhedral sets (Luo–Tseng 1992, SIAM J. Optim.), for strongly convex functions composed with a linear map (Luo–Tseng 1992, SIAM J. Control Optim.), and for dual functionals of linearly constrained strictly convex programs (Luo–Tseng 1993, Math. Oper. Res.), and used them to derive linear rates for feasible descent methods (Luo–Tseng 1993, Ann. Oper. Res.). Tseng and Yun carry these results over to the nonsmooth problem (1) by reformulating it as a smooth problem over the epigraph of the nonsmooth part.

Setting

Throughout, Rn\mathbb R^nRn carries the Euclidean norm ∥⋅∥\|\cdot\|∥⋅∥. The problem is

min⁡x  Fc(x)=f(x)+cP(x),(1)\min_x\; F_c(x) = f(x) + cP(x), \qquad (1)xmin​Fc​(x)=f(x)+cP(x),(1)

where c>0c > 0c>0, P:Rn→(−∞,∞]P:\mathbb R^n \to (-\infty,\infty]P:Rn→(−∞,∞] is proper, convex and lower semicontinuous with effective domain dom⁡P={x∣P(x)<∞}\operatorname{dom}P = \{x \mid P(x) < \infty\}domP={x∣P(x)<∞}, and fff is continuously differentiable on an open set containing dom⁡P\operatorname{dom}PdomP.

The residual at x∈dom⁡Px \in \operatorname{dom}Px∈domP is

dI(x)=arg⁡min⁡d{∇f(x)⊤d+12∥d∥2+cP(x+d)},d_I(x) = \arg\min_d \Big\{\nabla f(x)^\top d + \tfrac12\|d\|^2 + cP(x+d)\Big\},dI​(x)=argdmin​{∇f(x)⊤d+21​∥d∥2+cP(x+d)},

the unique minimizer of a strongly convex function. A point x∈dom⁡Px \in \operatorname{dom}Px∈domP is stationary if the one-sided directional derivative satisfies Fc′(x;d)≥0F_c'(x;d) \ge 0Fc′​(x;d)≥0 for every direction ddd; Xˉ\bar XXˉ denotes the set of stationary points and dist⁡(x,Xˉ)\operatorname{dist}(x,\bar X)dist(x,Xˉ) the distance to it. A point is stationary exactly when its residual vanishes.

Assumption 2(a) asks that Xˉ≠∅\bar X \neq \emptysetXˉ=∅ and that for every level ζ\zetaζ there be constants τ,ϵ>0\tau, \epsilon > 0τ,ϵ>0 with

dist⁡(x,Xˉ)≤τ∥dI(x)∥whenever Fc(x)≤ζ, ∥dI(x)∥≤ϵ.\operatorname{dist}(x,\bar X) \le \tau\|d_I(x)\| \quad\text{whenever } F_c(x) \le \zeta,\ \|d_I(x)\| \le \epsilon.dist(x,Xˉ)≤τ∥dI​(x)∥whenever Fc​(x)≤ζ, ∥dI​(x)∥≤ϵ.

Writing epi⁡P={(x,ξ)∣P(x)≤ξ}\operatorname{epi}P = \{(x,\xi) \mid P(x) \le \xi\}epiP={(x,ξ)∣P(x)≤ξ}, problem (1) is equivalent to the smooth problem min⁡{f(x)+cξ∣(x,ξ)∈epi⁡P}\min\{f(x) + c\xi \mid (x,\xi) \in \operatorname{epi}P\}min{f(x)+cξ∣(x,ξ)∈epiP} (41). Its projection residual at (x,ξ)(x,\xi)(x,ξ) is the optimal solution (d~,δ~)(\tilde d,\tilde\delta)(d~,δ~) of

min⁡(d,δ){∇f(x)⊤d+12∥d∥2+12δ2+cδ  ∣  (x+d,ξ+δ)∈epi⁡P}.(42)\min_{(d,\delta)}\Big\{\nabla f(x)^\top d + \tfrac12\|d\|^2 + \tfrac12\delta^2 + c\delta \;\Big|\; (x+d,\xi+\delta) \in \operatorname{epi}P\Big\}. \qquad (42)(d,δ)min​{∇f(x)⊤d+21​∥d∥2+21​δ2+cδ​(x+d,ξ+δ)∈epiP}.(42)

PPP is polyhedral if epi⁡P\operatorname{epi}PepiP is the solution set of finitely many linear inequalities in (x,ξ)(x,\xi)(x,ξ); fff is quadratic if f(x)=12x⊤Ax+b⊤x+c0f(x) = \tfrac12 x^\top Ax + b^\top x + c_0f(x)=21​x⊤Ax+b⊤x+c0​ with AAA symmetric, not necessarily positive semidefinite. The four problem classes are:

  • C1: fff quadratic, PPP polyhedral;
  • C2: f(x)=g(Ex)+q⊤xf(x) = g(Ex) + q^\top xf(x)=g(Ex)+q⊤x with ggg strongly convex and differentiable on Rm\mathbb R^mRm, ∇g\nabla g∇g Lipschitz, PPP polyhedral;
  • C3: f(x)=max⁡y∈Y{(Ex)⊤y−g(y)}+q⊤xf(x) = \max_{y\in Y}\{(Ex)^\top y - g(y)\} + q^\top xf(x)=maxy∈Y​{(Ex)⊤y−g(y)}+q⊤x with YYY polyhedral and ggg as in C2, PPP polyhedral;
  • C4: fff strongly convex with ∇f\nabla f∇f Lipschitz on dom⁡P\operatorname{dom}PdomP (condition (22)).

Formalization targets

Goal: Theorem 4 (p. 412)

(Xˉ≠∅ ∧ (C1∨C2∨C3)) ∨ C4  ⟹  Assumption 2(a).\Big(\bar X \neq \emptyset \ \wedge\ (\mathrm{C1} \vee \mathrm{C2} \vee \mathrm{C3})\Big) \ \vee\ \mathrm{C4} \;\Longrightarrow\; \text{Assumption 2(a)}.(Xˉ=∅ ∧ (C1∨C2∨C3)) ∨ C4⟹Assumption 2(a).

Under C4, nonemptiness of Xˉ\bar XXˉ is part of the conclusion. The constants τ,ϵ\tau, \epsilonτ,ϵ are existential, so the goal does not depend on any particular estimate.

Milestone: Lemma 6 (p. 410)

If PPP is Lipschitz on dom⁡P\operatorname{dom}PdomP with constant KKK, there is κ>0\kappa > 0κ>0 depending only on KKK with

∥(d~,δ~)∥≤κ ∥dI(x)∥(x∈dom⁡P, ξ=P(x)).\|(\tilde d,\tilde\delta)\| \le \kappa\,\|d_I(x)\| \qquad (x \in \operatorname{dom}P,\ \xi = P(x)).∥(d~,δ~)∥≤κ∥dI​(x)∥(x∈domP, ξ=P(x)).

Milestone: Lemma 7 (p. 411)

If Xˉ≠∅\bar X \neq \emptysetXˉ=∅ and C1, C2 or C3 holds, then for every ζ\zetaζ there are τ′,ϵ′>0\tau', \epsilon' > 0τ′,ϵ′>0 with

dist⁡(x,Xˉ)≤τ′∥(d~,δ~)∥whenever Fc(x)≤ζ, ∥(d~,δ~)∥≤ϵ′,(44)\operatorname{dist}(x,\bar X) \le \tau'\|(\tilde d,\tilde\delta)\| \quad\text{whenever } F_c(x) \le \zeta,\ \|(\tilde d,\tilde\delta)\| \le \epsilon', \qquad (44)dist(x,Xˉ)≤τ′∥(d~,δ~)∥whenever Fc​(x)≤ζ, ∥(d~,δ~)∥≤ϵ′,(44)

where (d~,δ~)(\tilde d,\tilde\delta)(d~,δ~) solves (42) with ξ=P(x)\xi = P(x)ξ=P(x).

A further item, not a milestone, states the remark after Assumption 2 (p. 404) that Assumption 2(b) (stationary points with different objective values are uniformly separated) holds whenever fff is convex.

Significance

Theorem 4 is what makes the linear convergence theorem of the paper (Theorem 2, the subject of the second mission of this series) applicable. Through C1 it covers every problem with a quadratic fff and a polyhedral PPP, including the Lasso and ℓ1\ell_1ℓ1​-regularized or bound-constrained quadratic programs, without convexity of fff. Through C2 it covers losses of the form g(Ex)g(Ex)g(Ex) with ggg strongly convex, such as least squares 12∥Ex−b∥2\tfrac12\|Ex - b\|^221​∥Ex−b∥2, where fff itself is not strongly convex because EEE may have a nontrivial kernel. These error bounds became a standard tool for linear rates of proximal and coordinate methods without strong convexity.

The paper's result is proved, but Lemma 7 is proved by citation: it applies three error bounds of Luo and Tseng to the reformulation (41). A complete formalization therefore requires those error bounds for smooth problems over polyhedral sets, which are not in Mathlib. To our knowledge none of the results of this mission has a machine-checked proof.

Difficulty

Lemma 6 and the C4 case of Theorem 4 are short inequality arguments. The difficulty is Lemma 7. The natural first idea, proving an error bound from strong convexity, fails for C1–C3: fff may be nonconvex (C1) or have a degenerate Hessian (C2, C3), and the objective f(x)+cξf(x) + c\xif(x)+cξ of (41) is never strongly convex in (x,ξ)(x,\xi)(x,ξ). What replaces strong convexity is the polyhedral structure of epi⁡P\operatorname{epi}PepiP, and the cited Luo–Tseng error bounds that exploit it are substantial results in their own right, each of which has to be established for a projection residual over a general polyhedron in Rn+1\mathbb R^{n+1}Rn+1.

Formalization scope

Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n), with indices 0,…,n−10,\dots,n-10,…,n−1. PPP is the pair (D,P)(D, P)(D,P), its effective domain and its finite values there, with "proper, convex, lsc" given by the published ProxNewton.Inexact.IsProperClosedConvex. The value +∞+\infty+∞ is never computed: every statement quantifies over x∈Dx \in Dx∈D, and membership in epi⁡P\operatorname{epi}PepiP is x + d ∈ D ∧ P (x + d) ≤ ξ + δ. dI(x)d_I(x)dI​(x) is a chosen minimizer of its subproblem, which at x∈Dx \in Dx∈D is the paper's unique one. The solutions of (42) enter through a predicate, and every bound is asserted for every optimal solution. Stationarity is the liminf form of Fc′(x;d)≥0F_c'(x;d) \ge 0Fc′​(x;d)≥0. dist⁡\operatorname{dist}dist is the infimum distance. Assumption 2(a) quantifies over every real ζ\zetaζ, which agrees with the paper's "ζ≥min⁡Fc\zeta \ge \min F_cζ≥minFc​" because the condition is vacuous below inf⁡Fc\inf F_cinfFc​. In Lemma 6 the constant κ\kappaκ is quantified before the dimension and the data, so it depends on the Lipschitz constant only.

Explicit choices relative to the printed text:

  • In C4, strong convexity and (22) are required on dom⁡P\operatorname{dom}PdomP only, since fff is only assumed smooth near dom⁡P\operatorname{dom}PdomP. This hypothesis is weaker than the paper's, so the formal theorem is at least as strong.
  • In C2 and C3, EEE is a continuous linear map Rn→Rm\mathbb R^n \to \mathbb R^mRn→Rm (equivalently an m×nm \times nm×n matrix). Strong convexity has a positive modulus and ∇g\nabla g∇g is globally Lipschitz.
  • In C3, the maximum must be attained at every xxx, which forces Y≠∅Y \neq \emptysetY=∅, as the paper's formula presumes.
  • Assumption 2(b) for convex fff is stated with convexity on dom⁡P\operatorname{dom}PdomP.

A polyhedrality notion that admits only affine or constant PPP, an Assumption 2(a) whose constants are chosen after xxx, and a Lemma 7 whose residual is dI(x)d_I(x)dI​(x) instead of the solution of (42) would all trivialize or change the statements. The encoding rules out each of them: polyhedral means a finite system of linear inequalities in (x,ξ)(x,\xi)(x,ξ), the constants precede xxx, and Lemma 7 is stated for (42).

Welcome contributions: proofs of Lemma 6 and of the C4 case; Lipschitz continuity of polyhedral functions on their domain (Rockafellar–Wets, Example 9.35); the Luo–Tseng error bounds for affine variational inequalities and for composite strongly convex objectives over polyhedra, which can be reused well beyond this mission.

Selected references

  • P. Tseng, S. Yun, A coordinate gradient descent method for nonsmooth separable minimization, Math. Program. Ser. B 117 (2009) 387–423. https://doi.org/10.1007/s10107-007-0170-0
  • Z.-Q. Luo, P. Tseng, Error bounds and the convergence analysis of matrix splitting algorithms for the affine variational inequality problem, SIAM J. Optim. 2 (1992) 43–54. https://doi.org/10.1137/0802004
  • Z.-Q. Luo, P. Tseng, On the linear convergence of descent methods for convex essentially smooth minimization, SIAM J. Control Optim. 30 (1992) 408–425. https://doi.org/10.1137/0330025
  • Z.-Q. Luo, P. Tseng, On the convergence rate of dual ascent methods for linearly constrained convex minimization, Math. Oper. Res. 18 (1993) 846–867. https://doi.org/10.1287/moor.18.4.846
  • Z.-Q. Luo, P. Tseng, Error bounds and convergence analysis of feasible descent methods: a general approach, Ann. Oper. Res. 46 (1993) 157–178. https://doi.org/10.1007/BF02096261
  • R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 1998. https://doi.org/10.1007/978-3-642-02431-3
7 thms1 active userReviewed
Dynamic ProgrammingOperations ResearchProbability·Captain: mikedeng1

On the Structure of Lost-Sales Inventory Models 3: If Demand Increases in the Convex Order, the Optimal Lost-Sales Cost f̄_t(v; φ) Is Nondecreasing in φResearch Paper

Motivation

In the periodic-review inventory model with lost sales, demand that cannot be met from stock is lost rather than backordered. With a positive order lead time LLL the state of the system is a vector of length LLL: on-hand stock plus the L−1L-1L−1 orders still in the pipeline. This model is standard in retail, where a customer facing an empty shelf buys elsewhere. Its optimal policy is not a base-stock policy and depends on the whole pipeline vector, which makes it much harder to analyse than the backorder model.

A basic question for any stochastic inventory model is how its optimal cost responds to uncertainty in demand. For the backorder model it is classical that more variable demand costs more (Song 1994). Zipkin's paper (Oper. Res. 56(4), 2008, 937–944) recasts the lost-sales model in a transformed state in which the optimal cost functions are L♮^\natural♮-convex. Its §5 uses this structure to prove the lost-sales analogue: if demand becomes more variable in the convex order, the optimal cost does not decrease. The paper presents this as new in the lost-sales setting.

Timeline of the structural results the mission rests on:

  • 1958: Karlin and Scarf analyse the lost-sales model with lead time one and show that the optimal order decreases in the on-hand stock, with sensitivity less than one.
  • 1969: Morton extends these monotonicity and bounded-sensitivity properties to general lead times and derives bounds on the optimal order.
  • 2008: Zipkin reproves these properties through L♮^\natural♮-convexity in the transformed state (Theorem 4) and adds the parametric result of §5 (Theorem 11).

Setting

The order lead time is a positive integer LLL. The cost factors are the unit procurement cost ccc, the unit holding cost h^\hat hh^, the unit lost-sales penalty ppp and the discount factor γ\gammaγ. Demands in different periods are independent and nonnegative, with a common law. The paper treats states and orders as continuous.

Transformed state. A state is a vector v=(v0,…,vL−1)v=(v_0,\dots,v_{L-1})v=(v0​,…,vL−1​), where vlv_lvl​ is the stock on hand plus all orders due to arrive lll or more periods hence, and vL=0v_L=0vL​=0 by convention. So v0v_0v0​ is the inventory position and v0−v1v_0-v_1v0​−v1​ is the stock on hand. The state space is

V={v∈RL: v0≥v1≥⋯≥vL−1≥0}.V=\{v\in\mathbb R^L:\ v_0\ge v_1\ge\cdots\ge v_{L-1}\ge0\}.V={v∈RL: v0​≥v1​≥⋯≥vL−1​≥0}.

The action is ζ=−z≤0\zeta=-z\le0ζ=−z≤0, where z≥0z\ge0z≥0 is the order quantity, and eee is the all-ones vector. After demand ddd, the next state is

v+=([v0−v1−d]++v1, v2, …, vL−1, 0)−ζe.v_+=\big([v_0-v_1-d]^++v_1,\ v_2,\ \dots,\ v_{L-1},\ 0\big)-\zeta e.v+​=([v0​−v1​−d]++v1​, v2​, …, vL−1​, 0)−ζe.

Costs and recursion. The end-of-period holding and penalty cost is q^(u)=h^u++pu−\hat q(u)=\hat hu^++pu^-q^​(u)=h^u++pu−, and its expectation given on-hand stock yyy is q^0(y)=E[q^(y−d)]\hat q^0(y)=E[\hat q(y-d)]q^​0(y)=E[q^​(y−d)]. The optimal cost functions satisfy

gˉt(v,ζ)=−γLcζ+q^0(v0−v1)+γE[fˉt+1(v+)],fˉt(v)=min⁡ζ≤0gˉt(v,ζ),\bar g_t(v,\zeta)=-\gamma^Lc\zeta+\hat q^0(v_0-v_1)+\gamma E[\bar f_{t+1}(v_+)],\qquad \bar f_t(v)=\min_{\zeta\le0}\bar g_t(v,\zeta),gˉ​t​(v,ζ)=−γLcζ+q^​0(v0​−v1​)+γE[fˉ​t+1​(v+​)],fˉ​t​(v)=ζ≤0min​gˉ​t​(v,ζ),

with fˉT+L+1=0\bar f_{T+L+1}=0fˉ​T+L+1​=0. This is the paper's recursion (1)–(2), written in the state vvv.

Program (4). Fix a demand ddd. Choosing the next stock level v+v_+v+​, with −d≤v+−v0≤0-d\le v_+-v_0\le0−d≤v+​−v0​≤0 and v+≥v1v_+\ge v_1v+​≥v1​, gives

κˉt(v,ζ∣d)=min⁡v+{h^(v+−v1)+p(v+−v0+d)+γfˉt+1[(v+,v2,…,vL−1,0)−ζe]}.\bar\kappa_t(v,\zeta\mid d)=\min_{v_+}\Big\{\hat h(v_+-v_1)+p(v_+-v_0+d)+\gamma\bar f_{t+1}\big[(v_+,v_2,\dots,v_{L-1},0)-\zeta e\big]\Big\}.κˉt​(v,ζ∣d)=v+​min​{h^(v+​−v1​)+p(v+​−v0​+d)+γfˉ​t+1​[(v+​,v2​,…,vL−1​,0)−ζe]}.

Here v+−v1v_+-v_1v+​−v1​ is the leftover stock and d−(v0−v+)d-(v_0-v_+)d−(v0​−v+​) the unmet demand.

Parametric demand. The demand d(ϕ)d(\phi)d(ϕ) depends on a real parameter ϕ\phiϕ, with law μϕ\mu_\phiμϕ​, and fˉt(v;ϕ)\bar f_t(v;\phi)fˉ​t​(v;ϕ) is the optimal cost under μϕ\mu_\phiμϕ​. A random variable XXX is smaller than YYY in the convex order if E g(X)≤E g(Y)E\,g(X)\le E\,g(Y)Eg(X)≤Eg(Y) for every convex g:R→Rg:\mathbb R\to\mathbb Rg:R→R for which both expectations exist. This forces equal means and a variance that does not decrease.

Formalization targets

Goal: Theorem 11 (p. 941)

If d(ϕ)d(\phi)d(ϕ) is increasing in ϕ\phiϕ with respect to the convex order, then for all ttt and all v∈Vv\in Vv∈V,

ϕ≤ϕ′ ⟹ fˉt(v;ϕ)≤fˉt(v;ϕ′).\phi\le\phi'\ \Longrightarrow\ \bar f_t(v;\phi)\le\bar f_t(v;\phi').ϕ≤ϕ′ ⟹ fˉ​t​(v;ϕ)≤fˉ​t​(v;ϕ′).

Milestones, in attack order

  1. Reformulation (proof of Theorem 4, p. 939). For v∈Vv\in Vv∈V, ζ≤0\zeta\le0ζ≤0, d≥0d\ge0d≥0, the stock level v+=[v0−v1−d]++v1v_+=[v_0-v_1-d]^++v_1v+​=[v0​−v1​−d]++v1​ is optimal in program (4):
κˉt(v,ζ∣d)=q^(v0−v1−d)+γfˉt+1(v+).\bar\kappa_t(v,\zeta\mid d)=\hat q(v_0-v_1-d)+\gamma\bar f_{t+1}(v_+).κˉt​(v,ζ∣d)=q^​(v0​−v1​−d)+γfˉ​t+1​(v+​).
  1. Convexity of the optimal cost (Theorem 4, p. 939, with the remark on p. 938). fˉt\bar f_tfˉ​t​ is convex on VVV for every ttt.
  2. The key step (proof of Theorem 11, p. 941). If FFF is convex and nonnegative on VVV, then program (4) with continuation FFF is jointly convex in (v,ζ,d)(v,\zeta,d)(v,ζ,d) on {v∈V, ζ≤0, d≥0}\{v\in V,\ \zeta\le0,\ d\ge0\}{v∈V, ζ≤0, d≥0}.
  3. The induction step (proof of Theorem 11, p. 941). If fˉt+1(v;ϕ)\bar f_{t+1}(v;\phi)fˉ​t+1​(v;ϕ) is nondecreasing in ϕ\phiϕ on VVV, then so is gˉt(v,ζ;ϕ)\bar g_t(v,\zeta;\phi)gˉ​t​(v,ζ;ϕ) for every ζ≤0\zeta\le0ζ≤0.

Significance

Theorem 11 is a comparative-statics statement: replacing demand by a mean-preserving spread cannot lower the optimal cost from any starting state, at any horizon. It justifies valuing variance reduction in lost-sales systems, for example forecasting or demand pooling, without solving the high-dimensional dynamic program. The induction pattern of the proof transfers to other parametric questions about the model; §6 of the paper notes that the parametric analysis remains valid in several extensions.

The paper proves Theorem 11 in a few lines on top of Theorem 4. No machine-checked proof of the result or of its structural prerequisites is known: neither the lost-sales recursion in the transformed state nor its convexity is formalized. A complete development checks the measure-theoretic steps the paper leaves implicit: that the optimal costs are finite, the existence of the expectations, and the passage from convexity in ddd on [0,∞)[0,\infty)[0,∞) to the convex order's test functions on R\mathbb RR.

Difficulty

The argument looks immediate: the costs are convex, so the convex order should apply directly. It does not. The function to which the convex order must be applied is the end-of-period cost as a function of demand. In recursion (1) that function is q^(v0−v1−d)+γfˉt+1(v+(d))\hat q(v_0-v_1-d)+\gamma\bar f_{t+1}(v_+(d))q^​(v0​−v1​−d)+γfˉ​t+1​(v+​(d)), where the next state depends on ddd through the kink [v0−v1−d]+[v_0-v_1-d]^+[v0​−v1​−d]+. Convexity of fˉt+1\bar f_{t+1}fˉ​t+1​ alone does not make this composition convex in ddd. The paper avoids the issue by passing to program (4), where the amount of demand filled is a decision. That requires two facts: that selling as much as possible is optimal (milestone 1), and that the program is jointly convex in state, action and demand (milestone 3), which needs convexity of fˉt+1\bar f_{t+1}fˉ​t+1​ on all of VVV (milestone 2). A second difficulty is analytic: the optimal costs are defined by infima and expectations, and one must show that these are finite and integrable before any order comparison applies.

Formalization scope

  • Model. States are Fin L → ℝ with 0-based indices matching the paper. vL=0v_L=0vL​=0 is the helper vext. VVV is the set of antitone, nonnegative vectors.
  • Time. Data are stationary, so the optimal cost is indexed by the number of periods to go kkk, with fˉ=0\bar f=0fˉ​=0 at k=0k=0k=0. The paper's "for all ttt" is "for all kkk".
  • Demand. One-period demand has law μ\muμ, a probability measure on R\mathbb RR with μ((−∞,0))=0\mu((-\infty,0))=0μ((−∞,0))=0 and finite mean. The finite mean is not in the paper; it is added so that q^0\hat q^0q^​0 is finite.
  • Parametric family. A family μϕ\mu_\phiμϕ​, ϕ∈R\phi\in\mathbb Rϕ∈R, with every hypothesis imposed for every ϕ\phiϕ. Every object depending on demand takes the law as an argument, so fˉt(v;ϕ)\bar f_t(v;\phi)fˉ​t​(v;ϕ) is fbar … (μ φ) k v.
  • Costs. "Unit cost" and "discount rate" are read as c,h^,p≥0c,\hat h,p\ge0c,h^,p≥0 and 0<γ≤10<\gamma\le10<γ≤1.
  • Minima. "Min" over orders is an infimum over ζ≤0\zeta\le0ζ≤0, and program (4) is an infimum over the interval [max⁡(v0−d,v1),v0][\max(v_0-d,v_1),v_0][max(v0​−d,v1​),v0​]. Lean's infimum is 000 on sets that are unbounded below or empty. Nonnegative costs and demand keep the infima genuine, and the generic key-step milestone assumes the continuation is nonnegative.
  • Expectations. Bochner integrals.
  • Convex order. The platform definition StochasticOrders.Convex.ConvexOrder (Shaked–Shanthikumar (3.A.1)), applied to the identity on (R,μϕ)(\mathbb R,\mu_\phi)(R,μϕ​). Equal means are a consequence and are not assumed.
  • Convexity milestone. Stated for the model's fˉ\bar ffˉ​ only, not as "L♮^\natural♮-convex implies convex" in general, which fails without regularity.

Ruled out. Value functions that collapse to a junk constant would make Theorem 11 trivially true. This is excluded because the recursion is defined, not assumed, and every cost and demand hypothesis is imposed for every ϕ\phiϕ. Replacing the convex order by "variance nondecreasing", by the increasing convex order, or by test functions convex only on [0,∞)[0,\infty)[0,∞) changes the theorem and is not accepted.

Infrastructure and contributions. A complete development needs:

  • finiteness and integrability of the optimal costs;
  • convexity of partial infima over convex fibers;
  • monotone extension of a function convex on [0,∞)[0,\infty)[0,∞) to all of R\mathbb RR.

The model file is shared in shape with the series' missions 1 (L♮^\natural♮-convexity) and 2 (policy bounds), and its convexity lemmas are reusable for other parametric comparisons of the lost-sales model. Proofs of any milestone, and alternative arguments that bypass program (4), are welcome.

Selected references

  • P. Zipkin, On the structure of lost-sales inventory models, Operations Research 56(4), 937–944, 2008. https://doi.org/10.1287/opre.1070.0482
  • S. Karlin, H. Scarf, Inventory models of the Arrow–Harris–Marschak type with time lag, in Studies in the Mathematical Theory of Inventory and Production, Chapter 10, Stanford University Press, 1958.
  • T. E. Morton, Bounds on the solution of the lagged optimal inventory equation with no demand backlogging and proportional costs, SIAM Review 11, 572–576, 1969 (as cited in Zipkin 2008).
  • J.-S. Song, The effect of leadtime uncertainty in a simple stochastic inventory model, Management Science 40(5), 603–613, 1994. https://doi.org/10.1287/mnsc.40.5.603
  • D. Stoyan, Comparison Methods for Queues and Other Stochastic Models, Wiley, 1983.
  • M. Shaked, J. G. Shanthikumar, Stochastic Orders, Springer, 2007. https://doi.org/10.1007/978-0-387-34675-5
8 thms1 active userReviewed
Convex OptimizationNumerical AnalysisOperations Research·Captain: mikedeng1

A Coordinate Gradient Descent Method for Nonsmooth Separable Minimization 2: Under a Local Lipschitzian Error Bound, CGD with the Restricted Gauss–Seidel Rule Converges LinearlyResearch Paper

Motivation

Many problems in statistics, signal processing and machine learning minimize the sum of a smooth loss and a convex, nonsmooth, separable regularizer: smooth optimization with ℓ1\ell_1ℓ1​-regularization, bound-constrained optimization, the group Lasso and, through duality, support vector regression are special cases listed in §1 of the paper discussed below. For such problems, methods that update one coordinate, or one small block of coordinates, at a time are often the method of choice, because each update is cheap and exploits separability.

Paul Tseng and Sangwoon Yun (Math. Program. Ser. B 117 (2009) 387–423) introduced the coordinate gradient descent (CGD) method for this class: at each iteration it minimizes a quadratic model of the smooth part plus the exact nonsmooth part over a chosen block of coordinates, then takes an Armijo step. Their paper proves global convergence (Theorem 1) and, under a local error bound, linear convergence (Theorems 2 and 3). This mission is the second of a three-mission series on the paper; it targets the linear convergence theorem for the cyclic (Gauss–Seidel-type) choice of blocks.

The analysis follows Luo and Tseng's error-bound framework for smooth constrained problems (Ann. Oper. Res. 46 (1993) 157–178), which established linear rates for feasible descent methods without strong convexity. Tseng and Yun extend that framework to a nonsmooth convex term.

Setting

Let ℜn\Re^nℜn carry the Euclidean norm ∥⋅∥\|\cdot\|∥⋅∥, let N={1,…,n}\mathcal N=\{1,\dots,n\}N={1,…,n}, and for J⊆N\mathcal J\subseteq\mathcal NJ⊆N let xJx_{\mathcal J}xJ​ be the subvector of coordinates in J\mathcal JJ. The problem (1) is

min⁡x Fc(x)=f(x)+cP(x),\min_x\ F_c(x)=f(x)+cP(x),xmin​ Fc​(x)=f(x)+cP(x),

where c>0c>0c>0, P:ℜn→(−∞,∞]P:\Re^n\to(-\infty,\infty]P:ℜn→(−∞,∞] is proper, convex and lower semicontinuous, and fff is continuously differentiable on an open set containing dom⁡P\operatorname{dom}PdomP.

Given x∈dom⁡Px\in\operatorname{dom}Px∈domP, a nonempty block J\mathcal JJ and a symmetric positive definite matrix HHH, the direction (6) is

dH(x;J)=arg⁡min⁡d{∇f(x)Td+12dTHd+cP(x+d) ∣ dj=0 ∀j∉J}.d_H(x;\mathcal J)=\arg\min_d\Big\{\nabla f(x)^Td+\tfrac12d^THd+cP(x+d)\ \Big|\ d_j=0\ \forall j\notin\mathcal J\Big\}.dH​(x;J)=argdmin​{∇f(x)Td+21​dTHd+cP(x+d) ​ dj​=0 ∀j∈/J}.

The CGD method starts at x0∈dom⁡Px^0\in\operatorname{dom}Px0∈domP, chooses at each iteration kkk a block Jk\mathcal J^kJk and a matrix HkH^kHk, computes dk=dHk(xk;Jk)d^k=d_{H^k}(x^k;\mathcal J^k)dk=dHk​(xk;Jk), and sets xk+1=xk+αkdkx^{k+1}=x^k+\alpha^kd^kxk+1=xk+αkdk. The Armijo rule takes αk\alpha^kαk as the largest element of {αinitkβj}j≥0\{\alpha^k_{\rm init}\beta^j\}_{j\ge0}{αinitk​βj}j≥0​ with

Fc(xk+αkdk)≤Fc(xk)+αkσΔk,Δk=∇f(xk)Tdk+γ dkTHkdk+cP(xk+dk)−cP(xk),F_c(x^k+\alpha^kd^k)\le F_c(x^k)+\alpha^k\sigma\Delta^k,\qquad \Delta^k=\nabla f(x^k)^Td^k+\gamma\,d^{kT}H^kd^k+cP(x^k+d^k)-cP(x^k),Fc​(xk+αkdk)≤Fc​(xk)+αkσΔk,Δk=∇f(xk)Tdk+γdkTHkdk+cP(xk+dk)−cP(xk),

with 0<β,σ<10<\beta,\sigma<10<β,σ<1 and 0≤γ<10\le\gamma<10≤γ<1. The restricted Gauss–Seidel rule (12) asks for indices 0=t0<t1<⋯0=t_0<t_1<\cdots0=t0​<t1​<⋯ (the set T\mathcal TT) such that the blocks used during each cycle ti≤k<ti+1t_i\le k<t_{i+1}ti​≤k<ti+1​ are pairwise disjoint and cover N\mathcal NN. PPP is block-separable with respect to J\mathcal JJ if P(x)=PJ(xJ)+PJC(xJC)P(x)=P_{\mathcal J}(x_{\mathcal J})+P_{\mathcal J^C}(x_{\mathcal J^C})P(x)=PJ​(xJ​)+PJC​(xJC​).

The analysis uses three assumptions: ∇f\nabla f∇f is LLL-Lipschitz on dom⁡P\operatorname{dom}PdomP (22); Assumption 1, λˉI⪰Hk⪰λ‾I\bar\lambda I\succeq H^k\succeq\underline\lambda IλˉI⪰Hk⪰λ​I with 0<λ‾≤λˉ0<\underline\lambda\le\bar\lambda0<λ​≤λˉ; and Assumption 2. Writing Xˉ\bar XXˉ for the set of stationary points of FcF_cFc​ and dI(x)d_I(x)dI​(x) for the full direction with H=IH=IH=I, Assumption 2 says (a) Xˉ≠∅\bar X\ne\emptysetXˉ=∅ and the local Lipschitzian error bound dist⁡(x,Xˉ)≤τ∥dI(x)∥\operatorname{dist}(x,\bar X)\le\tau\|d_I(x)\|dist(x,Xˉ)≤τ∥dI​(x)∥ holds on every level set {Fc≤ζ}\{F_c\le\zeta\}{Fc​≤ζ} wherever ∥dI(x)∥≤ϵ\|d_I(x)\|\le\epsilon∥dI​(x)∥≤ϵ; (b) stationary points with different objective values are at least a fixed distance δ>0\delta>0δ>0 apart.

Formalization targets

Goal: Theorem 2(b)

Under (22), Assumptions 1 and 2, the restricted Gauss–Seidel rule, block-separability of PPP with respect to every Jk\mathcal J^kJk, and Armijo steps with sup⁡kαinitk≤1\sup_k\alpha^k_{\rm init}\le1supk​αinitk​≤1 and inf⁡kαinitk>0\inf_k\alpha^k_{\rm init}>0infk​αinitk​>0:

{Fc(xk)}↓−∞or({Fc(xk)}T Q-linear and {xk}T R-linear).\{F_c(x^k)\}\downarrow-\infty\quad\text{or}\quad\big(\{F_c(x^k)\}_{\mathcal T}\ \text{Q-linear}\ \text{and}\ \{x^k\}_{\mathcal T}\ \text{R-linear}\big).{Fc​(xk)}↓−∞or({Fc​(xk)}T​ Q-linear and {xk}T​ R-linear).

No rate constant is fixed: the goal asserts the shape of the convergence, so it is not invalidated by sharper constants.

Milestones

Lemma 4 (Hölder dependence of the subproblem's solution on its linear term), Lemma 5(a) (a per-block variational inequality), Lemma 5(b) (an explicit stepsize at which the Armijo test passes), Theorem 1(f) (Armijo stepsizes bounded away from zero, Δk→0\Delta^k\to0Δk→0, dk→0d^k\to0dk→0), and Theorem 2(a) (the residual ∥dI(xk)∥\|d_I(x^k)\|∥dI​(xk)∥ at the start of a cycle is bounded by the step lengths of the cycle).

Significance

Theorem 2(b) gives a linear rate for a block coordinate method on a nonsmooth, possibly nonconvex composite problem without strong convexity: the rate follows from the error bound, which holds for a large class of problems studied in §6 of the paper (the third mission of this series).

The theorem is proved in the paper; none of it has been machine-checked, as far as a search of the Prove2Me library shows. Formalizing it requires a reusable treatment of extended-valued convex functions through their effective domains, of the coordinate-restricted proximal subproblem, and of the Armijo rule for composite objectives. The milestones Lemma 4 and Lemma 5 are self-contained facts about this subproblem and are reusable for other proximal coordinate methods.

Difficulty

The classical route to a linear rate, as in Luo and Tseng's smooth analysis, derives Fc(xk+1)−υˉ≤τ′∥xk+1−xk∥2F_c(x^{k+1})-\bar\upsilon\le\tau'\|x^{k+1}-x^k\|^2Fc​(xk+1)−υˉ≤τ′∥xk+1−xk∥2 from the error bound, where υˉ\bar\upsilonυˉ is the limit value. With a nonsmooth PPP this inequality is not available: the authors say so on p. 405, and work with −Δk-\Delta^k−Δk in place of the quadratic term. A second obstacle is that the error bound controls the full residual dI(xk)d_I(x^k)dI​(xk), while each iteration only computes a block direction at a different point; relating the two over a cycle needs the disjointness of the blocks in the restricted rule and block-separability of PPP. Neither the global analysis nor the error bound alone gives the rate.

Formalization scope

ℜn\Re^nℜn is EuclideanSpace ℝ (Fin n), with 0-based coordinates. The extended-valued PPP is encoded as a pair: its effective domain D=dom⁡PD=\operatorname{dom}PD=domP and its finite values on DDD, with "proper convex lsc" given by the published definition ProxNewton.Inexact.IsProperClosedConvex; FcF_cFc​ is never evaluated off DDD, and every statement carries membership in DDD explicitly. The direction dH(x;J)d_H(x;\mathcal J)dH​(x;J) is the unique minimizer of (6) when x∈Dx\in Dx∈D and H≻0H\succ0H≻0 (chosen by Classical.epsilon), and runs of the method carry the minimizer property itself. The Armijo rule takes the first admissible exponent jjj. T\mathcal TT is a strictly increasing map ttt with t0=0t_0=0t0​=0. Stationarity is Fc′(x;d)≥0F_c'(x;d)\ge0Fc′​(x;d)≥0 for all ddd, in liminf form. In Assumption 2, dist⁡\operatorname{dist}dist is the infimum distance and "for any ζ≥min⁡Fc\zeta\ge\min F_cζ≥minFc​" is "for every real ζ\zetaζ" (equivalent, since the condition is empty below inf⁡Fc\inf F_cinfFc​). Q-linear convergence includes convergence of the sequence; R-linear convergence is ∥xti−xˉ∥≤Cqi\|x^{t_i}-\bar x\|\le Cq^i∥xti​−xˉ∥≤Cqi with q<1q<1q<1. The rates in the goal are along T\mathcal TT, as the paper states.

Explicit choices relative to the printed text:

  • Theorem 2(a) is corrected. As printed, ∥dI(xk)∥≤sup⁡jαj C rk\|d_I(x^k)\|\le\sup_j\alpha^j\,C\,r^k∥dI​(xk)∥≤supj​αjCrk fails for small constant stepsizes and fails without block-separability (counterexamples in the item's statement). The milestone states ∥dI(xk)∥≤max⁡{1,sup⁡jαj} C rk\|d_I(x^k)\|\le\max\{1,\sup_j\alpha^j\}\,C\,r^k∥dI​(xk)∥≤max{1,supj​αj}Crk under block-separability of PPP with respect to every Jk\mathcal J^kJk (both are what the paper's proof gives and what Theorem 2(b) supplies), with the iterates in dom⁡P\operatorname{dom}PdomP, and with CCC quantified before the problem data, so it depends only on n,L,λ‾,λˉn,L,\underline\lambda,\bar\lambdan,L,λ​,λˉ.
  • Lemma 5(b)'s range 0≤α≤min⁡{1,2λ‾(1−σ+σγ)/L}0\le\alpha\le\min\{1,2\underline\lambda(1-\sigma+\sigma\gamma)/L\}0≤α≤min{1,2λ​(1−σ+σγ)/L} is stated as 0≤α≤10\le\alpha\le10≤α≤1 and αL≤2λ‾(1−σ+σγ)\alpha L\le2\underline\lambda(1-\sigma+\sigma\gamma)αL≤2λ​(1−σ+σγ), so that L=0L=0L=0 gives [0,1][0,1][0,1] as on paper rather than {0}\{0\}{0}.
  • Lemma 5(a) holds for every decomposition of PPP in (20), and xˉ\bar xxˉ ranges over dom⁡PJ\operatorname{dom}P_{\mathcal J}domPJ​ (outside it the left side is −∞-\infty−∞).
  • "lim⁡Fc(xk)>−∞\lim F_c(x^k)>-\inftylimFc​(xk)>−∞" is "the values Fc(xk)F_c(x^k)Fc​(xk) are bounded below"; "{Fc(xk)}↓−∞\{F_c(x^k)\}\downarrow-\infty{Fc​(xk)}↓−∞" is "nonincreasing and tending to −∞-\infty−∞"; suprema and infima of stepsizes are explicit bounds.

A statement that replaces Assumption 2 by strong convexity, claims a rate along the whole sequence rather than along T\mathcal TT, or asserts the Q-linear contraction without convergence to a limit is not this theorem and is out of scope.

Lemma 1, the claim after (10), Lemma 3 and Theorem 1(a), which the proof also uses, are milestones of the first mission of this series and are not restated here. Theorem 3 (the same conclusion along the whole sequence for the Gauss–Southwell-q rule) is not included: its proof is omitted in the paper. Contributions welcome: proofs of the milestones, and general facts about the coordinate-restricted proximal subproblem (existence and uniqueness of dH(x;J)d_H(x;\mathcal J)dH​(x;J), optimality conditions) that the milestones rely on.

Selected references

  • P. Tseng and S. Yun, A coordinate gradient descent method for nonsmooth separable minimization, Mathematical Programming Ser. B 117 (2009) 387–423. https://doi.org/10.1007/s10107-007-0170-0
  • Z.-Q. Luo and P. Tseng, Error bounds and convergence analysis of feasible descent methods: a general approach, Annals of Operations Research 46 (1993) 157–178. https://doi.org/10.1007/BF02096261
  • J. M. Ortega and W. C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, 1970, Chap. 9 (Q- and R-linear convergence). https://doi.org/10.1137/1.9780898719468
  • R. T. Rockafellar and R. J.-B. Wets, Variational Analysis, Springer, 1998. https://doi.org/10.1007/978-3-642-02431-3
9 thms1 active userReviewed
Dynamic ProgrammingOperations ResearchProbability·Captain: mikedeng1

Negative Dynamic Programming III: If the Actions Are Essentially Finite, Value Iteration from Zero Converges to the Optimal Return and a Stationary Policy Is OptimalResearch Paper

Motivation

A dynamic programming problem in Blackwell's sense describes a controller who observes the state of a system, picks an action, collects a return, and watches the system move at random to a new state, forever. Blackwell treated the discounted case, with a bounded return and a discount factor below one (Blackwell 1965), and the positive bounded case. Strauch's paper (Strauch 1966) studies the third case, the negative case: the return is non-positive and there is no discounting. Equivalently, a non-negative cost is minimized over an infinite horizon. This is the setting of stochastic shortest-path, optimal stopping with costs, and many inventory and search problems in which the total cost may be infinite.

In the negative case two standard tools of the discounted theory break down. An optimal policy need not exist, and the natural algorithm, value iteration from the zero function, need not converge to the optimal return. Strauch's §9 gives a condition on the action sets, essential finiteness, under which both are restored. The introduction (p. 872) summarizes the finite case: "In the negative case, … if A is finite, there is an optimal policy (Section 9)." In the later terminology of Bertsekas and Shreve (1978), Strauch's negative case is their positive-cost model, for which value iteration from zero is known to require such finiteness or compactness conditions.

Setting

The state space SSS and the action space AAA are non-empty Borel sets. The law of motion q(⋅∣s,a)q(\cdot\mid s,a)q(⋅∣s,a) is a probability measure on SSS depending measurably on (s,a)(s,a)(s,a). The return r(s,a,t)r(s,a,t)r(s,a,t), collected when action aaa is taken in state sss and the next state is ttt, is a Borel function with −∞<r≤0-\infty<r\le 0−∞<r≤0 and ∫r(s,a,t) dq(t∣s,a)>−∞\int r(s,a,t)\,dq(t\mid s,a)>-\infty∫r(s,a,t)dq(t∣s,a)>−∞ for every (s,a)(s,a)(s,a).

A policy π=(π1,π2,… )\pi=(\pi_1,\pi_2,\dots)π=(π1​,π2​,…) chooses the nnnth action at random, with a law depending measurably on the whole history (s1,a1,…,sn)(s_1,a_1,\dots,s_n)(s1​,a1​,…,sn​). A Markov policy (f1,f2,… )(f_1,f_2,\dots)(f1​,f2​,…) is a sequence of measurable maps S→AS\to AS→A; the stationary policy f(∞)f^{(\infty)}f(∞) uses one map fff at every stage. The expected return from the initial state sss is

I(π)(s)=∑n=1∞π1q⋯πnq r (s)∈[−∞,0],I(\pi)(s)=\sum_{n=1}^\infty \pi_1q\cdots\pi_nq\,r\,(s)\in[-\infty,0],I(π)(s)=n=1∑∞​π1​q⋯πn​qr(s)∈[−∞,0],

the sum of the expected stage returns. The optimal return is v∗=sup⁡πI(π)v^*=\sup_\pi I(\pi)v∗=supπ​I(π), over all policies, and π∗\pi^*π∗ is optimal if I(π∗)≥v∗I(\pi^*)\ge v^*I(π∗)≥v∗ at every state.

For a measurable f:S→Af:S\to Af:S→A and a non-positive Borel uuu, the operator TTT of fff is

Tu(s)=∫[r(s,f(s),t)+u(t)] dq(t∣s,f(s)),Tu(s)=\int\big[r(s,f(s),t)+u(t)\big]\,dq(t\mid s,f(s)),Tu(s)=∫[r(s,f(s),t)+u(t)]dq(t∣s,f(s)),

and the operator of a Markov policy π∗=(f1,f2,… )\pi^*=(f_1,f_2,\dots)π∗=(f1​,f2​,…) is Uu=sup⁡nTnuUu=\sup_nT_nuUu=supn​Tn​u, with TnT_nTn​ the operator of fnf_nfn​. Value iteration is the sequence Un0U^n0Un0.

Actions aaa and bbb are equivalent at sss if r(s,a,⋅)=r(s,b,⋅)r(s,a,\cdot)=r(s,b,\cdot)r(s,a,⋅)=r(s,b,⋅) and q(⋅∣s,a)=q(⋅∣s,b)q(\cdot\mid s,a)=q(\cdot\mid s,b)q(⋅∣s,a)=q(⋅∣s,b). AAA is essentially finite by π∗\pi^*π∗ if there is a partition of SSS into Borel sets S1,S2,…S_1,S_2,\dotsS1​,S2​,… such that for s∈Sns\in S_ns∈Sn​ every action is equivalent at sss to one of f1(s),…,fn(s)f_1(s),\dots,f_n(s)f1​(s),…,fn​(s). A finite AAA is essentially finite by any Markov policy whose first ∣A∣|A|∣A∣ rules are the constant rules.

Formalization targets

Goal: Theorem 9.1 (N), p. 887

If AAA is essentially finite by π∗\pi^*π∗ and UUU is the operator of π∗\pi^*π∗, then

Un0(s)→n→∞v∗(s)=sup⁡πI(π)(s)for every s,and∃f: I(f(∞))≥v∗.U^n0(s)\xrightarrow[n\to\infty]{}v^*(s)=\sup_\pi I(\pi)(s)\quad\text{for every } s,\qquad\text{and}\qquad \exists f:\ I(f^{(\infty)})\ge v^*.Un0(s)n→∞​v∗(s)=πsup​I(π)(s)for every s,and∃f: I(f(∞))≥v∗.

Both parts are kept together, as printed. The goal fixes no constants and no rate.

Milestones

  1. Lemma 6.1 (N), p. 880. For every Markov policy π^\hat\piπ^ with operator UUU, lim⁡nUn0\lim_nU^n0limn​Un0 exists and
lim⁡nUn0 ≥ sup⁡π∈G(π^)I(π) ≥ sup⁡f(∞)∈G(π^)I(f(∞)),\lim_nU^n0\ \ge\ \sup_{\pi\in G(\hat\pi)}I(\pi)\ \ge\ \sup_{f^{(\infty)}\in G(\hat\pi)}I(f^{(\infty)}),nlim​Un0 ≥ π∈G(π^)sup​I(π) ≥ f(∞)∈G(π^)sup​I(f(∞)),

where G(π^)G(\hat\pi)G(π^) is the set of π^\hat\piπ^-generated policies (each rule equal to fnf_nfn​ on the nnnth piece of a Borel partition). 2. Proof of Theorem 8.4, p. 887. sup⁡πI(π)=sup⁡{I(π^)∣π^ Markov}\sup_\pi I(\pi)=\sup\{I(\hat\pi)\mid\hat\pi\text{ Markov}\}supπ​I(π)=sup{I(π^)∣π^ Markov} pointwise. 3. Proof of Theorem 9.1, p. 887, first step. Under essential finiteness, Un0U^n0Un0 is non-increasing and I(π)≤v∞:=lim⁡nUn0I(\pi)\le v^\infty:=\lim_nU^n0I(π)≤v∞:=limn​Un0 for every policy π\piπ. 4. Proof of Theorem 9.1, p. 887, second step. Under essential finiteness, Uv∞≥v∞Uv^\infty\ge v^\inftyUv∞≥v∞.

Inside the proof of Theorem 9.1 the paper writes v∗v^*v∗ for lim⁡nUn0\lim_nU^n0limn​Un0; the mission writes v∞v^\inftyv∞ for it and reserves v∗v^*v∗ for sup⁡πI(π)\sup_\pi I(\pi)supπ​I(π).

An optional extra item states the introduction's special case: if AAA is finite, an optimal policy exists (§1, p. 872).

Significance

Theorem 9.1 gives, in the negative case, both a computational and an existential conclusion. Value iteration from zero computes the optimal return, so the optimal total cost of an essentially finite problem is the limit of the optimal finite-horizon costs. An optimal policy exists and can be taken stationary, so the controller needs only a single measurable decision rule. Without a hypothesis of this kind neither conclusion holds in the negative case; Example 6.1 of the paper exhibits a problem where the limit of value iteration, the best return among generated policies, and the best stationary return all differ.

The result is proved in the paper. What the mission adds is a machine-checked statement and, eventually, proof of it on general Borel spaces, with the return allowed to equal −∞-\infty−∞. Blackwell's discounted analogue already has a published statement on Prove2Me (DiscountedDP.Stationary.theorem7b_optimal_stationary), in a bounded-return model; the negative case is a separate statement in a separate model. No formalization of the negative case is known to exist.

Difficulty

The discounted proof rests on the contraction property of UUU in the supremum norm, and in the negative case that property is missing: returns are unbounded below and there is no discount. The obvious argument, "Un0U^n0Un0 decreases to some v∞v^\inftyv∞, and v∞v^\inftyv∞ is the optimal return because finite-horizon play approximates infinite play", fails at the second step. The finite-horizon optimum can stay strictly above the infinite-horizon optimum, because a policy can postpone a cost beyond every fixed horizon; this is exactly the gap Example 6.1 exhibits. Closing it needs the essential finiteness of the actions together with the reduction of arbitrary policies to Markov ones (milestone 2), whose proof in the paper passes through the measurable-selection results of §7–§8.

Formalization scope

  • The state and action spaces are non-empty standard Borel types; "Baire function" means Borel measurable.
  • The law of motion is a Markov kernel; the return is real-valued, non-positive, Borel, and integrable against every q(⋅∣s,a)q(\cdot\mid s,a)q(⋅∣s,a) (the paper's r>−∞r>-\inftyr>−∞ and qr>−∞qr>-\inftyqr>−∞).
  • Returns live in EReal and are computed as minus the lintegral of the loss −r-r−r, which keeps the value −∞-\infty−∞. I(π)I(\pi)I(π) is the sum over stages of the expected stage loss, which equals the paper's integral over futures by monotone convergence.
  • v∗v^*v∗ is the supremum over every randomized history-dependent plan, never over Markov or stationary policies only, and it is not defined through UUU. Defining v∗v^*v∗ as lim⁡nUn0\lim_nU^n0limn​Un0 would make part (a) of the goal hold by unfolding; this trivializing formalization is excluded.
  • Optimality is against every plan, at every state.
  • UUU is the operator of the fixed π∗\pi^*π∗ of the hypothesis, applied from the zero function; convergence is pointwise in EReal.
  • Stages are numbered from 000 in Lean. Essential finiteness is zero-based: Lean's piece nnn is the paper's Sn+1S_{n+1}Sn+1​ and allows the rules f1,…,fn+1f_1,\dots,f_{n+1}f1​,…,fn+1​. The pieces are measurable, pairwise disjoint and cover SSS; empty pieces are allowed, as in the paper.
  • Explicit choices: the existence of lim⁡Un0\lim U^n0limUn0 in Lemma 6.1 is part of the statement; the limit in the steps of Theorem 9.1 is written as the infimum of the non-increasing sequence.
  • Only the negative case is formalized; the paper's discounted and positive parts are not.

Policies, Markov policies, stationary policies and π^\hat\piπ^-generated rules come from the published definitions DiscountedDP.Stationary.Model, .Return and .Operators; the negative model is defined locally because the published Problem has a bounded return and a discount factor below one. A complete development needs the Ionescu-Tulcea construction of the history laws (already encoded as iterated composition products), monotone convergence for kernels, the measurable-selection step behind milestone 2, and a pigeonhole argument over the essentially finite action classes. The model and the Markov-reduction milestone are reusable by the other missions of this series. Proofs of any milestone, and alternative routes to milestone 2, are welcome.

Selected references

  • R. E. Strauch, Negative Dynamic Programming, The Annals of Mathematical Statistics 37(4), 871–890, 1966. https://doi.org/10.1214/aoms/1177699369
  • D. Blackwell, Discounted Dynamic Programming, The Annals of Mathematical Statistics 36(1), 226–235, 1965. https://doi.org/10.1214/aoms/1177700285
  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978. http://web.mit.edu/dimitrib/www/soc.html
11 thms1 active userReviewed
PreviousPage 69 of 72Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me