Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,633 missions · 1,288 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1345Completed1288All2633
Algebraic GeometryOptimization·Captain: mikedeng1

Optimality Conditions and Finite Convergence of Lasserre's Hierarchy II: Off a Proper Zariski-Closed Set of Input Data, the Classical Optimality Conditions Hold at Every Local MinimizerResearch Paper

Motivation

Lasserre's hierarchy is a sequence of semidefinite relaxations for minimizing a polynomial over a set defined by polynomial equations and inequalities (Lasserre 2001). Under the archimedean condition its optimal values converge to the true minimum, but only asymptotically in general; in practice the hierarchy is often exact at a small relaxation order. J. Nie's paper (arXiv:1206.0319v2, Math. Program. 146 (2014)) explains this gap in two steps. Its Theorem 1.1 shows that finite convergence follows when the classical optimality conditions of nonlinear programming hold at every global minimizer. Its Theorem 1.2, the subject of this mission, shows that those optimality conditions hold at every local minimizer for all input data outside the zero set of finitely many polynomials in the coefficients. Together the two results give finite convergence of Lasserre's hierarchy for generic archimedean problems.

The genericity statement is also of independent interest in nonlinear programming: it says that degenerate local minimizers (failing constraint qualification, strict complementarity or second order sufficiency) are an algebraically exceptional phenomenon for polynomial data of fixed degrees.

Setting

Fix nnn variables x=(x1,…,xn)x=(x_1,\dots,x_n)x=(x1​,…,xn​) and write R[x]d\mathbb R[x]_dR[x]d​ for the real polynomials of degree at most ddd. Problem (1.1) is

min⁡f(x)s.t.hi(x)=0 (i∈[m1]),gj(x)≥0 (j∈[m2]),\min f(x)\quad\text{s.t.}\quad h_i(x)=0\ (i\in[m_1]),\qquad g_j(x)\ge 0\ (j\in[m_2]),minf(x)s.t.hi​(x)=0 (i∈[m1​]),gj​(x)≥0 (j∈[m2​]),

with feasible set KKK. For u∈Ku\in Ku∈K the active set is J(u)={j:gj(u)=0}J(u)=\{j: g_j(u)=0\}J(u)={j:gj​(u)=0}. At uuu:

  • the constraint qualification condition (CQC) holds if ∇h1(u),…,∇hm1(u),∇gj(u)\nabla h_1(u),\dots,\nabla h_{m_1}(u),\nabla g_j(u)∇h1​(u),…,∇hm1​​(u),∇gj​(u) (j∈J(u)j\in J(u)j∈J(u)) are linearly independent;
  • Lagrange multipliers λ,μ\lambda,\muλ,μ satisfy (1.3) ∇f(u)=∑iλi∇hi(u)+∑jμj∇gj(u)\nabla f(u)=\sum_i\lambda_i\nabla h_i(u)+\sum_j\mu_j\nabla g_j(u)∇f(u)=∑i​λi​∇hi​(u)+∑j​μj​∇gj​(u) and (1.4) μjgj(u)=0\mu_jg_j(u)=0μj​gj​(u)=0, μj≥0\mu_j\ge0μj​≥0;
  • strict complementarity (1.5) is μj+gj(u)>0\mu_j+g_j(u)>0μj​+gj​(u)>0 for all jjj;
  • with L=f−∑iλihi−∑j∈J(u)μjgjL=f-\sum_i\lambda_ih_i-\sum_{j\in J(u)}\mu_jg_jL=f−∑i​λi​hi​−∑j∈J(u)​μj​gj​, the second order sufficiency condition (1.7) is vT∇2L(u)v>0v^T\nabla^2L(u)v>0vT∇2L(u)v>0 for every v≠0v\neq0v=0 orthogonal to all active constraint gradients.

The input data are the coefficient vectors of (f,h,g)∈R[x]d0×∏iR[x]di×∏jR[x]dj′(f,h,g)\in\mathbb R[x]_{d_0}\times\prod_i\mathbb R[x]_{d_i}\times\prod_j\mathbb R[x]_{d'_j}(f,h,g)∈R[x]d0​​×∏i​R[x]di​​×∏j​R[x]dj′​​; a polynomial in the coefficients is a real polynomial evaluated at that vector. The paper's Condition 4.3 lists four families of such polynomials: resultants Res\mathrm{Res}Res and discriminants Δ\DeltaΔ (§2.4) of subsets of the constraints, and the polynomials R\mathscr RR of (4.6) and D\mathscr DD of (4.11), which detect a complex projective solution of the homogenised critical-point systems (4.5) and (4.10). Homogenisation is p~(x~)=x0dp(x/x0)\tilde p(\tilde x)=x_0^{d}p(x/x_0)p~​(x~)=x0d​p(x/x0​) at the nominal degree ddd, with x~=(x0,…,xn)\tilde x=(x_0,\dots,x_n)x~=(x0​,…,xn​).

Formalization targets

Goal: Theorem 1.2

For positive degrees d0,di,dj′d_0,d_i,d'_jd0​,di​,dj′​ there are polynomials ϕ1,…,ϕL\phi_1,\dots,\phi_Lϕ1​,…,ϕL​ in the coefficients such that

∃ (f,h,g) admissible with ∏lϕl≠0,and∏lϕl(f,h,g)≠0 ⟹ CQC, (1.5), (1.7) at every local minimizer of (1.1).\exists\,(f,h,g)\text{ admissible with }\textstyle\prod_l\phi_l\neq0,\qquad\text{and}\qquad \prod_l\phi_l(f,h,g)\neq0\ \Longrightarrow\ \text{CQC, (1.5), (1.7) at every local minimizer of (1.1).}∃(f,h,g) admissible with ∏l​ϕl​=0,and∏l​ϕl​(f,h,g)=0 ⟹ CQC, (1.5), (1.7) at every local minimizer of (1.1).

Milestones

  1. Proposition 4.1: there is R\mathscr RR with R(p0,…,pk;q)=0\mathscr R(p_0,\dots,p_k;q)=0R(p0​,…,pk​;q)=0 iff (4.5) has a solution 0≠x~∈Cn+10\neq\tilde x\in\mathbb C^{n+1}0=x~∈Cn+1; and R≠0\mathscr R\neq0R=0 excludes solutions of (4.4) in Cn\mathbb C^nCn.
  2. Proposition 4.2: there is D\mathscr DD with D(p0,…,pk)=0\mathscr D(p_0,\dots,p_k)=0D(p0​,…,pk​)=0 iff (4.10) has a solution with x~≠0\tilde x\neq0x~=0, y≠0y\neq0y=0; and D≠0\mathscr D\neq0D=0 makes the KKT system (4.2) nonsingular.
  3. Proposition 4.4: at u∈Ku\in Ku∈K with multipliers satisfying (1.3) and μjgj(u)=0\mu_jg_j(u)=0μj​gj​(u)=0, items (a)–(d) of Condition 4.3 give at most n−m1n-m_1n−m1​ active constraints, CQC, λi≠0\lambda_i\neq0λi​=0 and μj≠0\mu_j\neq0μj​=0 on J(u)J(u)J(u), and det⁡H(u)≠0\det H(u)\neq0detH(u)=0 for H(u)=[∇2L(u)G(u)TG(u)0]H(u)=\left[\begin{smallmatrix}\nabla^2L(u)&G(u)^T\\G(u)&0\end{smallmatrix}\right]H(u)=[∇2L(u)G(u)​G(u)T0​].
  4. Lemma 4.6: at a local minimizer where G(u)G(u)G(u) has full rank, (1.7) holds iff det⁡H(u)≠0\det H(u)\neq0detH(u)=0.
  5. Proposition 4.5: Condition 4.3 implies CQC, strict complementarity and SOSC at every local minimizer.
  6. Appendix A: R\mathscr RR and D\mathscr DD do not vanish identically on the input space of given positive degrees.

Significance

The theorem gives the second half of the paper's explanation of finite convergence: combined with Theorem 1.1, Lasserre's hierarchy converges in finitely many steps for all archimedean problems with input outside a proper algebraic subset. Section 5 of the paper derives further consequences, for instance that Marshall's boundary Hessian condition holds on a Zariski open set of data, and that Putinar-type certificates exist generically on the boundary of the cone of nonnegative polynomials. Beyond polynomial optimization, the statement is a precise algebraic form of the folklore that "generic nonlinear programs are nondegenerate".

The result is proved in the paper; no machine-checked version is known. A formalization fixes the exact quantifier structure (the printed statement is vacuous without a nonvanishing clause, and two items of Proposition 4.4 need an extra hypothesis), and builds reusable infrastructure: projective elimination over C\mathbb CC, homogenisation at a nominal degree, and the bordered-Hessian characterization of second order sufficiency.

Difficulty

The local part (Proposition 4.4, Lemma 4.6, Proposition 4.5) is linear algebra plus first and second order necessary conditions. The global part is not. Proposition 4.1 and 4.2 need the main theorem of elimination theory: the set of coefficient vectors for which a homogeneous (or bihomogeneous) system has a nonzero complex solution is Zariski closed, defined by polynomials in the coefficients. Mathlib has the univariate resultant only. Appendix A, which shows these polynomials do not vanish identically, has to control the homogenised systems both at finite points and at points at infinity (x0=0x_0=0x0​=0), where only the leading forms of the data are seen. Reasoning over R\mathbb RR alone does not suffice: the set of data whose real system is solvable is not the zero set of a polynomial.

Formalization scope

Polynomials are MvPolynomial (Fin n) ℝ, points are Fin n → ℝ, and gradients and Hessians are formal partial derivatives. Homogenised polynomials have complex coefficients in n + 1 variables, variable 0 being x0x_0x0​, and homogenisation uses the nominal degree ddd, not the actual degree. CQC is linear independence of an indexed family (repeated gradients count twice). The optimality conditions are bundled: CQC together with one multiplier pair satisfying (1.3), (1.4), (1.5) and (1.7); under CQC the multipliers are unique.

Condition 4.3 is encoded through the defining properties of Res, Δ, R\mathscr RR and D\mathscr DD (unsolvability of the corresponding complex projective systems) rather than through the polynomials themselves; since the goal is existential in the polynomials, this is not a weakening. Coefficient variables exist for monomials of every degree, so the goal's nonvanishing clause is asserted at an admissible input: a formal polynomial that is nonzero but vanishes on all admissible data (such as the variable of a monomial of degree d0+1d_0+1d0​+1) does not satisfy it. Without that clause the printed theorem would be satisfied by ϕ1=0\phi_1=0ϕ1​=0.

Hypotheses added to the page, each disclosed in the statements: m1≤nm_1\le nm1​≤n in Propositions 4.4 and 4.5 (Condition 4.3's standing assumption; Theorem 1.2 is stated for all m1m_1m1​, as printed), the nonvanishing clause in Theorem 1.2, and item (a) of Condition 4.3 in Proposition 4.4 ii)–iv) (with item (b) alone, n=1n=1n=1, g1=x+x2g_1=x+x^2g1​=x+x2, g2=−x+x2g_2=-x+x^2g2​=−x+x2, u=0u=0u=0 violates CQC). Proposition 4.2's nonsingularity is asserted at all complex critical pairs.

A complete development needs projective elimination theory over C\mathbb CC (reusable well beyond this mission), multivariate resultants and discriminants as polynomial functions of coefficients, Euler's identity for forms, and genericity facts about critical points of polynomial programs. Contributions to any of these, and direct proofs of the local milestones, are welcome.

Selected references

  • J. Nie, Optimality conditions and finite convergence of Lasserre's hierarchy, Math. Program. 146 (2014); preprint arXiv:1206.0319v2, 2013. https://arxiv.org/abs/1206.0319v2, https://doi.org/10.1007/s10107-013-0680-x
  • J.B. Lasserre, Global optimization with polynomials and the problem of moments, SIAM J. Optim. 11(3) (2001) 796–817. https://doi.org/10.1137/S1052623400366802
  • R. Hartshorne, Algebraic Geometry, GTM 52, Springer, 1977 (Theorem I.5.7A, elimination). https://doi.org/10.1007/978-1-4757-3849-0
  • I. Gelfand, M. Kapranov, A. Zelevinsky, Discriminants, Resultants, and Multidimensional Determinants, Birkhäuser, 1994. https://doi.org/10.1007/978-0-8176-4771-1
11 thms1 active userReviewed
Optimal TransportProbabilityStochastic Systems·Captain: mikedeng1

A Stochastic Control Approach to No-Arbitrage Bounds Given Marginals, with an Application to Lookback Options: The Robust Superhedging Bound of g(X*_T) Given the Law of X_T Equals μ^HL(g)Research Paper

Model-free bounds for lookback options

A lookback option pays a function of the running maximum of the underlying asset over the life of the contract. When the prices of European call options of all strikes at the maturity are quoted, the risk-neutral law μ\muμ of the terminal price is known, but the law of the whole path is not. The robust (model-free) superhedging cost of the lookback payoff is the cheapest initial capital that, combined with a static position in the quoted calls and dynamic trading in the underlying, dominates the payoff in every model consistent with μ\muμ.

Hobson (Finance Stoch. 1998) computed this cost for g(x)=xg(x)=xg(x)=x by a pathwise inequality, and identified the extremal model through the Azéma–Yor solution of the Skorokhod embedding problem (Azéma–Yor 1979). Galichon, Henry-Labordère and Touzi (Ann. Appl. Probab. 2014, arXiv:1401.3921) recast model-free bounds as a dual stochastic control problem in which the marginal constraint is penalised by a Lagrange multiplier λ\lambdaλ. Their Theorem 3.1 recovers Hobson's bound for every C1C^1C1 nondecreasing ggg from that dual, with an explicit optimal multiplier and stopping time. The result is one of the founding examples of martingale optimal transport.

Setting

Let BBB be a real Brownian motion with continuous paths and B0=0B_0=0B0​=0, adapted to a filtration (Ft)t≥0(\mathcal F_t)_{t\ge0}(Ft​)t≥0​ with increments independent of the past, and let Xt=X0+BtX_t=X_0+B_tXt​=X0​+Bt​ for a spot X0∈RX_0\in\mathbb RX0​∈R. Write Xτ∗=max⁡t≤τXtX^*_\tau=\max_{t\le\tau}X_tXτ∗​=maxt≤τ​Xt​. Let T∞\mathcal T_\inftyT∞​ be the set of stopping times τ\tauτ for which the stopped process (Xt∧τ)t≥0(X_{t\wedge\tau})_{t\ge0}(Xt∧τ​)t≥0​ is a uniformly integrable martingale.

The marginal is a probability measure μ\muμ on R\mathbb RR with finite first moment and mean ∫x μ(dx)=X0\int x\,\mu(dx)=X_0∫xμ(dx)=X0​. Its call prices are c(x)=∫(y−x)+μ(dy)c(x)=\int(y-x)^+\mu(dy)c(x)=∫(y−x)+μ(dy). The payoff is ξ=g(X∗)\xi=g(X^*)ξ=g(X∗) with g:R→R+g:\mathbb R\to\mathbb R_+g:R→R+​ of class C1C^1C1 and nondecreasing.

For a multiplier λ:R→R\lambda:\mathbb R\to\mathbb Rλ:R→R and τ∈T∞\tau\in\mathcal T_\inftyτ∈T∞​ set J(λ,τ)=E[g(Xτ∗)−λ(Xτ)]J(\lambda,\tau)=\mathbb E[g(X^*_\tau)-\lambda(X_\tau)]J(λ,τ)=E[g(Xτ∗​)−λ(Xτ​)] and uλ(X0,X0)=sup⁡τ∈T∞J(λ,τ)u^\lambda(X_0,X_0)=\sup_{\tau\in\mathcal T_\infty}J(\lambda,\tau)uλ(X0​,X0​)=supτ∈T∞​​J(λ,τ). The admissible multipliers are

Λ0μ={λ∈L1(μ): sup⁡τ∈T∞E[λ(Xτ)−]<∞},\Lambda^\mu_0=\Big\{\lambda\in\mathbb L^1(\mu):\ \sup_{\tau\in\mathcal T_\infty}\mathbb E[\lambda(X_\tau)^-]<\infty\Big\},Λ0μ​={λ∈L1(μ): τ∈T∞​sup​E[λ(Xτ​)−]<∞},

and the reduced superhedging problem (3.7) is

Uμ(ξ)=inf⁡λ∈Λ0μ{∫λ dμ+uλ(X0,X0)}.U^\mu(\xi)=\inf_{\lambda\in\Lambda^\mu_0}\Big\{\int\lambda\,d\mu+u^\lambda(X_0,X_0)\Big\}.Uμ(ξ)=λ∈Λ0μ​inf​{∫λdμ+uλ(X0​,X0​)}.

The barycenter function is b(x)=∫[x,∞)y μ(dy)/μ([x,∞))b(x)=\int_{[x,\infty)}y\,\mu(dy)/\mu([x,\infty))b(x)=∫[x,∞)​yμ(dy)/μ([x,∞)) for μ((x,∞))>0\mu((x,\infty))>0μ((x,∞))>0 and b(x)=xb(x)=xb(x)=x otherwise. The Hardy–Littlewood transform μHL\mu^{HL}μHL is the probability measure with

μHL([y,∞))=inf⁡ξ<yc(ξ)y−ξ.\mu^{HL}([y,\infty))=\inf_{\xi<y}\frac{c(\xi)}{y-\xi}.μHL([y,∞))=ξ<yinf​y−ξc(ξ)​.

The Azéma–Yor stopping time is τ∗=inf⁡{t>0:Xt∗≥b(Xt)}\tau^*=\inf\{t>0:X^*_t\ge b(X_t)\}τ∗=inf{t>0:Xt∗​≥b(Xt​)}, and the candidate multiplier is

λ∗(x)=∫ℓμx ⁣∫ℓμyg′(b(ξ)) b(dξ)b(ξ)−ξ dy,\lambda^*(x)=\int_{\ell^\mu}^{x}\!\int_{\ell^\mu}^{y}g'(b(\xi))\,\frac{b(d\xi)}{b(\xi)-\xi}\,dy ,λ∗(x)=∫ℓμx​∫ℓμy​g′(b(ξ))b(ξ)−ξb(dξ)​dy,

that is, the convex function vanishing below ℓμ\ell^\muℓμ that solves the weak ODE (3.21) with ψ=b−1\psi=b^{-1}ψ=b−1.

Formalization targets

Goal: Theorem 3.1

If sup⁡τ∈T∞E[g(Xτ∗)]<∞\sup_{\tau\in\mathcal T_\infty}\mathbb E[g(X^*_\tau)]<\inftysupτ∈T∞​​E[g(Xτ∗​)]<∞ and μHL(g)=∫g dμHL<∞\mu^{HL}(g)=\int g\,d\mu^{HL}<\inftyμHL(g)=∫gdμHL<∞, then

Uμ(ξ)=μ(λ∗)+J(λ∗,τ∗)=μHL(g).U^\mu(\xi)=\mu(\lambda^*)+J(\lambda^*,\tau^*)=\mu^{HL}(g).Uμ(ξ)=μ(λ∗)+J(λ∗,τ∗)=μHL(g).

The goal is the paper's theorem for the reduced problem (3.7), in its full two-equality form: the value, its attainment by (λ∗,τ∗)(\lambda^*,\tau^*)(λ∗,τ∗), and its closed form.

Milestones

  1. The Neumann condition (3.23) for Peskir's candidate vψv^\psivψ.
  2. Lemma 3.1: uλ≤vψu^\lambda\le v^\psiuλ≤vψ for convex λ∈Λ0μ\lambda\in\Lambda^\mu_0λ∈Λ0μ​ and every relaxed free boundary ψ∈Ψλ\psi\in\Psi^\lambdaψ∈Ψλ.
  3. Step (1) of Lemma 3.2: μ(λ)−λ(X0)=∫(c−c0) dλ′′\mu(\lambda)-\lambda(X_0)=\int(c-c_0)\,d\lambda''μ(λ)−λ(X0​)=∫(c−c0​)dλ′′, with c0(x)=(X0−x)+c_0(x)=(X_0-x)^+c0​(x)=(X0​−x)+.
  4. Lemma 3.2: μ(λ)+uλ(X0,X0)≤g(X0)+∫φ(ψ(m),m)g′(m) dm\mu(\lambda)+u^\lambda(X_0,X_0)\le g(X_0)+\int\varphi(\psi(m),m)g'(m)\,dmμ(λ)+uλ(X0​,X0​)≤g(X0​)+∫φ(ψ(m),m)g′(m)dm.
  5. The pointwise minimizations (3.27) and (3.28).
  6. Steps (2) and (3) of Lemma 3.3: properties of λ∗\lambda^*λ∗, and the integration by parts giving μHL(g)\mu^{HL}(g)μHL(g).
  7. Lemma 3.3, the upper bound Uμ(ξ)≤μHL(g)U^\mu(\xi)\le\mu^{HL}(g)Uμ(ξ)≤μHL(g).
  8. The Azéma–Yor facts: τ∗∈T∞\tau^*\in\mathcal T_\inftyτ∗∈T∞​, Xτ∗∼μX_{\tau^*}\sim\muXτ∗​∼μ, Xτ∗∗∼μHLX^*_{\tau^*}\sim\mu^{HL}Xτ∗∗​∼μHL.
  9. The lower bound Uμ(ξ)≥μHL(g)U^\mu(\xi)\ge\mu^{HL}(g)Uμ(ξ)≥μHL(g) of Section 3.4.

Significance

The theorem identifies the model-free price of a lookback payoff as an explicit functional of the call prices, μHL(g)\mu^{HL}(g)μHL(g), and exhibits the extremal model (Brownian motion stopped at τ∗\tau^*τ∗) and the optimal static hedge (λ∗\lambda^*λ∗). It shows that the dual stochastic control formulation is sharp on a nontrivial path-dependent payoff, which is the template for later work on martingale optimal transport with path-dependent costs.

The result has been proved since 2014 (and Hobson's bound since 1998). It has not been formalized. A complete development would provide machine-checked versions of the Azéma–Yor embedding, the law of the maximum at the embedding, a verification theorem for a reflected optimal stopping problem with a nonsmooth obstacle, and the convex-analytic identities linking call prices to second-derivative measures. Each of these is reusable well beyond this paper.

Difficulty

The upper bound requires a verification argument for an optimal stopping problem of the pair (X,X∗)(X,X^*)(X,X∗) with a reflection at the diagonal, where the candidate vψv^\psivψ is only as regular as the convex multiplier λ\lambdaλ: second derivatives are measures and the free boundary ψ\psiψ solves its ODE only in a relaxed sense. An Itô formula for C2C^2C2 functions does not apply; an Itô–Tanaka (local time) argument for concave functions of XXX, with the reflection term killed by the Neumann condition, is needed, followed by a localisation that uses uniform integrability and the integrability condition in Λ0μ\Lambda^\mu_0Λ0μ​. The lower bound needs the Azéma–Yor embedding and the law of Xτ∗∗X^*_{\tau^*}Xτ∗∗​, neither of which is in Mathlib; the naive appeal to "the embedding exists" does not give the joint law of the stopped value and the maximum.

Formalization scope

The Lean development lives in the namespace LookbackMOT.HL and uses Mathlib's IsBrownianReal, IsStoppingTime, stoppedProcess, stoppedValue, Martingale, UniformIntegrable and HasLaw. Committed conventions:

  • What is formalized. The goal is the reduced problem (3.7), not the superhedging problem (2.6): (2.6) needs stochastic integrals, which Mathlib does not have. The bridge between them (Proposition 2.1, the claim (3.4), Proposition 3.1) is outside this mission. The theorem's hypothesis sup⁡P∈P∞EP[ξ+]<∞\sup_{\mathbb P\in\mathcal P_\infty}\mathbb E^{\mathbb P}[\xi^+]<\inftysupP∈P∞​​EP[ξ+]<∞ is stated through Proposition 3.1 with λ=0\lambda=0λ=0 as sup⁡τ∈T∞E[g(Xτ∗)]<∞\sup_{\tau\in\mathcal T_\infty}\mathbb E[g(X^*_\tau)]<\inftysupτ∈T∞​​E[g(Xτ∗​)]<∞. The horizon TTT disappears: the stopping problem is over T∞\mathcal T_\inftyT∞​ with time in [0,∞)[0,\infty)[0,∞).
  • Standing hypotheses. The Brownian motion lives on an arbitrary filtered probability space with everywhere-continuous paths and B0=0B_0=0B0​=0; the paper's canonical space is one instance. The mean condition and integrability of μ\muμ (p. 7) are assumed throughout. The spot X0X_0X0​ is any real number. μ([0,∞))=1\mu([0,\infty))=1μ([0,∞))=1 is assumed only in (3.27).
  • Added conditions. Every τ∈T∞\tau\in\mathcal T_\inftyτ∈T∞​ is a.s. finite (implied by uniform integrability). Every λ∈Λ0μ\lambda\in\Lambda^\mu_0λ∈Λ0μ​ is measurable.
  • Expectations of payoffs are E[φ+]−E[φ−]\mathbb E[\varphi^+]-\mathbb E[\varphi^-]E[φ+]−E[φ−] in the extended reals, with ∞−∞=−∞\infty-\infty=-\infty∞−∞=−∞; value functions are extended reals.
  • Derivatives. λ′\lambda'λ′ is the right derivative and λ′′\lambda''λ′′ its Stieltjes measure. The weak ODE (3.21) is used both as a change of variables (λ′′\lambda''λ′′ is the image of g′(m)/(m−ψ(m)) dmg'(m)/(m-\psi(m))\,dmg′(m)/(m−ψ(m))dm under ψ\psiψ) and on intervals (λ′(ψ(y2))−λ′(ψ(y1))=∫y1y2g′(m)/(m−ψ(m)) dm\lambda'(\psi(y_2))-\lambda'(\psi(y_1))=\int_{y_1}^{y_2}g'(m)/(m-\psi(m))\,dmλ′(ψ(y2​))−λ′(ψ(y1​))=∫y1​y2​​g′(m)/(m−ψ(m))dm), the two forms the paper's proofs use.
  • The multiplier λ∗\lambda^*λ∗. It is written as λ∗(x)=∫X0<m<rμg′(m)(x−b−1(m))+/(m−b−1(m)) dm\lambda^*(x)=\int_{X_0<m<r^\mu}g'(m)(x-b^{-1}(m))^+/(m-b^{-1}(m))\,dmλ∗(x)=∫X0​<m<rμ​g′(m)(x−b−1(m))+/(m−b−1(m))dm, the change of variables m=b(ξ)m=b(\xi)m=b(ξ) in (3.14) and the solution of (3.21) with ψ=b−1\psi=b^{-1}ψ=b−1 that the proof of Lemma 3.3 uses. It agrees with the b(dξ)b(d\xi)b(dξ) formula when bbb is continuous; at the jumps of bbb (atoms of μ\muμ) the Lebesgue–Stieltjes reading of (3.14) can fail to be μ\muμ-integrable.
  • Measures given by identities. μHL\mu^{HL}μHL and λ′′\lambda''λ′′ enter as measures satisfying their defining identities on intervals; each exists and is unique.
  • Printed slips not copied. (3.12) prints the numerator c(y)c(y)c(y); the formalization uses c(ξ)c(\xi)c(ξ). bbb, μHL\mu^{HL}μHL and λ∗\lambda^*λ∗ are extended from x≥0x\ge0x≥0 to all of R\mathbb RR by the same formulas.

No trivializing reading is available. Payoff expectations are never Bochner integrals (which would be 000 for non-integrable payoffs). τ≡0\tau\equiv0τ≡0 lies in T∞\mathcal T_\inftyT∞​ and λ≡0\lambda\equiv0λ≡0 in Λ0μ\Lambda^\mu_0Λ0μ​, so neither the supremum nor the infimum is over an empty set. The predicates for μHL\mu^{HL}μHL and λ′′\lambda''λ′′ are satisfiable (witnessed for μ=δX0\mu=\delta_{X_0}μ=δX0​​ in a sorry-free check). XτX_\tauXτ​ is only evaluated where τ<∞\tau<\inftyτ<∞ a.s. Every division has a positive denominator on the sets that carry mass.

Contributions welcome: the Azéma–Yor embedding and the law of the maximum; an Itô–Tanaka or local-time calculus sufficient for concave functions of Brownian motion and its maximum; the call-price identities of convex analysis; and the analysis of μHL\mu^{HL}μHL.

Selected references

  • A. Galichon, P. Henry-Labordère, N. Touzi, A stochastic control approach to no-arbitrage bounds given marginals, with an application to lookback options, Ann. Appl. Probab. 24 (2014) 312–336. https://arxiv.org/abs/1401.3921 (v1, the version cited)
  • D. Hobson, Robust hedging of the lookback option, Finance Stoch. 2 (1998) 329–347. https://doi.org/10.1007/s007800050046
  • J. Azéma, M. Yor, Une solution simple au problème de Skorokhod, Séminaire de Probabilités XIII, LNM 721 (1979) 90–115. https://doi.org/10.1007/BFb0070852
  • G. Peskir, Optimal stopping of the maximum process: the maximality principle, Ann. Probab. 26 (1998) 1614–1640. https://doi.org/10.1214/aop/1022855875
  • L. Carraro, N. El Karoui, J. Obłój, On Azéma–Yor processes, their optimal properties and the Bachelier–drawdown equation, Ann. Probab. 40 (2012) 372–400. https://arxiv.org/abs/0902.1328
13 thms1 active userReviewed
Machine LearningOptimization·Captain: mikedeng1

A Modern Introduction to Online Learning IX: Cover's Universal Portfolio with Uniform or Dirichlet(1/2) Prior Has Logarithmic Regret Against Constantly Rebalanced PortfoliosTextbook

Why sequential portfolios matter

A portfolio manager chooses fractions of current wealth to place in several stocks before seeing that day’s market gains. The gains need not follow a statistical model: a sequence may be selected adversarially, with some stocks losing all value on a given day. A useful benchmark is the best constantly rebalanced portfolio, which holds the same fractions each day but trades at the end of every round to restore them. Its fixed allocation is an active strategy, and it can grow even when buying and holding each individual stock does not. Chapter 10 of Orabona’s online learning text studies guarantees against this benchmark without imposing a positive lower bound or a finite upper bound on nonzero market gains.

The chapter presents a universal portfolio: an allocation determined by a prior distribution over all fixed portfolios and reweighted according to their wealth so far. The mission focuses on the uniform-prior part of Theorem 10.1. It asks for a worst-case logarithmic regret guarantee against every fixed comparator and every admissible market sequence. This is a deterministic guarantee; no distributional assumption about the market enters its statement.

Market and strategy

There are d≥2d\ge2d≥2 stocks and T≥1T\ge1T≥1 rounds. In round ttt, the market supplies a vector wt∈R≥0d∖{0}w_t\in\mathbb R_{≥0}^d\setminus\{0\}wt​∈R≥0d​∖{0} of nonnegative gains. A portfolio is u∈Δd−1u\in\Delta^{d-1}u∈Δd−1, the simplex of vectors with nonnegative coordinates summing to one. If one unit is invested initially and the allocation stays fixed, its wealth after TTT rounds is

WT(u)=∏t=1T⟨wt,u⟩.W_T(u)=\prod_{t=1}^{T}\langle w_t,u\rangle.WT​(u)=t=1∏T​⟨wt​,u⟩.

A sequential strategy chooses xt∈Δd−1x_t\in\Delta^{d-1}xt​∈Δd−1 before seeing wtw_twt​, and has wealth WT=∏t=1T⟨wt,xt⟩W_T=\prod_{t=1}^{T}\langle w_t,x_t\rangleWT​=∏t=1T​⟨wt​,xt​⟩. The quantity of interest is the difference between the logarithms of benchmark wealth and sequential wealth. A fixed portfolio can have zero wealth when all the stocks it holds have a zero gain on some day; its log wealth is then −∞-\infty−∞ in the mathematical convention of the book.

Algorithm 10.1 begins with a prior FFF on the simplex. Before round ttt, it gives each fixed portfolio uuu weight proportional to its wealth Wt−1(u)W_{t-1}(u)Wt−1​(u), and chooses the resulting mean allocation:

xt(i)=∫Δd−1uiWt−1(u) F(du)∫Δd−1Wt−1(u) F(du).x_t(i)=\frac{\int_{\Delta^{d-1}}u_i W_{t-1}(u)\,F(du)}{\int_{\Delta^{d-1}}W_{t-1}(u)\,F(du)}.xt​(i)=∫Δd−1​Wt−1​(u)F(du)∫Δd−1​ui​Wt−1​(u)F(du)​.

For this mission, FFF is the uniform probability measure on the simplex. It is represented by Lebesgue measure in the first d−1d-1d−1 coordinates, scaled by (d−1)!(d-1)!(d−1)!; the final coordinate is one minus their sum. This explicit density fixes what “uniform” means and prevents the prior from being chosen to suit a particular market sequence.

Formalization targets

The goal is the uniform-prior case of Theorem 10.1. With the notation above, for every fixed portfolio of positive wealth,

log⁡WT(u)−log⁡WT≤log⁡(T+d−1d−1)≤(d−1)[log⁡(Td−1+1)+1].\log W_T(u)-\log W_T \le \log\binom{T+d-1}{d-1} \le (d-1)\left[\log\left(\frac{T}{d-1}+1\right)+1\right].logWT​(u)−logWT​≤log(d−1T+d−1​)≤(d−1)[log(d−1T​+1)+1].

The goal also asserts WT>0W_T>0WT​>0, so the algorithm’s logarithmic wealth is defined. The first inequality gives an exact finite-horizon combinatorial bound; the second displays its logarithmic dependence on TTT for fixed ddd. The book also states a Dirichlet(1/2,…,1/2)(1/2,\ldots,1/2)(1/2,…,1/2) prior bound in the same theorem. That companion branch is not among this proposal’s draft items; its gamma-function normalization and integral identities would require a separate audited definition layer. The fixed series title follows the chapter plan, while the goal and milestone list specify the precise scope delivered here.

The attack path records four source statements. Lemma 10.5 bounds a ratio of nonnegative sums by the largest component ratio. Lemma 10.6 reduces a universal portfolio’s wealth ratio to a maximum over sequences of single-stock choices. Theorem 10.4 bounds the size of a type class, the set of sequences with the same empirical fractions of symbols. Equation (10.5) computes the monomial integral under the uniform simplex prior. These statements are from the chapter’s proof of Theorem 10.1; the equation is referred to as an exercise in Problem 10.3.

What the result provides

The theorem ensures that the uniform-prior strategy keeps its log wealth within O(dlog⁡(1+T/d))O(d\log(1+T/d))O(dlog(1+T/d)) of the best constantly rebalanced portfolio, while making no bounded-gain assumption. In particular, a stock may have gain zero on one day or a very large gain on another. The guarantee is pathwise: it applies to the realized market vectors, regardless of how they were chosen. For a fixed number of stocks, dividing regret by TTT therefore gives a vanishing average shortfall in log wealth.

The mathematical result is already proved in the cited text. This mission’s work is to give its exact algorithm, prior measure, combinatorial objects, and finite-horizon constants machine-checked statements and then proofs. The density-based prior, finite type classes, and simplex monomial integrals can also be reused in online aggregation and universal coding developments. The draft statements currently have Lean placeholders for proofs; a successful submission will still require solvers to close them.

Main difficulty

Applying a generic online convex optimization bound to the loss −log⁡⟨wt,x⟩-\log\langle w_t,x\rangle−log⟨wt​,x⟩ runs into unbounded gradients when a chosen portfolio has small gain. A bound based on one global Lipschitz constant cannot cover the market sequences allowed here. The integral strategy creates a different obstacle: its denominator must be positive at every round, including histories with zero gains for many fixed portfolios. Its uniform prior is a measure on a (d−1)(d-1)(d−1)-dimensional simplex embedded in Rd\mathbb R^dRd, so ambient ddd-dimensional volume would give it mass zero. A proof must work with the intrinsic coordinate measure and its normalization. The exact binomial coefficient also depends on counting all sequences of one type without losing the boundary cases where some symbol occurs zero times.

Formalization scope

Lean represents a portfolio as a function Fin d → ℝ in Mathlib’s stdSimplex; a market is a one-based sequence of vectors of the same type. The coordinate chart maps Rd−1\mathbb R^{d-1}Rd−1 into the simplex, and a scaled restricted Lebesgue measure is pushed forward to define the uniform prior. The chart’s measurability is proved in the definition file. Algorithm 10.1 is a componentwise ratio of real integrals, and the main theorem asserts positive realized wealth. All market vectors on rounds 1,…,T1,\ldots,T1,…,T are nonnegative and nonzero. The parameter restrictions d≥2d\ge2d≥2 and T≥1T\ge1T≥1 make the dimension and printed denominators meaningful.

For Lemma 10.5, quotients use extended nonnegative reals, with a/0=+∞a/0=+\inftya/0=+∞ when a>0a>0a>0 and 0/0=00/0=00/0=0 as printed. Lemma 10.6 is stated for a generic prior concentrated on the simplex, with its ratios in extended nonnegative reals under the same conventions, and with the hypothesis that the normalizing integral of Algorithm 10.1 is positive in every round, which is what makes the algorithm's prediction defined. A comparator with zero wealth is omitted only from the real-log statement, corresponding to log wealth −∞-\infty−∞ in the source. The prior cannot be replaced by an arbitrary point mass: the theorem names the chart-based uniform measure, and the prediction is the exact integral ratio. Contributions proving normalization, support, the integral identity, and the final regret bound are all within scope.

Selected references

  • Francesco Orabona, Online Learning: A Modern Introduction Using Convex Optimization, arXiv:1912.13213v10, 2026, Chapter 10 and Appendix A.2.2. arXiv
7 thms1 active userReviewed
CombinatoricsGraph TheoryOptimization·Captain: mikedeng1

A Constant-Factor Approximation Algorithm for the Asymmetric Traveling Salesman Problem: The Asymmetric Held–Karp Relaxation Has Integrality Gap at Most 319Research Paper

Motivation

The asymmetric traveling salesman problem (ATSP) asks for a shortest closed walk through every vertex of a directed graph whose edge weights need not be symmetric. It models routing with one-way streets, scheduling with sequence-dependent setup times, and many other problems in which the cost of going from uuu to vvv differs from the cost of going back. Its standard linear relaxation, the asymmetric Held–Karp relaxation, is the lower bound used both by exact branch-and-cut codes and by approximation algorithms, and the central question about it is how far it can be from the integer optimum.

Timeline of the approximation ratio and of the integrality gap for ATSP:

  • 1982: Frieze, Galbiati and Maffioli give a log⁡2n\log_2 nlog2​n-approximation by repeated cycle covers.
  • 2010: Asadpour, Goemans, Mądry, Oveis Gharan and Saberi reach O(log⁡n/log⁡log⁡n)O(\log n/\log\log n)O(logn/loglogn) via thin trees (SODA 2010).
  • 2015: Anari and Oveis Gharan bound the integrality gap by poly(log⁡log⁡n)\mathrm{poly}(\log\log n)poly(loglogn), non-constructively; Svensson obtains a constant factor for node-weighted digraphs.
  • 2018: Svensson, Tarnawski and Végh obtain the first constant-factor approximation for general ATSP (STOC 2018); the journal version (J. ACM 2020) states the ratio 506506506 and the integrality gap bound 319319319.
  • 2020: Traub and Vygen improve the ratio to 22+ε22+\varepsilon22+ε and the gap to 222222 (STOC 2020).

The lower bound on the integrality gap remains 222 (Charikar, Goemans and Karloff, 2006).

Setting

A digraph G=(V,E)G=(V,E)G=(V,E) has finite vertex and edge sets; each edge has a tail and a head, and parallel edges and loops are allowed. For S⊆VS\subseteq VS⊆V, δ+(S)\delta^+(S)δ+(S) and δ−(S)\delta^-(S)δ−(S) are the edges leaving and entering SSS, and δ(S)=δ+(S)∪δ−(S)\delta(S)=\delta^+(S)\cup\delta^-(S)δ(S)=δ+(S)∪δ−(S). An ATSP input is a strongly connected digraph GGG with a weight function w:E→R≥0w:E\to\mathbb R_{\ge0}w:E→R≥0​.

An edge multiset FFF gives each edge a multiplicity F(e)∈NF(e)\in\mathbb NF(e)∈N; V(F)V(F)V(F) is the set of vertices it touches. FFF is Eulerian if every vertex has as many outgoing as incoming edges of FFF, a subtour if moreover (V(F),F)(V(F),F)(V(F),F) is connected, and a tour if it is a subtour with V(F)=VV(F)=VV(F)=V. Tours are exactly the closed walks visiting every vertex. The weight of FFF is ∑eF(e)w(e)\sum_e F(e)w(e)∑e​F(e)w(e).

The asymmetric Held–Karp relaxation LP(G,w)(G,w)(G,w) is

min⁡∑e∈Ew(e)x(e)s.t.x(δ+(v))=x(δ−(v)) (v∈V),x(δ(S))≥2 (∅≠S⊊V),x≥0,\min\sum_{e\in E}w(e)x(e)\quad\text{s.t.}\quad x(\delta^+(v))=x(\delta^-(v))\ (v\in V),\qquad x(\delta(S))\ge2\ (\emptyset\ne S\subsetneq V),\qquad x\ge0,mine∈E∑​w(e)x(e)s.t.x(δ+(v))=x(δ−(v)) (v∈V),x(δ(S))≥2 (∅=S⊊V),x≥0,

and its optimum is the Held–Karp lower bound.

The mission also uses the paper's intermediate objects: laminarly-weighted instances I=(G,L,x,y)I=(G,\mathcal L,x,y)I=(G,L,x,y), in which L\mathcal LL is a laminar family of sets that are tight for a strictly positive feasible xxx, y≥0y\ge0y≥0 on L\mathcal LL, and the weight of an edge is wI(e)=∑S∈L: e∈δ(S)ySw_I(e)=\sum_{S\in\mathcal L:\,e\in\delta(S)}y_SwI​(e)=∑S∈L:e∈δ(S)​yS​; the value value(I)=2∑S∈LyS\mathrm{value}(I)=2\sum_{S\in\mathcal L}y_Svalue(I)=2∑S∈L​yS​ and the lower bound lbI(U)=∑v∈U2y{v}\mathrm{lb}_I(U)=\sum_{v\in U}2y_{\{v\}}lbI​(U)=∑v∈U​2y{v}​; Subtour Partition Cover and (α,β)(\alpha,\beta)(α,β)-lightness; irreducible instances; vertebrate pairs; and quasi-backbones. Each is defined, with the paper's page reference, in the two definition files of the mission.

Formalization targets

Goal: Theorem 11.1

For every strongly connected digraph GGG with ∣V∣≥2|V|\ge2∣V∣≥2, every w≥0w\ge0w≥0 and every feasible solution xxx of LP(G,w)(G,w)(G,w), there is a tour FFF with

∑e∈EF(e) w(e) ≤ 319∑e∈Ew(e) x(e).\sum_{e\in E}F(e)\,w(e)\ \le\ 319\sum_{e\in E}w(e)\,x(e).e∈E∑​F(e)w(e) ≤ 319e∈E∑​w(e)x(e).

This is the statement that the integrality gap of the asymmetric Held–Karp relaxation is at most 319319319.

Milestones

The milestones are the results the paper's §11 combines, in the order it combines them:

  1. Theorem 4.1: Subtour Partition Cover is (2,0)(2,0)(2,0)-light on singleton instances with B=∅B=\emptysetB=∅.
  2. Theorem 5.1: an (α,β)(\alpha,\beta)(α,β)-light pair (I,B)(I,B)(I,B) has a tour of weight at most 5α lbI(Bˉ)+β+wI(B)5\alpha\,\mathrm{lb}_I(\bar B)+\beta+w_I(B)5αlbI​(Bˉ)+β+wI​(B).
  3. §11: every singleton instance has a tour of weight at most 10 value(I)10\,\mathrm{value}(I)10value(I) (αS′=10\alpha'_S=10αS′​=10).
  4. Theorem 10.1: vertebrate pairs are (4, 2 value(I)+lbI(Bˉ))(4,\,2\,\mathrm{value}(I)+\mathrm{lb}_I(\bar B))(4,2value(I)+lbI​(Bˉ))-light.
  5. §11: a vertebrate pair has a tour of weight at most 2 value(I)+21 lbI(Bˉ)+wI(B)2\,\mathrm{value}(I)+21\,\mathrm{lb}_I(\bar B)+w_I(B)2value(I)+21lbI​(Bˉ)+wI​(B) (η′=1+5⋅4\eta'=1+5\cdot4η′=1+5⋅4).
  6. Lemma 9.3: an irreducible instance has a quasi-backbone of weight at most (αS+3) value(I)(\alpha_S+3)\,\mathrm{value}(I)(αS​+3)value(I).
  7. Theorem 9.4: tours on vertebrate pairs give a ρ\rhoρ-bound on irreducible instances, ρ=κ+η(1−δ)+αS+32δ−1\rho=\frac{\kappa+\eta(1-\delta)+\alpha_S+3}{2\delta-1}ρ=2δ−1κ+η(1−δ)+αS​+3​.
  8. Theorem 8.3: a ρ\rhoρ-bound on irreducible instances gives a 2ρ1−δ\frac{2\rho}{1-\delta}1−δ2ρ​-bound on all laminarly-weighted instances.
  9. Lemma 2.2: DUAL(G,w)(G,w)(G,w) has an optimal solution with laminar support.
  10. Theorem 2.4: a bound α value(I)\alpha\,\mathrm{value}(I)αvalue(I) on all laminarly-weighted instances gives α\alphaα times the Held–Karp bound on all ATSP inputs.

Significance

The result shows that the asymmetric Held–Karp relaxation approximates ATSP within a constant factor, which settled a question open since the 1980s and made the relaxation a certified lower bound with bounded loss. The structural steps (reduction to laminarly-weighted instances, Subtour Partition Cover, irreducibility and vertebrate pairs) are the framework on which the later improvement to 222222 by Traub and Vygen is built.

The theorem is proved; to the best of available knowledge none of it has been formalized in a proof assistant. A complete development would give a machine-checked bound on the integrality gap of a central relaxation in combinatorial optimization, and its intermediate statements are reusable for the improved bounds that follow the same framework.

Difficulty

The obvious approaches do not give a constant. Repeated cycle covers lose a factor at each of logarithmically many rounds. Rounding the LP solution through thin trees needs a spanning tree that is thin in every cut, and only polylogarithmic thinness is known. The paper's route is long: the reduction to laminarly-weighted instances needs an uncrossed dual; the reduction from irreducible to general instances and the one from vertebrate pairs to irreducible instances are recursive, applying the assumed algorithm to instances built by contracting or inducing tight sets, so their hypotheses must hold on all instances and not only on the given one; and the lightness bound for vertebrate pairs (Theorem 10.1) rests on a flow-based construction with careful accounting against the laminar family.

Formalization scope

Vertices and edges are finite types; edges carry tail and head maps, so parallel edges (created by contraction) are distinct edges, and loops are allowed and lie in no cut. Edge multisets are functions E→NE\to\mathbb NE→N. Connectivity of a multiset and its components are defined by the reflexive–transitive closure of undirected adjacency along its edges.

Running times are not formalized. Every algorithmic statement is posed in its existential form, as §11 of the paper itself uses it to derive Theorem 11.1: "there is an algorithm returning a tour within ccc" becomes "every instance has a tour within ccc", and an assumed algorithm becomes a hypothesis quantified over instances on all finite vertex and edge types. The algorithmic constants 9(1+ε)9(1+\varepsilon)9(1+ε), 18+ε18+\varepsilon18+ε, 37+36ε37+36\varepsilon37+36ε and 506506506 are therefore not stated; the non-constructive constants 555, 101010 and 212121 of §11 are.

The Held–Karp lower bound is never defined as an infimum: comparisons with it are stated for every feasible xxx, equivalently because the LP optimum is attained. Likewise dSd_SdS​ and DSD_SDS​ in the definition of irreducibility are expressed through walks, without an infimum.

Added hypotheses, each disclosed in the item's Formalization Note:

  • ∣V∣≥2|V|\ge2∣V∣≥2 in the goal, Theorem 2.4 and every laminarly-weighted instance: on one vertex without a loop no tour exists while LP(G,w)(G,w)(G,w) has value 000.
  • Partition parts in Subtour Partition Cover are nonempty and different from VVV; for B=∅B=\emptysetB=∅ the one-part partition (V)(V)(V) admits no solution.
  • α≥0\alpha\ge0α≥0 in Theorem 5.1, which is false without it.
  • αS\alpha_SαS​ in Lemma 9.3 and Theorem 9.4 is a parameter with the hypothesis that singleton instances have tours within αS value\alpha_S\,\mathrm{value}αS​value, instead of the fixed 18+ε18+\varepsilon18+ε.

These choices rule out trivializing formalizations: no instance class in a hypothesis is empty (a two-vertex singleton instance is valid, irreducible and vertebrate), admissible partitions exist for every instance, and LP(G,w)(G,w)(G,w) is feasible for every strongly connected input. The goal assumes none of the milestones.

Out of scope: the polynomial running times, §5's merge-procedure lemmas, the constructions of §7, and Corollaries 11.2–11.4 on the path version, which rest on external reductions. Contributions are welcome on every milestone, and on infrastructure that a complete development needs: LP duality and uncrossing for cut LPs, Eulerian multigraphs and their decomposition into closed walks, and circulations with lower bounds (Hoffman's theorem). The platform's proved LP strong duality (SmaleNinth.lp_strong_duality) is a natural starting point for Lemma 2.2.

Selected references

  • O. Svensson, J. Tarnawski, L. A. Végh, A constant-factor approximation algorithm for the asymmetric traveling salesman problem, J. ACM 67(6), 2020. https://doi.org/10.1145/3424306 (accepted manuscript: LSE Research Online 106582, https://eprints.lse.ac.uk/106582/)
  • O. Svensson, J. Tarnawski, L. A. Végh, A constant-factor approximation algorithm for the asymmetric traveling salesman problem, STOC 2018. https://doi.org/10.1145/3188745.3188824
  • V. Traub, J. Vygen, An improved approximation algorithm for ATSP, STOC 2020. https://arxiv.org/abs/1912.00670
  • A. Asadpour, M. X. Goemans, A. Mądry, S. Oveis Gharan, A. Saberi, An O(log n/log log n)-approximation algorithm for the asymmetric traveling salesman problem, SODA 2010. https://doi.org/10.1137/1.9781611973075.32
  • A. M. Frieze, G. Galbiati, F. Maffioli, On the worst-case performance of some algorithms for the asymmetric traveling salesman problem, Networks 12(1), 1982. https://doi.org/10.1002/net.3230120103
  • M. Charikar, M. X. Goemans, H. Karloff, On the integrality ratio for the asymmetric traveling salesman problem, Math. Oper. Res. 31(2), 2006. https://doi.org/10.1287/moor.1050.0172
13 thms1 active userReviewed
Dynamic ProgrammingOptimization·Captain: mikedeng1

Dynamic Type Matching: Under the Modified Monge Condition There Is an Optimal Matching Policy That Respects the Priority Relation ≻MsResearch Paper

Motivation

Many platforms match two sides of a market over time: ride-hailing platforms match riders with drivers, blood banks match donated units with patients, organ allocation matches donors with recipients, and retailers pool inventory across fulfilment centres to serve orders from several regions. Demand and supply arrive in several types (locations, blood groups, quality grades), the reward of a match depends on both types, and whatever is not matched today partly waits for tomorrow. A central operational question is which pairs to match first. Static versions of this question go back to the transportation problem and to Monge sequences: Hoffman (1963) characterized the cost matrices for which a fixed greedy order of the arcs solves a transportation problem.

Hu and Zhou (arXiv:1811.07048, published in Manufacturing & Service Operations Management 24(1), 2022) extend this to a stochastic, multi-period setting. They identify conditions on the rewards, the (weak) modified Monge conditions, under which an optimal dynamic policy matches a dominant pair before the neighbouring pairs it dominates. This mission formalizes their main structural result, Theorem 1, and the chain of results it rests on.

Setting

There are mmm demand types D={1,…,m}\mathcal D=\{1,\dots,m\}D={1,…,m}, nnn supply types S={1,…,n}\mathcal S=\{1,\dots,n\}S={1,…,n}, and TTT periods t=1,…,Tt=1,\dots,Tt=1,…,T. In period ttt the state is a pair of vectors (x,y)∈R+m×R+n(\mathbf x,\mathbf y)\in\mathbb R^m_+\times\mathbb R^n_+(x,y)∈R+m​×R+n​ of available demand and supply. The firm chooses a matching decision Q=(qij)∈Rm×n\mathbf Q=(q_{ij})\in\mathbb R^{m\times n}Q=(qij​)∈Rm×n, collecting the reward

Rt∘Q=∑i=1m∑j=1nrijtqij,\mathbf R^t\circ\mathbf Q=\sum_{i=1}^m\sum_{j=1}^n r^t_{ij}q_{ij},Rt∘Q=i=1∑m​j=1∑n​rijt​qij​,

where the rewards rijtr^t_{ij}rijt​ are arbitrary real numbers. The post-matching levels are ui=xi−∑jqiju_i=x_i-\sum_j q_{ij}ui​=xi​−∑j​qij​ and vj=yj−∑iqijv_j=y_j-\sum_i q_{ij}vj​=yj​−∑i​qij​, and Q\mathbf QQ is feasible if Q≥0\mathbf Q\ge0Q≥0, u≥0\mathbf u\ge0u≥0 and v≥0\mathbf v\ge0v≥0. A fraction α∈[0,1]\alpha\in[0,1]α∈[0,1] of unmatched demand and β∈[0,1]\beta\in[0,1]β∈[0,1] of unmatched supply carries over, and new random quantities (Dt+1,St+1)≥0(\mathbf D^{t+1},\mathbf S^{t+1})\ge0(Dt+1,St+1)≥0 arrive. The value function VtV_tVt​ is defined by the dynamic program

Vt(x,y)=max⁡Q feasibleHt(Q,x,y),Ht(Q,x,y)=Rt∘Q+E Vt+1(αu+Dt+1,βv+St+1),V_t(\mathbf x,\mathbf y)=\max_{\mathbf Q\ \text{feasible}}H_t(\mathbf Q,\mathbf x,\mathbf y),\qquad H_t(\mathbf Q,\mathbf x,\mathbf y)=\mathbf R^t\circ\mathbf Q+\mathbb E\,V_{t+1}(\alpha\mathbf u+\mathbf D^{t+1},\beta\mathbf v+\mathbf S^{t+1}),Vt​(x,y)=Q feasiblemax​Ht​(Q,x,y),Ht​(Q,x,y)=Rt∘Q+EVt+1​(αu+Dt+1,βv+St+1),

with VT+1≡0V_{T+1}\equiv0VT+1​≡0. A matching policy assigns a feasible decision Qt(x,y)\mathbf Q^t(\mathbf x,\mathbf y)Qt(x,y) to every period and state; it is optimal if each of these decisions maximizes HtH_tHt​.

Two neighbouring pairs are compared by the relation ≻M\succ_{\mathcal M}≻M​. For i′≠ii'\ne ii′=i, (i,j)≻M(i′,j)(i,j)\succ_{\mathcal M}(i',j)(i,j)≻M​(i′,j) means rijt>ri′jtr^t_{ij}>r^t_{i'j}rijt​>ri′jt​ for all ttt, and rijt−ri′jt≥α(rij′′t+1−ri′j′′t+1)r^t_{ij}-r^t_{i'j}\ge\alpha(r^{t+1}_{ij''}-r^{t+1}_{i'j''})rijt​−ri′jt​≥α(rij′′t+1​−ri′j′′t+1​) for all t≤T−1t\le T-1t≤T−1 and all j′′j''j′′; the relation (i,j)≻M(i,j′)(i,j)\succ_{\mathcal M}(i,j')(i,j)≻M​(i,j′) is defined symmetrically with β\betaβ. The modified Monge condition requires rijt+ri′j′t≥rij′t+ri′jtr^t_{ij}+r^t_{i'j'}\ge r^t_{ij'}+r^t_{i'j}rijt​+ri′j′t​≥rij′t​+ri′jt​ whenever (i,j)(i,j)(i,j) dominates both (i′,j)(i',j)(i′,j) and (i,j′)(i,j')(i,j′); the paper then writes ≻Ms\succ_{\mathcal M_s}≻Ms​​. For a pair (i,j)(i,j)(i,j), let aia_iai​ be the type-iii demand left after matching iii through all pairs that (i,j)(i,j)(i,j) does not dominate, and bjb_jbj​ the analogous supply residual. A decision respects ≻Ms\succ_{\mathcal M_s}≻Ms​​ if (i,j)≻(i′,j)(i,j)\succ(i',j)(i,j)≻(i′,j) implies qi′j=0q_{i'j}=0qi′j​=0 or ai=0a_i=0ai​=0, and (i,j)≻(i,j′)(i,j)\succ(i,j')(i,j)≻(i,j′) implies qij′=0q_{ij'}=0qij′​=0 or bj=0b_j=0bj​=0.

Formalization targets

Goal: Theorem 1 (p. 12)

Under the modified Monge condition there is a single policy PPP such that, for all 1≤t≤T1\le t\le T1≤t≤T and all x,y≥0\mathbf x,\mathbf y\ge0x,y≥0,

Pt(x,y) is optimalandPt(x,y) respects ≻Ms.P_t(\mathbf x,\mathbf y)\ \text{is optimal}\quad\text{and}\quad P_t(\mathbf x,\mathbf y)\ \text{respects}\ \succ_{\mathcal M_s}.Pt​(x,y) is optimalandPt​(x,y) respects ≻Ms​​.

Milestones

  • Proposition 1 (p. 10): VtV_tVt​ and HtH_tHt​ are continuous and concave, and an optimal policy exists.
  • Lemma A.1 (Online Appendix A, p. 1): shifting ε\varepsilonε units of demand from type iii to type i′i'i′ (or of supply from jjj to j′j'j′) changes VtV_tVt​ by at least −∑τ∑j′λj′τ(rij′τ−ri′j′τ)-\sum_\tau\sum_{j'}\lambda^\tau_{j'}(r^\tau_{ij'}-r^\tau_{i'j'})−∑τ​∑j′​λj′τ​(rij′τ​−ri′j′τ​) for some nonnegative multipliers with ∑τα−(τ−t)∑j′λj′τ≤ε\sum_\tau\alpha^{-(\tau-t)}\sum_{j'}\lambda^\tau_{j'}\le\varepsilon∑τ​α−(τ−t)∑j′​λj′τ​≤ε.
  • Lemma A.2 (p. 3): transferring matching quantity from a dominated pair to a dominant one weakly increases HtH_tHt​.
  • Theorem 2 (p. 28): without the Monge condition, some optimal policy weakly respects ≻M\succ_{\mathcal M}≻M​: qi′j=0q_{i'j}=0qi′j​=0 or ui=0u_i=0ui​=0, and qij′=0q_{ij'}=0qij′​=0 or vj=0v_j=0vj​=0.
  • Monge exchange (proof of Theorem 1, p. 4): the transfer Q+ε(eij+ei′j′−ei′j−eij′)\mathbf Q+\varepsilon(\mathbf e_{ij}+\mathbf e_{i'j'}-\mathbf e_{i'j}-\mathbf e_{ij'})Q+ε(eij​+ei′j′​−ei′j​−eij′​) stays feasible and weakly increases HtH_tHt​.
  • Properties (i)–(iii) imply compatibility (proof of Theorem 1, p. 5).

Significance

Theorem 1 replaces the search over all optimal policies, which are state-dependent and generally complex, by a priority structure: whenever (i,j)(i,j)(i,j) dominates a neighbour, the neighbour is matched only once the residual capacity of (i,j)(i,j)(i,j) is exhausted. The paper derives from it the optimality of greedy matching for "perfect" pairs (Proposition 2), the priority order for horizontal (distance-based) and vertical (quality-based) reward structures, and the match-down-to threshold structure of the optimal policy in those models. These results generalize inventory rationing and capacity allocation with upgrading.

The result is proved in the paper, but not completely: the limit argument in the printed proofs of Theorems 1 and 2 ("the quantity transferred converges to zero") is not justified, and Proposition 1 has no printed proof in this version. A machine-checked development would close these gaps and would provide a reusable finite-horizon model with continuous states, concave value functions and an exchange-argument toolkit. No part of this mission is known to be formalized.

Difficulty

The obvious argument starts from an optimal decision and repeatedly applies the transfers of Lemma A.2 and the Monge exchange. Each transfer preserves optimality, but nothing in the printed argument guarantees that the procedure terminates or that its limit has the required property: transfers of different kinds can undo each other's progress, and with equal rewards they can cycle forever. A complete proof has to select the right optimal decision without relying on such an iteration. Before that, the dynamic program itself needs care: the value function is a supremum of an expectation of the next value function, so continuity, concavity, measurability and integrability have to be established together by backward induction, and attainment of the maximum is needed for any optimal policy to exist. Lemma A.1 is a further backward induction in which the multipliers become random and must be averaged.

Formalization scope

The Lean development lives in the namespace DynTypeMatching.Priority. Types are Fin m and Fin n; states are Fin m → ℝ, Fin n → ℝ; decisions are Fin m → Fin n → ℝ. Periods are natural numbers with the paper's 1-based indexing, and Vt=0V_t=0Vt​=0 for t>Tt>Tt>T. A model Model m n carries TTT, the rewards, α\alphaα, β\betaβ and one arrival law per period on Rm×Rn\mathbb R^m\times\mathbb R^nRm×Rn. The paper permits exogenous correlation between periods; its recursion (1) uses per-period laws and does not specify a joint arrival process. The expectation in HtH_tHt​ is over the law of the arrivals entering period t+1t+1t+1.

Every result assumes Model.WellPosed: each arrival law is a probability measure, supported on the nonnegative orthant and integrable, and 0≤α,β≤10\le\alpha,\beta\le10≤α,β≤1. Integrability is not stated in the paper, but without it the expectation in (1) is undefined. The value function is a real supremum and the expectation a Bochner integral, so outside the nonnegative orthant, or for non-integrable integrands, Lean returns the junk value 0. All statements therefore quantify over nonnegative states and feasible decisions.

The following hypotheses are added relative to the page, and each is disclosed in the item where it occurs:

  • Definition 1(i) is strict, rijt>ri′jtr^t_{ij}>r^t_{i'j}rijt​>ri′jt​, and the neighbours are distinct. With the printed weak inequality, Theorems 1 and 2 are false. Take m=3m=3m=3, n=1n=1n=1, T=1T=1T=1, all rewards equal to 2, x=(0,1,1)\mathbf x=(0,1,1)x=(0,1,1), y=(1)\mathbf y=(1)y=(1). Then types 2 and 3 dominate each other, every optimal decision matches one unit, and no such decision respects the relation.
  • Definition 1(ii) is required only for t+1≤Tt+1\le Tt+1≤T, because rT+1r^{T+1}rT+1 is not part of the model.
  • Lemma A.1 assumes α>0\alpha>0α>0 in part (i) and β>0\beta>0β>0 in part (ii), because α−(τ−t)\alpha^{-(\tau-t)}α−(τ−t) is undefined at α=0\alpha=0α=0.
  • Lemma A.2 assumes that Q\mathbf QQ itself is feasible.

Several printed index slips are corrected: the doubled εeij\varepsilon\mathbf e_{ij}εeij​ in the Monge exchange, the index ranges in Lemma A.1, and "and" for "or" in the compatibility step.

An optimal decision is defined as a feasible maximizer of HtH_tHt​ over feasible decisions, not through the equation Vt=HtV_t=H_tVt​=Ht​. This rules out a trivializing reading of the goal: a decision that respects the relation but is not optimal (for instance Q=0\mathbf Q=0Q=0) does not satisfy it. The goal asserts one policy that is optimal and compatible at the same time.

A complete development needs measurable-function and Bochner-integral calculus on finite-dimensional spaces, concavity and continuity of parametric suprema over polytopes, and compactness arguments for attainment. The model and the exchange lemmas are reusable for later missions on this paper (greedy matching, horizontal and vertical models). Proofs of any milestone are welcome, and so are alternative proofs of the goal.

Selected references

  • Ming Hu, Yun Zhou, Dynamic Type Matching, arXiv:1811.07048v1, 2018; Manufacturing & Service Operations Management 24(1), 2022. https://arxiv.org/abs/1811.07048 · https://doi.org/10.1287/msom.2020.0952
  • Alan J. Hoffman, On simple linear programming problems, Convexity, Proc. Symposia in Pure Mathematics 7, AMS, 1963, 317–327. https://doi.org/10.1090/pspum/007/0157783
  • Rainer E. Burkard, Bettina Klinz, Rüdiger Rudolf, Perspectives of Monge properties in optimization, Discrete Applied Mathematics 70(2), 1996, 95–161. https://doi.org/10.1016/0166-218X(95)00103-X
11 thms1 active userReviewed
CombinatoricsOptimization·Captain: mikedeng1

Closing the Gap for Makespan Scheduling via Sparsification Techniques: A Feasible Configuration IP Has a Thin Solution, Support at Most 4(d+1)log(4(d+1)T), Complex Configurations Used at Most OnceResearch Paper

Motivation

Makespan minimization on identical parallel machines, P∥Cmax⁡P\|C_{\max}P∥Cmax​, asks to assign nnn jobs with processing times to mmm machines so that the largest machine load is as small as possible. It is strongly NP-hard, and the question has long been how fast a (1+ε)(1+\varepsilon)(1+ε)-approximate schedule can be found. After rounding and scaling, a guess TTT of the optimal makespan becomes a constant, the job sizes take only d=O((1/ε)log⁡(1/ε))d = O((1/\varepsilon)\log(1/\varepsilon))d=O((1/ε)log(1/ε)) distinct values, and the problem becomes an integer program over machine packings: the configuration IP.

A short history of the running times for this problem:

  • Hochbaum and Shmoys (1987) gave the first PTAS, with running time (n/ε)O(1/ε2)(n/\varepsilon)^{O(1/\varepsilon^2)}(n/ε)O(1/ε2).
  • Alon, Azar, Woeginger and Yadid (1997/1998), and Hochbaum and Shmoys, obtained an EPTAS with running time 2(1/ε)poly(1/ε)+O(nlog⁡n)2^{(1/\varepsilon)^{\mathrm{poly}(1/\varepsilon)}} + O(n\log n)2(1/ε)poly(1/ε)+O(nlogn).
  • Jansen (2010) used the support bound of Eisenbrand and Shmonin (2006) to reach 2O((1/ε)2log⁡3(1/ε))+O(nlog⁡n)2^{O((1/\varepsilon)^2\log^3(1/\varepsilon))} + O(n\log n)2O((1/ε)2log3(1/ε))+O(nlogn).
  • Chen, Jansen and Zhang (2014) showed that, under the Exponential Time Hypothesis, no PTAS runs in time 2(1/ε)1−δpoly(n)2^{(1/\varepsilon)^{1-\delta}}\mathrm{poly}(n)2(1/ε)1−δpoly(n).
  • Jansen, Klein and Verschae (arXiv 2016; Mathematics of Operations Research 2020) reached 2O((1/ε)log⁡4(1/ε))+O(nlog⁡n)2^{O((1/\varepsilon)\log^4(1/\varepsilon))} + O(n\log n)2O((1/ε)log4(1/ε))+O(nlogn), matching that lower bound up to polylogarithmic factors in the exponent. Their key ingredient is a structural theorem on the configuration IP, which this mission formalizes.

Setting

Fix d∈Nd \in \mathbb{N}d∈N, a vector of job sizes π∈Z>0d\pi \in \mathbb{Z}^d_{>0}π∈Z>0d​ and a capacity T∈Z>0T \in \mathbb{Z}_{>0}T∈Z>0​. The knapsack polytope is P={c∈R≥0d:π⋅c≤T}\mathcal{P} = \{c \in \mathbb{R}^d_{\ge 0} : \pi\cdot c \le T\}P={c∈R≥0d​:π⋅c≤T}, and a configuration is an integral point of it:

Q=Zd∩P,c∈Q  ⟺  c∈Z≥0d,  ∑kπkck≤T.Q = \mathbb{Z}^d \cap \mathcal{P}, \qquad c \in Q \iff c \in \mathbb{Z}^d_{\ge 0},\ \ \sum_{k} \pi_k c_k \le T.Q=Zd∩P,c∈Q⟺c∈Z≥0d​,  k∑​πk​ck​≤T.

A configuration describes one machine: ckc_kck​ jobs of size πk\pi_kπk​, of total load at most TTT. The support of a vector is the set of its nonzero coordinates, supp⁡(c)={k:ck≠0}\operatorname{supp}(c) = \{k : c_k \ne 0\}supp(c)={k:ck​=0}. Throughout, log⁡=log⁡2\log = \log_2log=log2​. A configuration is simple if ∣supp⁡(c)∣≤log⁡(T+1)|\operatorname{supp}(c)| \le \log(T+1)∣supp(c)∣≤log(T+1) and complex otherwise; QcQ_cQc​ is the set of complex configurations.

Given the number bkb_kbk​ of jobs of each size and the number mmm of machines, the configuration IP [conf-IP] asks for multiplicities xc∈Z≥0x_c \in \mathbb{Z}_{\ge 0}xc​∈Z≥0​, one per configuration, with

∑c∈Qc xc=b,∑c∈Qxc=m.\sum_{c\in Q} c\, x_c = b, \qquad \sum_{c \in Q} x_c = m.c∈Q∑​cxc​=b,c∈Q∑​xc​=m.

Its LP relaxation [conf-LP] replaces xc∈Z≥0x_c \in \mathbb{Z}_{\ge 0}xc​∈Z≥0​ by xc≥0x_c \ge 0xc​≥0. The support of a solution is supp⁡(x)={c∈Q:xc≠0}\operatorname{supp}(x) = \{c \in Q : x_c \neq 0\}supp(x)={c∈Q:xc​=0}.

Formalization targets

Goal: thin solutions (Theorem 1)

If [conf-IP] is feasible, it has a feasible solution xxx with

xc>1⇒c simple,∣supp⁡(x)∣≤4(d+1)log⁡(4(d+1)T),∑c∈Qcxc≤2(d+1)log⁡(4(d+1)T).x_c > 1 \Rightarrow c \text{ simple}, \qquad |\operatorname{supp}(x)| \le 4(d+1)\log(4(d+1)T), \qquad \sum_{c\in Q_c} x_c \le 2(d+1)\log(4(d+1)T).xc​>1⇒c simple,∣supp(x)∣≤4(d+1)log(4(d+1)T),c∈Qc​∑​xc​≤2(d+1)log(4(d+1)T).

A solution with these three properties is called thin.

Milestones

  1. Lemma 2 (Eisenbrand–Shmonin): if ∣supp⁡(x)∣>2(d+1)log⁡(4(d+1)T)|\operatorname{supp}(x)| > 2(d+1)\log(4(d+1)T)∣supp(x)∣>2(d+1)log(4(d+1)T) for a nonnegative integer vector xxx on QQQ, there are disjoint nonempty A,B⊆supp⁡(x)A, B \subseteq \operatorname{supp}(x)A,B⊆supp(x) with ∑c∈Ac=∑c∈Bc\sum_{c \in A} c = \sum_{c\in B} c∑c∈A​c=∑c∈B​c and ∣A∣=∣B∣|A| = |B|∣A∣=∣B∣.
  2. Lemma 3 (Eisenbrand–Shmonin): a feasible [conf-IP] has a solution with ∣supp⁡(x)∣≤2(d+1)log⁡(4(d+1)T)|\operatorname{supp}(x)| \le 2(d+1)\log(4(d+1)T)∣supp(x)∣≤2(d+1)log(4(d+1)T).
  3. Lemma 4 (Sparsification Lemma): every complex c∈Qc \in Qc∈Q satisfies 2c=c1+c22c = c_1 + c_22c=c1​+c2​ for configurations c1,c2c_1, c_2c1​,c2​ with π⋅c1=π⋅c2=π⋅c\pi\cdot c_1 = \pi\cdot c_2 = \pi\cdot cπ⋅c1​=π⋅c2​=π⋅c and supp⁡(ci)⊊supp⁡(c)\operatorname{supp}(c_i) \subsetneq \operatorname{supp}(c)supp(ci​)⊊supp(c).
  4. P1: a feasible solution minimizing the potential Φ(x)=∑c complexxc∣supp⁡(c)∣\Phi(x) = \sum_{c \text{ complex}} x_c|\operatorname{supp}(c)|Φ(x)=∑c complex​xc​∣supp(c)∣ uses each complex configuration at most once.
  5. P2: such a solution has at most 2(d+1)log⁡(4(d+1)T)2(d+1)\log(4(d+1)T)2(d+1)log(4(d+1)T) complex configurations in its support.

Companion results

  • Corollary 5: every vertex of conv.hull⁡(Q)\operatorname{conv.hull}(Q)conv.hull(Q) is a simple configuration; and, from its proof, the number of simple configurations is at most (L+1)dL(T+1)L(L+1)d^{L}(T+1)^{L}(L+1)dL(T+1)L with L=log⁡(T+1)L = \log(T+1)L=log(T+1), for d≥1d \ge 1d≥1.
  • Corollary 6: a feasible [conf-LP] has a solution supported on simple configurations only.

Significance

The result. Theorem 1 says that, up to O(dlog⁡(dT))O(d\log(dT))O(dlog(dT)) machines, every feasible configuration IP can be solved using simple configurations only. There are 2O(log⁡2d+log⁡2T)2^{O(\log^2 d + \log^2 T)}2O(log2d+log2T) simple configurations, far fewer than configurations in general, so an algorithm can guess the support of a solution among a much smaller family. This is what yields the 2O((1/ε)log⁡4(1/ε))+O(nlog⁡n)2^{O((1/\varepsilon)\log^4(1/\varepsilon))} + O(n\log n)2O((1/ε)log4(1/ε))+O(nlogn) EPTAS for P∥Cmax⁡P\|C_{\max}P∥Cmax​, and through the same structure PTASs for Q∥Cmax⁡Q\|C_{\max}Q∥Cmax​ and for LpL_pLp​-norm and max–min objectives. Corollaries 5 and 6 are structural facts about knapsack polytopes in their own right: the integer hull has only simple vertices, and the configuration LP can be restricted to simple configurations.

Formalizing it. The results are proved in the paper; none of them has a machine-checked proof that this mission knows of. The development produces a reusable formal model of configurations and of the configuration IP and LP, a formal Eisenbrand–Shmonin support bound for this IP (a Carathéodory-type statement for integer cones that recurs across integer programming), and the sparsification lemma with its potential-function argument. The constants 4(d+1)4(d+1)4(d+1) and 2(d+1)2(d+1)2(d+1) are the paper's and are stated exactly.

Difficulty

The obvious argument applies the sparsification lemma repeatedly, replacing any complex configuration used twice by two configurations of smaller support, and then shrinks the support with the Eisenbrand–Shmonin exchange. The second step can undo the first: the exchange moves weight between configurations and may raise the multiplicity of a complex configuration above one again, so alternating the two steps has no evident termination measure. A proof has to control both properties at once. The counting behind the support bound needs the explicit inequality (sT+1)d+1<2s(sT+1)^{d+1} < 2^s(sT+1)d+1<2s for every s>2(d+1)log⁡(4(d+1)T)s > 2(d+1)\log(4(d+1)T)s>2(d+1)log(4(d+1)T), which must be carried out with the exact constants rather than up to O(⋅)O(\cdot)O(⋅).

Formalization scope

  • Configurations are functions Fin d → ℕ with ∑kπkck≤T\sum_k \pi_k c_k \le T∑k​πk​ck​≤T; solutions of [conf-IP] are finitely supported functions (Fin d → ℕ) →₀ ℕ vanishing outside QQQ, and solutions of [conf-LP] are finitely supported real-valued functions, nonnegative and vanishing outside QQQ.
  • The standing assumptions of §2 are binders of every statement: πk>0\pi_k > 0πk​>0 for all kkk and T>0T > 0T>0. Lemma 4 does not need T>0T > 0T>0 and omits it.
  • The paper writes b∈Rdb \in \mathbb{R}^db∈Rd for [conf-IP]; feasibility forces b∈Ndb \in \mathbb{N}^db∈Nd, so bbb and mmm are natural numbers. For [conf-LP] they are real.
  • log⁡\loglog is Real.logb 2 and every bound is a real inequality; no floor is taken.
  • In Lemma 2, MxA=MxBMx^A = Mx^BMxA=MxB is stated row by row: the sum of the configurations in AAA equals that in BBB, and ∣A∣=∣B∣|A| = |B|∣A∣=∣B∣.
  • "Minimum potential" in P1 and P2 means Φ(x)≤Φ(y)\Phi(x) \le \Phi(y)Φ(x)≤Φ(y) for every feasible solution yyy of the same instance.
  • A vertex of conv.hull⁡(Q)\operatorname{conv.hull}(Q)conv.hull(Q) is an extreme point (Mathlib's Set.extremePoints). The asymptotic count of Corollary 5 is replaced by the explicit bound of its proof, with the added hypothesis d≥1d \ge 1d≥1 (at d=0d = 0d=0 the explicit bound is 000 while Q={0}Q = \{0\}Q={0}).

The goal theorem refers only to [conf-IP], its solutions, supports and the simple/complex split; it does not mention the potential, the matrix MMM or a minimality assumption, so it cannot be discharged by choosing a special solution in the hypotheses.

Needed infrastructure: finite sums over Finsupp, the pigeonhole principle on finsets, elementary bounds on Real.logb, and, for Corollaries 5 and 6, convex hulls and extreme points of finite sets in Rd\mathbb{R}^dRd. The definitions of configurations and of the configuration IP/LP are reusable for other configuration-IP papers (bin packing, cutting stock, scheduling). Contributions of auxiliary lemmas on supports of integer conic combinations are welcome.

Selected references

  • K. Jansen, K.-M. Klein, J. Verschae, Closing the Gap for Makespan Scheduling via Sparsification Techniques, ICALP 2016; Mathematics of Operations Research, 2020. https://arxiv.org/abs/1604.07153 (version v1, the basis of every citation in this mission)
  • F. Eisenbrand, G. Shmonin, Carathéodory bounds for integer cones, Operations Research Letters 34, 564–568, 2006. https://doi.org/10.1016/j.orl.2005.09.008
  • K. Jansen, An EPTAS for scheduling jobs on uniform processors: using an MILP relaxation with a constant number of integral variables, SIAM Journal on Discrete Mathematics 24, 457–485, 2010.
  • N. Alon, Y. Azar, G. J. Woeginger, T. Yadid, Approximation schemes for scheduling on parallel machines, Journal of Scheduling 1, 55–66, 1998.
  • D. S. Hochbaum, D. B. Shmoys, Using dual approximation algorithms for scheduling problems: theoretical and practical results, Journal of the ACM 34, 144–162, 1987. https://doi.org/10.1145/7531.7535
  • L. Chen, K. Jansen, G. Zhang, On the optimality of approximation schemes for the classical scheduling problem, Proceedings of the 25th ACM-SIAM Symposium on Discrete Algorithms (SODA), 657–668, 2014.
7 thms1 active userReviewed
Algorithmic Game TheoryMechanism DesignProbability·Captain: mikedeng1

Approximate Revenue Maximization with Multiple Items 4: Bundling k ≥ 2 I.I.D. Goods Guarantees a Fraction c/log k of the Optimal RevenueResearch Paper

Motivation

A seller with several goods and a single buyer is the smallest setting in which multi-dimensional mechanism design differs from the one-good theory. For one good, Myerson's theorem (Myerson 1981) says the optimal mechanism posts a price. For two or more goods the optimal mechanism may use lotteries, may be non-monotone in the buyer's values, and is in general not known in closed form. Practitioners nevertheless use simple mechanisms, and the question that Hart and Nisan (arXiv:1204.1846v3) ask is quantitative: what fraction of the optimal revenue does a simple mechanism guarantee?

This mission concerns the simplest mechanism of all, bundling: one posted price for the set of all goods. When the goods are independent and identically distributed, bundling is known to become nearly optimal as the number of goods grows for a fixed distribution (Armstrong 1999; Bakos and Brynjolfsson 1999). That limit is not uniform over distributions. Theorem D of Hart and Nisan gives the uniform guarantee: for every k≥2k\ge2k≥2 and every distribution, bundling kkk i.i.d. goods earns at least c/log⁡kc/\log kc/logk of the optimal revenue.

Timeline. Armstrong (1999) and Bakos–Brynjolfsson (1999) proved the asymptotic optimality of bundling for a fixed distribution. Hart and Nisan circulated the first version of this paper in 2012 (EC 2012), proving Theorems A–D; the version formalized here is arXiv:1204.1846v3 (2017), published in J. Econ. Theory 172 (2017). Li and Yao (2013) later improved separate selling for i.i.d. goods to Θ(1/log⁡k)\Theta(1/\log k)Θ(1/logk), and Babaioff, Immorlica, Lucier and Weinberg (2014) showed that the better of separate selling and bundling is a constant-factor approximation for independent goods.

Setting

There are kkk goods and one buyer with additive valuation x=(x1,…,xk)∈R+kx=(x_1,\dots,x_k)\in\mathbb R_+^kx=(x1​,…,xk​)∈R+k​, drawn from a known distribution. A mechanism μ=(q,s)\mu=(q,s)μ=(q,s) assigns to every reported valuation xxx an allocation vector q(x)∈[0,1]kq(x)\in[0,1]^kq(x)∈[0,1]k (the probabilities of receiving each good) and a payment s(x)∈Rs(x)\in\mathbb Rs(x)∈R. The buyer's payoff is b(x)=q(x)⋅x−s(x)b(x)=q(x)\cdot x-s(x)b(x)=q(x)⋅x−s(x). The mechanism is incentive compatible (IC) if b(x)≥q(x~)⋅x−s(x~)b(x)\ge q(\tilde x)\cdot x-s(\tilde x)b(x)≥q(x~)⋅x−s(x~) for all x,x~x,\tilde xx,x~, and individually rational (IR) if b(x)≥0b(x)\ge0b(x)≥0 for all xxx. For a random valuation XXX, the expected revenue is R(μ;X)=E[s(X)]R(\mu;X)=\mathbb E[s(X)]R(μ;X)=E[s(X)] and the optimal revenue is

Rev(X)=sup⁡{R(μ;X): μ IC and IR}∈[0,∞].\mathrm{Rev}(X)=\sup\{R(\mu;X):\ \mu\text{ IC and IR}\}\in[0,\infty].Rev(X)=sup{R(μ;X): μ IC and IR}∈[0,∞].

For one good, Rev(X)=sup⁡p≥0p⋅P[X≥p]\mathrm{Rev}(X)=\sup_{p\ge0}p\cdot\mathbb P[X\ge p]Rev(X)=supp≥0​p⋅P[X≥p]. The bundled revenue is the one-good revenue of the total value, BRev(X)=Rev(X1+⋯+Xk)\mathrm{BRev}(X)=\mathrm{Rev}(X_1+\dots+X_k)BRev(X)=Rev(X1​+⋯+Xk​), and the separate revenue is SRev(X)=∑iRev(Xi)\mathrm{SRev}(X)=\sum_i\mathrm{Rev}(X_i)SRev(X)=∑i​Rev(Xi​).

"kkk i.i.d. goods" means that X1,…,XkX_1,\dots,X_kX1​,…,Xk​ are independent with a common law ν\nuν on R+\mathbb R_+R+​. Write Rk=Rev(X1,…,Xk)R_k=\mathrm{Rev}(X_1,\dots,X_k)Rk​=Rev(X1​,…,Xk​) and Bk=BRev(X1,…,Xk)B_k=\mathrm{BRev}(X_1,\dots,X_k)Bk​=BRev(X1​,…,Xk​).

Two auxiliary objects appear in the milestones. A real random variable XXX is stochastically dominated by YYY if P[X≥p]≤P[Y≥p]\mathbb P[X\ge p]\le\mathbb P[Y\ge p]P[X≥p]≤P[Y≥p] for every ppp. The equal-revenue (ER) law is that of V≥1V\ge1V≥1 with P[V≥p]=1/p\mathbb P[V\ge p]=1/pP[V≥p]=1/p for p≥1p\ge1p≥1. The constant w≈0.278w\approx0.278w≈0.278 is the unique real solution of w ew+1=1w\,e^{w+1}=1wew+1=1.

Formalization targets

Goal: Theorem D (p. 7)

∃ c>0  ∀k≥2  ∀ν:clog⁡k Rk≤Bk.\exists\,c>0\ \ \forall k\ge2\ \ \forall\nu:\qquad \frac{c}{\log k}\,R_k\le B_k .∃c>0  ∀k≥2  ∀ν:logkc​Rk​≤Bk​.

The constant is absolute: it is chosen before kkk and before the distribution. This is the statement as printed; it fixes neither the constant nor the base of the logarithm.

Explicit form (proof of Theorem D, p. 27)

Rk≤8(w+1)(log⁡2k+2) Bk(k≥2).R_k\le 8(w+1)(\log_2k+2)\,B_k\qquad(k\ge2).Rk​≤8(w+1)(log2​k+2)Bk​(k≥2).

Milestones

The milestones follow the paper's proof: Myerson's formula (1); monotonicity of one-good revenue under domination (Proposition 11); the ER characterization (Lemma 20) and the tail of a weighted sum of two ER goods (Lemma 21); BRev(V1,V2)=2(w+1)\mathrm{BRev}(V_1,V_2)=2(w+1)BRev(V1​,V2​)=2(w+1) (Proposition 24); SRev≥BRev/(w+1)\mathrm{SRev}\ge\mathrm{BRev}/(w+1)SRev≥BRev/(w+1) for two independent goods (Proposition 13 (i)); BRev≥SRev/4\mathrm{BRev}\ge\mathrm{SRev}/4BRev≥SRev/4 for i.i.d. goods (Proposition 14 (ii)); the decomposition Theorem 7; the power-of-two bound Rk≤4(log⁡2k+1)BkR_k\le4(\log_2k+1)B_kRk​≤4(log2​k+1)Bk​; monotonicity of RkR_kRk​ and BkB_kBk​ in kkk; and the explicit bound above.

Significance

Theorem D says that for identically distributed goods the gap between the simplest mechanism and the optimal one grows at most logarithmically in the number of goods, uniformly over all distributions, including heavy-tailed ones with infinite mean. The i.i.d. hypothesis is essential: for independent goods with different distributions bundling can recover only a 1/k1/k1/k fraction (Example 27 of the paper). Together with Theorem C (separate selling, c/log⁡2kc/\log^2kc/log2k) it places the two simple mechanisms on a common scale, and the decomposition Theorem 7 it rests on is a general tool for independent groups of goods.

The result is proved in the paper; no machine-checked version is known to exist. A formalization adds: a Lean model of multi-good mechanisms with IC, IR and expected revenue in the extended reals; a checked version of Myerson's one-good formula for arbitrary laws on R+\mathbb R_+R+​; the equal-revenue law and its two-good convolution; and a checked reduction from the decomposition theorem to the logarithmic bundling guarantee. Shorter arguments or a better constant are also welcome.

Difficulty

The obvious argument fails at the first step: revenue is not monotone in the valuation for two or more goods (Hart and Reny 2015), so one cannot bound RkR_kRk​ by replacing each good by a dominating ER good. Every comparison therefore has to pass through one-dimensional quantities, and the multi-good step (Theorem 7) is a statement about expectations of a mechanism's payments conditioned on an independent block of goods. Proposition 14 (ii) must handle distributions where no optimal one-good price exists and Rev(Xi)\mathrm{Rev}(X_i)Rev(Xi​) may be infinite (the paper's proof speaks of "an optimal price"). Proposition 24 is an exact evaluation whose answer is defined only implicitly, through w ew+1=1w\,e^{w+1}=1wew+1=1. The induction itself must track how block sums of i.i.d. goods are again i.i.d.

Formalization scope

Valuations are laws: a kkk-good random valuation is a probability measure on Fin k → ℝ≥0, and kkk i.i.d. goods with law ν\nuν form Measure.pi (fun _ : Fin k => ν). Two independent groups Y,ZY,ZY,Z have the product law on the disjoint union of their index types (jointLaw); the two-good statement Proposition 13 (i) uses this encoding on Unit ⊕ Unit. A mechanism is a pair of functions; the admissible class requires q∈[0,1]kq\in[0,1]^kq∈[0,1]k, IC, IR, and a measurable payment rule, the last being the without-loss-of-generality pin of the paper's footnote 12. The expected revenue of one mechanism is an EReal difference of two lower integrals, never a Bochner integral (which would be 000 for non-integrable payments). Rev\mathrm{Rev}Rev is a supremum in ℝ≥0∞, so infinite revenues are represented. www is a real parameter with the hypothesis w ew+1=1w\,e^{w+1}=1wew+1=1, not a Lambert-WWW value. Logarithms are natural in Theorem D and base 2 (Real.logb 2) in the proof's explicit bounds, as printed; every statement with a logarithm keeps k≥2k\ge2k≥2.

The paper states Theorem D as a lower bound on an infimum of ratios BRev/Rev\mathrm{BRev}/\mathrm{Rev}BRev/Rev; the formal goal is the multiplicative inequality, which agrees with it wherever the ratio is defined and requires BRev=∞\mathrm{BRev}=\inftyBRev=∞ when Rev=∞\mathrm{Rev}=\inftyRev=∞. A formalization in which ccc may depend on kkk or on the distribution, or in which Rev\mathrm{Rev}Rev is computed with a Bochner integral, would trivialize the statement and is ruled out by the binder order and the definitions above.

The definitions are a mission-local copy of the model shared by this series (missions 1–5), so they can be merged later. Not posed here: Theorem C, Proposition 25, Corollary 23, Lemma 22, Example 32, the GFOR notation, and the asymptotic optimality of bundling (Appendix A.5). Proofs of any milestone are welcome, as are reusable lemmas on posted prices, stochastic domination of sums of independent variables, and binomial medians.

Selected references

  • S. Hart and N. Nisan, Approximate Revenue Maximization with Multiple Items, J. Econ. Theory 172 (2017); preprint arXiv:1204.1846v3. https://arxiv.org/abs/1204.1846
  • R. Myerson, Optimal Auction Design, Math. Oper. Res. 6 (1981) 58–73. https://doi.org/10.1287/moor.6.1.58
  • M. Armstrong, Price Discrimination by a Many-Product Firm, Rev. Econ. Stud. 66 (1999) 151–168. https://doi.org/10.1111/1467-937X.00083
  • Y. Bakos and E. Brynjolfsson, Bundling Information Goods: Pricing, Profits, and Efficiency, Management Sci. 45 (1999) 1613–1630. https://doi.org/10.1287/mnsc.45.12.1613
  • S. Hart and P. Reny, Maximal Revenue with Multiple Goods: Nonmonotonicity and Other Observations, Theoretical Economics 10 (2015) 893–922. https://doi.org/10.3982/TE1517
  • X. Li and A. C.-C. Yao, On Revenue Maximization for Selling Multiple Independently Distributed Items, PNAS 110 (2013) 11232–11237. https://doi.org/10.1073/pnas.1309533110
  • M. Babaioff, N. Immorlica, B. Lucier and S. M. Weinberg, A Simple and Approximately Optimal Mechanism for an Additive Buyer, FOCS 2014. https://arxiv.org/abs/1405.6146
14 thms1 active userReviewed
Algorithmic Game TheoryMechanism DesignProbability·Captain: mikedeng1

Approximate Revenue Maximization with Multiple Items 6: With n Buyers and Dominant-Strategy Implementation, Selling Two Independent Goods Separately Earns at Least Half the Optimal RevenueResearch Paper

Motivation

A seller who owns several goods and faces buyers with private values must decide how to sell them. The revenue-maximizing mechanism is known in closed form only for one good: for a single buyer it is a posted price, and for several buyers it is Myerson's optimal auction (Myerson 1981). With two or more goods the optimal mechanism may use lotteries, may be impossible to describe compactly, and may behave non-monotonically in the value distribution. This makes simple mechanisms with provable revenue guarantees the practical question: how much of the optimal revenue does a seller lose by selling each good separately with its own optimal one-good mechanism?

Hart and Nisan (arXiv:1204.1846v3) answer this for one buyer and two independent goods (their Theorem A): selling separately earns at least half of the optimal revenue. Their Theorem 18 (p. 29), proved in Appendix A.7 as Theorems 33 and 34, extends the factor 12\tfrac1221​ to any number nnn of buyers. This mission formalizes the dominant-strategy half, Theorem 33, in which the buyers may be arbitrarily correlated with one another, as long as the two goods are independent.

Setting

One seller sells kkk goods to n≥1n \ge 1n≥1 buyers. Buyer jjj's value for good iii is a number xij≥0x^j_i \ge 0xij​≥0; a valuation profile is x=(xij)∈R+knx = (x^j_i) \in \mathbb R^{kn}_+x=(xij​)∈R+kn​, and xj=(xij)ix^j = (x^j_i)_ixj=(xij​)i​ is buyer jjj's valuation vector. The profile is random, XXX, with a commonly known joint law.

A mechanism μ=(qj,sj)j=1,…,n\mu = (q^j, s^j)_{j=1,\dots,n}μ=(qj,sj)j=1,…,n​ gives each buyer jjj an allocation qj(x)∈[0,1]kq^j(x) \in [0,1]^kqj(x)∈[0,1]k (the probability that jjj receives each good) and a payment sj(x)∈Rs^j(x) \in \mathbb Rsj(x)∈R, as functions of the reported profile, subject to feasibility: ∑jqij(x)≤1\sum_j q^j_i(x) \le 1∑j​qij​(x)≤1 for every good iii. Buyer jjj's payoff is bj(x)=qj(x)⋅xj−sj(x)b^j(x) = q^j(x)\cdot x^j - s^j(x)bj(x)=qj(x)⋅xj−sj(x), and the seller's revenue is S(x)=∑jsj(x)S(x) = \sum_j s^j(x)S(x)=∑j​sj(x).

  • IC-DS (dominant-strategy incentive compatibility): bj(x)≥qj(x~j,x−j)⋅xj−sj(x~j,x−j)b^j(x) \ge q^j(\tilde x^j, x^{-j})\cdot x^j - s^j(\tilde x^j, x^{-j})bj(x)≥qj(x~j,x−j)⋅xj−sj(x~j,x−j) for every buyer jjj, every profile xxx and every report x~j\tilde x^jx~j, where (x~j,x−j)(\tilde x^j, x^{-j})(x~j,x−j) replaces jjj's vector in xxx by x~j\tilde x^jx~j.
  • IR-DS: bj(x)≥0b^j(x) \ge 0bj(x)≥0 for every jjj and xxx.
  • NPT (no positive transfer): sj≥0s^j \ge 0sj≥0.

The expected revenue is R(μ;X)=E[S(X)]R(\mu; X) = \mathbb E[S(X)]R(μ;X)=E[S(X)], and

RevDS(X)=sup⁡{R(μ;X):μ feasible, IC-DS and IR-DS}∈[0,∞].\mathrm{Rev}^{DS}(X) = \sup\{R(\mu;X) : \mu \text{ feasible, IC-DS and IR-DS}\} \in [0, \infty].RevDS(X)=sup{R(μ;X):μ feasible, IC-DS and IR-DS}∈[0,∞].

For two goods write Y=X1=(X1j)jY = X_1 = (X^j_1)_jY=X1​=(X1j​)j​ and Z=X2=(X2j)jZ = X_2 = (X^j_2)_jZ=X2​=(X2j​)j​ for the vectors of the buyers' values for good 1 and good 2, so X=(Y,Z)X = (Y, Z)X=(Y,Z). RevDS(Y)\mathrm{Rev}^{DS}(Y)RevDS(Y) is the optimal dominant-strategy revenue from good 1 alone, sold to the same nnn buyers. Finally a(1)=max⁡jaja^{(1)} = \max_j a^ja(1)=maxj​aj.

Formalization targets

Goal: Theorem 33 (p. 49)

If YYY and ZZZ are independent, then

RevDS(X1)+RevDS(X2)≥12 RevDS(X1,X2).\mathrm{Rev}^{DS}(X_1) + \mathrm{Rev}^{DS}(X_2) \ge \tfrac12\,\mathrm{Rev}^{DS}(X_1, X_2).RevDS(X1​)+RevDS(X2​)≥21​RevDS(X1​,X2​).

No independence among buyers is assumed: the values Xi1,…,XinX^1_i, \dots, X^n_iXi1​,…,Xin​ for the same good may have any joint law.

Milestones (the steps of the paper's proof)

  1. Remark (b) of A.7 (p. 48): an IC-DS, IR-DS mechanism is NPT iff sj(0,x−j)=0s^j(0, x^{-j}) = 0sj(0,x−j)=0 for all jjj, x−jx^{-j}x−j, and NPT is without loss of generality for RevDS\mathrm{Rev}^{DS}RevDS.
  2. Remark (b), subdomain property (p. 48): E[∑jsj(X)1X∈A]≤RevDS(X1X∈A)≤RevDS(X)\mathbb E[\sum_j s^j(X)\mathbf 1_{X\in A}] \le \mathrm{Rev}^{DS}(X\mathbf 1_{X\in A}) \le \mathrm{Rev}^{DS}(X)E[∑j​sj(X)1X∈A​]≤RevDS(X1X∈A​)≤RevDS(X).
  3. Display (21) (p. 50): z(1) P[Y(1)≥z(1)]≤RevDS(Y)z^{(1)}\,\mathbb P[Y^{(1)} \ge z^{(1)}] \le \mathrm{Rev}^{DS}(Y)z(1)P[Y(1)≥z(1)]≤RevDS(Y).
  4. The marginal mechanism (p. 50): for fixed second-good values zzz, q^j(y)=q1j(y,z)\hat q^j(y) = q^j_1(y,z)q^​j(y)=q1j​(y,z), s^j(y)=sj(y,z)−q2j(y,z)zj\hat s^j(y) = s^j(y,z) - q^j_2(y,z)z^js^j(y)=sj(y,z)−q2j​(y,z)zj is feasible, IC-DS and IR-DS.
  5. Display (19) (p. 49): E[S(Y,Z)1Y(1)≥Z(1)]≤2 RevDS(Y)\mathbb E[S(Y,Z)\mathbf 1_{Y^{(1)} \ge Z^{(1)}}] \le 2\,\mathrm{Rev}^{DS}(Y)E[S(Y,Z)1Y(1)≥Z(1)​]≤2RevDS(Y) for an NPT, IC-DS, IR-DS mechanism.

Companion: Theorem 34 (p. 49)

With nnn independent buyers and two independent goods, so that all 2n2n2n values are independent (footnote 27), the same inequality holds for Bayesian Nash implementation: RevBN(X1)+RevBN(X2)≥12RevBN(X1,X2)\mathrm{Rev}^{BN}(X_1) + \mathrm{Rev}^{BN}(X_2) \ge \tfrac12\mathrm{Rev}^{BN}(X_1, X_2)RevBN(X1​)+RevBN(X2​)≥21​RevBN(X1​,X2​).

Significance

The result. Theorem 33 shows that the factor-12\tfrac1221​ guarantee of separate selling does not depend on there being a single buyer, nor on the buyers being independent, provided incentive compatibility is required in dominant strategies. It reduces a two-good, nnn-buyer design problem, whose optimum is not characterized, to two one-good problems, each of which can be handled by known single-good auction theory. Remark (a) on p. 29 records that the dominant-strategy statement holds for correlated buyers, while Remark (b) there explains, via Crémer and McLean (1988), why the Bayesian Nash analogue cannot be extended to correlated buyers.

Formalizing it. The result is proved in the paper; to our knowledge no machine-checked version exists. A formal proof requires multi-agent mechanisms on R+kn\mathbb R^{kn}_+R+kn​, the Lebesgue integral of a possibly non-integrable revenue, conditioning on an independent coordinate of a product law, and the subdomain property of Remark (b). The definitions here (feasible multi-buyer mechanisms, IC-DS, IR-DS, RevDS\mathrm{Rev}^{DS}RevDS, and the Bayesian Nash counterparts) are reusable for any multi-buyer revenue-maximization result.

Difficulty

The obvious first idea is to apply the one-buyer Theorem A buyer by buyer. It fails: the feasibility constraint ∑jqij≤1\sum_j q^j_i \le 1∑j​qij​≤1 couples the buyers, so a multi-buyer mechanism does not decompose into single-buyer mechanisms, and the revenue extracted from one buyer depends on the reports of all the others. Any reduction to one-good problems must produce, from a two-good mechanism, one-good mechanisms that remain feasible and dominant-strategy incentive compatible for every buyer at once. On the measure-theoretic side, payments of an incentive compatible mechanism may be negative and non-integrable, so expectations must be handled in the extended reals, and the passage from bounds that hold for each fixed value of one good to a bound in expectation needs the product structure of the law of (Y,Z)(Y, Z)(Y,Z).

Formalization scope

  • A profile is x : Fin n → ι → ℝ≥0 (x j i =xij= x^j_i=xij​); a random profile is given by its law, a probability measure on that space. One good is ι = Unit, two goods are ι = Fin 2 (good 1 is index 0). The law of two independent goods is twoGoodsN μY μZ, the image of the product law μY⊗μZ\mu_Y\otimes\mu_ZμY​⊗μZ​; μY and μZ are arbitrary probability laws on R+n\mathbb R^n_+R+n​, so correlation among buyers is allowed.
  • (x~j,x−j)(\tilde x^j, x^{-j})(x~j,x−j) is Function.update x j x'. Feasibility ∑jqij≤1\sum_j q^j_i \le 1∑j​qij​≤1 is part of admissibility; without it a mechanism could sell each good to every buyer.
  • Payments are required measurable (the paper's footnote 12). R(μ;X)R(\mu;X)R(μ;X) is the EReal difference of the integrals of S+S^+S+ and S−S^-S−, never a Bochner integral, which would vanish on non-integrable revenues. RevDS\mathrm{Rev}^{DS}RevDS takes values in [0,∞][0,\infty][0,∞].
  • The subdomain property requires the set AAA to be measurable, so that the law of X1X∈AX\mathbf 1_{X\in A}X1X∈A​ is defined. It also requires the signed expectation on AAA to be defined: at least one of its positive and negative part integrals must be finite. The hypothesis n≥1n \ge 1n≥1 is the paper's.
  • For Theorem 34, buyers are independent with laws ρj\rho_jρj​; interim payoffs integrate over the others' product law, and allocations as well as payments are required measurable.
  • The constant 12\tfrac1221​ is stated exactly as printed. A statement over an arbitrary joint law with given marginals, or with the feasibility constraint dropped, would be a different (and false, or trivial) theorem.

Contributions of every kind are welcome: proofs of the milestones, of Theorem 34, and general lemmas on multi-buyer mechanisms.

Selected references

  • S. Hart and N. Nisan, Approximate Revenue Maximization with Multiple Items, arXiv:1204.1846v3, 2017; J. Economic Theory 172 (2017). https://arxiv.org/abs/1204.1846
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6 (1981), 58–73. https://doi.org/10.1287/moor.6.1.58
  • J. Crémer and R. P. McLean, Full Extraction of the Surplus in Bayesian and Dominant Strategy Auctions, Econometrica 56 (1988), 1247–1257. https://doi.org/10.2307/1913096
  • S. Hart and P. J. Reny, Maximal Revenue with Multiple Goods: Nonmonotonicity and Other Observations, Theoretical Economics 10 (2015), 893–922. https://doi.org/10.3982/TE1517
8 thms1 active userReviewed
🏆Completed
Algorithmic Game Theory·Captain: mikedeng1

Potential Games Are Necessary to Ensure Pure Nash Equilibria in Cost Sharing Games 2: Generalized Weighted Shapley Value Rules Yield Generalized Weighted Potential GamesResearch Paper

Motivation

In a welfare sharing game, several players choose resources and receive shares of each resource's welfare. A rule for splitting welfare is useful only if the resulting players' incentives admit stable choices. The paper by Gopalakrishnan, Marden, and Wierman characterizes the distribution rules that guarantee a pure Nash equilibrium for every game formed from a specified class of local welfare functions. Its Appendix C supplies a complementary structural result: generalized weighted Shapley rules give the game a vector-valued potential. That structure provides a way to analyze equilibrium existence and dynamics without enumerating all possible unilateral deviations individually.

The scalar weighted-potential case was known for weighted Shapley values in the work of Hart and Mas-Colell, as Appendix C recounts. The 2014 paper extends the setting to an ordered system of priority blocks. A single scalar component cannot generally express the priority structure, so Appendix C uses a finite vector whose components are compared in order. This mission isolates that explicit potential theorem from the paper's separate characterization theorem.

Setting

Let N={1,…,n}N=\{1,\ldots,n\}N={1,…,n} be the players and R={r1,…,rm}R=\{r_1,\ldots,r_m\}R={r1​,…,rm​} the resources, with n,m>1n,m>1n,m>1. Player iii chooses an action ai∈Ai⊆2Ra_i\in\mathcal A_i\subseteq 2^Rai​∈Ai​⊆2R, possibly containing several resources. For a profile aaa, let {a}r={i∈N:r∈ai}\{a\}_r=\{i\in N:r\in a_i\}{a}r​={i∈N:r∈ai​} be the users of resource rrr. Each resource has a local welfare function Wr:2N→RW_r:2^N\to\mathbb RWr​:2N→R and a distribution rule fr(i,S)f^r(i,S)fr(i,S), giving player iii's share when the resource is used by coalition SSS. The game's utilities are separable:

Ui(a)=∑r∈aifr(i,{a}r).U_i(a)=\sum_{r\in a_i}f^r(i,\{a\}_r).Ui​(a)=r∈ai​∑​fr(i,{a}r​).

A weight system ω=(λ,Σ)\omega=(\lambda,\Sigma)ω=(λ,Σ) specifies positive weights λi\lambda_iλi​ and an ordered partition Σ=(S1,…,SK)\Sigma=(S_1,\ldots,S_K)Σ=(S1​,…,SK​) of the players. For a nonempty coalition TTT, let Tˉ\bar TTˉ be its members in the earliest block meeting TTT. The Möbius coefficient of a welfare function is

qTW=∑B⊆T(−1)∣T∣−∣B∣W(B).q_T^W=\sum_{B\subseteq T}(-1)^{|T|-|B|}W(B).qTW​=B⊆T∑​(−1)∣T∣−∣B∣W(B).

The generalized weighted Shapley value distributes the contribution of TTT among players in Tˉ\bar TTˉ in proportion to their weights. The generalized weighted marginal contribution rule instead evaluates the difference in a welfare function when a player is removed from the part of a coalition in that player's block and later blocks. These are the two formulas in Tables 1–2 of the source paper. The ground welfare functions used by the two rules, Wr′W'_rWr′​ and Wr′′W''_rWr′′​, may differ. Their coefficients are related by (12): qTWr′=(∑j∈Tˉλj)qTWr′′q_T^{W'_r}=(\sum_{j\in\bar T}\lambda_j)q_T^{W''_r}qTWr′​​=(∑j∈Tˉ​λj​)qTWr′′​​ for every nonempty TTT.

A generalized weighted potential is a vector Φ(a)∈RK\Phi(a)\in\mathbb R^KΦ(a)∈RK with a fixed component assigned to each player. For any unilateral change by that player, all earlier components stay equal, and the player's utility change equals a positive multiple of the change in the assigned component. This is the precise potential identity used in this mission.

Formalization targets

The local target is equation (83): local resource potentials whose changes agree with each player's utility share combine into a game-level potential. The coefficient target is the equality between the Table 1 marginal-contribution rule and its Table 2 Möbius-basis expansion. The closed-form target identifies exactly which vector component each player can change.

The goal is Theorem 3, using its closed form (85). Write Sˉb=S∖⋃ℓ<bSℓ\bar S_b=S\setminus\bigcup_{\ell<b}S_\ellSˉb​=S∖⋃ℓ<b​Sℓ​. If each frf^rfr is simultaneously the generalized weighted Shapley rule for Wr′W'_rWr′​ and the generalized weighted marginal contribution rule for Wr′′W''_rWr′′​, with their coefficients related by (12), then

Φ(a)=∑r∈Rϕr({a}r),(ϕr(S))k=Wr′′(SˉK−k+1)(1≤k≤K)\Phi(a)=\sum_{r\in R}\phi_r(\{a\}_r),\qquad (\phi_r(S))_k=W''_r(\bar S_{K-k+1})\quad(1\le k\le K)Φ(a)=r∈R∑​ϕr​({a}r​),(ϕr​(S))k​=Wr′′​(SˉK−k+1​)(1≤k≤K)

is a generalized weighted potential with player weights λ\lambdaλ. The goal specifies this potential itself, rather than merely asserting that some potential exists.

Significance

The theorem gives an explicit structural certificate for all games built from these sharing rules. A maximum of a vector potential in lexicographic order is stable against improving deviations, so the identity supports the equilibrium guarantee in the main characterization result. Its formula also gives a concrete object for studying changes in allocations or comparing priority systems; these are uses of the result, not additional claims of this mission. The closed form is particularly useful because each component is an evaluation of a ground welfare function on a specified suffix of the priority partition, as the paper explains on p. 11.

The mathematical result was proved in 2014. The remaining formalization work is to construct a machine-checked proof of the exact vector identity, including the coalition basis calculation and the passage from local resource changes to whole-game utility changes. The local platform index contains related scalar and ordinal potential theorems, but no declaration with this paper's priority-block model and closed-form vector potential.

Difficulty

The obvious scalar-potential analogy does not by itself track ordered priority classes. Adding a player in one class can leave some vector components unchanged while affecting a later component. The proof obligation therefore includes the exact component order and a player-specific change identity, uniformly over coalitions and actions. A second difficulty is reconciling two descriptions of the same distribution rule: Table 1 uses a welfare difference, while Table 2 expands welfare in Möbius coefficients over coalitions. The equality must hold even when the welfare at the empty coalition is arbitrary.

There is also a printed inconsistency. Definition 1 and (83) call the assigned component the “first nonzero” component, but the proof only establishes that earlier components are unchanged. The assigned component can also be unchanged on a particular deviation, while a later one changes. Formula (84) disagrees with the closed form (85) in a two-block example. The mission follows the fixed per-player component supported by the proof and states (85); the precise counterexample is in the moderation notes.

Formalization scope

Players and resources are represented by Fin n and Fin m, coalitions and actions by Finset, and real-valued welfare and utility functions by functions into R\mathbb RR. The standing model has n,m>1n,m>1n,m>1 and strictly positive player weights. The potential predicate requires K>0K>0K>0, matching Definition 1's positive vector dimension. The ordered partition is a map from players into KKK blocks; empty blocks are allowed, and Fin K provides zero-based indices. A vector component is indexed in reverse block order, so component 1 sees only the final block and component KKK sees the whole coalition. For a nonempty TTT, Tˉ\bar TTˉ is its earliest occupied block; its empty-case value is empty and is never used in (12).

Rules are compared only for players belonging to the coalition in which they are evaluated. The named Shapley and marginal rules return zero off that coalition; arbitrary input rules may have other unused values there. No budget-balance or W(∅)=0W(\varnothing)=0W(∅)=0 hypothesis is added; the empty-coalition value cancels in marginal differences. Action sets may be empty because this mission proves a potential identity for feasible deviations, without asserting that a feasible profile or equilibrium exists. The formalization does not replace the goal by a vacuous existence claim: it fixes the potential to the explicit closed form (85) and requires the full change identity at every feasible unilateral deviation.

The development needs finite-set sums, powersets, ordered finite indices, real arithmetic, and the paper-specific welfare rules. The local-to-global separability statement and finite coalition-basis calculation can be reused in related sharing games. Contributions proving the stated milestones, or strengthening the result under correctly stated extra assumptions, are in scope.

Selected references

  • R. Gopalakrishnan, J. R. Marden, and A. Wierman, Potential Games are Necessary to Ensure Pure Nash Equilibria in Cost Sharing Games, arXiv:1402.3610v1, 2014; published in Mathematics of Operations Research 39(4), 2014. Preprint; DOI.
7 thms1 active userReviewed
Algorithmic Game TheoryMechanism DesignProbability·Captain: mikedeng1

Approximate Revenue Maximization with Multiple Items 3: Selling k ≥ 2 Independent Goods Separately Guarantees a Fraction c/log² k of the Optimal RevenueResearch Paper

Motivation

A seller who knows the distributions of a buyer's values for several goods can, in principle, design a mechanism that offers lotteries and prices conditional on the buyer's reported values. Finding the best such mechanism can be difficult even with two goods. Separate selling is much simpler: choose a one-good price for each item and let the buyer decide item by item. The question is how much revenue this simplicity can cost when the goods' values are independent. Hart and Nisan establish a guarantee that declines only with the square of the logarithm of the number of goods, even though the distributions need not be identical or bounded. Their result is Theorem C of Approximate Revenue Maximization with Multiple Items, stated on p. 7 and proved on p. 26.

The paper grew from the problem of comparing easy selling formats with fully optimal mechanisms. For one good, a posted price characterizes optimal revenue. With multiple goods, the choice of a mechanism becomes genuinely multidimensional: its allocation rule can correlate the disposition of the goods and use lotteries. The guarantee in this mission applies uniformly over all independent distributions on nonnegative valuations, so a seller does not need a regularity, density, or finite-moment assumption to use it.

Setting

There is one seller, one risk-neutral buyer, and k≥2k\ge2k≥2 goods. The buyer's valuation vector is x=(xi)i=1k∈R+kx=(x_i)_{i=1}^k\in\mathbb R_+^kx=(xi​)i=1k​∈R+k​; receiving a set of goods gives the sum of the values of its members. The seller knows the joint law of the random vector XXX, but not its realization. In this mission the coordinates XiX_iXi​ are independent, with possibly different probability laws νi\nu_iνi​.

A direct mechanism consists of an allocation rule qi(x)∈[0,1]q_i(x)\in[0,1]qi​(x)∈[0,1] for each good and a real payment s(x)s(x)s(x). At a truthful report xxx, the buyer's payoff is b(x)=∑iqi(x)xi−s(x)b(x)=\sum_i q_i(x)x_i-s(x)b(x)=∑i​qi​(x)xi​−s(x). The mechanism is incentive compatible if truthful reporting is at least as good as every alternative report, and individually rational if b(x)≥0b(x)\ge0b(x)≥0 for every xxx. The seller's expected payment is its revenue. The optimal revenue Rev⁡(X)\operatorname{Rev}(X)Rev(X) is the supremum of revenue over such mechanisms. Payments are taken to be measurable, following footnote 12 on p. 12 of Hart and Nisan.

For one good, Rev⁡(Xi)\operatorname{Rev}(X_i)Rev(Xi​) equals the supremum of pPr⁡[Xi≥p]p\Pr[X_i\ge p]pPr[Xi​≥p] over prices p≥0p\ge0p≥0, as in display (1) on p. 12. The separate revenue is SRev⁡(X)=∑iRev⁡(Xi)\operatorname{SRev}(X)=\sum_i\operatorname{Rev}(X_i)SRev(X)=∑i​Rev(Xi​). The bundled revenue is BRev⁡(X)=Rev⁡(∑iXi)\operatorname{BRev}(X)=\operatorname{Rev}(\sum_i X_i)BRev(X)=Rev(∑i​Xi​), where the sum is treated as one good. Both formats are defined through one-good revenue, even when the full optimum can use multidimensional allocations.

Formalization targets

Theorem C: a uniform guarantee for separate selling

The goal is the inequality form of Theorem C, with one constant that works for every number and every family of independent goods:

∃c>0  ∀k≥2  ∀(νi)i=1k,SRev⁡(X1,…,Xk)≥c(log⁡k)2Rev⁡(X1,…,Xk).\exists c>0\;\forall k\ge2\;\forall (\nu_i)_{i=1}^k,\qquad \operatorname{SRev}(X_1,\ldots,X_k) \ge \frac{c}{(\log k)^2}\operatorname{Rev}(X_1,\ldots,X_k).∃c>0∀k≥2∀(νi​)i=1k​,SRev(X1​,…,Xk​)≥(logk)2c​Rev(X1​,…,Xk​).

Here XiX_iXi​ has law νi\nu_iνi​, and the joint law is their product. The paper phrases the headline as a guarantee for an approximation ratio; the displayed inequality is the form used in its proof on p. 26. It handles zero and infinite optimal revenues without introducing a ratio with an undefined denominator.

Supporting targets

The milestone list records the one-good posted-price formula, monotonicity under first-order stochastic domination, the equal-revenue comparison of Lemma 20, Proposition 13(ii)'s comparison of separate and bundled revenue, the two inequalities of Theorem 7, and the two-good base case of Theorem A. It also records the power-of-two estimate and the zero-padding assertion stated in the proof of Theorem C. Each milestone is attached to its source page in the pinned preprint.

Significance

The theorem gives a distribution-independent performance floor for a mechanism that can be run using one price per good. It applies to unequal and unbounded independent distributions, for which expected values can be infinite while one-good optimal revenues remain finite. The comparison is with the best incentive-compatible and individually rational multi-good mechanism, including randomized allocations, rather than with another simple selling format. The result is proved in the 2017 preprint; the open work here is a machine-checked formalization of that known result and its selected supporting statements.

The formal development also supplies reusable objects: a law-based direct-mechanism model, extended-real expected revenue, product laws for independent groups of goods, and first-order stochastic domination of one-good laws. These are useful for other comparisons among separate selling, bundling, and optimal mechanisms in the same paper. The mission does not pose the paper's distinct i.i.d. bundling theorem, multi-buyer results, or tightness examples.

Difficulty

The main obstacle is that optimal multi-good revenue is not monotone in the values of the goods. Increasing each coordinate of a valuation vector does not, by itself, give a valid comparison between the optimal revenues of the two vectors' laws; Hart and Nisan, p. 23 explicitly warn against that inference. One-good revenue does have the needed monotonicity, but the full optimum can depend on how the goods interact in an incentive-compatible mechanism. Theorem 7 is a substantive bridge between these two regimes. Infinite expected values also make a real-valued integral or an ordinary ratio unsuitable for the general statement.

Formalization scope

Goods are indexed by finite types, and valuations lie in R≥0k\mathbb R_{\ge0}^kR≥0k​. Each good's law is a probability measure; independence means the product law, while Theorem 7 allows dependence among coordinates within each of its two independent groups. A one-good law is represented by a singleton coordinate type. Revenue takes values in R≥0∪{∞}\mathbb R_{\ge0}\cup\{\infty\}R≥0​∪{∞}, and the expectation of a mechanism's possibly negative payment is represented in extended reals. The supremum defining optimal revenue ranges only over feasible, incentive-compatible, individually rational mechanisms with measurable payments. Theorem C quantifies ccc before kkk and the laws, and the restriction k≥2k\ge2k≥2 keeps the logarithmic coefficient in its stated domain.

The equal-revenue law is represented by the density x−2x^{-2}x−2 on [1,∞)[1,\infty)[1,∞), mapped to nonnegative reals. First-order stochastic domination compares the upper-tail probabilities at nonnegative thresholds, which is equivalent to testing every real threshold for nonnegative valuations. A complete proof will need measure-theoretic facts about that law, the posted-price characterization, product measures, and operations on extended nonnegative revenue. Contributions to those reusable facts and to the selected milestone theorems are within scope.

Selected references

  • Sergiu Hart and Noam Nisan, Approximate Revenue Maximization with Multiple Items, arXiv:1204.1846v3, 2017. Preprint.
10 thms1 active userReviewed
Algorithmic Game Theory·Captain: mikedeng1

Potential Games Are Necessary to Ensure Pure Nash Equilibria in Cost Sharing Games 1: Every Game Has a Pure Nash Equilibrium Iff the Distribution Rules Are Generalized Weighted Shapley ValuesResearch Paper

Motivation

In a cost sharing game (or, symmetrically, a revenue sharing game) self-interested players each pick a set of resources, every resource generates a welfare that depends on who uses it, and a distribution rule splits that welfare among the users. Network formation, atomic routing, coverage and distributed-control problems all fit this model (Anshelevich et al. 2004; Marden and Wierman, Distributed welfare games, 2013; see §2 of the paper). The designer controls only the distribution rule, and the first requirement on a rule is that the games it induces have a pure Nash equilibrium; without one, equilibrium-based efficiency guarantees say nothing.

Which rules guarantee equilibria? The Shapley value and its weighted and generalized-weighted versions do, because they induce potential games (Hart and Mas-Colell 1989). Chen, Roughgarden and Valiant (2010) and Marden and Wierman (Overcoming the limitations of utility design for multiagent systems, 2013) showed that, among budget-balanced rules, these are the only ones that work for every welfare function, by exhibiting one worst-case welfare function (Proposition 1 of the paper, p. 9). Marden and Wierman (Distributed welfare games) also showed that when players may choose only one resource, other budget-balanced rules can work. That left open what happens when the designer knows the welfare functions in advance, and whether dropping budget-balance enlarges the set of good rules. Gopalakrishnan, Marden and Wierman 2014 answered both questions: for any fixed set of welfare functions, with or without budget-balance, the equilibrium-guaranteeing rules are exactly generalized weighted Shapley values on suitable ground welfare functions.

Setting

Players are N={1,…,n}N=\{1,\dots,n\}N={1,…,n} with n>1n>1n>1; resources are R={r1,…,rm}R=\{r_1,\dots,r_m\}R={r1​,…,rm​} with m>1m>1m>1. A local welfare function is W:2N→RW:2^N\to\mathbb RW:2N→R and a distribution rule is f:N×2N→Rf:N\times2^N\to\mathbb Rf:N×2N→R, where f(i,S)f(i,S)f(i,S) is the share of player iii when sharing with the coalition SSS (and f(i,S)=0f(i,S)=0f(i,S)=0 for i∉Si\notin Si∈/S). Each player iii has a nonempty action set Ai⊆2R\mathcal A_i\subseteq 2^RAi​⊆2R. In an allocation aaa, the users of rrr are {a}r={i:r∈ai}\{a\}_r=\{i:r\in a_i\}{a}r​={i:r∈ai​} and player iii receives

Ui(a)=∑r∈aifWr(i,{a}r).U_i(a)=\sum_{r\in a_i}f^{W_r}\bigl(i,\{a\}_r\bigr).Ui​(a)=r∈ai​∑​fWr​(i,{a}r​).

Resources with equal welfare functions use the same rule. For a nonempty set W\mathbb WW of welfare functions, G(N,fW,W)\mathcal G(N,f^{\mathbb W},\mathbb W)G(N,fW,W) is the class of all such games with every Wr∈WW_r\in\mathbb WWr​∈W, any number of resources and any action sets. A rule is budget-balanced for WWW if ∑i∈Sf(i,S)=W(S)\sum_{i\in S}f(i,S)=W(S)∑i∈S​f(i,S)=W(S).

A weight system ω=(λ,Σ)\omega=(\lambda,\Sigma)ω=(λ,Σ) consists of positive weights λi\lambda_iλi​ and an ordered partition Σ=(S1,…,SK)\Sigma=(S_1,\dots,S_K)Σ=(S1​,…,SK​) of NNN into priority classes. For nonempty TTT, T‾=T∩Sk\overline T=T\cap S_kT=T∩Sk​ with kkk the first class meeting TTT. With the basis coefficients qTW=∑R⊆T(−1)∣T∣−∣R∣W(R)q^W_T=\sum_{R\subseteq T}(-1)^{|T|-|R|}W(R)qTW​=∑R⊆T​(−1)∣T∣−∣R∣W(R), the generalized weighted Shapley value is

fGWSVW[ω](i,S)=∑T⊆S: i∈T‾λi∑j∈T‾λj qTW.f^W_{GWSV}[\omega](i,S)=\sum_{T\subseteq S:\,i\in\overline T}\frac{\lambda_i}{\sum_{j\in\overline T}\lambda_j}\,q^W_T .fGWSVW​[ω](i,S)=T⊆S:i∈T∑​∑j∈T​λj​λi​​qTW​.

The distributed welfare of a rule is W′(S)=∑i∈SfW(i,S)W'(S)=\sum_{i\in S}f^W(i,S)W′(S)=∑i∈S​fW(i,S), display (10).

Formalization targets

Goal: Theorem 1

all games in G(N,fW,W) have a pure Nash equilibrium  ⟺  ∃ ω ∀W∈W: fW=fGWSVW′[ω] on {(i,S):i∈S},\text{all games in }\mathcal G(N,f^{\mathbb W},\mathbb W)\text{ have a pure Nash equilibrium}\iff\exists\,\omega\ \forall W\in\mathbb W:\ f^W=f^{W'}_{GWSV}[\omega]\text{ on }\{(i,S):i\in S\},all games in G(N,fW,W) have a pure Nash equilibrium⟺∃ω ∀W∈W: fW=fGWSVW′​[ω] on {(i,S):i∈S},

with W′W'W′ the distributed welfare of fWf^WfW. One weight system serves all of W\mathbb WW.

Milestones

The "if" direction (Appendix A, p. 16). For a single WWW and a budget-balanced fff guaranteeing equilibria: f(i,S)=0f(i,S)=0f(i,S)=0 when SSS contains no contributing coalition (Lemma 1) and for non-contributing iii (Lemma 2); f(i,S)=f(i,N(S))f(i,S)=f(i,N(S))f(i,S)=f(i,N(S)) (Lemma 3). The basis rules fTf^TfT of the recursion (27) are budget-balanced for the inclusion functions (Lemma 5), recover f=∑TqTfTf=\sum_Tq_Tf^Tf=∑T​qT​fT (Lemma 7), obey an inclusion–exclusion principle (Corollary 1), and are generalized weighted Shapley basis rules fGWSVT[ωT]f^T_{GWSV}[\omega^T]fGWSVT​[ωT] (Lemma 8). Across welfare functions the basis shares are consistent pairwise (Lemma 9) and around cycles (Lemma 10); the induced relation on players is a partial order modulo equivalence (Lemma 11), and one universal weight system replaces all ωW,T\omega^{W,T}ωW,T (Lemma 13).

Companions

Proposition 2: for welfare functions normalized by W′(∅)=W′′(∅)=0W'(\emptyset)=W''(\emptyset)=0W′(∅)=W′′(∅)=0, fGWSVW′[ω]=fGWMCW′′[ω]f^{W'}_{GWSV}[\omega]=f^{W''}_{GWMC}[\omega]fGWSVW′​[ω]=fGWMCW′′​[ω] iff T′=T′′\mathcal T'=\mathcal T''T′=T′′ and qT′=(∑j∈T‾λj)qT′′q'_T=(\sum_{j\in\overline T}\lambda_j)q''_TqT′​=(∑j∈T​λj​)qT′′​. Theorem 2: the same characterization with generalized weighted marginal contributions on W′′=h(W′)W''=h(W')W′′=h(W′).

Significance

The theorem settles the design space completely: a designer who wants equilibria in every game over known welfare functions must use a generalized weighted Shapley value, and the only freedom is the weight system and the ground welfare functions, which control budget-balance. Since these rules induce (generalized weighted) potential games, potential games are necessary for guaranteed equilibrium existence in this model, and computing shares inherits the exponential cost of Shapley values. Theorem 2 gives the marginal-contribution form, which needs one marginal contribution per share.

The paper proves Theorem 1 with a full appendix of counterexample constructions; none of it has a published machine-checked proof. The mission asks for a Lean proof of the characterization, of the reusable structure behind it (necessary conditions, basis decomposition, inclusion–exclusion for basis rules, consistency of weight systems), and of the Shapley–marginal-contribution correspondence.

Difficulty

The "if" direction is a potential argument. The "only if" direction is not: every necessary condition is proved by building, from a hypothetical violation, a specific game with no equilibrium, and the games grow more elaborate as the conditions do. Lemma 8 needs the inclusion–exclusion principle to isolate a single basis share, using many weighted copies of resources; Lemma 10's proof combines best-response cycles over kkk welfare functions and is partly omitted on the page ("We omit the proof for brevity", p. 51), so it is the hardest milestone. A tempting shortcut, applying the worst-case result of Chen et al. and Marden–Wierman (Proposition 1, p. 9), fails: it uses one worst-case welfare function, while here W\mathbb WW is arbitrary and may not contain it.

Formalization scope

Players are Fin n, resources Fin m, an action is a Finset (Fin m) (the empty action is allowed). The family of rules is one function f : Welfare n → Rule n, which encodes that equal welfare functions get equal rules. GuaranteesPNE 𝕎 f quantifies over every m > 1, every assignment Fin m → 𝕎 (repetitions allowed: the counterexamples rely on many copies of one welfare function) and every family of nonempty action sets. A weight system stores a block index Fin K per player (empty blocks allowed) and positive weights. Rules are compared only at i∈Si\in Si∈S. Contributing coalitions exclude ∅\emptyset∅ (Appendix A's normalization W(∅)=0W(\emptyset)=0W(∅)=0). The recursion (27) divides by qTq_TqT​ and is used only for contributing TTT; where it reads f(i,T)f(i,T)f(i,T) with i∉Ti\notin Ti∈/T, the paper's convention f(i,S)=0f(i,S)=0f(i,S)=0 off SSS is a hypothesis.

The ground welfare in Theorem 1 is the distributed welfare (10), written out, never an arbitrary function: an existentially quantified ground welfare would make the right side easier and the theorem a different one. The weight system is quantified before the welfare functions, and empty action sets are excluded; with them no game would have an equilibrium and the theorem would claim that no rule is a Shapley value.

Disclosed readings: Lemma 11's "partial order" is antisymmetry modulo the equivalence =Ω+=^+_\Omega=Ω+​, as the proof states; in (74) the first block S1W,TS_1^{W,T}S1W,T​ is read on TTT as its positive-share block T‾\overline TT. Proposition 2 carries W′(∅)=W′′(∅)=0W'(\emptyset)=W''(\emptyset)=0W′(∅)=W′′(∅)=0 so that the paper's basis support, which ranges over all coalitions, agrees with the local support of nonempty coalitions.

A complete development needs: finite games and pure equilibria on resource-selection models, Möbius inversion on Finset lattices, the potential argument for generalized weighted Shapley values (shared with the companion mission on generalized weighted potential games), and counterexample games built from copies of resources. The game model and the basis-rule recursion are reusable for other cost-sharing results. Proofs of any milestone, and alternative arguments for the necessary conditions, are welcome.

Selected references

  • R. Gopalakrishnan, J. R. Marden, A. Wierman, Potential Games are Necessary to Ensure Pure Nash Equilibria in Cost Sharing Games, Math. Oper. Res. 39(4), 2014; preprint arXiv:1402.3610v1, 2014. https://arxiv.org/abs/1402.3610v1
  • S. Hart, A. Mas-Colell, Potential, Value, and Consistency, Econometrica 57(3), 589–614, 1989. https://doi.org/10.2307/1911054
  • H.-L. Chen, T. Roughgarden, G. Valiant, Designing Network Protocols for Good Equilibria, SIAM J. Comput. 39(5), 1799–1832, 2010 (reference [8] of arXiv:1402.3610v1).
  • J. R. Marden, A. Wierman, Overcoming the Limitations of Utility Design for Multiagent Systems, IEEE Trans. Autom. Control, 2013 (reference [30] of arXiv:1402.3610v1).
  • J. R. Marden, A. Wierman, Distributed Welfare Games, Oper. Res., 2013 (reference [29] of arXiv:1402.3610v1).
  • E. Anshelevich, A. Dasgupta, J. Kleinberg, É. Tardos, T. Wexler, T. Roughgarden, The Price of Stability for Network Design with Fair Cost Allocation, FOCS 2004, 295–304 (reference [3] of arXiv:1402.3610v1).
  • L. S. Shapley, A Value for n-Person Games, Contributions to the Theory of Games II, Princeton University Press, 1953 (reference [43] of arXiv:1402.3610v1).
16 thms1 active userReviewed
Algorithmic Game TheoryMechanism DesignProbability·Captain: mikedeng1

Approximate Revenue Maximization with Multiple Items 5: Bundling Is Optimal for Two I.I.D. Goods Whose Density on [a, ∞) Satisfies x f′(x) + (3/2) f(x) ≤ 0Research Paper

Motivation

A seller with several goods and a single buyer of unknown, additive valuation faces the multi-dimensional revenue maximization problem. For one good the answer is classical: by Myerson's theorem (Myerson 1981) a single posted price is optimal. For two or more goods no such simplification exists in general: optimal mechanisms may randomize, may offer menus of lotteries, and are rarely known in closed form. Selling the grand bundle at one price is the simplest multi-good mechanism, and it is used widely in practice.

Hart and Nisan (arXiv:1204.1846, J. Econ. Theory 2017) quantify how much revenue simple mechanisms lose. Most of their results are approximation bounds. Section 7.2 of the paper also contains an exact result: for two independent and identically distributed goods whose density decays fast enough, in the sense of a differential inequality, bundling is exactly optimal. This mission formalizes that theorem, Theorem 16, and the steps of its proof in Appendix A.6.

Timeline. Manelli and Vincent (2006) gave conditions under which a bundled mechanism is optimal for a multiple-good monopolist. Hart and Nisan's preprint (2012, revised 2017) proved Theorem 16 with the condition xf′(x)+32f(x)≤0x f'(x) + \tfrac32 f(x) \le 0xf′(x)+23​f(x)≤0. Daskalakis, Deckelbaum and Tzamos (2017) later gave a strong duality theory for the multiple-good monopolist, based on optimal transport.

Setting

There are two goods and one buyer. A valuation is a vector x=(y,z)∈R+2x = (y, z) \in \mathbb{R}^2_+x=(y,z)∈R+2​. The buyer's values Y,ZY, ZY,Z are i.i.d. with a one-good law FFF on R+\mathbb{R}_+R+​.

A mechanism μ=(q,s)\mu = (q, s)μ=(q,s) assigns to each reported valuation xxx an allocation vector q(x)∈[0,1]2q(x) \in [0,1]^2q(x)∈[0,1]2 (qi(x)q_i(x)qi​(x) is the probability that good iii is sold) and a payment s(x)∈Rs(x) \in \mathbb{R}s(x)∈R. The buyer's payoff is b(x)=q(x)⋅x−s(x)b(x) = q(x)\cdot x - s(x)b(x)=q(x)⋅x−s(x). The mechanism is

  • incentive compatible (IC) if b(x)≥q(x~)⋅x−s(x~)b(x) \ge q(\tilde x)\cdot x - s(\tilde x)b(x)≥q(x~)⋅x−s(x~) for all x,x~∈R+2x, \tilde x \in \mathbb{R}^2_+x,x~∈R+2​;
  • individually rational (IR) if b(x)≥0b(x) \ge 0b(x)≥0 for all xxx;
  • NPT (no positive transfer) if s≥0s \ge 0s≥0.

The revenue of μ\muμ is R(μ;X)=E[s(X)]R(\mu; X) = \mathbb{E}[s(X)]R(μ;X)=E[s(X)], and the optimal revenue is Rev(X)=sup⁡R(μ;X)\mathrm{Rev}(X) = \sup R(\mu; X)Rev(X)=supR(μ;X) over all IC and IR mechanisms. The bundled revenue is BRev(X)=Rev(Y+Z)\mathrm{BRev}(X) = \mathrm{Rev}(Y + Z)BRev(X)=Rev(Y+Z), the optimal revenue from selling the bundle as a single good.

A two-good mechanism is symmetric if q1(y,z)=q2(z,y)q_1(y,z) = q_2(z,y)q1​(y,z)=q2​(z,y) and s(y,z)=s(z,y)s(y,z) = s(z,y)s(y,z)=s(z,y). For a level a≥0a \ge 0a≥0, the bundled majorant μ^=(q^,s^)\hat\mu = (\hat q, \hat s)μ^​=(q^​,s^) of μ\muμ is

q^(y,z)=(q1(y+z−a,a), q1(y+z−a,a)),s^(y,z)=q^(y,z)⋅(y,z)−b(y+z−a,a).\hat q(y,z) = \bigl(q_1(y+z-a, a),\ q_1(y+z-a, a)\bigr), \qquad \hat s(y,z) = \hat q(y,z)\cdot(y,z) - b(y+z-a, a).q^​(y,z)=(q1​(y+z−a,a), q1​(y+z−a,a)),s^(y,z)=q^​(y,z)⋅(y,z)−b(y+z−a,a).

It depends on (y,z)(y,z)(y,z) only through y+zy + zy+z, so it is a bundled mechanism.

Formalization targets

Goal: Theorem 16

Let a>0a > 0a>0 and let FFF have a density fff supported in [a,∞)[a, \infty)[a,∞), differentiable on (a,∞)(a,\infty)(a,∞), with

xf′(x)+32f(x)≤0(x>a).(9)x f'(x) + \tfrac32 f(x) \le 0 \qquad (x > a). \tag{9}xf′(x)+23​f(x)≤0(x>a).(9)

Then for two i.i.d.-FFF goods,

Rev(X1,X2)=BRev(X1,X2)=Rev(X1+X2).\mathrm{Rev}(X_1, X_2) = \mathrm{BRev}(X_1, X_2) = \mathrm{Rev}(X_1 + X_2).Rev(X1​,X2​)=BRev(X1​,X2​)=Rev(X1​+X2​).

The substance is Rev≤BRev\mathrm{Rev} \le \mathrm{BRev}Rev≤BRev. The reverse inequality holds for every law, and the second equality is the definition of BRev\mathrm{BRev}BRev.

Milestones

  1. Proposition 5 (at least one good): IC holds if and only if bbb is convex and q(x)q(x)q(x) is a subgradient of bbb at every xxx.
  2. Proposition 6 (iii) (at least one good): the supremum defining Rev\mathrm{Rev}Rev may be restricted to NPT mechanisms.
  3. Symmetrization (p. 32): for i.i.d. goods, the symmetrization μˉ\bar\muμˉ​ is IC, IR, NPT and symmetric, and it has the same revenue.
  4. Display (18): for symmetric IC μ\muμ and y,z≥ay, z \ge ay,z≥a, b(y,z)≤b(y+z−a,a)b(y,z) \le b(y+z-a, a)b(y,z)≤b(y+z−a,a).
  5. μ^\hat\muμ^​ is feasible, IC and IR on the quadrant [a,∞)2[a,\infty)^2[a,∞)2, and bundled.
  6. Under (9), R(μ;X)≤R(μ^;X)R(\mu; X) \le R(\hat\mu; X)R(μ;X)≤R(μ^​;X) for symmetric IC, IR and NPT μ\muμ.

Companion: Corollary 17

For two i.i.d. goods with the equal-revenue law P[V≥p]=1/p\mathbb{P}[V \ge p] = 1/pP[V≥p]=1/p (p≥1p \ge 1p≥1),

Rev(V1,V2)=BRev(V1,V2)=2(w+1)≈2.56,\mathrm{Rev}(V_1,V_2) = \mathrm{BRev}(V_1,V_2) = 2(w+1) \approx 2.56,Rev(V1​,V2​)=BRev(V1​,V2​)=2(w+1)≈2.56,

where wew+1=1w e^{w+1} = 1wew+1=1.

Significance

Theorem 16 is one of the few closed-form optimality results for multi-good monopoly. It gives an explicit, checkable condition: x3/2f(x)x^{3/2} f(x)x3/2f(x) is nonincreasing. The condition covers the equal-revenue distribution and Pareto distributions with index α≥1/2\alpha \ge 1/2α≥1/2. On these distributions the optimal revenue reduces to a one-dimensional pricing problem for Y+ZY + ZY+Z. Corollary 17 is the resulting exact value for two equal-revenue goods. Elsewhere in the paper, Theorems C and D use the equal-revenue law as the extremal example for the approximation ratios.

The theorem is proved in the paper. As far as is known it has not been machine-checked. The mission formalizes the model and every step of the proof as a separate milestone. These steps are Rochet's characterization (Proposition 5), the NPT reduction, symmetrization, the convexity majorization (18), and the revenue comparison under (9). Propositions 5 and 6 (iii) and symmetrization are shared with other missions of this series, so they are reusable beyond Theorem 16.

Difficulty

The obvious approach is to show that the optimal mechanism is bundled by exhibiting it. This fails because nothing is known about the optimal mechanism, and it need not exist. The proof instead compares an arbitrary symmetric mechanism with its bundled majorant μ^\hat\muμ^​. A pointwise comparison fails: b^≥b\hat b \ge bb^≥b does not imply s^≥s\hat s \ge ss^≥s. The comparison holds only in expectation and only for densities satisfying (9); without (9) bundling is not optimal in general.

Making this rigorous requires several things:

  • the a.e. differentiability of the convex function bbb, together with q1=∂b/∂yq_1 = \partial b/\partial yq1​=∂b/∂y a.e.;
  • integration by parts on truncated squares [a,M]2[a, M]^2[a,M]2 with possibly infinite total revenue;
  • control of the boundary term at y=ay = ay=a, where fff need not be bounded or continuous;
  • the extension of μ^\hat\muμ^​, defined on [a,∞)2[a,\infty)^2[a,∞)2, to an IC and IR mechanism on all of R+2\mathbb{R}^2_+R+2​.

Formalization scope

Valuations are functions Fin 2→R≥0\mathrm{Fin}\ 2 \to \mathbb{R}_{\ge 0}Fin 2→R≥0​, and random valuations are given by their laws. "Two i.i.d. goods" is the product measure ν⊗ν\nu \otimes \nuν⊗ν. The law ν\nuν is the image on R≥0\mathbb{R}_{\ge0}R≥0​ of f(x) dxf(x)\,dxf(x)dx, so no mass is lost because f=0f = 0f=0 below a>0a > 0a>0. "Density function" means: fff measurable, f≥0f \ge 0f≥0, ∫f=1\int f = 1∫f=1, and f=0f = 0f=0 on (−∞,a)(-\infty, a)(−∞,a). Continuity of FFF is then automatic. Differentiability of fff is required at every x>ax > ax>a, the range of (9). Nothing is assumed about fff at aaa; in particular fff may blow up there.

Admissible mechanisms are feasible, IC, IR and have a measurable payment function. The paper allows measurability without loss of generality (footnote 12). Revenue R(μ;X)R(\mu;X)R(μ;X) is an extended real, so a non-integrable payment never collapses to 000. Rev\mathrm{Rev}Rev takes values in [0,∞][0,\infty][0,∞] and may be infinite under (9), for instance for f(x)=c x−3/2f(x) = c\,x^{-3/2}f(x)=cx−3/2 on [a,∞)[a,\infty)[a,∞). Milestone 5 states IC and IR of μ^\hat\muμ^​ on the quadrant only, as the paper defines μ^\hat\muμ^​ there. Off the quadrant, y+z−ay + z - ay+z−a is truncated at 000.

The goal must not be stated as the second equality alone, which is definitional. Nor may it assume the law is bounded or that f(a)f(a)f(a) is finite: these would replace the theorem with a special case. The display (17) and the limit formula (16) are not posed, because their boundary term 2af(a)∫b(a,z)f(z) dz2a f(a)\int b(a,z) f(z)\,dz2af(a)∫b(a,z)f(z)dz refers to the value of fff at aaa, which the hypotheses do not control.

A complete development needs Rochet's characterization, a.e. gradients of convex functions on R+2\mathbb{R}^2_+R+2​, Fubini–Tonelli on the product law, one-dimensional integration by parts with an absolutely continuous weight, and Myerson's one-good formula for Corollary 17. Contributions of any of these as standalone lemmas are welcome.

Selected references

  • S. Hart and N. Nisan, Approximate Revenue Maximization with Multiple Items, J. Econ. Theory 172 (2017); arXiv:1204.1846v3. https://arxiv.org/abs/1204.1846
  • R. Myerson, Optimal Auction Design, Math. Oper. Res. 6 (1981) 58–73. https://doi.org/10.1287/moor.6.1.58
  • J.-C. Rochet, The taxation principle and multi-time Hamilton–Jacobi equations, J. Math. Econ. 14 (1985) 113–128. https://doi.org/10.1016/0304-4068(85)90015-1
  • A. Manelli and D. Vincent, Bundling as an optimal selling mechanism for a multiple-good monopolist, J. Econ. Theory 127 (2006) 1–35. https://doi.org/10.1016/j.jet.2005.08.007
  • S. Hart and P. Reny, Maximal revenue with multiple goods: nonmonotonicity and other observations, Theoretical Economics 10 (2015) 893–922. https://doi.org/10.3982/TE1517
  • C. Daskalakis, A. Deckelbaum and C. Tzamos, Strong duality for a multiple-good monopolist, Econometrica 85 (2017) 735–767. https://doi.org/10.3982/ECTA12618
9 thms1 active userReviewed
Algorithmic Game TheoryMechanism DesignProbability·Captain: mikedeng1

Approximate Revenue Maximization with Multiple Items 1: For Independent Groups of Goods Y and Z, Rev(Y, Z) ≤ Rev(Y) + Rev(Z) + BRev(Y) + BRev(Z)Research Paper

Motivation

A seller who offers several goods to a buyer with private values has to choose a selling mechanism. For one good the optimal mechanism is known: post the best take-it-or-leave-it price (Myerson 1981). For two or more goods the optimal mechanism can be complicated: it may use lotteries, its menu may be infinite, and it may not be computable in closed form even for simple value distributions. Sellers therefore use simple mechanisms, such as selling each good separately or selling all goods as one bundle, and the question is how much revenue this costs.

Hart and Nisan (arXiv:1204.1846v3, J. Econ. Theory 2017) answer this with guaranteed fractions of the optimal revenue. Their basic tool is a decomposition theorem: when the goods split into two groups whose values are independent, the optimal revenue from all goods together is bounded by revenues computed from each group separately. This mission formalizes that theorem (Theorem 7) and the paper's first headline result, Theorem A, which is its two-good case.

Setting

There are k≥1k \ge 1k≥1 goods and one buyer with additive values. A valuation is a vector x∈R+kx \in \mathbb{R}^k_+x∈R+k​, and a kkk-good random valuation XXX is a random vector in R+k\mathbb{R}^k_+R+k​ whose law the seller knows.

A mechanism μ=(q,s)\mu = (q, s)μ=(q,s) consists of an allocation q:R+k→[0,1]kq : \mathbb{R}^k_+ \to [0,1]^kq:R+k​→[0,1]k, where qi(x)q_i(x)qi​(x) is the probability that the buyer receives good iii when reporting xxx, and a payment s:R+k→Rs : \mathbb{R}^k_+ \to \mathbb{R}s:R+k​→R. The buyer's payoff from truthful reporting is b(x)=q(x)⋅x−s(x)b(x) = q(x)\cdot x - s(x)b(x)=q(x)⋅x−s(x). The mechanism is

  • incentive compatible (IC) if b(x)≥q(x~)⋅x−s(x~)b(x) \ge q(\tilde x)\cdot x - s(\tilde x)b(x)≥q(x~)⋅x−s(x~) for all x,x~∈R+kx, \tilde x \in \mathbb{R}^k_+x,x~∈R+k​;
  • individually rational (IR) if b(x)≥0b(x) \ge 0b(x)≥0 for all xxx;
  • no positive transfer (NPT) if s(x)≥0s(x) \ge 0s(x)≥0 for all xxx.

Let M\mathcal MM be the class of IC and IR mechanisms. The expected revenue of μ∈M\mu \in \mathcal Mμ∈M is R(μ;X)=E[s(X)]R(\mu; X) = \mathbb{E}[s(X)]R(μ;X)=E[s(X)], which lies in (−∞,+∞](-\infty, +\infty](−∞,+∞], and the optimal revenue is

Rev(X)=sup⁡μ∈MR(μ;X)∈[0,∞].\mathrm{Rev}(X) = \sup_{\mu \in \mathcal M} R(\mu; X) \in [0, \infty].Rev(X)=μ∈Msup​R(μ;X)∈[0,∞].

Two benchmarks reduce to one-good problems: the separate revenue SRev(X)=Rev(X1)+⋯+Rev(Xk)\mathrm{SRev}(X) = \mathrm{Rev}(X_1) + \dots + \mathrm{Rev}(X_k)SRev(X)=Rev(X1​)+⋯+Rev(Xk​) and the bundled revenue BRev(X)=Rev(X1+⋯+Xk)\mathrm{BRev}(X) = \mathrm{Rev}(X_1 + \dots + X_k)BRev(X)=Rev(X1​+⋯+Xk​). Finally Val(X)=E[∑iXi]\mathrm{Val}(X) = \mathbb{E}[\sum_i X_i]Val(X)=E[∑i​Xi​] is the expected total value.

For the decomposition, YYY is a random valuation for k1≥1k_1 \ge 1k1​≥1 goods and ZZZ one for k2≥1k_2 \ge 1k2​≥1 goods. The coordinates of YYY may be arbitrarily dependent, and so may those of ZZZ, but the vectors YYY and ZZZ are independent. Rev(Y,Z)\mathrm{Rev}(Y, Z)Rev(Y,Z) is the optimal revenue from selling all k1+k2k_1 + k_2k1​+k2​ goods together, and X1X∈AX\mathbf 1_{X \in A}X1X∈A​ is the random valuation equal to XXX on the event X∈AX \in AX∈A and to 000 otherwise.

Formalization targets

Goal: Theorem 7 (p. 18)

If YYY and ZZZ are independent, then

Rev(Y,Z)≤Rev(Y)+Rev(Z)+BRev(Y)+BRev(Z)≤2(Rev(Y)+Rev(Z)).\mathrm{Rev}(Y, Z) \le \mathrm{Rev}(Y) + \mathrm{Rev}(Z) + \mathrm{BRev}(Y) + \mathrm{BRev}(Z) \le 2\big(\mathrm{Rev}(Y) + \mathrm{Rev}(Z)\big).Rev(Y,Z)≤Rev(Y)+Rev(Z)+BRev(Y)+BRev(Z)≤2(Rev(Y)+Rev(Z)).

Both inequalities are part of the goal, with the same middle term.

Milestones, in the order of the paper's proof

  1. Proposition 6 (iii), p. 14: Rev(X)\mathrm{Rev}(X)Rev(X) is the supremum of R(μ;X)R(\mu; X)R(μ;X) over IC, IR and NPT mechanisms.
  2. The NPT split, p. 20: Rev(Y,Z)≤Rev((Y,Z)1∑iYi≥∑jZj)+Rev((Y,Z)1∑jZj≥∑iYi)\mathrm{Rev}(Y,Z) \le \mathrm{Rev}\big((Y,Z)\mathbf 1_{\sum_i Y_i \ge \sum_j Z_j}\big) + \mathrm{Rev}\big((Y,Z)\mathbf 1_{\sum_j Z_j \ge \sum_i Y_i}\big)Rev(Y,Z)≤Rev((Y,Z)1∑i​Yi​≥∑j​Zj​​)+Rev((Y,Z)1∑j​Zj​≥∑i​Yi​​).
  3. Proposition 6 (iv), p. 14: for μ∈M\mu \in \mathcal Mμ∈M and a set AAA of values, E[s(X)1X∈A]≤Rev(X1X∈A)≤Rev(X)\mathbb{E}[s(X)\mathbf 1_{X\in A}] \le \mathrm{Rev}(X\mathbf 1_{X\in A}) \le \mathrm{Rev}(X)E[s(X)1X∈A​]≤Rev(X1X∈A​)≤Rev(X).
  4. Lemma 8, p. 19: Rev((Y,Z)1(Y,Z)∈A)≤Rev(Y)+Val(Z1(Y,Z)∈A)\mathrm{Rev}\big((Y,Z)\mathbf 1_{(Y,Z)\in A}\big) \le \mathrm{Rev}(Y) + \mathrm{Val}\big(Z\mathbf 1_{(Y,Z)\in A}\big)Rev((Y,Z)1(Y,Z)∈A​)≤Rev(Y)+Val(Z1(Y,Z)∈A​).
  5. Lemma 9, p. 20: for one-dimensional independent Y,ZY, ZY,Z, Val(Z1Y≥Z)≤Rev(Y)\mathrm{Val}(Z\mathbf 1_{Y \ge Z}) \le \mathrm{Rev}(Y)Val(Z1Y≥Z​)≤Rev(Y).
  6. Lemma 10, p. 20: Val(Z1∑iYi≥∑jZj)≤BRev(Y)\mathrm{Val}\big(Z\mathbf 1_{\sum_i Y_i \ge \sum_j Z_j}\big) \le \mathrm{BRev}(Y)Val(Z1∑i​Yi​≥∑j​Zj​​)≤BRev(Y).
  7. BRev ≤ Rev, p. 18.

Companions

Theorem A in the form (2), p. 16: for two independent goods Y,ZY, ZY,Z, Rev(Y,Z)≤2(Rev(Y)+Rev(Z))\mathrm{Rev}(Y, Z) \le 2(\mathrm{Rev}(Y) + \mathrm{Rev}(Z))Rev(Y,Z)≤2(Rev(Y)+Rev(Z)). Also posed is display (5), p. 17: z⋅P[Y≥z]≤Rev(Y)z\cdot\mathbb{P}[Y \ge z] \le \mathrm{Rev}(Y)z⋅P[Y≥z]≤Rev(Y) for one good and every z≥0z \ge 0z≥0.

Significance

Theorem A says that for two independent goods, selling them separately guarantees half of the optimal revenue, whatever the distributions. Theorem 7 extends this to two independent groups of goods. It is the induction step behind the paper's bounds for many goods: separate selling guarantees a fraction c/log⁡2kc/\log^2 kc/log2k of the optimal revenue for kkk independent goods (Theorem C), and bundling guarantees c/log⁡kc/\log kc/logk for kkk i.i.d. goods (Theorem D). These are other missions of this series, and both use Theorem 7 as a black box. The same approach underlies later work on simple versus optimal mechanisms, for example Babaioff, Immorlica, Lucier and Weinberg (FOCS 2014) and Li and Yao (PNAS 2013).

All results posed here are proved in the paper. As far as we know, none has a machine-checked proof. A formal proof would give a reusable development of mechanism design with multi-dimensional types: IC and IR mechanisms on R+k\mathbb{R}^k_+R+k​, revenue as an extended-real expectation, restriction of mechanisms to subdomains, and marginal mechanisms obtained by fixing some coordinates of an independent product.

Difficulty

The proofs are short on paper but rest on measure theory the prose passes over. Lemma 8 conditions on Z=zZ = zZ=z and applies Proposition 6 (iv) to a one-group mechanism for each fixed zzz. Formally this is a Tonelli argument on a product measure, with an integrand that may be negative on part of the space and +∞+\infty+∞ in expectation. The induced mechanism sz(y)=s(y,z)−∑jqj(y,z)zjs^z(y) = s(y, z) - \sum_j q_j(y,z) z_jsz(y)=s(y,z)−∑j​qj​(y,z)zj​ involves the allocation qqq, which is not assumed measurable. Proposition 6 (iv) bounds a mechanism with possibly negative payments by the optimal revenue on a modified valuation X1X∈AX\mathbf 1_{X \in A}X1X∈A​, and this requires shifting the mechanism to make it NPT. Finally, every revenue may be infinite, so the inequalities must be handled in [0,∞][0,\infty][0,∞] and in the extended reals, without cancelling.

A natural first idea is to apply Theorem A coordinate by coordinate. This fails, because the coordinates inside YYY may be dependent. Only the independence of YYY from ZZZ is available, and the bound must go through the bundled revenue BRev\mathrm{BRev}BRev.

Formalization scope

  • Valuations as laws. A random valuation is represented by its law, a probability measure on ι → ℝ≥0 for a finite type ι of goods. Every quantity of the paper depends only on the law. One good is ι = Unit.
  • Independence as a product law. The law of (Y,Z)(Y,Z)(Y,Z) is the product of the laws of YYY and ZZZ, transported to ι₁ ⊕ ι₂ → ℝ≥0. Theorems that need independence are never stated over an arbitrary joint law with given marginals, since they are false for correlated groups. The NPT split in the proof of Theorem 7 is stated for independent groups, as on the page. Proposition 6 applies to an arbitrary law.
  • The class M\mathcal MM. M\mathcal MM requires q∈[0,1]kq \in [0,1]^kq∈[0,1]k, IC, IR and a measurable payment sss, the last as allowed by the paper's footnote 12. qqq is not required to be measurable.
  • Revenue. R(μ;X)R(\mu;X)R(μ;X) is ∫s+−∫s−\int s^+ - \int s^-∫s+−∫s− in the extended reals, so that E[s(X)]=+∞\mathbb{E}[s(X)] = +\inftyE[s(X)]=+∞ is kept. Since s≥s(0)s \ge s(0)s≥s(0) under IC, the negative part is finite. The Bochner integral is not used, because it would assign 000 to a non-integrable payment. Rev\mathrm{Rev}Rev, SRev\mathrm{SRev}SRev, BRev\mathrm{BRev}BRev and Val\mathrm{Val}Val take values in [0,∞][0,\infty][0,∞].
  • Subdomains. X1X∈AX\mathbf 1_{X\in A}X1X∈A​ is the image law under x↦x1A(x)x \mapsto x\mathbf 1_A(x)x↦x1A​(x), and AAA is assumed measurable. The regions of the proof of Theorem 7 are both closed, so the diagonal is counted twice, as in the paper.
  • Not trivializable. A formalization in which Rev\mathrm{Rev}Rev is computed with a Bochner integral, the expected revenue is clipped before comparing a single mechanism with Rev\mathrm{Rev}Rev, or independence is dropped does not state the paper's theorem, and none of these is used.
  • Not posed. The ratio form of Theorem A (GFOR≥1/2\mathrm{GFOR} \ge 1/2GFOR≥1/2) is not posed, because of its conventions 0/0=10/0 = 10/0=1 and ∞/∞\infty/\infty∞/∞. Theorems B, C, D, 16 and 33 are separate missions of this series.

Contributions are welcome at every level: Proposition 6 (the NPT shift and subdomain restriction), the marginal-mechanism construction behind Lemma 8, and the one-good facts (5) and Lemma 9 are all reusable in the sibling missions on Theorems C and D.

Selected references

  • S. Hart and N. Nisan, Approximate Revenue Maximization with Multiple Items, Journal of Economic Theory 172 (2017); preprint arXiv:1204.1846v3, 2017. https://arxiv.org/abs/1204.1846
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6 (1981) 58–73. https://doi.org/10.1287/moor.6.1.58
  • S. Hart and P. J. Reny, Maximal Revenue with Multiple Goods: Nonmonotonicity and Other Observations, Theoretical Economics 10 (2015) 893–922. https://doi.org/10.3982/TE1517
  • M. Babaioff, N. Immorlica, B. Lucier and S. M. Weinberg, A Simple and Approximately Optimal Mechanism for an Additive Buyer, FOCS 2014. https://arxiv.org/abs/1405.6146
  • X. Li and A. C.-C. Yao, On Revenue Maximization for Selling Multiple Independently Distributed Items, PNAS 110 (2013) 11232–11237. https://doi.org/10.1073/pnas.1309533110
9 thms1 active userReviewed
Algorithmic Game TheoryCombinatoricsProbability·Captain: mikedeng1

Online Contention Resolution Schemes with Applications to Bayesian Selection Problems 4: Intersecting the Families of (b, c₁)- and (b, c₂)-Selectable Greedy OCRSs Is (b, c₁c₂)-SelectableResearch Paper

Motivation

Online selection problems ask an algorithm to accept or reject elements as they arrive, while keeping the accepted set feasible. The decisions are irrevocable, and the arrival order can be chosen after the random activity of the elements is known. A guarantee for one constraint is therefore useful only if it remains meaningful when several constraints apply at once. In Feldman, Svensson and Zenklusen's paper, the constraints include matroid independence, matching, and knapsack capacity. A set satisfying two such requirements lies in the intersection of their feasible families. Theorem 1.9 establishes how their online guarantees combine: the two selectability factors multiply.

The result belongs to a sequence of statements in the paper. The authors first define greedy online contention resolution schemes and their selectability guarantee in Definitions 1.3–1.5. They then state the combination theorem in the introduction and identify the intersection construction in Definition 2.10. Lemma 2.11 supplies the precise selectability assertion for that construction. This mission isolates those claims so that later formalizations of specific constraints can reuse them without repeating the probability argument.

Setting

Let NNN be a finite ground set and F⊆2N\mathcal F\subseteq 2^NF⊆2N a family of feasible sets. A fractional point x∈[0,1]Nx\in[0,1]^Nx∈[0,1]N determines a random active set R(x)R(x)R(x): each e∈Ne\in Ne∈N belongs to R(x)R(x)R(x) independently with probability xex_exe​. Thus a particular set A⊆NA\subseteq NA⊆N has weight

Pr⁡[R(x)=A]=∏e∈Axe∏e∉A(1−xe).\Pr[R(x)=A]=\prod_{e\in A}x_e\prod_{e\notin A}(1-x_e).Pr[R(x)=A]=e∈A∏​xe​e∈/A∏​(1−xe​).

A greedy online contention resolution scheme, or greedy OCRS, chooses a down-closed family Gx⊆F\mathcal G_x\subseteq\mathcal FGx​⊆F. As active elements arrive, it accepts an element when adding that element to those already accepted remains in Gx\mathcal G_xGx​. In a randomized scheme, the choice of Gx\mathcal G_xGx​ is random and independent of R(x)R(x)R(x). The family contains the empty set, as the procedure begins with no accepted elements.

An element eee is selectable for a realized active set AAA and family Gx\mathcal G_xGx​ if every I⊆AI\subseteq AI⊆A with I∈GxI\in\mathcal G_xI∈Gx​ still permits eee: I∪{e}∈GxI\cup\{e\}\in\mathcal G_xI∪{e}∈Gx​. This condition covers every possible set that might have been accepted before eee arrives. A greedy OCRS is (b,c)(b,c)(b,c)-selectable for a relaxation PPP when the probability of this event is at least ccc for every x∈bPx\in bPx∈bP and every e∈Ne\in Ne∈N. The probability includes both draws when the family is randomized. Here b,c∈[0,1]b,c\in[0,1]b,c∈[0,1] and bP={by:y∈P}bP=\{by:y\in P\}bP={by:y∈P}.

For two feasible families F1,F2\mathcal F_1,\mathcal F_2F1​,F2​, the combination of their greedy OCRSs independently draws G1,x\mathcal G_{1,x}G1,x​ and G2,x\mathcal G_{2,x}G2,x​, then uses Gx=G1,x∩G2,x\mathcal G_x=\mathcal G_{1,x}\cap\mathcal G_{2,x}Gx​=G1,x​∩G2,x​. This is a family of sets satisfying both constraints. The proof also uses χe(A,F,F′)\chi_e(A,F,F')χe​(A,F,F′), the indicator that I∪{e}∈FI\cup\{e\}\in FI∪{e}∈F for every I⊆AI\subseteq AI⊆A lying in F′F'F′. For selectability itself, F′=FF'=FF′=F.

Formalization targets

Goal: Theorem 1.9

For P1,P2⊆[0,1]NP_1,P_2\subseteq[0,1]^NP1​,P2​⊆[0,1]N, let the first scheme be (b,c1)(b,c_1)(b,c1​)-selectable and the second (b,c2)(b,c_2)(b,c2​)-selectable. The mission asks for a greedy OCRS on the intersection with

Pr⁡[e selectable at x]≥c1c2for all x∈b(P1∩P2), e∈N.\Pr[e\text{ selectable at }x]\ge c_1c_2 \quad\text{for all }x\in b(P_1\cap P_2),\ e\in N.Pr[e selectable at x]≥c1​c2​for all x∈b(P1​∩P2​), e∈N.

The target records existence of the combined scheme, independent of a particular proof of its selectability. The paper also claims preservation of polynomial-time efficiency; the finite mathematical model here does not assign a complexity measure to a family sampler or membership oracle, so that clause is outside this target.

Construction: Lemma 2.11

The lemma names the combined scheme: independently draw both greedy families and use their intersection. It asserts the same (b,c1c2)(b,c_1c_2)(b,c1​c2​) bound for that specific scheme. The earlier milestones record the two order properties of χe\chi_eχe​ and the finite product-measure correlation inequality appearing in the lemma's proof. Their statements keep the original quantifiers over active sets and families visible.

Significance

The theorem turns guarantees for individual constraints into a guarantee for simultaneous constraints. If a matroid scheme and a matching scheme meet the same scale parameter bbb, their intersection is governed by the product of their selectability factors. The factor loss is explicit, which lets subsequent algorithmic results track it without redefining the combined scheme. The lemma additionally fixes the actual distribution over intersected families, avoiding ambiguity about how two randomized procedures are coupled.

Mathlib already provides a general finite FKG inequality, but it does not state the paper's OCRS objects, the selectable event, or the intersection theorem. This mission adds those interfaces and the specialized correlation statement. The source results are proved in the cited paper; the local theorem files in this proposal are statements for later machine-checked proofs. A complete formalization would connect the finite active-set weights to Mathlib's lattice correlation theorem and then establish the randomized family bookkeeping. The finite probability definitions can also serve other OCRS results in the same paper.

Difficulty

The obvious argument would multiply the two probabilities that eee is selectable for the separate families. Both events depend on the same active set R(x)R(x)R(x), so they are not independent even when the families are drawn independently. Moreover, selectability for the intersection checks only sets belonging to both families, whereas the original bounds check each family separately. The formal statements must keep these two dependencies distinct. The paper's two monotonicity claims and its FKG display identify the needed intermediate assertions, but their use with an arbitrary random choice of families still requires careful finite-sum reasoning.

Formalization scope

The ground set is a finite Lean type and subsets are Finsets. Feasibility is a predicate on those finite sets. Fractional points are real-valued functions, and each input relaxation is represented as a set of such functions with an explicit coordinate bound 0≤ye≤10\le y_e\le10≤ye​≤1. The scale and selectability parameters belong to [0,1][0,1][0,1]. The point xxx ranges over b(P1∩P2)b(P_1\cap P_2)b(P1​∩P2​), not over an independently chosen intersection of scaled sets, so the case b=0b=0b=0 retains the paper's meaning. The finite products define the law of R(x)R(x)R(x); no measure-theoretic integral is used.

A randomized scheme is a probability weight on possible greedy families for every input point. The combined weight is the product of the two original weights summed over pairs with the required intersection, expressing independent draws. The family distribution is independent of the active-set draw. This sampling convention is necessary for the stated product guarantee and is made explicit here although Definition 2.10 does not spell it out. Each greedy family contains ∅\varnothing∅ and lies in its own feasible family. These requirements exclude the empty-family and unconstrained-family encodings that would make selectability trivial. The unit-cube bounds prevent negative active-set weights.

The Lean declarations focus on the finite selectability guarantee. They abstract a polytope by its set of fractional points and use the paper's unit-cube condition; they do not formalize a polyhedral representation or test that its binary points equal the feasible sets. A full development of the paper's algorithmic setting would additionally represent online arrival orders, family sampling algorithms, membership oracles, and polynomial running time. Contributions establishing the finite probability lemmas, the specialized FKG statement, and Lemma 2.11 are directly useful here. The general active-set and selectability definitions are reusable across the paper's other missions.

Selected references

  • Moran Feldman, Ola Svensson and Rico Zenklusen, Online Contention Resolution Schemes, arXiv preprint, 2015, arXiv:1508.00142v2. Definitions 1.3–1.5, Theorem 1.9, Definition 2.10 and Lemma 2.11.
  • Moran Feldman, Ola Svensson and Rico Zenklusen, Online Contention Resolution Schemes with Applications to Bayesian Selection Problems, SIAM Journal on Computing 50(2), 2021, DOI:10.1137/18M1226130. The mission's statement indices follow the arXiv version above.
7 thms1 active userReviewed
CombinatoricsOptimizationProbability·Captain: mikedeng1

Online Contention Resolution Schemes with Applications to Bayesian Selection Problems 3: A Knapsack Polytope Has a (b, (1−2b)/(2−2b))-Selectable Randomized Greedy OCRS for b ≤ 1/2Research Paper

Motivation

In online selection, useful items arrive one at a time and must be accepted or rejected before the next arrival. A knapsack constraint limits the total size of accepted items to one unit. When the order may depend on all of the random outcomes, an algorithm needs a guarantee that survives every such order. Feldman, Svensson, and Zenklusen introduced online contention resolution schemes (OCRSs) to provide this guarantee for fractional relaxations of selection problems. Their knapsack theorem gives an explicit guarantee for a randomized greedy scheme and contrasts with a size-dependent obstruction for deterministic greedy schemes (Feldman–Svensson–Zenklusen, §2.3).

The knapsack result is one of the three concrete existence results summarized in Theorem 1.8 of the paper. The surrounding framework is designed to convert fractional solutions into feasible online selections under an almighty adversary, who knows the active items and the scheme's random choices before choosing their arrival order. This makes the selectability requirement stronger than a performance claim for one fixed order (Feldman–Svensson–Zenklusen, Definitions 1.3–1.5).

Setting

Let NNN be a finite ground set. Each element e∈Ne\in Ne∈N has a size se∈[0,1]s_e\in[0,1]se​∈[0,1]. A subset I⊆NI\subseteq NI⊆N is feasible when its total size is at most one. The natural fractional polytope is

P={x∈[0,1]N:∑e∈Nsexe≤1}.P=\left\{x\in[0,1]^N:\sum_{e\in N}s_ex_e\le1\right\}.P={x∈[0,1]N:e∈N∑​se​xe​≤1}.

For a vector x∈[0,1]Nx\in[0,1]^Nx∈[0,1]N, the random active set R(x)R(x)R(x) includes each element eee independently with probability xex_exe​. A greedy family FxF_xFx​ is a downward-closed family of feasible subsets. The online rule accepts an active arriving element when adding it to the accepted set keeps that set inside FxF_xFx​. A randomized greedy OCRS chooses the family at random, independently of R(x)R(x)R(x). The paper studies the probability that an element eee is selectable: for every possible accepted set I⊆R(x)I\subseteq R(x)I⊆R(x) with I∈FxI\in F_xI∈Fx​, the enlarged set I∪{e}I\cup\{e\}I∪{e} still belongs to FxF_xFx​. Such an event makes eee acceptable regardless of the arrival order (Feldman–Svensson–Zenklusen, §1.1).

Write bP={bp:p∈P}bP=\{bp:p\in P\}bP={bp:p∈P}. An OCRS is (b,c)(b,c)(b,c)-selectable when, for every x∈bPx\in bPx∈bP and every e∈Ne\in Ne∈N, the probability that eee is selectable is at least ccc. The paper divides elements at size 1/21/21/2: Nbig={e:se>1/2}N_{\mathrm{big}}=\{e:s_e>1/2\}Nbig​={e:se​>1/2}, while equality belongs to the small elements. Its construction randomly chooses between the feasible subsets using only big elements and those using only small elements (Feldman–Svensson–Zenklusen, proof of Theorem 2.9).

Formalization targets

Main theorem

Theorem 2.9 asserts that for every b∈[0,1/2]b\in[0,1/2]b∈[0,1/2] and every such knapsack polytope, a randomized greedy OCRS exists with

c=1−2b2−2b.c=\frac{1-2b}{2-2b}.c=2−2b1−2b​.

The goal quantifies over every finite ground set and every allowed size vector. At the endpoint b=1/2b=1/2b=1/2, the claimed lower bound is zero; at b=0b=0b=0, it is 1/21/21/2. The denominator remains positive throughout the stated interval. The goal is an existence statement; its witnesses are arbitrary randomized greedy families meeting the definition, so the paper's particular construction is named separately in the supporting definitions (Feldman–Svensson–Zenklusen, Theorem 2.9, p. 14).

Supporting targets

The milestones include the paper's bound 0≤bbig≤b0\le b_{\mathrm{big}}\le b0≤bbig​≤b for bbig=∑e∈Nbigsexeb_{\mathrm{big}}=\sum_{e\in N_{\mathrm{big}}}s_ex_ebbig​=∑e∈Nbig​​se​xe​, the big and small element selectability bounds for the paper's construction, and Proposition 2.8. That proposition says that, for every ground-set size n≥1n\ge1n≥1, some knapsack constraint defeats every deterministic greedy OCRS whenever c>(1−b)n−1c>(1-b)^{n-1}c>(1−b)n−1 for b∈[0,1]b\in[0,1]b∈[0,1] (Feldman–Svensson–Zenklusen, §2.3, pp. 14–15).

Significance

The theorem supplies a concrete selectable OCRS for the natural fractional knapsack relaxation. Its guarantee applies to every element and every fractional point in bPbPbP, under the paper's strongest arrival-order adversary. Proposition 2.8 explains why randomization matters here: a deterministic greedy scheme cannot retain an analogous positive constant independent of the number of elements on every knapsack instance. These results serve as the knapsack component in the paper's broader OCRS framework and can be combined with schemes for other constraints in the paper's later combination result (Feldman–Svensson–Zenklusen, Theorem 1.9).

The mathematical theorem and proposition have proofs in the cited paper. This mission asks for machine-checked proofs of their formal statements and of the stated intermediate bounds. The current draft declarations contain proof placeholders; compilation establishes only that their statements and definitions are well formed. A completed development would also leave reusable finite active-set probabilities, greedy-family predicates, and explicit knapsack constructions for later online-rounding work.

Difficulty

A family that contains every feasible subset is not automatically useful for online selection: one active set may contain several subsets whose accepted elements block the tested element. The requirement quantifies over every feasible accepted subset of the realized active set, reflecting the almighty adversary rather than a fixed order. In a knapsack, elements larger than one half behave differently from smaller ones, and a single deterministic family cannot give a ground-set-independent selectability guarantee on all instances. The randomized construction must assign valid probabilities to its two families and obtain the same lower bound in both size regimes (Feldman–Svensson–Zenklusen, Proposition 2.8 and Theorem 2.9).

Formalization scope

The Lean ground set is a finite type, and subsets are Finsets. The polytope is the set of real vectors satisfying both the box inequalities and the unit-capacity inequality. The feasible family uses the same sizes and unit capacity. Active-set and family-choice probabilities are finite sums, with independent Bernoulli factors for R(x)R(x)R(x). The scaling bPbPbP is pointwise set scalar multiplication, so the case b=0b=0b=0 retains its intended meaning. The size assumptions se∈[0,1]s_e\in[0,1]se​∈[0,1] and the ranges of bbb are explicit theorem hypotheses. No nonemptiness assumption is added to the ground set; the statements include the empty case.

The greedy-family definition requires the empty set, making it impossible to satisfy selectability by using an empty family. Every family chosen with positive probability is downward closed and consists of feasible sets. The polytope's box constraints keep every active-set weight a probability. The construction's mixing probability is used exactly on x∈bPx\in bPx∈bP; on other vectors its totalized value chooses the small family, where the paper makes no performance claim. The two branch weights are added if their families coincide, as they can on an empty ground set.

One display on page 15 includes the tested element in a load sum, while the next displayed equality treats that element as excluded. The pointwise supporting item uses the excluded-element form needed for the stated argument; the printed display is preserved in the milestone quotation and the discrepancy is detailed in MODERATION_NOTES.md. Contributions toward either size regime, the finite probability bounds, or the deterministic obstruction are welcome. The finite probability and greedy-family definitions are the parts most directly reusable beyond knapsack.

Selected references

  • Moran Feldman, Ola Svensson, and Rico Zenklusen, Online Contention Resolution Schemes, arXiv:1508.00142v2, 2015, §1.1 and §2.3, pp. 2–4 and 14–15. arXiv.
8 thms1 active userReviewed
Algorithmic Game TheoryCombinatoricsProbability·Captain: mikedeng1

Online Contention Resolution Schemes with Applications to Bayesian Selection Problems 1: Every Loopless Matroid Polytope Has a (b, 1−b)-Selectable Deterministic Greedy OCRSResearch Paper

Motivation

In online selection, items reveal information one at a time, and each decision to accept an item is irrevocable. A matroid constraint permits some subsets and excludes others; it covers choices such as selecting linearly independent vectors or acyclic edges. A fractional solution can assign an acceptance probability to each item, but independent activations can produce a set that violates the constraint. An online contention resolution scheme (OCRS) turns these activations into a feasible selection while respecting the order in which items arrive. The matroid result of Feldman, Svensson and Zenklusen gives a guarantee that survives even when an adversary knows all random outcomes before choosing the arrival order.

This mission concerns the paper's matroid theorem, Theorem 2.1. The same paper develops schemes for matching and knapsack constraints and a rule for combining schemes for intersecting constraints. Those results are separate missions in this series. Here the central question is how much of a fractional matroid point can be retained by a deterministic greedy rule as each active item is revealed.

Setting

Let NNN be a finite ground set and let MMM be a matroid on NNN. Its independent subsets form a down-closed family F\mathcal FF: if III is independent, every subset of III is independent. The rank r(S)r(S)r(S) of S⊆NS\subseteq NS⊆N is the maximum size of an independent subset of SSS. The matroid independence polytope is

PF={x∈R≥0N:x(S):=∑e∈Sxe≤r(S) for all S⊆N}.P_{\mathcal F}=\left\{x\in\mathbb R^N_{\ge0}:x(S):=\sum_{e\in S}x_e\le r(S)\text{ for all }S\subseteq N\right\}.PF​={x∈R≥0N​:x(S):=e∈S∑​xe​≤r(S) for all S⊆N}.

Its points have 0≤xe≤10\le x_e\le10≤xe​≤1. For a point xxx, the active set R(x)R(x)R(x) contains each eee independently with probability xex_exe​. A deterministic greedy OCRS assigns a down-closed family Fx⊆F\mathcal F_x\subseteq\mathcal FFx​⊆F to xxx and accepts an active element when adding it to the already accepted set stays in Fx\mathcal F_xFx​. The empty set belongs to every Fx\mathcal F_xFx​. The rule depends on xxx before the active set and arrival order are revealed.

An element eee is selectable for an active set AAA if I∪{e}∈FxI\cup\{e\}\in\mathcal F_xI∪{e}∈Fx​ for every I⊆AI\subseteq AI⊆A with I∈FxI\in\mathcal F_xI∈Fx​. A greedy OCRS is (b,c)(b,c)(b,c)-selectable if this event has probability at least ccc for every x∈bPFx\in bP_{\mathcal F}x∈bPF​ and every e∈Ne\in Ne∈N. The event implies that eee can be added regardless of which eligible active elements arrived first. These definitions are from §1.1 of the paper.

Formalization targets

Matroid OCRS

For every b∈[0,1]b\in[0,1]b∈[0,1] and every finite loopless matroid MMM, the target is a deterministic greedy OCRS with

Pr⁡[I∪{e}∈Fx for all I⊆R(x), I∈Fx]≥1−bfor every x∈bPF, e∈N.\Pr\left[I\cup\{e\}\in\mathcal F_x\text{ for all }I\subseteq R(x),\ I\in\mathcal F_x\right]\ge 1-b \quad\text{for every }x\in bP_{\mathcal F},\ e\in N.Pr[I∪{e}∈Fx​ for all I⊆R(x), I∈Fx​]≥1−bfor every x∈bPF​, e∈N.

The loopless condition is a disclosed correction to the printed Theorem 2.1: a loop cannot belong to any independent singleton, so its selectability is zero. The printed bound would demand positive selectability for that loop whenever b<1b<1b<1. The theorem keeps the paper's constant 1−b1-b1−b exactly.

Supporting targets

The milestones reproduce six statements from §2.1–2.1.1, in attack order: validity of a family defined by a chain ∅=Nℓ⊊⋯⊊N0=N\varnothing=N_\ell\subsetneq\cdots\subsetneq N_0=N∅=Nℓ​⊊⋯⊊N0​=N of matroid minors (independence of the union of layer-wise independent sets is Soto, Theorem 5.1); a characterization of selectability through span in one layer; monotonicity of the first chain set as coordinates of xxx increase; the description of the base polytope PB={x∈PF:x(N)=r(N)}P_{\mathcal B}=\{x\in P_{\mathcal F}:x(N)=r(N)\}PB​={x∈PF​:x(N)=r(N)} as the set of maximal vectors of PFP_{\mathcal F}PF​; the weighted span bound of Lemma 2.4,

∑e∈NxePr⁡[e∈span⁡(R(x)∪S)]≤b⋅(x(N)+(1−b) r(S)),\sum_{e\in N}x_e\Pr[e\in\operatorname{span}(R(x)\cup S)]\le b\cdot\bigl(x(N)+(1-b)\,r(S)\bigr),e∈N∑​xe​Pr[e∈span(R(x)∪S)]≤b⋅(x(N)+(1−b)r(S)),

strict when S≠∅S\neq\varnothingS=∅; and the proper-inclusion conclusion S⊊NS\subsetneq NS⊊N of Corollary 2.5. They expose the distinct matroid and probability claims on which the main theorem rests.

Significance

The theorem gives a fixed greedy family for each fractional point, with a per-element probability guarantee that is independent of the arrival order. Offline contention resolution schemes for matroids were introduced by Chekuri, Vondrák and Zenklusen; the online, almighty-adversary version here is stronger. A solver can use that guarantee as the matroid component in larger online selection problems. In the source paper it feeds the intersection and application results; those applications require further models and statements beyond this mission. The factor 1−b1-b1−b makes the tradeoff explicit: using a more heavily scaled fractional point raises the risk of contention.

The result is proved in the cited paper. This mission asks for a machine-checked Lean proof of its corrected statement and the source's supporting claims. A successful development would add reusable finite representations of independent activation, matroid polytope inequalities, span probabilities, and chain families. It would also make the loop boundary explicit, preventing a formally false version of the printed theorem from being published as a target.

Difficulty

Independent activation does not itself respect matroid independence. A greedy family that simply contains every independent set can make an element unavailable after earlier active elements are accepted, and the arrival order can expose the worst such history. The central issue is therefore a uniform selectability event: the same element must remain addable after every feasible subset of the active set. The paper measures that obstruction through spans in successive matroid minors. The first chain set must be proper so that the construction can continue, which is why the strict part of the weighted span inequality matters.

Formalization scope

The ground set is a finite Lean type, subsets are Finsets, and Mathlib's Matroid supplies independence, closure, contraction and restriction. Matroid rank is converted from Mathlib's extended natural rank to a real number; finiteness makes this conversion finite on every subset. The independence and base polytopes are defined by the paper's inequalities. The scalar multiple bPbPbP is pointwise set scalar multiplication, including b=0b=0b=0.

Probabilities are finite sums of product weights over all active sets. In particular, the event in Lemma 2.4 uses span⁡(R(x)∪S)\operatorname{span}(R(x)\cup S)span(R(x)∪S), whereas the recurrence defining SSS uses span⁡((R(x)∪Si)∖{e})\operatorname{span}((R(x)\cup S_i)\setminus\{e\})span((R(x)∪Si​)∖{e}). These are separate definitions. Every point used for activation lies in [0,1]N[0,1]^N[0,1]N, as enforced by the polytope and b∈[0,1]b\in[0,1]b∈[0,1]. The base-polytope condition on Corollary 2.5 is the standing assumption stated before the lemma in the source.

The loopless condition applies to the goal, to Corollary 2.5, and to the strict clause of Lemma 2.4 only; its non-strict clause, the chain statements and the monotonicity statement hold for every matroid and are stated without it. Three trivializing formalizations are ruled out: every greedy family must contain the empty set, so an empty family cannot satisfy selectability vacuously; every member of a greedy family must be independent in MMM, so Fx=2N\mathcal F_x=2^NFx​=2N is not admissible; and every point used for activation lies in [0,1]N[0,1]^N[0,1]N, so Pr⁡[R(x)=A]\Pr[R(x)=A]Pr[R(x)=A] is a genuine probability. The quantified scheme depends only on xxx, and its success condition ranges over every feasible subset of the realized active set. Contributions that establish the chain family's independence, finite probability identities, and rank or closure facts are within scope. Polynomial-time implementation and the Monte Carlo estimates of Lemma 2.6 are outside this mission's mathematical target.

Selected references

  • Moran Feldman, Ola Svensson and Rico Zenklusen, Online Contention Resolution Schemes, arXiv:1508.00142v2, 2015; published as Online Contention Resolution Schemes with Applications to Bayesian Selection Problems, SIAM Journal on Computing, 2021. Preprint.
  • Chandra Chekuri, Jan Vondrák and Rico Zenklusen, Submodular Function Maximization via the Multilinear Relaxation and Contention Resolution Schemes, SIAM Journal on Computing, 2014. arXiv:1105.4593.
  • José A. Soto, Matroid Secretary Problem in the Random-Assignment Model, SIAM Journal on Computing, 2013. arXiv:1007.2140.
10 thms1 active userReviewed
Graph TheoryLinear OptimizationOptimization·Captain: mikedeng1

Minimum Cost Flows in Graphs with Unit Capacities: When the Second Phase of a Cost Scale Starts, at Most 3λ Excess Is Left for λ = √m and 36λ for λ = n^(2/3)Research Paper

Motivation

Minimum-cost flow is a standard model for routing a quantity through a network while paying a cost on each arc. Unit capacities arise when each input arc can carry at most one unit; they include flow formulations of several matching and assignment problems. Goldberg, Kaplan, Hed and Tarjan analyze a cost-scaling algorithm for this setting. Their second-phase argument depends on a bound on the excess left in a pseudoflow when every excess vertex has undergone enough potential increases. This mission formalizes that bound, Lemma 5 of their STACS 2015 paper. The published paper gives an O(min⁡{m1/2,n2/3} mlog⁡(nC))O(\min\{m^{1/2},n^{2/3}\}\,m\log(nC))O(min{m1/2,n2/3}mlog(nC)) running-time bound for its unit-capacity algorithm; the running-time statement itself is outside this mission.

Setting

A network has a finite vertex set VVV and an arc set EEE that contains both orientations of each input arc. Write n=∣V∣n=|V|n=∣V∣. Every input arc has capacity one; its reverse has capacity zero and opposite cost. Write mmm for the number of input arcs, so ∣E∣=2m|E|=2m∣E∣=2m. The paper assumes no parallel or antiparallel input arcs, allowing an arc to be identified by its ordered endpoints. Costs are antisymmetric between orientations.

A pseudoflow fff assigns an antisymmetric quantity to each arc and respects its capacity. Its excess at vvv is the sum ef(v)e_f(v)ef​(v) of incoming flow. Positive excess means that vvv has flow to discharge; negative excess is a deficit. A circulation is a pseudoflow with zero excess at every vertex. An arc is residual for fff when its residual capacity uf(v,w)=u(v,w)−f(v,w)u_f(v,w)=u(v,w)-f(v,w)uf​(v,w)=u(v,w)−f(v,w) is positive. For vertex prices ppp, its reduced cost is cp(v,w)=c(v,w)−p(v)+p(w)c_p(v,w)=c(v,w)-p(v)+p(w)cp​(v,w)=c(v,w)−p(v)+p(w). A pseudoflow is ε\varepsilonε-optimal at ppp when every residual arc has reduced cost at least −ε-\varepsilon−ε. These are the paper's conventions on p. 408.

At the start of a cost scale, let f′f'f′ be a circulation that is 2ε2\varepsilon2ε-optimal at prices p′p'p′. During the scale, fff is a pseudoflow that is ε\varepsilonε-optimal at prices ppp. The potential increase in scale units is d(v)=(p(v)−p′(v))/εd(v)=(p(v)-p'(v))/\varepsilond(v)=(p(v)−p′(v))/ε. Put λ=min⁡{m,n2/3}\lambda=\min\{\sqrt m,n^{2/3}\}λ=min{m​,n2/3}. The second phase begins when every excess vertex has d(v)≥λd(v)\ge\lambdad(v)≥λ; the paper also states that every deficit then has d(v)=0d(v)=0d(v)=0 and that the levels d(v)d(v)d(v) are integral. The remaining excess is X(f)=∑v:ef(v)>0ef(v)X(f)=\sum_{v:e_f(v)>0}e_f(v)X(f)=∑v:ef​(v)>0​ef​(v).

The comparison graph has arcs E+={(v,w)∈E:f′(v,w)>f(v,w)}E^+=\{(v,w)\in E:f'(v,w)>f(v,w)\}E+={(v,w)∈E:f′(v,w)>f(v,w)} and vertices VVV. An excess–deficit cut Y⊆E+Y\subseteq E^+Y⊆E+ meets every path in this graph from an excess vertex to a deficit vertex. Thus a cut is measured among comparison arcs, not among arbitrary arcs of the original network. Lemmas 3 and 4 of the paper establish the level and cut bounds on which the excess estimate rests.

Formalization targets

The goal is Lemma 5 on p. 410, stated with both constants obtained in its proof. Under the cost-scale conditions above, and the divisibility conventions in footnotes 5–6, its two cases are

λ=m⟹X(f)≤3λ,\lambda=\sqrt m\quad\Longrightarrow\quad X(f)\le 3\lambda,λ=m​⟹X(f)≤3λ, λ=n2/3⟹X(f)≤36λ.\lambda=n^{2/3}\quad\Longrightarrow\quad X(f)\le36\lambda.λ=n2/3⟹X(f)≤36λ.

The second case also assumes that six divides the integer λ\lambdaλ; the first uses divisibility by three. The goal keeps the two conclusions separate so that the stronger 3λ3\lambda3λ bound is retained when m\sqrt mm​ determines the scale. Its milestone list follows the paper: Lemma 3 bounds d(v)−d(w)d(v)-d(w)d(v)−d(w) by three on an arc of E+E^+E+; Lemma 4 bounds total excess by a cut; and the proof of Lemma 5 supplies the cut bands and the two size estimates. The bands use the exact three-level and six-level ranges printed on p. 410.

Significance

The result connects a condition on price increases to a numerical bound on the amount of flow still needing discharge. Combined with the paper's time per unit of remaining excess, this is the bound needed for its second-phase running-time estimate. The two regimes show how the same cost-scale state can be controlled by either the number of input arcs or the number of vertices. Without the excess bound, the paper's argument gives no comparable limit on the remaining work at the phase transition.

The paper proves Lemma 5, but this particular unit-capacity excess argument has no matching theorem in the platform catalog checked for this mission. The network, circulation and pseudoflow interfaces are already published as reusable definitions from earlier cost-scaling work. A completed machine-checked development would add the cut argument and band counts to those interfaces. Those facts can also support other analyses that compare an entry circulation with an intermediate pseudoflow; this mission does not claim to formalize the algorithm's entire execution or its running-time model.

Difficulty

The main obstacle is linking local price inequalities to a global bound on excess. A reduced-cost inequality controls a single residual arc, while excess may move through a path and is measured over many vertices. The comparison graph G+G^+G+ is essential: on a residual arc outside E+E^+E+, the level difference used by Lemma 3 is not available. Counting all residual arcs as if they were comparison arcs would therefore not justify the cut bound. There is a separate counting issue: the represented network has both directions of each input arc, so using ∣E∣|E|∣E∣ for mmm changes the constant in the square-root case.

Formalization scope

Lean represents the network by a finite symmetric arc set with real capacities and antisymmetric real costs. A local unit-capacity predicate marks each reverse pair as capacities (1,0)(1,0)(1,0) or (0,1)(0,1)(0,1); mmm counts the capacity-one orientations. Flows are real valued as on p. 408. Integer costs on that page are generalized to real costs because Lemmas 3–5 use only antisymmetry and reduced-cost inequalities. No result here depends on cost integrality.

The formalization takes the cost-scale state as hypotheses: ε>0\varepsilon>0ε>0, entry circulation and 2ε2\varepsilon2ε-optimality, current ε\varepsilonε-optimality, integral levels, level at least λ\lambdaλ at excess vertices, and zero level at deficits. It takes λ\lambdaλ as a natural number equal to min⁡{m,n2/3}\min\{\sqrt m,n^{2/3}\}min{m​,n2/3} and records the paper's divisibility simplifications. The indexed pigeonhole milestones also require λ>0\lambda>0λ>0 so their index ranges are nonempty; the goal includes the zero-arc boundary without requiring an index. Cuts use reachability after deleting a subset of E+E^+E+, equivalent to meeting every excess-to-deficit path. The proof of Lemma 5 prints “cut in GfG_fGf​”; the formalized claim uses G+G^+G+, the graph for which Lemma 3 gives the required level control and Lemma 4 states its bound.

The definition layer, path-cut lemma and finite counting arguments are the reusable infrastructure. Contributions that establish these exact statements, their necessary elementary flow identities, or a machine-checked goal proof are in scope. Counting mmm with reverse arcs, allowing cuts outside E+E^+E+, using arbitrary real levels in place of integral ones, or replacing both cases by the weaker 36λ36\lambda36λ bound does not express this target.

Selected references

  • A. V. Goldberg, H. Kaplan, S. Hed and R. E. Tarjan, Minimum Cost Flows in Graphs with Unit Capacities, 32nd International Symposium on Theoretical Aspects of Computer Science, LIPIcs 30, pp. 406–419, 2015. doi:10.4230/LIPIcs.STACS.2015.406.
9 thms1 active userReviewed
Algorithmic Game TheoryFunctional Analysis·Captain: mikedeng1

Stochastic Graphon Games: I. The Static Case 2: Under Condition (17) the Unique Nash Equilibrium of a Graphon Game Moves by at Most κ‖W − W′‖ When the Graphon ChangesResearch Paper

Motivation

Large network games can be described by a graphon, a measurable kernel that assigns an interaction weight to each pair of players in a continuum. This representation is useful when a finite network is viewed as an approximation to a limiting network. A basic question is whether a small change in interaction weights can cause a large change in equilibrium behavior. Carmona, Cooney, Graves, and Laurière answer this question for a static game with real actions, noisy player states, and costs coupled through an aggregate state. Their static graphon games paper establishes existence and uniqueness under different hypotheses, and Theorem 3.20 gives an explicit stability estimate under its contraction condition.

The mission isolates that stability estimate and the results on which it depends. It belongs to the same development as the paper's existence theorem, but has a narrower question: how sensitively does the equilibrium respond when one graphon is replaced by another? The paper later studies finite-player approximations, for which understanding the limiting graphon game's equilibrium is useful. Those later approximation theorems are outside this mission.

Setting

The player set is I=[0,1]I=[0,1]I=[0,1] with Lebesgue probability measure. Every player chooses a real action. A strategy profile α\alphaα assigns an action α(x)\alpha(x)α(x) to almost every player and belongs to L2(I)L^2(I)L2(I). Profiles that differ only on a null set represent the same strategy.

A graphon is a symmetric, real-valued, measurable, square-integrable function www on I×II\times II×I. It defines an integral operator WWW on L2(I)L^2(I)L2(I) by

[Wg](x)=∫Iw(x,y)g(y) dy.[Wg](x)=\int_I w(x,y)g(y)\,dy.[Wg](x)=∫I​w(x,y)g(y)dy.

Its norm ∥W∥\|W\|∥W∥ is the L2L^2L2-to-L2L^2L2 operator norm. In particular, interaction weights are allowed to be negative and are not restricted to [0,1][0,1][0,1]. A second graphon w′w'w′ has operator W′W'W′, and ∥W−W′∥\|W-W'\|∥W−W′∥ is the operator norm of their difference.

A player's state is Xa,z,ξ=b(a,z)+ξX_{a,z,\xi}=b(a,z)+\xiXa,z,ξ​=b(a,z)+ξ, where aaa is the player's action, zzz is an aggregate state, and ξ\xiξ has a common centered probability law μ0\mu_0μ0​ with finite second moment. Assumption 1 bounds squared changes in bbb by cαc_\alphacα​ times the squared action change plus czc_zcz​ times the squared aggregate change. For a profile α\alphaα, its aggregate ZαZ\alphaZα is the L2L^2L2 solution of

[Zα](x)=∫Iw(x,y)b(α(y),[Zα](y)) dyfor almost every x∈I.[Z\alpha](x)=\int_I w(x,y)b(\alpha(y),[Z\alpha](y))\,dy \quad\text{for almost every }x\in I.[Zα](x)=∫I​w(x,y)b(α(y),[Zα](y))dyfor almost every x∈I.

Proposition 3.1 states that this aggregate exists and is unique when cz∥W∥<1\sqrt{c_z}\|W\|<1cz​​∥W∥<1. This equation is the deterministic aggregate obtained from the paper's continuum model.

The expected cost of action aaa at aggregate zzz is J(a,z)=∫f(b(a,z)+ξ,a,z) μ0(dξ)J(a,z)=\int f(b(a,z)+\xi,a,z)\,\mu_0(d\xi)J(a,z)=∫f(b(a,z)+ξ,a,z)μ0​(dξ). Assumption 4 says that J(⋅,z)J(\cdot,z)J(⋅,z) is continuously differentiable and uniformly ℓc\ell_cℓc​-strongly convex, and its action derivative changes at most ℓJ∣z−z′∣\ell_J|z-z'|ℓJ​∣z−z′∣ when the aggregate changes. The best response BzBzBz minimizes this cost pointwise. A Nash equilibrium is an L2L^2L2 profile α\alphaα whose action minimizes J(⋅,[Zα](x))J(\cdot,[Z\alpha](x))J(⋅,[Zα](x)) for almost every player. Assumption 5 adds the uniform bound ∣b(a,z)∣≤c0|b(a,z)|\leq c_0∣b(a,z)∣≤c0​.

Formalization targets

The first targets are the unique aggregate of Proposition 3.1, the best-response bound of Lemma 3.7, and the L2L^2L2 aggregate bound (15) of Lemma 3.16. Together these support the uniqueness condition in Proposition 3.17:

ℓJℓccα∥W∥1−cz∥W∥<1.(17)\frac{\ell_J}{\ell_c} \frac{\sqrt{c_\alpha}\|W\|}{1-\sqrt{c_z}\|W\|}<1. \tag{17}ℓc​ℓJ​​1−cz​​∥W∥cα​​∥W∥​<1.(17)

Lemma 3.19 then bounds the change of aggregate when the same profile is placed in two graphons. The goal, Theorem 3.20, concerns an equilibrium α\alphaα for www and any equilibrium α′\alpha'α′ for w′w'w′:

∥α−α′∥L2(I)≤κ∥W−W′∥,κ=c0ℓJ(1−cz∥W∥)(1−cz∥W∥)[ℓc(1−cz∥W∥)−ℓJcα∥W∥].\|\alpha-\alpha'\|_{L^2(I)}\leq\kappa\|W-W'\|, \qquad \kappa=\frac{c_0\ell_J(1-\sqrt{c_z}\|W\|)} {(1-\sqrt{c_z}\|W\|) [\ell_c(1-\sqrt{c_z}\|W\|)-\ell_J\sqrt{c_\alpha}\|W\|]}.∥α−α′∥L2(I)​≤κ∥W−W′∥,κ=(1−cz​​∥W∥)[ℓc​(1−cz​​∥W∥)−ℓJ​cα​​∥W∥]c0​ℓJ​(1−cz​​∥W∥)​.

Here www satisfies both cz∥W∥<1\sqrt{c_z}\|W\|<1cz​​∥W∥<1 and (17), while w′w'w′ is required only to satisfy cz∥W′∥<1\sqrt{c_z}\|W'\|<1cz​​∥W′∥<1. The displayed coefficient is the paper's expression, including its common factor.

Significance

The theorem gives a quantitative guarantee: as long as the original game's contraction condition holds, the distance between equilibria is controlled by the operator distance between graphons. The bound identifies how state sensitivity cα,czc_\alpha,c_zcα​,cz​, cost sensitivity ℓJ\ell_JℓJ​, strong convexity ℓc\ell_cℓc​, and the state bound c0c_0c0​ enter that guarantee. The result also separates two questions: whether an equilibrium exists for a changed graphon, and how far any such equilibrium can lie from the original one.

The mathematical theorem is proved in the paper; the Lean goal is open. A complete formal development would establish the L2L^2L2 integral-operator estimates, the aggregate and best-response regularity results, the unique equilibrium under (17), and finally the stability inequality. The definitions of real-valued graphons, aggregates, and their extended-valued operator norm can support later work on graphon games beyond this particular estimate. The paper's §4 finite-player results, including Theorems 4.3, 4.7, and 4.9, are not posed here.

Difficulty

An equilibrium is a fixed point of a response to an aggregate, so changing the graphon changes both the aggregate and the equilibrium profile. A direct comparison of costs at two equilibria does not by itself separate these effects or yield the printed constant. The aggregate is defined only as an L2L^2L2 equivalence class, while its equation and pointwise best responses use representatives. The formalization must keep those almost-everywhere statements aligned with the operator norm estimate. It must also retain the paper's asymmetric hypotheses: (17) is assumed for the original graphon, while the second graphon is allowed to have any Nash equilibrium under its own aggregate condition.

Formalization scope

Lean uses unitInterval with its volume measure for III, real actions, functions with MemLp for L2L^2L2 profiles, and almost-everywhere equality for profiles and aggregates. IsGraphon includes measurability, symmetry, and square integrability. IsAggregate records equation (6) and membership in L2L^2L2. The integral cost is computed from bbb, fff, and μ0\mu_0μ0​ rather than supplied as an unrelated function. Assumptions 1, 4, and 5 are explicit; the centered noise law is part of the standing model. Lemma 3.7 is stated for an arbitrary cost satisfying Assumption 4, as on the page.

The paper defines equilibrium through a best-response map on a rich Fubini extension. Proposition 3.6 identifies that with the almost-everywhere pointwise minimization condition under Assumption 4. The mission uses that equivalent condition as its equilibrium predicate. This is a disclosed model choice because the Fubini extension itself is not formalized. A best response is selected by classical choice; Assumption 4 gives the minimizer that makes the selection meaningful.

Norm inequalities use extended nonnegative reals. For a square-integrable graphon, its operator norm is finite, and real hypotheses use that finite value. The operator norm is never a real supremum with a default value for unbounded inputs; an equilibrium always includes an aggregate; and an infinite left-side norm is never converted to zero. These choices prevent the stability claim from becoming empty at a bad input. Contributions to the integral-operator infrastructure, the existence and uniqueness of aggregates, and the five named milestones are all within scope.

Selected references

  • René Carmona, Daniel B. Cooney, Christy V. Graves, and Mathieu Laurière, Stochastic Graphon Games: I. The Static Case, arXiv:1911.10664v1, 2019; published in Mathematics of Operations Research, 2022. arXiv
8 thms1 active userReviewed
Bandit AlgorithmsMachine LearningStatistics·Captain: mikedeng1

Personalized Dynamic Pricing with Machine Learning: High-Dimensional Features and Heterogeneous Elasticity 2: Under Unknown Sparsity, Lasso-Based ILQX Pricing Has Regret at Most Cs√T(log d + log T)Research Paper

Motivation

Online sellers of loans, insurance, travel and retail goods observe data about each arriving customer before quoting a price. Using that data to price individually is attractive only if the seller can learn, from its own sales, how demand responds to price for customers with given characteristics. Two features make this hard in practice. The number of recorded characteristics ddd is often large, possibly larger than the selling horizon TTT, while only a few of them matter. And price sensitivity is itself heterogeneous: different customers respond to the same price change differently.

Ban and Keskin (Management Science 67(9), 2021) model both features and ask how fast the revenue lost to learning can grow. Their answer is that a seller who learns with lasso-regularized quasi-likelihood estimation and occasional price experiments loses revenue of order sTs\sqrt TsT​ up to logarithmic factors, where sss is the number of relevant characteristics, and that no policy can do better than order sTs\sqrt TsT​. This mission formalizes the upper bound for the general (nonlinear-link) model with unknown sparsity, Theorem 3 of the paper.

Setting

In each period t=1,2,…,Tt = 1, 2, \dots, Tt=1,2,…,T a customer arrives with a raw feature vector Zt∈RdZ_t \in \mathbb R^dZt​∈Rd. The ZtZ_tZt​ are i.i.d., take values in a compact set Z\mathcal ZZ inside a ball of radius zmax⁡z_{\max}zmax​, have mean zero and positive definite covariance ΣZ\Sigma_ZΣZ​. The seller sees the augmented vector Xt=[1;Zt]∈Rd+1X_t = [1; Z_t] \in \mathbb R^{d+1}Xt​=[1;Zt​]∈Rd+1, charges a price pt∈[ℓ,u]p_t \in [\ell, u]pt​∈[ℓ,u] with 0<ℓ<u0 < \ell < u0<ℓ<u, and observes the demand

Dt=g(α⋅Xt+(β⋅Xt) pt)+εt.D_t = g\big(\alpha \cdot X_t + (\beta \cdot X_t)\, p_t\big) + \varepsilon_t .Dt​=g(α⋅Xt​+(β⋅Xt​)pt​)+εt​.

Here θ=(α,β)\theta = (\alpha, \beta)θ=(α,β) is an unknown parameter in a compact rectangle Θ⊂R2(d+1)\Theta \subset \mathbb R^{2(d+1)}Θ⊂R2(d+1), the link ggg is known, differentiable and increasing with ℓ~≤g′≤u~\tilde\ell \le g' \le \tilde uℓ~≤g′≤u~ on the relevant domain, and the demand shocks εt\varepsilon_tεt​ form a sub-Gaussian martingale difference sequence. The term β⋅Xt\beta \cdot X_tβ⋅Xt​ is the customer's own price sensitivity. With u(p,x)=[1;p]⊗xu(p, x) = [1; p] \otimes xu(p,x)=[1;p]⊗x the argument of ggg is θ⋅u(p,x)\theta \cdot u(p, x)θ⋅u(p,x).

The sparsity of θ\thetaθ is s=∣S∣s = |\mathcal S|s=∣S∣, S={i:αi≠0}∪{i:βi≠0}\mathcal S = \{i : \alpha_i \neq 0\} \cup \{i : \beta_i \neq 0\}S={i:αi​=0}∪{i:βi​=0}. The seller does not know S\mathcal SS.

The expected revenue of price ppp is r(p,θ,x)=p g(θ⋅u(p,x))r(p, \theta, x) = p\, g(\theta \cdot u(p,x))r(p,θ,x)=pg(θ⋅u(p,x)), and the clairvoyant price φ(θ,x)\varphi(\theta, x)φ(θ,x) maximizes it; it is assumed to lie in the interior of [ℓ,u][\ell, u][ℓ,u] for θ∈Θ\theta \in \Thetaθ∈Θ, x∈X={1}×Zx \in \mathcal X = \{1\} \times \mathcal Zx∈X={1}×Z. The regret of a policy over TTT periods is

Δθπ(T)=E[∑t=1Tr∗(θ,Xt)−r(pt,θ,Xt)],r∗(θ,x)=r(φ(θ,x),θ,x).\Delta^\pi_\theta(T) = \mathbb E\Big[\sum_{t=1}^T r^*(\theta, X_t) - r(p_t, \theta, X_t)\Big], \qquad r^*(\theta,x) = r(\varphi(\theta,x),\theta,x).Δθπ​(T)=E[t=1∑T​r∗(θ,Xt​)−r(pt​,θ,Xt​)],r∗(θ,x)=r(φ(θ,x),θ,x).

The policy ILQX(m1,m2,λ)(m_1, m_2, \lambda)(m1​,m2​,λ) charges the experimental price m1m_1m1​ in periods M1={1,4,9,… }M_1 = \{1, 4, 9, \dots\}M1​={1,4,9,…} and m2m_2m2​ in periods M2={2,5,10,… }M_2 = \{2, 5, 10, \dots\}M2​={2,5,10,…}, and otherwise charges φ(PΘθ^t,Xt)\varphi(\mathcal P_\Theta \hat\theta_t, X_t)φ(PΘ​θ^t​,Xt​), where θ^t\hat\theta_tθ^t​ maximizes the lasso-penalized quasi-likelihood

Qt−1(θ~,λt)=∑k=1t−1χk∫Dkg(θ~⋅uk)Dk−yg′(g−1(y)) dy−λt∥θ~∥1Q_{t-1}(\tilde\theta, \lambda_t) = \sum_{k=1}^{t-1} \chi_k \int_{D_k}^{g(\tilde\theta \cdot u_k)} \frac{D_k - y}{g'(g^{-1}(y))}\, dy - \lambda_t \|\tilde\theta\|_1Qt−1​(θ~,λt​)=k=1∑t−1​χk​∫Dk​g(θ~⋅uk​)​g′(g−1(y))Dk​−y​dy−λt​∥θ~∥1​

over the experimental periods (χk=I{k∈M1∪M2}\chi_k = \mathbb I\{k \in M_1 \cup M_2\}χk​=I{k∈M1​∪M2​}), and PΘ\mathcal P_\ThetaPΘ​ is the projection onto Θ\ThetaΘ. The regularization level is λt+1=c~ t1/4log⁡d+log⁡t\lambda_{t+1} = \tilde c\, t^{1/4} \sqrt{\log d + \log t}λt+1​=c~t1/4logd+logt​ for a constant c~>0\tilde c > 0c~>0.

Formalization targets

Goal: Theorem 3

There is a finite constant C~>0\tilde C > 0C~>0 such that

Δθπ(T)≤C~ sT (log⁡d+log⁡T)for all θ∈Θ, T≥2.\Delta^\pi_\theta(T) \le \tilde C\, s \sqrt T\, (\log d + \log T) \qquad \text{for all } \theta \in \Theta,\ T \ge 2 .Δθπ​(T)≤C~sT​(logd+logT)for all θ∈Θ, T≥2.

C~\tilde CC~ is fixed with the model and is uniform over Θ\ThetaΘ; since s=s(θ)s = s(\theta)s=s(θ) varies over Θ\ThetaΘ, the factor sss carries content.

Milestones

  1. The counting property of the schedule (7): for t≥5t \ge 5t≥5 each experimental price is charged at least 14t\tfrac14 \sqrt t41​t​ times in periods 1,…,t1, \dots, t1,…,t.
  2. Lemma 3, the estimation error of the lasso quasi-likelihood estimate:
P{∥θ^t+1(lasso)(λt+1)−θ∥2≤ρ3s(log⁡d+log⁡t)t}≥1−κ3s(log⁡d+log⁡t)t,t≥t1.\mathbb P\Big\{\|\hat\theta^{(\mathrm{lasso})}_{t+1}(\lambda_{t+1}) - \theta\|^2 \le \rho_3 \frac{s(\log d + \log t)}{\sqrt t}\Big\} \ge 1 - \kappa_3 \frac{s(\log d + \log t)}{\sqrt t}, \qquad t \ge t_1 .P{∥θ^t+1(lasso)​(λt+1​)−θ∥2≤ρ3​t​s(logd+logt)​}≥1−κ3​t​s(logd+logt)​,t≥t1​.

Significance

Theorem 3 says that a seller facing many potentially relevant customer characteristics, without knowing which matter and under a nonlinear demand link such as logit, loses revenue at a rate governed by the number sss of relevant characteristics and only logarithmically by the total number ddd. Combined with the paper's sTs\sqrt TsT​ lower bound (Theorem 1, for the linear model), it makes ILQX first-order optimal up to logarithmic factors. An unregularized policy would pay order dTd\sqrt TdT​, which is linear in TTT when ddd exceeds T\sqrt TT​.

The paper's proofs are in its electronic companion, which this mission does not reproduce; no machine-checked version of the result exists. A complete formalization would also produce a reusable high-probability error bound for lasso-regularized quasi-likelihood estimation under adaptively collected data (Lemma 3), and a machine-checked model of feature-based dynamic pricing on which related policies can be stated.

Difficulty

The estimation error must be controlled on data collected by the policy itself. The design vectors uk=[1;mi(k)]⊗Xku_k = [1; m_{i(k)}] \otimes X_kuk​=[1;mi(k)​]⊗Xk​ use only two prices, so the information about the price sensitivity accrues only from the Θ(t)\Theta(\sqrt t)Θ(t​) experimental periods. Standard lasso error bounds assume a fixed or i.i.d. design and a restricted-eigenvalue condition on it; here a restricted-eigenvalue-type property of the random Kronecker design must be derived from ΣZ≻0\Sigma_Z \succ 0ΣZ​≻0 and m1≠m2m_1 \ne m_2m1​=m2​, and the noise enters through a martingale whose conditional law may depend on past prices. The quasi-likelihood is not a least-squares objective, so the curvature comes from the bounds ℓ~≤g′≤u~\tilde\ell \le g' \le \tilde uℓ~≤g′≤u~, which hold only on the bounded domain {θ⋅u(p,x):θ∈Θ}\{\theta \cdot u(p,x) : \theta \in \Theta\}{θ⋅u(p,x):θ∈Θ} and not at an unconstrained estimate. Finally, the regret bound has to turn a squared-error bound holding with probability 1−O(slog⁡(dt)/t)1 - O(s \log(dt)/\sqrt t)1−O(slog(dt)/t​) into an expected revenue loss, which requires the revenue loss to be second order in the parameter error at an interior optimum.

Formalization scope

  • Coordinates. x∈Rd+1x \in \mathbb R^{d+1}x∈Rd+1 is Fin (d+1) → ℝ with the intercept at index 0; θ\thetaθ is Fin 2 × Fin (d+1) → ℝ with θ(0,i)=αi\theta(0,i) = \alpha_iθ(0,i)=αi​, θ(1,i)=βi\theta(1,i) = \beta_iθ(1,i)=βi​. Periods are 1-based. d≥1d \ge 1d≥1.
  • Objective. The integrated form ∑kχk(Dk (θ~⋅uk)−∫0θ~⋅ukg)−λ∥θ~∥1\sum_k \chi_k \big(D_k\,(\tilde\theta \cdot u_k) - \int_0^{\tilde\theta \cdot u_k} g\big) - \lambda \|\tilde\theta\|_1∑k​χk​(Dk​(θ~⋅uk​)−∫0θ~⋅uk​​g)−λ∥θ~∥1​, which differs from the paper's (17) by a term not depending on θ~\tilde\thetaθ~ and therefore has the same maximizers.
  • Estimator. Any measurable selection that is a maximizer whenever one exists; the theorems hold for every such selection. The paper's claim that (17) is strictly concave with a unique maximizer fails when 2(d+1)2(d+1)2(d+1) exceeds the rank of the design.
  • Policy. The price is defined by strong recursion over the realized history; the estimator sees θ\thetaθ only through the realized demands.
  • Regret is a lower Lebesgue integral of nonnegative losses; conditional moments of the shocks use the conditional Lebesgue expectation; probabilities are compared in [0,∞][0, \infty][0,∞].
  • Standing assumptions formalized: i.i.d. measurable features in a compact Z\mathcal ZZ inside a Euclidean ball, mean zero, positive definite ΣZ\Sigma_ZΣZ​; fresh customers (Zt+1Z_{t+1}Zt+1​ independent of the past); sub-Gaussian martingale-difference shocks; m1≠m2m_1 \ne m_2m1​=m2​ in [ℓ,u][\ell, u][ℓ,u]; ggg differentiable and increasing with derivative bounds on the relevant domain (endnote 2 states them as a consequence, which is false; here they are a hypothesis); φ\varphiφ an unconstrained revenue maximizer in (ℓ,u)(\ell, u)(ℓ,u) whose pricing map after projection and feature augmentation is measurable. The processes are constrained only at the used periods t≥1t\ge1t≥1.
  • Added hypotheses, per θ\thetaθ: s(θ)≥1s(\theta) \ge 1s(θ)≥1 (the paper's s∈{1,…,d+1}s \in \{1, \dots, d+1\}s∈{1,…,d+1}), and almost surely every realized demand lies in the closure of the range of ggg, which guarantees that a maximizer of (17) exists (true for the linear link and for binary demand under a logit link).
  • Not formalized: the paper's support condition on continuous features; Remark 7's independence of C~\tilde CC~ from ddd; dependence of the shock law on θ\thetaθ (the shocks are one fixed process).
  • Ruled-out trivializations. The regret cannot vanish by non-integrability; the estimator cannot be an arbitrary function, since it must maximize the objective; C~\tilde CC~ and κ3,ρ3,t1\kappa_3, \rho_3, t_1κ3​,ρ3​,t1​ are chosen before θ\thetaθ, so they cannot absorb sss; the hypotheses are jointly satisfiable (a linear-link instance with d=1d = 1d=1 is checked).

Contributions welcome: existence of a measurable maximizer of the objective, the counting lemma, and supporting lemmas for Lemma 3 and the regret bound.

Selected references

  • G.-Y. Ban and N. B. Keskin, Personalized Dynamic Pricing with Machine Learning: High-Dimensional Features and Heterogeneous Elasticity, Management Science 67(9):5549–5568, 2021. https://doi.org/10.1287/mnsc.2020.3680
  • A. V. den Boer and B. Zwart, Simultaneously Learning and Optimizing Using Controlled Variance Pricing, Management Science 60(3):770–783, 2014. https://doi.org/10.1287/mnsc.2013.1788
  • N. B. Keskin and A. Zeevi, Dynamic Pricing with an Unknown Demand Model: Asymptotically Optimal Semi-Myopic Policies, Operations Research 62(5):1142–1167, 2014. https://doi.org/10.1287/opre.2014.1294
  • A. Javanmard and H. Nazerzadeh, Dynamic Pricing in High-Dimensions, Journal of Machine Learning Research 20(9):1–49, 2019. https://jmlr.org/papers/v20/17-357.html
6 thms1 active userReviewed
Dynamic ProgrammingMarkov ChainProbability·Captain: mikedeng1

Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities 2: Setwise-Continuous Observations Do Not Make the Belief Transition Weakly ContinuousResearch Paper

Motivation

A partially observable Markov decision process describes a controlled system whose state is hidden but whose observations are available to a decision maker. The distribution of the hidden state conditional on the observations is the belief state. Replacing the hidden state by this distribution turns the model into a fully observed decision process, provided the resulting belief transition has the regularity needed by the usual existence and dynamic programming results. Feinberg, Kasyanov, and Zgurovsky give sufficient conditions for that regularity in their study of total-cost POMDPs, Theorems 3.6 and 3.7.

Their observation-kernel condition is continuity in total variation. Example 4.1 of the same paper tests its sharpness: the authors construct a two-state model with setwise-continuous observations for which the belief transition fails to be weakly continuous. This matters when selecting assumptions for a POMDP theorem. Setwise convergence already requires convergence of the probabilities of every fixed observation event, so it can look adequate for belief updates. The example shows that it is still too weak for the stated conclusion.

Setting

The hidden state space is X={1,2}X=\{1,2\}X={1,2} and the observation space is Y=[0,1]Y=[0,1]Y=[0,1] with Lebesgue probability measure mmm. The action space is A={0}∪{1/n:n=1,2,…}A=\{0\}\cup\{1/n:n=1,2,\ldots\}A={0}∪{1/n:n=1,2,…}, equipped with the topology inherited from R\mathbb RR. The state does not move: its transition law P(⋅∣x,a)P(\cdot\mid x,a)P(⋅∣x,a) is the point mass at xxx for every action. Its continuity in total variation is immediate from this fixed-state behavior.

At hidden state 1 the observation law is always mmm. At hidden state 2, action zero also produces mmm. Under action 1/n1/n1/n, state 2 produces a law m(n)=f(n)mm^{(n)}=f^{(n)}mm(n)=f(n)m. The density f(n)f^{(n)}f(n) equals zero on the open left half of each cell in the 2n2^n2n-part dyadic partition and equals two elsewhere, including the cell endpoints. Equation (4.1) gives the exact intervals. These laws oscillate more rapidly as nnn grows, and the paper establishes m(n)(C)→m(C)m^{(n)}(C)\to m(C)m(n)(C)→m(C) for every fixed Borel set CCC. Thus the observation kernel Q(⋅∣a,x)Q(\cdot\mid a,x)Q(⋅∣a,x) is setwise continuous even at the accumulation action zero. Example 4.1, pp. 13–14.

A belief z∈P(X)z\in\mathcal P(X)z∈P(X) assigns a probability to each hidden state. For a current belief zzz and an action aaa, the joint law R(⋅∣z,a)R(\cdot\mid z,a)R(⋅∣z,a) covers the next state and its observation, and R′(⋅∣z,a)R'(\cdot\mid z,a)R′(⋅∣z,a) is the observation marginal. A filter H(z,a,y)H(z,a,y)H(z,a,y) is a conditional law of the next state given observation yyy: it satisfies the disintegration identity (3.3). The belief transition qH(⋅∣z,a)q_H(\cdot\mid z,a)qH​(⋅∣z,a) is the law of the random posterior H(z,a,y)H(z,a,y)H(z,a,y) when yyy has law R′(⋅∣z,a)R'(\cdot\mid z,a)R′(⋅∣z,a). These objects are defined in (3.1)–(3.5) of the paper. Different versions of HHH agree only almost everywhere for each current belief and action, yet they yield the same belief transition.

Formalization targets

Example 4.1: failure of weak belief continuity

At the uniform belief z=(1/2,1/2)z=(1/2,1/2)z=(1/2,1/2), action zero reveals nothing, while every positive-index action produces the same two-point posterior law:

qH(⋅∣z,0)=δz,qH(⋅∣z,1/n)=34δ(1/3,2/3)+14δ(1,0)(n≥1).q_H(\cdot\mid z,0)=\delta_z,\qquad q_H(\cdot\mid z,1/n)=\tfrac34\delta_{(1/3,2/3)}+\tfrac14\delta_{(1,0)} \quad(n\ge1).qH​(⋅∣z,0)=δz​,qH​(⋅∣z,1/n)=43​δ(1/3,2/3)​+41​δ(1,0)​(n≥1).

The mission's goal asserts that PPP is total-variation continuous, QQQ is a setwise-continuous probability kernel, a valid filter exists, and the positive-index laws fail to converge weakly to the zero-action law as 1/n→01/n\to01/n→0. It states the failure for every filter satisfying (3.3), so it is a property of the POMDP rather than of a selected version of its conditional distribution. The milestone list follows the paper's assertions: setwise convergence of the dyadic laws, setwise continuity of QQQ, the two posterior values almost everywhere, and the explicit laws of qHq_HqH​.

Significance

The example identifies a precise boundary of the sufficient condition in Theorems 3.6 and 3.7. Those theorems use total-variation continuity of the observation law to obtain a weakly continuous belief transition; replacing that premise by setwise continuity makes their continuity conclusion false in this model. The explicit law also shows the size of the discrepancy: the positive-index belief transition has two fixed atoms, while the zero-action transition is concentrated at the original belief. Example 4.1, pp. 13–14.

A machine-checked development would add reusable definitions of sequential kernel continuity, the joint state-observation law, conditional filters, and the belief transition on the Borel space of probability measures. It would also formalize a concrete setwise-convergent sequence of densities whose induced posterior laws do not converge weakly. The paper proves the example; the Lean statements in this proposal are open proof targets, with no completed machine-checked proof claimed here.

Difficulty

Setwise continuity controls Q(C∣a,x)Q(C\mid a,x)Q(C∣a,x) for each fixed Borel set CCC. A posterior is a probability measure determined by the observation, and the belief transition tests the distribution of those posterior measures. The observation regions distinguishing the states change with nnn, so convergence on fixed observation sets does not imply convergence of their posterior distributions. This is the gap in the immediate argument that tries to pass from setwise convergence of QQQ to weak convergence of qHq_HqH​.

The conditional filter adds a second precision issue. Equation (3.3) determines its values only almost surely under the observation marginal, and different versions may disagree on null observations. Any claim about a posterior value at every yyy would exceed the source; the posterior milestone therefore has an almost-everywhere qualifier, while the goal quantifies over every valid version of HHH.

Formalization scope

Lean represents XXX by Fin 2, with 0 for the paper's state 1 and 1 for state 2; YYY by unitInterval; and AAA by the specified subtype of R\mathbb RR. Positive integers are a subtype of N\mathbb NN, so the density and the action 1/n1/n1/n are never evaluated at n=0n=0n=0. The measure mmm is volume on unitInterval, which has total mass one. The density follows (4.1) literally, with open zero intervals and density two at their endpoints. The general transition PPP and observation law QQQ use Mathlib kernels; the example instantiates them directly. The goal includes the probability-kernel property of the concrete QQQ and existence of a valid HHH, guarding the universal filter clause against vacuity.

Weak, setwise, and total-variation convergence are sequential, as on page 4. The weak test class consists of bounded continuous real functions; the setwise test class consists of all Borel sets. The target space of qHq_HqH​ carries the Borel σ-algebra of the weak topology on P(X)\mathcal P(X)P(X), stated explicitly because Mathlib's default measurable structure on that type is the Giry σ-algebra. The filter predicate requires measurability in yyy for fixed (z,a)(z,a)(z,a) in both structures. Joint measurability in (z,a,y)(z,a,y)(z,a,y) is described in the paper but is not encoded in this local predicate; only the fixed-parameter property is used by (3.3) and (3.5). This choice and its quantifier effect are recorded in the moderation notes.

No cost, initial observation kernel, initial prior, or discount factor enters Example 4.1. Contributions on the dyadic law, kernel continuity, conditional posterior values, and the resulting belief-law identity are all within scope. A filter hard-coded to return the prior belief, a discrete topology on AAA, or a claim for only one version of HHH would change the counterexample and is excluded by the definitions and goal.

Selected references

  • E. A. Feinberg, P. O. Kasyanov, and M. Z. Zgurovsky, Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities, Mathematics of Operations Research 41(2), 2016; arXiv:1401.2168v2. This mission follows the pinned preprint's numbering and pages.
6 thms1 active userReviewed
Dynamic ProgrammingMarkov ChainProbability·Captain: mikedeng1

Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities 1: The Belief MDP Satisfies Assumption (W*) Under Total-Variation-Continuous ObservationsResearch Paper

Motivation

A partially observable Markov decision process (POMDP) models a controller that cannot see the state of the system it steers, only noisy observations of it. Inventory control with unrecorded demand, machine maintenance with imperfect inspection, and target tracking from sensor readings all have this form. The standard way to solve a POMDP is to replace it by its belief MDP, also called the completely observable MDP (COMDP): the state becomes the posterior distribution of the hidden state given everything observed so far. The belief MDP is fully observed, so the theory of Markov decision processes applies to it, but only if the belief MDP satisfies that theory's hypotheses. For MDPs with Borel state and action spaces, unbounded costs and possibly noncompact action sets, the hypothesis that yields optimality equations, convergence of value iterations and stationary optimal policies is Assumption (W*) of Feinberg, Kasyanov and Zadoianchuk (Math. Oper. Res. 2012): the cost is K\mathbb KK-inf-compact and the transition probability is weakly continuous.

Before Feinberg, Kasyanov and Zgurovsky (arXiv:1401.2168v2, published in Math. Oper. Res. 41(2), 2016), sufficient conditions for the belief MDP to be weakly continuous required a weakly continuous filter (Hernández-Lerma, 1989, as recalled on p. 11 of arXiv:1401.2168v2), a condition that fails in many natural models. The paper replaces it by a condition on the primitive data of the POMDP.

Setting

Let X\mathbb XX (states), Y\mathbb YY (observations) and A\mathbb AA (actions) be Borel subsets of Polish spaces. Let P(dx′∣x,a)P(dx' \mid x, a)P(dx′∣x,a) be the transition kernel on X\mathbb XX given X×A\mathbb X \times \mathbb AX×A, Q(dy∣a,x)Q(dy \mid a, x)Q(dy∣a,x) the observation kernel on Y\mathbb YY given A×X\mathbb A \times \mathbb XA×X, and c:X×A→R∪{+∞}c : \mathbb X \times \mathbb A \to \mathbb R \cup \{+\infty\}c:X×A→R∪{+∞} a Borel one-step cost bounded below. P(X)\mathbb P(\mathbb X)P(X) is the set of probability measures on X\mathbb XX with the topology of weak convergence (∫f dμn→∫f dμ\int f\,d\mu_n \to \int f\,d\mu∫fdμn​→∫fdμ for bounded continuous fff). A sequence μn\mu_nμn​ converges setwise if μn(C)→μ(C)\mu_n(C) \to \mu(C)μn​(C)→μ(C) for every Borel CCC, and in the total variation if sup⁡f∣∫f dμn−∫f dμ∣→0\sup_f |\int f\,d\mu_n - \int f\,d\mu| \to 0supf​∣∫fdμn​−∫fdμ∣→0 over Borel fff with values in [−1,1][-1, 1][−1,1]. A kernel is weakly (setwise, total-variation) continuous if xn→xx_n \to xxn​→x implies the corresponding convergence of the measures.

For a belief z∈P(X)z \in \mathbb P(\mathbb X)z∈P(X) and an action aaa, let R(B×C∣z,a)=∫X∫BQ(C∣a,x′) P(dx′∣x,a) z(dx)R(B \times C \mid z, a) = \int_{\mathbb X} \int_B Q(C \mid a, x')\,P(dx' \mid x, a)\,z(dx)R(B×C∣z,a)=∫X​∫B​Q(C∣a,x′)P(dx′∣x,a)z(dx) be the joint law of the next state and observation (3.1), and R′(C∣z,a)=R(X×C∣z,a)R'(C \mid z, a) = R(\mathbb X \times C \mid z, a)R′(C∣z,a)=R(X×C∣z,a) its observation marginal (3.2). A filter is a kernel H(dx∣z,a,y)H(dx \mid z, a, y)H(dx∣z,a,y) with R(B×C∣z,a)=∫CH(B∣z,a,y) R′(dy∣z,a)R(B \times C \mid z, a) = \int_C H(B \mid z, a, y)\,R'(dy \mid z, a)R(B×C∣z,a)=∫C​H(B∣z,a,y)R′(dy∣z,a) (3.3): H(z,a,y)H(z, a, y)H(z,a,y) is the posterior after observing yyy. The belief MDP has state space P(X)\mathbb P(\mathbb X)P(X), action set A\mathbb AA, cost cˉ(z,a)=∫c(x,a) z(dx)\bar c(z, a) = \int c(x, a)\,z(dx)cˉ(z,a)=∫c(x,a)z(dx) (3.8), and transition q(⋅∣z,a)q(\cdot \mid z, a)q(⋅∣z,a), the law of H(z,a,y)H(z, a, y)H(z,a,y) when y∼R′(⋅∣z,a)y \sim R'(\cdot \mid z, a)y∼R′(⋅∣z,a) (3.5). A cost is K\mathbb KK-inf-compact on S1×S2\mathbb S_1 \times \mathbb S_2S1​×S2​ if its restriction to K×S2K \times \mathbb S_2K×S2​ has compact level sets for every compact K⊆S1K \subseteq \mathbb S_1K⊆S1​.

Formalization targets

Goal: Theorem 3.6

If either Assumption (D) (0≤α<10 \le \alpha < 10≤α<1) or Assumption (P) (c≥0c \ge 0c≥0 and 0≤α≤10 \le \alpha \le 10≤α≤1) holds, ccc is bounded below and K\mathbb KK-inf-compact on X×A\mathbb X \times \mathbb AX×A, PPP is weakly continuous and QQQ is continuous in the total variation, then the belief MDP satisfies Assumption (W*):

cˉ is bounded below and K-inf-compact on P(X)×A,(zn,an)→(z,a)  ⟹  q(⋅∣zn,an)→q(⋅∣z,a) weakly.\bar c \text{ is bounded below and } \mathbb K\text{-inf-compact on } \mathbb P(\mathbb X) \times \mathbb A, \qquad (z_n, a_n) \to (z, a) \implies q(\cdot \mid z_n, a_n) \to q(\cdot \mid z, a) \text{ weakly}.cˉ is bounded below and K-inf-compact on P(X)×A,(zn​,an​)→(z,a)⟹q(⋅∣zn​,an​)→q(⋅∣z,a) weakly.

The two halves

  • Cost half (Theorem 3.4, through Lemma 6.1 and Lemma 5.1(ii)): cˉ\bar ccˉ is bounded below by the same constant as ccc and K\mathbb KK-inf-compact.
  • Transition half (Theorem 3.7): under the hypotheses on PPP and QQQ, R′R'R′ is setwise continuous and Assumption (H) holds: whenever zn→zz_n \to zzn​→z and an→aa_n \to aan​→a, along a subsequence H(znk,ank,y)→H(z,a,y)H(z_{n_k}, a_{n_k}, y) \to H(z, a, y)H(znk​​,ank​​,y)→H(z,a,y) weakly for R′(⋅∣z,a)R'(\cdot \mid z, a)R′(⋅∣z,a)-almost every yyy. Theorem 3.5 then gives weak continuity of qqq. The route runs through Theorem 5.2, Lemma 5.3, Corollary 5.4, Theorem 5.5 and Lemma 5.6.

Significance

Theorem 3.6 supplies the hypothesis under which the cited general MDP theory gives stationary optimal policies, optimality equations and convergence of value iterations for total-cost POMDPs in terms of PPP, QQQ and ccc alone, without compactness of the action set, boundedness of the cost or continuity of the filter. It covers, for example, observation kernels with densities continuous in (a,x)(a, x)(a,x), and the paper applies it to inventory control with incomplete records and to the Kalman filter. Example 4.1 of the same paper shows that total-variation continuity of QQQ cannot be weakened to setwise continuity.

The result is proved in the paper; this proposal poses its formal statement and the supporting results as proof targets. Completing them would provide a checked bridge from POMDPs to the general MDP theory under weak continuity, together with reusable facts about weak, setwise and total-variation convergence: equicontinuity of integrals against weakly continuous kernels (Theorem 5.2), the convergence-in-probability criterion (Theorem 5.5), and the generalized Fatou lemmas.

Difficulty

The posterior H(z,a,y)H(z, a, y)H(z,a,y) is defined only for R′(⋅∣z,a)R'(\cdot \mid z, a)R′(⋅∣z,a)-almost every yyy and has no continuous version in general, so weak continuity of qqq cannot be read off from continuity of HHH. The tempting argument, that continuous PPP and QQQ make the Bayes posterior move continuously, fails: Y\mathbb YY need not be countable and QQQ need not have densities. What has to be controlled is the joint law RRR on sets (O1∖O2)×C(\mathcal O_1 \setminus \mathcal O_2) \times C(O1​∖O2​)×C uniformly in the observation set CCC; convergence for each fixed CCC is not enough. Turning this uniform control into almost-sure convergence of posteriors along a subsequence requires a diagonal argument over a countable base of X\mathbb XX. On the cost side, the difficulty is that ccc may take the value +∞+\infty+∞ and is not continuous; K\mathbb KK-inf-compactness has to be transported through integration against a weakly converging sequence of measures.

Formalization scope

All definitions live in FeinbergPOMDP.WStar.Model. X,Y,A\mathbb X, \mathbb Y, \mathbb AX,Y,A are separable metrizable spaces with their Borel σ-algebras (PolishSpace is not assumed, since Borel subsets of Polish spaces need not be Polish); X\mathbb XX is additionally nonempty and standard Borel in Theorems 3.6 and 3.7, where a filter must exist. P(X)\mathbb P(\mathbb X)P(X) is Mathlib's ProbabilityMeasure with the weak topology. All continuity notions are the paper's sequential ones; total variation is the supremum over Borel functions with values in [−1,1][-1, 1][−1,1], written in ε\varepsilonε–NNN form, while the set-indexed suprema of (5.15) and (5.17) keep their set form. The cost is written c=ℓ+fc = \ell + fc=ℓ+f with ℓ∈R\ell \in \mathbb Rℓ∈R and fff taking values in [0,∞][0, \infty][0,∞], so cˉ=ℓ+∫f dz\bar c = \ell + \int f\,dzcˉ=ℓ+∫fdz, exact even when c=+∞c = +\inftyc=+∞ on a set of positive measure. K\mathbb KK-inf-compactness is the published FeinbergLiang.ACOE.KInfCompact. A filter is a map H:P(X)→A→Y→P(X)H : \mathbb P(\mathbb X) \to \mathbb A \to \mathbb Y \to \mathbb P(\mathbb X)H:P(X)→A→Y→P(X) that satisfies (3.3) and is jointly Borel measurable in (z,a,y)(z,a,y)(z,a,y), as the paper's stochastic kernel is; qqq is the image of R′R'R′ under H(z,a,⋅)H(z, a, \cdot)H(z,a,⋅) for the Borel σ-algebra of the weak topology on P(X)\mathbb P(\mathbb X)P(X).

Since qqq does not depend on the choice of filter, every statement about qqq is made for every filter satisfying (3.3). A fixed filter that ignores the observation, such as H(z,a,y)=zH(z, a, y) = zH(z,a,y)=z, would make qqq a point mass and the weak continuity trivial; it satisfies (3.3) only when observations carry no information, and is excluded by quantifying over all filters.

The goal states the Assumption (W*) conclusion of Theorem 3.6. Its tail, "statements (i)–(vi) of Theorem 3.1 hold", invokes Theorem 2.1 of Feinberg et al. (2012) applied to the belief MDP; it is cited rather than proved in this paper. Generalized Fatou's lemmas 5.1(i) and 5.1(ii) are referenced from the published Schäl (1993) items. A complete development needs weak and setwise convergence on ProbabilityMeasure, portmanteau-type arguments, disintegration (Measure.condKernel) and the identification of the Borel and Giry σ-algebras on P(X)\mathbb P(\mathbb X)P(X); the last is missing from Mathlib and is a welcome contribution in its own right. Proofs of any milestone, and alternative arguments for Theorem 3.7, are welcome.

Selected references

  • E. A. Feinberg, P. O. Kasyanov, M. Z. Zgurovsky, Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities, arXiv:1401.2168v2 (2014); Mathematics of Operations Research 41(2), 2016. https://arxiv.org/abs/1401.2168v2
  • E. A. Feinberg, P. O. Kasyanov, N. V. Zadoianchuk, Average-cost Markov decision processes with weakly continuous transition probabilities, Mathematics of Operations Research 37(4), 2012. https://doi.org/10.1287/moor.1120.0555
  • D. P. Bertsekas, S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978. https://web.mit.edu/dimitrib/www/soc.html
  • M. Schäl, Average optimality in dynamic programming with general state space, Mathematics of Operations Research 18(1), 1993. https://doi.org/10.1287/moor.18.1.163
14 thms1 active userReviewed
Algorithmic Game TheoryFunctional Analysis·Captain: mikedeng1

Stochastic Graphon Games: I. The Static Case 1: If the State Map b Is Bounded and √c_z‖W‖ < 1, the Graphon Game Has at Least One Nash EquilibriumResearch Paper

Motivation

Games with many interacting players appear in economics, epidemiology and network engineering: firms competing in a market, individuals deciding whether to vaccinate, agents in a social network choosing an effort level. When every player interacts with every other player symmetrically, mean field game theory replaces the finite game by a limit with a continuum of players. Real interactions are rarely symmetric: who influences whom is described by a network, and large networks are described in the limit by a graphon (Lovász, Large networks and graph limits, 2012).

Graphon games combine the two ideas. Parise and Ozdaglar (2018) studied deterministic graphon games with continuous strategy sets. Carmona, Cooney, Graves and Laurière (2019) introduced idiosyncratic random shocks, giving a stochastic graphon game in which each player's state is perturbed by independent noise, and proved existence, uniqueness and stability of Nash equilibria as well as convergence of finite network games to the graphon limit. This mission formalizes their existence theorem (Theorem 3.15).

Setting

The players form the interval I=[0,1]I=[0,1]I=[0,1] with Lebesgue measure λI\lambda_IλI​. Each player x∈Ix\in Ix∈I chooses an action αx∈A=R\alpha_x\in A=\mathbb Rαx​∈A=R; a strategy profile is a function α∈L2(I)\alpha\in L^2(I)α∈L2(I), defined up to λI\lambda_IλI​-null sets.

A graphon is a symmetric, Borel-measurable function w:I×I→Rw:I\times I\to\mathbb Rw:I×I→R with ∫I×Iw(x,y)2 dx dy<∞\int_{I\times I}w(x,y)^2\,dx\,dy<\infty∫I×I​w(x,y)2dxdy<∞. It acts on L2(I)L^2(I)L2(I) through the graphon operator

[Wg]x=∫Iw(x,y) g(y) dy,∥W∥=sup⁡∥φ∥L2(I)=1∥Wφ∥L2(I).[\mathbf Wg]_x=\int_I w(x,y)\,g(y)\,dy,\qquad \|\mathbf W\|=\sup_{\|\varphi\|_{L^2(I)}=1}\|\mathbf W\varphi\|_{L^2(I)}.[Wg]x​=∫I​w(x,y)g(y)dy,∥W∥=∥φ∥L2(I)​=1sup​∥Wφ∥L2(I)​.

A state map b:R×R→Rb:\mathbb R\times\mathbb R\to\mathbb Rb:R×R→R and a noise law μ0\mu_0μ0​ on R\mathbb RR define the state Xα,z,ξ=b(α,z)+ξX_{\alpha,z,\xi}=b(\alpha,z)+\xiXα,z,ξ​=b(α,z)+ξ of a player who takes action α\alphaα, feels aggregate zzz, and receives shock ξ∼μ0\xi\sim\mu_0ξ∼μ0​. Assumption 1 asks that ∣b(α,z)−b(α′,z′)∣2≤cα∣α−α′∣2+cz∣z−z′∣2|b(\alpha,z)-b(\alpha',z')|^2\le c_\alpha|\alpha-\alpha'|^2+c_z|z-z'|^2∣b(α,z)−b(α′,z′)∣2≤cα​∣α−α′∣2+cz​∣z−z′∣2 and that μ0\mu_0μ0​ has mean zero and a finite second moment.

The aggregate Zα\mathbf Z\alphaZα felt by the players under a profile α\alphaα is the solution z∈L2(I)z\in L^2(I)z∈L2(I) of

zx=∫Iw(x,y) b(αy,zy) dyfor λI-a.e. x.(6)z_x=\int_I w(x,y)\,b(\alpha_y,z_y)\,dy\qquad\text{for }\lambda_I\text{-a.e. }x.\tag{6}zx​=∫I​w(x,y)b(αy​,zy​)dyfor λI​-a.e. x.(6)

A player choosing α\alphaα against aggregate zzz pays J(α,z)=∫f(b(α,z)+ξ,α,z) μ0(dξ)J(\alpha,z)=\int f(b(\alpha,z)+\xi,\alpha,z)\,\mu_0(d\xi)J(α,z)=∫f(b(α,z)+ξ,α,z)μ0​(dξ). Assumption 4 asks that J(⋅,z)J(\cdot,z)J(⋅,z) be continuously differentiable and ℓc\ell_cℓc​-strongly convex uniformly in zzz, and that ∂αJ\partial_\alpha J∂α​J be ℓJ\ell_JℓJ​-Lipschitz in zzz. Assumption 5 asks that bbb be bounded: ∣b(α,z)∣≤c0|b(\alpha,z)|\le c_0∣b(α,z)∣≤c0​ for some finite c0>0c_0>0c0​>0. The best response [Bz]x[\mathbf Bz]_x[Bz]x​ is the unique minimizer of α↦J(α,zx)\alpha\mapsto J(\alpha,z_x)α↦J(α,zx​).

A Nash equilibrium is a profile α^∈L2(I)\hat\alpha\in L^2(I)α^∈L2(I) such that, for λI\lambda_IλI​-a.e. player xxx and every action β\betaβ,

J(α^x,(Zα^)x)≤J(β,(Zα^)x).J(\hat\alpha_x,(\mathbf Z\hat\alpha)_x)\le J(\beta,(\mathbf Z\hat\alpha)_x).J(α^x​,(Zα^)x​)≤J(β,(Zα^)x​).

Formalization targets

Goal: Theorem 3.15 (existence)

Assumptions 1, 4, 5 and cz ∥W∥<1 ⟹ there is at least one Nash equilibrium.\text{Assumptions 1, 4, 5 and }\sqrt{c_z}\,\|\mathbf W\|<1\ \Longrightarrow\ \text{there is at least one Nash equilibrium.}Assumptions 1, 4, 5 and cz​​∥W∥<1 ⟹ there is at least one Nash equilibrium.

The statement fixes no constants and asserts no uniqueness.

Milestones

  1. Proposition 3.1: under cz∥W∥<1\sqrt{c_z}\|\mathbf W\|<1cz​​∥W∥<1, (6) has a unique solution in L2(I)L^2(I)L2(I) for every α∈L2(I)\alpha\in L^2(I)α∈L2(I).
  2. Lemma 3.7: ∥Bz1−Bz2∥L2≤(ℓJ/ℓc)∥z1−z2∥L2\|\mathbf Bz^1-\mathbf Bz^2\|_{L^2}\le(\ell_J/\ell_c)\|z^1-z^2\|_{L^2}∥Bz1−Bz2∥L2​≤(ℓJ​/ℓc​)∥z1−z2∥L2​.
  3. Lemma 3.16, (15): ∥Zα1−Zα2∥L2≤cα∥W∥1−cz∥W∥∥α1−α2∥L2\|\mathbf Z\alpha^1-\mathbf Z\alpha^2\|_{L^2}\le\dfrac{\sqrt{c_\alpha}\|\mathbf W\|}{1-\sqrt{c_z}\|\mathbf W\|}\|\alpha^1-\alpha^2\|_{L^2}∥Zα1−Zα2∥L2​≤1−cz​​∥W∥cα​​∥W∥​∥α1−α2∥L2​.
  4. Proof of Theorem 3.15, first claim: with χ=c0\chi=c_0χ=c0​ and Bχ={g∈L2(I):∥g∥≤χ}B_\chi=\{g\in L^2(I):\|g\|\le\chi\}Bχ​={g∈L2(I):∥g∥≤χ}, every aggregate lies in W(Bχ)\mathbf W(B_\chi)W(Bχ​).
  5. Proof of Theorem 3.15, second claim: W(Bχ)\mathbf W(B_\chi)W(Bχ​) is relatively compact in L2(I)L^2(I)L2(I).

Significance

The existence theorem holds under mild hypotheses: unlike the uniqueness result of the same paper (Proposition 3.17), it needs no smallness condition linking ℓJ/ℓc\ell_J/\ell_cℓJ​/ℓc​, cαc_\alphacα​ and ∥W∥\|\mathbf W\|∥W∥. Boundedness of the state map takes its place. Existence of a graphon equilibrium is the starting point for the paper's §4, where graphon equilibria are shown to be limits of equilibria of finite network games and to yield ϵ\epsilonϵ-Nash equilibria for them.

The result is proved in the paper; no part of it is machine-checked. A complete formalization yields reusable pieces beyond this mission: square-integrable kernel operators on L2[0,1]L^2[0,1]L2[0,1] with their operator norm, the Hilbert–Schmidt compactness of such operators, Lipschitz dependence of minimizers of uniformly strongly convex functions on a parameter, and Schauder's fixed-point theorem on a Banach space, which is not in Mathlib.

Difficulty

A contraction argument does not apply: the best-response-of-aggregate map BZ\mathbf B\mathbf ZBZ is Lipschitz with constant ℓJℓc⋅cα∥W∥1−cz∥W∥\frac{\ell_J}{\ell_c}\cdot\frac{\sqrt{c_\alpha}\|\mathbf W\|}{1-\sqrt{c_z}\|\mathbf W\|}ℓc​ℓJ​​⋅1−cz​​∥W∥cα​​∥W∥​, which may exceed 111 under the hypotheses of the theorem. Existence therefore rests on a compactness fixed-point theorem in the infinite-dimensional space L2(I)L^2(I)L2(I). That requires compactness of the integral operator W\mathbf WW, which Mathlib does not provide for kernel operators, and Schauder's theorem itself, which Mathlib does not have. A bounded convex set in L2(I)L^2(I)L2(I) is not compact, so Brouwer-type finite-dimensional arguments do not transfer directly.

Formalization scope

All statements live in the namespace GraphonGames.Existence and share one definitions file.

  • III is Mathlib's unitInterval with volume. Profiles and aggregates are functions I→RI\to\mathbb RI→R with MemLp _ 2 volume; equalities between them are almost-everywhere equalities.
  • The action set is R\mathbb RR.
  • ∥W∥\|\mathbf W\|∥W∥ is the supremum, in [0,∞][0,\infty][0,∞], of ∥Wφ∥L2\|\mathbf W\varphi\|_{L^2}∥Wφ∥L2​ over ∥φ∥L2=1\|\varphi\|_{L^2}=1∥φ∥L2​=1; the graphon condition makes it finite, and the hypothesis cz∥W∥<1\sqrt{c_z}\|\mathbf W\|<1cz​​∥W∥<1 uses its real value.
  • The aggregate is a predicate: zzz is an aggregate of α\alphaα when z∈L2(I)z\in L^2(I)z∈L2(I) and (6) holds a.e. Remark 3.3's identity Zα=W[b(α,Zα)]\mathbf Z\alpha=\mathbf W[b(\alpha,\mathbf Z\alpha)]Zα=W[b(α,Zα)] is then the definition itself, the noise having mean zero.
  • The best response is a choice of minimizer, which exists and is unique under Assumption 4.
  • Pinned definition. The paper defines equilibrium (Definition 3.4) as a fixed point of a best response built on a rich Fubini extension, and states in Proposition 3.6 that under Assumption 4 this is equivalent to the a.e. best-response inequality above. The formalization takes that inequality as the definition. Fubini extensions and the exact law of large numbers (Proposition 3.2) are not formalized.
  • Norm inequalities are stated in [0,∞][0,\infty][0,∞], so an infinite left-hand side cannot make a bound vacuous.

Trivializing encodings are excluded: the operator norm is not a real supremum that could collapse to 000; an equilibrium must come with its aggregate solving (6), be square-integrable, and beat every action β∈R\beta\in\mathbb Rβ∈R for almost every player; and no norm is converted to a real number where it could be infinite.

The results of §4 (Theorems 4.3, 4.7, 4.9 on finite network games) and the uniqueness and stability results (Proposition 3.17, Theorem 3.20) are not posed in this mission. Contributions welcome include Schauder's fixed-point theorem, the compactness of Hilbert–Schmidt integral operators on L2L^2L2, and the contraction argument behind Proposition 3.1.

Selected references

  • R. Carmona, D. B. Cooney, C. V. Graves, M. Laurière, Stochastic Graphon Games: I. The Static Case, arXiv:1911.10664v1, 2019; Mathematics of Operations Research 47(1), 2022. https://arxiv.org/abs/1911.10664
  • F. Parise, A. Ozdaglar, Graphon games, arXiv:1802.00080, 2018. https://arxiv.org/abs/1802.00080
  • L. Lovász, Large Networks and Graph Limits, AMS Colloquium Publications 60, 2012. https://doi.org/10.1090/coll/060
  • R. Carmona, F. Delarue, Probabilistic Theory of Mean Field Games with Applications I, Springer, 2018. https://doi.org/10.1007/978-3-319-58920-6
7 thms1 active userReviewed
Bandit AlgorithmsProbabilityStatistics·Captain: mikedeng1

Data-Based Dynamic Pricing and Inventory Control with Censored Demand and Limited Price Changes 1: In the Well-Separated Case, Algorithm-I with m Price Changes Has Regret at Most KT^(1/(m+1))Research Paper

Motivation

Retailers set prices and stock levels without knowing how demand responds to price. They must learn the demand curve from their own sales while still earning money, which is the exploration–exploitation trade-off of dynamic pricing with learning (den Boer 2015). Two features of practice make the problem harder than the textbook bandit. First, demand is censored: when the shelf runs empty, the firm sees only its sales min⁡{dt,yt}\min\{d_t,y_t\}min{dt​,yt​}, not the demand dtd_tdt​. Second, firms change prices rarely, because of menu costs and customer reaction, so a policy may change its price at most mmm times over the whole horizon (Cheung, Simchi-Levi and Wang 2017).

Chen, Chao and Wang study a firm facing both features at once, in a parametric model where the demand distribution is known up to a parameter. For the well-separated case they give an algorithm, Algorithm-I, whose regret grows as T1/(m+1)T^{1/(m+1)}T1/(m+1), and they show that no admissible policy does better in general. This mission formalizes the upper bound. A companion mission formalizes the lower bound.

Setting

A firm sells one product over periods t=1,…,Tt=1,\dots,Tt=1,…,T. At the start of period ttt it holds inventory xtx_txt​ (with x1=0x_1=0x1​=0). It chooses a price pt∈P=[pl,ph]p_t\in\mathcal P=[p^l,p^h]pt​∈P=[pl,ph] and an order-up-to level yt∈Y={yl,…,yh}y_t\in\mathcal Y=\{y^l,\dots,y^h\}yt​∈Y={yl,…,yh} with yt≥xty_t\ge x_tyt​≥xt​, and the order arrives at once. Demand dtd_tdt​ then has probability mass function f(⋅;pt,z)f(\cdot;p_t,z)f(⋅;pt​,z) on {dl,dl+1,…,dh}\{d^l,d^l+1,\dots,d^h\}{dl,dl+1,…,dh}, where dh≤+∞d^h\le+\inftydh≤+∞ and the parameter zzz lies in Z=[zl,zh]\mathcal Z=[z^l,z^h]Z=[zl,zh], 0≤zl≤zh0\le z^l\le z^h0≤zl≤zh. Unmet demand is lost, and the firm observes only the sales min⁡{dt,yt}\min\{d_t,y_t\}min{dt​,yt​}. Leftover stock carries over, xt+1=(yt−dt)+x_{t+1}=(y_t-d_t)^+xt+1​=(yt​−dt​)+. Each unit left over costs h≥0h\ge0h≥0 and each lost sale costs b≥0b\ge0b≥0. The single-period expected profit is

G(p,y,z)=p E[D(p,z)]−h E[y−D(p,z)]+−(b+p) E[D(p,z)−y]+.G(p,y,z)=p\,\mathbb E[D(p,z)]-h\,\mathbb E[y-D(p,z)]^+-(b+p)\,\mathbb E[D(p,z)-y]^+ .G(p,y,z)=pE[D(p,z)]−hE[y−D(p,z)]+−(b+p)E[D(p,z)−y]+.

For each yyy, py∗(z)p^*_y(z)py∗​(z) is an optimal price, max⁡p∈PG(p,y,z)=G(py∗(z),y,z)\max_{p\in\mathcal P}G(p,y,z)=G(p^*_y(z),y,z)maxp∈P​G(p,y,z)=G(py∗​(z),y,z), and the clairvoyant value is G∗(z)=max⁡(p,y)∈P×YG(p,y,z)G^*(z)=\max_{(p,y)\in\mathcal P\times\mathcal Y}G(p,y,z)G∗(z)=max(p,y)∈P×Y​G(p,y,z).

A policy's decision in period ttt may depend only on past decisions and past sales. The regret of a policy is

R(T)=T G∗(z)−E[Vϕ(T,z)]=∑t=1TE[G∗(z)−G(pt,yt,z)].R(T)=T\,G^*(z)-\mathbb E[V^\phi(T,z)]=\sum_{t=1}^T\mathbb E\big[G^*(z)-G(p_t,y_t,z)\big].R(T)=TG∗(z)−E[Vϕ(T,z)]=t=1∑T​E[G∗(z)−G(pt​,yt​,z)].

The family is well-separated (Definition 1) if for every price the pmfs f(⋅;p,z)f(\cdot;p,z)f(⋅;p,z), z∈Zz\in\mathcal Zz∈Z, are pairwise distinct.

Algorithm-I splits the horizon into m+1m+1m+1 stages of lengths Ii=⌈Ti/(m+1)⌉I_i=\lceil T^{i/(m+1)}\rceilIi​=⌈Ti/(m+1)⌉ for i≤mi\le mi≤m, with Im+1=T−∑i≤mIiI_{m+1}=T-\sum_{i\le m}I_iIm+1​=T−∑i≤m​Ii​. Stage iii uses one price p^i\hat p_ip^​i​ and the order-up-to target y~i\tilde y_iy~​i​. The target equals the planned level y^i\hat y_iy^​i​, raised by Δ≥1\Delta\ge1Δ≥1 when y^i=dl\hat y_i=d^ly^​i​=dl so that the sales carry information. At the end of the stage the algorithm computes the censored-data maximum-likelihood estimate z^i\hat z_iz^i​ (5). It then sets the next stage's decisions to a maximizer of G(⋅,⋅,z^i)G(\cdot,\cdot,\hat z_i)G(⋅,⋅,z^i​) (6). It changes its price at most mmm times.

Formalization targets

Goal: Theorem 1

Under Assumption A (regularity of GGG and of py∗p^*_ypy∗​ near the true zzz), Assumption 1 (Fisher-information bounds, a positive lower bound on the pmf, strict monotonicity of f(dl;p,⋅)f(d^l;p,\cdot)f(dl;p,⋅)), Definition 1, and the condition that every optimal order-up-to level exceeds dld^ldl, there is K6>0K_6>0K6​>0 such that for all large TTT

R(T)≤K6 T1m+1.R(T)\le K_6\,T^{\frac1{m+1}} .R(T)≤K6​Tm+11​.

The constant may depend on the model, the true parameter and the algorithm's inputs. The rate T1/(m+1)T^{1/(m+1)}T1/(m+1) is the content.

Milestones

  1. Theorem B1: if an estimator satisfies P{∥z^−z∥≥ϵ}≤K14e−nK15ϵ2+K16/n\mathbb P\{\|\hat z-z\|\ge\epsilon\}\le K_{14}e^{-nK_{15}\epsilon^2}+K_{16}/nP{∥z^−z∥≥ϵ}≤K14​e−nK15​ϵ2+K16​/n, then the plug-in decision has optimality gap G∗(z)−E[G(p^∗,y^∗,z)]≤K17/nG^*(z)-\mathbb E[G(\hat p^*,\hat y^*,z)]\le K_{17}/nG∗(z)−E[G(p^​∗,y^​∗,z)]≤K17​/n.
  2. Proposition 1: the censored MLE satisfies P{∣z−z^i∣≥ϵ}≤K3e−K4Iiϵ2+K5/Ii\mathbb P\{|z-\hat z_i|\ge\epsilon\}\le K_3e^{-K_4I_i\epsilon^2}+K_5/I_iP{∣z−z^i​∣≥ϵ}≤K3​e−K4​Ii​ϵ2+K5​/Ii​.
  3. Per-stage estimation regret (p. 25): E[G∗(z)−G(p^i,y^i,z)]≤K17/Ii−1\mathbb E[G^*(z)-G(\hat p_i,\hat y_i,z)]\le K_{17}/I_{i-1}E[G∗(z)−G(p^​i​,y^​i​,z)]≤K17​/Ii−1​.
  4. (25): the summed estimation regret is at most a constant times mT1/(m+1)mT^{1/(m+1)}mT1/(m+1).
  5. (26): P(y^i≠y~i)≤K/Ii−1\mathbb P(\hat y_i\ne\tilde y_i)\le K/I_{i-1}P(y^​i​=y~​i​)≤K/Ii−1​, so exploration after stage 1 is rare.

Significance

The upper bound shows that a budget of mmm price changes costs only a T1/(m+1)T^{1/(m+1)}T1/(m+1) regret even under censoring. With mmm of order log⁡T\log TlogT the rate drops to logarithmic (Theorem 3 of the paper). Together with the matching lower bound (Theorem 2), it identifies the exact price of limiting price changes in this model. Theorem B1 is a general transfer principle, from a large-deviation bound on an estimate to a 1/n1/n1/n optimality gap of the plug-in decision. It allows continuous and discrete decisions together and needs no unique optimizer. It is reusable for any parametric learning problem with that structure. Proposition 1 is a large-deviation bound for maximum likelihood from censored, dependent, non-identically distributed data. The paper notes that such results were not previously available in the statistics literature.

The results are proved in the paper's appendices. None of them has a machine-checked proof. A formalization would check the regret decomposition (23), the stagewise bookkeeping with ceilings, and the large-deviation argument for the censored MLE. It would also make the reading of several loosely stated steps exact (see Formalization scope).

Difficulty

The obvious argument plugs a consistent estimator into the optimizer and bounds the regret by the estimation error. It fails twice. The error of z^i\hat z_iz^i​ is of order Ii−1−1/2I_{i-1}^{-1/2}Ii−1−1/2​, so a Lipschitz bound on the profit would give regret of order Ii/Ii−1I_i/\sqrt{I_{i-1}}Ii​/Ii−1​​ per stage, which is too large. The 1/n1/n1/n rate of Theorem B1 needs the first-order condition at an interior optimum and the exact gap δ\deltaδ between optimal and suboptimal discrete levels. Second, the data are censored and dependent. The censoring level yty_tyt​ depends on carried inventory, which depends on past demand and on past prices. The classical large-deviation results for maximum likelihood assume i.i.d. uncensored samples (Borovkov 1998) and do not apply. Proposition 1 needs a separate argument that the inventory target is reached in most periods with high probability.

Formalization scope

The model is encoded with a scalar parameter. P\mathcal PP, Y\mathcal YY and Z\mathcal ZZ are as above. The pmf is positive exactly on {dl,…,dh}\{d^l,\dots,d^h\}{dl,…,dh} and sums to one, and dh=+∞d^h=+\inftydh=+∞ is allowed. The expected profit GGG is built from these sums. G∗(z)G^*(z)G∗(z) is the finite maximum max⁡yG(py∗(z),y,z)\max_{y}G(p^*_y(z),y,z)maxy​G(py∗​(z),y,z) for a price selection p∗p^*p∗, not a real supremum. Periods are 0-based in Lean, while stages keep the paper's indices. Expectations and probabilities are sums over demand paths d∈NTd\in\mathbb N^Td∈NT weighted by ∏tf(dt;pt,z)\prod_tf(d_t;p_t,z)∏t​f(dt​;pt​,z), the law of the path under the algorithm, taken in [0,∞][0,\infty][0,∞]. Every regret summand is nonnegative.

Algorithm-I reads demand only through sales. Step 2's arg max is any maximizer of the censored product likelihood, which exists by compactness. Step 3's arg max is y^\hat yy^​, any maximizer of y↦G(py∗(z^),y,z^)y\mapsto G(p^*_y(\hat z),y,\hat z)y↦G(py∗​(z^),y,z^), together with the price py^∗(z^)p^*_{\hat y}(\hat z)py^​∗​(z^) of Assumption A(iii). This is the decision the proof of Theorem B1 analyses. Proposition 1's "large enough iii" is read as "large enough TTT, uniformly in the stage and in ϵ\epsilonϵ". Theorem B1 is stated for a scalar price and level and a parameter in Rk\mathbb R^kRk.

Three hypotheses are added and disclosed. Differentiability of fff in zzz is presupposed by Assumption 1. Finiteness of the mean demand is needed for (4) when dh=∞d^h=\inftydh=∞. The condition dl≤yld^l\le y^ldl≤yl is needed because Step 1 defines the target only for y^≥dl\hat y\ge d^ly^​≥dl. "The optimal order-up-to level exceeds dld^ldl" is read for every optimal level.

A trivializing formalization is ruled out. Regret and probabilities are path sums of nonnegative terms, not Bochner integrals that vanish on non-integrable inputs. T1/(m+1)T^{1/(m+1)}T1/(m+1) is a real power. The hypotheses are jointly satisfiable: a Bernoulli instance with Y={1}\mathcal Y=\{1\}Y={1}, P=[1,2]\mathcal P=[1,2]P=[1,2], Z=[2/3,4/5]\mathcal Z=[2/3,4/5]Z=[2/3,4/5], f(0;p,z)=zp/2f(0;p,z)=zp/2f(0;p,z)=zp/2 satisfies all of them, together with explicit selections, and this has been verified in Lean.

A complete development needs the following:

  • Hoeffding-type concentration for dependent bounded sums;
  • a large-deviation bound for the censored log-likelihood;
  • Taylor's theorem with integral remainder on an interval;
  • bookkeeping lemmas for the stage lengths ⌈Ti/(m+1)⌉\lceil T^{i/(m+1)}\rceil⌈Ti/(m+1)⌉.

Theorem B1 and the model definitions are reusable for the paper's later results (Theorems 3, 5, 6), which repeat these arguments. Contributions to any milestone are welcome, including alternative proofs of Proposition 1.

Selected references

  • B. Chen, X. Chao, Y. Wang, Data-Based Dynamic Pricing and Inventory Control with Censored Demand and Limited Price Changes, Operations Research (technical note), 2020; read in the SSRN revision of 2020-02-10. https://doi.org/10.1287/opre.2020.1993, https://ssrn.com/abstract=2700747
  • W. C. Cheung, D. Simchi-Levi, H. Wang, Dynamic Pricing and Demand Learning with Limited Price Experimentation, Operations Research 65(6), 2017. https://doi.org/10.1287/opre.2017.1629
  • J. Broder, P. Rusmevichientong, Dynamic Pricing under a General Parametric Choice Model, Operations Research 60(4), 2012. https://doi.org/10.1287/opre.1120.1057
  • A. A. Borovkov, Mathematical Statistics, Gordon and Breach, 1998.
  • A. V. den Boer, Dynamic pricing and learning: Historical origins, current research, and new directions, Surveys in Operations Research and Management Science 20(1), 2015. https://doi.org/10.1016/j.sorms.2015.03.001
9 thms1 active userReviewed
OptimizationProbability·Captain: mikedeng1

Optimization-Based Scenario Reduction for Data-Driven Two-Stage Stochastic Optimization II: Under a Symmetric Uncertainty Law the Mean Solves the Convex Upper-Bound Scenario ProblemResearch Paper

Why reduce scenarios with the cost in view

A two-stage stochastic programme chooses a decision zzz before an uncertain parameter ξ\xiξ is revealed and pays a cost c(z;ξ)c(z;\xi)c(z;ξ). When ξ\xiξ is known only through nnn data points, or through a law with many atoms, the expected cost is expensive to optimize, and practitioners replace the law by a small set of mmm reduced scenarios. Classical scenario reduction chooses these scenarios to be close to the data in a Wasserstein distance, without looking at the cost (Dupačová, Gröwe-Kuska and Römisch, 2003; Rujeerapaiboon, Schindler, Kuhn and Wiesemann, 2022). Bertsimas and Mundru (Operations Research, 2023) propose problem-dependent scenario reduction: the distance between two scenarios measures how much the optimal decision for one costs when evaluated on the other. Their method needs, for each cluster of data, the scenario that minimizes a cost-dependent dissimilarity, which they replace by a convex upper bound, problem (16).

Theorem 3 of the paper is the sanity check for that upper bound. For the simplest cost to which it applies and a single reduced scenario (m=1m=1m=1), under a symmetry assumption on the law, the minimizer of the upper bound is the mean of ξ\xiξ, which is also what Wasserstein scenario reduction returns for m=1m=1m=1. This mission formalizes that statement.

Setting

Decisions and parameters both live in Rd\mathbb R^dRd, with the Euclidean inner product z′ξz'\xiz′ξ. The feasible set is a polytope

Z={z∈R+d:Pz≤q},\mathcal Z = \{ z\in\mathbb R^d_+ : Pz\le q\},Z={z∈R+d​:Pz≤q},

for a matrix P∈Rr×dP\in\mathbb R^{r\times d}P∈Rr×d and a vector q∈Rrq\in\mathbb R^rq∈Rr, assumed nonempty and bounded. The cost is c(z;ξ)=max⁡{z′ξ,0}c(z;\xi)=\max\{z'\xi,0\}c(z;ξ)=max{z′ξ,0}, a special case of the piecewise bilinear costs max⁡1≤t≤kz′Atξ\max_{1\le t\le k} z'A_t\ximax1≤t≤k​z′At​ξ of (15) (take k=2k=2k=2, A1=IA_1=IA1​=I, A2=0A_2=0A2​=0).

An optimal-decision map is any function z∗:Rd→Rdz^*:\mathbb R^d\to\mathbb R^dz∗:Rd→Rd with z∗(ξ)∈arg⁡min⁡z∈Zz′ξz^*(\xi)\in\arg\min_{z\in\mathcal Z} z'\xiz∗(ξ)∈argminz∈Z​z′ξ for every ξ\xiξ; for a vector vvv, Z∗(v)=arg⁡min⁡z∈Zz′v\mathcal Z^*(v)=\arg\min_{z\in\mathcal Z} z'vZ∗(v)=argminz∈Z​z′v is the whole set of minimizers. The set of cost-reducing parameters is

U={ξ:min⁡z∈Zz′ξ<0}.\mathcal U=\Big\{\xi : \min_{z\in\mathcal Z} z'\xi<0\Big\}.U={ξ:z∈Zmin​z′ξ<0}.

For a candidate reduced scenario ζ∈Rd\zeta\in\mathbb R^dζ∈Rd, the per-scenario upper-bound loss is

L(ξ,ζ)=max⁡{max⁡z∈Zz′(ξ−2ζ), 0}+2max⁡{z∗(ξ)′ζ, 0}.L(\xi,\zeta)=\max\Big\{\max_{z\in\mathcal Z} z'(\xi-2\zeta),\,0\Big\}+2\max\{z^*(\xi)'\zeta,\,0\}.L(ξ,ζ)=max{z∈Zmax​z′(ξ−2ζ),0}+2max{z∗(ξ)′ζ,0}.

For this cost it is the optimal value, in the auxiliary variables (λ,θ,γ)(\lambda,\theta,\gamma)(λ,θ,γ), of the per-point linear programme in (16). With a random parameter ξ\xiξ of law μ\muμ, the upper-bound objective for m=1m=1m=1 is E[L(ξ,ζ)]\mathbb E[L(\xi,\zeta)]E[L(ξ,ζ)]. The squared cost for Wasserstein reduction to one atom is W(ζ)=∫∥ξ−ζ∥22 dμW(\zeta)=\int\|\xi-\zeta\|_2^2\,d\muW(ζ)=∫∥ξ−ζ∥22​dμ; (4) takes its square root, which preserves minimizers.

Assumption 5 (p. 24) asks:

  • (a) ξ\xiξ has a continuous distribution on U\mathcal UU and density 000 elsewhere;
  • (b) the mean ξˉ=E[ξ]\bar\xi=\mathbb E[\xi]ξˉ​=E[ξ] is finite and z∗(ξˉ)′ξˉ>0z^*(\bar\xi)'\bar\xi>0z∗(ξˉ​)′ξˉ​>0;
  • (c) the law of ξ\xiξ is symmetric about ξˉ\bar\xiξˉ​, that is, ξ\xiξ and 2ξˉ−ξ2\bar\xi-\xi2ξˉ​−ξ are equal in distribution.

Formalization targets

Goal: Theorem 3 (p. 24)

Under Assumption 5, for every measurable optimal-decision map z∗z^*z∗,

E[L(ξ,ξˉ)]  ≤  E[L(ξ,ζ)]andW(ξˉ)≤W(ζ)for all ζ∈Rd.\mathbb E\big[L(\xi,\bar\xi)\big]\;\le\;\mathbb E\big[L(\xi,\zeta)\big]\quad\text{and}\quad W(\bar\xi)\le W(\zeta)\qquad\text{for all }\zeta\in\mathbb R^d.E[L(ξ,ξˉ​)]≤E[L(ξ,ζ)]andW(ξˉ​)≤W(ζ)for all ζ∈Rd.

The page's "the solution … is simply the mean" is read as "the mean is a minimizer", which is what the proof concludes; uniqueness is not claimed.

Milestones (steps of the proof, pp. 24–25)

  1. For each ξ\xiξ, ζ↦L(ξ,ζ)\zeta\mapsto L(\xi,\zeta)ζ↦L(ξ,ζ) is convex.
  2. L(ξ,ζ)≤∣max⁡z∈Zz′(ξ−2ζ)∣+2∣ζ′z∗(ξ)∣≤(∥ξ−2ζ∥1+2∥ζ∥1)max⁡z∈Z∥z∥∞≤(∥ξ∥1+4∥ζ∥1)max⁡z∈Z∥z∥∞L(\xi,\zeta)\le\big|\max_{z\in\mathcal Z} z'(\xi-2\zeta)\big|+2|\zeta'z^*(\xi)|\le(\|\xi-2\zeta\|_1+2\|\zeta\|_1)\max_{z\in\mathcal Z}\|z\|_\infty\le(\|\xi\|_1+4\|\zeta\|_1)\max_{z\in\mathcal Z}\|z\|_\inftyL(ξ,ζ)≤​maxz∈Z​z′(ξ−2ζ)​+2∣ζ′z∗(ξ)∣≤(∥ξ−2ζ∥1​+2∥ζ∥1​)maxz∈Z​∥z∥∞​≤(∥ξ∥1​+4∥ζ∥1​)maxz∈Z​∥z∥∞​.
  3. With probability one, 2ξˉ−ξ∈U2\bar\xi-\xi\in\mathcal U2ξˉ​−ξ∈U and Z∗(2ξˉ−ξ)\mathcal Z^*(2\bar\xi-\xi)Z∗(2ξˉ​−ξ) is a singleton.
  4. Under symmetry, E[z∗(2ξˉ−ξ)]=E[z∗(ξ)]\mathbb E[z^*(2\bar\xi-\xi)]=\mathbb E[z^*(\xi)]E[z∗(2ξˉ​−ξ)]=E[z∗(ξ)].
  5. If z∗(ξˉ)′ξˉ>0z^*(\bar\xi)'\bar\xi>0z∗(ξˉ​)′ξˉ​>0 then z′ξˉ≥z∗(ξˉ)′ξˉ>0z'\bar\xi\ge z^*(\bar\xi)'\bar\xi>0z′ξˉ​≥z∗(ξˉ​)′ξˉ​>0 for every z∈Zz\in\mathcal Zz∈Z.

Significance

The upper bound (16) is the computational core of the paper's Algorithm 1: each alternating-minimization step solves one instance of it per cluster. Theorem 3 is the only result in the paper that identifies its minimizer in closed form, and it shows that, in a symmetric case, the cost-aware reduction agrees with the classical one at m=1m=1m=1. It is the paper's justification that the upper bound is a sensible surrogate and not an arbitrary convex relaxation.

The argument is a variant of the mean-minimizes-the-surrogate result of Elmachtoub and Grigas for the SPO+ loss (Management Science, 2022, Proposition 6(a)), with both terms clipped at zero and with a law living only on U\mathcal UU instead of all of Rd\mathbb R^dRd. Theorem 3 is proved on paper; it has not been formalized, and on Prove2Me the Elmachtoub–Grigas statement is posed but open. The work here is to formalize the known proof, including the measure-theoretic steps the paper treats in one sentence each: integrability of the loss, exchange of the subdifferential and the expectation, and the almost-sure uniqueness of linear minimizers over a polytope.

Difficulty

Convexity of the objective and a vanishing subgradient at ξˉ\bar\xiξˉ​ would settle the theorem, but two steps of that argument are not routine. First, the objective is not differentiable everywhere, and the subdifferential of ζ↦E[L(ξ,ζ)]\zeta\mapsto\mathbb E[L(\xi,\zeta)]ζ↦E[L(ξ,ζ)] is not in general the expectation of the pointwise subdifferentials: the exchange needs the integrable bound of milestone 2 and the almost-sure uniqueness of milestone 3. Second, that uniqueness is a statement about the geometry of polytopes and about the law of the reflected parameter 2ξˉ−ξ2\bar\xi-\xi2ξˉ​−ξ together: neither convexity nor absolute continuity alone gives it. The clipping at zero adds a third point: one has to check that it is inactive at ζ=ξˉ\zeta=\bar\xiζ=ξˉ​ almost surely, which is where Assumption 5a's support condition on U\mathcal UU and Assumption 5b enter. Dropping either half of Assumption 5a breaks the argument: a two-atom symmetric law can put both atoms where Z∗(2ξˉ−ξ)\mathcal Z^*(2\bar\xi-\xi)Z∗(2ξˉ​−ξ) is a whole edge, and a law charging the complement of U\mathcal UU can make the first clipping active at ξˉ\bar\xiξˉ​.

Formalization scope

  • Rd\mathbb R^dRd is EuclideanSpace ℝ (Fin d) and z′ξz'\xiz′ξ is ⟪z, ξ⟫_ℝ. Decision and parameter spaces coincide (nz=dn_z=dnz​=d), as the cost z′ξz'\xiz′ξ requires.
  • Z\mathcal ZZ is polytope P qv, with the hypotheses that it is nonempty and bounded (§1 of the paper assumes Z\mathcal ZZ nonempty and compact; the polytope is closed).
  • The maximum and minimum of z′vz'vz′v over Z\mathcal ZZ and the argmin set are the published definitions SmartPTO.Fisher.xi, SmartPTO.Fisher.zstar and SmartPTO.Fisher.Wstar; "symmetric about its mean" is the published SmartPTO.Fisher.CentrallySymmetric.
  • z∗z^*z∗ is a function zsel with the hypothesis that zsel ξ is a minimizer for every ξ\xiξ, and it is assumed measurable (needed for E[z∗(ξ)]\mathbb E[z^*(\xi)]E[z∗(ξ)]; not on the page). The theorem holds for every such selection; uniqueness of minimizers is not assumed.
  • The law is a probability measure μ\muμ. Assumption 5a is two hypotheses: μ≪\mu\llμ≪ Lebesgue and μ(Rd∖U)=0\mu(\mathbb R^d\setminus\mathcal U)=0μ(Rd∖U)=0. Full support is not assumed and would contradict the second. Assumption 5b is integrability of ξ\xiξ plus z∗(ξˉ)′ξˉ>0z^*(\bar\xi)'\bar\xi>0z∗(ξˉ​)′ξˉ​>0 with ξˉ=∫ξ dμ\bar\xi=\int\xi\,d\muξˉ​=∫ξdμ.
  • The goal is stated on E[L(ξ,ζ)]\mathbb E[L(\xi,\zeta)]E[L(ξ,ζ)], the first display of the proof, not on the linear programme (16) with its auxiliary variables; for this cost the two coincide by LP duality (Proposition 3's proof), and Theorem 3 is the population, m=1m=1m=1 version.
  • Expectations are Bochner integrals, which return 000 for non-integrable integrands. Under the stated hypotheses ξ↦L(ξ,ζ)\xi\mapsto L(\xi,\zeta)ξ↦L(ξ,ζ) is dominated by (∥ξ∥1+4∥ζ∥1)max⁡z∈Z∥z∥∞(\|\xi\|_1+4\|\zeta\|_1)\max_{z\in\mathcal Z}\|z\|_\infty(∥ξ∥1​+4∥ζ∥1​)maxz∈Z​∥z∥∞​ and is integrable, so the goal is not satisfied by junk values; integrability and measurability hypotheses must not be weakened.
  • The Wasserstein clause uses an extended nonnegative integral for WWW. This expresses the theorem without adding a second-moment hypothesis absent from Assumption 5. With a finite second moment it is the usual squared Wasserstein objective; with an infinite second moment every one-atom value is infinite, so the clause has only the extended-value meaning.

Useful infrastructure, reusable beyond this mission: support functions of polytopes and their directional derivatives; the fact that a linear function has a unique minimizer over a polytope for Lebesgue-almost every cost vector; differentiation of convex integral functionals under the integral sign. Contributions of any of these as stand-alone lemmas are welcome.

The source is the authors' accepted manuscript (MIT DSpace, "Submitted to Operations Research"), not the published article; all page and theorem numbers refer to the manuscript, whose printed page numbers equal its PDF page numbers.

Selected references

  • D. Bertsimas and N. Mundru, Optimization-based Scenario Reduction for Data-Driven Two-stage Stochastic Optimization, Operations Research, 2023 (author manuscript, MIT DSpace). https://doi.org/10.1287/opre.2022.2265
  • A. N. Elmachtoub and P. Grigas, Smart "Predict, then Optimize", Management Science 68(1), 2022. https://doi.org/10.1287/mnsc.2020.3922
  • J. Dupačová, N. Gröwe-Kuska and W. Römisch, Scenario reduction in stochastic programming: an approach using probability metrics, Mathematical Programming 95, 2003. https://doi.org/10.1007/s10107-002-0331-0
  • N. Rujeerapaiboon, K. Schindler, D. Kuhn and W. Wiesemann, Scenario Reduction Revisited: Fundamental Limits and Guarantees, Mathematical Programming 191, 2022. https://doi.org/10.1007/s10107-018-1269-1
9 thms1 active userReviewed
Probability·Captain: mikedeng1

Robust Dynamic Pricing with Strategic Customers: Over Horizon T the Simple Robust Pricing Policy Earns at Least V*_β(x₀)/(1 + e^{−βT}/(βT))Research Paper

Motivation

A seller with a fixed stock must choose prices before knowing when customers will arrive or what they will be willing to pay. If customers can wait for a later price, the seller must also account for how today's price changes their purchasing decisions. Chen and Farias study this problem with strategic customers and identify a simple inventory-based policy that can be compared with the best attainable revenue. Their Theorem 1 shows that this policy, with discount rate β=1/(1.42T)\beta=1/(1.42T)β=1/(1.42T) for a season of length TTT, earns at least 0.290.290.29 of the optimal expected revenue. The policy posts the price that is optimal in the canonical discounted revenue-management problem with myopic customers (Gallego and van Ryzin, 1994; Farias and Van Roy, 2010) at the current inventory level. This mission targets the lower-bound half of its argument, stated as Lemma 9: a comparison between the policy's revenue over a fixed selling season and a discounted, infinite-horizon value. The latter comparison is meaningful independently of the paper's strategic-customer benchmark.

Setting

The seller begins with inventory x0∈Nx_0\in\mathbb Nx0​∈N and sells at most one item to each customer. Customers arrive at rate λ>0\lambda>0λ>0. Their nonnegative valuations have density fff with total mass one. Write Fˉ(p)=∫p∞f(v) dv\bar F(p)=\int_p^\infty f(v)\,dvFˉ(p)=∫p∞​f(v)dv for the probability that a valuation exceeds price ppp. A customer who behaves myopically buys at a posted price ppp exactly when the valuation is high enough, so sales occur at rate λFˉ(p)\lambda\bar F(p)λFˉ(p) while that price is posted.

The paper's Assumption 1 concerns the virtual value ψ(p)=p−Fˉ(p)/f(p)\psi(p)=p-\bar F(p)/f(p)ψ(p)=p−Fˉ(p)/f(p): it is nondecreasing on nonnegative prices and has a nonnegative root. The simple policy is built from a discount rate β>0\beta>0β>0 and an infinite-horizon Bellman value V:N→RV:\mathbb N\to\mathbb RV:N→R. It has V(0)=0V(0)=0V(0)=0 and, for x≥1x\ge1x≥1, satisfies the sign-corrected recursion

βV(x)=sup⁡p≥0λFˉ(p)(p+V(x−1)−V(x)).\beta V(x)=\sup_{p\ge0}\lambda\bar F(p)\bigl(p+V(x-1)-V(x)\bigr).βV(x)=p≥0sup​λFˉ(p)(p+V(x−1)−V(x)).

At inventory x≥1x\ge1x≥1 the root price π(x)\pi(x)π(x) is the unique nonnegative solution of ψ(π(x))=V(x)−V(x−1)\psi(\pi(x))=V(x)-V(x-1)ψ(π(x))=V(x)−V(x−1). The price posted just before a sale is π(x)\pi(x)π(x), and the inventory then becomes x−1x-1x−1. At zero inventory the posted price is infinity and there are no more sales. The expected sum of prices paid at sales by time TTT is denoted J(x0,T)J(x_0,T)J(x0​,T). These objects come from §§2–3.1 of the paper.

Formalization targets

The goal is Lemma 9, for every λ,β,T>0\lambda,\beta,T>0λ,β,T>0 and every initial inventory x0x_0x0​:

V(x0)≤(1+e−βTβT)J(x0,T).V(x_0)\le\left(1+\frac{e^{-\beta T}}{\beta T}\right)J(x_0,T).V(x0​)≤(1+βTe−βT​)J(x0​,T).

The coefficient is part of the target. No choice of β\betaβ is fixed. The milestones follow the results stated in the paper: inventory monotonicity of VVV, price monotonicity, pathwise monotonicity of the price and its revenue rate (Lemma 7), the expected-rate identity, revenue-per-time monotonicity (Lemma 8), the identification of VVV with discounted policy revenue, and the comparison through an independent exponential horizon. The last milestone evaluates E[max⁡{1,X/T}]\mathbb E[\max\{1,X/T\}]E[max{1,X/T}] exactly for X∼Exp⁡(β)X\sim\operatorname{Exp}(\beta)X∼Exp(β).

Significance

The bound quantifies how much of the discounted value this explicit policy earns within a finite selling season. Its factor depends only on the dimensionless product βT\beta TβT; it does not depend on inventory, arrival rate or valuation density. Together with the paper's separate upper bound on its strategic benchmark, Lemma 9 contributes to the advertised 0.290.290.29 comparison. The full comparison requires definitions and equilibrium arguments beyond this mission, so the goal here is precisely the fixed-horizon lower bound.

Chen and Farias proved these statements in the published paper. The Lean items in this proposal are statements awaiting machine-checked proofs. A completed development would establish the discounted-value verification step and the fixed-horizon comparison for an explicit pure-death sales process. Its constructions of inventory-dependent sale times and finite-horizon revenue could also be reused in other pricing models with Poisson arrivals.

Difficulty

The Bellman value is specified by an optimization equation, while J(x0,T)J(x_0,T)J(x0​,T) is defined from the actual sales process. Their equality at an exponential horizon does not follow by unfolding a definition. The price chosen through the virtual-value equation must be connected to the Bellman optimum, and the inventory-dependent process must be related to the same value. The paper also relies on the fact that the root price falls as inventory rises, citing Lemma 1 of Farias and Van Roy; that fact does not follow merely from monotonicity of ψ\psiψ without control of the marginal values V(x)−V(x−1)V(x)-V(x-1)V(x)−V(x−1). Lemma 8 then concerns expected revenue over two different horizons, including paths that sell out early.

Formalization scope

The Lean model uses a nonnegative integrable density on R\mathbb RR, zero on negative valuations and normalized to mass one. It adds f(p)>0f(p)>0f(p)>0 for every p≥0p\ge0p≥0. This disclosed condition excludes bounded-support densities: without it the paper's quotient Fˉ(p)/f(p)\bar F(p)/f(p)Fˉ(p)/f(p) can divide by zero and Lean would assign a spurious value. The paper says the root equation has a unique solution under Assumption 1, but nondecreasing ψ\psiψ alone does not guarantee existence or uniqueness. Accordingly, the root policy is characterized by its equation and an explicit uniqueness condition. The Bellman recursion uses a least-upper-bound predicate rather than a real supremum with a default value on an empty or unbounded set. The corrected sign in the recursion matches the paper's root equation and discounted-revenue equation.

For stock x0x_0x0​, the model uses x0x_0x0​ independent rate-one exponential clocks. At inventory xxx, the next holding time is the next clock divided by λFˉ(π(x))\lambda\bar F(\pi(x))λFˉ(π(x)). Sales are numbered 1,…,x01,\ldots,x_01,…,x0​, and sale kkk earns π(x0−k+1)\pi(x_0-k+1)π(x0​−k+1). The law is the myopic sales process with intensity λFˉ(π(x))\lambda\bar F(\pi(x))λFˉ(π(x)). Expected revenues are lower integrals in the extended nonnegative reals; nonnegative prices make their real-to-extended conversion exact. An independent X∼Exp⁡(β)X\sim\operatorname{Exp}(\beta)X∼Exp(β) is represented by an outer integral over its law. The factor λ\lambdaλ missing from the paper's printed compensator display is restored, and the paper's intermediate 1+e−βT/T1+e^{-\beta T}/T1+e−βT/T is read with the missing β\betaβ restored.

The strategic-customer types, stopping rules, perfect Bayesian equilibrium, and the identification of the strategic policy's revenue with myopic-sales revenue are not formalized here. Neither are Theorem 1's OPT\mathrm{OPT}OPT and J∗J^*J∗ benchmarks: their specification is not pinned down sufficiently in the paper for this proposal. In particular, JJJ is constructed from sale times and payments, never from VVV, and VVV is specified by the Bellman equation, never as the policy's revenue. Contributions toward the goal include the individual milestones and reusable facts about the clock process, its revenue, and the exponential horizon.

Selected references

  • Y. Chen and V. F. Farias, Robust Dynamic Pricing with Strategic Customers, Mathematics of Operations Research 43(4):1119–1142, 2018. DOI: 10.1287/moor.2017.0897.
  • G. Gallego and G. van Ryzin, Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons, Management Science 40(8):999–1020, 1994. DOI: 10.1287/mnsc.40.8.999.
  • V. F. Farias and B. Van Roy, Dynamic Pricing with a Prior on Market Response, Operations Research 58(1):16–29, 2010. DOI: 10.1287/opre.1090.0729.
  • P. Brémaud, Point Processes and Queues: Martingale Dynamics, Springer, 1981. DOI: 10.1007/978-1-4684-9477-8.
11 thms1 active userReviewed
PreviousPage 89 of 106Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me