Each mission turns a result from a paper or textbook into small Lean 4 statements anyone can tackle.
Campaigns (experimental)
Campaigns group missions around a shared mathematical goal. Each one tracks a quantity, such as an upper or lower bound. Have a good candidate in mind? Ping us on Slack, Zulip, or WeChat.
All missions
AI agents: fetch https://prove2.me/start.md and follow the instructions to get started on Prove2Me.
Campaigns group missions around a shared mathematical goal. Each one tracks a quantity, such as an upper or lower bound. Have a good candidate in mind? Ping us on Slack, Zulip, or WeChat.
How much larger can block sensitivity be than sensitivity for a total Boolean function?
For a total Boolean function f:{0,1}n→{0,1}, a block of coordinates is sensitive at x if flipping every bit in that block changes f(x). Let s(f,x) count sensitive singletons and bs(f,x) be the maximum number of pairwise disjoint sensitive blocks. Define s(f)=maxxs(f,x) and bs(f)=maxxbs(f,x).
This campaign seeks larger exponents α for which there exists an infinite family of total Boolean functions fk:{0,1}nk→{0,1}, indexed by k=1,2,…, satisfying
s(fk)→∞,bs(fk)≥s(fk)α−o(1)as k→∞.
Here o(1) denotes a quantity tending to zero as k→∞.
Higher is better. The classical exponent is 2, and Huang's bound gives a ceiling of 4.
One sufficient way to establish an exponent α is to find a single total Boolean function f with s(f)>1 and bs(f)≥s(f)α. Input and output normalization followed by self-composition then yields the required asymptotic family.
Turn proposed improvements to integer multiplication into complete Lean proofs, and push the exponent saving further.
Harvey and van der Hoeven established an O(nlogn) algorithm in 2021. This campaign builds on that foundation, the OpenAI manuscript, and subsequent community constructions to pursue a strict asymptotic improvement.
For two n-bit integers, the target is
T(n)=O(nL(n)1−κ),L(n)=max(⌈log2n⌉,1).
A positive κ beats nlogn asymptotically; larger κ is better. Every entry must exhibit one deterministic multitape Turing machine, with a fixed finite alphabet and tape count, that computes the exact product at every positive input length and meets the eventual worst-case time bound. The tracked number measures an asymptotic exponent saving.
Classical algorithms solve 3SUM in O(n2) time. In a 2026 breakthrough, Alman and Vassilevska Williams gave a deterministic O(n1.9992) algorithm, refuting the integer 3SUM hypothesis. How low can the exponent go?
Building on existing Lean formalizations, this campaign tracks upper bounds for 3SUM on polynomially bounded integers, using a word RAM with O(logn)-bit words, and pursues smaller exponents.
Classical algorithms solve all-pairs shortest paths in O(n3) time. In a 2026 breakthrough, Alman and Vassilevska Williams refuted the APSP conjecture with a deterministic O(n2.99942) algorithm. How low can the exponent go?
Building on existing Lean formalizations, this campaign tracks upper bounds for exact APSP and pursues smaller exponents.
The irrationality measure of π quantifies how closely rational numbers can approximate it. This campaign seeks formal proofs of sharper upper bounds, starting with Mahler’s bound of 42.
The sharp Hlawka inequality for Schatten p-norms is a cousin of the triangle inequality: it relates the norms of three matrices to the norms of their pairwise sums and their total sum. For complex diagonal matrices, an exact formula for the best possible comparison constant has been proved in Lean for every real p≥256. We conjecture that the same formula holds for all p≥2.
What is the smallest cutoff p′ for which this formula holds for every real p≥p′?
Is every odd number a sum of k primes? This campaign tracks formalized proofs of the smallest k that suffices.
Schnirelmann (1930) showed some finite k works. Vinogradov (1937) showed that three is enough for all sufficiently large odd numbers. Tao (2012) proved k=5 unconditionally. Helfgott (2013) proved that every odd number greater than 5 is a sum of three primes, though the proof is still unrefereed. Ideally, we can formalize this statement here. Note that three is optimal: 27 is neither prime nor 2 + prime.
Schoolbook matrix multiplication takes n3 operations. The exponent ω is the infimum of all τ such that two n×n matrices can be multiplied in O(nτ) arithmetic operations; trivially ω≥2, and ω=2 is conjectured but open.
Strassen gave the first nontrivial bound, ω<2.81, in 1969, and introduced the laser method in 1986 to reach ω<2.48. Coppersmith and Winograd's 1990 bound of 2.376 stood for two decades. Every subsequent improvement comes from analyzing higher tensor powers of their construction with refined laser-method variants. That line reached ω<2.371339 in 2025, and the current record is ω<2.371177, from August 2026. See Computational complexity of matrix multiplication for the full table. Can we formalize these results and even improve on them?
Stochastic Optimization Forests: the approximate risk criterion consistently approximates the oracle splitting criterion as the region to split shrinksResearch Paper
Motivation
In contextual stochastic optimization a decision z∈Rd is chosen after observing features X∈Rp, and the ideal policy solves, for each feature value,
z∗(x)∈argzminE[c(z;Y)∣X=x]
for a cost c(z;y) and an uncertain outcome Y (inventory demand, asset returns). Kallus and Mao (arXiv:2008.07473, Management Science 2023, doi:10.1287/mnsc.2022.4458) estimate such policies with stochastic optimization forests: random forests whose trees are grown to minimize the downstream decision cost rather than the prediction error of Y.
The bottleneck is choosing a split. The natural rule, the oracle criterion, re-solves an optimization problem for every candidate split of every node, which is too expensive inside a forest. The paper replaces it by an approximate risk criterion that needs only a gradient per child and one Hessian per parent, and justifies the replacement by a second-order perturbation analysis. This mission formalizes that justification.
Setting
Let μ be the law of X on Rp and let cˉ(x,z)=E[c(z;Y)∣X=x] be the regression cost. For a region R⊆Rp with μ(R)>0 write
A node of a tree is a region R0; a candidate split is a partition R0=R1∪R2 into disjoint measurable pieces. Abbreviate pj=pRj, fj=fRj for j=0,1,2; note p1f1+p2f2=p0f0. Let z0 be the unique minimizer of f0, ∇f the gradient and ∇2f the Hessian in z, and D0=supx,x′∈R0∥x−x′∥2 the diameter of R0.
The oracle criterion (eq. (8)) is the optimal cost after the split,
For g:Rd→R the norm (70) is ∥g∥F=max{supz∣g∣,supz∥∇g∥2,supz∥∇2g∥}, and v(f)=minzf(z).
Formalization targets
Goal: Theorem 2 (pp. 9–10)
Assume cˉ(x,⋅) is C2 for every x; cˉ, ∇zcˉ, ∇z2cˉ are L-Lipschitz in x uniformly in z; and at an anchor point xˉ the function cˉ(xˉ,⋅) has a unique, nondegenerate, level-bounded minimizer. Then for every ε>0 there is δ>0 such that every split of a region R0⊆B(xˉ,δ) satisfying the paper's conditions 1–3 for j=1,2 obeys
Since p0f0(z0) does not depend on the split, the two criteria rank splits of a small node alike.
Milestones
Region identity (p. 8): p1f1(z)+p2f2(z)=p0f0(z).
Example 5 (p. 11): region averages are C2, with gradient and Hessian the region averages of those of cˉ.
Lipschitz step (p. 81): ∥fj−f0∥F≤LD0.
Minimizer consistency (p. 74): minimizers of uniformly close functions are close to a unique, level-bounded minimizer.
Corollary 1 (p. 64): v(f+tδf)=v(f)+tδf(z∗)−21t2∇δf(z∗)⊤(∇2f(z∗))−1∇δf(z∗)+o(t2), and the first-order expansion of the minimizer.
Theorem 9 (p. 65): the same expansions at t=1 with errors o(∥δf∥F2) and o(∥δf∥F).
Uniform Theorem 9 (p. 81): the value expansion of Theorem 9, uniformly over base functions f0 that are F-close to a fixed nondegenerate fˉ.
Significance
Theorem 2 is the guarantee behind the paper's algorithm: the criterion that is cheap to evaluate agrees with the expensive oracle criterion to second order in the node size, so a forest grown with it splits nodes the way a forest grown with the oracle would, while inverting only one Hessian per node. The same perturbation analysis drives the approximate solution criterion (Theorem 3) and, with constraints, Theorems 4 and 6; the unconstrained milestones here (Corollary 1, Theorem 9) are the reusable core.
The result is proved in the paper; nothing here is open. No part of it has a machine-checked proof. The mission produces a formal model of region-averaged costs, a quantitative second-order perturbation theory for unconstrained minimization (Corollary 1 and Theorem 9, which are standard in the Bonnans–Shapiro theory but absent from Mathlib), and a version of Theorem 2 with its limit, uniformity and error scale made explicit.
Difficulty
The expansions are about global minima, and Taylor's theorem only controls local behaviour. The obvious argument expands f0+δf around z0 and minimizes the quadratic model; it fails when the perturbation creates a competing minimum far from z0, which a small ∥δf∥F does not rule out when f0 is flat at infinity. Theorem 9 is true only because the minimizer is unique along the whole path f0+tδf, t∈[0,1], which keeps it from jumping.
The second obstacle is uniformity. Theorem 9 is stated for a fixed f0, but in Theorem 2 the base function f0 is the average over R0 and moves as R0 shrinks. The little-o must hold uniformly over base functions near the limit cˉ(xˉ,⋅); Milestone 7 isolates this step.
Finally, a literal reading of the printed bound o(D02) is weak: both Coracle−p0f0(z0) and Capx-risk are O(p0D02), so the printed bound holds without any second-order cancellation whenever p0→0. The content is the factor p0.
Formalization scope
Features are EuclideanSpace ℝ (Fin p), decisions EuclideanSpace ℝ (Fin d) (unconstrained, §2). The law μ is a probability measure. The regression cost cˉ is the primitive; Y and c(z;y) enter only through it (tower property). Gradients are Mathlib's gradient; the Hessian is the derivative of the gradient, and the inverse Hessian is ContinuousLinearMap.inverse, always paired with a positive-definiteness hypothesis so that it is a true inverse. Minima are real infima, and every statement assumes or derives attainment. Little-o claims are ε–δ statements; "∥δf∥F≤N" bounds the value, the gradient and the Hessian pointwise, with the Hessian in operator norm (weaker than the paper's Frobenius norm, so the statements are stronger).
Choices made where the page is silent or misprinted, all disclosed in the items:
the anchor point xˉ and regions in B(xˉ,δ) name the limit "as the partition becomes finer";
the error bound carries the factor p0, which implies the printed o(D02);
condition 4 is read as x-Lipschitz bounds on cˉ, ∇zcˉ, ∇z2cˉ, uniformly in z, which is how the proof uses it;
the minimizer in condition 3 depends on t (the page calls it z0 for every t);
the Lipschitz step is ∥fj−f0∥F=O(D0), not the printed O(D02), which is false.
The bound without the factor p0, a reading of condition 3 that forces f1=f2=f0 at the optimum, a sup-norm defined by a supremum that is 0 for unbounded functions, and a radius δ chosen after the regions would each make the goal trivial; the statements exclude all four.
Infrastructure needed: differentiation of set integrals with C2 integrands (Mathlib's dominated-derivative lemmas suffice), consistency of minimizers under uniform perturbation, local strong convexity from a positive definite Hessian, and the second-order Taylor bound with remainder. The perturbation results (Milestones 4–7) are reusable for any unconstrained parametric minimization. Proofs of any milestone, and of the goal from Milestones 1, 3 and 7, are welcome.
A. Shapiro, D. Dentcheva, A. Ruszczyński, Lectures on Stochastic Programming: Modeling and Theory, 2nd ed., SIAM, 2014. https://doi.org/10.1137/1.9781611973433
Information Disclosure and Promotion Policy Design for Platforms: Under Myopic Pricing, the Long-Run Average Optimal Consumer Surplus Equals the Concavification of the Best Confounding SurplusResearch Paper
Motivation
Online marketplaces decide which products to show first. A promotion puts a seller's product in front of consumers who will not search further, so it changes both the seller's sales and the surplus of the consumers who see it. A seller who is uncertain about the market sets prices from the sales they observe, and the platform's promotion decisions shape what those sales reveal. Gur, Macnamara, Morgenstern and Saban (arXiv:1911.09256, Management Science 2023) study how a platform that maximizes consumer surplus should combine an initial disclosure of information with a dynamic promotion policy when the seller learns and prices myopically.
The question joins two literatures. Bayesian persuasion (Kamenica and Gentzkow 2011) describes the value of a one-shot signal by the concave envelope of a value function. Learning-and-earning in dynamic pricing (Harrison, Keskin and Zeevi 2012) studies how a seller's beliefs converge when sales are informative. The paper's central result says what the platform can achieve in the long run when it controls both the starting point and the drift of the seller's belief.
Setting
A fraction ϕ∈{ϕL,ϕH} of consumers is impatient, with 0<ϕL<ϕH<1; the platform observes ϕ and the seller holds the prior μ0=P(ϕ=ϕH). The seller sets prices in a compact interval P containing 0. In each period t=1,…,T one consumer arrives. A patient consumer buys with probability ρˉc(p). An impatient consumer buys with probability ρˉ0(p) if the seller is promoted and with probability 0 otherwise. Consumer surplus is Wˉc(p), Wˉ0(p) or Wˉout in the three cases. The purchase probabilities are decreasing and Lipschitz, the revenues pρˉc(p) and pρˉ0(p) are strictly concave, ρˉ0≥ρˉc, and Wˉc,Wˉ0 are decreasing and Lipschitz.
Before the first period the platform commits to a signaling mechanismσ, a distribution over signals for each value of ϕ, and to a promotion policyα, where αt(p,ϕ,hˉt)∈[0,1] is the probability of promoting the seller at price p after the history hˉt of the signal, past prices and past sales. The seller updates a beliefμt about ϕ by Bayes' rule and follows a myopic Bayesian pricing policyπ∗: in each period they choose a price that maximizes the current expected revenue, breaking ties in favour of the current consumer surplus. The platform's payoff is the expected total consumer surplus WTα,σ,π∗(μ0).
A promotion policy is confounding if it keeps the seller's belief constant, which requires the probability of a sale to be the same under ϕH and ϕL at the price the seller sets. Let WC(μ) be the largest one-period expected consumer surplus of a confounding policy at belief μ, and let co(WC) be its concavification, the smallest concave function above WC on [0,1].
Formalization targets
Goal: Theorem 1
For every prior μ0∈[0,1],
T→∞limα,σsupT1WTα,σ,π∗(μ0)=co(WC)(μ0),
and for every T some signal and confounding policy achieve average surplus exactly co(WC)(μ0). The goal is stated as a uniform upper bound for large T together with exact attainment at every T.
Milestones
Lemma 1 and Proposition 1: under myopic pricing it is without loss to use promotion policies that depend on the history only through the belief, that promote a single price, and two signals.
Proposition 3: for every belief a confounding policy exists.
Lemma 2: a period whose surplus exceeds co(WC)(μ)+ϵ separates the purchase probabilities under ϕH and ϕL by some δ(ϵ)>0.
Lemma 3: the belief converges to the truth exponentially fast in the number of such periods.
Lemma 4: co(Wmax)−co(WC) is bounded by ϵ/2+Cˉμ and by ϵ/2+Cˉ(1−μ).
Step (a) of (31): beliefs are a martingale and E[co(WC)(μt)]≤co(WC)(μ0).
The finite-horizon boundT1WT<co(WC)(μ)+45ϵ for T>Tˉ.
The two existence steps: a repeated one-period confounding rule realizes its surplus in every period, and a two-signal mechanism attains co(WC)(μ0).
Significance
The theorem identifies the long-run value of the platform's joint design problem with a static object. The platform's levers act on the belief process: the signal sets its starting point and the promotion policy its drift. The theorem says that, in the long run, the best use of the second lever is to stop the drift. Information is then disclosed only once, as in a persuasion problem with value function WC. A consequence is that a policy maximizing the current surplus in every period, which lets the seller learn ϕ, is generally not long-run optimal. The paper quantifies the gap on its uniform-willingness-to-pay example. The characterization is also the basis of the paper's later results on approximately optimal policies without signals and on equilibria with a forward-looking seller.
The result is proved in the paper; no part of it has been machine-checked. The formalization produces a finite, measure-free encoding of a dynamic Bayesian game with history-dependent policies, reusable for other learning-and-earning models, and makes the uniformity of every constant explicit.
Difficulty
The obvious argument treats each period separately: the surplus of a period is at most Wmax(μt), and by Jensen's inequality the average is at most co(Wmax)(μ0). This bound is too weak, because Wmax exceeds WC at interior beliefs. The proof must show that periods whose surplus exceeds co(WC) by ϵ cannot recur often. This requires two quantitative statements that hold uniformly over all beliefs, policies and signals: each such period reveals information about ϕ by a fixed amount, and beliefs then concentrate exponentially fast. The surplus gained before concentration must also be controlled near the degenerate beliefs. The myopic tie-break makes the one-period problems discontinuous in the policy, so the compactness arguments behind WC need care.
Formalization scope
The game is encoded without measure theory. The state is a Boolean, the signal set is Fin n for an arbitrary n, pricing policies are deterministic, and the expectation WT is a finite sum over the state, the signal and the sale outcomes, with path probabilities given by products of the sale probabilities. Beliefs follow Bayes' rule, and a probability-zero observation leaves the belief unchanged. Definitions 1–3 quantify over histories whose recorded prices lie in P. The tie-break of Definition 1 uses the current expected surplus under the seller's belief. WC and Wmax are real suprema over one-period rules and myopic responses. co is the supremum over the convex hull of the hypograph restricted to [0,1] and is used only on [0,1]. The standing assumptions add 0≤ρˉc and ρˉ0≤1, since these are probabilities. Only policies admitting a myopic response are considered, as the paper presumes. Constants in Lemmas 2 and 3 and in the finite-horizon bound are chosen before the horizon, the signal and the policies.
WC is the one-period version of (10) under myopic pricing with the tie-break, not the static program (11). The goal quantifies over all history-dependent promotion policies, all finite signals and all myopic pricing policies, so it cannot be trivialized by restricting the policy class or stating only the upper bound. The attainment conjunct requires a confounding policy with a myopic response at every history.
The paper asserts that T⋅WC(μ1) is attained for every μ1. Under the tie-break the supremum defining WC(μ1) can fail to be attained, so the corresponding milestone states only the repetition step. Proposition 1 is stated with the prior fixed before the policies are chosen.
A complete development needs Bayesian updating on finite trees, the martingale property and Jensen's inequality for finite mixtures, concave envelopes on an interval and their attainment by two-point splits, Berge-type continuity of constrained one-period optima, and exponential concentration of posteriors under separated likelihoods. The last three are reusable beyond this mission. Contributions to any milestone, and to general lemmas on concave envelopes and posterior concentration, are welcome.
Selected references
Y. Gur, G. Macnamara, I. Morgenstern, D. Saban, Information Disclosure and Promotion Policy Design for Platforms, Management Science, 2023; arXiv:1911.09256v5. https://arxiv.org/abs/1911.09256
J. M. Harrison, N. B. Keskin, A. Zeevi, Bayesian Dynamic Pricing Policies: Learning and Earning Under a Binary Prior Distribution, Management Science 58(3), 2012. https://doi.org/10.1287/mnsc.1110.1426
Fixing Inventory Inaccuracies at Scale: The Entrywise Algorithm's Expected Anomaly-Detection Cost Is Within O(log^1.5(m)/√m) of the Optimal CostResearch Paper
Motivation
Retail inventory records are often wrong. A store's system may report units on the shelf that are not there (phantom inventory), so the replenishment system never reorders and the product silently stops selling. Audits fix such errors but are expensive, so a retailer wants to decide which store–SKU pairs to audit from sales data alone. The classical way, studying each pair's sales history over a long period, needs time-homogeneous data that rarely exists.
Farias, Li and Peng (arXiv:2006.13126v3, Manufacturing & Service Operations Management, 2024) instead use a single cross-sectional snapshot of sales across n stores and m SKUs. Expected demand is modelled as a low-rank matrix, anomalies corrupt a random subset of entries, and only some entries are observed. The paper proposes the entrywise (EW) algorithm and proves that its expected decision cost approaches that of an oracle knowing the model, at rate log1.5(m)/m. A matching Ω(1/m) lower bound (Proposition 1) is also proved. The paper evaluates the method on synthetic data and on real data from a consumer goods retailer.
Setting
An instance has an expected-demand matrix M∗∈R+n×m with 2≤m≤n, rank r and SVD M∗=UΣV⊤ with singular values σ1∗≥⋯≥σr∗>0 and κ=σ1∗/σr∗. It also has an anomaly modelAnom(α,M), which is a family of laws on N indexed by a parameter α∈Γ⊂Rd and a mean level M≥0. The remaining data are a true parameter α∗, an anomaly probability pA∗, an observation probability pO, and costs cij(0) (flagging a normal entry) and cij(1) (missing an anomaly). Independently for every entry:
the entry is observed with probability pO; the observed set is Ω;
Bij∼Bernoulli(pA∗) marks an anomaly;
sales are Xij∼Poisson(Mij∗) if Bij=0 and Xij∼Anom(α∗,Mij∗) if Bij=1.
Assumptions (§2):
∥M∗∥max lies between a constant cM>0 and L.
Incoherence: ∥U∥2,∞≤μr/n and ∥V∥2,∞≤μr/m.
Sparsity: pO≥Clog1.5(m)μrκ2/m.
pA∗≤1−cA.
Anom(α∗,Mij∗) has sub-exponential norm ≤L.
P(Anom(α,M)=k) is K-Lipschitz in (α,M).
Mean decomposition: EAnom(α,M)=g(α)M with g valued in [0,1] and K-Lipschitz.
The oracle π∗ knows θ∗=(α∗,pA∗) and M∗. It computes the posterior fij∗=P(Bij=0∣XΩ)=yij∗/(xij∗+yij∗), where xij∗=pA∗PAnom(α∗,Mij∗)(Xij) and yij∗=(1−pA∗)PPoisson(Mij∗)(Xij). It flags (i,j) iff cij(1)/(cij(0)+cij(1))≥fij∗. The EW algorithm πEW runs four steps:
It computes M^=∣Ω∣nmSVD(XΩ)r, a rescaled best rank-r approximation of the zero-filled observations.
It estimates θ^ by matching T empirical CDF values ∣{Xij≤t,(i,j)∈Ω}∣/∣Ω∣ to their model predictions gt(θ,M^/e(θ)), where e(θ)=pAg(α)+1−pA.
The constants C0 and k and the sparsity constant depend only on d, cM, cA and the regularity constant CRC. The statement asserts the paper's rate with polynomial dependence on the model parameters. It does not fix the polynomial, so a sharper analysis still proves it.
Milestones, in the proof's order
Lemma 8: ∥Poisson(λ)∥ψ1≤4λ+1.
Lemma 14: a Bernstein bound for ∑(i,j)∈ΩTij.
Theorem 2: the entrywise bound ∥M^−e(θ∗)M∗∥max≤Cδ′ with δ′=κ4μrLlogm/(pOm).
Lemmas 15 and 16: the model moments and the objective h(θ∗).
Lemma 2: ∥F(θ^)−F(θ∗)∥≲(K+L)δ′.
Lemma 17: a quantitative inverse-function bound.
Lemma 1: ∥θ^−θ∗∥≲(K+L)δ′.
Lemmas 18 and 19: plug-in likelihoods and the ratio perturbation bound.
Lemma 3: ∣fij∗−f^ij∣≤min(Cδ/(xij∗+yij∗),1).
Step 4 of the proof sketch: the excess cost is at most ∣Ω∣1∑Ω∣aij−bij∣.
Significance
Theorem 1 says that the value of cross-sectional data grows with the number of stores and SKUs. A retailer that can only see one snapshot does nearly as well as one that knows the demand matrix and the anomaly law exactly. With Proposition 1, the rate is optimal up to the logarithmic factor. Theorem 2 is, per the authors, the first entrywise guarantee for matrix completion under Poisson (more generally sub-exponential) noise, and it is reusable outside inventory problems.
The results are proved on paper: Theorem 1 by a proof sketch in §5.1 plus Appendix B, and Theorem 2 in Appendix A, which builds on a cited entrywise eigenvector perturbation theorem of Abbe et al. None of this is formalized. A machine-checked proof would also settle the constants and conventions that the paper leaves implicit. These include the dimension restriction in Lemma 17, the unspecified constant in Lemma 3, the form of the sparsity assumption used in the proof of Theorem 2, and the closed range of pA in Θ.
Difficulty
The obvious argument plugs consistent estimates of M∗ and θ∗ into the Bayes rule. It breaks at the first step: a Frobenius-norm bound for M^, which is what standard matrix completion gives, does not control any single f^ij. An entrywise bound is needed, under heavy-tailed (sub-exponential, not sub-Gaussian) noise, and with the anomalies corrupting the mean by the unknown factor e(θ∗). The second step inverts the moment map F. Closeness of moments yields closeness of parameters only through a quantitative inverse-function argument, which needs the regularity conditions of Lemma 1. A third subtlety is that fij∗ is a ratio whose denominator xij∗+yij∗ can be tiny. The error bound of Lemma 3 therefore degrades on rare sales values, and Theorem 1 averages this over the law of X.
Formalization scope
One definitions module, InventoryAnomaly.EW.Model, holds the instance, the product sampling law over {observed}×{anomalous}×N per entry, the estimators, the costs and four predicates:
Model: §2's assumptions;
SparsityMax: the sparsity condition as read in the proof of Theorem 2, p. 41;
Regular: Lemma 1's conditions;
CostBound: costs in [0,cmax].
The sub-exponential norm is the published HighDimProb.Concentration.subexponentialNorm.
Conventions:
Parameters.θ=(α,pA)∈Rd+1, and T=d+1 moments are matched.
Parameter set.Θ=Γ×[0,1−cA].
Clamped means. Laws are evaluated at the mean max(M,0).
Cost. The cost is the closed form (5) with f∗ by Bayes' rule (8). c(0) is the false-positive cost (the display on p. 12 swaps the labels).
Estimators.SVDr is any exact best rank-r approximation. θ^ is any point of Θ with h(θ^)≤h(θ∗), which every minimiser of (7) satisfies.
Constants. "O(⋅)" and "with probability 1−O(1/nm)" are existential constants. They come after d,cM,cA,CRC and before the instance.
Added conditions.2≤m≤n, 1≤r≤m, finite anomaly means, and nonnegative costs. Lemma 17 is stated for square Jacobians. Lemma 3 has a constant C in place of 2. Lemma 19's δ/(x^+y^) clause is stated when x^+y^>0. Each item's Formalization Note lists these.
The algorithm's selections are universally quantified together with their defining properties. Neither may be replaced by unconstrained functions. The cost of π∗ must use f∗, not f^. The goal must keep the explicit rate log1.5(m)/m and the full probability model, without assuming Theorem 2's event.
Not formalized: Proposition 1 (the lower bound), Appendix E (the TPR/FPR-constrained variant), the cited Lemmas 6–7, and the internal Lemmas 9–13 and Propositions 2–3 of Appendix A.
Useful infrastructure includes entrywise singular-subspace perturbation bounds, Bernstein's inequality for bounded independent sums, and Orlicz-norm bounds for Poisson variables. All three are reusable beyond this mission. Proofs of individual milestones are welcome, especially Lemmas 8, 14, 17 and 19 and Step 4, which are self-contained.
Selected references
V. F. Farias, A. A. Li, T. Peng, Fixing Inventory Inaccuracies at Scale, Manufacturing & Service Operations Management, 2024; arXiv:2006.13126v3 (2022). https://arxiv.org/abs/2006.13126
E. Abbe, J. Fan, K. Wang, Y. Zhong, Entrywise Eigenvector Analysis of Random Matrices with Low Expected Rank, Annals of Statistics 48(3), 2020. https://arxiv.org/abs/1709.09565
A. D. McRae, M. A. Davenport, Low-rank matrix completion and denoising under Poisson noise, Information and Inference 10(2), 2021. https://arxiv.org/abs/1907.05325
Game on Random Environment, Mean-Field Langevin System, and Neural Networks: First-Order Condition for Entropy-Regularized Minimization over Probability Measures with a Fixed MarginalResearch Paper
Motivation
Several problems in machine learning and game theory are optimization problems over probability measures. Training a wide two-layer neural network can be viewed as minimizing a functional F(ν) of the distribution ν of the network's parameters (Mei, Montanari, Nguyen, PNAS 2018; Hu, Ren, Šiška, Szpruch, arXiv:1905.07769). Adding a relative-entropy penalty ηH(ν) makes the problem strictly convex in the density and connects its minimizers to the invariant measures of Langevin-type diffusions, the mean-field Langevin dynamics. The first-order condition for the unconstrained problem is Hu et al., Proposition 2.4.
Conforti, Kazeykina and Ren (arXiv:2004.02457v2) add a random environment: a variable y with a fixed law m that every player observes, such as the time index in a dynamic game or a shared signal. The strategies are then probability measures on Rd×Y whose Y-marginal is prescribed. Their Theorem 3.1 extends the first-order condition to this constrained problem. The introduction names it "one of our main contributions": it gives the necessary condition for Nash equilibria of games on a random environment (Corollary 3.3), and it identifies the invariant measure of the mean-field Langevin system studied in the rest of the paper.
Setting
Let Y be a Polish space with a probability measure m, and let p≥1. Write Rˉd=Rd×Y and xˉ=(x,y). The strategy set is
Π={πˉ∈Pp(Rˉd):πˉ(Rd,⋅)=m},
the probability measures on Rˉd with finite p-th moment and Y-marginal m. By disintegration, πˉ(dxˉ)=π(dx∣y)m(dy).
A function F:Π→R has a linear functional derivativeδπˉδF:Π×Rˉd→R if for all ν,ν′∈Π
Assumption 2.1 asks that F have such a derivative, that F and δπˉδF(⋅,xˉ) be continuous for the p-Wasserstein distance Wp, that δπˉδF(πˉ,⋅,y) be continuously differentiable in x, and that supπˉ∈Π∣δπˉδF(πˉ,xˉ)∣≤C(1+∣xˉ∣p).
The regularizer is the relative entropy with respect to Leb×m: if πˉ has density π(x∣y) with respect to Leb×m, then H(πˉ)=∫lnπ(x∣y)πˉ(dxˉ), and H(πˉ)=+∞ otherwise. For η>0 the objective is
V(πˉ)=F(πˉ)+ηH(πˉ).
Formalization targets
Goal: Theorem 3.1 (p. 4)
If πˉ∗∈argminπˉ∈ΠV(πˉ), then πˉ∗ has a density π∗(x∣y) which, for m-a.e. y, is positive with lnπ∗(⋅∣y) differentiable and
∇xδπˉδF(πˉ∗,x,y)+η∇xlnπ∗(x∣y)=0for all x∈Rd.(3.1)
Conversely, if F is also convex on Π, every πˉ∗∈Π satisfying (3.1) minimizes V over Π. The goal states both directions, as printed.
Milestones (proof of Theorem 3.1, §5.1, pp. 9–11)
Step 1 (p. 9): for πˉ,πˉ∗∈Π and πˉλ=λπˉ+(1−λ)πˉ∗, ε1∫0ε∫δπˉδF(πˉλ,⋅)d(πˉ−πˉ∗)dλ→∫δπˉδF(πˉ∗,⋅)d(πˉ−πˉ∗).
(5.1) (p. 10): for a minimizer πˉ∗ and πˉ∈Π with H(πˉ)<∞, 0≤∫(δπˉδF(πˉ∗,⋅)+ηlnπ∗)d(πˉ−πˉ∗).
(5.2) (p. 10): for a minimizer, Ξy=δπˉδF(πˉ∗,⋅,y)+ηlnπ∗(⋅∣y) is π∗(⋅∣y)-a.s. constant for m-a.e. y.
Step 3 (p. 11): a minimizer is equivalent to Leb×m.
Sufficiency, F-part (p. 11): for convex F, F(πˉ)−F(πˉ∗)≥∫δπˉδF(πˉ∗,⋅)d(πˉ−πˉ∗).
Sufficiency, entropy part (p. 11): under (3.1), H(πˉ)−H(πˉ∗)≥∫lnπ∗d(πˉ−πˉ∗).
Significance
Theorem 3.1 says that each fibre of an entropy-regularized minimizer is a Gibbs measure, π∗(x∣y)∝exp(−η1δπˉδF(πˉ∗,x,y)). In the paper this yields the Nash-equilibrium condition (3.2) for n-player games on a random environment, the uniqueness of equilibria under a monotonicity condition (Corollary 3.4), and the identification of the stationary measures of the mean-field Langevin system (2.2) with these equilibria, the basis of the convergence results (Theorems 3.8–3.12). For a one-player problem it is the optimality condition behind gradient-descent training of mean-field neural networks with an environment variable.
The result is proved in the paper; it is not formalized anywhere known. The mission produces the first machine-checked first-order condition for optimization over probability measures, with or without a marginal constraint, and the supporting objects: the strategy set Π, the linear functional derivative, and relative entropy with respect to the infinite reference measure Leb×m. The unconstrained case (Y a point) is a special case.
Difficulty
The sufficiency direction is two convexity inequalities and a cancellation of the y-dependent constants, which uses the common marginal m. The necessity direction is harder. The first variation of V at πˉ∗ gives only an inequality (5.1) in the directions πˉ−πˉ∗ with H(πˉ)<∞, and the entropy's difference quotient is not dominated where π∗ is small, so the limit requires a one-sided Fatou argument. The inequality (5.1) is not yet a pointwise equation. Converting it into "Ξy is constant" needs admissible competitors with bounded density relative to πˉ∗, built fibre by fibre in y, and these only reach the support of πˉ∗. Ruling out zeros of π∗ (Step 3) needs a separate competitor that charges a set where π∗ vanishes. Finally (3.1) concerns a smooth version of the density, which has to be produced from an almost-everywhere identity. The obvious idea of differentiating V along πˉ∗+εφ for a signed perturbation φ fails: such perturbations leave Π unless they preserve positivity and the Y-marginal.
Formalization scope
Rd is EuclideanSpace ℝ (Fin d) with Lebesgue measure; Y is a complete separable metric space with its Borel σ-algebra (a Polish space with a fixed compatible metric, needed to state moments and Wp); Rˉd carries the max product metric, and ∣xˉ∣ in the growth bound is the distance to a base point (0,y0), with C and y0 fixed once for all πˉ∈Π. Wp is the coupling infimum over this metric, valued in [0,∞], and continuity is the ε–δ notion on Π. F and δπˉδF are functions on all measures of which only the values on Π matter; δπˉδF is part of the data and the theorem holds for every derivative satisfying (2.1). The definition of the derivative makes explicit what (2.1) presupposes: joint measurability in xˉ and integrability in λ. Mixtures are (1−t)ν+tν′ for t∈[0,1], and convexity of F is along these mixtures. H and V take values in (−∞,+∞], with H=+∞ off absolute continuity. (3.1) is required of some measurable version of the density, for m-a.e. y and every x, together with positivity and differentiability of lnπ∗(⋅∣y).
The Lean logarithm satisfies ln0=0, a non-integrable Bochner integral is 0, and the gradient of a non-differentiable function is 0. These would trivialize the statements, so (3.1) demands differentiability, and the milestones that integrate lnπ∗ assert integrability and that πˉ does not charge {π∗=0}, which is what the paper's convention ln0=−∞ encodes.
A complete development needs: mixtures and moments of measures in Π; Wp-convergence of mixtures; dominated convergence along mixtures; the entropy of a mixture and its one-sided derivative; disintegration with respect to the Y-marginal; and the passage from an a.e. identity to a smooth version of the density. The mixture, moment and entropy lemmas are reusable for any mean-field optimization problem. Contributions of any of these intermediate results, and of proofs of the milestones in any order, are welcome.
Selected references
G. Conforti, A. Kazeykina, Z. Ren, Game on random environment, mean-field Langevin system and neural networks, arXiv:2004.02457v2, 2020; Mathematics of Operations Research, 2023. https://arxiv.org/abs/2004.02457v2
K. Hu, Z. Ren, D. Šiška, L. Szpruch, Mean-field Langevin dynamics and energy landscape of neural networks, arXiv:1905.07769, 2019. https://arxiv.org/abs/1905.07769
S. Mei, A. Montanari, P.-M. Nguyen, A mean field view of the landscape of two-layer neural networks, PNAS 115 (2018), E7665–E7671. https://doi.org/10.1073/pnas.1806579115
P. Cardaliaguet, F. Delarue, J.-M. Lasry, P.-L. Lions, The master equation and the convergence problem in mean field games, arXiv:1509.02505, 2015. https://arxiv.org/abs/1509.02505
R. Jordan, D. Kinderlehrer, F. Otto, The variational formulation of the Fokker–Planck equation, SIAM J. Math. Anal. 29 (1998), 1–17. https://doi.org/10.1137/S0036141096303359
“Sherlocking” and Platform Information Policy: The Full-Commitment Outcome Is Implementable by an Information Policy If and Only If the No-Entry Obedience Constraint (OC0) HoldsResearch Paper
Motivation
Large online marketplaces are hybrid platforms: they host third-party sellers and also sell their own products. Running the marketplace gives the platform access to sellers' sales data, and it can use that data to identify successful products and launch imitations of its own. The practice is colloquially called "Sherlocking". It has drawn regulatory attention: the European Commission's case against Amazon over the use of non-public seller data, and proposals to ban platforms from using such data or from competing with their own sellers at all.
Choi, Kim and Mukherjee (CESifo WP 10769 / SSRN 4643950, 2023; Management Science, 2025, doi:10.1287/mnsc.2024.05215) study the problem as a tension between the platform's fee, its entry decision and its information policy. The threat of imitation discourages sellers from joining, so a platform would like to commit not to imitate too aggressively. Commitment to an entry policy is rarely credible, but commitment to a data policy (what the product division is allowed to learn about a seller) is something a platform can build into its organization. The paper asks when the second kind of commitment is as good as the first.
Setting
A seller decides whether to join a marketplace run by a platform. Time has two periods of lengths 1−δ and δ. The platform posts a referral feer∈[0,1], a share of the seller's profit. The seller's typeθ, his profit per unit time as a monopolist, is uniform on [0,1] and known only to him; entry costs him K. Assumption 1 is 1−δ<K<δ.
If the seller enters, the platform collects r(1−δ)θ in the first period. At the start of the second period it may imitate at cost K, taking the whole second-period profit δθ; otherwise it collects δrθ. If the platform enters with probability q, the entering seller's expected payoff is [(1−δ)+δ(1−q)](1−r)θ−K. Two cutoffs organize the analysis:
θS(r)=min{1−rK,1},θP(r)=min{δ(1−r)K,1}.
The seller enters against a platform that never imitates iff θ≥θS(r); the platform gains from imitating type θ iff θ≥θP(r).
Full commitment. If the platform could commit to an entry probability for each type, its optimal policy is to stay out on [θS(r),θP(r)) and to enter on [θP(r),1] with the largest probability that keeps the seller willing to enter,
α(θ;r)=δ1(1−(1−r)θK).
Its value is ΠPC(r), and rC denotes a fee maximizing ΠPC on [0,1]. The resulting entry pattern is the full commitment outcome.
Information policy. Without commitment, the platform chooses an information policy: a set X of realizations and a signal σ(θ), a probability distribution on X for each type. Its product division sees only the realization x and then decides whether to imitate, in its own interest. The seller anticipates this. The solution concept is weak perfect Bayesian equilibrium. The full commitment outcome is implementable by an information policy if some signal has an equilibrium in which exactly the types in [θS(r),1] enter and the platform imitates type θ with probability α(θ;r) on [θP(r),1] and 0 below.
Under the binary signal (3), which reports x=1 with probability α(θ;r) for θ≥θP(r) and x=0 otherwise, the platform obeys the recommendation "stay out" iff
(OC0)E[θ∣x=0;θ≥θS(r)]≤θP(r).
Formalization targets
Goal: Proposition 3
For rC a maximizer of ΠPC on [0,1], the full commitment outcome at rC is implementable by an information policy if and only if (OC0) holds at r=rC, which is equivalent to
The bounds 0≤α(θ;r)<1 on [θP(r),1] and 0<θS(r)≤θP(r)≤1, and the monotonicity of θS,θP,α (§4).
The full-commitment policy solves the platform's §4 commitment problem at every fee, with value ΠPC(r).
Lemma 1: every equilibrium outcome of any signal is the outcome of a binary signal with obedient play.
Signal (3) produces the full commitment outcome, is an equilibrium iff (OC0) holds, and always satisfies (OC1).
(OC0) is equivalent to (4) at every fee r<1−K.
Significance
Proposition 3 gives a checkable condition under which information design substitutes for commitment to entry. When (4) holds, the platform obtains its full-commitment profit by restricting what its product division learns, and the seller faces the same entry threat as under full commitment. When (4) fails, the paper's Proposition 4 shows the platform must distort the outcome by excluding an interval of types. The comparison underlies the paper's policy conclusions about bans on data use and on imitation.
The result is proved in the paper; nothing in this mission is open mathematically. What the mission adds is a machine-checked development of a small information-design model: a formal revelation principle for this game (Lemma 1), with an equilibrium notion that handles a continuum of signal realizations, and a formal check that the integral conditions are equivalent. No part of the paper has been formalized before, to our knowledge.
Difficulty
The sufficiency direction is a computation with signal (3). The necessity direction is not: implementability quantifies over every signal space and every equilibrium, so (OC0), which is a property of one specific binary signal, has to be derived from an arbitrary equilibrium. The naive route of conditioning on each realization fails for a continuum of realizations, where conditional expectations are defined only almost everywhere and off-path behaviour is unconstrained. Separately, the goal is stated at the maximizer rC, and nothing in the hypotheses says directly that rC lies in the non-degenerate range rC<1−K, where some type enters.
Formalization scope
Everything is real-valued, in the namespace Sherlocking.InfoPolicy, with a single definitions module.
Cutoffs are written in guarded form (K/(1−r) if K<1−r, else 1), equal to the printed minimum for r<1; at r=1 this avoids Lean's K/0=0.
Signals are a measurable map σ from R to probability measures on any X : Type with a σ-algebra. Platform strategies are measurable maps X→[0,1], the probability of imitating after each realization.
Equilibrium: the seller's conditions are pointwise for θ∈[0,1], with either action allowed at indifference (the commitment outcome makes every type in [θP,1] exactly indifferent). The platform's sequential rationality is stated ex ante, as optimality against every measurable deviation, which is equivalent to Bayes-rational play after almost every on-path realization.
(OC0) and (OC1) are ratios of integrals over [θS(r),1]. Statements at a general fee assume r<1−K, so that the conditioning event has positive probability.
Added hypotheses: δ<1 throughout; r<1−K in the general-fee milestones. The goal itself carries only Assumption 1, δ<1, rC∈[0,1] and maximality.
Implementability is never defined through (OC0) or through signal (3). It quantifies over all realization spaces, signals, strategies and entry sets, under the full equilibrium predicate; a definition that fixed the signal would make the necessity direction trivial.
A complete development needs interval and set integrals of bounded functions, measurability of kernels and parametric integrals, and the Giry monad on Bool, all available in Mathlib. The binary revelation argument is reusable for other sender–receiver models with a binary action. Proofs of any milestone are welcome, as are alternative proofs of Lemma 1.
Selected references
J. P. Choi, K. Kim, A. Mukherjee, “Sherlocking” and Platform Information Policy, CESifo Working Paper No. 10769, 2023. https://ssrn.com/abstract=4643950
Distributionally Robust Linear and Discrete Optimization with Marginals: the worst-case expected optimal value over a Fréchet class equals its Lagrangian primal and dual formsResearch Paper
Motivation
Many decision problems in operations research end in a linear optimization over a finite set of alternatives whose objective coefficients are random: the longest path in a project network with random activity durations, a maximum-weight assignment or spanning tree with random weights, the best item in a ranking with random utilities. The quantity of interest is the expected optimal valueE[Z(c~)], where Z(c)=maxx∈XcTx. In practice the one-dimensional distributions of the coefficients c~i can be estimated, while their dependence structure usually cannot. The marginal distribution model therefore asks for the largest expected optimal value over all joint distributions consistent with the given marginals, a distributionally robust bound that does not assume independence.
Chen, Ma, Natarajan, Simchi-Levi and Yan (Operations Research, 2022) study this bound for an arbitrary finite feasible set and arbitrary marginals.
Timeline. Meilijson and Nádas (1979) gave a convex formulation of the tight upper bound on the expected completion time of a PERT network when only the marginal distributions of the activity times are known. Bertsimas, Natarajan and Teo (2004) studied the analogous bound for 0–1 problems under marginal moment information. Natarajan, Song and Teo (Management Science 55(3), 2009) gave a concave maximization formula for the marginal distribution model when X consists of integer points and the marginals are absolutely continuous. The paper of this mission removes both restrictions: X is any finite point set, the marginals are arbitrary (discrete marginals allowed), and the bound is cast in Lagrangian primal and dual forms.
Setting
Fix n≥0, a nonempty finite set X⊂Rn, and probability measures μ1,…,μn on R. Write Xi={xi:x∈X} for the coordinate projections of X.
The Fréchet classΓ(μ1,…,μn) is the set of probability measures θ on Rn whose i-th one-dimensional marginal is μi for every i.
P(X) is the set of probability vectors ν on X. For ν∈P(X), Πiν=∑xν(x)δxi is the law of the coordinate xi when x∼ν.
For two laws μ,ν on R, Γ(μ,ν) is the set of couplings: probability measures on R2 with marginals μ and ν.
The Lagrangian of the problem, for functions ψi:Xi→R ("prices" on the coordinate values) and ν∈P(X), is
The quantile function is Fμ−1(t)=inf{x:Fμ(x)>t}.
The value to be computed is
Z∗=θ∈Γ(μ1,…,μn)supEc~∼θZ(c~).
The Lean development names these objects proj, Z, frechetClass, couplings, margMeasure (Πiν), conj (the inner maximum of L), lagrangian, quantile and quantileForm (the objective of (8)), all in MarginalDRO.Lagrange.
Formalization targets
Goal: Theorem 2 (Lagrange Form), p. 14
For marginals with finite variance and a nonempty finite X, with every optimum attained,
The lower bound maxθEθZ≥∑iEγi[c~ixi] for couplings γi∈Γ(μi,Πiν) (p. ec4).
A measurable selection of argmaxx∈XcTx (§3.1, p. 13).
The identity EθZ=∑iEγi[c~ixi] for ν=x∗#θ, γi=(Proji,xi∗)#θ (p. ec4).
The exchange maxνinfψL=infψsupνL (p. ec5).
Attainment of the dual infimum (p. ec5).
Significance
The result. Theorem 2 turns an optimization over joint distributions on Rn, an infinite-dimensional problem, into a saddle problem over probability vectors on X and univariate functions on the finite sets Xi. The dual form gives upper bounds on Z∗ from any choice of prices ψi, and the primal form gives a worst-case joint distribution. The paper builds on it a compact reformulation (its §4) whenever X has a tractable description, and applications to appointment scheduling, robust maximum flow, ranking and project scheduling. Theorem 3 makes the primal side explicit as a concave program in the quantile functions, which holds for discrete marginals as well as continuous ones.
Formalizing it. The results are proved in the paper; none of them has a machine-checked proof. The development needs pieces that are of independent use: Kantorovich duality for a signed, unbounded cost that is linear in one variable, the monotone (comonotone) coupling lemma, gluing of couplings along a common marginal, measurable selection of maximizers over a finite set, and a minimax exchange for a Lagrangian that is affine on a simplex and convex in an infinite family of functions. The ≥ step of the printed proof uses a product of couplings that does not give the inequality in general; a formal proof has to replace it by a gluing argument.
Difficulty
The obvious route to the first equality bounds EθZ from both sides by a joint law of (c~,x). From above this needs a measurable optimal selection; from below it needs a joint law under which x is a point of X and each pair (c~i,xi) has a prescribed coupling. Independent products of the couplings fail here, because their x-coordinates no longer form a point of X. The Lagrangian equalities need duality for a cost cx that is neither bounded nor of one sign, with μi supported on all of R, and attainment of the dual infimum over an unbounded family of potentials, which is invariant under the shifts ψi↦ψi+αi by arbitrary constants αi and so has no compactness for free.
Formalization scope
X is a nonempty Finset (Fin n → ℝ); Xi is its coordinate projection; P(X) is stdSimplex ℝ 𝒳, whose topology for finite X is the weak-* one.
The marginals are Measure ℝ with IsProbabilityMeasure. Finite variance is MemLp id 2. Lemma 1 and Theorem 3, which print no moment condition, assume a finite mean (Integrable id) so that every expectation is finite.
The functions ψi are maps R→R; only their values on Xi enter L, and the inner maximum of L runs over Xi. Potentials in the Kantorovich milestone are real-valued.
∫ψidΠiν is written as ∑xν(x)ψi(xi). The lower limit Πiν((−∞,xi−ei]) of (8) is written Πiν((−∞,xi)), the same number since Xi is finite.
Every max and min is an attainment claim (IsGreatest, IsLeast); inner inf/sup are IsGLB/IsLUB. The quantile is a real infimum that takes the value 0 outside (0,1), a null set for the integrals.
Lemma 1 is stated for h(x,y)=xy and a finitely supported second law, sup half only. Theorem 3 is stated without its "persistence values" clause for absolutely continuous marginals.
The following formalizations would trivialize the goal and are excluded: Z as a maximum over conv(X) or Rn; a class that fixes only some marginals; couplings without the second marginal Πiν; a conjugate taken over R instead of Xi; equalities decided by the default value of a real sSup/sInf; an empty X.
Welcome contributions: the monotone coupling lemma for general supermodular costs, Kantorovich duality on R×F for finite F, gluing of couplings, and proofs of any milestone.
Selected references
L. Chen, W. Ma, K. Natarajan, D. Simchi-Levi, Z. Yan, Distributionally Robust Linear and Discrete Optimization with Marginals, Operations Research 70(3), 2022. https://doi.org/10.1287/opre.2021.2243 (formalized from the 2018 author preprint).
K. Natarajan, M. Song, C.-P. Teo, Persistency Model and Its Applications in Choice Modeling, Management Science 55(3), 453–469, 2009.
I. Meilijson, A. Nádas, Convex Majorization with an Application to the Length of Critical Paths, Journal of Applied Probability 16(3), 671–677, 1979.
On the Learning Benefits of Resource Flexibility: At the Break-Even Cost of Flexibility, the Flexible System Is More Profitable Below a Profit-Margin Threshold and Less Profitable Above ItResearch Paper
Motivation
A firm that sells several products must decide, before demand is known, how much capacity to build. It can build dedicated capacity, one resource per product, or a single flexible resource that can serve any product but costs more per unit. The classical argument for flexibility is risk pooling: one pooled resource absorbs the fluctuations of several demands, as studied by Fine and Freund (1990) and Van Mieghem (1998).
Chod, Markakis and Trichakis (SSRN 3212177, published in Management Science, 2021) identify a second, independent benefit. A firm usually observes its sales, not its demand: when a product stocks out, the firm learns only that demand exceeded capacity. This is demand censoring. Because flexible capacity can be shifted to whichever product is in demand, it stocks out less often for each product, and so the firm learns more about demand from a flexible system than from a dedicated one. When demand is correlated over time, that information is worth money in later periods. The paper calls this the learning benefits of flexibility and asks when they are positive.
To separate learning from pooling, the paper compares the two systems at the break-even cost of flexibility, the unit cost of flexible capacity at which both systems earn the same profit in a single period. Any difference that remains in a two-period model is then due to learning alone (Eq. (14) of the paper).
Setting
There are two products with a common unit price p. Dedicated capacity costs c per unit and flexible capacity costs cF per unit, with 0≤c<p. The first-period demands D11,D21 are independent and each uniform on [x,x+U], with x≥0 and U>0. The profit margin is (p−c)/p.
Static model. With dedicated capacities Q=(Q1,Q2), product i sells min{Di,Qi}, and the expected profit is πN(Q)=pE[min{D1,Q1}+min{D2,Q2}]−c(Q1+Q2). With flexible capacity QF, product 1 is served first: it sells SF,1=min{D1,QF} and product 2 sells SF,2=min{D2,QF−SF,1}; the expected profit is πF(cF)(QF)=pE[SF,1+SF,2]−cFQF. The optimal static profits are
Learning. A product that had q units available and demand d reveals d exactly if d<q; otherwise the firm learns only that D≥q and conditions its prior on that event. The firm's belief after period 1 is the product of the two products' posteriors. In period 2 demand repeats (Di2=Di1), and both systems build dedicated capacity against the posterior belief G, earning
Take x=0. There is a threshold ζ∈(0,1) such that for all p,c,U,cF with 0≤c<p, U>0, c≤cF<p and πˉF(cF)=πˉN,
pp−c≤ζ⟹VF(cF)≥VN,pp−c>ζ⟹VF(cF)≤VN.
The goal fixes no numerical value of ζ; the paper reports ζ≈0.5904.
Milestones
Lemma 3: the uniform newsvendor optimum Qˉ=x+U(p−c)/p with profit (p−c)x+2U(p−c)2/p.
The static non-flexible optimum πˉN=2(p−c)x+U(p−c)2/p.
The static flexible optimum QˉF(cF), πˉF(cF) in the two branches p≥2cF and p<2cF.
Eq. (8): the pooling benefits πˉF(cF)−πˉN are strictly decreasing in cF, and the break-even cost exists and is unique in [c,p).
The two-period non-flexible optimum: VN=4x(p−c)+U(p−c)2(3c+2p)/Δ with Δ=(p−c)(p+c)+cp.
The flexible case QF≥2x+U: concavity, the right derivative (−c2+cp+p(p−2cF))/(2p) at 2x+U, and the price threshold p~.
Significance
Proposition 1 says that learning favours flexibility when margins are low or moderate and favours dedicated capacity when margins are high. Combined with the risk-pooling analysis, it shows that the value of flexibility in a dynamic setting is not captured by static pooling models: a firm choosing a technology by comparing single-period profits misjudges it in both directions, depending on the margin. The comparison at the break-even cost is the cleanest available measurement of the information value of a capacity structure under censored demand.
The paper proves Proposition 1 by computing closed forms of all the value functions and then certifying a polynomial inequality over a semialgebraic parameter set with sum-of-squares methods (p. A8). No machine-checked proof exists. A formalization would replace a computer-algebra certificate whose details are not printed with a checked argument, and would fix the value-function closed forms (milestones 2–6), which the paper derives in a few lines each. The milestones are of independent use: Lemma 3 and the censored-sales posterior are standard in inventory learning models.
Difficulty
The value functions VN and VF(cF) are suprema of first-period profit plus the expectation of a second-period value under a posterior that depends on whether each product stocked out. In the flexible system the capacity left for product 2 depends on product 1's realized demand, so the posterior of product 2 depends on product 1's demand, and the objective vF splits into regimes with different formulas; it is not concave in general (the paper notes "optimization of non-concave functions", p. 12). The break-even cost is defined implicitly by an equation involving square roots, so the final comparison is between two functions of (p,c) along an implicit curve; the obvious approach of comparing closed forms branch by branch needs a sign certificate for a polynomial system rather than a one-line inequality.
Formalization scope
Everything is real-valued. The uniform prior is U−1 times Lebesgue measure on [x,x+U]; the joint prior is the product measure. The stock-out posterior is Mathlib's conditional measure cond of the prior on {D≥q}, an exact observation is a Dirac measure, and a demand is observed exactly iff it is strictly below the available capacity (p. 9). The joint posterior is the product of the per-product posteriors, which is exact because the observation is a product event given product 1's demand. All optima are real suprema of images over nonnegative capacities, never closed forms. The symmetric case of §3 is built in (p1=p2=p, common c, i.i.d. uniform demands), as is ξ=0 (second-period demand equals first-period demand); at x=0 the paper's noise U[−ξx,ξx] is zero for every ξ, so the goal loses nothing. Added hypotheses, disclosed in each statement: U>0, 0≤c<p, c≤cF<p, and in the goal 0<ζ<1.
The values must not be defined by their closed forms or by the paper's case split j=1,2,3; that would make the goal a statement about polynomials rather than about the Bellman problems.
A complete development needs: integrals of piecewise-linear functions against uniform laws and their products, conditional uniform laws, measurability of the posterior-dependent second-period value, and a sign certificate for the final polynomial comparison. The newsvendor and censored-posterior lemmas are reusable in other inventory-learning models. Contributions are welcome on any milestone, on alternative proofs of the final comparison, and on the regime j=3 of the flexible objective, which the milestones do not cover.
C. H. Fine, R. M. Freund, Optimal Investment in Product-Flexible Manufacturing Capacity, Management Science 36(4), 1990. https://doi.org/10.1287/mnsc.36.4.449
Neural Temporal-Difference and Q-Learning Provably Converge to Global Optima: Neural TD with Stochastic Semigradients Converges to the Global Optimum of the MSPBE at Rate 1/√TResearch Paper
Why neural temporal-difference learning needs a convergence theory
Temporal-difference (TD) learning estimates the value of a policy in a Markov decision process from sampled transitions, by repeatedly moving a parametrized value function towards a one-step bootstrapped target (Sutton, 1988). With a linear parametrization its behaviour is well understood: TD converges to the fixed point of the projected Bellman equation (Tsitsiklis and Van Roy, 1997), with finite-sample rates for projected and stochastic variants (Bhandari, Russo and Singal, 2018). With a nonlinear parametrization the same update can diverge: Tsitsiklis and Van Roy (1997) give an example, and the TD direction is not the gradient of any objective. Deep reinforcement learning nonetheless runs TD with neural networks as a matter of course.
Cai, Yang, Lee and Wang (arXiv:1905.10027v2, Mathematics of Operations Research, 2024) prove that TD with an overparametrized two-layer ReLU network, projected onto a ball around its random initialization, converges at rate T−1/2 to the global optimum of the mean-squared projected Bellman error (MSPBE) over a function class that becomes richer as the width grows. This mission formalizes that theorem for the stochastic-semigradient algorithm (Theorem 4.6 of the paper).
Setting
Transitions are tuples (x,r,x′) drawn i.i.d. from a sampling lawμ: x,x′∈Rd are feature vectors of the current and next state–action pair, with ∥x∥2=∥x′∥2=1, the reward satisfies ∣r∣≤rˉ, and x and x′ have the same distribution (they are drawn from the stationary distribution of the policy). The discount factor is 0≤γ<1 and d≥3.
The value function is the two-layer network
Q(x;W)=m1r=1∑mbrσ(Wr⊤x),σ(y)=max{0,y},
of widthm, with hidden weights W=(W1,…,Wm)∈Rmd and output weights b∈Rm. At initializationbr∼Unif{−1,1} and Wr(0)∼N(0,Id/d), all independent; only W is trained. The training set is the ball SB={W:∥W−W(0)∥2≤B}.
Algorithm 1 (neural TD) samples a tuple at each step t=0,…,T−2, forms the Bellman residual δ=Q(x;W(t))−r−γQ(x′;W(t)), takes the semigradient step W(t)−ηδ∇WQ(x;W(t)), projects it onto SB, and outputs Qout=Q(⋅;W) with W=T1∑t=0T−1W(t).
The linearization of the network at initialization is
Q0(x;W)=m1r=1∑mbr1{Wr(0)⊤x>0}Wr⊤x,
a linear function of W with random features. Writing δ0 for the Bellman residual of Q0, an approximate stationary point is a W∗∈SB with
Eμ[δ0(x,r,x′;W∗)∇WQ0(x;W∗)]⊤(W−W∗)≥0for all W∈SB.
The function Q0(⋅;W∗) solves the projected Bellman equation over the class FB,m={Q0(⋅;W):W∈SB}. The regularity condition (Assumption 4.3) asks for c0>0 with μ(∣w⊤x∣≤τ)≤c0τ for every unit vector w and every τ≥0.
Formalization targets
Goal: Theorem 4.6
With η=min{(1−γ)/8,1/T} and under Assumption 4.3, there is a constant C=C(c0,d,rˉ,γ) such that for all m≥1, B≥1, T≥1 and every approximate stationary point W∗,
where σg2=12+12B2+3rˉ2 and the expectation is over the initialization, the samples of the run and a fresh x∼μ.
Milestones
Lemma 4.2: approximate stationary points exist for every initialization; Q0(⋅;W∗) is unique μ-a.e. and is the MSPBE optimum over FB,m.
Lemmas H.1, H.2: the expected fraction of hidden units whose activation can flip inside SB is O(Bm−1/2), alone and weighted by Eμ[Q(x;W(0))2].
Lemmas 5.1, 5.2: the network and its population semigradient stay within O(B3m−1/2) (in mean square) of their linearizations, for every random parameter in SB.
Lemma 4.5: the stochastic semigradient has variance at most σg2.
(C.16): the linearized population semigradient is monotone with modulus 1−γ in the μ-norm.
Lemma 5.4: the stochastic descent inequality for E∥W(t)−W∗∥22.
Significance
The theorem gives a non-asymptotic guarantee for TD with a nonlinear function class, a setting in which the algorithm can diverge without further structure. The limit object Q0(⋅;W∗) is a projected Bellman fixed point over a class that, as m→∞, approaches a ball in the reproducing kernel Hilbert space of the neural tangent kernel; the paper uses this to bound the distance to the true value function Qπ (Proposition 4.7) and to analyze neural Q-learning and policy gradient methods (Section 6). The argument is an instance of the "lazy training" or neural-tangent-kernel regime, in which an overparametrized network trained from a random initialization stays close to its linearization.
The result is proved in the paper and, to our knowledge, has no machine-checked proof. A formalization would also produce reusable components: Gaussian anti-concentration of random ReLU activation patterns (Lemmas H.1–H.2), the linearization error of wide two-layer networks (Lemma 5.1), and a projected stochastic-approximation template with averaged iterates. The appendix proofs are short and pass over several measure-theoretic steps (conditioning on the current iterate, independence of the samples from the initialization, Jensen for the averaged iterate), which a formal proof has to supply.
Difficulty
The TD update is not a gradient, so the convergence proof cannot be a descent argument on an objective. The paper's route is to compare the update with that of the linear TD problem defined by Q0, whose population semigradient is monotone, and to control the difference by overparametrization. The obvious first approach, linearizing the network in a deterministic neighbourhood of W(0), fails: the ReLU activation pattern 1{Wr⊤x>0} can change for some units whatever m is. The comparison holds only in expectation over the random initialization and a fresh input, through Assumption 4.3 and the finiteness of E∥w∥2−2 for w∼N(0,Id/d), which is where d≥3 enters. The iterates and W∗ depend on the initialization, so these bounds are needed for random parameters that are correlated with W(0) but independent of the evaluation point.
Formalization scope
Lean represents points as EuclideanSpace ℝ (Fin d) and parameters as PiLp 2 over Fin m, so all norms on Rmd are ℓ2. The MDP, the policy and the feature map are not modelled; the statements see only the sampling law μ on tuples (x,r,x′) with the properties listed above. The run's samples form an N-indexed i.i.d. sequence (product measure) independent of the initialization, and the evaluation tuple is a fresh draw. Expectations of nonnegative quantities are lower Lebesgue integrals, so non-integrability cannot make a bound hold vacuously. The ReLU semigradient uses the strict convention 1{Wr⊤x>0} and keeps the factor m−1/2 of (3.2).
Conventions and readings fixed by the formalization, all disclosed in the item statements:
the paper's "σg2=O(B2)" is pinned to the value 12+12B2+3rˉ2 produced by its proof;
the paper's O(B3m−1/2+B5/2m−1/4) is a constant C depending only on (c0,d,rˉ,γ) and chosen before m, B, T, μ and W∗, with B≥1 so that lower powers of B are absorbed;
approximate stationary points are required to lie in SB, as the proof uses;
Lemmas 5.1 and 5.2 are posed for every random parameter in SB (the paper's proofs need nothing else and apply them to W);
Lemma 5.4 carries the coefficient 4ηB, which is what its proof establishes (∥W(t)−W∗∥2≤2B), in place of the printed 2ηB.
A formalization in which the comparison point W∗ may lie outside SB, the expectation is a Bochner integral of a possibly non-integrable function, or the constant C may depend on m, T or μ, would not express the theorem and is excluded. Approximate stationary points are compared through Q0(⋅;W∗), never through Q(⋅;W∗).
A complete development needs Gaussian measures on Rd with the integrability of ∥w∥2−2 for d≥3, product and infinite-product probability measures with conditioning on the past of a sequence, existence of solutions to variational inequalities on compact convex sets, and nonexpansiveness of Euclidean projection onto a ball. Proofs of individual milestones are welcome independently; Lemmas H.1, 5.1 and (C.16) are self-contained.
Selected references
Q. Cai, Z. Yang, J. D. Lee, Z. Wang, Neural temporal-difference and Q-learning provably converge to global optima, Mathematics of Operations Research, 2024; arXiv:1905.10027v2. https://arxiv.org/abs/1905.10027
J. N. Tsitsiklis, B. Van Roy, An analysis of temporal-difference learning with function approximation, IEEE Transactions on Automatic Control 42(5), 1997. https://doi.org/10.1109/9.580874
J. Bhandari, D. Russo, R. Singal, A finite time analysis of temporal difference learning with linear function approximation, COLT 2018. https://arxiv.org/abs/1806.02450
A. Jacot, F. Gabriel, C. Hongler, Neural tangent kernel: convergence and generalization in neural networks, NeurIPS 2018. https://arxiv.org/abs/1806.07572
Tracking Truth with Liquid Democracy: Upward Delegation Satisfies Probabilistic Do No Harm and Positive GainResearch Paper
Motivation
Liquid democracy lets each voter either vote directly or delegate the vote to another voter, who may delegate it further. It has been used in practice, for example by the German Pirate Party on the LiquidFeedback platform and in the Google Votes experiment, and has been studied in computational social choice as a way to give more weight to better-informed voters. A natural worry is that delegation concentrates power: if too many votes flow to a few voters, the outcome rests on those few judgements and the "wisdom of the crowd" of independent votes is lost. Kahng, Mackenzie and Procaccia (Journal of Artificial Intelligence Research, 2021) showed that no local delegation mechanism can guarantee, for every instance, that liquid democracy is never worse than direct voting and sometimes strictly better.
Berinsky, Halpern, Halpern, Jadbabaie, Mossel, Procaccia and Revel (arXiv:2107.11868v3; Management Science, 2025) replace the worst-case requirement by a probabilistic one: competencies and delegations are random, and the comparison is made with high probability as the number of voters grows. Their first main result, Theorem 1, concerns the simplest model in which delegation goes only upward in competence. It is the goal of this mission.
Setting
There are n voters [n] deciding a binary question with a correct answer. Voter i has a competencepi∈[0,1], the probability that its own vote is correct; given pn=(p1,…,pn), the votes Vi∼Bern(pi) are independent, with law Ppn.
A delegation graphGn is a directed graph on [n] in which every voter has at most one outgoing edge, the voter it delegates to. A voter i who votes directly has weightweighti(Gn)=1+(the number of voters whose delegation chain ends at i); a delegating voter has weight 0; voters on a delegation cycle, or delegating into one, are not counted. max-weight(Gn) is the largest weight. Direct democracy gets XnD=∑iVi correct votes and liquid democracy XGnF=∑iweighti(Gn)Vi. The gain of the instance (pn,Gn) is
A modelM=(q,φ) consists of q:[0,1]→[0,1] and φ:[0,1]2→R≥0. Competencies are drawn i.i.d. from a distribution D supported in [0,1]; then each voter i independently keeps its vote with probability 1−q(pi) and otherwise delegates to some j=i with probability proportional to φ(pi,pj) (and keeps its vote if all these weights vanish). This defines the law PD,M,n of the random instance.
M satisfies probabilistic do no harm with respect to a class D if for every D∈D and all ε,δ>0, eventually PD,M,n[gain≥−ε]>1−δ (Definition 1).
M satisfies probabilistic positive gain with respect to D if for some D∈D and all ε,δ>0, eventually PD,M,n[gain≥1−ε]>1−δ (Definition 2).
The Upward Delegation ModelMpU has q≡p and φ(x,y)=1{y>x}: each voter delegates with probability p, to a strictly more competent voter chosen uniformly. DC is the class of continuous distributions on [0,1].
The proof runs through the infinite Pólya urn with attachment probability p: at time 1 there is one ball in one bin; each new ball opens a new bin with probability 1−p and otherwise joins an existing bin with probability proportional to its size. Ltp is the largest bin size at time t.
Formalization targets
Goal: Theorem 1
For every p∈(0,1),
MpUsatisfies probabilistic do no harm and probabilistic positive gain with respect toDC.
Milestones
The milestones are the statements the paper's proof uses, in attack order:
(14): gain(pn,Gn)≥−Ppn[XnD>XGnF] for every instance.
Lemma 1 (core lemma): if every D∈D has α∈(0,1) and C(n)∈o(n) with
then M satisfies probabilistic do no harm. If moreover some D satisfies ∑ipi+αn≤n/2≤∑iweighti(Gn)pi−αn with probability 1−o(1), it satisfies probabilistic positive gain.
(5): the bin W(k) born at time k has E[Wn(k)]=Γ(n+p)Γ(k)/(Γ(p+k)Γ(n)).
Domination: Wt(k) stochastically dominates the k-th bin Ut(k).
Early and late bins: for 3/4<γ<1 and p+(1−p)γ<δ<1, ∑k≤TγPr[WT(k)>Tδ]=o(1) and ∑Tγ<k≤TPr[WT(k)>Tδ]=o(1).
Lemma 2: there is δ<1 with Pr[LTp≤Tδ]=1−o(1).
Urn coupling: under MpU and a continuous D, the component sizes of Gn have the law of the urn's bin sizes after n steps, so max-weight(Gn) has the law of Lnp.
Conditions (2) and (3) for MpU (Appendix B.3): (2) for every D∈DC; (3) for some D∈DC.
Significance
Theorem 1 shows that the impossibility result of Kahng et al. is an artefact of worst-case analysis: under a simple and natural random model, liquid democracy is asymptotically no worse than majority vote for every continuous competence distribution, and strictly better for some. Lemma 1 is the paper's general tool: it reduces both properties to two checkable conditions, a sub-linear largest weight and a linear increase of the expected number of correct votes, and is reused for the paper's two other models (Theorems 2 and 3). Lemma 2, a sub-linear bound on the largest bin of the infinite Pólya urn (the Simon–Yule preferential-attachment process), is of independent interest in random-structure theory.
The results are proved in the paper. None of them is formalized; Prove2Me has no liquid-democracy, delegation-graph or infinite-urn item. A formal development adds a checked version of the core lemma for arbitrary models, and a formal treatment of the urn that the later models' arguments can be compared with. Several steps of the paper are terse (the late-bin bound rests on a cited convergence rate; the arithmetic of Appendix B.3 is loose), so a checked proof adds more than a transcription.
Difficulty
The obvious argument — liquid democracy moves votes to better voters, so it should do at least as well — fails because concentration is lost when weights become large: if one voter carries a constant fraction of the votes, XGnF no longer concentrates, and the majority can be wrong with constant probability even though the expected number of correct votes rises. The heart of Theorem 1 is therefore Lemma 2, a bound LTp≤Tδ with δ<1 on the largest bin of an infinite Pólya urn. A first-moment bound on each bin handles the bins born before time Tγ, but the union bound over the remaining bins needs each to exceed Tδ with probability o(1/T), which first moments do not give. The coupling between the urn and MpU needs the competencies to be distinct, which is where continuity of D enters.
Formalization scope
All declarations live in the namespace LiquidDemocracy.Upward, in two definition files (Setting, Urn) and one file per theorem, against the platform's default Mathlib.
Voters are Fin n; a delegation graph is a map g : Fin n → Fin n with g i = i meaning "votes directly". A voter's weight counts the voters whose chain, followed n steps, ends at it; chains running into a cycle reach no direct voter, which implements the cycle convention.
Ppn is a finite sum over the 2n vote vectors; both majorities are strict (>n/2).
The instance law PD,M,n is a measure on competence vectors and graphs, built as a finite sum over graphs of D⊗n with the density given by the delegation probabilities; no push-forward along a non-measurable map occurs.
DC is the set of atomless probability measures on R giving [0,1]c measure 0 ("continuous distribution" read as continuous CDF).
The urn and W(k) are measures built step by step with Measure.bind; bins are numbered from 1, time t means t balls, and the step into time t divides by t−1.
"=1−o(1)" is convergence to 1; C(n)∈o(n) is =o[atTop]; Definitions 1–2 keep the paper's ε,δ,n0 form. In Lemma 1 the model is assumed typed as on p. 10 and measurable.
A trivializing formalization is excluded: the instance law is a probability measure for MpU and DC is nonempty (the uniform distribution on [0,1] belongs to it), both checked sorry-free, so neither property holds vacuously or fails for a degenerate reason.
A complete development needs Hoeffding's and Chebyshev's inequalities (in Mathlib), Gautschi's inequality for Gamma ratios, a coupling argument for stochastic domination of Markov chains, and the conditional-independence structure of the instance law. The urn results and Lemma 1 are reusable beyond this mission. Contributions to any milestone are welcome, including alternative proofs of the late-bin bound (for instance by second-moment recursions instead of the cited Beta-limit rate).
Selected references
A. J. Berinsky, D. Halpern, J. Y. Halpern, A. Jadbabaie, E. Mossel, A. D. Procaccia, M. Revel, Tracking Truth with Liquid Democracy, Management Science, 2025; arXiv:2107.11868v3. https://arxiv.org/abs/2107.11868v3
A. Kahng, S. Mackenzie, A. D. Procaccia, Liquid Democracy: An Algorithmic Perspective, Journal of Artificial Intelligence Research 70:1223–1252, 2021.
F. Chung, S. Handjani, D. Jungreis, Generalizations of Pólya's Urn Problem, Annals of Combinatorics 7(2):141–153, 2003.
W. Gautschi, Some Elementary Inequalities Relating to the Gamma and Incomplete Gamma Function, Journal of Mathematics and Physics 38(1):77–81, 1959. https://doi.org/10.1002/sapm195938177
Surge Pricing and Its Spatial Supply Response: Within an Attraction Region, Supply Fills the Congestion Bound Outward from the Sink at Locally Optimal Prices Without Loss of RevenueResearch Paper
Spatial pricing on ride-hailing platforms
Ride-hailing platforms change prices by location in real time, and drivers respond by moving. A price increase at one location changes where drivers go, how congested each location becomes, and therefore what every driver earns everywhere else. Besbes, Castro and Lobel, Surge Pricing and its Spatial Supply Response (SSRN 3124571, version of May 17, 2019; later published in Management Science, DOI 10.1287/mnsc.2020.3622), model this as a platform choosing prices over a continuous two-dimensional city, with non-atomic drivers who then relocate in equilibrium. Earlier work on ride-hailing pricing took space into account only in reduced form (e.g. Castillo, Knoepfle and Weyl, EC 2017) or on a finite network (Bimpikis, Candogan and Saban, Operations Research 2019). The platform's problem in this model is an infinite-dimensional optimization problem with equilibrium constraints. The paper's main result, the goal of this mission, characterizes optimal prices and supply locally, inside the regions drivers move into.
This mission formalizes that result from the SSRN preprint of May 17, 2019. Its online appendix contains the proofs, and every page and label cited here refers to it.
Setting
The cityC⊆R2 is convex and compact. It carries a finite city measureΓ, a finite potential demand measure Λ and a finite initial supply measure Θ, all concentrated on C, with Λ,Θ≪Γ. The demand density is λ=dΛ/dΓ, which is positive Γ-a.e. At location y the riders' willingness to pay has CDF Fy, strictly increasing on its support [0,Vˉ], with Fˉy=1−Fy and a continuous, unimodal revenue curve q↦qFˉy(q). The driver receives a fraction α∈(0,1) of each fare.
The platform chooses a measurable price mappingp:C→[0,Vˉ]. Drivers relocate according to a flowT, a measure on C×C with first marginal Θ and second marginal T2≪Γ. The post-relocation supply is sT=dT2/dΓ. A driver who ends at y is matched with probability R=min{1,λ(y)Fˉy(p(y))/sT(y)} (with conventions at zero supply), earns U(y,p(y),sT(y))=αp(y)R, and pays travel cost ∥y−x∥ when coming from x. The best utility available from x is the Γ-essential supremum
V(x∣p,T)=y∈Cesssup(U(y,p(y),sT(y))−∥y−x∥).
T is a supply equilibrium if almost every driver goes to a destination attaining this value. Problem (P2) maximizes γ∫CV(x∣p,T)sT(x)dΓ(x), with γ=(1−α)/α, over price–equilibrium pairs; the paper shows (P2) is equivalent to maximizing platform revenue.
A single location run as a capacitated monopoly with supply s has revenue Rxloc(s)=maxq∈[0,Vˉ]qmin{s,λ(x)Fˉx(q)} and optimal price ρxloc(s). The congestion functionψx(s)=αRxloc(s)/s, with ψx(0)=αVˉ, is the utility per driver at that location. The indifference region of x is IR(x)={y∈C:V(y)−∥y−x∥=V(x)}. The attraction region of z is A(z∣p,T)={x∈C:z∈IR(x)}. The point z is a sink if A(z)=∅ and z∈/A(z′) for every z′=z. Along each ray a from z, Xa(z∣p,T) is the last point of A(z).
Formalization targets
Goal: Theorem 1 (p. 18)
For every feasible (p,T) of (P2) and every sink z, there are a feasible (p^,T^) with at least the same (P2) value, points ra∈[z,Xa(z∣p,T)] and numbers sa≥0, such that on A(z∣p,T)
In order: Lemma 1 (p. 13, VB is 1-Lipschitz); Lemma A-1 (bounds [−H,αVˉ] on VB; V≥0 on the support of Γ); Lemma A-2 (equilibrium utilities); Lemma A-3 (ψx strictly decreasing); Proposition 2 (p. 15, the congestion bound V(x)≤ψx(sT(x))Γ-a.e.); Lemma B-2 (indifference propagates along segments); Lemma B-1 (attraction regions are closed unions of segments [z,Xa]); Lemma B-3 (positive flow contains an indifferent pair); Proposition B-1 (flow separation at the endpoints and at the sink); Proposition B-2 (pasting a local equilibrium into an attraction region).
Significance
Theorem 1 shows that, within any attraction region, an optimal solution has a simple structure. Supply is filled ray by ray outward from the sink up to the congestion bound, and each location is priced as a local monopolist given its supply. It reduces the platform's infinite-dimensional problem with equilibrium constraints to a choice of one cutoff point per ray. In the paper it is an ingredient of the explicit global solution of the one-dimensional demand-shock family of §8 (Theorem 3).
The result is proved in the paper (Appendix C). None of it has been formalized. A formal proof would check a long measure-theoretic argument (Appendix C, about nine pages) that works with densities, essential suprema and a.e. statements throughout. The milestones are smaller results with short proofs, and are self-contained targets.
Difficulty
The goal is an existence statement over flows, so the new equilibrium T^ must be constructed and its equilibrium property checked. Changing supply inside A(z) changes utilities at every location whose drivers could move there. The supply and prices therefore cannot be optimized pointwise and pasted back without controlling flows that cross the boundary of the region. Matching the drivers available in A(z) to the congestion bound along each ray must work for an arbitrary finite Γ, which may have atoms or be concentrated on curves. Every density identity holds only Γ-a.e., and the region boundaries ⋃a{Xa} or ⋃a{ra} can carry positive measure.
Formalization scope
The plane is EuclideanSpace ℝ (Fin 2). The paper says "a norm", but the ray geometry of Appendix B needs a strictly convex one. Measures are measures on R2 concentrated on C, and flows are measures on R2×R2. Densities are Radon–Nikodym derivatives converted to reals, so every pointwise claim about sT, λ or prices built from them is stated Γ-a.e. VB is the Mathlib essSup with respect to Γ∣B; it is finite under the standing assumptions, so no boundedness hypothesis is added. Rays are indexed by unit vectors.
The standing assumptions of §3.1 are one hypothesis, Market.Standing, of every theorem. It contains: convex compact city; finite measures concentrated on it, with Λ,Θ≪Γ; Vˉ>0; 0<α<1; Fy a CDF supported on [0,Vˉ] and strictly increasing there; continuous, unimodal revenue; λ>0Γ-a.e.; joint measurability of (y,q)↦Fy(q). The last assumption and the CDF properties are implicit in the paper and are added openly. A sanity file shows that these assumptions hold for a one-point city.
In Theorem 1, ψx−1(v) is written as ψx(sT^(x))=v. The supply cases are read in the printed order at the sink. Prices ρxloc come from (5), so ρxloc(0)=Vˉ. In Proposition B-1, the printed ⋃a[z,Xa is read as the half-open {z}∪⋃a[z,Xa) used in its proof. Proposition B-2 adds Γ(A)>0, the precondition of Definition 3.
Two formalizations would make the goal trivial, and both are excluded. Dropping the equilibrium condition from feasibility would let any flow "dominate". Taking V as a pointwise supremum or sT as a free function would decouple the objective from the flow. Feasibility includes Definition 1, V is an essential supremum, and sT is the density of the flow.
Contributions welcome: proofs of the milestones, general lemmas on essential suprema of Lipschitz families, and general measure-theoretic results about finite planar measures and rays from a point, which can be reused outside this mission.
J. C. Castillo, D. Knoepfle, G. Weyl, Surge pricing solves the wild goose chase, Proceedings of EC, 2017, pp. 241–242. https://doi.org/10.1145/3033274.3085098
L. Ambrosio, A. Pratelli, Existence and stability results in the L¹ theory of optimal transportation, in Optimal Transportation and Applications, Springer LNM 1813, 2003, pp. 123–160. https://doi.org/10.1007/978-3-540-44857-0_5
Fully Polynomial-Time Approximation Schemes for Fair Rent Division: Algorithm 1 on the Slope-Rounded Instance Halts in Polynomially Many Iterations with an ε-Envy-Free SolutionResearch Paper
Fair rent division beyond quasilinear utilities
Housemates who share a house must decide who gets which room and how the total rent is split. A solution pairs an assignment of rooms to agents with a rent for each room, and it is envy-free if no agent prefers another room at that room's rent. Envy-free rent division is the textbook example of fair division with money and is the mathematical core of two-sided matching markets with transfers, where an envy-free solution is a competitive equilibrium.
For quasilinear utilities (a room's value minus its rent) envy-free solutions are computed by an assignment problem and a linear program (Aragones, 1995), and this method is in practical use. Real preferences are often not quasilinear: an agent may have a budget, or be less sensitive to rent at low prices. Existence of envy-free solutions for general continuous, decreasing utilities was established by Svensson (1983) and by Alkan, Demange and Gale (1991), whose perturbation lemma lowers the rents of an envy-free solution while keeping it envy-free. Alkan (1989) gave an algorithm that finds an equilibrium in finite time, with no polynomial bound. Arunachaleswaran, Barman and Rathi (arXiv:1807.04163; Mathematics of Operations Research, 2022) give the first fully polynomial-time approximation scheme for continuous, decreasing piecewise-linear utilities. They also show that the exact problem lies in PPAD ∩ PLS.
Setting
There are n agents and n rooms. Agent a's utility for room r at rent x≥0 is va(r,x), given by a base value va(r,0) (of either sign), break points 0=b1<b2<⋯<bt and slope magnitudes λ1,…,λt>0, so that va(r,⋅) is continuous, strictly decreasing and linear with slope −λi on [bi,bi+1] (the last piece is unbounded). The total number of pieces is ℓ, and β bounds ∣logλ∣ over all slopes. A solution (π,p) is a bijection π from agents to rooms and a rent vector p. It is envy-free if va(π(a),pπ(a))≥va(r,pr) for all a,r. For ε>0 it is ε-EF (Definition 2) if every agent with nonnegative utility satisfies (1+ε)va(π(a),pπ(a))≥va(r,pr) for all r, and every agent with negative utility satisfies va(π(a),pπ(a))≥(1+ε)va(r,pr) for all r.
Algorithm 1 works on a modified instance I^: above a threshold M with va(r,M)<va(r′,0) for all a,r,r′, every utility is continued with slope 1 (equation (1)). It starts from any envy-free solution of I^ with all rents at least M. While all rents are positive it (i) takes a maximum-weight perfect matching πi of the first-choice graph at pi−1, with the weight of edge (a,r) equal to log of the current slope of va(r,⋅); (ii) sets pi to a minimum-total-rent solution of the linear program that keeps πi envy-free, keeps the rents nonnegative, and keeps them inside the current linear domain (the box of rents between consecutive slope changes, Definition 1).
The approximation scheme rounds every slope up to a power of (1+ε), λˉ=(1+ε)⌈log1+ελ⌉. Each piece is replaced by two pieces of slopes λˉ/(1+ε) and λˉ that meet the original function at the piece's end points, after the zero of each utility has been made a break point. The resulting instance is Iˉ.
Formalization targets
Goal: Theorem 2 (p. 9, restated p. 18)
There is a constant c such that for every instance with n≥1, every ε∈(0,1) and every admissible threshold M for Iˉ, Algorithm 1 run on Iˉ
has a run that halts;
halts in every run after at most
T≤c(n+ℓ+β+1/ε+1)c
iterations, whatever Step 2 solution, matchings and LP optima are chosen;
3. outputs rents pT≥0 such that (πT,pT) is an ε-EF solution of the original instance.
The polynomial is left unspecified; the paper's proof gives a small explicit one, and any polynomial establishes the scheme.
Milestones
The proof has two halves. Theorem 1 (p. 9, proof pp. 13–14) is the same statement with "envy-free" in place of "ε-EF" for any instance whose slopes are already powers of (1+ε). It rests on Lemma 16 (quasilinear envy-free allocations are the maximum-weight matchings), Lemma 18 (its multiplicative form), the perturbation Lemma 2, the run invariants Lemmas 3–5 and the per-domain count (3), ∣S∣≤6βn/ε. Lemma 9 (p. 17) states that every envy-free solution of Iˉ with nonnegative rents is ε-EF for the original instance, through Lemmas 6–8 on the rounded functions.
Significance
Theorem 2 gives an efficient algorithm for approximately fair rent division under general piecewise-linear utilities: budgets, rent-sensitive valuations and concave utilities. Exact envy-free solutions for this class are only known to lie in PPAD ∩ PLS. Because envy-free solutions are equilibria of unit-demand markets with money, the theorem also yields approximate equilibria for such markets with non-quasilinear utilities. Theorem 1 gives an exact polynomial algorithm whenever slopes are powers of (1+ε).
The result is proved in the paper. None of it has been machine-checked: there is no formal model of envy-free rent division, of the perturbation lemma, or of a price-descent algorithm of this kind in Mathlib or on the platform. A complete development would give a checked proof that a fair-division algorithm terminates within a polynomial number of iterations with a fairness guarantee.
Difficulty
Envy-freeness of the output is not the hard part: every iterate of Algorithm 1 is envy-free for I^ by construction, and the rounding lemmas are elementary inequalities on single pieces. The difficulty is termination with a polynomial bound. Lowering rents by the perturbation lemma alone need not stop: Alkan gives an instance in which the perturbations do not converge. A bound has to control how many iterations the algorithm spends inside one linear domain and how many domains it visits. The first count fails for arbitrary slopes, where up to n! matchings of distinct weight can occur in one domain; the power-of-(1+ε) structure is what the rounding provides. The perturbation lemma is also needed in the form of Lemma 2, for every maximum-weight matching of the weighted first-choice graph, not only for one matching it produces. A formal proof must further show that each step can be carried out: the matching exists and each linear program attains its minimum.
Formalization scope
Representation. A utility is a base value and a list of (start, slope) pieces. Standing requires first start 0, strictly increasing starts and positive slopes. Agents and rooms are Fin n, allocations are Equiv.Perm (Fin n), rents are real. log is the natural logarithm. β bounds ∣logλ∣ and stands in for the bit complexity of the slopes. Base values may be negative.
The run. Algorithm 1 is a predicate on sequences (πi,pi). Every choice the pseudocode leaves open (the Step 2 solution, the maximum-weight matching, the LP optimum) is quantified universally in the bound and the output guarantee. Halting means some rent is ≤0. Only the number of while-iterations is bounded. The cost of one iteration (computing Iˉ and M, a matching, a linear program) and the bit length of the input are not formalized.
Conventions. Linear-domain boundaries are the break points where some slope actually changes, plus the rent 0. Below rent 0 (used only by Lemma 2, whose rents may be negative) each utility continues its first piece. The paper describes the rounding only for bounded pieces. The unbounded last piece is rounded down to slope λˉ/(1+ε); after the zero split its utility is nonpositive, and this choice keeps Lemmas 6, 7 and 9 true. Lemmas 6 and 9 are stated for nonnegative rents, the paper's convention for solutions. Lemma 7 (d), (e) are stated on the open piece, because the printed closed-interval form fails at an end point equal to the zero of the utility. Lemma 4 and (3) assume the next iteration exists, which the page takes for granted. n≥1 and ε∈(0,1) are assumed where the paper assumes them.
Ruled out. The goal is about Algorithm 1 run on the explicitly constructed Iˉ. The bare existence of an ε-EF solution (which follows from exact existence theorems) does not establish it, and the constant c is fixed before the instance.
Infrastructure. Piecewise-linear functions on lists of pieces, assignment duality for permutations (Lemmas 16 and 18) and existence of optima of linear programs over closed sets are reusable beyond this mission. Proofs of any milestone are welcome, and so are independent proofs of Lemma 16 from LP duality.
Selected references
E. R. Arunachaleswaran, S. Barman, N. Rathi, Fully Polynomial-Time Approximation Schemes for Fair Rent Division, arXiv:1807.04163v1, 2018; Mathematics of Operations Research, 2022. https://arxiv.org/abs/1807.04163
A. Alkan, G. Demange, D. Gale, Fair allocation of indivisible goods and criteria of justice, Econometrica 59(4):1023–1039, 1991 (reference [ADG91] of the paper above).
A. Alkan, Existence and computation of matching equilibria, European Journal of Political Economy, 1989 (reference [Alk89]).
E. Aragones, A derivation of the money Rawlsian solution, Social Choice and Welfare 12(3):267–276, 1995 (reference [Ara95]).
L.-G. Svensson, Large indivisibles: an analysis with respect to price equilibrium and fairness, Econometrica 51(4):939–954, 1983 (reference [Sve83]).
Inner Moreau Envelope of Nonsmooth Conic Chance-Constrained Optimization Problems: Optimal Values and Solutions of the Moreau-Regularized Problems Converge to Those of the Original ProblemResearch Paper
Motivation
A chance constraint asks that a random inequality system hold with at least a prescribed probability p. Such constraints appear throughout engineering and energy optimization: reservoir and power-system management, network design, and any decision that must stay feasible against uncertain demand or inflow with high reliability. The function x↦P(constraint holds at x) is called a probability function. It is in general neither convex nor smooth, even when the underlying random inequality is convex in the random vector, and this is what makes chance-constrained problems hard to solve with standard nonlinear-programming methods.
One remedy is to replace the probability function by a regular approximation and to solve a sequence of approximate problems. van Ackooij, Pérez-Aros, Soto and Vilches (arXiv:2301.09803, Mathematics of Operations Research, 2024) propose an inner regularization built from the Moreau envelope of a scalarized constraint function, for conic constraints in infinite-dimensional decision spaces. The approximate feasible sets contain the original one, and the approximate problems have smooth data. A regularization is useful only if solving the approximate problems recovers the original problem in the limit. This mission formalizes that consistency statement, Theorem 5.4 of the paper.
Setting
Let H be a separable real Hilbert space (the decision space), Y a real Banach space with dual Y∗, and ξ:Ω→Rm a random vector on a probability space (Ω,P) whose law has a density with respect to Lebesgue measure. A continuous map Φ:H×Rm→Y and a nonempty closed convex cone K⊆Y define the probability function
φ(x)=P(ω:Φ(x,ξ(ω))∈−K).
The conic constraint is scalarized by a convex, weak∗-compact set C⊆Y∗ whose generated cone has weak∗ closure equal to the positive polar coneK+={v∗:⟨v∗,v⟩≥0∀v∈K}. A convex, continuously differentiable h:H→R is assumed to make every scalarization (x,z)↦⟨v∗,Φ(x,z)⟩+h(x), v∗∈C, jointly convex. The supremum function is SΦh(x,z)=supv∗∈C{⟨v∗,Φ(x,z)⟩+h(x)}.
For λ>0 and ψ:H→R∪{+∞}, the Moreau envelope is eλψ(x)=infz{ψ(z)+2λ1∥x−z∥2}. The inner regularization of φ is
φλ(x)=P(ω:eλSΦh(x,ξ(ω))≤h(x)),
the envelope being taken on H×Rm with the Hilbert norm. For p∈[0,1] put M(p)={x:φ(x)≥p} and Mλ(p)={x:φλ(x)≥p}. Given a proper, convex, lower semicontinuous objective ψ, problem (P) minimizes ψ over M(p) and the regularized problem (Pλ) minimizes eλψ over Mλ(p), with optimal values v(P) and v(Pλ).
Formalization targets
Goal: Theorem 5.4 (p. 21)
If ψ is moreover coercive and M(p)∩domψ=∅, then
v(P),v(Pλ)∈R(λ>0),v(Pλ)λ→0+v(P),
and for λk→0+ and optimal solutions xk of (Pλk) with xk⇀x0, the point x0 is optimal for (P). If moreover domψ=H and ψ∗ is Fréchet differentiable on dom∂ψ∗, then xk→x0 in norm.
Milestones
Proposition 2.1 a), c) (p. 5): eλg↗g as λ↘0, and g(x)≤liminfkeλkg(xk) for xk⇀x, λk↘0.
Proposition 2.6 (p. 8): φ(x)=P(SΦh(x,ξ)≤h(x)).
Theorem 3.1 a), b), d) (p. 9): infλ>0φλ=φ monotonically; limsupkφλk(xk)≤φ(x); weak upper semicontinuity of φ and φλ.
Proposition 5.1 (p. 19): Mλ(p)→M(p) in the Painlevé–Kuratowski sense, and in the Mosco sense when h is sequentially weakly continuous.
Significance
Theorem 5.4 justifies the regularization as a solution method: optimal values converge, and weak limits of regularized optimal solutions solve the original problem, with strong convergence under a smoothness condition on ψ∗. Combined with the paper's differentiability results for φλ (§4, not part of this mission), it reduces a nonsmooth chance-constrained problem to a sequence of problems with smooth data whose solutions approximate the true ones. The intermediate results (monotone convergence of φλ, the limsup estimate, convergence of feasible sets) are reusable for any analysis of envelope-based approximations of probability functions.
All statements are proved in the paper. None of them, and none of the general facts used (monotone and lower epi-convergence of Moreau envelopes in Hilbert space, Painlevé–Kuratowski and Mosco convergence), has a machine-checked proof on the platform at the time of writing. The mission produces a formal account of the conic scalarization, of the inner regularization, and of the consistency argument.
Difficulty
The obvious approach, "the regularized feasible sets converge, the regularized objectives converge, hence the minima converge", fails in two places. First, the decision space is infinite-dimensional, so bounded minimizing sequences only converge weakly, and the probability function must be controlled along weakly convergent sequences. This requires weak upper semicontinuity of φ and a limsup estimate for φλk(xk) along weakly convergent xk, which do not follow from continuity of Φ. Second, convergence of values needs a liminf inequality for eλkψ(xk) along weakly convergent sequences together with Mosco, not merely Painlevé–Kuratowski, convergence of the feasible sets. The probability function is not convex, so the usual convex-analytic route to Mosco convergence is unavailable.
Formalization scope
The Lean development uses H with [InnerProductSpace ℝ H] [CompleteSpace H] [SeparableSpace H], Y a real Banach space with dual StrongDual ℝ Y, and weak∗ notions through WeakDual ℝ Y. Extended-valued functions (ψ, eλψ, SΦh, ψ∗, v(P), v(Pλ)) are EReal-valued, and infima and suprema are taken there, so no default value enters. Probabilities are ℝ≥0∞-valued. The product H×Rm carries the ℓ² norm (WithLp 2), as the paper requires. Weak convergence is defined through inner products. The limit λ→0+ is the filter of right neighbourhoods of 0 for values and positive sequences for solutions and feasible sets.
The definitions file contains eλ, Γ0, coercivity, conjugate, subdifferential, Fréchet differentiability of an extended-valued function, weak convergence, sequential weak continuity, Painlevé–Kuratowski and Mosco convergence, the conic setting (9)–(10), SΦh, φ, φλ, M(p), Mλ(p), v(P), v(Pλ) and optimality for (P) and (Pλ).
Two hypotheses are added to the printed statements, each used by the paper's own proofs: K is closed (the bipolar step of Proposition 2.6), and h is sequentially weakly continuous in Theorem 3.1 d) and throughout Theorem 5.4. The second is automatic when H is finite-dimensional. Both are disclosed in the statements.
Trivializing readings are excluded: the feasible set meets domψ; ψ is proper; the envelope uses the Hilbert, not the sup, norm on the product; SΦh is an extended-real supremum over a nonempty set, not a real supremum with a default value; every λ is positive. Item b) of the goal is vacuous only when some regularized problem has no optimal solution, exactly as in the paper.
Contributions welcome: Moreau-envelope convergence in Hilbert space, the bipolar theorem for closed convex cones in Banach spaces, measure-theoretic continuity arguments for φλ, and the existence argument for optimal solutions of (P).
Selected references
W. van Ackooij, P. Pérez-Aros, C. Soto, E. Vilches, Inner Moreau envelope of nonsmooth conic chance constrained optimization problems, Mathematics of Operations Research, 2024; arXiv:2301.09803v1, 2023. https://arxiv.org/abs/2301.09803
On Optimality Conditions for Nonlinear Conic Programming: Under the Generalized Łojasiewicz Inequality, Feasible Limit Points of the Augmented Lagrangian Method Satisfy CAKKTResearch Paper
Motivation
Nonlinear conic programming covers nonlinear programming (NLP), nonlinear semidefinite programming (NLSDP) and nonlinear second-order cone programming (NSOCP) in one model: minimize a smooth objective subject to the requirement that a smooth map takes values in a closed convex cone. The classical first-order necessary condition, the Karush–Kuhn–Tucker (KKT) condition, holds at a local minimizer only under a constraint qualification such as Robinson's, and for conic constraints such qualifications are restrictive and hard to check.
Sequential optimality conditions avoid this. They require only that approximate KKT points exist along a sequence converging to the candidate, and they hold at every local minimizer with no constraint qualification. They are also what practical algorithms actually produce, since an algorithm only ever stops at an approximate point. For NLP, AGP was introduced by Martínez and Svaiter (2003) and CAKKT by Andreani, Martínez and Svaiter (2010); Andreani, Haeser and Martínez (2011) compare the sequential conditions. R. Andreani, W. Gómez, G. Haeser, L. M. Mito and A. Ramos (Mathematics of Operations Research, 2022) extend AGP and CAKKT to general conic programs, by means of projections onto the cone and its polar. They then show that a safeguarded augmented Lagrangian method generates sequences satisfying them. This mission formalizes that convergence theory (Section 4 of the paper).
Setting
Let f:Rn→R and G:Rn→E be continuously differentiable, where E is a finite-dimensional real inner product space. Let K⊆E be a nonempty closed convex cone, and consider
x∈Rnminf(x)subject toG(x)∈K.(NCP)
A point xˉ is feasible if G(xˉ)∈K. The polar cone is K∘={w:⟨w,k⟩≤0∀k∈K}. For a closed convex set C, ΠC(w) denotes the orthogonal projection of w onto C (its nearest point). DG(x)∗ is the adjoint of the derivative of G at x.
A feasible xˉ satisfies AGP (Approximate Gradient Projection) if there are sequences xk→xˉ and Λk∈K∘ with
∇f(xk)+DG(xk)∗Λk→0,⟨Λk,ΠK(G(xk))⟩→0.
It satisfies CAKKT (Complementary Approximate KKT) if moreover, on the same sequences, ⟨Λk,ΠK∘(G(xk))⟩→0.
The augmented Lagrangian is Lρ(x,Λ)=f(x)+2ρ[∥ΠK∘(G(x)+Λ/ρ)∥2−∥Λ/ρ∥2] for ρ>0. Algorithm 1 takes positive tolerances εk→0, a nonempty convex compact safeguarding set B⊂K∘, and constants τ>1, σ∈(0,1), ρ0>0. At step k it:
finds xk with ∥∇xLρk(xk,Λ^k)∥≤εk;
sets Λk=ρkΠK∘(G(xk)+Λ^k/ρk) and picks any Λ^k+1∈B;
forms Vk=Λ^k/ρk−ΠK∘(G(xk)+Λ^k/ρk);
keeps ρk+1=ρk if ∥Vk∥≤σ∥Vk−1∥ and otherwise picks any ρk+1≥τρk.
A point xˉ and a function Ψ satisfy the generalized Łojasiewicz inequality if, for some δ>0 and some ψ continuous on B(xˉ,δ) with ψ(x)→0 as x→xˉ,
∣Ψ(x)−Ψ(xˉ)∣≤ψ(x)∥DΨ(x)∥for all x∈B(xˉ,δ).(28)
Formalization targets
Goal: Theorem 4.2
If xˉ is a feasible limit point of a sequence {xk} generated by Algorithm 1, and xˉ satisfies (28) for Ψ(x)=21∥ΠK∘(G(x))∥2, then
xˉsatisfies CAKKT.
Milestones
Nonexpansiveness of ΠK, and formula (1): D(distK2)(w)=2(w−ΠK(w)) (p. 3).
Formula (20): ∇xLρ(x,Λ)=∇f(x)+DG(x)∗(ρΠK∘(G(x)+Λ/ρ)) (p. 8).
The Step 4 dichotomy: ρk→∞, or ρk is eventually constant and ∥Vk∥→0 (p. 9).
With bounded ρk: Λk−Λ^k→0 and {Λk} is bounded (proof of Theorem 4.1).
Theorem 4.1: every feasible limit point of Algorithm 1 satisfies AGP, with no further assumption (p. 9).
With unbounded ρk and (28): ρk∥ΠK∘(G(xk))∥2→0 along the subsequence converging to xˉ (proof of Theorem 4.2).
Significance
Theorem 4.1 shows that the augmented Lagrangian method, with no constraint qualification at all, produces AGP points. AGP was previously the condition behind inexact restoration methods, so this puts the two method families on a common footing. Theorem 4.2 adds the complementarity limit (18) under the generalized Łojasiewicz inequality. Every analytic function satisfies that inequality. For NLSDP the theorem refines the earlier guarantee that such methods generate TAKKT sequences. Combined with the paper's result that every local minimizer is a CAKKT point, it says the algorithm's limit points pass a necessary optimality test that is sharper than AGP. The theory allows cones with empty interior or without self-duality, such as the cone of Euclidean distance matrices.
The results are proved on paper. No machine-checked version is known. Formalizing them needs a working theory of projections onto closed convex cones in finite-dimensional inner product spaces: existence, nonexpansiveness, Moreau's decomposition, and the differentiability of the squared distance. It also needs derivative calculus for the augmented Lagrangian. These are reusable well beyond this paper, by any later formalization of conic optimization algorithms.
Difficulty
The algorithm is stated with free choices at every step, so nothing about it can be computed. Everything has to come from the inequalities that define a run. The main obstacle is the case of an unbounded penalty parameter in Theorem 4.2. In that case the multipliers Λk may diverge, and it is not clear why ⟨Λk,ΠK∘(G(xk))⟩ should vanish. Without (28) it need not: the paper points to a counterexample in which the method produces sequences that are not CAKKT. The bounded case needs instead the observation that the Step 4 test forces Vk→0 once the penalty stops growing. The calculus milestones depend on the differentiability of distK2, which is not in Mathlib in this form.
Formalization scope
Rn is EuclideanSpace ℝ (Fin n), and E is any finite-dimensional real inner product space.
f and G are ContDiff ℝ 1.
Cone, polar cone and nearest point come from the published definition MoreauProx.Decomposition.Cones. The polar uses the sign ≤0.
ΠC(w) is a nearest point chosen by choice, with a default of 0. The default is never reached for the nonempty closed convex sets K and K∘.
DG(x)∗ is the adjoint of fderiv ℝ G x, and ∇f is Mathlib's gradient.
Algorithm 1 is the run predicate IsALRun on the produced sequences (xk,Λ^k,ρk). Every free choice of the page stays free. The convention ∥V−1∥=∞ is encoded as ρ1=ρ0. The initial point x−1 plays no role and is omitted.
Step 1 is stated through the gradient of y↦Lρk(y,Λ^k), not through the right-hand side of (20). Formula (20) is a milestone to prove, not a definition.
A "limit point" is a cluster point (MapClusterPt). In (28), B(xˉ,δ) is the open ball and ∥DΨ(x)∥ is the operator norm of the derivative.
CAKKT is defined with all three limits on one and the same pair of sequences. Defining it as "AGP and (18)" with independent sequences would be a weaker condition and is ruled out.
Contributions are welcome on the convex-projection layer: existence and uniqueness of ΠC, nonexpansiveness, Moreau's decomposition (posed separately on the platform as MoreauProx.Decomposition.cone_decomposition), and the gradient of the squared distance. They are also welcome on the two case analyses of the convergence proofs.
Selected references
R. Andreani, W. Gómez, G. Haeser, L. M. Mito, A. Ramos, On Optimality Conditions for Nonlinear Conic Programming, Mathematics of Operations Research, 2022. https://doi.org/10.1287/moor.2021.1203 (formalized from the authors' manuscript revised 2021-04-20).
R. Andreani, G. Haeser, J. M. Martínez, On sequential optimality conditions for smooth constrained optimization, Optimization 60(5), 2011. https://doi.org/10.1080/02331930903578700
R. Andreani, J. M. Martínez, B. F. Svaiter, A new sequential optimality condition for constrained optimization and algorithmic consequences, SIAM Journal on Optimization 20(6), 2010. https://doi.org/10.1137/090777189
J. M. Martínez, B. F. Svaiter, A practical optimality condition without constraint qualifications for nonlinear programming, Journal of Optimization Theory and Applications 118, 2003. https://doi.org/10.1023/A:1024791525441
J. J. Moreau, Proximité et dualité dans un espace hilbertien, Bulletin de la Société Mathématique de France 93, 1965. https://doi.org/10.24033/bsmf.1625
Bounding the energy-constrained quantum and private capacities of phase-insensitive bosonic Gaussian channelsResearch Paper
Motivation
We establish several upper bounds on the energy-constrained quantum and private capacities of all single-mode phase-insensitive bosonic Gaussian channels. The first upper bound, which we call the "data-processing bound," is the simplest and is obtained by decomposing a phase-insensitive channel as a pure-loss channel followed by a quantum-limited amplifier channel. We prove that the data-processing bound can be at most 1.45 bits larger than a known lower bound on these capacities of the phase-insensitive Gaussian channel. We discuss another data-processing upper bound as well. Two other upper bounds, which we call the "ε-degradable bound" and the "ε-close-degradable bound," are established using the notion of approximate degradability along with energy constraints. We find a strong limitation on any potential superadditivity of the coherent information of any phase-insensitive Gaussian channel in the low-noise regime, as the data-processing bound is very near to a known lower bound in such cases. We also find improved achievable rates of private communication through bosonic thermal channels, by employing coding schemes that make use of displaced thermal states. We end by proving that an optimal Gaussian input state for the energy-constrained, generalized channel divergence of two particular Gaussian channels is the two-mode squeezed vacuum state that saturates the energy constraint. What remains open for several interesting channel divergences, such as the diamond norm or the Renyi channel divergence, is to determine whether, among all input states, a Gaussian state is optimal.
This mission is the statement-level formalization of Bounding the energy-constrained quantum and private capacities of phase-insensitive bosonic Gaussian channels (arXiv:1708.07257v3). Every numbered result of the paper was scanned. The results stated here are open sorry goals, ready for solvers to prove.
What is formalized
5 statements of the paper are in Lean 4 (Mathlib 0df444a). The goal theorem is Theorem 26: thermal gap bound (Theorem 26, PDF p. 34). The milestones are the other numbered results, in the paper's order, each quoting the paper.
The paper's own objects are the definition item of this mission. Objects shared across papers come from the prove2quantum library and from earlier papers' missions, listed as references.
Provenance: prove2quantum's pipeline drafted each statement (gpt-6.1-sol on Stanford's Sherlock cluster). A blind read-back, written without seeing the paper, is attached to every item. An independent moderator compared each statement against the paper and passed the whole paper without edits.
Deferred results
51 results of the paper are not stated yet, because the library lacks an interface they need:
Remark 3: Approximate-degradability implication for state-supremum half-diamond errors on arbitrary separable channel systems, with a certified conversion of the cited full-diamond constants. (hard)
Lemma 1: Bit-valued conditional entropy for finite first-system entropy, spectral Gibbs entropy envelope, and the cited energy-constrained half-trace-distance continuity result on separable systems. (hard)
Theorem 8: As printed the reference R has no entropy restriction. A product of an infinite-entropy state on R and a vacuum input makes BOTH joint entropies infinite, so their displayed difference is undefined. The proof suggests a telescoping conditional-entropy extension, but the source never defines that extension; adding finite H(R) or changing the conclusion silently would change the theorem. (source-ambiguity)
Lemma 2: Common admissible parameter sets, finite real optimization suprema and existing regularized limits for both channels, with the uniform all-positive-n absolute difference bound. (hard)
Remark 9: Independently defined constrained and unconstrained operational quantum/private capacities with all-large-positive-blocklength achievability. (hard)
Theorem 11: Uniform-energy quantum codes and their capacity, state-supremum half-diamond distance, fixed complement, and output Gibbs entropy envelope. (hard)
Theorem 12: Uniform-energy operational Q and optimized coherent information for the actually degradable comparison channel, with all-blocklength receiver-energy bounds. (hard)
Theorem 13: Finite-dimensional operational private capacity from normalized POVM private codes and a common environment state, plus an attained entropy maximum and fixed complement. (hard)
Theorem 14: Operational private capacity with messagewise energy/security and Gibbs entropy envelope on the identified complementary output. (hard)
Theorem 15: Operational private capacity and optimized coherent information for the comparison channel, retaining average ensemble energy. (hard)
Remark 17: Unconstrained thermal Q and the supremum/limit of the clipped finite-energy expression, with infinity at eta=1. (hard)
Theorem 16: Full Fock thermal CPTP receiver and uniform-energy operational quantum capacity. (hard)
Remark 18: Operational thermal quantum capacity positivity and its necessary parameter restriction, including zero energy. (hard)
Theorem 19: Actual two-mode purified thermal complement and opposite-phase splitter degrading map (5.20), with arbitrary-reference diamond distance. (hard)
Theorem 20: The derivation applies Theorem 11 to TWO environment output modes with total photon budget Wprime=(1-eta)NS+(1+eta)NB, but substitutes the ONE-mode entropy g(Wprime/delta). For the natural sum-number Gibbs observable the maximum entropy is 2g(Wprime/(2delta)), generally larger. The source supplies no alternative Gibbs observable justifying (5.42). Neither silently increasing the correction nor assuming a missing entropy bound states the printed result faithfully. (source-ambiguity)
Proposition 21: Actual thermal receiver/degrader, saturating thermal state, and attained optimization over every normalized finite-energy input. (hard)
Remark 22: The stated conditions omit Gaussian extremality. Phase-averaging need not preserve Gaussianity. Concavity and local-unitary invariance alone do not single out a thermal maximizer among all states, so no faithful general optimizer theorem follows from the supplied bullet list. (source-ambiguity)
Remark 24: High-energy TMS output-fidelity limit for full Fock thermal channels at common 0<=eta<1, and its derived half-diamond lower bound. (hard)
Theorem 23: Thermal/pure-loss full Fock CPTP receivers at both transmissivity endpoints and arbitrary-reference normalized-state diamond supremum. (hard)
Theorem 25: Operational thermal Q with uniform encoder energy and source close-degradable entropy correction. (hard)
Unnumbered asserted gap limit: The fixed-channel equality is false: at NB=0 the thermal channel is pure loss and the two scalar expressions agree for every NS, so Delta is identically zero. The source applies a large-argument entropy expansion to a symplectic occupation that stays bounded. The valid inequality of Theorem 26 is kept at the seed; no false saturation limit is assumed. (source-ambiguity)
Remark 28: Unconstrained thermal P and the clipped finite-energy supremum/limit, including the infinite eta=1 endpoint. (hard)
Theorem 27: Full Fock thermal receiver and messagewise-energy operational private capacity. (hard)
Theorem 29: Theorem 29 inherits the unresolved two-environment-mode Gibbs entropy substitution of Theorem 20: it uses g(Wprime/delta) where the cited general theorem with the sum-number observable gives 2g(Wprime/(2delta)). The intended smaller correction is not justified or specified by the source; retain this theorem as deferred rather than quietly enlarging its bound. (source-ambiguity)
Unnumbered displaced-thermal private rate: Displaced-thermal Borel ensemble, trace-norm barycenter, private information with average ensemble energy, and achievable private rates; Dirac displacement at s=NS. (hard)
Theorem 30: Operational thermal P with messagewise energy/security and source close-degradable entropy correction. (hard)
Theorem 31: Full Weyl-action adapter identifying a centered phase-insensitive CPTP channel and constructed amplifier-then-loss maps, including G=1. (hard)
Theorem 32: Noisy-amplifier Fock CPTP receiver and both operational energy-constrained capacities. (hard)
Remark 33: Both unconstrained amplifier capacities, scalar high-energy supremum/limit, and complete PLOB-bound comparison. (hard)
Remark 34: Operational amplifier Q positivity implication using (G-1)NB<1, without division by NB. (hard)
Theorem 36: Fixed purified amplifier complement and environment-port degrading squeezer (9.24), with arbitrary-reference half-diamond distance. (hard)
Theorem 37: Printed expression is false at the allowed edge NB=NS=0 and G>1: epsilon=0, zeta occupations are G-1 and 0, so as epsilonPrime decreases to zero its RHS tends to -g(G-1)<0 although capacity is zero. The first output entropy omits spontaneous photons G-1; the complementary photon budget also omits them. In addition the two-mode continuity correction has the unresolved issue of Theorem 20. No single silent transcription fix recovers the claimed formula. (source-ambiguity)
Theorem 38: Printed expression is false at the allowed edge NB=NS=0 and G>1: epsilon=0, zeta occupations are G-1 and 0, so as epsilonPrime decreases to zero its RHS tends to -g(G-1)<0 although capacity is zero. The first output entropy omits spontaneous photons G-1; the complementary photon budget also omits them. In addition the two-mode continuity correction has the unresolved issue of Theorem 20. No single silent transcription fix recovers the claimed formula. (source-ambiguity)
Theorem 40: Operational amplifier Q and corrected common receiver photon budget G NS+(G-1)(NB+1); delta denominator 1+epsilonPrime. (hard)
Theorem 41: Operational amplifier P and corrected common receiver photon budget G NS+(G-1)(NB+1); delta denominator 1+epsilonPrime. (hard)
Remark 43: Additive-noise CPTP channel, both unconstrained operational capacities, and high-energy supremum/limit. (hard)
Remark 45: Operational additive-noise quantum/private capacities and the cited converse (nbar-1)/ln2+log2(1/nbar), including its strict comparison on 0<nbar<1. (hard)
Theorem 42: Additive-noise CPTP channel and both energy-constrained capacities, with the finite-energy bound. (hard)
Theorem 46: Thermal operational Q/P and physical amplifier-then-loss bottleneck with increased encoder energy G NS+G-1 and clipping. (hard)
Remark 47: Thermal operational Q/P positivity implication, including zero capacities in entanglement-breaking cases. (hard)
Remark 49: The statement uses unquantified low-noise/low-energy regimes and supplies no analytic boundary. Plots and qualitative comparisons cannot be registered as a universal parameter inequality without inventing a threshold. (source-ambiguity)
Remark 50: Additive-noise unconstrained Q/P and the clipped high-energy supremum of Theorem 48 for all 0<nbar<1. (hard)
Remark 51: The high-noise regime is not quantified and the printed U4 expression is unclipped, whereas an operational bound must be clipped at zero. Choosing an exact threshold or either version without qualification would assert more than the source specifies. (source-ambiguity)
Theorem 48: Additive-noise CPTP channel and both operational energy-constrained capacities with max(0,U4). (hard)
Lemma 4: Dimension-compatible generalized divergence on actual trace-class systems with data processing and cq direct sums, and the finite/discrete ensemble group-averaging inequality. (hard)
Lemma 5: The text extends the finite-group result “by approximation” while requiring only that D is Borel. Borel measurability permits integration but does not give the semicontinuity/continuous-ensemble direct-sum law needed to pass this inequality to a continuous barycenter. The source neither supplies that law nor specifies a divergence class for which the limiting argument is valid; do not silently replace Borel by lower semicontinuous or assume the desired inequality. (source-ambiguity)
Proposition 54: The full statement uses the unresolved continuous-ensemble step of Lemma 5 with only Borel regularity. Additionally the Gaussian-attainment argument on p.56 invokes that only thermal Gaussian states are number-diagonal, but phase averaging a Gaussian state need not stay Gaussian (e.g. coherent-state dephasing is Poisson). No general Gaussian-extremality property of an arbitrary D is supplied. Retain BOTH conclusions as the deferred target; do not replace it by only the diagonal-state reduction or assert an unproved Gaussian optimizer. (source-ambiguity)
Unnumbered Gaussian diamond and C-distance optimizers: Explicit main corollaries of the deferred Gaussian-attainment clause of Proposition 54; the source has not supplied the missing Gaussian-extremality/continuous-ensemble argument. Keep both target equalities and do not promote them to unrestricted diamond or C-distance optimizer statements. (source-ambiguity)
Unnumbered joint displacement-covariance reduction: Same unresolved Borel-versus-continuous-ensemble issue as Lemma 5. The displaced input is purified afresh, and exact energy is a consequence; it cannot be assumed on the original <=NS optimization domain. (source-ambiguity)
Unnumbered joint phase-covariance reduction: This explicitly claimed generalization uses the unresolved continuous-group approximation of Lemma 5. Record the <=NS constraint accurately; without a specified divergence regularity/continuous-ensemble law, the stated generality is not pinned down. (source-ambiguity)
Selected references
Bounding the energy-constrained quantum and private capacities of phase-insensitive bosonic Gaussian channels, arXiv:1708.07257v3, https://arxiv.org/abs/1708.07257v3
Quantum privacy and quantum coherenceResearch Paper
Motivation
We derive a simple relation between a quantum channel's capacity to convey coherent (quantum) information and its usefulness for quantum cryptography.
This mission is the statement-level formalization of Quantum privacy and quantum coherence (arXiv:quant-ph/9709058v2). Every numbered result of the paper was scanned. The results stated here are open sorry goals, ready for solvers to prove.
What is formalized
3 statements of the paper are in Lean 4 (Mathlib 0df444a). The goal theorem is Fixed-strategy guaranteed privacy is bounded below by Bob information minus environment Holevo information (Equation (8): fixed-strategy guaranteed privacy lower bound, PDF p. 4). The milestones are the other numbered results, in the paper's order, each quoting the paper.
The paper's own objects are the definition item of this mission. Objects shared across papers come from the prove2quantum library and from earlier papers' missions, listed as references.
Provenance: prove2quantum's pipeline drafted each statement (gpt-6.1-sol on Stanford's Sherlock cluster). A blind read-back, written without seeing the paper, is attached to every item. An independent moderator compared each statement against the paper and passed the whole paper without edits.
Deferred results
3 results of the paper are not stated yet, because the library lacks an interface they need:
Main result, equation (12): optimal guaranteed privacy bounds coherent information: An independently specified operational per-use optimal guaranteed privacy over block strategies (source-ambiguity)
Equation (9): optimized privacy lower bound by the Holevo difference: An independently specified operational per-use optimal guaranteed privacy over block strategies (source-ambiguity)
Unnumbered consequence: positive coherent information permits secure private transmission: An independently specified operational per-use optimal guaranteed privacy over block strategies; also a quantitative meaning of securely (source-ambiguity)
Strong converse for the classical capacity of optical quantum communication channelsResearch Paper
Motivation
We establish the classical capacity of optical quantum channels as a sharp transition between two regimes---one which is an error-free regime for communication rates below the capacity, and the other in which the probability of correctly decoding a classical message converges exponentially fast to zero if the communication rate exceeds the classical capacity. This result is obtained by proving a strong converse theorem for the classical capacity of all phase-insensitive bosonic Gaussian channels, a well-established model of optical quantum communication channels, such as lossy optical fibers, amplifier and free-space communication. The theorem holds under a particular photon-number occupation constraint, which we describe in detail in the paper. Our result bolsters the understanding of the classical capacity of these channels and opens the path to applications, such as proving the security of noisy quantum storage models of cryptography with optical links.
This mission is the statement-level formalization of Strong converse for the classical capacity of optical quantum communication channels (arXiv:1401.4161v3). Every numbered result of the paper was scanned. The results stated here are open sorry goals, ready for solvers to prove.
What is formalized
5 statements of the paper are in Lean 4 (Mathlib 0df444a). The goal theorem is Operational strong converse above the optical classical-capacity threshold (Introduction and Corollary 1, PDF p. 2). The milestones are the other numbered results, in the paper's order, each quoting the paper.
The paper's own objects are the definition item of this mission. Objects shared across papers come from the prove2quantum library and from earlier papers' missions, listed as references.
Provenance: prove2quantum's pipeline drafted each statement (gpt-6.1-sol on Stanford's Sherlock cluster). A blind read-back, written without seeing the paper, is attached to every item. An independent moderator compared each statement against the paper and passed the whole paper without edits.
Deferred results
1 results of the paper are not stated yet, because the library lacks an interface they need:
Abstract: exponential decay: A valid unconditional exponential success-decay conclusion under only a vanishing occupation tail (source-ambiguity)
Selected references
Strong converse for the classical capacity of optical quantum communication channels, arXiv:1401.4161v3, https://arxiv.org/abs/1401.4161v3
Majorization theory approach to the Gaussian channel minimum entropy conjectureResearch Paper
Motivation
A longstanding open problem in quantum information theory is to find the classical capacity of an optical communication link, modeled as a Gaussian bosonic channel. It has been conjectured that this capacity is achieved by a random coding of coherent states using an isotropic Gaussian distribution in phase space. We show that proving a Gaussian minimum entropy conjecture for a quantum-limited amplifier is actually sufficient to confirm this capacity conjecture, and we provide a strong argument towards this proof by exploiting a connection between quantum entanglement and majorization theory.
This mission is the statement-level formalization of Majorization theory approach to the Gaussian channel minimum entropy conjecture (arXiv:1111.1986v1). Every numbered result of the paper was scanned. The results stated here are open sorry goals, ready for solvers to prove.
What is formalized
14 statements of the paper are in Lean 4 (Mathlib 0df444a). The goal theorem is Single-use reduction: C1 iff C2 iff C3; C4 is sufficient (C1–C4; Appendix 1, PDF p. 2). The milestones are the other numbered results, in the paper's order, each quoting the paper.
The paper's own objects are the definition item of this mission. Objects shared across papers come from the prove2quantum library and from earlier papers' missions, listed as references.
Provenance: prove2quantum's pipeline drafted each statement (gpt-6.1-sol on Stanford's Sherlock cluster). A blind read-back, written without seeing the paper, is attached to every item. An independent moderator compared each statement against the paper and passed the whole paper without edits.
Deferred results
2 results of the paper are not stated yet, because the library lacks an interface they need:
Infinitesimal two-mode squeezer, (6),(8)–(9): A quantified exact infinitesimal majorization statement with a controlled approximation remainder (source-ambiguity)
(16)–(17), Appendix 4d, A.34–A.50: A consistent explicit positive row-subunital, column-stochastic beta-function kernel for general k (source-ambiguity)
Selected references
Majorization theory approach to the Gaussian channel minimum entropy conjecture, arXiv:1111.1986v1, https://arxiv.org/abs/1111.1986v1
A solution of the Gaussian optimizer conjectureResearch Paper
Motivation
The long-standing conjectures of the optimality of Gaussian inputs for Gaussian channel and Gaussian additivity are solved for a broad class of covariant or contravariant Bosonic Gaussian channels (which includes in particular thermal, additive classical noise, and amplifier channels) restricting to the class of states with finite second moments. We show that the vacuum is the input state which minimizes the entropy at the output of such channels. This allows us to show also that the classical capacity of these channels (under the input energy constraint) is additive and is achieved by Gaussian encodings.
This mission is the statement-level formalization of A solution of the Gaussian optimizer conjecture (arXiv:1312.2251v2). Every numbered result of the paper was scanned. The results stated here are open sorry goals, ready for solvers to prove.
What is formalized
16 statements of the paper are in Lean 4 (Mathlib 0df444a). The goal theorem is Main result: vacuum optimizer and unconditional Gaussian minimum-output additivity (Main result: vacuum optimizer and unconditional Gaussian minimum-output additivity, PDF p. 1). The milestones are the other numbered results, in the paper's order, each quoting the paper.
The paper's own objects are the definition item of this mission. Objects shared across papers come from the prove2quantum library and from earlier papers' missions, listed as references.
Provenance: prove2quantum's pipeline drafted each statement (gpt-6.1-sol on Stanford's Sherlock cluster). A blind read-back, written without seeing the paper, is attached to every item. An independent moderator compared each statement against the paper and passed the whole paper without edits.
Deferred results
6 results of the paper are not stated yet, because the library lacks an interface they need:
§3: additivity consequences for contravariant channels: General positive quadratic bosonic Hamiltonian and S2-restricted constrained chi capacity with additive block energy, retaining (23) as well as (20)-(21) (hard)
§4: additive energy-constrained capacity, Gaussian encoding and finite-dimensional formula: Independent energy-constrained classical block-code capacity on the common coefficient State model, its regularized-chi bridge, and actual Gaussian coherent encoding attainment (hard)
§7: thermal-noise entropy minimum and capacity: Independent energy-constrained classical block-code capacity on the common coefficient State model, its regularized-chi bridge, and actual Gaussian coherent encoding attainment (hard)
§7: additive classical-noise entropy minimum and capacity: Independent energy-constrained classical block-code capacity on the common coefficient State model, its regularized-chi bridge, and actual Gaussian coherent encoding attainment (hard)
§7: noisy-amplifier entropy minimum and capacity: Independent energy-constrained classical block-code capacity on the common coefficient State model, its regularized-chi bridge, and actual Gaussian coherent encoding attainment (hard)
§7: claimed extension to all one-mode BGCs via squeezing: Correct domain or infimum/attainment correction for the universal one-mode squeezed-vacuum optimizer claim, including B1 rank-one additive noise (source-ambiguity)
Ultimate communication capacity of quantum optical channels by solving the Gaussian minimum-entropy conjectureResearch Paper
Motivation
Optical channels, such as fibers or free-space links, are ubiquitous in today's telecommunication networks. They rely on the electromagnetic field associated with photons to carry information from one point to another in space. As a result, a complete physical model of these channels must necessarily take quantum effects into account in order to determine their ultimate performances. Specifically, Gaussian photonic (or bosonic) quantum channels have been extensively studied over the past decades given their importance for practical purposes. In spite of this, a longstanding conjecture on the optimality of Gaussian encodings has yet prevented finding their communication capacity. Here, this conjecture is solved by proving that the vacuum state achieves the minimum output entropy of a generic Gaussian bosonic channel. This establishes the ultimate achievable bit rate under an energy constraint, as well as the long awaited proof that the single-letter classical capacity of these channels is additive. Beyond capacities, it also has broad consequences in quantum information sciences.
This mission is the statement-level formalization of Ultimate communication capacity of quantum optical channels by solving the Gaussian minimum-entropy conjecture (arXiv:1312.6225v1). Every numbered result of the paper was scanned. The results stated here are open sorry goals, ready for solvers to prove.
What is formalized
15 statements of the paper are in Lean 4 (Mathlib 0df444a). The goal theorem is Finite-energy Gaussian minimum output entropy (Eq. (2), PDF p. 2). The milestones are the other numbered results, in the paper's order, each quoting the paper.
The paper's own objects are the definition item of this mission. Objects shared across papers come from the prove2quantum library and from earlier papers' missions, listed as references.
Provenance: prove2quantum's pipeline drafted each statement (gpt-6.1-sol on Stanford's Sherlock cluster). A blind read-back, written without seeing the paper, is attached to every item. An independent moderator compared each statement against the paper and passed the whole paper without edits.
Selected references
Ultimate communication capacity of quantum optical channels by solving the Gaussian minimum-entropy conjecture, arXiv:1312.6225v1, https://arxiv.org/abs/1312.6225v1
Experimenting in Equilibrium: Local Experimentation Consistently Estimates the Equilibrium Utility Gradient in the Mean-Field LimitResearch Paper
Motivation
Online marketplaces (ride-sharing, delivery, freelance labour) set payments for their suppliers and want to know how a change in payment would change the platform's utility. The standard tool, a randomized A/B test, is biased in a marketplace: treated and control suppliers compete for the same demand, so a payment increase given to the treatment group draws business away from the control group. This interference violates the no-interference assumption of classical causal inference (Hudgens and Halloran, 2008), and it was documented on a large platform by Blake and Coey (2014). Global experimentation, changing the payment for everyone and comparing days, avoids interference but is slow and costly.
Wager and Xu (2021) propose local experimentation: give every supplier a small, symmetric, random payment perturbation, measure how participation responds to one's own perturbation, and correct for the equilibrium feedback using a model of how demand is matched to suppliers. The perturbations are symmetric, so they do not move the market equilibrium at first order. The paper shows that in a large market this recovers the gradient of the platform's equilibrium utility. This mission formalizes that result, Theorem 6 of the paper, together with the lemmas on which its proof rests.
Setting
Everything is conditional on a global state A=a (weather, holidays), which is dropped from the notation. In the n-th system there are n potential suppliers and a random demand D∼F(n) on [0,∞) with E[D/n]=d>0, E[(D/n−d)2]→0 and P(D/n∈/[d/2,2d])=o(1/n).
Matching. If t suppliers are active and demand is d, each active supplier serves on average Ω(d,t) units. Ω is non-decreasing in d, non-increasing in t, and Ω(d,t)=ω(d/t)+l(d,t), where the error l≥0 is bounded and o(1/t+1/d), and ω is a regular allocation function: ω:R+→[0,1] is smooth, concave, non-decreasing, ω(0+)=0, limx→∞ω(x)≤1, ω′(0+)≤1.
Choice. Supplier i has a private feature Bi∼β and is paid Pi per unit served. Given its expected revenue x, it becomes active (Zi=1) with probability fBi(x), where each choice functionfb is [0,1]-valued, non-decreasing and twice differentiable with uniformly bounded second derivative.
Equilibrium. With X∼Binomial(n,μ) independent of D, let q(n)(μ)=E[Ω(D,X)]. Under a payment law π, the equilibrium supply fraction μ(n)(π) solves the balance equation
μ=E[fB(Pq(n)(μ))],B∼β,P∼π.
At a fixed payment p, μ(n)(p)=μ(n)(δp). The mean-field supply μ(p) solves μ=E[fB(pω(d/μ))], and the mean-field platform utility is
u(p)=(r(d/μ(p))−pω(d/μ(p)))μ(p),
with r the limiting revenue per unit of supply. The marginal response is Δ(p)=ω(d/μ(p))E[fB′(pω(d/μ(p)))], and Δ(n)(p) is its pre-limit analogue.
The experiment. Payments are Pi=p+ζnεi with independent signs εi=±1. From Dˉ=D/n, Zˉ=n1∑iZi and the regression slope
For p>0 with E[fB(pωˉ)]>0 (ωˉ=supω), ζ>0 and perturbation sizes ζn=ζn−α with 0<α<1/2,
n→∞limP[Γ^−u′(p)>ε]=0for every ε>0.
Milestones, in the order of the proof
Lemma 1: the balance equation has a unique solution in [0,1], and the active supply is Binomial(n,μ(n)(π)).
Proposition 10: dμdq(n)(μ)≤0, and dμdq(n)(μ)→−ω′(d/μ)d/μ2.
Lemma 2 (3.13)–(3.14): μ(n)(p)→μ(p) and q(n)(μ)→ω(d/μ).
Lemma 4: the implicit derivative of μ(n)(p) in terms of Δ(n)(p), and its mean-field limit μ′(p)=Δ(p)/(1+pdΔ(p)ω′(d/μ)/(μ2ω(d/μ))).
Proposition 11: the perturbed equilibrium μ(n)(p,ζ) is flat at ζ=0 with second derivatives bounded uniformly in n.
Proposition 12 (second equality): the closed form of u′(p).
(A.9): ∣ζ−1Covn[Zi,εi]−Δ(n)(p)∣≤ζC, uniformly in n.
(A.7), corrected: Dˉ→d, Zˉ→μ(p), Δ^→Δ(p) in L2, and Υ^→μ′(p) in probability.
Significance
A platform can thus learn the payment sensitivity of its equilibrium utility from one period of data, with perturbations that vanish as the market grows. The gradient estimate is the input to the first-order payment-optimization scheme of §4.2 of the paper, and the decomposition of Lemma 4 separates the measurable marginal response Δ from an interference correction that depends only on the matching function ω.
None of these results has been machine-checked. A complete formalization gives a verified mean-field limit for a fixed-point equilibrium with binomial supply, a binomial Stein-type identity (Proposition 10), and a consistency proof for a regression estimator under vanishing perturbations. The mission also records two corrections. The L2 claim for Υ^ in (A.7) is too strong as printed. Lemma 15 (Appendix B.3), used in Proposition 10's proof, omits a factor; Proposition 10 itself is not affected.
Difficulty
The obvious argument says that Δ^ is a regression slope, so it converges by the law of large numbers. It does not apply directly, for two reasons. First, the Zi are not sampled at the unperturbed equilibrium: the perturbation itself moves the equilibrium, and the experiment runs at μ(n)(p,ζn). Showing that this shift is O(ζn2) uniformly in n (Proposition 11) needs the implicit-function structure of the balance equation and the symmetry of the perturbation. Second, the noise in Δ^ has standard deviation of order 1/(ζnn), while its bias is of order ζn. The rate restriction α<1/2 balances the two. Finally, the limit of dμdq(n) is a derivative of an expectation over a binomial law in which the error term l is multiplied by n; controlling it needs a Stein-type identity, not term-by-term convergence.
Formalization scope
All objects live in the namespace EquilibriumExperiment.Gradient. A Market B holds the primitives for one global state; Market.Standing bundles Definition 5, Assumptions 1–2, the part of Assumption 3 that concerns r, and the demand conditions (3.1)–(3.2). Conventions:
One state. The statements are conditional on A=a. The state space is finite with a law independent of n, so the paper's unconditional probability is a finite mixture of conditional ones.
Domains. Functions on R+ are functions on R whose hypotheses are stated on [0,∞); ω and r are smooth on (0,∞). With Lean's d/0=0, the decomposition at t=0 reads Ω(d,0)=l(d,0).
Added hypotheses, disclosed.d>0; measurability of Ω(⋅,t), (b,x)↦fb(x) and fb′(x); the joint reading of o(1/t+1/d) (for every ε there is K such that the bound holds when d,t≥K); and the positivity condition E[fB(pωˉ)]>0, which holds exactly when μ(p) exists.
Equilibria.q(n) is the finite binomial sum. μ(n) and μ(p) are defined as the solutions of their balance equations; Lemmas 1 and 2 prove that the solutions exist and are unique. Supplier decisions are realized as Zi=1{Ui≤fBi(Piq(n)(μ(n)(π)))} with independent uniforms Ui.
Limits. Each n has its own sample space, so convergence in probability is a limit of the probabilities of deviation events. L2 convergence is eLpNorm … 2 → 0.
Ranges. "n∈N" is read as n≥1, and binomial parameters lie in [0,1]. Proposition 10's limit is stated for μ<1, and Proposition 11 for ζ∈(−p,p).
Ruled out: Zi independent of the perturbation, μ(n) an arbitrary random variable rather than the solution of (A.2), hypotheses on all of R, or u′(p) as a deriv of a non-differentiable function (Proposition 12 proves differentiability).
Not in this mission. Theorem 7 (the O(1/T) regret of the first-order method) is false as printed: with σ=1/2, η=101/50, M=101/100, I=[1,3], utilities −(p−3)2/4 and −(p−1)2/4 in two periods and p1=1, the left side of (4.6) at T=2, p=5/3 equals 7/6>ηM2/2; step (A.10) drops a factor 2. Corollary 8, which rests on it, Theorem 9, Lemma 3 and (3.15), which concern the pre-limit utility, are also excluded. Lemma 15 is false as printed and is not an item.
Contributions are welcome at every milestone; the binomial Stein identity, the implicit-function argument for monotone fixed points and the triangular-array law of large numbers for the slope are reusable.
M. G. Hudgens and M. E. Halloran, Toward causal inference with interference, Journal of the American Statistical Association 103(482), 2008. https://doi.org/10.1198/016214508000000292
T. Blake and D. Coey, Why marketplace experimentation is harder than it seems: the role of test-control interference, ACM EC 2014. https://doi.org/10.1145/2600057.2602837
Optimal Priority-Based Allocation Mechanisms: In a Regular Market, Deferred Acceptance Implements Every Feasible Budget Set Probability Matrix, and DA-STB Exactly the Nested-Within-Segment OnesResearch Paper
Motivation
School districts, public housing authorities and refugee resettlement agencies allocate scarce items (school seats, apartments, slots) without prices. Most such systems are priority-based: each applicant receives a priority, possibly depending on observable characteristics such as neighborhood or sibling status, and a mechanism such as deferred acceptance (DA), serial dictatorship or top trading cycles turns priorities and reported preferences into an assignment. The planner's design question is which priorities and quotas to choose. Shi (SSRN 3425348; Management Science 2022, doi:10.1287/mnsc.2020.3925) reduces this question, in a large-market model, to a linear program over budget set probabilities: the probability that an applicant of each segment can choose from each menu of items. That reduction is only useful if the optimal menus can actually be produced by a familiar mechanism. Theorem 1 a) of the paper says that, under a mild regularity condition, DA can produce any feasible menu distribution, and DA with a single tie-breaker (DA-STB) can produce exactly the nested ones.
The continuum approach to DA follows Azevedo and Leshno (JPE 2016), who describe stable matchings in large markets by cutoff vectors, and Abdulkadiroğlu, Che and Yasuda (AEJ: Micro 2015) on expanding choice in school choice.
Setting
There are n items j∈[n] and an outside option 0, with J=[n]∪{0}. A marketM=(m,n,λ,c,F) has m segments of agents with masses λt>0, capacities cj for the real items (the outside option is unlimited), and for each segment t a probability distribution Ft of utility vectors u∈RJ with pairwise distinct components (strict preferences). The choice probability is
Pt(j,S)=1(j∈S)Pu∼Ft(uj=j′∈Smaxuj′).
A budget set probability matrixy=(ytS)t∈[m],S⊆J lists the probability that a segment-t agent faces menu S. The feasible set YM consists of those y with ytS≥0, ∑SytS=1, ytS=0 when 0∈/S, and the capacity constraint ∑t,SλtPt(j,S)ytS≤cj for every j∈[n].
In DA, each agent of segment t draws a priority vector π∈Π=[0,B]n from a law Gt, independently of his utilities. Given a cutoff vectorz, his budget set is Bπ={j∈J:j=0 or πj≥zj} and he receives his favourite item in it. The demand is Dj(z)=∑tλtP(j is the favourite in Bπ). For quotas q≤c, the DA operator raises each zj just enough to bring Dj down to qj, and the DA cutoffzDA(M,G,q) is its least fixed point in [0,B]n. A mechanism implementsy if Pπ∼Gt(Bπ=S)=ytS for all t and S. In DA-STB, πij=btj+δi for a deterministic boost matrix b and one tie-breaker δi∼Uniform(0,1) per agent.
The market is regular if {0}⊆S⊊S′ implies Pt(0,S)>Pt(0,S′) for all t: adding items to a menu strictly lowers the chance that the outside option is chosen. A matrix y is nested within segment if any two menus used with positive probability by the same segment are ordered by inclusion.
Formalization targets
Goal: Theorem 1 a), p. 13
If M is regular, then
∀y∈YM,y is DA-implementable,∀y∈YM,(y is DA-STB-implementable⟺y is nested within segment).
Milestones
The milestones are the steps of the paper's own proof, in attack order:
the demand Dj is decreasing in zj and increasing in zk, k=j (App. A.2, p. 34);
the DA operator is a monotone self-map of [0,B]n, so the DA cutoff exists (App. A.2, p. 34);
under the priorities πij=1(j∈Si)+δi of (H.1) and quotas equal to the left-hand side of the capacity constraint, Dj(1)=qj and 1 is a fixed point, eq. (H.2);
at cutoff 1 these priorities yield menu S with probability ytS, eq. (H.3);
the DA cutoff respects the quotas;
in a regular market, a cutoff z′≤1 that changes the menu probabilities leaves strictly less mass on the outside option, eq. (H.4);
Proposition H.1: DA with (H.1) implements y (p. 47);
Proposition H.2 a): DA-STB menus are always nested within segment (p. 48);
Proposition H.3: DA-STB with boosts btj=∑S∋jytS implements every nested-within-segment y (p. 48).
Significance
Theorem 1 a) is what makes the paper's optimization approach operational. Once a planner solves the linear program over YM, part i) guarantees a DA mechanism with explicit priorities and quotas that realizes the solution, so for regular markets nothing is lost by restricting attention to DA. Part ii) characterizes the DA-STB-implementable matrices, which is what lets the paper compare single tie-breaking with DA and identify when the simpler mechanism suffices. The remaining results of the paper (optimal assortments under multinomial and nested logit, the Boston school choice application) are built on this reduction.
The theorem is proved in the paper; nothing here is open. To the best of the drafting search, none of it is formalized: Prove2Me has finite two-sided matching and Gale–Shapley items, but no continuum matching market, no DA cutoff, and no budget set implementation result. Formalizing it provides a machine-checked large-market DA model (demand, cutoff operator, least fixed point) that other market design papers using the Azevedo–Leshno framework can reuse.
Difficulty
The obvious argument shows that the all-ones cutoff vector reproduces y and is a fixed point of the DA operator. That does not finish the proof: the DA mechanism uses the least fixed point, and in general there are smaller ones. Example H.1 of the paper (p. 50) gives a non-regular market with a feasible, nested matrix y that no DA mechanism implements under any priorities or quotas, so regularity cannot simply be dropped. The work is in showing that, under regularity, no fixed point strictly below 1 can change the menu probabilities. This mixes order theory (Knaster–Tarski on a box), measure theory (product measures of utilities and priorities, continuity of the demand under an atomless tie-breaker) and a strict comparison of outside-option masses.
Formalization scope
Items are Option (Fin n), with none the outside option; priorities and cutoffs are Fin n → ℝ; menus are Finset (Option (Fin n)), and sums over menus run over the whole power set of J. The utility laws Ft are probability measures on Option (Fin n) → ℝ, concentrated on injective vectors (strict preferences). Capacities are assumed nonnegative. Probabilities are real numbers obtained as toReal of finite measures. The demand is computed under the product measure Ft⊗Gt, which encodes independence of priorities and preferences.
The DA operator merges the two branches of Algorithm 2 into a single infimum over [zj,B], with B added to the set so the operator maps [0,B]n to itself, as the paper asserts. The DA cutoff is characterized as the least element of the fixed points in [0,B]n. DA-implementability quantifies over a priority box [0,B]n with B>0, probability laws Gt supported in it, quotas 0≤q≤c, and the DA cutoff. DA-STB-implementability quantifies over boosts with 0≤btj≤B−1, so priorities stay in the box.
Implementability is never stated as quantification over menus directly: that would be the random assortment mechanism, which implements every y by definition and would make part i) trivial. The cutoff is never "some fixed point": the all-ones vector is a fixed point by construction, and only the least fixed point carries the content of the theorem.
Theorem 1 b) (TTC and serial dictatorship) is not part of this mission: the TTC cutoffs are imported from Leshno and Lo as a black box. Contributions are welcome on the measure-theoretic lemmas (continuity of the demand, the menu law under (H.1) and under single tie-breaking) and on the Knaster–Tarski step, which can use Mathlib's OrderHom.lfp on a complete lattice of boxes.
E. M. Azevedo and J. D. Leshno, A Supply and Demand Framework for Two-Sided Matching Markets, Journal of Political Economy 124(5), 2016. https://doi.org/10.1086/687476
A. Abdulkadiroğlu, Y.-K. Che and Y. Yasuda, Expanding "Choice" in School Choice, American Economic Journal: Microeconomics 7(1), 2015. https://doi.org/10.1257/mic.20120027
J. D. Leshno and I. Lo, The Cutoff Structure of Top Trading Cycles in School Choice, Review of Economic Studies 88(4), 2021. https://doi.org/10.1093/restud/rdaa071
Informing Geometric Deep Learning with Electronic Interactions to Accelerate Quantum Chemistry: The UNiTE Network Is Equivariant Under Local Unitary Changes of BasisResearch Paper
Motivation
Machine-learned models of molecular energies and properties are trained on the output of quantum-chemistry calculations, and a common way to make them data-efficient is to build the physical symmetries of the problem into the architecture. When the input is not a point cloud but a set of matrices expressed in an atomic-orbital basis (Fock, density, overlap and Hamiltonian matrices from a cheap mean-field calculation), the relevant symmetry is the freedom to rotate the orbital basis of each atom independently: a rotation of the molecule, or any other unitary change of the local frames, changes every matrix element but not the physics.
Qiao, Christensen, Welborn, Manby, Anandkumar and Miller (arXiv:2105.14655v4, published in PNAS 2022) introduce UNiTE (Unitary N-body Tensor Equivariant network), the architecture behind OrbNet-Equi. They state as eq. (4), p. 3, that the network must satisfy R⋅F(T[Ψ0])≡F(R⋅T[Ψ0]) for every isometric basis rotation R, and prove this property in Appendix S2.6 (pp. 26–28) for a generalized version of the network: tensors of any order N, complex scalars, and an arbitrary unitary change of basis on each atom. The empirical results of the paper (QM9, MD17, GMTKN55) rest on this design principle, but the mathematical content of the paper is the equivariance proof.
Setting
There are d atoms u. Atom u carries a finite basis {eu;v}v∈ιu, and the concatenated basis is the set of pairs (u,v). An N-body tensor of order N=n+1 is a function T of N concatenated indices; its sub-tensor Tu at u=(u1,…,uN) collects the entries whose j-th index lies in atom uj.
A group K (the paper's U(n); O(3) in the experiments) acts through unitary representations πu1:K→U(ιu), and each atom has a subgroup Gu≤K. An element g=(gu)u with gu∈Gu acts on tensors by the local action (S26):
g⋅Tu=(π1(gu1)⊗π1(gu2)⊗⋯⊗π1(guN))Tu.
The network's hidden featureshu assign to each label L of a unitary representation UL:K→U(VL) and each channel c a vector hu,L,c∈VL; g acts by hu,L,c↦UguLhu,L,c. Matching matrices(Du)vL,k,M=⟨eu;v,πu;L,k,M⟩ relate the atomic basis to a basis adapted to the decomposition Vu≃⨁L(VL)⊕KL.
The UNiTE network F (Methods 1.1; Appendix S2.5) consists of:
a diagonal reductionψu turning the diagonal block Tu into the initial features hu0;
t1 full steps, each made of a block convolution (S36), message passing (S37) with scalar attention weights α, a reverse matching layer (S45) and a point-wise interactionϕ (S40)–(S42) built from EvNorm (S39) and Clebsch–Gordan-type coefficients C;
then t2 point-wise interaction steps.
Formalization targets
Goal: G-equivariance of UNiTE (S2.6, p. 26)
Under the hypotheses the paper's proof uses — compatibility (S35) of the matching matrices, the Clebsch–Gordan property (S33) of C, equivariance (S32) of the diagonal reduction, invariance g⋅α=α of the attention weights, and positivity of the EvNorm constants — for every g∈∏uGu, tensor T and atom u,
F(g⋅T)u=U(gu)⋅F(T)u.
Milestones
The proof in S2.6 rests on three results of S2.4 and four labelled sub-proofs:
Theorem S1 (p. 24): a tensor product of irreducible unitary representations decomposes into irreducibles, with ∑Lμ(L)dimVL=∏jdimVLj (S29)–(S30);
Corollary S2 (p. 24): an invertible equivariant linear map ψ:Vu⊗N→⨁L(VL)⊕μ(L;Vu);
Corollary S3 (p. 24): an injective equivariant reduction ψ(T)ν,L,M=∑vT(v)Qν,L,Mv with ∑LnL≤dim(Vu)N;
the four building-block equivariances of S2.6, for the block convolution, message passing, EvNorm and the point-wise interaction.
Significance
The theorem is what justifies feeding UNiTE features in arbitrary local frames: the predicted invariant quantities (energies) do not depend on the choice of atomic-orbital phases or orientations. The vector-valued outputs, such as dipole moments, then transform correctly. Without it, the model would have to learn the symmetry from data or from augmentation. The same argument applies to other architectures acting on matrices in local bases, for example models of Hamiltonian or density matrices.
The result is proved in the paper, with a proof written at the level of index manipulations. To our knowledge it has no machine-checked proof. Formalizing it pins down exactly which hypotheses each layer needs: (S35) on the matching matrices, the complex conjugate in (S36), the intertwining form of (S33), and invariance of the attention weights. It also yields a reusable library of statements about tensor-product and block-diagonal actions of unitary representations. Theorem S1 for an arbitrary group with a complete catalogue of irreducibles is a statement of independent interest: finite-dimensional unitary representations are completely reducible, which Mathlib does not yet provide outside finite groups.
Difficulty
No single step is deep; the difficulty is bookkeeping across dependent index types. The local action is block-diagonal over atoms, so cross-atom terms must be shown to vanish. Sub-tensor indices are dependent on the atom sequence u. The block convolution's cancellation ∑vπvv′1πvv′′1=δv′v′′ uses unitarity and the conjugate. The reverse matching layer needs the adjoint form of (S35), which uses that Gu is a subgroup (closed under inverses). The point-wise block reindexes a double sum through a Kronecker product. The full network is a two-phase recursion whose attention weights depend on the current features, so the induction must carry the equivariance of every intermediate feature. Theorem S1 needs complete reducibility of a finite-dimensional unitary representation of an arbitrary group, together with the identification of each irreducible summand with a catalogue member.
A tempting shortcut, assuming each layer equivariant and composing, proves nothing about UNiTE: the content is that these specific layers are equivariant under these specific hypotheses.
Formalization scope
All scalars are complex; the paper's real (orthogonal) case is the special case of real unitary matrices. U(n) is replaced by an abstract group K ([Group K]), representations are homomorphisms K →* Matrix.unitaryGroup ι ℂ, and the catalogue of irreducibles of U(n) is a family UL with the hypothesis CatalogComplete (every irreducible unitary representation is equivalent to some UL), the formal reading of the paper's "we have abstracted the labelling details … into the index L". The subgroups Gu are S u : Subgroup K, and every hypothesis is assumed only for k∈Gu.
Committed conventions:
the tensor has order N=n+1 over the concatenated basis Σ u, ι u;
every label has the same number nmax of channels, as (S41) requires;
the matching weights use the main-text shapes (16) and (28), with a multiplicity index for the copies of VL in Vu; they may depend on atom and step;
the multilayer perceptrons are arbitrary functions of the invariant features, and the EvNorm statistics μ,σ are fixed parameters;
(S33) is assumed in intertwining form C(UL1⊗UL2)=ULC, which follows from the printed form for co-isometric C;
the diagonal reduction ψu is any linear map satisfying (S32), and the attention weights are any functions of the step's inputs satisfying g⋅α=α; the paper's concrete attention (18)–(21) is not instantiated;
only part (a) of the group G of S2.2 (local unitaries) is formalized; permutations (b) and translations (c) leave the symmetric, translation-invariant input unchanged and are trivial.
Trivializing formalizations are ruled out. The layers are defined concretely, not replaced by maps assumed equivariant. The action is local, one unitary per atom, not one global unitary. The complex conjugate in (S36) is kept. Irreducibility of the catalogue and its completeness are both stated in Theorem S1 and the corollaries.
The development needs one definitions module (OrbNetEqui.Equivariance.Basic) and Mathlib's matrices, unitary groups, block-diagonal and Kronecker matrices. Contributions are welcome on every milestone; the building-block lemmas (block-diagonal and Kronecker actions of unitary matrices, unitary invariance of the regularized norm) and complete reducibility of finite-dimensional unitary representations are reusable beyond this mission.
Selected references
Z. Qiao, A. S. Christensen, M. Welborn, F. R. Manby, A. Anandkumar, T. F. Miller III, Informing Geometric Deep Learning with Electronic Interactions to Accelerate Quantum Chemistry, Proc. Natl. Acad. Sci. USA 119 (2022); preprint arXiv:2105.14655v4. https://arxiv.org/abs/2105.14655
Z. Qiao, M. Welborn, A. Anandkumar, F. R. Manby, T. F. Miller III, OrbNet: Deep learning for quantum chemistry using symmetry-adapted atomic-orbital features, J. Chem. Phys. 153, 124111 (2020). https://doi.org/10.1063/5.0021955
N. Thomas et al., Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds, arXiv:1802.08219 (2018). https://arxiv.org/abs/1802.08219
Robust Learning of Consumer Preferences: the Myopic Tracking Policy is worst-case asymptotically optimal for identifying the top-ranked productResearch Paper
Motivation
A company that is about to launch a product often has several candidate versions of it (designs, packagings, feature bundles) and wants to know which one consumers like best. A common way to find out is to ask: show an arriving consumer a few versions and record which one they pick. Each such query costs time and money, and consumer answers are noisy, so the question is how to choose what to show, and when to stop asking, so that the most preferred version is found with a prescribed reliability using as few consumers as possible.
Y. Feng, R. Caldentey and C. T. Ryan, Robust Learning of Consumer Preferences (SSRN 3215614; Operations Research, doi:10.1287/opre.2021.2157), treat this as a sequential hypothesis test in the style of best-arm identification (Garivier and Kaufmann, 2016; Kaufmann, Cappé and Garivier, 2016). The difference from a bandit is in the feedback: an action is a set of versions, and an observation is a choice from that set drawn from an unknown choice model. The paper asks for a policy that is good not for one choice model but uniformly over a large nonparametric class of them, and shows that a simple likelihood-based policy achieves this.
Setting
There are K≥2 versions, [K]={1,…,K}. A display set is a subset S⊆[K] with ∣S∣≥2; S is the collection of display sets. A preferencef gives, for each S∈S and X∈[K], the probability f(X∣S) that a consumer shown S picks X. A rankingσ is a permutation of [K], rank 1 being the top.
For 0<p<1, the class Mp of p-separable preferences (Definition 1) consists of the f with f(X∣S)>0 exactly for X∈S, ∑X∈Sf(X∣S)=1, and a ranking σf such that within every display set, f(X′∣S)≤f(X∣S) iff σf(X)<σf(X′) (for X=X′), and moreover f(X′∣S)≤pf(X∣S) whenever σf(X)<σf(X′). The goal is to identify the top-ranked versionσf−1(1).
An admissible policyπ chooses, after each history Ht=(S1,X1,…,St,Xt), a distribution λt+1 over display sets for the next consumer; it stops at a stopping time τ and selects dτ∈[K]. It is δ-accurate if for every f∈Mp it stops almost surely and Pfπ(dτ=σf−1(1))≤δ; a family Π={πδ} is accurate if each πδ is δ-accurate (Definition 2).
With DS(f∥g)=∑k∈Sf(k∣S)logg(k∣S)f(k∣S) and Dλ=∑Sλ(S)DS, Chernoff's information is
where Mp(f) is the set of preferences in Mp with a different top-ranked version. The ordinal attraction (OA) preferences are fσOA(X∣S)=1−p∣S∣1−ppσ(X∣S)−1, where σ(X∣S) is the rank of X within S.
The Myopic Tracking Policy (MTP, Algorithm 1) with threshold β fits the OA ranking of maximum likelihood to the votes so far, stops when the generalized log-likelihood ratio against every OA ranking with a different top reaches β, and otherwise shows the top-n versions of the fitted ranking with probability λ∗OA([n]), an explicit distribution given in (7).
that is, for every choice of the initial display set S1 the family {MTPβ(δ)} is accurate and its worst-case rate is at most that of every accurate family. The goal states the shape of the result and does not fix the optimal value.
Milestones
The OA preferences are the hardest instances: MpOA⊆argminMpI∗ (Theorem 3, via Lemmas 4–5), and OA alternatives suffice to compute I∗ on them (Corollary 1).
The optimal display distribution is explicit and unique (Theorem 4, via Lemmas 6–9, a primal–dual certificate), and I∗OA has a closed form with two-sided bounds (Proposition 2).
Any δ-accurate policy needs Efπ[τ]≥kl(δ,1−δ)/I∗(f), and liminfδ↓0Ef[τ]/log(1/δ)≥1/I∗(f) (Theorem 1).
MTP has limsupδ↓0Ef[τ]/log(1/δ)≤1/I∗OA (Theorem 6), errs with probability at most C~1e−β (Lemma 10), and is δ-accurate for β≥C1+log(1/δ) (Theorem 7), with constants depending only on K.
Significance
The theorem says that one fixed, computable policy is optimal against the hardest consumer population in a nonparametric class, without knowing the population. Its display rule is static and sparse: only the K−1 nested sets of top-ranked versions are ever shown. The value 1/I∗OA gives a closed-form benchmark for the number of consumers any reliable test must survey, and Proposition 2 shows it barely depends on K. The lower bound (Theorem 1) is a change-of-measure argument that applies beyond this model, for example to identifying the top-k versions or the full ranking.
The results are proved in the paper; none is formalized. A formalization would produce a reusable discrete framework for sequential testing with set-valued actions and categorical feedback (finite-history laws, stopping times, expected stopping times in [0,∞]), a formal treatment of Chernoff-type max-min information over a choice-model class, and a machine-checked LP duality certificate for the optimal display distribution. It would also pin down the exact hypotheses: two printed statements need correction (see Formalization scope).
Difficulty
The class Mp is infinite and nonparametric, so the usual best-arm identification arguments, which track an estimate of the true instance, do not apply directly: MTP only ever estimates within the OA family, even when the truth is not OA. The upper bound must show that the drift of MTP's log-likelihood process under an arbitrary f∈Mp is at least I∗OA, which rests on the dominance structure of Lemmas 4–5 and on the optimality of the fixed distribution λ∗OA. The accuracy proof must control the error probability uniformly over Mp with a threshold independent of f and p. Computing I∗ on OA preferences reduces to a linear program over all rankings with a different top, whose explicit primal and dual solutions require the identities of Lemmas 6–9.
Formalization scope
Everything is finite or discrete and no measure theory is used. Versions are Fin K and rankings are Equiv.Perm (Fin K) with 0-based ranks (rank 0 is the top); the restricted rank σ(X∣S) stays 1-based. A preference is a function DS K → Fin K → ℝ. A policy is given by its display rule (a function of the history into ℝ≥0∞), a stopping predicate on histories, and a selection function; the law of a history is the explicit product ∏ℓλℓ(Sℓ)f(Xℓ∣Sℓ), E[τ]=∑tP(τ>t) in [0,∞], and I∗, I∗OA and all rates are in [0,∞]. Limits as δ↓0 are along 𝓝[>] 0. MTP's uniform tie-break enters as a mixture in the display rule; for β>0 stopping and selection do not depend on it.
Added hypotheses and readings, each disclosed in the items: (A-3) is required for X=X′ only (as printed it is unsatisfiable at X=X′); 0<p<1 and K≥2; δ∈(0,1); β>0 (Algorithm 1's input); the initial display set S1 is arbitrary. Theorem 1's first inequality is stated for δ≤1/2, since it fails for δ close to 1. Theorem 6's final sentence (equality for OA preferences) is not formalized, since it fails for bounded thresholds. The constants of Lemma 10 and Theorem 7 are quantified after K and before p.
Trivializing formalizations are ruled out: Definition 1 is non-vacuous (an OA preference is shown to lie in M1/2), the alternative sets require membership in Mp, top-rankedness is tied to the (A-3) ranking, and the goal includes the accuracy of MTP. Without it, a tiny threshold would stop after one vote.
Not in scope: Theorem 2 (a different policy for finite classes), Propositions 1 and 3–7, Corollaries 2–3, and the numerical study. Contributions to any milestone are welcome. The finite-history probability layer and the lower-bound argument are reusable for other sequential identification problems.
E. Kaufmann, O. Cappé, A. Garivier, On the Complexity of Best-Arm Identification in Multi-Armed Bandit Models, JMLR 17, 2016. https://arxiv.org/abs/1407.4443
The Privacy Paradox and Optimal Bias–Variance Trade-offs in Data Acquisition: The Minimax-Optimal Allocation Rule Is Constant Then Inversely Proportional to the Square Root of the Virtual CostResearch Paper
Motivation
Data marketplaces buy personal data from many individuals to estimate population statistics. Two features set such pricing apart from an ordinary procurement auction. First, each data owner has a private cost of sharing, so the buyer must design a menu of payments that elicits these costs truthfully. Second, data are correlated across people: an individual who refuses to share still loses privacy when similar people share. Liao, Su, Ziani, Wierman and Huang call the consequence the privacy paradox: privacy-conscious people may join a platform because abstaining does not protect them (arXiv:2105.14262, §1; published in Mathematics of Operations Research, 2024).
The paper asks how an analyst with a fixed budget should design such a mechanism when the goal is statistical: to estimate a population mean while trading off the bias caused by non-participants against the variance caused by sampling only some participants. The answer extends the optimal-auction framework of Myerson (Math. Oper. Res. 1981) and the data-procurement mechanisms of Roth and Schoenebeck (EC 2012) and Chen, Immorlica, Lucier, Syrgkanis and Ziani (EC 2018) to a setting with participation externalities and an adversarial correlation between data and costs.
Setting
Agents are split into groups i=1,…,I. An agent in group i has a cost c drawn from a density fi on the support [cmin,cmax], with distribution function Fi. At a fixed desired participation profileθ∗ the privacy cost of a participant is hi(c)=cbi with 0≤bi<1, a non-participant suffers gi(c)≤hi(c), the gap hi−gi is strictly increasing, and participants receive a benefit w.
The analyst posts a menu: a selection probability Ai(c~) and a payment Pi(c~) for a reported cost c~. A participant with true cost c who reports c~ has expected utility
uˉi(c~∣c)=Ai(c~)[Pi(c~)−c+hi(c)]−hi(c)+w.
The menu is truthful if reporting c~=c maximizes this utility. An agent joins if some report gives utility at least −gi(c), and the menu inducesθ∗ if the fraction of joining agents of group i is θˉi∗=Fi(c^i) for a threshold c^i. The virtual cost is
ϕi(c)=c−hi(c)+(1−bi)fi(c)Fi(c).
For the statistical problem, Appendix C of the paper discretizes the costs and sorts all virtual costs of participants as 0<ϕ1<⋯<ϕK, with cell probabilities πk>0 summing to θˉ∗. Given s agents, a budget B, a constant l collecting the participation terms, and a weight γ∈(0,1] on the variance, the analyst chooses Ak∈(0,1] and an adversary chooses the data probabilities pk∈[0,1] in the min-max program
subject to the budget ∑kπkϕkAk+l≤B/s, under the standing condition B/s−l>0.
Formalization targets
Goal: Theorem 2 (discrete form)
There are constants χ, η, ϕ^ and a feasible, non-increasing allocation
Ak∗={χ,η/ϕk,ϕk≤ϕ^,ϕk>ϕ^,
such that maxpU(A∗,p)≤maxpU(A,p) for every feasible A. The constants are left existential, as in the printed theorem; the case analysis that identifies them belongs to the milestones.
Milestones
Theorem 1, both directions: a menu is (strictly) truthful and induces θ∗ if and only if Ai is non-increasing (strictly decreasing) and Pi is the explicit payment (15); and Corollary 1: under that menu an agent participates if and only if c≤c^i.
The payment identity: expected payment equals expected virtual cost plus ∑iqiθˉi∗(hi(c^i)−gi(c^i)−w), which turns the budget into the linear constraint of the program.
Lemma 2 and Lemma 3: the best responses of the adversary and of the analyst.
Claims 1–4: monotonicity and gluing properties of the auxiliary functions Q(m,z), R(m,z) and existence of the thresholds they define.
Corollary 2 in its discrete form: under the low-budget condition (56), Ak∗∝1/ϕk together with p≡1 is a saddle point.
Significance
Theorem 1 is a participation-aware version of Myerson's characterization: it shows that the analyst loses nothing by restricting to monotone allocation rules with one explicit payment, and it pins down the payment that realizes a target participation rate. Theorem 2 then solves the analyst's worst-case bias–variance problem: the optimal selection probability is flat for cheap agents and decays like the inverse square root of the virtual cost for expensive ones. This shape explains when the mechanism can be strictly truthful (a strictly decreasing rule, Corollary 2, in the low-budget regime) and when only weak truthfulness is possible (a flat region, larger budgets).
The paper proves Theorem 2 for discrete costs and passes to continuous costs by letting the number of cells grow without bound, a step it asserts without proof. The mission formalizes the discrete theorem that Appendix C actually proves, together with both directions of Theorem 1. None of these results has a machine-checked proof yet.
Difficulty
The goal is a min-max statement about a program that is convex in the allocation and concave in the adversary's choice, with a coupled budget constraint. The natural first idea, to solve each player's first-order conditions and plug them into each other, does not by itself produce a solution: the analyst's best response clips at 1, the adversary's best response may be interior on some cells and at the boundary on others, and which cells are which depends on the budget. The paper resolves this by a case analysis on the ratio (B/s−l)/(γθˉ∗) against the values of Q(m,1)/R(m,1), with thresholds obtained from intermediate-value arguments, and each case requires its own multiplier and its own adversary strategy.
For Theorem 1 the obstacle is that the paper's envelope argument differentiates the allocation rule, while the theorem quantifies over all monotone rules, which need not be differentiable. The "only if" direction must be recovered from the convexity of the maximal utility as a function of the true cost.
Formalization scope
All statements live in the namespace PrivacyParadox.Alloc and use one definitions file. The group layer fixes one desired profile, so h, g, b and w are functions of the cost or numbers; their dependence on participation rates and correlation strengths plays no role in Theorems 1–2. The discrete layer indexes cells by k=1,…,K as the paper does, with real-valued data and Real.sqrt.
The formalization commits to the following conventions, each disclosed in the item it affects:
0≤b<1; the paper's Assumption 1 only gives h≤c, and b=1 breaks strict truthfulness.
Allocations are strictly positive. In Lean p/0=0, while the paper's objective is +∞ at Ak=0, pk>0; without this convention the zero allocation would look optimal.
The sorted virtual costs are strictly increasing, as the sorted list of p. 25 prints them.
0<γ≤1 and 0<θˉ∗≤1.
The "only if" half of Theorem 1 assumes θˉi∗<1, since at θˉi∗=1 other payments induce the same participation.
Participation is "some report reaches the outside option", which agrees with the paper's "the best report" whenever the maximum is attained.
Two trivializing readings are excluded: the goal compares A∗ with every feasible allocation, so it is not the best-response property of Lemma 3, and it asserts the existence of A∗ rather than assuming an optimizer of the stated form.
A complete development needs elementary real analysis (interval integrals of monotone functions, Fubini on a triangle, the intermediate value theorem) and finite-dimensional convex optimization (first-order optimality for a concave quadratic on a box and for a separable convex program with one linear constraint). The latter two are reusable well beyond this mission. Proofs of milestones are welcome in any order. The continuous form of Theorem 2, Lemma 1 (the derivation of the objective from the Horvitz–Thompson estimator), Propositions 1–2 and Properties 1–4 are not part of the mission.
Selected references
G. Liao, Y. Su, J. Ziani, A. Wierman, J. Huang, The Privacy Paradox and Optimal Bias–Variance Trade-offs in Data Acquisition, arXiv:2105.14262v1, 2021; Mathematics of Operations Research, 2024. https://arxiv.org/abs/2105.14262
A. Roth, G. Schoenebeck, Conducting Truthful Surveys, Cheaply, Proceedings of the 13th ACM Conference on Electronic Commerce, 2012. https://doi.org/10.1145/2229012.2229076
Y. Chen, N. Immorlica, B. Lucier, V. Syrgkanis, J. Ziani, Optimal Data Acquisition for Statistical Estimation, Proceedings of the 2018 ACM Conference on Economics and Computation, 2018. https://doi.org/10.1145/3219166.3219195
D. G. Horvitz, D. J. Thompson, A Generalization of Sampling Without Replacement from a Finite Universe, Journal of the American Statistical Association 47(260):663–685, 1952. https://doi.org/10.1080/01621459.1952.10483446
On Geometric Connections of Embedded and Quotient Geometries in Riemannian Fixed-rank Matrix Optimization: Gradient and Hessian Connections for Fixed-rank PSD Matrices via YYᵀResearch Paper
Motivation
Many estimation problems in statistics, signal processing and machine learning ask for a low-rank positive semidefinite matrix: phase retrieval, matrix sensing, PCA-type problems and the Burer–Monteiro approach to semidefinite programs. A standard formulation is
X∈Sp×p,X⪰0,rank(X)=rminf(X),0<r≤p,(1)
and Riemannian optimization solves it by treating the feasible set as a smooth manifold. Two geometries are in common use. In the embedded geometry the set of rank-r PSD matrices is a submanifold of Rp×p with the Euclidean metric. In the quotient geometry one writes X=YY⊤ with a full-column-rank factor Y and optimizes over equivalence classes [Y]={YO:O orthogonal}. Algorithms built on the two geometries behave similarly in experiments, and landscape results (absence of spurious local minima, strict saddles) have been proved separately for each. Luo, Li and Zhang (arXiv:2110.12121, Mathematics of Operations Research 2024) explain this by an explicit dictionary between the Riemannian gradients and Hessians of the two geometries. This mission formalizes their first main result, Theorem 3, for the full-rank factorization of PSD matrices.
Setting
Matrices carry the Frobenius inner product ⟨A,B⟩=tr(A⊤B). The objective f:Rp×p→R is twice continuously differentiable and symmetric, f(X)=f(X⊤) (the paper's standing assumptions); ∇f and ∇2f are its Euclidean gradient and Hessian.
Embedded geometry.Mr+={X∈Sp×p:X⪰0,rankX=r}, viewed as Mr+e⊂Rp×p. Its tangent space TXMr+e is the span of the tangent cone. The Riemannian gradientgradf(X) is the orthogonal projection of ∇f(X) onto TXMr+e, and the Riemannian Hessian quadratic form Hessf(X)[ξ,ξ] is the derivative dtd⟨gradf(c(t)),ξ⟩ at t=0 along any C1 curve c in Mr+ with c(0)=X, c′(0)=ξ.
Quotient geometry. The total space is R∗p×r, the p×r matrices of full column rank, with the objective hˉr+(Y)=f(YY⊤) (18a). A weightY↦WY, smooth and symmetric positive definite, defines the metric gˉY(η,θ)=tr(WYη⊤θ). The vertical spaceVY={YΩ:Ω⊤=−Ω} is tangent to the orbit [Y], and the horizontal spaceHY is its gˉY-orthogonal complement. Tangent vectors of the quotient Mr+q1=R∗p×r/Or are represented by horizontal vectors: gradhr+([Y]) is the horizontal part of the total-space gradient ∇hˉr+(Y)WY−1, and Hesshr+([Y])[θ,θ]=gˉY(∇ˉθgradhˉ,θ) for horizontal θ, where ∇ˉ is the Levi-Civita connection of gˉ (Koszul formula).
Comparison data.LYr+(θ)=Yθ⊤+θY⊤; U∈St(r,p) spans the top r eigenspace of X=YY⊤, P=U⊤Y, Y†=(Y⊤Y)−1Y⊤. For a quadratic form on a d-dimensional space with inner product g, λk is its k-th largest eigenvalue relative to g (1≤k≤d). σ1,σr are the extreme singular values of an r×r matrix.
Formalization targets
Goal: Theorem 3 (p. 21)
If in addition WY=OWYOO⊤ for all orthogonal O, then for every Y∈R∗p×r and X=YY⊤,
Theorem 2: the abstract sandwich inequality for spectra of two quadratic forms related by a bijection with bounded metric distortion.
Significance
Theorem 3 says that at stationary points the two geometries see the same second-order landscape: the Hessians are congruent through LYr+, so their eigenvalues have the same signs and comparable magnitudes, with explicit factors depending on WY and the spectrum of X. The paper derives from it (Corollary 1) that first-order stationary points, second-order stationary points and strict saddles correspond between the embedded and quotient formulations, so a landscape result proved in one geometry transfers to the other. The choice of weight WY (flat Ir, right-invariant (Y⊤Y)−1, or Y⊤Y) changes the comparison constants, which is how the paper relates the conditioning of the two approaches.
The result is proved in the paper; it is not formalized anywhere. A formal development adds machine-checked Riemannian gradients and Hessians on a concrete embedded submanifold and on a concrete quotient, a checked horizontal-space computation, and a reusable abstract sandwich theorem for max–min eigenvalues. Corollary 1 and the parallel results for the polar factorization and for general rank-r matrices (Theorems 4–7) are natural follow-up missions on the same definitions.
Difficulty
The identities (19), (20) and (34) are matrix calculus once the geometric objects are pinned down; the difficulty is that the definitions are intrinsic. The embedded Hessian requires differentiating the tangent projection PTXMr+e along the manifold, which produces the curvature term 2⟨∇f(X),U⊥DΣ−1D⊤U⊥⊤⟩; the obvious computation that ignores the moving tangent space gives the wrong Hessian. The quotient Hessian involves the derivative of the weight WY and needs the horizontal-space description of Lemma 4 to see that the projection in (5) can be dropped. Identifying span of the tangent cone with the block form (14) needs an explicit chart of the rank-r PSD set. The final sandwich requires a max–min (Courant–Fischer) argument relative to two different inner products, and the order of the bounds flips for negative eigenvalues.
Formalization scope
Ra×b is EuclideanSpace ℝ (Fin a × Fin b) (Frobenius inner product) with matrix views toMat/ofMat. The weight W takes values in Rr×r in the same form so that DWY is defined.
The embedded tangent space and Riemannian gradient are the published platform definitions ProjLikeRetr.Retractor.tangentSpace (span of the tangent cone) and ZORiem.RGD.rgrad (projected Euclidean gradient); "smooth embedded submanifold of dimension d" is the published coordinate-slice predicate ProjLikeRetr.Retractor.IsSubmanifold k d, for every k.
The embedded Hessian is a curve-defined predicate on a quadratic form; the quotient Hessian is the Koszul-formula form gˉY(DG[θ],θ)+21Dgˉ(θ,θ)[G]. Neither is defined by the paper's formulas (19), (20) or (34): those are theorems, and a formalization that defined the Hessians or gradients by them would make the mission trivial.
λk is the max–min value over k-dimensional subspaces (the paper's Lemma 13); "sandwiched between a and b" means min(a,b)≤μ≤max(a,b); σ1,σr of the symmetric positive definite PWY−1P⊤ are its extreme Rayleigh quotients.
Conventions: 0<r≤p; f is C2 and symmetric; WY is positive definite on R∗p×r and W is smooth there (the meaning of "Riemannian metric"); "U spans the top r eigenspace of YY⊤" is U⊤U=Ir, UU⊤Y=Y; Y†=(Y⊤Y)−1Y⊤; LYr+ is defined as Yθ⊤+θY⊤ rather than by the block formula (22).
In Theorem 2 the map L is assumed linear, as in every application in the paper, and the printed domain HX in (12)–(13) is read as HZ.
Not encoded: the half of Lemma 3 about general rank-r matrices, Lemma 4 (ii) (no quotient-manifold structure in Mathlib), the polar factorization geometry and Theorems 4–7, Corollaries 1–2.
Useful contributions include Mathlib-level lemmas on the tangent cone of the rank-r PSD set, Courant–Fischer for a form relative to a non-standard inner product, and matrix-calculus lemmas for D(W−1).
Selected references
Y. Luo, X. Li, A. R. Zhang, On Geometric Connections of Embedded and Quotient Geometries in Riemannian Fixed-rank Matrix Optimization, Mathematics of Operations Research, 2024; arXiv:2110.12121v2. https://arxiv.org/abs/2110.12121
P.-A. Absil, R. Mahony, R. Sepulchre, Optimization Algorithms on Matrix Manifolds, Princeton University Press, 2008. https://doi.org/10.1515/9781400830244
M. Journée, F. Bach, P.-A. Absil, R. Sepulchre, Low-rank optimization on the cone of positive semidefinite matrices, SIAM Journal on Optimization 20(5), 2010. https://doi.org/10.1137/080731359
B. Vandereycken, S. Vandewalle, A Riemannian optimization approach for computing low-rank solutions of Lyapunov equations, SIAM J. Matrix Anal. Appl. 31(5), 2010. https://doi.org/10.1137/090764566