Optimization of Mean-field Spin Glasses III: The Lagrangian Value of the Stochastic Control Problem Equals the Parisi FunctionalResearch Paper
Motivation
The ground-state energy of a mixed -spin spin glass, , converges almost surely to the infimum of the Parisi functional over non-decreasing order parameters (Auffinger–Chen 2017). El Alaoui, Montanari and Sellke (arXiv:2001.00904v1) study algorithms that find near-optimal configurations. They introduce incremental approximate message passing (IAMP) and show that, among a broad class of such algorithms, the best achievable energy is the infimum of the Parisi functional over a larger space of order parameters (their Theorem 4).
The upper bound in Theorem 4 is reduced, in Section 4 of the paper, to a stochastic optimal control problem. The energy reached by a message-passing algorithm becomes the objective of a control problem driven by a Brownian motion, with a terminal constraint and a variance constraint. The variance constraint is removed by a Lagrange multiplier . Proposition 4.1 states that the resulting Lagrangian value is exactly the Parisi functional . This mission formalizes that duality and the verification argument behind it (Section 7).
Setting
Mixture. Real coefficients define the mixture , with the standing assumption for some . Its derivatives , are nonnegative and nondecreasing on .
Order parameters. is the set of nonnegative step functions
Put .
Parisi PDE and functional. solves
For it is given explicitly by the Cole–Hopf recursion: with and , for ,
The Parisi functional is .
Control problem. Let be a standard Brownian motion. A control is a process on , progressively measurable for the filtration of , with . The value is
Candidate value function. With ,
Formalization targets
Goal: Proposition 4.1
Milestones
- Lemma 7.2 (a)–(e): is smooth for , with derivatives jointly continuous on and in time where is constant. The range of is , it is strictly increasing, and for .
- Envelope identities (proof of Lemma 7.3): and , where is the unique root of .
- Lemma 7.3: solves the HJB equation
- Evaluation at the origin: .
- Proposition 7.1: for all .
Proposition 7.1 at together with milestone 4 gives the goal.
Significance
The result. By integration by parts (Eq. (4.4) of the paper), bounds the value of the constrained control problem (4.2). That problem in turn bounds the asymptotic energy of every message-passing algorithm in the class of Theorem 4. Proposition 4.1 turns the bound into , which is the analytic core of the optimality statement for IAMP. It is also an instance of a broader principle: the Parisi functional has a stochastic-control representation (Jagannath–Tobasco 2016).
Formalizing it. The result is proved in the paper; no machine-checked version exists. A complete formalization needs a verification theorem for a control problem with a state constraint (), Itô's formula for a function that is only piecewise in time, and quantitative regularity of the Cole–Hopf solution. Each of these is reusable well beyond spin glasses.
Difficulty
The value function is not known to be smooth, and the dynamic-programming equation (4.6) is only heuristic. The proof therefore guesses a solution and verifies it. Two steps carry the difficulty.
First, the guess is a Legendre transform. Its regularity, and the sign that makes the HJB supremum finite, rest on strict convexity and bounded curvature of (Lemma 7.2). These must be proved by induction through the Cole–Hopf recursion, including the steps with .
Second, the verification argument applies Itô's formula to , where is a martingale confined to and is only in time between the jumps of . The boundary needs a dominated-convergence argument, and attaining the supremum needs an explicit optimal feedback control built from an SDE.
Formalization scope
- Mixture. is a coefficient sequence with imposed. and are explicit termwise series.
- Step functions. is represented by its data (breakpoints and values). is extended by outside ; its value at never matters.
- Cole–Hopf. is defined by the recursion. When , the recursion uses its limit, the heat semigroup, instead of dividing by zero. Expectations over are integrals against
gaussianReal 0 1. - Derivatives. Space derivatives are
deriv/iteratedDeriv. Time derivatives are right derivatives, because jumps. - Legendre transform. is a real infimum, used only for , where it is bounded below.
- Brownian motion and filtration. is a Mathlib
IsBrownianRealprocess on , with each measurable. The filtration is . - Stochastic integral. It is the Itô integral of the published definition
Peng1990.SMP.IsItoIntegral(horizon ), whose integrability class is exactly . - Supremum. is stated as " is the least upper bound of the objective values of admissible controls" (
IsLUB), never as a realsSup. A default value of an empty or unbounded supremum therefore cannot make a statement trivially true. - Disclosed hypothesis. Lemma 7.2, the envelope identities and Lemma 7.3 assume that is not identically zero (some ). For one has for all , and these statements fail. Proposition 7.1, the evaluation at the origin and the goal need no such hypothesis.
- Lemma 7.3. The statement includes the inequality , which the page proves. This rules out reading the HJB supremum as a default value.
The paper's algorithmic results (Theorems 2–4, Corollary 2.2) are out of scope. They need the AMP and state-evolution machinery of Section 5 and Appendix A, and an informal model of computation. The optional bound (4.4) is not stated.
Welcome contributions include the regularity of Cole–Hopf solutions (Gaussian convolution, log-moment-generating functions), a general verification theorem for one-dimensional controlled martingales with a terminal state constraint, and Itô's formula for functions.
Selected references
- A. El Alaoui, A. Montanari, M. Sellke, Optimization of Mean-field Spin Glasses, arXiv:2001.00904v1, 2020. https://arxiv.org/abs/2001.00904
- A. Auffinger, W.-K. Chen, Parisi formula for the ground state energy in the mixed p-spin model, Ann. Probab. 45(6b), 2017. https://arxiv.org/abs/1606.05335
- A. Jagannath, I. Tobasco, A dynamic programming approach to the Parisi functional, Proc. AMS 144, 2016. https://arxiv.org/abs/1502.04398
- N. Touzi, Optimal Stochastic Control, Stochastic Target Problems, and Backward SDE, Fields Institute Monographs 29, Springer, 2012 (cited as [Tou12] in the paper; the verification argument of Section 7 follows its Theorem 4.1).