Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Dynamical Systems

164 missions · 68 completed

Missions

Open96Completed68All164
Mathematical Physics·Captain: Yivy Yu

Birkhoff's Retrograde Global-Section Conjecture in the Planar Circular Restricted Three-Body ProblemOpen Problem

Motivation and historical timeline

In 1915, George D. Birkhoff proved the existence of a retrograde periodic orbit in each bounded component of the planar circular restricted three-body problem and asked whether its double cover bounds a disk-like global surface of section. Such a surface turns a three-dimensional flow into a two-dimensional return map and was intended as a route to a direct periodic orbit (Birkhoff 1915; Liu--Salomão, Section 1.4). McGehee obtained the corresponding section in the small-mass perturbative regime in 1969, while modern contact and symplectic methods recast the question in terms of regularized energy hypersurfaces and Reeb dynamics (Joung--van Koert, Introduction).

In 2012, Hryniewicz established the global-section criterion later quoted by Joung and van Koert: on a dynamically convex star-shaped hypersurface, the proposed binding orbit must be unknotted with self-linking number −1 (Joung--van Koert, Theorem 1.3; Hryniewicz). In 2025, Joung and van Koert combined that criterion with validated orbit and convexity computations for 0≤μ≤1/20\leq\mu\leq 1/20≤μ≤1/2 and 2.1≤c≤2.1+10−62.1\leq c\leq 2.1+10^{-6}2.1≤c≤2.1+10−6 (Theorems 1.2 and 1.5). In May 2026, Liu and Salomão proved the conjecture at every subcritical energy for mass ratios sufficiently close to 1/21/21/2, in fact obtaining rational open books bound by every retrograde orbit in that regime (Theorem 1.16). Their June 2026 Hill result covers every subcritical energy in Hill's lunar problem, which is a limiting model rather than a finite-mass instance of the circular restricted problem (Liu--Salomão 2026). These results leave the universal finite-mass, all-subcritical statement below as the open target.

Setting

Two primaries of masses 1−μ1-\mu1−μ and μ\muμ, with 0<μ<10<\mu<10<μ<1, are fixed in rotating coordinates at (−μ,0)(-\mu,0)(−μ,0) and (1−μ,0)(1-\mu,0)(1−μ,0). For a massless particle with phase coordinates (q1,q2,p1,p2)(q_1,q_2,p_1,p_2)(q1​,q2​,p1​,p2​), the Hamiltonian is

Hμ(q,p)=p12+p222+q1p2−q2p1−1−μ(q1+μ)2+q22−μ(q1−1+μ)2+q22.H_\mu(q,p)=\frac{p_1^2+p_2^2}{2}+q_1p_2-q_2p_1 -\frac{1-\mu}{\sqrt{(q_1+\mu)^2+q_2^2}} -\frac{\mu}{\sqrt{(q_1-1+\mu)^2+q_2^2}}.Hμ​(q,p)=2p12​+p22​​+q1​p2​−q2​p1​−(q1​+μ)2+q22​​1−μ​−(q1​−1+μ)2+q22​​μ​.

This is equation (1.1) of Joung--van Koert. Let h1(μ)=Hμ(L1)h_1(\mu)=H_\mu(L_1)h1​(μ)=Hμ​(L1​) be the smallest collision-free critical value, where L1L_1L1​ lies between the primaries. The subcritical range is Hμ=−c<h1(μ)H_\mu=-c<h_1(\mu)Hμ​=−c<h1​(μ); there are then two bounded physical components, one around each primary (Liu--Salomão, Section 4).

The mission labels the primary at (−μ,0)(-\mu,0)(−μ,0). With complex Levi-Civita variables z=z1+iz2z=z_1+iz_2z=z1​+iz2​ and w=w1+iw2w=w_1+iw_2w=w1​+iw2​, the inverse position map is q+μ=2z2q+\mu=2z^2q+μ=2z2, and the regularized Hamiltonian is

Kμ,c(z,w)=∣w∣22+c∣z∣2−1−μ2+2∣z∣2(z1w2−z2w1)−μ(z1w2+z2w1)−μ∣z∣2∣2z2−1∣.\begin{aligned} K_{\mu,c}(z,w)={}&\frac{|w|^2}{2}+c|z|^2-\frac{1-\mu}{2} +2|z|^2(z_1w_2-z_2w_1)\\ &-\mu(z_1w_2+z_2w_1) -\frac{\mu|z|^2}{|2z^2-1|}. \end{aligned}Kμ,c​(z,w)=​2∣w∣2​+c∣z∣2−21−μ​+2∣z∣2(z1​w2​−z2​w1​)−μ(z1​w2​+z2​w1​)−∣2z2−1∣μ∣z∣2​.​

On the collision-free domain, Kμ,c=∣z∣2(Hμ+c)K_{\mu,c}=|z|^2(H_\mu+c)Kμ,c​=∣z∣2(Hμ​+c), and its zero level regularizes collision with the labeled primary (Joung--van Koert, equation (2.2)). The selected component Σμ,c\Sigma_{\mu,c}Σμ,c​ is anchored at (z,w)=(0,1−μ)(z,w)=(0,\sqrt{1-\mu})(z,w)=(0,1−μ​). Below h1h_1h1​, it is a star-shaped three-sphere, invariant under the free antipodal deck map (z,w)↦(−z,−w)(z,w)\mapsto(-z,-w)(z,w)↦(−z,−w), and it double-covers the corresponding Moser-regularized RP3\mathbb{R}P^3RP3 component (Joung--van Koert, Proposition 2.4).

Target

For every 0<μ<10<\mu<10<μ<1, every −c<h1(μ)-c<h_1(\mu)−c<h1​(μ), and every complete flow φ\varphiφ on Σμ,c\Sigma_{\mu,c}Σμ,c​ generated by XKμ,cX_{K_{\mu,c}}XKμ,c​​ and commuting with the antipodal map, prove

∃ δGeometricRetrograde⁡(δ) ∧ RationalGSS⁡(DoubleLift⁡(δ)).\exists\,\delta\quad \operatorname{GeometricRetrograde}(\delta)\ \land\ \operatorname{RationalGSS}(\operatorname{DoubleLift}(\delta)).∃δGeometricRetrograde(δ) ∧ RationalGSS(DoubleLift(δ)).

Here δ\deltaδ consists of x∈Σμ,cx\in\Sigma_{\mu,c}x∈Σμ,c​ and a quotient period P>0P>0P>0 with φP(x)=−x\varphi_P(x)=-xφP​(x)=−x, with no earlier positive time reaching either xxx or −x-x−x. Its physical projection is required to be a q2q_2q2​-symmetric, simple, collision-free loop of winding +1+1+1 around the labeled primary. Traversing it twice gives a least-period closed orbit upstairs. This records the geometric retrograde orbit used in the Birkhoff-conjecture formulation; it does not impose the stronger pointwise astronomical monotonicity test distinguished in Joung--van Koert, Definition 2.1, Proposition 2.2, and Remark 2.3.

The rational page is encoded by a smooth immersive disk lift f~:D2→Σμ,c\widetilde f:D^2\to\Sigma_{\mu,c}f​:D2→Σμ,c​. Its lift is embedded, its interior is transverse to XKμ,cX_{K_{\mu,c}}XKμ,c​​, and its boundary is the closed double lift. After passing to the antipodal quotient, the interior remains embedded and the only nontrivial fibers are antipodal boundary pairs; hence the boundary maps exactly two-to-one onto the prime quotient orbit. Every nonbinding quotient trajectory must meet the page interior at arbitrarily large positive and negative times, matching the recurrence clause in the standard definition of a global surface of section (Hryniewicz, Definition 1.1).

Significance

A global surface of section replaces the continuous three-dimensional regularized flow, away from its binding, by the iterates of a two-dimensional first-return map. Periodic points, invariant sets, and recurrence of that map encode periodic and recurrent trajectories of the original system. This is why Birkhoff connected the conjecture to the existence of a direct orbit, and why later work uses such sections to obtain global dynamical consequences (Birkhoff 1915; Joung--van Koert, Introduction). A proof across all finite mass ratios and all subcritical energies would close the gap between the known perturbative, near-equal-mass, and narrow validated regimes.

Difficulty

Existence of a q2q_2q2​-symmetric geometric retrograde orbit is not the unresolved step: Birkhoff's shooting argument supplies one in each bounded component for every 0<μ<10<\mu<10<μ<1 and every energy below L1(μ)L_1(\mu)L1​(μ) (Liu--Salomão, Theorem 5.1). The difficult assertion is global. One must produce a disk with the correct two-fold boundary behavior, prove transversality at every interior point, and prove that every other trajectory returns to it indefinitely in both time directions. Known proofs obtain these conclusions from convexity, dynamical convexity, and pseudo-holomorphic-curve machinery only in restricted parameter ranges (Joung--van Koert, Theorem 1.5; Liu--Salomão, Theorem 1.16).

Formalization scope

The Lean model uses total real-valued extensions of the displayed Hamiltonians, but every physical assertion carries explicit collision-free or denominator guards. The first critical value is initially an infimum; a separate theorem row proves nonemptiness, boundedness below, and attainment at an inner Lagrange point. The energy component is selected by a concrete regularized collision point, the physical mass range is strict, and the headline theorem assumes an actual Flow together with its Hamiltonian-generator and antipodal-equivariance properties. These choices prevent singular derivatives, an unintended component, an empty critical set, or an arbitrary dynamics from satisfying the goal vacuously.

The antipodal quotient in Lean is presently the topological quotient by the explicit deck relation. The formal rational-page predicate is therefore a cover-lift encoding: continuity, the real-action laws, exact quotient fibers, primeness, and global returns are stated downstairs, while smoothness, immersion, and transversality are stated on the Levi-Civita lift. It does not install a smooth atlas or explicit Moser coordinates on the quotient, and it asks for one rational page rather than a full open-book fibration. The theorem concerns one labeled primary; it does not simultaneously assert the analogous result on the other bounded component. The Hill limiting problem and the pointwise astronomical sign condition are not part of the headline conclusion.

All theorem rows are Lean declarations ending in by sorry. Successful elaboration verifies that the statements are syntactically and type-theoretically coherent; it is not evidence that the open theorem has been proved. Supporting rows isolate analytic facts, regularization identities, component geometry, quotient descent, the known retrograde-orbit theorem, and the parameter ranges already covered in the cited literature.

Selected references

  • G. D. Birkhoff, The restricted problem of three bodies, Rendiconti del Circolo Matematico di Palermo 39 (1915), 265--334. DOI.
  • U. Hryniewicz, Fast finite-energy planes in symplectizations and applications, Trans. Amer. Math. Soc. 364 (2012), 1859--1931. arXiv:0812.4076v8.
  • C. Joung and O. van Koert, Computational symplectic topology and symmetric orbits in the restricted three-body problem, Nonlinearity 38 (2025), 025015. arXiv:2407.19159v3.
  • L. Liu and P. A. S. Salomão, Finite energy foliations and global dynamics in the restricted three-body problem, arXiv:2506.17867v2 (25 May 2026). Preprint.
  • L. Liu and P. A. S. Salomão, Birkhoff conjecture and finite energy foliations in Hill's lunar problem, arXiv:2606.12912 (2026). Preprint.
338 thms8 active usersReviewed
Analysis·Captain: Lucas

Dynamics in One Complex Variable I: Sullivan's No Wandering Domains TheoremTextbook

Motivation

The iteration of a rational map f:C^→C^f:\hat{\mathbb C}\to\hat{\mathbb C}f:C^→C^ of the Riemann sphere is the model problem of holomorphic dynamics. The subject was founded by Fatou and Julia around 1918–1920, who split the sphere into a region of stable behaviour and a region of chaotic behaviour, and it was revived in the 1980s by Douady, Hubbard, Sullivan and Thurston. John Milnor's textbook Dynamics in One Complex Variable (3rd ed., Princeton, 2006) is the standard graduate introduction. This mission, the first of a series on the book, formalizes the chain of results that leads from Montel's theorem on normal families to Sullivan's theorem that rational maps have no wandering domains.

Timeline of the results formalized here:

  • 1912–1927, Montel. Families of holomorphic maps omitting three values are normal (Milnor, Theorem 3.7).
  • 1918–1920, Fatou and Julia. Definition of the Fatou and Julia sets; the Julia set of a map of degree d≥2d\ge2d≥2 is nonempty and equals the closure of the repelling periodic points (Milnor, Lemma 4.8 and Theorem 14.1).
  • 1920s–1942. Fatou classified the possible dynamics on an invariant Fatou component; Siegel (1942) showed that Siegel disks exist, and Herman (1979) constructed Herman rings. Together these give the four cases of Milnor's Theorem 16.1.
  • 1985, Sullivan. Every Fatou component is eventually periodic (Sullivan, Quasiconformal homeomorphisms and dynamics I, Ann. of Math. 122 (1985); Milnor, Theorem 16.4).

Setting

The Riemann sphere is C^=C∪{∞}\hat{\mathbb C}=\mathbb C\cup\{\infty\}C^=C∪{∞}, the one-point compactification of C\mathbb CC, with the two coordinates zzz (near finite points) and 1/z1/z1/z (near ∞\infty∞). A rational map is f=p/qf=p/qf=p/q with p,qp,qp,q coprime complex polynomials, q≠0q\neq0q=0; it acts on C^\hat{\mathbb C}C^ in the usual way, and its degree is d=max⁡(deg⁡p,deg⁡q)d=\max(\deg p,\deg q)d=max(degp,degq). Write f∘nf^{\circ n}f∘n for the nnn-th iterate.

A family of maps from an open set to C^\hat{\mathbb C}C^ is normal if every sequence in it has a subsequence converging locally uniformly in the spherical (chordal) metric. The Fatou set F(f)F(f)F(f) is the set of points having a neighbourhood on which the iterates {f∘n}\{f^{\circ n}\}{f∘n} form a normal family; the Julia set is its complement J(f)=C^∖F(f)J(f)=\hat{\mathbb C}\setminus F(f)J(f)=C^∖F(f). A Fatou component is a connected component of F(f)F(f)F(f). A periodic point z0=f∘m(z0)z_0=f^{\circ m}(z_0)z0​=f∘m(z0​) of minimal period mmm has multiplier λ=(f∘m)′(z0)\lambda=(f^{\circ m})'(z_0)λ=(f∘m)′(z0​), computed in a local coordinate; it is repelling if ∣λ∣>1|\lambda|>1∣λ∣>1 and attracting if ∣λ∣<1|\lambda|<1∣λ∣<1.

A Fatou component UUU with f(U)=Uf(U)=Uf(U)=U is a Siegel disk (resp. Herman ring) if f∣Uf|_Uf∣U​ is conformally conjugate to an irrational rotation of the unit disk (resp. of a round annulus {1<∣w∣<r}\{1<|w|<r\}{1<∣w∣<r}).

Formalization targets

Goal: no wandering domains (Theorem 16.4)

For a rational map fff of degree d≥2d\ge2d≥2 and every Fatou component UUU there are n≥0n\ge0n≥0, p≥1p\ge1p≥1 with

f∘p(f∘n(U))=f∘n(U).f^{\circ p}\bigl(f^{\circ n}(U)\bigr)=f^{\circ n}(U).f∘p(f∘n(U))=f∘n(U).

Milestones

  1. Lemma 2.5: C^∖{0,1,∞}\hat{\mathbb C}\setminus\{0,1,\infty\}C^∖{0,1,∞} is covered holomorphically by the unit disk.
  2. Corollary 3.3 (case D→C∖{0,1}\mathbb D\to\mathbb C\setminus\{0,1\}D→C∖{0,1}): holomorphic maps between hyperbolic surfaces form a normal family.
  3. Lemma 3.5 (case C∖{0,1}⊂C^\mathbb C\setminus\{0,1\}\subset\hat{\mathbb C}C∖{0,1}⊂C^).
  4. Theorem 3.7 (Montel): holomorphic maps from a domain to C^\hat{\mathbb C}C^ omitting three values form a normal family.
  5. Lemma 4.3: z∈J(f)  ⟺  f(z)∈J(f)z\in J(f)\iff f(z)\in J(f)z∈J(f)⟺f(z)∈J(f).
  6. Lemma 4.4: J(f∘k)=J(f)J(f^{\circ k})=J(f)J(f∘k)=J(f) for k>0k>0k>0.
  7. Lemma 4.8: J(f)≠∅J(f)\neq\emptysetJ(f)=∅ when d≥2d\ge2d≥2.
  8. Theorem 14.1: J(f)={repelling periodic points}‾J(f)=\overline{\{\text{repelling periodic points}\}}J(f)={repelling periodic points}​ when d≥2d\ge2d≥2.
  9. Theorem 16.1: an invariant Fatou component is an attracting basin, a parabolic basin, a Siegel disk or a Herman ring.

Significance

The results. Montel's theorem is the engine of the Fatou–Julia theory: nonemptiness of JJJ, density of iterated preimages and density of repelling cycles all rest on it. Theorem 14.1 identifies the non-normality locus with the closure of the repelling cycles, the form in which the Julia set is usually computed and pictured. Sullivan's theorem, combined with Theorem 16.1, gives a complete qualitative picture of the dynamics on the Fatou set; it is used throughout the later theory, e.g. to show that the Julia set of a postcritically finite map without superattracting cycles is the whole sphere (Milnor, Corollary 16.5).

Formalizing them. All results here are classical theorems with published proofs; none is open. A text search of Mathlib at the platform's pinned revision (0df444a) finds no Montel theorem for families of holomorphic maps, no Fatou or Julia sets and no wandering-domain results; it does contain the Schwarz lemma and the hyperbolic metric on the upper half-plane. The remaining work is to formalize the known proofs.

Difficulty

The early milestones need the uniformization-type input that C∖{0,1}\mathbb C\setminus\{0,1\}C∖{0,1} is covered by the disk (via the modular function or an equivalent construction) and Schwarz–Pick-type estimates on hyperbolic surfaces; Mathlib has the Schwarz lemma and the hyperbolic metric of the upper half-plane, but not the Poincaré metric of general hyperbolic domains or covering-space uniformization. Theorem 14.1 requires a quantitative use of Montel's theorem around points of JJJ that are not critical values. Theorem 16.1 needs the Denjoy–Wolff-type classification of self-maps of hyperbolic surfaces and the Snail Lemma for parabolic points. The goal is substantially harder: Sullivan's proof uses the measurable Riemann mapping theorem (Morrey–Ahlfors–Bers) to build an infinite-dimensional family of quasiconformal deformations of fff, contradicting the finite dimensionality of the space of rational maps of degree ddd. The theory of quasiconformal maps and Beltrami equations is absent from Mathlib, and no elementary argument avoiding it is known.

Formalization scope

All declarations live in the book-wide namespace MilnorDynamics and build on the published definition files MilnorDynamics_NormalFamilies, MilnorDynamics_RationalMaps and MilnorDynamics_PeriodicPoints; one new definition file, MilnorDynamics_FatouComponents, adds Fatou components, immediate basins, Siegel disks and Herman rings.

  • C^\hat{\mathbb C}C^ is OnePoint ℂ; a rational map is a structure of coprime polynomials p,qp,qp,q with q≠0q\ne0q=0, acting on OnePoint ℂ via RationalMap.toFun; the degree is max⁡(deg⁡p,deg⁡q)\max(\deg p,\deg q)max(degp,degq).
  • Holomorphy of a map into C^\hat{\mathbb C}C^ on an open U⊆CU\subseteq\mathbb CU⊆C is continuity plus complex differentiability in the charts zzz and 1/z1/z1/z (IsHolomorphicOn). Normality is locally uniform subconvergence in the chordal metric (IsNormalFamily); the Fatou set is defined through the standard charts of C^\hat{\mathbb C}C^.
  • Multipliers are derivatives of f∘mf^{\circ m}f∘m in the standard chart at the periodic point, mmm the minimal period.
  • Montel's theorem is stated for a domain U⊆CU\subseteq\mathbb CU⊆C rather than an arbitrary Riemann surface (normality is local, Milnor Problem 3-e); Lemma 2.5, Corollary 3.3 and Lemma 3.5 are linked in the special cases used for Montel's theorem.
  • The degree hypotheses are Milnor's: d≥1d\ge1d≥1 (nonconstant) in §4 Lemmas 4.3–4.4, d≥2d\ge2d≥2 elsewhere. Without d≥2d\ge2d≥2 several statements are false (e.g. J(z↦2z)=∅J(z\mapsto 2z)=\emptysetJ(z↦2z)=∅), so the hypothesis must not be dropped.

Welcome contributions: the Poincaré metric and Schwarz–Pick on hyperbolic domains, the modular covering of C∖{0,1}\mathbb C\setminus\{0,1\}C∖{0,1}, the degree theory of rational maps, quasiconformal maps and the measurable Riemann mapping theorem. These are reusable far beyond this mission.

Selected references

  • J. Milnor, Dynamics in One Complex Variable, 3rd ed., Annals of Mathematics Studies 160, Princeton University Press, 2006. https://doi.org/10.1515/9781400835539
  • D. Sullivan, Quasiconformal homeomorphisms and dynamics I. Solution of the Fatou–Julia problem on wandering domains, Ann. of Math. 122 (1985), 401–418. https://doi.org/10.2307/1971308
  • L. Carleson and T. W. Gamelin, Complex Dynamics, Universitext, Springer, 1993. https://doi.org/10.1007/978-1-4612-4364-9
  • P. Montel, Leçons sur les familles normales de fonctions analytiques et leurs applications, Gauthier-Villars, Paris, 1927.
49 thms5 active usersReviewed
AnalysisTopology·Captain: Lucas

Local Connectivity of the Mandelbrot Set (MLC)Open Problem

The set

For a complex parameter ccc, iterate the quadratic map

fc(z)=z2+cf_c(z) = z^2 + cfc​(z)=z2+c

starting at the critical point z=0z = 0z=0. The Mandelbrot set is the set of parameters for which this orbit stays bounded:

M={ c∈C : sup⁡k∈N∣fc k(0)∣<∞ }.M = \{\, c \in \mathbb{C} \ : \ \sup_{k \in \mathbb{N}} \left| f_c^{\,k}(0) \right| < \infty \,\}.M={c∈C : k∈Nsup​​fck​(0)​<∞}.

Equivalently -- and this is the first milestone of the mission -- c∈Mc \in Mc∈M if and only if ∣fc k(0)∣≤2|f_c^{\,k}(0)| \le 2∣fck​(0)∣≤2 for every kkk, which exhibits MMM as a compact subset of the plane.

MMM is the parameter-space picture of the simplest non-trivial family in complex dynamics, and it acts as a dictionary: the shape of MMM near a parameter ccc encodes the dynamics of fcf_cfc​ on its Julia set, so structural questions about MMM are questions about the whole quadratic family at once. Douady and Hubbard proved in 1982 that MMM is connected, by exhibiting a conformal isomorphism

Φ:C∖M⟶C∖D‾\Phi : \mathbb{C} \setminus M \longrightarrow \mathbb{C} \setminus \overline{\mathbb{D}}Φ:C∖M⟶C∖D

between the complement of MMM and the exterior of the closed unit disk.

The question

MLC conjecture. MMM is locally connected: every point of MMM has a neighbourhood basis, in the subspace topology, consisting of connected sets.

By Caratheodory's theorem, MLC is equivalent to the statement that Φ−1\Phi^{-1}Φ−1 extends continuously to the unit circle. That extension would deliver a complete combinatorial description of MMM -- the pinched disk model of Douady and Thurston -- in which every boundary point is labelled by the external rays landing on it. Two headline consequences follow: the density of hyperbolicity in the quadratic family (Fatou's conjecture: every quadratic polynomial can be perturbed to one with an attracting cycle), and zero area for ∂M\partial M∂M.

MLC has been open since the early 1980s and is regarded as the central problem of one-dimensional complex dynamics.

Timeline

  • 1982 -- Douady and Hubbard prove that MMM is connected, via the Boettcher uniformisation of its complement, and formulate MLC.
  • 1984/85 -- The Orsay notes develop the combinatorics of external rays and the pinched-disk model, and show that MLC implies the density of hyperbolicity in the quadratic family.
  • 1990 -- Yoccoz proves MLC at every finitely renormalizable parameter without an indifferent periodic point, introducing the Yoccoz puzzle and the rigidity techniques that dominate later work.
  • 1997 -- Lyubich extends local connectivity to infinitely renormalizable parameters of bounded type, using complex bounds for quadratic-like renormalization.
  • 1997 -- Graczyk-Swiatek and Lyubich prove density of hyperbolicity in the real quadratic family.
  • 1998 -- Shishikura proves that ∂M\partial M∂M has Hausdorff dimension 222, by parabolic implosion. Whether ∂M\partial M∂M has positive area remains open.
  • 2005 -- Buff and Cheritat construct quadratic Julia sets of positive area, showing that the analogous area question in the dynamical plane has a negative answer.
  • Today -- MLC is known at large classes of parameters, but the general case, and with it the density of hyperbolicity, remain open.

What this mission asks for

The goal theorem is MLC itself, in the form "the Mandelbrot set, as a topological subspace of C\mathbb{C}C, is a locally connected space".

The milestones are of three kinds, and are ordered accordingly:

  1. Foundations provable today -- the escape criterion (in the quadratic and the general unicritical degree) and compactness. These make the filter-theoretic definition usable and are the natural entry point for a solver new to the mission.
  2. Known theorems from the literature -- connectedness of MMM (Douady-Hubbard), the implication MLC ⇒\Rightarrow⇒ density of hyperbolicity (Douady-Hubbard), and dim⁡H(∂M)=2\dim_H(\partial M) = 2dimH​(∂M)=2 (Shishikura). These are hard but settled, and formalizing them builds the infrastructure -- Boettcher coordinates, external rays, parabolic implosion -- that any attack on the goal will need.
  3. The open companions -- density of hyperbolicity in the quadratic and unicritical families, zero area of ∂M\partial M∂M, and MLC for all Multibrot sets MnM_nMn​, the parameter sets of z↦zn+cz \mapsto z^n + cz↦zn+c.

All statements are phrased against a single shared definition file, so a solver can move between milestones without re-fixing conventions.

24 thms4 active usersReviewed
Group TheoryProbability·Captain: dbenbenn

Is the group IET of interval exchange transformations amenable?Open Problem

This mission formalizes the question whether the group IET\mathrm{IET}IET of interval exchange transformations is amenable, Question 1.6 of Juschenko, Matte Bon, Monod and de la Salle, Extensive amenability and an application to interval exchanges, Ergodic Theory Dynam. Systems 38 (2018) 195–219, p. 4 (doi:10.1017/etds.2016.32), together with the landmark results of the literature on the question.

Motivation

An interval exchange transformation cuts the circle R/Z\mathbf R/\mathbf ZR/Z into finitely many arcs and puts them back in a different order. These maps model the dynamics of polygonal billiards with rational angles, and since Katok–Stepin (1967) and Keane (1975) they have been a central object of ergodic theory. Under composition they form a group, IET\mathrm{IET}IET. Two questions about this group are open: whether it contains a non-abelian free subgroup (Katok's question), and whether it is amenable, that is, whether it carries a finitely additive, translation-invariant probability measure on all of its subsets. Amenability would answer Katok's question in the negative, since an amenable group has no non-abelian free subgroup.

Timeline.

  • 1967: Katok and Stepin first consider exchanges of three or more intervals (JMMS, p. 4).
  • 1975: Keane introduces interval exchange transformations systematically and the terminology (doi:10.1007/BF01236981).
  • 2009: Novak shows that cyclic subgroups of IET\mathrm{IET}IET are undistorted (doi:10.3934/jmd.2009.3.379).
  • 2013: Dahmani, Fujiwara and Guirardel show that two generic interval exchange transformations do not generate a free group (doi:10.4171/GGD/209).
  • 2013: Juschenko and Monod prove that the topological full group of every minimal Cantor system is amenable, which gives the first finitely generated infinite simple amenable groups (doi:10.4007/annals.2013.178.2.7). The technical core is the case X=ZX = \mathbf ZX=Z of the lamplighter question for the wobbling group below (Juschenko–de la Salle, p. 2).
  • 2013: de Cornulier's Bourbaki exposé records that “La question de la moyennabilité du groupe entier IET est ouverte” (p. 1064-04; published 2014, arXiv:2002.09342).
  • 2013: Juschenko, Nekrashevych and de la Salle prove that recurrent actions are extensively amenable (arXiv 2013; published 2016, doi:10.1007/s00222-016-0664-6).
  • 2013: Juschenko and de la Salle prove that the lamplighter action of the wobbling group of a recurrent metric space of bounded geometry, for instance Z\mathbf ZZ or Z2\mathbf Z^2Z2, is amenable, and that it is not when the space contains a Lipschitz injective image of the binary tree; the case Zd\mathbf Z^dZd, d≥3d \ge 3d≥3, is left open (arXiv 2013; published 2015, doi:10.36045/bbms/1432840864).
  • 2015: Juschenko, Matte Bon, Monod and de la Salle introduce extensive amenability of group actions, show that a subgroup of IET\mathrm{IET}IET is amenable if and only if its action on R/Z\mathbf R/\mathbf ZR/Z is extensively amenable, prove that every subgroup of rational rank at most 222 is amenable, and show that finitely supported random walks are Liouville in rank 111 and are not in rank at least 333 (arXiv 2015; published 2018, doi:10.1017/etds.2016.32).
  • 2017: Dahmani, Fujiwara and Guirardel prove that every finitely generated torsion-free solvable subgroup of IET\mathrm{IET}IET is virtually abelian (arXiv 2017; published 2020, doi:10.5802/afst.1641).
  • 2018: Garban shows that the action of the wobbling group of a bounded degree graph is diffuse-extensively amenable if and only if the graph is recurrent, and conjectures that W(Zd)↷ZdW(\mathbf Z^d) \curvearrowright \mathbf Z^dW(Zd)↷Zd is not extensively amenable for d≥3d \ge 3d≥3 (arXiv 2018; published 2020, doi:10.4171/GGD/567).
  • 2026: Guelman and Liousse record (p. 2) that “there is no known example of non amenable or torsion-free non virtually abelian finitely generated iet-group” (arXiv:2601.23054). The question remains open as of 2026.

Setting

Write R/Z\mathbf R/\mathbf ZR/Z for the circle (UnitAddCircle). A permutation ggg of R/Z\mathbf R/\mathbf ZR/Z is an interval exchange transformation (IntervalExchange.IsIntervalExchange g) when it is right-continuous, has finitely many points of discontinuity, and has finitely many angles g(x)−xg(x) - xg(x)−x. Equivalently, ggg cuts the circle into finitely many half-open arcs and translates each of them. The group IET\mathrm{IET}IET (IntervalExchange.IET) is the subgroup of permutations of R/Z\mathbf R/\mathbf ZR/Z that they generate; a milestone states that it consists of the interval exchange transformations themselves. For a subgroup G≤IETG \le \mathrm{IET}G≤IET, the angle group Λ(G)\Lambda(G)Λ(G) (angleGroup G) is the subgroup of R/Z\mathbf R/\mathbf ZR/Z generated by all angles of elements of GGG, and the rational rank rkQ\mathrm{rk}_{\mathbf Q}rkQ​ (rationalRank) of a subgroup of R/Z\mathbf R/\mathbf ZR/Z is the supremum of the ddd such that Zd\mathbf Z^dZd embeds in it. For a subgroup Λ\LambdaΛ of R/Z\mathbf R/\mathbf ZR/Z, IET(Λ)\mathrm{IET}(\Lambda)IET(Λ) (IETOf Λ) consists of the elements of IET\mathrm{IET}IET all of whose angles lie in Λ\LambdaΛ.

A mean on a set SSS is a function mmm from the subsets of SSS to [0,∞][0, \infty][0,∞] with m(∅)=0m(\emptyset) = 0m(∅)=0, m(A∪B)=m(A)+m(B)m(A \cup B) = m(A) + m(B)m(A∪B)=m(A)+m(B) for disjoint A,BA, BA,B, and m(S)=1m(S) = 1m(S)=1. A group GGG is amenable (Garrido.IsAmenable G) when it carries a mean with m(gA)=m(A)m(gA) = m(A)m(gA)=m(A) for all g∈Gg \in Gg∈G and A⊆GA \subseteq GA⊆G. An action of GGG on a set XXX is amenable (IsAmenableAction G X) when XXX carries a GGG-invariant mean, and extensively amenable (IsExtensivelyAmenable G X) when the finite subsets of XXX carry a GGG-invariant mean that, for each finite E0⊆XE_0 \subseteq XE0​⊆X, gives full weight to the finite sets containing E0E_0E0​.

The milestones use further notions, defined precisely in the definitions item and in their own statements:

  • A finitely supported probability measure μ\muμ on GGG drives the left random walk gn=hn⋯h1g_n = h_n \cdots h_1gn​=hn​⋯h1​; the inverted orbit of x0∈Xx_0 \in Xx0​∈X is On={x0,g1−1x0,…,gn−1x0}O_n = \{x_0, g_1^{-1}x_0, \dots, g_n^{-1}x_0\}On​={x0​,g1−1​x0​,…,gn−1​x0​}. The action is recurrent (IsRecurrentAction) when for every symmetric such μ\muμ and every x0x_0x0​, the induced walk gnx0g_n x_0gn​x0​ returns to x0x_0x0​ with probability 111.
  • For a functor FFF from finite sets with injections to amenable groups, F(X)F(X)F(X) (extend F X) is its extension to an arbitrary set XXX by direct limits, and an action of GGG on XXX gives the semidirect product F(X)⋊GF(X) \rtimes GF(X)⋊G (FunctorProduct F G X) acting on F(X)F(X)F(X). The lamplighter case is F(X)=(Z/2Z)(X)F(X) = (\mathbf Z/2\mathbf Z)^{(X)}F(X)=(Z/2Z)(X) (Lamplighter G X).
  • The wobbling group W(X)W(X)W(X) (wobbling X) of a metric space XXX consists of the permutations ggg of XXX with sup⁡xd(x,gx)<∞\sup_x d(x, gx) < \inftysupx​d(x,gx)<∞.

Formalization targets

Goal

IsAmenable(IET).\mathrm{IsAmenable}(\mathrm{IET}).IsAmenable(IET).

The question is open. A proof settles it positively and, through von Neumann's theorem, answers Katok's question in the negative; a disproof shows that IET\mathrm{IET}IET is not amenable.

Landmarks

The milestones are results from the literature, stated as their sources state them. From Juschenko–Matte Bon–Monod–de la Salle: IET\mathrm{IET}IET is a group (p. 4); Lemmas 2.1 and 2.2 on extensive amenability; Theorem 1.3 and Corollary 1.4, the functorial criterion; Proposition 5.3, that a subgroup of IET\mathrm{IET}IET is amenable if and only if its action on R/Z\mathbf R/\mathbf ZR/Z is extensively amenable; Proposition 4.1 and Lemma 4.3, the inverted-orbit reformulations; Theorem 4.2, recurrence implies extensive amenability; Lemma 5.2 and Theorems 5.1 and 1.9, amenability in rational rank at most 222; and Theorem 1.10, the Liouville dichotomy, with the steps of its proof: Lemma 5.10, Proposition 5.11 with Lemma 5.13 (realizing IET(Λ;Σ)\mathrm{IET}(\Lambda; \Sigma)IET(Λ;Σ) as the topological full group of a minimal subshift of polynomial complexity), and Matte Bon's theorem for virtually cyclic groups. The external results these proofs cite are milestones too: Kesten's criterion for a graph (Woess, Theorem 10.6), Lyons–Peres Theorem 2.17 on rough embeddings, Pólya's theorem (already proved on the platform as MarkovMixing.polya_recurrence), the Baldi–Lohoué–Peyrière comparison lemma, and Matte Bon's Theorem 1.2 on topological full groups of subshifts of slow complexity. From Juschenko–de la Salle: Theorem 1.4 on the wobbling group, with coarse embeddings defined by non-decreasing control functions.

Two further open statements

Garban's question, whether W(Zd)↷ZdW(\mathbf Z^d) \curvearrowright \mathbf Z^dW(Zd)↷Zd is extensively amenable for every ddd, and Question 1.11 of Juschenko–Matte Bon–Monod–de la Salle, whether a polynomially growing Schreier graph forces extensive amenability, are stated as open milestones. Each comes with a milestone stating that a positive answer implies the goal.

Significance

The result. A proof would make IET\mathrm{IET}IET a natural amenable group containing, by Juschenko–Monod and Juschenko–Matte Bon–Monod–de la Salle, finitely generated infinite simple amenable groups, and would answer Katok's question. A disproof would give the first non-amenable finitely generated group of interval exchange transformations; by Theorem 1.9 it would have rational rank at least 333.

Formalizing it. The definitions of extensive amenability, of the functorial semidirect products F(X)⋊GF(X) \rtimes GF(X)⋊G, of inverted orbits and recurrent actions, and of wobbling groups are reusable beyond this mission, as are the external probabilistic results (Kesten's criterion, rough embeddings and recurrence). Pólya's theorem is already formalized and proved on the platform (MarkovMixing.polya_recurrence). None of the other landmarks is formalized.

Difficulty

Every known amenability proof for subgroups of IET\mathrm{IET}IET passes through Proposition 5.3 and then needs extensive amenability of the action on the circle. The available criterion for extensive amenability is recurrence of the Schreier graphs, which embed into lattices Zd\mathbf Z^dZd with ddd the rational rank; for d≥3d \ge 3d≥3 these graphs can be transient, so recurrence is unavailable. Garban's theorem shows that the natural strengthening of extensive amenability fails for all transient wobbling actions, and Theorem 1.10 shows that the Liouville route fails in rank at least 333.

Formalization scope

R/Z\mathbf R/\mathbf ZR/Z is UnitAddCircle, and permutations act on it by evaluation. IET\mathrm{IET}IET is defined as the subgroup generated by the interval exchange transformations, so that its group structure needs no proof inside the definitions; a milestone states that nothing else lies in it. The source's precise definition (“a right-continuous permutation ggg of R/Z\mathbf R/\mathbf ZR/Z such that the set {gx−x,x∈R/Z}\{gx - x, x \in \mathbf R/\mathbf Z\}{gx−x,x∈R/Z}, called the set of angles of ggg, is finite”) is read together with its opening phrase, “cutting this circle into finitely many intervals”, so the definition also requires finitely many points of discontinuity: without that requirement a right-continuous permutation with two angles can have infinitely many discontinuities, and the cocycle of Proposition 5.3 would not be finitely supported. Means take values in [0,∞][0, \infty][0,∞] and are normalized to total mass 111. Random walks have finitely supported step distributions μ:G→0R\mu : G \to_0 \mathbf Rμ:G→0​R where the sources say “finitely supported”, and probabilities of events of a walk are finite sums over the step sequences. Recurrence of a Markov chain is return to the starting point with probability 111, expressed through first-return probabilities. Functors I→AmenI \to \mathrm{Amen}I→Amen are Mathlib functors from the wide subcategory of FintypeCat on the injective maps to GrpCat with amenable values, extended to a set XXX by the filtered colimit over its finite subsets.

The goal admits no trivializing reading: IET\mathrm{IET}IET contains the irrational rotations and the non-rotation exchanges, and Garrido.IsAmenable is the standard notion. The external milestones (Kesten, Lyons–Peres, Baldi–Lohoué–Peyrière) are cited results, stated in the form the sources apply; proofs of them are welcome contributions in their own right.

Selected references

  • K. Juschenko, N. Matte Bon, N. Monod and M. de la Salle, Extensive amenability and an application to interval exchanges, Ergodic Theory Dynam. Systems 38 (2018) 195–219, doi:10.1017/etds.2016.32, arXiv:1503.04977.
  • K. Juschenko and M. de la Salle, Invariant means for the wobbling group, Bull. Belg. Math. Soc. Simon Stevin 22 (2015) 281–290, doi:10.36045/bbms/1432840864.
  • K. Juschenko, V. Nekrashevych and M. de la Salle, Extensions of amenable groups by recurrent groupoids, Invent. Math. 206 (2016) 837–867, doi:10.1007/s00222-016-0664-6.
  • K. Juschenko and N. Monod, Cantor systems, piecewise translations and simple amenable groups, Ann. of Math. 178 (2013) 775–787, doi:10.4007/annals.2013.178.2.7.
  • C. Garban, Inverted orbits of exclusion processes, diffuse-extensive-amenability, and (non-?)amenability of the interval exchanges, Groups Geom. Dyn. 14 (2020) 871–897, doi:10.4171/GGD/567.
  • Y. de Cornulier, Groupes pleins-topologiques [d'après Matui, Juschenko, Monod, ...], Séminaire Bourbaki, exposé 1064, Astérisque 361 (2014) 183–223, arXiv:2002.09342.
  • F. Dahmani, K. Fujiwara and V. Guirardel, Free groups of interval exchange transformations are rare, Groups Geom. Dyn. 7 (2013) 883–910, doi:10.4171/GGD/209.
  • F. Dahmani, K. Fujiwara and V. Guirardel, Solvable groups of interval exchange transformations, Ann. Fac. Sci. Toulouse Math. 29 (2020) 595–618, doi:10.5802/afst.1641.
  • M. Keane, Interval exchange transformations, Math. Z. 141 (1975) 25–31, doi:10.1007/BF01236981.
  • C. F. Novak, Discontinuity-growth of interval-exchange maps, J. Mod. Dyn. 3 (2009) 379–405, doi:10.3934/jmd.2009.3.379.
  • R. Lyons and Y. Peres, Probability on Trees and Networks, Cambridge University Press, 2016, doi:10.1017/9781316672815.
  • W. Woess, Random Walks on Infinite Graphs and Groups, Cambridge University Press, 2000, doi:10.1017/CBO9780511470967.
  • N. Matte Bon, Subshifts with slow complexity and simple groups with the Liouville property, Geom. Funct. Anal. 24 (2014) 1637–1659, doi:10.1007/s00039-014-0293-4.
  • P. Baldi, N. Lohoué and J. Peyrière, Sur la classification des groupes récurrents, C. R. Acad. Sci. Paris Sér. A–B 285 (1977) A1103–A1104 (no DOI).
  • N. Guelman and I. Liousse, Some elementary amenable subgroups of interval exchange transformations, arXiv:2601.23054 (2026).
33 thms3 active usersReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Stability and Instability of Fluid Models for Reentrant Lines 4: The Lu–Kumar Network Has an Unstable Work-Conserving Fluid Model iff m₂ + m₄ ≥ 1Research Paper

Motivation

A reentrant line is a queueing network in which every customer follows one fixed route but may return to a station after visiting another one. A manufacturing line can have this pattern when a product revisits the same machine at different processing stages. A station can then have little nominal workload and still face unstable queues under an unfortunate service order. Dai and Weiss studied this gap between nominal capacity and fluid stability for reentrant lines in their 1996 paper. The four-class line associated with Lu and Kumar is their sharp example: its behavior changes at a simple cross-station inequality that is different from either station's ordinary workload constraint.

The paper establishes several positive stability results for other disciplines and networks, then gives an exact boundary for the Lu–Kumar line. Here the exact boundary is the focus. The result concerns fluid models, deterministic large-scale approximations of queue trajectories. It does not assert positive Harris recurrence or transience of the underlying stochastic network in both directions. The paper cites Dai's earlier implication from a stable fluid model to a stable stochastic discipline, but the converse was still open in its concluding discussion (Dai and Weiss 1996, pp. 119 and 133).

Setting

There are four customer classes, encountered in order 1→2→3→41\to2\to3\to41→2→3→4. Classes 111 and 444 use station 111; classes 222 and 333 use station 222. Each class kkk has a positive mean service time mkm_kmk​ and service rate μk=1/mk\mu_k=1/m_kμk​=1/mk​. The external arrival rate is normalized to one. The nominal workloads are ρ1=m1+m4\rho_1=m_1+m_4ρ1​=m1​+m4​ and ρ2=m2+m3\rho_2=m_2+m_3ρ2​=m2​+m3​, both assumed strictly below one. These assumptions say that each station has enough average capacity for its own stages, but they leave the scheduling decision unresolved.

At time ttt, Qk(t)≥0Q_k(t)\ge0Qk​(t)≥0 is the amount of class-kkk fluid, and Tk(t)T_k(t)Tk​(t) is the cumulative service time devoted to that class. The fluid equations balance the inflow and outflow of each class. Outside fluid enters class 111 at unit rate; completion of class kkk feeds class k+1k+1k+1 until class 444 exits. Service times and idle times are nondecreasing, and a station's idle time can increase only when its total queue content is zero. A pair (Q,T)(Q,T)(Q,T) with these properties is a work-conserving fluid solution.

The Lu–Kumar priority discipline gives class 444 priority over class 111 at station 111, and class 222 priority over class 333 at station 222. Its fluid model adds the priority complementarity condition: service capacity available to a priority prefix can be unused only when that prefix has no immediate workload. For either model, fluid stability means that some common time δ>0\delta>0δ>0 empties every admissible solution with ∑kQk(0)=1\sum_kQ_k(0)=1∑k​Qk​(0)=1, with all queues remaining zero for t≥δt\ge\deltat≥δ. Instability is the negation of this statement; it does not require every solution to diverge.

Formalization targets

Exact threshold

Theorem 5.1 and Remark 1 give two connected classifications, under mk>0m_k>0mk​>0, ρ1<1\rho_1<1ρ1​<1, and ρ2<1\rho_2<1ρ2​<1:

¬FluidStable⁡(all work-conserving solutions)⟺m2+m4≥1,\neg\operatorname{FluidStable}(\text{all work-conserving solutions}) \quad\Longleftrightarrow\quad m_2+m_4\ge1,¬FluidStable(all work-conserving solutions)⟺m2​+m4​≥1, ¬FluidStable⁡(Lu–Kumar priority solutions)⟺m2+m4≥1.\neg\operatorname{FluidStable}(\text{Lu–Kumar priority solutions}) \quad\Longleftrightarrow\quad m_2+m_4\ge1.¬FluidStable(Lu–Kumar priority solutions)⟺m2​+m4​≥1.

The first clause captures the paper's existence of an unstable work-conserving policy: on the unstable side, the named priority discipline supplies one; on the other side, every work-conserving fluid model is stable. The second clause records the particular policy classification stated in Remark 1. Equality belongs to the unstable side: the paper exhibits a periodic nonempty solution there (Dai and Weiss 1996, pp. 125–127).

Supporting targets

The milestones follow the paper's own statements and proof claims. The real-analysis extinction criterion of Lemma 2.2(ii) and the maximum-of-components criterion of Lemma 3.2 provide the stability language. Display (3.2), already available as a proved platform theorem, identifies the derivative of an attained maximum at a regular point. The priority condition (4.4) implies the ordinary work-conserving condition (1.13). The unstable half records one first cycle, one solution with every scaled cycle, and instability of the priority model. The stable half records the authors' explicit parameter choice, the two linear Lyapunov conditions, and stability of every work-conserving fluid solution.

Significance

The threshold says that the two station-load inequalities alone do not characterize stability of all work-conserving service orders. The extra inequality m2+m4<1m_2+m_4<1m2​+m4​<1 determines when the entire work-conserving fluid class is stable; its failure admits a concrete priority discipline with a nonempty trajectory. At the boundary m2+m4=1m_2+m_4=1m2​+m4​=1, growth need not be strict: periodic fluid behavior already defeats finite-time stability. The result therefore distinguishes the paper's global stability region from the larger parameter region in which both stations are nominally underloaded (Dai and Weiss 1996, Remark 1, p. 125).

A machine-checked development would give reusable definitions for a four-stage reentrant fluid model, its priority complementarity condition, and the precise unit-initial-state notion of stability. The local Lean statements in this proposal compile, but their proofs remain open. The published maximum-derivative fact is the one already proved platform component used by this mission. The other milestones identify the mathematical work needed to formalize the known 1996 result, rather than presenting the result as a new open conjecture.

Difficulty

The ordinary load test ρi<1\rho_i<1ρi​<1 controls how much service each station needs on average, but it does not control which class receives service when several buffers at a station are nonempty. In the Lu–Kumar priority discipline, serving a high-priority downstream class changes the future arrival pattern seen by the other station. Thus a direct argument from ρ1<1\rho_1<1ρ1​<1 and ρ2<1\rho_2<1ρ2​<1 to queue extinction fails. On the stable side, checking a single station's workload is also insufficient: its content may fall while earlier-stage fluid continues to feed it. The paper formulates two linear components and a finite maximum; the challenge is to obtain a uniform negative drift whenever that maximum is positive, including times when one station is empty and the other determines the active component (Dai and Weiss 1996, pp. 126–128).

Formalization scope

Classes and stations are Fin 4 and Fin 2, with zero-based Lean indices: paper class kkk is Lean index k−1k-1k−1. The fixed station map is (0,1,1,0)(0,1,1,0)(0,1,1,0). Service times remain real parameters with explicit positivity hypotheses. Paths are total functions of real time, while equations and conclusions apply only on t≥0t\ge0t≥0. The external arrival rate is one, and initial size is the sum ∑kQk(0)\sum_kQ_k(0)∑k​Qk​(0), since class contents are nonnegative. The nominal-load assumptions are the two strict inequalities in (5.1). The named priority ranking is a permutation; it encodes only the station-local comparisons that matter.

Conditions (1.13) and (4.4), printed as complementarity or “increases only when empty,” use an equivalent interval-constancy condition in Lean. No extra Lipschitz or continuity assumption is placed on solutions: the fluid equations and monotone capacity constraints are intended to supply that regularity. Derivatives at regular points are represented with HasDerivAt. Lemma 2.2(ii) uses the non-strict bound g˙≤−ε\dot g\le-\varepsilong˙​≤−ε, the version used by the paper's applications, although its displayed hypothesis prints g˙<−ε\dot g<-\varepsilong˙​<−ε. The p. 127 line involving G1G_1G1​ prints (1−θ2)Q4(1-\theta_2)Q_4(1−θ2​)Q4​; (5.3) fixes the intended coefficient as (1−θ1)Q4(1-\theta_1)Q_4(1−θ1​)Q4​.

The goal uses Definition 1.3 exactly: one uniform emptying time for all solutions of unit initial content. An impossible solution predicate, or an instability claim that only asks for a nonzero state at time zero, would not represent the paper's theorem. The mission needs finite-index sum and maximum infrastructure, absolute continuity and almost-everywhere differentiation on nonnegative time, plus elementary algebra of service rates and the cycle scaling. These components can be reused in later fluid-network missions. Contributions that preserve the source's hypotheses and boundary case are welcome.

Selected references

  • J. G. Dai and G. Weiss, Stability and instability of fluid models for reentrant lines, Mathematics of Operations Research 21(1), 115–134, 1996. DOI: 10.1287/moor.21.1.115.
14 thms3 active usersReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Stability and Instability of Fluid Models for Reentrant Lines 5: Without Immediate Feedback, Every Work-Conserving Fluid Model of a Two-Station Kelly-Type Line Is StableResearch Paper

Motivation

A multiclass queueing network can be unstable even when every station has enough capacity on average: the queue lengths grow without bound although each server's nominal load is below one. Kumar and Seidman, Lu and Kumar (1991) and Rybko and Stolyar (1992) exhibited such networks under simple priority disciplines. This raised the question of which networks are stable under every reasonable policy, and which policies are stable in every network. Dai (1995) reduced the stability of a queueing network to the stability of its deterministic fluid model, so that the question becomes one about solutions of a system of linear equations and inequalities.

Dai and Weiss (1996) use this reduction to study reentrant lines, the model of semiconductor wafer fabrication in which a single route visits the same machines many times. Section 6 of their paper treats Kelly-type lines, in which every visit to a station has the same mean service time. Kelly (1979) showed that such networks with exponential service times are stable under FIFO and have a product-form stationary distribution. Theorem 6.1 shows that with two stations, and a route that never visits the same station twice in a row, stability holds under every work-conserving policy, not only FIFO. This mission formalizes that theorem.

Setting

A reentrant line has stations 1,…,I1,\dots,I1,…,I and classes 1,…,K1,\dots,K1,…,K. Fluid enters class 111 at rate 111, moves from class kkk to class k+1k+1k+1 on service, and leaves after class KKK. Class kkk is served at station σ(k)\sigma(k)σ(k) with mean service time mk>0m_k > 0mk​>0 and rate μk=1/mk\mu_k = 1/m_kμk​=1/mk​. The constituency of station iii is Ci={k:σ(k)=i}C_i = \{k : \sigma(k) = i\}Ci​={k:σ(k)=i} and its nominal workload is ρi=∑k∈Cimk\rho_i = \sum_{k\in C_i} m_kρi​=∑k∈Ci​​mk​. The traffic condition (1.7) is ρi<1\rho_i < 1ρi​<1 for every iii.

A fluid model solution is a pair (Q,T)(Q, T)(Q,T): Qk(t)≥0Q_k(t) \ge 0Qk​(t)≥0 is the fluid in class kkk at time ttt and Tk(t)T_k(t)Tk​(t) the cumulative service time given to class kkk by time ttt. They satisfy, for t≥0t \ge 0t≥0,

Qk(t)=Qk(0)+μk−1Tk−1(t)−μkTk(t)(μ0T0(t)=t),Q_k(t) = Q_k(0) + \mu_{k-1}T_{k-1}(t) - \mu_k T_k(t) \quad (\mu_0 T_0(t) = t),Qk​(t)=Qk​(0)+μk−1​Tk−1​(t)−μk​Tk​(t)(μ0​T0​(t)=t),

Tk(0)=0T_k(0) = 0Tk​(0)=0 with TkT_kTk​ nondecreasing, and the idle time Ui(t)=t−Bi(t)U_i(t) = t - B_i(t)Ui​(t)=t−Bi​(t), where Bi(t)=∑k∈CiTk(t)B_i(t) = \sum_{k\in C_i} T_k(t)Bi​(t)=∑k∈Ci​​Tk​(t), is nondecreasing. The solution is work-conserving if UiU_iUi​ increases only at times when station iii holds no fluid. The immediate volume of station iii is Wi(t)=∑k∈CimkQk(t)W_i(t) = \sum_{k \in C_i} m_k Q_k(t)Wi​(t)=∑k∈Ci​​mk​Qk​(t).

The line is of Kelly type with station means β1,…,βI\beta_1, \dots, \beta_Iβ1​,…,βI​ if mk=βσ(k)m_k = \beta_{\sigma(k)}mk​=βσ(k)​ for every class kkk. Its routing has no immediate feedback if σ(k+1)≠σ(k)\sigma(k+1) \ne \sigma(k)σ(k+1)=σ(k) for every k<Kk < Kk<K. A set of fluid solutions is stable (Definition 1.3) if there is a δ>0\delta > 0δ>0 such that every solution in the set with ∣Q(0)∣=∑kQk(0)=1|Q(0)| = \sum_k Q_k(0) = 1∣Q(0)∣=∑k​Qk​(0)=1 is empty from time δ\deltaδ on.

Formalization targets

Goal: Theorem 6.1

For a two-station Kelly-type reentrant line without immediate feedback that satisfies (1.7), the work-conserving fluid model is stable: there is δ>0\delta > 0δ>0 with

∑kQk(0)=1 ⟹ Qk(t)=0for all t≥δ, k=1,…,K,\sum_k Q_k(0) = 1 \ \Longrightarrow\ Q_k(t) = 0 \quad \text{for all } t \ge \delta,\ k = 1,\dots,K,k∑​Qk​(0)=1 ⟹ Qk​(t)=0for all t≥δ, k=1,…,K,

for every work-conserving fluid solution (Q,T)(Q,T)(Q,T). The number of classes KKK is arbitrary, of either parity, and the route may start at either station.

Milestones

The milestones follow the proof on p. 130 and the two general lemmas it uses: the extinction criterion of Lemma 2.2 (ii); the derivative of a maximum at an active index, display (3.2), already proved on the platform; the piecewise-linear Lyapunov Lemma 3.2; the drift identity Gi(t)=Gi(0)+∣Ci∣t−Bi(t)/βiG_i(t) = G_i(0) + |C_i|t - B_i(t)/\beta_iGi​(t)=Gi​(0)+∣Ci​∣t−Bi​(t)/βi​ for Gi=∑k∈CiQk+G_i = \sum_{k\in C_i} Q_k^+Gi​=∑k∈Ci​​Qk+​, with Qk+=∑l≤kQlQ_k^+ = \sum_{l\le k} Q_lQk+​=∑l≤k​Ql​; the comparison Wi(t)=0⇒Gi(t)≤Gj(t)W_i(t) = 0 \Rightarrow G_i(t) \le G_j(t)Wi​(t)=0⇒Gi​(t)≤Gj​(t); and the verification that G1,G2G_1, G_2G1​,G2​ meet the hypotheses of Lemma 3.2 with εi=1/βi−∣Ci∣\varepsilon_i = 1/\beta_i - |C_i|εi​=1/βi​−∣Ci​∣.

Significance

The result. Theorem 6.1 gives a class of networks in which stability needs no knowledge of the scheduling policy: any policy that never idles a server with work waiting is stable whenever the nominal loads are below one. For queueing networks this is the property usually called global stability. Through Theorem 1.1 of the paper (Dai 1995, Theorem 4.3) the fluid statement implies positive Harris recurrence of the corresponding multiclass queueing network under every work-conserving head-of-the-line policy. The paper's Remarks 2 and 3 show the boundary: with immediate feedback (the line 1,2,2,2,1,11,2,2,2,1,11,2,2,2,1,1 with all means 0.30.30.3), or with three stations, a Kelly-type line can be unstable. A two-station Kelly-type line without immediate feedback is a unidirectional ring with one customer type, so the theorem is a special case of the ring-network result the paper proves as Theorem 6.2. That result is an open goal on the platform (ProcessingNetworks.GlobalStability.ring_globally_stable, Dai and Harrison's Theorem 8.24) in a different encoding of the fluid model.

Formalizing it. The theorem is proved in the paper, and the mission formalizes that proof. No machine-checked proof of the result, or of the Lyapunov lemmas it uses, is known to exist. The mission also produces reusable pieces: a fluid model of reentrant lines in the paper's own formulation, an extinction lemma for absolutely continuous functions, and the max-of-linear Lyapunov lemma, which the paper uses again in §§3 and 5.

Difficulty

The obvious Lyapunov function, the total workload, does not work: a work-conserving policy may starve a station while the other one is busy, so the total content need not decrease. The paper's components Gi=∑k∈CiQk+G_i = \sum_{k\in C_i}Q_k^+Gi​=∑k∈Ci​​Qk+​ each decrease at the constant rate 1/βi−∣Ci∣1/\beta_i - |C_i|1/βi​−∣Ci​∣ while station iii is busy. When station iii is idle, GiG_iGi​ can grow, and the argument then needs the comparison Gi≤GjG_i \le G_jGi​≤Gj​, which requires the alternating route. The analytic difficulty is the passage from these pointwise statements to extinction. Fluid paths are only Lipschitz. The maximum G=max⁡(G1,G2)G = \max(G_1, G_2)G=max(G1​,G2​) need not be differentiable where the maximum switches, and the drift statements hold only almost everywhere. Lemma 2.2 (ii) and the derivative-of-a-maximum fact (3.2) make this step rigorous. The proof for odd KKK is not printed ("can be proved similarly"), and the formal goal covers it.

Formalization scope

All objects live in the namespace DaiWeissFluid.KellyType. The conventions are fixed as follows.

  • Classes and stations are 0-based (Fin K, Fin I). The paper's class kkk is Lean k - 1.
  • Paths are total functions ℝ → Fin K → ℝ, and every equation is imposed for t≥0t \ge 0t≥0 only. Derivatives are taken at t>0t > 0t>0 via HasDerivAt.
  • Work conservation (1.13) is stated in interval form: UiU_iUi​ is constant on every interval [s,t]⊆[0,∞)[s,t] \subseteq [0,\infty)[s,t]⊆[0,∞) on which station iii holds fluid throughout. For the continuous nondecreasing UiU_iUi​ this is equivalent to the paper's Stieltjes condition. Lipschitz continuity of the paths is not assumed, because it follows from the model.
  • mk>0m_k > 0mk​>0 is an explicit hypothesis. ∣Q(0)∣|Q(0)|∣Q(0)∣ is ∑kQk(0)\sum_k Q_k(0)∑k​Qk​(0).
  • Stability is Definition 1.3, which constrains only solutions with ∣Q(0)∣=1|Q(0)| = 1∣Q(0)∣=1.
  • The paper's Theorem 6.1 says "any work-conserving policy is stable", which is stability of the queueing network (Definition 1.1). Its proof establishes stability of the work-conserving fluid model, and the queueing-level conclusion follows from the cited Theorem 1.1 (Dai 1995). The goal is the fluid statement. Theorem 1.1 and the stochastic model are not formalized.
  • Lemma 2.2 (ii) is stated with the hypothesis g˙≤−ε\dot g \le -\varepsilong˙​≤−ε, where the page prints <<<. This is the form in which every application uses it, and it gives a stronger lemma.
  • The drift identity is stated for every Kelly-type line, which implies the printed K=2nK = 2nK=2n display. The printed "G2(t)=G2(t)+nt−…G_2(t) = G_2(t) + nt - \dotsG2​(t)=G2​(t)+nt−…" is read as G2(0)+nt−…G_2(0) + nt - \dotsG2​(0)+nt−….
  • Condition (b) and the Lemma 3.2 check are stated for both parities of KKK and both starting stations. A station with no classes has its εi\varepsilon_iεi​ left free.

The goal must not be trivialized. It quantifies over all work-conserving solutions with ∣Q(0)∣=1|Q(0)| = 1∣Q(0)∣=1, and this set is nonempty: a sorry-free witness with K=2K = 2K=2 is checked locally. Neither the Kelly-type hypothesis nor the absence of immediate feedback may be dropped (Remark 2), nor may the goal be generalized beyond two stations (Remark 3). Restricting it to even KKK, or to a route starting at station 1, would weaken it.

Contributions welcome: proofs of the general Lemmas 2.2 (ii) and 3.2, which apply across the whole series; the drift identity, which is pure algebra from (1.8); the continuity facts for fluid paths (Lipschitz bounds from (1.10)–(1.12)); and the final assembly.

Selected references

  • J. G. Dai and G. Weiss, Stability and instability of fluid models for reentrant lines, Mathematics of Operations Research 21(1), 115–134, 1996. https://doi.org/10.1287/moor.21.1.115
  • J. G. Dai, On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models, Annals of Applied Probability 5(1), 49–77, 1995. https://doi.org/10.1214/aoap/1177004828
  • S. H. Lu and P. R. Kumar, Distributed scheduling based on due dates and buffer priorities, IEEE Transactions on Automatic Control 36(12), 1406–1416, 1991. https://doi.org/10.1109/9.106156
  • F. P. Kelly, Reversibility and Stochastic Networks, Wiley, 1979.
  • J. G. Dai and J. M. Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press, 2020. https://doi.org/10.1017/9781108772662
11 thms3 active usersReviewed
Algorithmic Game TheoryProbabilityStochastic Systems·Captain: mikedeng1

On the Global Convergence of Stochastic Fictitious Play III: Almost Sure Convergence to Linearly Stable Rest Points in Potential GamesResearch Paper

Motivation

Stochastic fictitious play is a basic model of learning in repeated games. Each period every player best responds to the empirical frequencies of the opponents' past play, after the player's payoffs have been hit by a fresh random shock. It was introduced by Fudenberg and Kreps (1993), is a standard object in the theory of learning in games (Fudenberg and Levine, The Theory of Learning in Games, 1998), and underlies the quantal-response and logit-learning models used in experimental economics and multi-agent reinforcement learning. The question is whether the players' beliefs settle down, and on what.

Potential games, in which all players receive the same payoff, cover pure coordination games and, after the usual payoff transformations, congestion games and weighted potential games. For them Hofbauer and Sandholm (Econometrica 70, 2002) proved that stochastic fictitious play converges almost surely, and that under a generic regularity condition the limit is a single linearly stable rest point of the perturbed best response dynamic.

Timeline. Fudenberg and Kreps (1993) and Kaniovski and Young (1995) established convergence in 2×2 games. Benaïm and Hirsch (1999) related the process to its mean ordinary differential equation and proved convergence in some ppp player, two strategy games. Hofbauer (2000) and Hofbauer and Hopkins (2000) constructed Lyapunov functions for the deterministically perturbed dynamics. Hofbauer and Sandholm (2002) combined these with a representation theorem for random utility models and with Pemantle's (1990) nonconvergence theorem to obtain the result formalized here.

Setting

A ppp player game has finite strategy sets Sα={0,…,nα−1}S^\alpha = \{0,\dots,n^\alpha-1\}Sα={0,…,nα−1} and utilities uα:S→Ru^\alpha : S \to \mathbb Ruα:S→R on pure profiles S=∏βSβS = \prod_\beta S^\betaS=∏β​Sβ. The game is a potential game if uα(s)=uβ(s)u^\alpha(s) = u^\beta(s)uα(s)=uβ(s) for all players and all profiles. Mixed profiles form Σ=∏αΔSα\Sigma = \prod_\alpha \Delta S^\alphaΣ=∏α​ΔSα, and player α\alphaα's payoff vector is Uiα(x−α)=∑s: sα=iuα(s)∏β≠αxsββU^\alpha_i(x^{-\alpha}) = \sum_{s:\,s^\alpha=i} u^\alpha(s)\prod_{\beta\ne\alpha}x^\beta_{s^\beta}Uiα​(x−α)=∑s:sα=i​uα(s)∏β=α​xsββ​.

Player α\alphaα's payoffs are perturbed by a random vector εα\varepsilon^\alphaεα with a strictly positive density fαf^\alphafα on Rnα\mathbb R^{n^\alpha}Rnα. The choice function is Ciα(π)=P(arg⁡max⁡jπj+εjα=i)C^\alpha_i(\pi) = P(\arg\max_j \pi_j + \varepsilon^\alpha_j = i)Ciα​(π)=P(argmaxj​πj​+εjα​=i), assumed continuously differentiable, and the perturbed best response is B~α(x−α)=Cα(Uα(x−α))\tilde B^\alpha(x^{-\alpha}) = C^\alpha(U^\alpha(x^{-\alpha}))B~α(x−α)=Cα(Uα(x−α)).

In standard stochastic fictitious play, shocks εtα\varepsilon^\alpha_tεtα​ are independent over time and across players. From an arbitrary initial pure profile, at time t+1t+1t+1 each player plays a maximizer of Ukα(Zt−α)+(εtα)kU^\alpha_k(Z_t^{-\alpha}) + (\varepsilon^\alpha_t)_kUkα​(Zt−α​)+(εtα​)k​, where the beliefs are the time averages

Zt=1t∑u=1tζu.Z_t = \frac1t\sum_{u=1}^t \zeta_u .Zt​=t1​u=1∑t​ζu​.

The mean dynamic of this process is the perturbed best response dynamic

(P)x˙α=B~α(x−α)−xα.(P)\qquad \dot x^\alpha = \tilde B^\alpha(x^{-\alpha}) - x^\alpha .(P)x˙α=B~α(x−α)−xα.

A rest point x∗x^*x∗ of (P) is hyperbolic if every eigenvalue of DF(x∗)DF(x^*)DF(x∗) restricted to the tangent space ∏αR0nα\prod_\alpha \mathbb R^{n^\alpha}_0∏α​R0nα​ of Σ\SigmaΣ has nonzero real part, and linearly stable if every such eigenvalue has negative real part. RP(P)RP(P)RP(P) and LS(P)LS(P)LS(P) denote the rest points and the linearly stable rest points.

By Theorem 2.1 of the paper, Cα(π)=arg⁡max⁡y∈int⁡Δ(y⋅π−Vα(y))C^\alpha(\pi) = \arg\max_{y\in\operatorname{int}\Delta}(y\cdot\pi - V^\alpha(y))Cα(π)=argmaxy∈intΔ​(y⋅π−Vα(y)) for an admissible deterministic perturbation VαV^\alphaVα, so (P) coincides with the deterministically perturbed dynamic (PV), in which the argmax replaces CαC^\alphaCα.

Formalization targets

Goal: Theorem 6.1(iii)

For every potential game, every family of densities meeting the conditions above, every probability space, independent shock family and initial profile:

  1. if the shocks are smooth enough that the VαV^\alphaVα are CNC^NCN, N=∑α(nα−1)N = \sum_\alpha(n^\alpha-1)N=∑α​(nα−1), then
P(ω(Zt) is a connected subset of RP(P))=1;P\big(\omega(Z_t)\text{ is a connected subset of } RP(P)\big) = 1;P(ω(Zt​) is a connected subset of RP(P))=1;
  1. if every rest point of (P) is hyperbolic and the field of (P) is C2C^2C2, then
P(lim⁡t→∞Zt exists and lies in LS(P))=1.P\Big(\lim_{t\to\infty} Z_t \text{ exists and lies in } LS(P)\Big) = 1.P(t→∞lim​Zt​ exists and lies in LS(P))=1.

Milestones

In attack order: Theorem 2.1 (the representation), Proposition 4.1 (the function Π(x)=∑su1(s)∏αxsαα−∑αVα(xα)\Pi(x) = \sum_s u^1(s)\prod_\alpha x^\alpha_{s^\alpha} - \sum_\alpha V^\alpha(x^\alpha)Π(x)=∑s​u1(s)∏α​xsαα​−∑α​Vα(xα) is a strict Lyapunov function for (PV)), the identification of the critical points of Π\PiΠ with the rest points of (PV), Proposition 4.2 (CR(PV)=RP(PV)CR(PV) = RP(PV)CR(PV)=RP(PV) under CNC^NCN smoothness), Proposition 4.3 (under hyperbolicity RP(PV)RP(PV)RP(PV) is finite and equals CR(PV)CR(PV)CR(PV)), and Lemmas A.5 and A.4 (a uniform nondegeneracy condition for the noise of the process).

Significance

The result. Theorem 6.1(iii) says that decentralised, boundedly rational learning in common-interest games does not cycle or wander: beliefs converge to a rest point of the perturbed dynamic, and generically to one that is linearly stable, hence a local maximizer of the perturbed potential Π\PiΠ. Rest points approximate Nash equilibria as the noise vanishes (Proposition 3.1 of the paper), so the theorem is a selection result for equilibria reached by learning. It is also a template for the stochastic-approximation analysis of learning algorithms whose mean dynamic has a Lyapunov function.

Formalizing it. The theorem is proved in the paper, but none of its ingredients is machine-checked: the random utility representation, chain recurrence of flows, Lyapunov arguments for (PV), and the stochastic-approximation step (Benaïm–Hirsch, Benaïm, Pemantle) are all absent from Mathlib and from this platform. A complete development produces a reusable stochastic-approximation layer, not only this theorem.

Difficulty

The obvious argument, "(P) has a strict Lyapunov function, so the process converges to its rest points", fails twice. First, a strict Lyapunov function does not by itself make every chain recurrent point a rest point (the paper cites counterexamples of Akin and of Benaïm); the step needs either Sard's theorem for a CNC^NCN function or finiteness of the rest points, and the stochastic-approximation theory controls the process only through the chain recurrent set. Second, convergence to linearly stable points requires showing that the process avoids unstable rest points. This rests on Pemantle's theorem, whose nondegeneracy hypothesis must be verified uniformly over states and directions (Lemma A.4). Neither step follows from the ODE alone: the theorem is about the random process ZtZ_tZt​.

Formalization scope

Players are Fin p with p ≥ 2, strategies Fin (n α) with n α ≥ 1, and mixed profiles live in the ambient space (α : Fin p) → Fin (n α) → ℝ, on which every vector field is defined. Choice probabilities are probabilities of strict argmax events under volume.withDensity (f α). The process ZtZ_tZt​ is defined pathwise from the shocks, ties broken by the smallest index (a null event), and the theorem quantifies over every probability space and every independent shock family with the given laws. Derivatives of VαV^\alphaVα are those of VαV^\alphaVα composed with the projection onto the plane ∑iyi=1\sum_i y_i = 1∑i​yi​=1. Eigenvalues are the complex roots of the characteristic polynomial of the derivative restricted to the tangent space of Σ\SigmaΣ. Solutions of a dynamic are differentiable curves on [0,∞)[0,\infty)[0,∞) that stay in Σ\SigmaΣ, and chain recurrence uses ε\varepsilonε-chains with times ti≥1t_i \ge 1ti​≥1.

A formalization about the ODE (P) in place of the process ZtZ_tZt​, a fixed noise law such as logit, or convergence to RP(P)RP(P)RP(P) in place of LS(P)LS(P)LS(P) would prove a different and weaker statement. These are excluded.

Needed infrastructure: the random utility representation (mission I of this series), flows and chain recurrence of C1C^1C1 vector fields on compact sets, Sard's theorem for real-valued CNC^NCN functions, and the stochastic-approximation theorems of Benaïm–Hirsch (1999, Thm 3.3), Benaïm (1999, Props. 5.3 and 6.4) and Pemantle (1990, Thm 1). The last three are reusable well beyond this mission, and contributions of any of them are welcome.

Selected references

  • J. Hofbauer and W. H. Sandholm, On the Global Convergence of Stochastic Fictitious Play, Econometrica 70(6), 2265–2294, 2002. https://doi.org/10.1111/1468-0262.00376
  • M. Benaïm and M. W. Hirsch, Mixed Equilibria and Dynamical Systems Arising from Fictitious Play in Perturbed Games, Games and Economic Behavior 29, 36–72, 1999. https://doi.org/10.1006/game.1999.0717
  • M. Benaïm, Dynamics of Stochastic Approximation Algorithms, Séminaire de Probabilités XXXIII, Lecture Notes in Mathematics 1709, 1–68, 1999. https://doi.org/10.1007/BFb0096509
  • R. Pemantle, Nonconvergence to Unstable Points in Urn Models and Stochastic Approximations, Annals of Probability 18(2), 698–712, 1990. https://doi.org/10.1214/aop/1176990853
  • D. Fudenberg and D. M. Kreps, Learning Mixed Equilibria, Games and Economic Behavior 5, 320–367, 1993. https://doi.org/10.1006/game.1993.1021
  • J. Hofbauer and E. Hopkins, Learning in Perturbed Asymmetric Games, Games and Economic Behavior 52, 133–152, 2005. https://doi.org/10.1016/j.geb.2004.06.006
14 thms3 active usersReviewed
EconomicsOperations ResearchOptimization·Captain: mikedeng1

Minimum Earnings Regulation and the Stability of Marketplaces I: The Marketplace Is Stable Exactly When M ≤ w* Under Tight Labor Supply (p* ≤ w*) and M ≤ H(R(p*)) Under Loose SupplyResearch Paper

Motivation

Minimum hourly earnings rules for ride-hailing drivers are meant to protect income during periods when drivers spend part of their time idle. A platform pays a wage per hour carrying riders, yet drivers care about earnings per hour logged onto the platform. When many drivers enter after a wage increase, utilization can fall and offset the increase. A regulation that uses the preceding period's utilization to set the next wage can therefore create feedback in the marketplace. Asadpour, Lobel, and van Ryzin model this feedback and identify the exact minimum earnings targets compatible with bounded wages and continuing service (Asadpour, Lobel, and van Ryzin, 2022, §§3–4).

The question matters to marketplace design because a target that cannot be sustained within the model cannot be reached through a bounded wage policy, even if the platform changes prices over time. The theorem separates two economic regimes. When labor supply is tight, the decisive number is the price where demand equals supply. When supply is loose, the decisive number is the greatest revenue the platform can obtain from riders, converted into affordable driver earnings. This mission concerns the paper's threshold theorem and the four lemmas that state its main analytic ingredients.

Setting

In each discrete period ttt, a platform chooses a rider price pt≥0p_t\ge0pt​≥0 and a wage per ride hour wt≥0w_t\ge0wt​≥0. At price ppp, riders demand D(p)D(p)D(p) hours of trips. At expected hourly earnings zzz, drivers supply S(z)S(z)S(z) hours. The quantity of completed rides and driver utilization are

Q(p,z)=min⁡{D(p),S(z)},u(p,z)=Q(p,z)S(z).Q(p,z)=\min\{D(p),S(z)\},\qquad u(p,z)=\frac{Q(p,z)}{S(z)}.Q(p,z)=min{D(p),S(z)},u(p,z)=S(z)Q(p,z)​.

Drivers earn wages only while carrying riders. Thus an earnings equilibrium is a positive sequence ztz_tzt​ satisfying zt=wtu(pt,zt)z_t=w_tu(p_t,z_t)zt​=wt​u(pt​,zt​) in every period. The platform's period profit is π(p,w,z)=(p−w)Q(p,z)\pi(p,w,z)=(p-w)Q(p,z)π(p,w,z)=(p−w)Q(p,z). A minimum earnings target M>0M>0M>0 requires

wt+1≥Mu(pt,zt).w_{t+1}\ge\frac{M}{u(p_t,z_t)}.wt+1​≥u(pt​,zt​)M​.

The rule uses utilization in one period to set a wage floor in the next. A policy is stable if its prices and wages are feasible, it satisfies equilibrium and the wage rule, wages have a finite upper bound across all periods, and profit is nonnegative in all but finitely many periods. This definition permits a finite transition with losses but excludes a wage sequence that grows without bound (Asadpour, Lobel, and van Ryzin, 2022, p. 8, Definitions 1–2 and (5)).

The revenue function is R(p)=pD(p)R(p)=pD(p)R(p)=pD(p), and the labor cost function is C(z)=zS(z)C(z)=zS(z)C(z)=zS(z). Write HHH for the inverse of CCC on positive expenditure. The paper assumes that DDD is positive, continuous, and strictly decreasing; SSS is strictly increasing, differentiable, and positive except possibly at zero; RRR has a unique peak at p∗p^*p∗; and demand and supply cross at w∗w^*w∗, so D(w∗)=S(w∗)D(w^*)=S(w^*)D(w∗)=S(w∗) (Asadpour, Lobel, and van Ryzin, 2022, p. 8, Regularity assumptions).

Each theorem in this mission retains these standing assumptions, including when a particular result uses only some of them.

Formalization targets

Exact stability threshold

The goal is Theorem 1 of the paper. For every M>0M>0M>0, stability is characterized by

Stable⁡(D,S,M)⟺M≤z∗,z∗={w∗,p∗≤w∗,H(R(p∗)),p∗>w∗.\operatorname{Stable}(D,S,M)\quad\Longleftrightarrow\quad M\le z^*,\qquad z^*=\begin{cases}w^*,&p^*\le w^*,\\H(R(p^*)),&p^*>w^*.\end{cases}Stable(D,S,M)⟺M≤z∗,z∗={w∗,H(R(p∗)),​p∗≤w∗,p∗>w∗.​

The equality case p∗=w∗p^*=w^*p∗=w∗ belongs to the first branch. The theorem gives an if and only if statement about all feasible sequences of prices and wages, rather than a condition for one chosen stationary policy (Asadpour, Lobel, and van Ryzin, 2022, p. 11, Theorem 1 and (7)).

Supporting results

The milestones reproduce Lemmas 1–4 and two claims in the Online Appendix. Lemma 1 establishes the inverse labor cost's existence, regularity, and monotonicity. Lemma 2 identifies continuous, unique equilibrium earnings for a given price and positive wage. Lemma 3 states that stability admits a policy with price equal to wage. Lemma 4 rewrites the wage rule in that regime. The appendix claims compare the loose-supply threshold with w∗w^*w∗ and show that the tight-supply wage-growth factor exceeds one above w∗w^*w∗ (Asadpour, Lobel, and van Ryzin, 2022, pp. 9–10 and Online Appendix p. 4).

Significance

The theorem identifies the full stable range of targets in this model. In the tight-supply case, raising the target above the demand–supply crossing cannot be stabilized by choosing a different sequence of prices. In the loose-supply case, the highest stable target is tied to the cost of supplying drivers at the platform's peak potential revenue. The distinction explains why the same regulation can have different limits across markets with different demand and supply curves (Asadpour, Lobel, and van Ryzin, 2022, p. 11 and Figure 2).

The paper proves this result mathematically. The remaining formalization task is to represent its sequence model and analytic assumptions in Lean and prove the threshold statement and its supporting lemmas there. Its inverse-cost, equilibrium, and policy-stability interfaces can also be reused for the companion results on utilization shocks and static stability in the same paper. Those companion theorems are separate missions in this series.

Difficulty

The short threshold formula hides two distinct obligations: a policy must satisfy the earnings equilibrium and lagged wage rule at every period, while the impossibility direction must exclude every stable feasible policy, including policies that vary prices over time. The equilibrium earnings formula changes regime when supply at the posted wage crosses demand. At the boundary the two formulas must agree, and the argument must still handle wages that approach or cross the demand–supply point. Boundedness and profit conditions also interact with a finite initial period in which profit may be negative.

The paper's printed explanation for one strict inequality in the tight-supply converse is insufficient: two decreasing factors do not determine the direction of their product. The formal target keeps the inequality the paper uses, while the appendix quotation remains as printed (Asadpour, Lobel, and van Ryzin, 2022, Online Appendix p. 4).

Formalization scope

Prices, wages, earnings, demand, supply, cost, and revenue are real valued. The curves' regularity is imposed on [0,∞)[0,\infty)[0,∞); differentiability of supply is imposed on (0,∞)(0,\infty)(0,∞) together with continuity at zero. Revenue is strictly increasing up to p∗p^*p∗ and strictly decreasing afterward, encoding the unique peak. The crossing w∗w^*w∗ and inverse HHH are parameters with their characterizing properties, so the statements hold for their uniquely determined values. The inverse is only used at positive costs.

Lean indexes the first period by 000, so its rule applies to wt+1w_{t+1}wt+1​ for every t≥0t\ge0t≥0 and places no floor on w0w_0w0​. The paper starts at period 111 and likewise leaves the first wage free. “Bounded wages” means a single real upper bound for every period; “all but finitely many periods” is represented by an eventually true condition on N\mathbb NN.

An equilibrium requires zt>0z_t>0zt​>0. This explicit domain condition prevents a zero-supply input from making u=0/0u=0/0u=0/0 and then M/u=0M/u=0M/u=0 under Lean's total real division, which would make the regulation vacuous. Lemma 2 correspondingly uses w>0w>0w>0. Its branch condition S(w)<D(p)S(w)<D(p)S(w)<D(p) agrees with the paper's w<S−1(D(p))w<S^{-1}(D(p))w<S−1(D(p)) wherever that inverse exists and remains meaningful when demand is outside the range of supply. These domain choices are stated with the items they affect. A complete development needs real-analysis facts about continuous strictly monotone functions and inverses, eventual properties of sequences, and elementary bounds on the utilization ratio. Contributions establishing these interfaces or the stated milestones are within scope.

Selected references

  • Arash Asadpour, Ilan Lobel, and Garrett van Ryzin, Minimum Earnings Regulation and the Stability of Marketplaces, SSRN preprint 3502607, version of August 24, 2022; published in Manufacturing & Service Operations Management, 2022. SSRN preprint. The local formalization uses the dated preprint's page and theorem numbering.
8 thms2 active usersReviewed
Mathematical Physics·Captain: Lucas

Alexander–Temple–Vogler 2025: Instability of the Critical Friedmann Spacetime at the Big BangResearch Paper

Motivation

The Friedmann spacetimes (FLRW spacetimes) are the explicit, spatially homogeneous and isotropic solutions of Einstein's field equations on which standard Big Bang cosmology is built. Under a pressureless (dust, p=0p=0p=0) equation of state they form a family indexed by a curvature parameter kkk: the critical spacetime k=0k=0k=0, the underdense spacetimes k<0k<0k<0 and the overdense spacetimes k>0k>0k>0. The current Λ\LambdaΛCDM model fits supernova data with the critical Friedmann spacetime plus a cosmological constant (dark energy).

Alexander, Temple and Vogler (arXiv:2510.14228) study how stable the pressureless Friedmann spacetimes are under smooth, spherically symmetric (radial) perturbations near the Big Bang. They write the Einstein–Euler equations in self-similar variables (tˉ,ξ)(\bar t,\xi)(tˉ,ξ), ξ=rˉ/tˉ\xi=\bar r/\bar tξ=rˉ/tˉ, a formulation introduced by Smoller, Temple and Vogler (Proc. R. Soc. A, 2017). In these variables the critical Friedmann spacetime is a time-independent solution. They argue that the instability of this rest point causes underdense perturbations to accelerate away from k<0k<0k<0 Friedmann spacetimes at intermediate times, and they propose this as a mechanism for the observed acceleration that needs no cosmological constant.

This mission formalizes the dynamical-systems core of that paper: the STV ODE of orders n=1n=1n=1 and n=2n=2n=2, its rest points and eigenvalues, the exact k<0k<0k<0 Friedmann trajectory, and the order-2 instability theorem.

Setting

Expand a solution that is smooth at the centre of symmetry in even powers of ξ\xiξ: z=κρrˉ2=z2(tˉ)ξ2+z4(tˉ)ξ4+…z=\kappa\rho\bar r^2=z_2(\bar t)\xi^2+z_4(\bar t)\xi^4+\dotsz=κρrˉ2=z2​(tˉ)ξ2+z4​(tˉ)ξ4+… (density) and w=v/ξ=w0(tˉ)+w2(tˉ)ξ2+…w=v/\xi=w_0(\bar t)+w_2(\bar t)\xi^2+\dotsw=v/ξ=w0​(tˉ)+w2​(tˉ)ξ2+… (velocity). Collecting like powers of ξ\xiξ gives, at each order nnn, a closed 2n×2n2n\times 2n2n×2n system tˉ U˙=Fn(U)\bar t\,\dot U=F_n(U)tˉU˙=Fn​(U), the STV ODE of order nnn. At order 111, in the unknowns (z2,w0)(z_2,w_0)(z2​,w0​):

tˉz˙2=2z2−3z2w0,tˉw˙0=−16z2+w0−w02.\bar t\dot z_2=2z_2-3z_2w_0,\qquad \bar t\dot w_0=-\tfrac16z_2+w_0-w_0^2 .tˉz˙2​=2z2​−3z2​w0​,tˉw˙0​=−61​z2​+w0​−w02​.

At order 222, in (z2,w0,z4,w2)(z_2,w_0,z_4,w_2)(z2​,w0​,z4​,w2​), the system adds

tˉz˙4=512z22w0+4z4−5w0z4−5z2w2,tˉw˙2=−124z22+14z2w02−110z4+3w2−4w0w2.\bar t\dot z_4=\tfrac5{12}z_2^2w_0+4z_4-5w_0z_4-5z_2w_2,\qquad \bar t\dot w_2=-\tfrac1{24}z_2^2+\tfrac14z_2w_0^2-\tfrac1{10}z_4+3w_2-4w_0w_2 .tˉz˙4​=125​z22​w0​+4z4​−5w0​z4​−5z2​w2​,tˉw˙2​=−241​z22​+41​z2​w02​−101​z4​+3w2​−4w0​w2​.

The system is autonomous in log-time τ=ln⁡tˉ\tau=\ln\bar tτ=lntˉ. Its rest points include the Minkowski point M=(0,1)M=(0,1)M=(0,1), resp. (0,1,0,0)(0,1,0,0)(0,1,0,0), and the critical Friedmann point SM=(43,23)SM=(\tfrac43,\tfrac23)SM=(34​,32​), resp. (43,23,4027,29)(\tfrac43,\tfrac23,\tfrac{40}{27},\tfrac29)(34​,32​,2740​,92​). The p=0p=0p=0, k=−1k=-1k=−1 Friedmann spacetime with parameter Δ0>0\Delta_0>0Δ0​>0 is given in parametric form by tˉ=Δ02(sinh⁡2θ−2θ)\bar t=\tfrac{\Delta_0}{2}(\sinh2\theta-2\theta)tˉ=2Δ0​​(sinh2θ−2θ) and explicit functions z~2,w~0,z~4,w~2\tilde z_2,\tilde w_0,\tilde z_4,\tilde w_2z~2​,w~0​,z~4​,w~2​ of θ>0\theta>0θ>0 (equations (2.41), (2.43)).

Formalization targets

Goal: Theorem 8 at order n=2n=2n=2

Fix Δ0>0\Delta_0>0Δ0​>0. Let S\mathcal SS be the set of solutions of the order-2 STV ODE on tˉ∈(0,∞)\bar t\in(0,\infty)tˉ∈(0,∞) that tend to SMSMSM as tˉ→0+\bar t\to0^+tˉ→0+, tend to MMM as tˉ→∞\bar t\to\inftytˉ→∞, and agree exactly with the k=−1k=-1k=−1 Friedmann spacetime at leading order, i.e. (z2,w0)(tˉ)=(z~2,w~0)(θ)(z_2,w_0)(\bar t)=(\tilde z_2,\tilde w_0)(\theta)(z2​,w0​)(tˉ)=(z~2​,w~0​)(θ). Then

S={Ub:b∈R},b↦Ub injective,U0=(z~2,w~0,z~4,w~2).\mathcal S=\{U_b : b\in\mathbb R\},\qquad b\mapsto U_b \text{ injective},\qquad U_0=(\tilde z_2,\tilde w_0,\tilde z_4,\tilde w_2).S={Ub​:b∈R},b↦Ub​ injective,U0​=(z~2​,w~0​,z~4​,w~2​).

So the k<0k<0k<0 Friedmann spacetime is one member of a one-parameter family of trajectories from SMSMSM to MMM. All members agree with it at leading order, and the others differ from it at order 2.

Milestones

  1. Corollary 1 at n=1n=1n=1: the rest points U,M,SMU,M,SMU,M,SM; the eigenpairs (23,(−9,32))(\tfrac23,(-9,\tfrac32))(32​,(−9,23​)) and (−1,(4,1))(-1,(4,1))(−1,(4,1)) at SMSMSM; MMM is degenerate stable.
  2. Corollary 1 at n=2n=2n=2: the rest points; the four eigenpairs (2.30)–(2.33) at SMSMSM; −1-1−1 is the only eigenvalue at MMM.
  3. Equation (2.29): for every k≥1k\ge1k≥1 the block PkP_kPk​ of (2.26) at SMSMSM has eigenvalues 2k3\tfrac{2k}332k​ and 2k−53\tfrac{2k-5}332k−5​.
  4. Theorem 5 at n=1n=1n=1 and n=2n=2n=2: the explicit k=−1k=-1k=−1 Friedmann curve solves the STV ODE and runs from SMSMSM to MMM.
  5. Theorem 7: solutions tending to MMM satisfy z2,z4=O(tˉ−1)z_2,z_4=O(\bar t^{-1})z2​,z4​=O(tˉ−1) and w0−1,w2=O(tˉ−1ln⁡tˉ)w_0-1,w_2=O(\bar t^{-1}\ln\bar t)w0​−1,w2​=O(tˉ−1lntˉ).
  6. Theorem 9 at n=2n=2n=2: some solutions that agree with Friedmann at leading order and decay to MMM blow up as tˉ→0+\bar t\to0^+tˉ→0+ instead of tending to SMSMSM.

Significance

The result. At order 111 every relevant trajectory is a Friedmann spacetime. Order 222 is the first order where the instability of SMSMSM (the second positive eigenvalue 43\tfrac4334​) produces trajectories that agree with a k<0k<0k<0 Friedmann spacetime as tˉ→0\bar t\to0tˉ→0 and as tˉ→∞\bar t\to\inftytˉ→∞ but differ from it in between. The paper reads this as an acceleration away from Friedmann spacetimes without dark energy. The extra eigenvalue −13-\tfrac13−31​ is why some perturbations do not have a self-similar Big Bang.

Formalizing it. The paper is an announcement: most claims are justified by eigenvalue computations and appeals to standard ODE theory (Hartman–Grobman, decay at degenerate nodes). A machine-checked proof of the order-2 statements would turn these appeals into explicit arguments for a concrete polynomial system. None of these results is known to have been formalized.

Difficulty

The eigenvalue milestones are finite computations. The trajectory milestones (Theorem 5) need hyperbolic-function identities and limits at θ→0+\theta\to0^+θ→0+, where numerators and denominators both vanish to high order. The goal is harder because it is global. Linearizing at SMSMSM only describes trajectories near SMSMSM. One must also show that every member of the family exists for all time and reaches MMM, and that nothing outside the family belongs to S\mathcal SS. Theorem 7 needs sharp decay rates at a rest point whose Jacobian is not diagonalizable, which is where the logarithm comes from.

Formalization scope

  • Phase-space points are vectors Fin 2 → ℝ or Fin 4 → ℝ, with coordinates ordered (z2,w0)(z_2,w_0)(z2​,w0​) and (z2,w0,z4,w2)(z_2,w_0,z_4,w_2)(z2​,w0​,z4​,w2​).
  • A solution is a map U:R→R2nU:\mathbb R\to\mathbb R^{2n}U:R→R2n of log-time τ=ln⁡tˉ\tau=\ln\bar tτ=lntˉ with U′(τ)=Fn(U(τ))U'(\tau)=F_n(U(\tau))U′(τ)=Fn​(U(τ)) for every τ\tauτ. Hence tˉ→0+\bar t\to0^+tˉ→0+ is τ→−∞\tau\to-\inftyτ→−∞, tˉ→∞\bar t\to\inftytˉ→∞ is τ→+∞\tau\to+\inftyτ→+∞, and tˉ=Δ02(sinh⁡2θ−2θ)\bar t=\tfrac{\Delta_0}{2}(\sinh2\theta-2\theta)tˉ=2Δ0​​(sinh2θ−2θ) becomes τ=log⁡(Δ0⋅bigBangTime(θ))\tau=\log(\Delta_0\cdot\mathrm{bigBangTime}(\theta))τ=log(Δ0​⋅bigBangTime(θ)).
  • Jacobians are Fréchet derivatives (fderiv). Norms on R4\mathbb R^{4}R4 are sup norms.
  • The goal requires a family parametrized by R\mathbb RR that is injective, has range exactly S\mathcal SS, and has U0U_0U0​ equal to the Friedmann curve. Exhibiting a single solution does not prove it.
  • Out of scope: the derivation of the STV PDE and STV ODE from the Einstein–Euler equations (Theorems 1–3), the coordinate transformations (Theorems 4 and 6), and the general-order statements of Theorems 8–9. The paper does not write out the order-nnn system for general nnn, so these cannot be stated without first formalizing that derivation. Contributions in that direction are welcome.
  • Discrepancy with the source: Corollary 1 says RM\boldsymbol R_MRM​ is the only eigenvector at MMM. For the explicit order-2 system (2.48)–(2.51) the −1-1−1 eigenspace at MMM is two-dimensional, so the order-2 milestone does not include that uniqueness claim.

Selected references

  • C. Alexander, B. Temple, Z. Vogler, The Instability of the Critical Friedmann Spacetime at the Big Bang as an Alternative to Dark Energy, arXiv preprint, 2025. https://arxiv.org/abs/2510.14228
  • J. Smoller, B. Temple, Z. Vogler, An instability of the standard model of cosmology creates the anomalous acceleration without dark energy, Proc. R. Soc. A 473 (2017). https://doi.org/10.1098/rspa.2016.0887
13 thms2 active usersReviewed
Topology·Captain: Lucas

C^r Stability Conjecture (Palis–Smale)Open Problem

Motivation

Structural stability asks when the qualitative behaviour of a dynamical system survives small perturbations. A diffeomorphism fff of a closed manifold is structurally stable if every diffeomorphism ggg close enough to fff is topologically conjugate to fff: some homeomorphism hhh of the manifold satisfies h∘f=g∘hh\circ f=g\circ hh∘f=g∘h, so that hhh carries orbits of fff onto orbits of ggg. Systems that model physical phenomena are only known up to small errors, which is the original reason for interest in this notion (Andronov–Pontryagin, 1937).

In the 1960s Smale introduced Axiom A, a uniform-hyperbolicity condition on the nonwandering set, and showed that it yields a detailed description of the dynamics (spectral decomposition, symbolic dynamics). Palis and Smale conjectured that structural stability forces this hyperbolic structure. The conjecture appears on the Open Problem Garden as the CrC^rCr Stability Conjecture (openproblemgarden.org/op/c_r_stability_conjecture, rated Outstanding): any CrC^rCr structurally stable diffeomorphism is hyperbolic. The same page describes the higher-regularity case as one of the most important and difficult problems in dynamical systems.

Timeline.

  • 1967 — D. V. Anosov proves that Anosov diffeomorphisms (the whole manifold is a hyperbolic set) are structurally stable (Proc. Steklov Inst. Math. 90).
  • 1970 — J. Palis and S. Smale prove that Morse–Smale diffeomorphisms are structurally stable and state the stability conjecture: fff is structurally stable if and only if fff satisfies Axiom A and the strong transversality condition (Global Analysis, Proc. Sympos. Pure Math. 14, AMS).
  • 1971 — J. Robbin proves the "if" direction for C2C^2C2 diffeomorphisms (Ann. of Math. 94); J. Franks obtains necessary conditions for C1C^1C1 stability, including hyperbolicity of periodic points (Trans. Amer. Math. Soc. 158).
  • 1976 — C. Robinson proves the "if" direction for C1C^1C1 diffeomorphisms (J. Differential Equations 22).
  • 1988 — R. Mañé proves the "only if" direction in the C1C^1C1 topology: a C1C^1C1 structurally stable diffeomorphism satisfies Axiom A (Publ. Math. IHÉS 66). In the same volume J. Palis derives the C1C^1C1 Ω\OmegaΩ-stability conjecture.
  • 1997 — S. Hayashi proves the analogous C1C^1C1 statements for flows (Ann. of Math. 145).

For every r≥2r\ge 2r≥2 the "only if" direction remains open.

Setting

Let MMM be a closed manifold: a compact Hausdorff smooth manifold without boundary, of dimension nnn. For an integer r≥1r\ge 1r≥1, Diffr(M)\mathrm{Diff}^r(M)Diffr(M) is the set of CrC^rCr diffeomorphisms f ⁣:M→Mf\colon M\to Mf:M→M, with the CrC^rCr topology: ggg is close to fff when, in finitely many charts and on compact sets, ggg and its derivatives of order ≤r\le r≤r are uniformly close to those of fff.

  • A point xxx is nonwandering for fff if for every neighbourhood UUU of xxx there is k≥1k\ge 1k≥1 with fk(U)∩U≠∅f^k(U)\cap U\neq\emptysetfk(U)∩U=∅. The nonwandering points form the compact invariant set Ω(f)\Omega(f)Ω(f). Every periodic point lies in Ω(f)\Omega(f)Ω(f).
  • A compact set Λ\LambdaΛ with f(Λ)=Λf(\Lambda)=\Lambdaf(Λ)=Λ is hyperbolic if, for a continuous Riemannian metric, each tangent space TxMT_xMTx​M, x∈Λx\in\Lambdax∈Λ, splits as Es(x)⊕Eu(x)E^s(x)\oplus E^u(x)Es(x)⊕Eu(x), the splitting is carried to itself by DfDfDf, and there are C>0C>0C>0 and 0<λ<10<\lambda<10<λ<1 with
∥Dfxkv∥≤Cλk∥v∥ (v∈Es(x)),∥Dfx−kv∥≤Cλk∥v∥ (v∈Eu(x)),k≥0.\|Df^k_x v\|\le C\lambda^k\|v\|\ (v\in E^s(x)),\qquad \|Df^{-k}_x v\|\le C\lambda^k\|v\|\ (v\in E^u(x)),\qquad k\ge 0 .∥Dfxk​v∥≤Cλk∥v∥ (v∈Es(x)),∥Dfx−k​v∥≤Cλk∥v∥ (v∈Eu(x)),k≥0.
  • fff satisfies Axiom A if Ω(f)\Omega(f)Ω(f) is hyperbolic and the periodic points of fff are dense in Ω(f)\Omega(f)Ω(f). fff is Anosov if MMM itself is hyperbolic.
  • fff is CrC^rCr structurally stable if some CrC^rCr neighbourhood of fff consists of diffeomorphisms topologically conjugate to fff. It is CrC^rCr Ω\OmegaΩ-stable if for all ggg in some CrC^rCr neighbourhood, f∣Ω(f)f|_{\Omega(f)}f∣Ω(f)​ and g∣Ω(g)g|_{\Omega(g)}g∣Ω(g)​ are topologically conjugate.

Formalization targets

Goal: the CrC^rCr stability conjecture

For every closed manifold MMM, every r≥1r\ge 1r≥1 and every f∈Diffr(M)f\in\mathrm{Diff}^r(M)f∈Diffr(M),

f is Cr structurally stable  ⟹  f satisfies Axiom A.f \text{ is } C^r \text{ structurally stable} \;\Longrightarrow\; f \text{ satisfies Axiom A}.f is Cr structurally stable⟹f satisfies Axiom A.

The case r=1r=1r=1 is Mañé's theorem; the cases r≥2r\ge 2r≥2 are open.

Milestones

  1. Franks (1971). A C1C^1C1 structurally stable diffeomorphism has only hyperbolic periodic points.
  2. Consequence of Pugh's closing lemma. For a C1C^1C1 structurally stable fff, Per(f)‾=Ω(f)\overline{\mathrm{Per}(f)}=\Omega(f)Per(f)​=Ω(f).
  3. Mañé (1988). The goal for r=1r=1r=1.
  4. Palis (1988). A C1C^1C1 Ω\OmegaΩ-stable diffeomorphism satisfies Axiom A.
  5. Anosov (1967). For every r≥1r\ge1r≥1, an Anosov CrC^rCr diffeomorphism is CrC^rCr structurally stable.

Significance

The result. A positive answer would give a dynamical characterization of structural stability in every regularity: together with the theorems of Robbin and Robinson (Axiom A plus strong transversality implies stability), it would show that structurally stable diffeomorphisms are exactly the hyperbolic ones with transverse stable and unstable manifolds. Every structurally stable system would then inherit Smale's spectral decomposition and its symbolic models. In the C1C^1C1 topology this picture is complete (Mañé); in higher regularity it is not known whether a structurally stable system can fail to be hyperbolic.

Formalizing it. The mission produces a common Lean vocabulary for hyperbolic sets, Axiom A, and structural and Ω\OmegaΩ-stability of diffeomorphisms of closed manifolds, compatible with the existing CrC^rCr topology and nonwandering-set definitions on the platform. The proved cases (Anosov, Franks, Mañé, Palis) are milestones whose formal proofs would be new contributions; the goal itself is open for r≥2r\ge 2r≥2.

Difficulty

The known C1C^1C1 proof rests on perturbation tools that work only in the C1C^1C1 topology: Franks' lemma (realizing any small change of the derivative along a periodic orbit by a C1C^1C1-small perturbation), Pugh's closing lemma and Mañé's ergodic closing lemma. In the CrC^rCr topology, r≥2r\ge 2r≥2, a perturbation that changes the derivative by a fixed amount on a small ball has large higher derivatives, so these local constructions are not CrC^rCr-small; Gutierrez's examples on the torus show that the local perturbation schemes used for the C1C^1C1 closing lemma cannot work in the C2C^2C2 topology. Whether periodic points are even dense in Ω(f)\Omega(f)Ω(f) for a CrC^rCr structurally stable fff is a case of the CrC^rCr closing problem, itself open.

Formalization scope

  • MMM is a type with [TopologicalSpace M] [T2Space M] [CompactSpace M], a ChartedSpace structure over EuclideanSpace ℝ (Fin n) and IsManifold (𝓡 n) ∞ M (smooth, no boundary). Diffr(M)\mathrm{Diff}^r(M)Diffr(M) is ClosingLemma.Diff n M r with the weak CrC^rCr topology ClosingLemma.crTopology r (published definition ClosingLemma_DiffeoCrTopology); on compact MMM it coincides with the strong topology. rrr is a natural number with r≥1r\ge 1r≥1; r=∞r=\inftyr=∞ is not covered.
  • Ω(f)\Omega(f)Ω(f) is PughClosingLemma.nonwanderingSet (published definition PughClosingLemma_nonwandering).
  • Hyperbolicity uses mfderiv and an arbitrary continuous Riemannian metric (Bundle.ContinuousRiemannianMetric on the tangent bundle); since MMM is compact, the choice of metric only changes CCC. Continuity of the splitting is not assumed, being a consequence of the estimates. A periodic point is hyperbolic when its finite orbit is a hyperbolic set, which is equivalent to the eigenvalue condition.
  • Axiom A requires density of periodic points in Ω(f)\Omega(f)Ω(f) as a separate condition, following Smale's definition.
  • Structural stability asks only for a conjugating homeomorphism, without requiring it to be close to the identity. The strong transversality part of the Palis–Smale conjecture is not part of the goal.
  • Infrastructure needed: stable manifold theory for hyperbolic sets, shadowing, Franks' lemma and closing lemmas on manifolds. These are reusable beyond this mission, and contributions of them are welcome.

Selected references

  • Open Problem Garden, CrC^rCr Stability Conjecture, posted December 20, 2007. https://www.openproblemgarden.org/op/c_r_stability_conjecture
  • D. V. Anosov, Geodesic flows on closed Riemannian manifolds with negative curvature, Proc. Steklov Inst. Math. 90, 1967.
  • J. Palis, S. Smale, Structural stability theorems, Global Analysis, Proc. Sympos. Pure Math. 14, AMS, 1970.
  • J. Robbin, A structural stability theorem, Ann. of Math. 94, 1971.
  • J. Franks, Necessary conditions for stability of diffeomorphisms, Trans. Amer. Math. Soc. 158, 1971.
  • C. Robinson, Structural stability of C1C^1C1 diffeomorphisms, J. Differential Equations 22, 1976.
  • R. Mañé, A proof of the C1C^1C1 stability conjecture, Publ. Math. IHÉS 66, 1988.
  • J. Palis, On the C1C^1C1 Ω\OmegaΩ-stability conjecture, Publ. Math. IHÉS 66, 1988.
  • S. Hayashi, Connecting invariant manifolds and the solution of the C1C^1C1 stability and Ω\OmegaΩ-stability conjectures for flows, Ann. of Math. 145, 1997.
  • C. Pugh, An improved closing lemma and a general density theorem, Amer. J. Math. 89, 1967.
12 thms2 active usersReviewed
Captain: Lucas

Palis Conjecture: Denseness of Finitude of AttractorsOpen Problem

Motivation

A basic aim of the theory of dynamical systems is to describe the long-term behaviour of typical orbits of typical systems. In the 1960s Smale's programme hoped that hyperbolic (structurally stable) systems would be dense, so that the asymptotic behaviour of a dense set of systems would be described by finitely many hyperbolic pieces. This hope fails: there are open sets of diffeomorphisms none of which is hyperbolic. Jacob Palis proposed a replacement global picture, in which hyperbolicity is replaced by a statistical requirement: for a dense set of systems, the asymptotics of Lebesgue-almost every orbit is captured by finitely many attractors. The problem appears on the Open Problem Garden (page), rated Outstanding, with the monograph of Bonatti, Diaz and Viana as reference.

Timeline.

  • 1962 — Peixoto: on a compact orientable surface, structurally stable vector fields (which are Morse–Smale) form an open and dense subset of Xr(M)\mathfrak X^r(M)Xr(M), r≥1r\ge1r≥1. In particular the flow version of the conjecture holds on orientable surfaces (Topology 1, 1962).
  • 1970s — Sinai, Ruelle and Bowen: for C2C^2C2 Axiom A systems, Lebesgue-almost every point lies in the basin of one of finitely many hyperbolic attractors (Bowen, Equilibrium States and the Ergodic Theory of Anosov Diffeomorphisms, LNM 470, 1975; Bowen–Ruelle, Invent. Math. 29, 1975).
  • 1974 — Newhouse: there are open sets of C2C^2C2 surface diffeomorphisms in which a residual subset has infinitely many sinks. Hence finitude of attractors cannot hold on an open and dense set in general, and dense is the natural quantifier.
  • 2000 — Palis states the global conjecture on the denseness of finitude of attractors (Astérisque 261), together with companion conjectures on physical measures and stochastic stability.
  • 2000 — Pujals–Sambarino: every C1C^1C1 surface diffeomorphism can be C1C^1C1-approximated by a hyperbolic one or by one with a homoclinic tangency (Ann. of Math. 151).

The conjecture is open in general.

Setting

Let MMM be a compact, connected, boundaryless smooth manifold of dimension nnn. For r≥1r\ge1r≥1 let Diffr(M)\mathrm{Diff}^r(M)Diffr(M) be the space of CrC^rCr diffeomorphisms of MMM and Xr(M)\mathfrak X^r(M)Xr(M) the space of CrC^rCr vector fields, both with the CrC^rCr topology (uniform convergence of the maps and of their derivatives up to order rrr in charts).

For a diffeomorphism fff and p∈Mp\in Mp∈M, the ω\omegaω-limit set ω(p)\omega(p)ω(p) is the set of accumulation points of the forward orbit fk(p)f^k(p)fk(p), k→∞k\to\inftyk→∞; for a flow (φt)t∈R(\varphi_t)_{t\in\mathbb R}(φt​)t∈R​ it is the set of accumulation points of φt(p)\varphi_t(p)φt​(p) as t→+∞t\to+\inftyt→+∞. The basin of a set Λ⊂M\Lambda\subset MΛ⊂M is

B(Λ)={p∈M: ω(p)⊂Λ}.B(\Lambda)=\{p\in M:\ \omega(p)\subset\Lambda\}.B(Λ)={p∈M: ω(p)⊂Λ}.

Following the source, Λ\LambdaΛ is an attractor if it is invariant (f(Λ)=Λf(\Lambda)=\Lambdaf(Λ)=Λ, resp. φt(Λ)=Λ\varphi_t(\Lambda)=\Lambdaφt​(Λ)=Λ for all ttt), transitive (some point of Λ\LambdaΛ has a forward orbit dense in Λ\LambdaΛ), and B(Λ)B(\Lambda)B(Λ) has positive Lebesgue measure. A set has Lebesgue measure zero in MMM if its image in every chart has Lebesgue measure zero in Rn\mathbb R^nRn; this notion does not depend on the smooth atlas.

Formalization targets

Goal: the Palis conjecture

For every r≥1r\ge1r≥1 there is a dense set D⊂Diffr(M)D\subset\mathrm{Diff}^r(M)D⊂Diffr(M) such that every f∈Df\in Df∈D has finitely many attractors Λ1,…,Λk\Lambda_1,\dots,\Lambda_kΛ1​,…,Λk​ with

Leb(M∖⋃i=1kB(Λi))=0,\mathrm{Leb}\Big(M\setminus\bigcup_{i=1}^k B(\Lambda_i)\Big)=0,Leb(M∖i=1⋃k​B(Λi​))=0,

and likewise there is a dense set D⊂Xr(M)D\subset\mathfrak X^r(M)D⊂Xr(M) such that the flow of every X∈DX\in DX∈D has finitely many attractors whose basins cover Lebesgue-almost all of MMM.

Milestones

  1. The diffeomorphism version and the flow version of the conjecture, separately.
  2. Dimension one: the diffeomorphism version on the circle.
  3. Peixoto: the flow version on compact orientable surfaces.
  4. Basic facts fixing the meaning of the definitions: a hyperbolic sink is an attractor; the identity map (dimension ≥1\ge1≥1) does not have finitely many attractors covering almost all of MMM; every CrC^rCr vector field on a compact boundaryless manifold has a unique global flow.

Significance

The result. A positive answer would give a dense set of systems whose statistical behaviour is completely described by finitely many invariant pieces, providing a global substitute for the failed density of hyperbolicity. It underlies Palis' companion conjectures on the existence of finitely many physical (SRB) measures and their stochastic stability.

Formalizing it. The full conjecture is open. The mission produces a reusable formal language for CrC^rCr diffeomorphisms and vector fields of compact manifolds, CrC^rCr density, Lebesgue-null sets on manifolds, ω\omegaω-limit sets, basins and attractors, together with formal statements of the classical cases (circle diffeomorphisms; Peixoto's theorem on orientable surfaces).

Difficulty

The obvious route — perturb to a hyperbolic system and invoke the Axiom A theory — fails because hyperbolic systems are not dense in dimension ≥2\ge2≥2 for diffeomorphisms (Newhouse phenomenon, robust homoclinic tangencies and heterodimensional cycles). One must control systems near which non-hyperbolic phenomena persist on open sets, where generic systems can have infinitely many sinks, and still find dense subsets with finitely many attractors. Even in the classical cases the proofs require the full machinery of hyperbolic critical elements, stable manifolds and the Kupka–Smale theorem.

Formalization scope

  • MMM is a Hausdorff, compact, connected topological space with a charted-space structure modelled on EuclideanSpace ℝ (Fin n) and a C∞C^\inftyC∞ manifold structure IsManifold (𝓡 n) ∞ M; the model has no boundary, so MMM is boundaryless.
  • rrr is a natural number with r≥1r\ge1r≥1 (the C∞C^\inftyC∞ topology is not covered). Diffr(M)\mathrm{Diff}^r(M)Diffr(M) is M ≃ₘ^r⟮𝓡 n, 𝓡 n⟯ M; vector fields are sections (x : M) → TangentSpace (𝓡 n) x, of class CrC^rCr when x↦(x,X(x))x\mapsto(x,X(x))x↦(x,X(x)) is CrC^rCr into the tangent bundle.
  • Density is expressed with sequences: every element is the CrC^rCr limit of a sequence from DDD (equivalent to topological density since the CrC^rCr topology on a compact manifold is metrizable). CrC^rCr convergence of maps is compact-open convergence plus uniform convergence on compact subsets of chart domains of all derivatives of order ≤r\le r≤r of the chart representatives; for vector fields, the same for the chart representatives y↦De(e−1y) X(e−1y)y\mapsto De(e^{-1}y)\,X(e^{-1}y)y↦De(e−1y)X(e−1y).
  • A set is Lebesgue-null if its image under every chart of the atlas has Lebesgue outer measure zero. ω\omegaω-limits use Mathlib's omegaLimit along atTop. Transitivity means the closure of a forward orbit of a point of Λ\LambdaΛ equals Λ\LambdaΛ.
  • Flows: the flow statements quantify over every global flow Φ\PhiΦ of XXX (Φ0=id\Phi_0=\mathrm{id}Φ0​=id, each orbit an integral curve of XXX); a milestone states that such a flow exists and is unique, so these statements are not vacuous.
  • The goal is not trivialized by taking DDD to be all systems: the identity milestone shows that the finitude property fails for some diffeomorphisms.
  • Reusable infrastructure: Lebesgue-null sets on manifolds, CrC^rCr convergence and density, attractors and basins, flows of vector fields on compact manifolds. Contributions such as hyperbolic fixed points and periodic orbits, stable manifold theorems, rotation numbers of circle diffeomorphisms, and Morse–Smale systems are welcome.

Selected references

  • J. Palis, A global view of dynamics and a conjecture on the denseness of finitude of attractors, Astérisque 261 (2000), 335–347.
  • J. Palis, A global perspective for non-conservative dynamics, Ann. Inst. H. Poincaré Anal. Non Linéaire 22 (2005), 485–507.
  • C. Bonatti, L. J. Díaz, M. Viana, Dynamics Beyond Uniform Hyperbolicity, Encyclopaedia of Mathematical Sciences 102, Springer, 2005.
  • M. M. Peixoto, Structural stability on two-dimensional manifolds, Topology 1 (1962), 101–120.
  • S. E. Newhouse, Diffeomorphisms with infinitely many sinks, Topology 13 (1974), 9–18.
  • R. Bowen, Equilibrium States and the Ergodic Theory of Anosov Diffeomorphisms, Lecture Notes in Math. 470, Springer, 1975.
  • R. Bowen, D. Ruelle, The ergodic theory of Axiom A flows, Invent. Math. 29 (1975), 181–202.
  • E. R. Pujals, M. Sambarino, Homoclinic tangencies and hyperbolicity for surface diffeomorphisms, Ann. of Math. 151 (2000), 961–1023.
  • J. Palis, W. de Melo, Geometric Theory of Dynamical Systems: An Introduction, Springer, 1982.
  • W. de Melo, S. van Strien, One-Dimensional Dynamics, Springer, 1993.
  • Open Problem Garden: https://www.openproblemgarden.org/op/jacob_palis_conjecture_finitude_of_attractors_dynamical_systems
13 thms2 active usersReviewed
Algorithmic Game TheoryConvex Optimization·Captain: mikedeng1

Learning in Games via Reinforcement and Regularization 2: Under Regularized Reinforcement Learning, Every Strict Nash Equilibrium Is Asymptotically StableResearch Paper

Motivation

In a repeated game, players who do not know the payoff structure can still learn by reinforcement: each player keeps a running score for every action, the cumulative payoff that action would have earned, and plays a mixed strategy that favours actions with high scores. Turning scores into mixed strategies through a regularized best response (maximize score minus a convex penalty) gives a family of dynamics that includes exponential weights and the replicator dynamics (entropic penalty), and also the projection dynamics (quadratic penalty). The same scheme is the continuous-time counterpart of online mirror descent and dual averaging in online optimization.

For the replicator dynamics, the standard folk results of evolutionary game theory say that Nash equilibria are stationary, that limits of interior orbits are Nash equilibria, that Lyapunov stable states are Nash equilibria, and that strict equilibria are asymptotically stable (Weibull 1995; Hofbauer–Sigmund 1998). Mertikopoulos and Sandholm (arXiv:1407.6267v2, Math. Oper. Res. 41(4), 2016) show that all four results survive for the whole family. For steep, decomposable penalties several of them were known (Coucheney–Gaujal–Mertikopoulos 2015). The new part is the nonsteep case, where mixed strategies can hit the boundary of the simplex and the induced dynamics on strategies are no longer well defined.

Setting

A finite game G\mathcal GG has a finite set N\mathcal NN of players. Player kkk has a finite nonempty set Ak\mathcal A_kAk​ of pure strategies and a payoff function uk:∏ℓAℓ→Ru_k:\prod_\ell\mathcal A_\ell\to\mathbb Ruk​:∏ℓ​Aℓ​→R. A mixed profile is x=(xk)k∈X=∏kΔ(Ak)x=(x_k)_k\in\mathcal X=\prod_k\Delta(\mathcal A_k)x=(xk​)k​∈X=∏k​Δ(Ak​), and uk(x)u_k(x)uk​(x) is player kkk's expected payoff when the players randomize independently. The payoff vector is vkα(x)=uk(α;x−k)v_{k\alpha}(x)=u_k(\alpha;x_{-k})vkα​(x)=uk​(α;x−k​), the payoff of pure strategy α\alphaα against x−kx_{-k}x−k​.

A penalty function on a simplex Δ\DeltaΔ (Definition 2.1) is a function h:Δ→Rh:\Delta\to\mathbb Rh:Δ→R that is continuous, smooth on the relative interior of every face, and KKK-strongly convex:

h(tx1+(1−t)x2)≤t h(x1)+(1−t) h(x2)−12Kt(1−t)∥x1−x2∥22.h(tx_1+(1-t)x_2)\le t\,h(x_1)+(1-t)\,h(x_2)-\tfrac12Kt(1-t)\|x_1-x_2\|_2^2 .h(tx1​+(1−t)x2​)≤th(x1​)+(1−t)h(x2​)−21​Kt(1−t)∥x1​−x2​∥22​.

Steepness (gradients blowing up at the boundary) is not required. Its choice map is Q(y)=arg⁡max⁡x∈Δ{⟨y∣x⟩−h(x)}Q(y)=\arg\max_{x\in\Delta}\{\langle y|x\rangle-h(x)\}Q(y)=argmaxx∈Δ​{⟨y∣x⟩−h(x)}. Every player kkk has a penalty function hkh_khk​ with constant KkK_kKk​.

The reinforcement learning dynamics (RL) are

y˙kα=vkα(x),xk=Qk(yk),\dot y_{k\alpha}=v_{k\alpha}(x),\qquad x_k=Q_k(y_k),y˙​kα​=vkα​(x),xk​=Qk​(yk​),

and an orbit is a pair (y(t),x(t))(y(t),x(t))(y(t),x(t)), t≥0t\ge0t≥0, satisfying them. A Nash equilibrium is a profile x∗x^*x∗ with uk(x∗)≥uk(xk;x−k∗)u_k(x^*)\ge u_k(x_k;x^*_{-k})uk​(x∗)≥uk​(xk​;x−k∗​) for every kkk and every mixed xkx_kxk​. It is strict if the inequality is strict for every xk≠xk∗x_k\neq x^*_kxk​=xk∗​.

Because (RL) lives in the space of scores and QQQ is neither injective nor surjective, stability is defined on the trajectories of play (Definition 5.1):

  • x∗x^*x∗ is Lyapunov stable if for every ε>0\varepsilon>0ε>0 there is δ>0\delta>0δ>0 such that every orbit with ∥x(0)−x∗∥<δ\|x(0)-x^*\|<\delta∥x(0)−x∗∥<δ stays within ε\varepsilonε of x∗x^*x∗ forever;
  • it is attracting if every orbit started close enough to x∗x^*x∗ converges to x∗x^*x∗;
  • it is asymptotically stable if it is both;
  • it is stationary if x∗∈im⁡Qx^*\in\operatorname{im}Qx∗∈imQ and every orbit with x(0)=x∗x(0)=x^*x(0)=x∗ stays at x∗x^*x∗.

Formalization targets

Goal: Theorem 5.2, Part IV

x∗ strict Nash equilibrium of G ⟹ x∗ asymptotically stable under (RL),x^*\ \text{strict Nash equilibrium of }\mathcal G\ \Longrightarrow\ x^*\ \text{asymptotically stable under (RL)},x∗ strict Nash equilibrium of G ⟹ x∗ asymptotically stable under (RL),

for every finite game and every choice of penalty functions hkh_khk​, steep or not.

Milestones (the steps of the proof, pp. 23–24, and the Appendix results it uses)

  • A strict equilibrium is a pure profile x∗=(α1∗,…,αN∗)x^*=(\alpha^*_1,\dots,\alpha^*_N)x∗=(α1∗​,…,αN∗​), and δk=min⁡μ≠αk∗{vkαk∗(x∗)−vkμ(x∗)}>0\delta_k=\min_{\mu\neq\alpha^*_k}\{v_{k\alpha^*_k}(x^*)-v_{k\mu}(x^*)\}>0δk​=minμ=αk∗​​{vkαk∗​​(x∗)−vkμ​(x∗)}>0.
  • Proposition A.1(iii): Qα(y)→0Q_\alpha(y)\to0Qα​(y)→0 whenever yα−yβ→−∞y_\alpha-y_\beta\to-\inftyyα​−yβ​→−∞.
  • Proposition C.3: the Fenchel coupling Fh(p,y)=h(p)+h∗(y)−⟨y∣p⟩F_h(p,y)=h(p)+h^*(y)-\langle y|p\rangleFh​(p,y)=h(p)+h∗(y)−⟨y∣p⟩ satisfies Fh(p,y)≥12K∥Q(y)−p∥2F_h(p,y)\ge\tfrac12K\|Q(y)-p\|^2Fh​(p,y)≥21​K∥Q(y)−p∥2.
  • Proposition C.2(i)–(iii): the Bregman divergence Dh(p,x)=h(p)−h(x)−h′(x;p−x)D_h(p,x)=h(p)-h(x)-h'(x;p-x)Dh​(p,x)=h(p)−h(x)−h′(x;p−x), built from the one-sided derivative, is finite, nonnegative with (C.6), and continuous on Δp={x:supp⁡x⊇supp⁡p}\Delta_p=\{x:\operatorname{supp}x\supseteq\operatorname{supp}p\}Δp​={x:suppx⊇suppp}.
  • (C.11): Fh(p,y)=Dh(p,Q(y))F_h(p,y)=D_h(p,Q(y))Fh​(p,y)=Dh​(p,Q(y)) whenever Q(y)∈ΔpQ(y)\in\Delta_pQ(y)∈Δp​.
  • The monotonicity step: h∗(y)−yα∗=max⁡x{∑μ≠α∗xμzμ−h(x)}h^*(y)-y_{\alpha^*}=\max_{x}\{\sum_{\mu\ne\alpha^*}x_\mu z_\mu-h(x)\}h∗(y)−yα∗​=maxx​{∑μ=α∗​xμ​zμ​−h(x)} is nondecreasing in the relative scores zμ=yμ−yα∗z_\mu=y_\mu-y_{\alpha^*}zμ​=yμ​−yα∗​.

Companions

Theorem 5.2, Parts I–III (stationary   ⟺  \iff⟺ Nash and in im⁡Q\operatorname{im}QimQ; limits of orbits and Lyapunov stable states are Nash), Proposition 5.3, Proposition 3.1 (global existence and uniqueness of orbits) and Proposition A.1(i)–(ii).

Significance

Theorem 5.2 says that, as far as the qualitative long-run behaviour is concerned, the whole class of regularized reinforcement dynamics behaves like the replicator dynamics. Part IV is the positive half: strict equilibria are robust attractors of learning. This is used to justify equilibrium selection by learning, and Proposition 5.4 (not part of this mission) builds the rates of convergence, including convergence in finite time for nonsteep penalties, on top of it.

The result is proved in the paper; none of it is formalized. A Lean development would provide a reusable layer of game-theoretic learning dynamics: penalty functions without steepness, choice maps as regularized argmax, the Fenchel coupling and the one-sided Bregman divergence on the simplex. Two companion missions on the same paper use the same layer, for the extinction of dominated strategies and for time averages in zero-sum games. As far as is known, the stability theory of Section 5 has no machine-checked proof even for the replicator dynamics.

Difficulty

The obvious argument would be a Lyapunov argument for the induced dynamics on X\mathcal XX, as for the replicator equation. For nonsteep penalties these dynamics are not well defined: orbits reach the boundary and QQQ is not invertible there. The proof works in the dual space instead, where the natural Lyapunov candidate is the Fenchel coupling Fh(x∗,y)F_h(x^*,y)Fh​(x∗,y). The coupling is not differentiable along the orbit in the usual sense, and its sublevel sets in score space must be related to genuine neighbourhoods of x∗x^*x∗ in X\mathcal XX. That needs the Bregman divergence with one-sided derivatives at boundary points and its continuity across faces of different dimension (Proposition C.2(iii)). A second obstacle is that the coupling does not strictly decrease when the maximizer sits at the vertex. The page states a strict inequality there, which fails for nonsteep penalties, so the argument has to be run with the weak inequality and a first-exit-time argument.

Formalization scope

  • The game uses the published agt_games vocabulary: AGT.IsLottery, AGT.IsMixedProfile, AGT.expectedPayoff, and AGT.IsMixedNash for (5.1). Players form a Fintype ι, and actions are A k with Fintype and DecidableEq.
  • Penalty functions are IsPenalty h K, Definition 2.1 with the Euclidean norm in (2.5) and C∞C^\inftyC∞ smoothness along curves inside the relative interiors of faces. There is no steepness.
  • The choice map is the predicate IsChoice h y x, never a chosen argmax.
  • Orbits are IsRLOrbit u h y x, the differential form (3.1) with one-sided derivatives at t=0t=0t=0. Statements quantify over orbits and never construct one.
  • Neighbourhoods of x∗x^*x∗ in X\mathcal XX are balls of the sup metric on ∏kRAk\prod_k\mathbb R^{\mathcal A_k}∏k​RAk​, and Definition 5.1 is stated in ε\varepsilonε–δ\deltaδ form.
  • Strict equilibria are not assumed pure; purity is a milestone.
  • The one-sided derivative (C.3) is a limit predicate with a real value, so the Bregman divergence's value +∞+\infty+∞ is never represented by a junk number.
  • Proposition 3.1 adds that every Ak\mathcal A_kAk​ is nonempty. This is implicit in "finite game", and without it no orbit exists.
  • The monotonicity step is stated with ≤\le≤, not the printed <<<.

Trivializing encodings are excluded. Q is not a chosen maximizer that could be chosen badly. Orbit hypotheses are not vacuous: a verification file exhibits an orbit and a strict equilibrium together with a penalty function. Steepness is not added to the hypotheses. The conclusion is genuine convergence x(t)→x∗x(t)\to x^*x(t)→x∗ together with Lyapunov stability, not a lim inf⁡\liminfliminf or a stability-only statement. Proofs of any milestone are welcome. The conjugate and Bregman layer (Appendix C), the regularized-argmax lemmas (Appendix A) and the well-posedness of (RL) (Proposition 3.1) are reusable beyond this mission.

Selected references

  • P. Mertikopoulos and W. H. Sandholm, Learning in games via reinforcement and regularization, Math. Oper. Res. 41(4), 2016. Cited as arXiv:1407.6267v2. https://arxiv.org/abs/1407.6267v2
  • P. Coucheney, B. Gaujal and P. Mertikopoulos, Penalty-regulated dynamics and robust learning procedures in games, Math. Oper. Res. 40(3), 2015. https://doi.org/10.1287/moor.2014.0687
  • J. W. Weibull, Evolutionary Game Theory, MIT Press, 1995. https://mitpress.mit.edu/9780262731218/
  • J. Hofbauer and K. Sigmund, Evolutionary Games and Population Dynamics, Cambridge University Press, 1998. https://doi.org/10.1017/CBO9781139173179
  • K. C. Kiwiel, Free-steering relaxation methods for problems with strictly convex costs and linear constraints, Math. Oper. Res. 22(2), 1997. https://doi.org/10.1287/moor.22.2.326
12 thms2 active usersReviewed
Control TheoryGraph TheoryLinear algebra·Captain: mikedeng1

Synchronization via Pinning Control on General Complex Networks II: Componentwise LMIs on the Strongly Connected Components Globally Synchronize a Pinned Network with a Directed Spanning TreeResearch Paper

Motivation

Networks of identical dynamical systems coupled along a directed graph model power grids, sensor and robot swarms, neural populations and coupled oscillators. A basic control question is how to steer every node of such a network onto a prescribed reference trajectory by acting directly on only a few nodes. This is pinning control: feedback is injected at a small set of pinned vertices, and the coupling has to carry the reference signal to the rest of the network.

For undirected or strongly connected networks, criteria for pinning synchronization go back to Wang and Chen (2002) and Chen, Liu and Lu (2007), and the first mission of this series treats the strongly connected case of Yu, Chen, Lü and Kurths (2013). Many networks of interest are not strongly connected: information flows down a hierarchy of groups, and the minimal requirement for the reference to reach every node is that the network, with the reference added as a virtual leader, contains a directed spanning tree rooted at the leader. Section 4 of that paper gives a criterion for this general case that splits into one condition per strongly connected component. This mission formalizes that criterion, Theorem 4.5, with the lemmas its proof uses and three corollaries.

Setting

There are NNN vertices with states xi(t)∈Rnx_i(t)\in\mathbb R^nxi​(t)∈Rn. The coupling configuration matrix G∈RN×NG\in\mathbb R^{N\times N}G∈RN×N has Gij≥0G_{ij}\ge0Gij​≥0 for i≠ji\ne ji=j, where Gij>0G_{ij}>0Gij​>0 records a connection from vertex jjj to vertex iii, and zero row sums, Gii=−∑j≠iGijG_{ii}=-\sum_{j\ne i}G_{ij}Gii​=−∑j=i​Gij​. Given a function f:Rn×R+→Rnf:\mathbb R^n\times\mathbb R_+\to\mathbb R^nf:Rn×R+​→Rn, a coupling strength ccc, an inner coupling matrix Γ∈Rn×n\Gamma\in\mathbb R^{n\times n}Γ∈Rn×n and pinning gains di≥0d_i\ge0di​≥0 (vertex iii is pinned when di>0d_i>0di​>0), the controlled network is

x˙i=f(xi,t)+c∑j=1NGijΓxj−c di Γ(xi−s),i=1,…,N,\dot x_i=f(x_i,t)+c\sum_{j=1}^N G_{ij}\Gamma x_j-c\,d_i\,\Gamma(x_i-s),\qquad i=1,\dots,N,x˙i​=f(xi​,t)+cj=1∑N​Gij​Γxj​−cdi​Γ(xi​−s),i=1,…,N,

where the reference sss solves s˙=f(s,t)\dot s=f(s,t)s˙=f(s,t). The network is globally synchronized when xi(t)−s(t)→0x_i(t)-s(t)\to0xi​(t)−s(t)→0 for every vertex and every pair of solutions.

The nonlinearity is controlled by Assumption 1: there is a matrix KKK with (x−y)T(f(x,t)−f(y,t))≤(x−y)TKΓ(x−y)(x-y)^{\mathsf T}(f(x,t)-f(y,t))\le(x-y)^{\mathsf T}K\Gamma(x-y)(x−y)T(f(x,t)−f(y,t))≤(x−y)TKΓ(x−y) for all x,yx,yx,y and t≥0t\ge0t≥0. Throughout §4 the paper also assumes that KKK and Γ\GammaΓ commute, that Γ\GammaΓ is positive definite, and puts θ=λmax⁡((K+KT)/2)≥0\theta=\lambda_{\max}((K+K^{\mathsf T})/2)\ge0θ=λmax​((K+KT)/2)≥0.

The vertices split into strongly connected components V1,…,VMV_1,\dots,V_MV1​,…,VM​. In the Frobenius normal form the components are ordered so that no edge goes from a later component to an earlier one, which makes GGG block lower triangular. For each component jjj the mission uses three matrices:

  • G~j\widetilde G_jGj​, the diagonal block of G−diag(d)G-\mathrm{diag}(d)G−diag(d) on VjV_jVj​;
  • AjA_jAj​, the within-component part of GGG with zero row sums;
  • Π~j=diag(Πj)\widetilde\Pi_j=\mathrm{diag}(\Pi_j)Πj​=diag(Πj​), where Πj\Pi_jΠj​ is a positive vector with ΠjTAj=0\Pi_j^{\mathsf T}A_j=0ΠjT​Aj​=0.

In Lean, component membership is a map blk : Fin N → Fin M, and Fin M carries the Frobenius order.

Formalization targets

Goal: Theorem 4.5

If, for every component jjj,

2θΠ~j+c(Π~jG~j+G~jTΠ~j)<0,(4.8)2\theta\widetilde\Pi_j+c\bigl(\widetilde\Pi_j\widetilde G_j+\widetilde G_j^{\mathsf T}\widetilde\Pi_j\bigr)<0, \tag{4.8}2θΠj​+c(Πj​Gj​+GjT​Πj​)<0,(4.8)

then the controlled network with a directed spanning tree is globally synchronized.

Milestones

  1. The θ bound (p. 1402). Commutation and Γ>0\Gamma>0Γ>0 turn Assumption 1 into (x−y)T(f(x,t)−f(y,t))≤θ(x−y)TΓ(x−y)(x-y)^{\mathsf T}(f(x,t)-f(y,t))\le\theta(x-y)^{\mathsf T}\Gamma(x-y)(x−y)T(f(x,t)−f(y,t))≤θ(x−y)TΓ(x−y).
  2. Lemma 2.13. The strict Schur complement test for a symmetric block matrix.
  3. Lemma 4.4. If Π~jG~j+G~jTΠ~j<0\widetilde\Pi_j\widetilde G_j+\widetilde G_j^{\mathsf T}\widetilde\Pi_j<0Πj​Gj​+GjT​Πj​<0 on every diagonal block of a block lower-triangular G‾\overline GG, then positive block weights Δj\Delta_jΔj​ exist with ΔΠ~G‾+G‾TΠ~Δ<0\Delta\widetilde\Pi\overline G+\overline G^{\mathsf T}\widetilde\Pi\Delta<0ΔΠG+GTΠΔ<0.
  4. (4.10). Along solutions, V=∑jΔje~jTΠ~je~jV=\sum_j\Delta_j\widetilde e_j^{\mathsf T}\widetilde\Pi_j\widetilde e_jV=∑j​Δj​ejT​Πj​ej​ satisfies V˙≤eT{[ΔΠ~(cG‾+θIN)+(cG‾+θIN)TΠ~Δ]⊗Γ}e\dot V\le e^{\mathsf T}\{[\Delta\widetilde\Pi(c\overline G+\theta I_N)+(c\overline G+\theta I_N)^{\mathsf T}\widetilde\Pi\Delta]\otimes\Gamma\}eV˙≤eT{[ΔΠ(cG+θIN​)+(cG+θIN​)TΠΔ]⊗Γ}e.

Companions

  • Corollary 4.7: the same conclusion under θΠ~j+c(A‾j−Π~jCj−Π~jD‾j)<0\theta\widetilde\Pi_j+c(\overline A_j-\widetilde\Pi_jC_j-\widetilde\Pi_j\overline D_j)<0θΠj​+c(Aj​−Πj​Cj​−Πj​Dj​)<0, which separates the outer in-degrees CjC_jCj​ from the pinning gains D‾j\overline D_jDj​.
  • Corollary 4.8 (i): an explicit coupling-strength threshold under Assumption 2.
  • Corollary 4.9: partial synchronization of the first components.

Significance

Theorem 4.5 replaces a single Nn×NnNn\times NnNn×Nn matrix inequality for the whole network with MMM inequalities, one of the size of each component. In practice the test runs component by component down the Frobenius order: decide which components need pinning, choose gains for each one separately, and get synchronization of the whole network. Corollary 4.7 makes this explicit in terms of the outer in-degrees: a component with no incoming edges from earlier components has to be pinned (Remark 4), while a component that receives enough weight from upstream needs no control. These conditions underlie the pinning scheme algorithm of §5 of the paper.

On the formal side, as far as a search of the platform and of Mathlib shows, none of these results is machine-checked. Mathlib has the positive semidefinite Schur complement and irreducible nonnegative matrices, but not the strict Schur complement, block-diagonal Lyapunov scaling, or Lyapunov arguments for networked ODEs with Kronecker-structured couplings. The mission produces, beyond the paper's theorem:

  • a reusable strict Schur complement lemma;
  • a block-triangular diagonal-stability lemma;
  • a template for Lyapunov estimates on coupled networks in Lean.

Difficulty

The obvious argument is to take one Lyapunov function weighted by a positive left null vector of the whole coupling matrix, as in the strongly connected case. Here it fails: the coupling matrix of a network that is not strongly connected has no positive left null vector, and condition (4.8) is local to each component. The central step is the passage from blockwise to global negative definiteness (Lemma 4.4). Condition (4.8) says nothing about the off-diagonal blocks that couple a component to earlier ones, and a block lower-triangular matrix whose symmetrized diagonal blocks are negative definite need not have a negative definite symmetric part; the component weights Δj\Delta_jΔj​ have to be found so that those couplings are dominated, which is a quantitative statement about Schur complements. Turning the resulting matrix inequality into convergence of the trajectories then needs a differential inequality on [0,∞)[0,\infty)[0,∞), a Kronecker-product definiteness argument with Γ\GammaΓ, and the commutation of KKK and Γ\GammaΓ to reach the θ bound.

Formalization scope

States are Fin n → ℝ and matrices are indexed by Fin N, Fin n, or the subtype of one component's vertices. Solutions are functions on ℝ that satisfy their ODE on [0,∞)[0,\infty)[0,∞) through HasDerivWithinAt … (Set.Ici 0). "For any initial conditions" means for every pair of solutions (s,x)(s,x)(s,x); existence of solutions is not claimed. Convergence is componentwise, which agrees with every norm on Rn\mathbb R^nRn. "Positive definite" is Mathlib's Matrix.PosDef, which includes symmetry, and X<0X<0X<0 is (-X).PosDef. λmax⁡\lambda_{\max}λmax​ is the least Rayleigh bound, IsLamMax, never a supremum of a possibly empty set.

The vertices are not permuted into Frobenius form. The hypotheses say instead that:

  • every component is nonempty;
  • every component is strongly connected inside itself;
  • every edge between components points forward in the order;
  • every vertex is reachable from a pinned vertex.

The weights Πj\Pi_jΠj​ are tied to the paper's object by ΠjTAj=0\Pi_j^{\mathsf T}A_j=0ΠjT​Aj​=0. The standing assumptions of p. 1402 (Assumption 1, KΓ=ΓKK\Gamma=\Gamma KKΓ=ΓK, θ=λmax⁡((K+KT)/2)≥0\theta=\lambda_{\max}((K+K^{\mathsf T})/2)\ge0θ=λmax​((K+KT)/2)≥0, Γ>0\Gamma>0Γ>0) are hypotheses of every goal-level statement. The goal does not assume the weights Δj\Delta_jΔj​, the bound (4.10), or definiteness of a whole-network matrix; it assumes only (4.8) on each component, so it cannot be trivialized by assuming its own conclusion. For n=0n=0n=0 the λmax⁡\lambda_{\max}λmax​ hypothesis cannot be met, so that degenerate dimension is excluded.

The pages contain three misprints. (4.10) has "−c-c−c" in its third line and "++++++" in its last; the last line, with a single +++, is formalized. Corollary 4.9 ranges "i=1,…,Ni=1,\dots,Ni=1,…,N" where the component range is meant.

A complete development needs a Gronwall-type decay lemma on [0,∞)[0,\infty)[0,∞), the strict Schur complement, definiteness of Kronecker products, and the square root of a positive definite matrix commuting with matrices that commute with it. Each of these is reusable well beyond this mission, and contributions to any of them are welcome, as are proofs of the milestones in any order.

Selected references

  • W. Yu, G. Chen, J. Lü, J. Kurths, Synchronization via pinning control on general complex networks, SIAM J. Control Optim. 51(2) (2013), 1395–1416. https://doi.org/10.1137/100781699
  • X. F. Wang, G. Chen, Pinning control of scale-free dynamical networks, Physica A 310 (2002), 521–531. https://doi.org/10.1016/S0378-4371(02)00772-0
  • T. Chen, X. Liu, W. Lu, Pinning complex networks by a single controller, IEEE Trans. Circuits Syst. I 54(6) (2007), 1317–1326. https://doi.org/10.1109/TCSI.2007.895383
  • S. Boyd, L. El Ghaoui, E. Feron, V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, 1994. https://doi.org/10.1137/1.9781611970777
  • R. A. Brualdi, H. J. Ryser, Combinatorial Matrix Theory, Cambridge University Press, 1991. https://doi.org/10.1017/CBO9781107325708
7 thms2 active usersReviewed
AnalysisConvex OptimizationOptimization·Captain: mikedeng1

A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights I: The ODE Ẍ + (3/t)Ẋ + ∇f(X) = 0 with X(0) = x₀, Ẋ(0) = 0 Has a Unique Global SolutionResearch Paper

Why this ODE needs a well-posedness theorem

Nesterov’s accelerated gradient method is a discrete procedure for minimizing a smooth convex function. Its iterates use both a gradient step and a momentum term, so the position at the next step depends on recent motion as well as on the current gradient. Su, Boyd, and Candès study a continuous-time model of that behavior: a trajectory whose acceleration is driven by the negative gradient and opposed by a time-dependent damping term. The model is useful only if its prescribed starting point determines an actual trajectory. The first theorem of the paper supplies that guarantee for the damping coefficient 3/t3/t3/t. Su, Boyd, and Candès, 2015, Theorem 1.

The coefficient 3/t3/t3/t is undefined at the stated initial time t=0t=0t=0. Standard results for differential equations with a continuous right-hand side at the initial time therefore cannot be applied directly. The existence and uniqueness claim is substantive: it makes the trajectory used in the paper’s later rate and restart theorems a defined mathematical object, including its behavior at the singular endpoint. The source proves the result; this mission asks for a machine-checked formalization of its statement and its supporting appendix lemmas.

The setting

Fix a dimension nnn, a starting point x0∈Rnx_0\in\mathbb R^nx0​∈Rn, and a real-valued objective fff. For a constant L>0L>0L>0, the paper’s class FL\mathcal F_LFL​ consists of functions that are convex, continuously differentiable, and have an LLL-Lipschitz gradient:

∥∇f(x)−∇f(y)∥≤L∥x−y∥for all x,y∈Rn.\|\nabla f(x)-\nabla f(y)\|\le L\|x-y\| \qquad\text{for all }x,y\in\mathbb R^n.∥∇f(x)−∇f(y)∥≤L∥x−y∥for all x,y∈Rn.

The larger class F∞\mathcal F_\inftyF∞​ is the union of these classes over positive LLL. In particular, the objective need not be strongly convex and need not have a minimizer for this mission.

A solution is a position X:[0,∞)→RnX:[0,\infty)\to\mathbb R^nX:[0,∞)→Rn and its velocity V=X˙V=\dot XV=X˙, starting at X(0)=x0X(0)=x_0X(0)=x0​ and V(0)=0V(0)=0V(0)=0, that satisfy equation (3) at every positive time:

V˙(t)+3tV(t)+∇f(X(t))=0,t>0.\dot V(t)+\frac{3}{t}V(t)+\nabla f(X(t))=0,\qquad t>0.V˙(t)+t3​V(t)+∇f(X(t))=0,t>0.

The trajectory is continuously differentiable through the initial endpoint, with a right derivative there, and twice continuously differentiable for t>0t>0t>0. The paper also uses a smoothed equation indexed by δ>0\delta>0δ>0, replacing 3/t3/t3/t with 3/max⁡(δ,t)3/\max(\delta,t)3/max(δ,t). Its solutions are denoted XδX_\deltaXδ​, and its velocity-growth quantity is

Mδ(t)=sup⁡0<u≤t∥X˙δ(u)∥u.M_\delta(t)=\sup_{0<u\le t}\frac{\|\dot X_\delta(u)\|}{u}.Mδ​(t)=0<u≤tsup​u∥X˙δ​(u)∥​.

For local uniqueness, two solutions X,YX,YX,Y on [0,a)[0,a)[0,a) are compared using M~(t)=sup⁡0≤u<t∥X˙(u)−Y˙(u)∥\widetilde M(t)=\sup_{0\le u<t}\|\dot X(u)-\dot Y(u)\|M(t)=sup0≤u<t​∥X˙(u)−Y˙(u)∥. These quantities appear in the appendix lemmas and are represented by pointwise bounds in the formal statements.

Formalization targets

The goal is Theorem 1, the well-posedness of equation (3). For every f∈F∞f\in\mathcal F_\inftyf∈F∞​ and every x0x_0x0​, it asserts both existence of a global trajectory with the regularity above and uniqueness on nonnegative time:

∃X solving (3) from (x0,0),X,Y both solve (3) from (x0,0)⟹X(t)=Y(t)(t≥0).\exists X\ \text{solving (3) from }(x_0,0), \qquad X,Y\ \text{both solve (3) from }(x_0,0) \Longrightarrow X(t)=Y(t)\quad(t\ge0).∃X solving (3) from (x0​,0),X,Y both solve (3) from (x0​,0)⟹X(t)=Y(t)(t≥0).

The milestone list follows the numbered statements in Appendix A. Lemma 16 controls the change in ∇f\nabla f∇f along a smoothed trajectory. Lemmas 15 and 17 bound MδM_\deltaMδ​ on the initial smoothing interval and beyond it, with the explicit thresholds δ<6/L\delta<\sqrt{6/L}δ<6/L​ and t<12/Lt<\sqrt{12/L}t<12/L​. Lemma 18 states that the family of smoothed trajectories with δ=3/L/2m\delta=\sqrt{3/L}/2^mδ=3/L​/2m is uniformly bounded and equicontinuous on [0,6/L][0,\sqrt{6/L}][0,6/L​]. Lemma 14 gives existence for equation (3). Lemma 20 bounds the difference between gradients along two local solutions, and Lemma 19 gives uniqueness in a neighborhood of zero. The goal and milestones preserve the source’s domains, constants, and order of dependence.

What the result provides

Theorem 1 permits the rest of the paper to refer to “the” trajectory of equation (3) from a specified initial point. In particular, statements about its objective value, energy, and restarts need an actual trajectory, and uniqueness makes those statements independent of a choice of solution. The appendix estimates also provide reusable facts about this singular second-order equation: quantitative control of smoothed velocities and local agreement at the singular time.

The paper proves Theorem 1 and the seven listed lemmas on pp. 6 and 28–32. This mission does not claim a new analytical result. Its output would be checked Lean statements and, when solvers finish the proofs, a machine-checked development of the singular initial-value problem. The formal definitions are shared by all items in this mission; the lemmas can be reused in later formal work on accelerated gradient trajectories. No machine-checked proof of these particular statements is being claimed by the draft proposal.

The central difficulty

The initial time is precisely where the damping 3/t3/t3/t has no finite value. Treating the problem as an ordinary initial-value problem at t=0t=0t=0 leaves the differential equation undefined there. Imposing the equation at t=0t=0t=0 after Lean’s total division would instead change it: Lean assigns a value to division by zero, while the paper imposes equation (3) only for t>0t>0t>0. The demanded derivative at zero is one-sided, and control of the behavior as t↓0t\downarrow0t↓0 is part of the result.

The smoothed equations are regular at zero, but a statement about each smoothed trajectory does not by itself give a solution of the original singular equation. The appendix’s uniform bounds and equicontinuity are formulated on a common compact interval for a specified sequence of smoothing parameters. Uniqueness has a second boundary issue: local agreement near zero must be connected to ordinary uniqueness at positive time to obtain agreement for every t≥0t\ge0t≥0.

Formalization scope

The Lean space is EuclideanSpace R (Fin n)\mathrm{EuclideanSpace}\ \mathbb R\ (\mathrm{Fin}\ n)EuclideanSpace R (Fin n), with its Euclidean norm; nnn is arbitrary. The objective class includes convexity, C1C^1C1 regularity, a positive Lipschitz constant, and a globally Lipschitz gradient. A solution is encoded as a pair (X,V)(X,V)(X,V), so V=X˙V=\dot XV=X˙ is witnessed by derivative assertions rather than by a total derivative operator. The initial conditions specify X(0)=x0X(0)=x_0X(0)=x0​, V(0)=0V(0)=0V(0)=0, a right derivative of XXX, and right continuity of VVV. The differential equation and ordinary derivatives are required only at positive times. For the smoothed equation, δ>0\delta>0δ>0 is part of the solution predicate.

These choices rule out a vacuous solution predicate and prevent division by zero from defining a different equation. Lean functions are represented on all real times, but the source’s solution lives on [0,∞)[0,\infty)[0,∞); uniqueness is therefore equality on that half-line. At negative times the formal representatives are unrestricted. The paper’s real suprema MδM_\deltaMδ​ and M~\widetilde MM are expressed as bounds on every member of their defining ranges, so an empty or unbounded real supremum cannot acquire a misleading default value. Every denominator in Lemmas 15 and 17 has the paper’s strict threshold in its hypotheses.

A full proof development needs ordinary differential equation existence and uniqueness at positive time, continuity and derivative facts at the right endpoint, and compactness of uniformly bounded equicontinuous families. The definitions of the objective class and solution predicates, the quantitative estimates, and the local uniqueness statement are welcome solver contributions. The target is the source theorem with its stated hypotheses and conclusion; a special objective, a weakened time interval, or a proof by an impossible hypothesis does not close it.

Selected references

  • Weijie Su, Stephen Boyd, and Emmanuel J. Candès, A Differential Equation for Modeling Nesterov’s Accelerated Gradient Method: Theory and Insights, arXiv:1503.01243v2, 2015; published in Journal of Machine Learning Research 17(153), 2016. Preprint.
9 thms2 active usersReviewed
Markov ChainProbabilityStochastic Systems·Captain: mikedeng1

Coexistence and Extinction for Stochastic Kolmogorov Systems 1: If Every Boundary Ergodic Measure Repels, X Converges Exponentially Fast in Total Variation to a Unique Interior Stationary LawResearch Paper

Motivation

Whether interacting species can coexist in a fluctuating environment is one of the basic questions of mathematical ecology. Deterministic models (Lotka–Volterra competition, predator–prey systems, food chains) answer it through invasion criteria: a population persists if, whenever it is rare, it grows. In a random environment the analogous criterion is phrased through Lyapunov exponents (long-run per-capita growth rates) computed against stationary distributions of the subcommunities in which some species are absent. Schreiber, Benaïm and Atchadé ([SBA11], J. Math. Biol. 62 (2011), MR 2786721) proved such a criterion for stochastic differential equations on a compact state space; A. Hening and D. H. Nguyen (arXiv:1704.06984, Ann. Appl. Probab. 2018) extended it to the non-compact orthant R+n\mathbb R^n_+R+n​, which is where population sizes actually live, and added an exponential rate of convergence.

Timeline. [SBA11] (2011) gave the compact-state SDE criterion via a minimax principle; Hening and Nguyen (2017/2018) removed compactness, proved convergence in total variation at a geometric rate, and in the same paper gave matching extinction results (the second and third missions of this series).

Setting

Let n≥1n\ge1n≥1 be the number of populations and X(t)=(X1(t),…,Xn(t))∈R+n=[0,∞)nX(t)=(X_1(t),\dots,X_n(t))\in\mathbb R^n_+=[0,\infty)^nX(t)=(X1​(t),…,Xn​(t))∈R+n​=[0,∞)n their sizes. The stochastic Kolmogorov system is

dXi(t)=Xi(t)fi(X(t)) dt+Xi(t)gi(X(t)) dEi(t),i=1,…,n,dX_i(t)=X_i(t)f_i(X(t))\,dt+X_i(t)g_i(X(t))\,dE_i(t),\qquad i=1,\dots,n,dXi​(t)=Xi​(t)fi​(X(t))dt+Xi​(t)gi​(X(t))dEi​(t),i=1,…,n,

where fif_ifi​ are per-capita growth rates, gig_igi​ noise intensities, and E(t)=Γ⊤B(t)E(t)=\Gamma^\top B(t)E(t)=Γ⊤B(t) with BBB an nnn-dimensional standard Brownian motion and Σ=Γ⊤Γ=(σij)\Sigma=\Gamma^\top\Gamma=(\sigma_{ij})Σ=Γ⊤Γ=(σij​). Write R+n,∘=(0,∞)n\mathbb R^{n,\circ}_+=(0,\infty)^nR+n,∘​=(0,∞)n for the states with all species present, ∂R+n\partial\mathbb R^n_+∂R+n​ for its complement (some species absent) and ∥x∥=∑i∣xi∣\|x\|=\sum_i|x_i|∥x∥=∑i​∣xi​∣.

Assumption 1.1 (standing) requires: the matrix (gi(x)gj(x)σij)(g_i(x)g_j(x)\sigma_{ij})(gi​(x)gj​(x)σij​) is positive definite on R+n\mathbb R^n_+R+n​; fi,gif_i,g_ifi​,gi​ are locally Lipschitz; and for some c∈R+n,∘c\in\mathbb R^{n,\circ}_+c∈R+n,∘​, γb>0\gamma_b>0γb​>0,

lim sup⁡∥x∥→∞[∑icixifi(x)1+c⊤x−12∑i,jσijcicjxixjgi(x)gj(x)(1+c⊤x)2+γb(1+∑i(∣fi(x)∣+gi2(x)))]<0,\limsup_{\|x\|\to\infty}\Big[\frac{\sum_ic_ix_if_i(x)}{1+c^\top x}-\frac12\frac{\sum_{i,j}\sigma_{ij}c_ic_jx_ix_jg_i(x)g_j(x)}{(1+c^\top x)^2}+\gamma_b\Big(1+\sum_i(|f_i(x)|+g_i^2(x))\Big)\Big]<0,∥x∥→∞limsup​[1+c⊤x∑i​ci​xi​fi​(x)​−21​(1+c⊤x)2∑i,j​σij​ci​cj​xi​xj​gi​(x)gj​(x)​+γb​(1+i∑​(∣fi​(x)∣+gi2​(x)))]<0,

a dissipativity condition satisfied by logistic and competitive Lotka–Volterra models.

PX(t,x,⋅)P_X(t,x,\cdot)PX​(t,x,⋅) is the law of X(t)X(t)X(t) started at xxx. A probability measure μ\muμ is invariant if ∫PX(t,x,⋅) μ(dx)=μ\int P_X(t,x,\cdot)\,\mu(dx)=\mu∫PX​(t,x,⋅)μ(dx)=μ for all ttt; ergodic invariant measures are the extreme points of that convex set. M\mathcal MM is the set of ergodic invariant probability measures supported on ∂R+n\partial\mathbb R^n_+∂R+n​ (it contains the Dirac mass δ∗\delta^*δ∗ at 000), and Conv(M)\mathrm{Conv}(\mathcal M)Conv(M) its finite convex combinations. The Lyapunov exponent of species iii at μ\muμ is

λi(μ)=∫(fi(x)−σiigi2(x)2)μ(dx).\lambda_i(\mu)=\int\Big(f_i(x)-\frac{\sigma_{ii}g_i^2(x)}{2}\Big)\mu(dx).λi​(μ)=∫(fi​(x)−2σii​gi2​(x)​)μ(dx).

Assumption 1.2: max⁡iλi(μ)>0\max_i\lambda_i(\mu)>0maxi​λi​(μ)>0 for every μ∈Conv(M)\mu\in\mathrm{Conv}(\mathcal M)μ∈Conv(M) — every boundary state is invadable by some missing species.

Formalization targets

Goal: Theorem 1.1 (p. 6)

Under Assumptions 1.1 and 1.2 there is an invariant probability measure π∗\pi^*π∗ with π∗(R+n,∘)=1\pi^*(\mathbb R^{n,\circ}_+)=1π∗(R+n,∘​)=1, it is the only invariant probability measure concentrated on R+n,∘\mathbb R^{n,\circ}_+R+n,∘​, and for some r∈(0,1)r\in(0,1)r∈(0,1) and every x∈R+n,∘x\in\mathbb R^{n,\circ}_+x∈R+n,∘​ there is CxC_xCx​ with

∥PX(t,x,⋅)−π∗∥TV≤Cx rt,t≥0.\|P_X(t,x,\cdot)-\pi^*\|_{TV}\le C_x\,r^t,\qquad t\ge0.∥PX​(t,x,⋅)−π∗∥TV​≤Cx​rt,t≥0.

This is strong stochastic persistence (Definition 1.1) with an exponential rate; it leaves the rate rrr and the constants unspecified, as the paper does.

Milestones

The milestones follow the proof: well-posedness, invariant faces and the moment bound (3.6) (Lemma 3.1); uniform moment bounds and the Feller property (Lemma 3.2); integrability under invariant measures (Lemma 3.3); δ∗∈M\delta^*\in\mathcal Mδ∗∈M; convergence of occupation-measure integrals (Lemma 3.4); the log-Laplace bound (Lemma 3.5); irreducibility, aperiodicity and petite compacts for the skeleton chain (Lemma 3.6); the weighted invasion rate (4.1); boundary repulsion on average (Lemma 4.1); the Lyapunov contraction near the boundary (Proposition 4.1); the geometric drift (4.18); geometric ergodicity of the skeleton chain (4.26).

Significance

The result. Theorem 1.1 turns coexistence into a checkable condition on boundary subcommunities: one computes invasion rates of missing species against the stationary laws of the smaller systems. It is the persistence half of a dichotomy whose extinction half (Theorems 1.2–1.3) uses the same exponents, and it underlies the classification of stochastic food chains in the paper's own §2 (Theorem 2.1). The exponential rate gives quantitative mixing and supports further limit theorems for time averages.

Formalizing it. The theorem is proved in the paper but no machine-checked proof is recorded in this mission. A formalization exercises a chain of tools largely absent from current libraries: strong solutions of SDEs with locally Lipschitz coefficients on a closed orthant, the Feller property, tightness and weak limits of occupation measures, invariant and ergodic measures of diffusions, Meyn–Tweedie theory for skeleton chains, and log-Laplace (cumulant) estimates. Each milestone is a self-contained target; several (Lemma 3.5, the Meyn–Tweedie step) are independent of the population model.

Difficulty

The naive argument — positive invasion rates at each boundary ergodic measure imply that the process is pushed away from the boundary — fails twice. First, the state space is non-compact, so occupation measures need not be tight and the growth-rate functionals are unbounded; Assumption 1.1(3) and the moment bounds of Lemmas 3.2–3.4 are what replace compactness. Second, invasion rates are averages along the boundary dynamics, not pointwise drifts: the Lyapunov function V(x)=(1+c⊤x)/∏ixipiV(x)=(1+c^\top x)/\prod_ix_i^{p_i}V(x)=(1+c⊤x)/∏i​xipi​​ decreases only on average over a time window of length T∗T^*T∗, and turning this into a uniform contraction of VθV^\thetaVθ requires controlling the full log-Laplace transform of the increment ln⁡V(X(T))−ln⁡V(x)\ln V(X(T))-\ln V(x)lnV(X(T))−lnV(x) (Proposition 4.1), not just its mean. Uniformity of all constants in the starting point is the delicate part.

Formalization scope

The process is a family X x of strong solutions, one from each x∈R+nx\in\mathbb R^n_+x∈R+n​, on one probability space driven by one Brownian motion, using the published Ethier–Kurtz definitions SolvesBrownianSDE and IsStandardBrownian on Rn=\mathbb R^n=Rn= SDEState n. Coordinates are Fin n; n≥1n\ge1n≥1. The coefficients are functions on Rn\mathbb R^nRn read at the positive part x+x^+x+, which agrees with the model on R+n\mathbb R^n_+R+n​. The norm is ℓ1\ell^1ℓ1. Invariance is stated through the transition probabilities PX(t,x,⋅)=P_X(t,x,\cdot)=PX​(t,x,⋅)= law of Xx(t)X^x(t)Xx(t); ergodic means extremal invariant. The lim sup⁡<0\limsup<0limsup<0 of (1.2) is written as "≤−ε\le-\varepsilon≤−ε for ∥x∥≥R\|x\|\ge R∥x∥≥R". Total variation is the published MarkovChainCLT.tvDist, sup⁡A∣μ(A)−ν(A)∣\sup_A|\mu(A)-\nu(A)|supA​∣μ(A)−ν(A)∣; the paper does not fix the factor 222, and geometric convergence is insensitive to it. The constants M>0,δ0M>0,\delta_0M>0,δ0​ of §3 are data satisfying (3.1), (3.2); HHH is the supremum (3.5).

Deviations, all disclosed in the items: aperiodicity is the Meyn–Tweedie notion (no cycle of d≥2d\ge2d≥2 nonempty disjoint sets), because the literal definition on p. 15 makes every chain aperiodic; (4.1), cited from [SBA11, Lemma 4], retains the attained minimum 2ρ∗2\rho^*2ρ∗ and is stated only in the direction used. Lemma 3.5 allows K2K_2K2​ to depend on the fixed θ0\theta_0θ0​ as its proof requires, despite the page saying “only on K1K_1K1​”. Expectations of nonnegative quantities are lower Lebesgue integrals; wherever a Bochner integral appears, its integrability is part of the conclusion.

Trivializing readings are excluded: uniqueness is among invariant measures on R+n,∘\mathbb R^{n,\circ}_+R+n,∘​ only (boundary invariant measures always exist), M\mathcal MM is nonempty (δ∗∈M\delta^*\in\mathcal Mδ∗∈M is a milestone, so Assumption 1.2 is never vacuous), and every existential constant is quantified before the points it must be uniform in. The logistic model on p. 4 gives a nonvacuous instance of Assumption 1.1.

Contributions welcome: general SDE well-posedness on invariant closed sets, Feller and tightness results for diffusions, Meyn–Tweedie geometric ergodicity for kernels, and cumulant-generating-function bounds, all reusable beyond this mission.

Selected references

  • A. Hening, D. H. Nguyen, Coexistence and extinction for stochastic Kolmogorov systems, Ann. Appl. Probab. 28(3), 2018. arXiv:1704.06984v1. https://arxiv.org/abs/1704.06984
  • S. J. Schreiber, M. Benaïm, K. A. S. Atchadé, Persistence in fluctuating environments, J. Math. Biol. 62(5), 655–683, 2011. MR 2786721, https://mathscinet.ams.org/mathscinet-getitem?mr=2786721
  • S. P. Meyn, R. L. Tweedie, Stability of Markovian processes I: criteria for discrete-time chains, Adv. Appl. Probab. 24(3), 542–574, 1992. MR 1174380, https://mathscinet.ams.org/mathscinet-getitem?mr=1174380
  • R. Khasminskii, Stochastic Stability of Differential Equations, 2nd ed., Springer, 2012. MR 2894052, https://mathscinet.ams.org/mathscinet-getitem?mr=2894052
20 thms2 active usersReviewed
Harmonic AnalysisMachine LearningProbability·Captain: mikedeng1

Approximation Bounds for Random Neural Networks and Reservoir Systems II: Echo State Networks with Random Weights Approximate Regular Functionals with an Explicit L² Error Bound (Theorem 2)Research Paper

Motivation

Reservoir computing learns an input/output system from data in two stages. A dynamical system, the reservoir, is driven by the input sequence and its state is recorded; then only a linear readout of that state is trained, by least squares. The echo state network (ESN) is the most widely used reservoir: its state evolves by xt=σ(Axt−1+Czt+ζ)x_t = \sigma(Ax_{t-1} + Cz_t + \zeta)xt​=σ(Axt−1​+Czt​+ζ), with the matrices A,CA, CA,C and the vector ζ\zetaζ drawn at random and never trained. ESNs predict chaotic systems well in practice (Jaeger & Haas, Science 2004), and they are known to be universal: for every fading-memory input/output map some ESN approximates it (Grigoryeva & Ortega, Neural Netw. 2018). Universality does not explain the practice, where the reservoir weights are random and fixed in advance. Gonon, Grigoryeva & Ortega (Ann. Appl. Probab. 2023) prove that an ESN whose weights are drawn from an explicit distribution that does not depend on the target approximates every sufficiently regular target, with an explicit L2L^2L2 error bound. This mission formalizes that result, Theorem 2, and the chain of results its proof rests on.

Setting

Time runs over Z−={0,−1,−2,… }\mathbb Z_- = \{0, -1, -2, \dots\}Z−​={0,−1,−2,…}. Inputs take values in a set DdD_dDd​ with 0∈Dd⊂BM⊂Rd0 \in D_d \subset B_M \subset \mathbb R^d0∈Dd​⊂BM​⊂Rd, where BMB_MBM​ is the closed Euclidean ball of radius M>0M > 0M>0. The input Z=(Zt)t∈Z−Z = (Z_t)_{t \in \mathbb Z_-}Z=(Zt​)t∈Z−​​ is a DdD_dDd​-valued process with law μZ\mu_ZμZ​. The target is a functional H∗:(Dd)Z−→RH^* : (D_d)^{\mathbb Z_-} \to \mathbb RH∗:(Dd​)Z−​→R, the present output as a function of the whole input history. All norms are Euclidean.

Regularity. Fix weights w−i>0w_{-i} > 0w−i​>0 with ∑ii w−i<∞\sum_i i\, w_{-i} < \infty∑i​iw−i​<∞. H∗H^*H∗ is www-Lipschitz with constant L>0L > 0L>0 if ∣H∗(u)−H∗(v)∣≤L∑i≥0w−i∥u−i−v−i∥|H^*(u) - H^*(v)| \le L\sum_{i \ge 0} w_{-i}\|u_{-i} - v_{-i}\|∣H∗(u)−H∗(v)∣≤L∑i≥0​w−i​∥u−i​−v−i​∥. Assumption 1 asks, in addition, for every T≥1T \ge 1T≥1: with q=d(T+1)q = d(T+1)q=d(T+1), the truncation HT∗(z0,…,z−T)=H∗(…,0,z−T,…,z0)H^*_T(z_0, \dots, z_{-T}) = H^*(\dots, 0, z_{-T}, \dots, z_0)HT∗​(z0​,…,z−T​)=H∗(…,0,z−T​,…,z0​) has a Fourier representation HT∗(u)=∫Rqei⟨w,u⟩gT(w) dwH^*_T(u) = \int_{\mathbb R^q} e^{i\langle w, u\rangle} g_T(w)\,dwHT∗​(u)=∫Rq​ei⟨w,u⟩gT​(w)dw on (Dd)T+1(D_d)^{T+1}(Dd​)T+1, with gT∈L1g_T \in L^1gT​∈L1 and ∫max⁡(1,∥w∥3)∣gT(w)∣2 dw<∞\int \max(1, \|w\|^3)|g_T(w)|^2\,dw < \infty∫max(1,∥w∥3)∣gT​(w)∣2dw<∞.

The random ESN. Fix T,N≥1T, N \ge 1T,N≥1, R>0R > 0R>0, and a bound MTM_TMT​ with ∥(Z0,…,Z−T)∥≤MT\|(Z_0, \dots, Z_{-T})\| \le M_T∥(Z0​,…,Z−T​)∥≤MT​ almost surely. Draw A1,…,ANA_1, \dots, A_NA1​,…,AN​ i.i.d. uniform on BR⊂RqB_R \subset \mathbb R^qBR​⊂Rq and, independently, ζ1,…,ζN\zeta_1, \dots, \zeta_Nζ1​,…,ζN​ i.i.d. uniform on [−max⁡(MTR,1),max⁡(MTR,1)][-\max(M_TR,1), \max(M_TR,1)][−max(MT​R,1),max(MT​R,1)]. With SSS the block shift on Rq\mathbb R^qRq and ccc the embedding of Rd\mathbb R^dRd into the first block, and aaa the matrix with rows Ai⊤A_i^\topAi⊤​, put

Aˉ=(S0aS0),Cˉ=(cac),ζˉ=(0ζ),A=(Aˉ−Aˉ−AˉAˉ),C=(Cˉ−Cˉ),ζ=(ζˉ−ζˉ).\bar A = \begin{pmatrix} S & 0\\ aS & 0\end{pmatrix},\quad \bar C = \begin{pmatrix} c\\ ac\end{pmatrix},\quad \bar\zeta = \begin{pmatrix} 0\\ \zeta\end{pmatrix},\quad A = \begin{pmatrix}\bar A & -\bar A\\ -\bar A & \bar A\end{pmatrix},\quad C = \begin{pmatrix}\bar C\\ -\bar C\end{pmatrix},\quad \zeta = \begin{pmatrix}\bar\zeta\\ -\bar\zeta\end{pmatrix}.Aˉ=(SaS​00​),Cˉ=(cac​),ζˉ​=(0ζ​),A=(Aˉ−Aˉ​−AˉAˉ​),C=(Cˉ−Cˉ​),ζ=(ζˉ​−ζˉ​​).

The ESN is Xt=σ(AXt−1+CZt+ζ)X_t = \sigma(AX_{t-1} + CZ_t + \zeta)Xt​=σ(AXt−1​+CZt​+ζ), Yt=WXtY_t = WX_tYt​=WXt​, with σ(x)=max⁡(x,0)\sigma(x) = \max(x, 0)σ(x)=max(x,0) and state space R2(N+d(T+1))\mathbb R^{2(N+d(T+1))}R2(N+d(T+1)).

Formalization targets

Goal: Theorem 2 (p. 54)

For every H∗H^*H∗ satisfying Assumption 1 there is a readout WWW, a function of the random weights alone, such that the ESN has the echo state property (a unique state sequence for every input) and

E[∣Y0−H∗(Z)∣2]1/2≤CT,RN+∫Rq∖BR∣gT(u)∣ du+LM∑i>Tw−i,\mathbb E\big[|Y_0 - H^*(Z)|^2\big]^{1/2} \le \frac{\sqrt{C_{T,R}}}{\sqrt N} + \int_{\mathbb R^q \setminus B_R}|g_T(u)|\,du + LM\sum_{i > T} w_{-i},E[∣Y0​−H∗(Z)∣2]1/2≤N​CT,R​​​+∫Rq∖BR​​∣gT​(u)∣du+LMi>T∑​w−i​,

with CT,R=16max⁡(MTR,1)Volq(BR)(MT+1)2(MT3+MT+16)∫BRmax⁡(1,∥u∥3)∣gT(u)∣2 duC_{T,R} = 16\max(M_TR,1)\mathrm{Vol}_q(B_R)(M_T+1)^2(M_T^3+M_T+16)\int_{B_R}\max(1,\|u\|^3)|g_T(u)|^2\,duCT,R​=16max(MT​R,1)Volq​(BR​)(MT​+1)2(MT3​+MT​+16)∫BR​​max(1,∥u∥3)∣gT​(u)∣2du.

Milestones

  1. (8), p. 33: a scalar identity expressing eiz−iz−1e^{iz} - iz - 1eiz−iz−1 as an integral of ReLU ramps.
  2. Proposition 2, pp. 31–32: under a Fourier condition, fff is an integral of ReLU ridge functions with a compactly supported, square-integrable weight π\piπ.
  3. Proposition 3, pp. 41–42: a static ReLU network with uniformly sampled inner weights achieves mean-square error C∗/NC^*/NC∗/N.
  4. Corollary 1, p. 43: the same with a dimension-free integrability condition and a truncation term.
  5. Remark 10, p. 53: the shift reservoir is nilpotent, has K=IK = IK=I and stores the last T+1T+1T+1 inputs.
  6. Proposition 6, p. 51: a linear reservoir with a random ReLU readout satisfies the bound (54).
  7. (64)–(66), pp. 55–56: every solution of the ESN reduces to the linear shift reservoir, which gives uniqueness.

Significance

Theorem 2 is the first approximation bound for echo state networks whose recurrent and input weights are sampled from a generic distribution rather than constructed from the target. The bound separates three error sources: a Monte Carlo term decaying like N−1/2N^{-1/2}N−1/2, a truncation term in the sampling radius RRR, and a memory term in the window length TTT. Because the readout can be taken to be the least-squares readout, the bound also controls the trained networks used in practice, and it is the input to the paper's rate and universality corollaries (Corollaries 4 and 5).

Status: the result is proved on paper. No part of it is formalized; the only reservoir-computing material on the platform is the published definition ReservoirESN (the state equation), which this mission reuses. A formal proof would supply the first machine-checked random-feature approximation bound with explicit constants.

Difficulty

The obvious argument fails in two places. First, the classical integral representations of Barron type place the inner weights on unbounded sets, which cannot be sampled uniformly; Proposition 2 needs a change of variables that makes the weight compactly supported while keeping it square integrable, and this costs the factor R−(2q+2)R^{-(2q+2)}R−(2q+2) and the condition (5). Second, a ReLU network is not contractive, so the echo state property of the ESN cannot be taken from the standard contraction criterion; it has to be derived from the block structure of AAA, which makes the difference of the two state halves follow a nilpotent linear recursion.

Formalization scope

Rq\mathbb R^qRq is EuclideanSpace ℝ (Fin (T+1) × Fin d), block kkk holding z−kz_{-k}z−k​; input sequences are ℕ → EuclideanSpace ℝ (Fin d) with index k=−tk = -tk=−t, and xt=F(xt−1,zt)x_t = F(x_{t-1}, z_t)xt​=F(xt−1​,zt​) is the published ReservoirESN.IsSolution. Points of Rq+1\mathbb R^{q+1}Rq+1 are pairs with norm (∥w∥2+u2)1/2(\|w\|^2 + u^2)^{1/2}(∥w∥2+u2)1/2. The uniform laws are Lebesgue measure conditioned on the ball or interval; NNN i.i.d. rows have the product law. The input is independent of the weights (§4.1) and DdD_dDd​-valued with 0∈Dd⊂BM0 \in D_d \subset B_M0∈Dd​⊂BM​ (§5.1): expectations are iterated lower Lebesgue integrals over μZ\mu_ZμZ​ and the product law, and probability-(1−δ)(1-\delta)(1−δ) statements bound the product measure of the bad set. The scalar output case m=1m = 1m=1 is used, as in the paper. Assumption 1 is required for every T≥1T \ge 1T≥1, as printed.

A readout allowed to depend on the input would make every bound trivial; in every statement the readout is a measurable function of the inner weights alone.

Departures from the print, each disclosed in the item: the last term of Proposition 6 is the L2(μZ)L^2(\mu_Z)L2(μZ​) norm of ∥K−1ST+1X−T−1∥\|K^{-1}S^{T+1}X_{-T-1}\|∥K−1ST+1X−T−1​∥, which the page prints outside the expectation; the state space of the linear reservoir (52) is a parameter DND_NDN​, as in §2.1, and its solution is assumed to be a random process; Proposition 3 omits "C∗>0C^* > 0C∗>0" (the explicit value (33) is used); measurability of the Fourier density ggg is stated where the page leaves it implicit.

A complete development needs Fourier integrals on Euclidean spaces, change of variables under linear maps, product measures and Fubini–Tonelli, and an importance-sampling variance bound. The static results (Propositions 2, 3, Corollary 1) are reusable for random-feature models beyond reservoir computing. Proofs of any milestone, and alternative arguments, are welcome.

Selected references

  • L. Gonon, L. Grigoryeva, J.-P. Ortega, Approximation bounds for random neural networks and reservoir systems, Ann. Appl. Probab. 33(1), 28–69, 2023. https://doi.org/10.1214/22-AAP1806
  • L. Grigoryeva, J.-P. Ortega, Echo state networks are universal, Neural Netw. 108, 495–508, 2018. https://doi.org/10.1016/j.neunet.2018.08.025
  • H. Jaeger, H. Haas, Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication, Science 304, 78–80, 2004. https://doi.org/10.1126/science.1091277
  • A. R. Barron, Universal approximation bounds for superpositions of a sigmoidal function, IEEE Trans. Inf. Theory 39, 930–945, 1993. https://doi.org/10.1109/18.256500
  • J. M. Klusowski, A. R. Barron, Approximation by combinations of ReLU and squared ReLU ridge functions with ℓ1 and ℓ0 controls, IEEE Trans. Inf. Theory 64, 7649–7656, 2018. https://doi.org/10.1109/tit.2018.2874447
  • C. Cuchiero, L. Gonon, L. Grigoryeva, J.-P. Ortega, J. Teichmann, Discrete-time signatures and randomness in reservoir computing, IEEE Trans. Neural Netw. Learn. Syst., 2021. https://doi.org/10.1109/TNNLS.2021.3076777
11 thms2 active usersReviewed
Machine LearningProbability·Captain: mikedeng1

Approximation Bounds for Random Neural Networks and Reservoir Systems III: Echo State Networks with Output Feedback and Random Weights Approximate Contracting Reservoirs (Theorem 4)Research Paper

Motivation

An echo state network with output feedback is a recurrent model whose previous output is fed back into its next hidden-state update. In reservoir computing only the linear output weights are trained, while the internal weights are fixed, typically after being drawn at random. This raises a quantitative question: if the internal rows are sampled from a fixed law, can a network with NNN blocks of random rows and a suitable linear readout approximate a given input–output rule, and at what rate in NNN? Gonon, Grigoryeva and Ortega answer this for targets generated by contracting reservoir systems. Their Theorem 4 (p. 63) gives, with explicit constants, a probability bound and an excess-risk bound of order 1/N1/\sqrt N1/N​, plus a term decaying geometrically in the length TTT of the observation window. The input set is not required to be bounded: the bound depends on the input process only through E[max⁡t∥Zt∥]\mathbb E[\max_{t}\|Z_t\|]E[maxt​∥Zt​∥] over the window.

Setting

Inputs are vectors in a set Dd⊆RdD_d\subseteq\mathbb R^dDd​⊆Rd and an input history is z=(zt)t∈Z−z=(z_t)_{t\in\mathbb Z_-}z=(zt​)t∈Z−​​, with Z−={0,−1,−2,… }\mathbb Z_-=\{0,-1,-2,\dots\}Z−​={0,−1,−2,…}. A target reservoir is a map F∗:RN∗×Dd→BMF^*:\mathbb R^{N^*}\times D_d\to B_MF∗:RN∗×Dd​→BM​, with BMB_MBM​ the closed Euclidean ball of radius MMM, such that F∗(⋅,v)F^*(\cdot,v)F∗(⋅,v) is an rrr-contraction for every v∈Ddv\in D_dv∈Dd​, with r∈(0,1)r\in(0,1)r∈(0,1). Its reservoir functional is H∗(z)=x0∗H^*(z)=x^*_0H∗(z)=x0∗​, where xt∗=F∗(xt−1∗,zt)x^*_t=F^*(x^*_{t-1},z_t)xt∗​=F∗(xt−1∗​,zt​) for all t∈Z−t\in\mathbb Z_-t∈Z−​. The output dimension is m=N∗m=N^*m=N∗.

The approximating network has NNN blocks of N∗N^*N∗ rows. Each row is a vector ω=(a,c,ζ)∈RN∗+d+1\omega=(a,c,\zeta)\in\mathbb R^{N^*+d+1}ω=(a,c,ζ)∈RN∗+d+1, and the Nˉ=NN∗\bar N=NN^*Nˉ=NN∗ rows Uj(i)U_j^{(i)}Uj(i)​ of [A,C,ζ][A,C,\zeta][A,C,ζ] are i.i.d. with law π\piπ. With an activation σ\sigmaσ and a readout matrix W∈Mm,NˉW\in\mathbb M_{m,\bar N}W∈Mm,Nˉ​, the system is

xt=σ(Ayt−1+Czt+ζ),yt=Wxt,t=−T,…,0,y−T−1=Ξ,x_t=\sigma(Ay_{t-1}+Cz_t+\zeta),\qquad y_t=Wx_t,\qquad t=-T,\dots,0,\qquad y_{-T-1}=\Xi,xt​=σ(Ayt−1​+Czt​+ζ),yt​=Wxt​,t=−T,…,0,y−T−1​=Ξ,

with T≥1T\ge1T≥1 and ∥Ξ∥≤M\|\Xi\|\le M∥Ξ∥≤M; its functional is HWA,C,ζ(z)=y0H^{A,C,\zeta}_W(z)=y_0HWA,C,ζ​(z)=y0​. For each k≥1k\ge1k≥1 and j=1,…,N∗j=1,\dots,N^*j=1,…,N∗ a signed measure πjk≪π\pi_j^k\ll\piπjk​≪π defines the integral map

Fj∗,N(x,v)=∫σ((x,v,1)⋅ω) πjN(dω).F_j^{*,N}(x,v)=\int\sigma((x,v,1)\cdot\omega)\,\pi_j^N(d\omega).Fj∗,N​(x,v)=∫σ((x,v,1)⋅ω)πjN​(dω).

The constant C∗=43Lσsup⁡k∑j(∫∥ω∥2(dπjk/dπ)2dπ)1/2C_*=4\sqrt3L_\sigma\sup_{k}\sum_j(\int\|\omega\|^2(d\pi_j^k/d\pi)^2d\pi)^{1/2}C∗​=43​Lσ​supk​∑j​(∫∥ω∥2(dπjk​/dπ)2dπ)1/2 measures the size of these densities, and sN=E[max⁡t∈{0,…,−T}sup⁡x∈BM+1∥F∗,N(x,Zt)−F∗(x,Zt)∥]s_N=\mathbb E[\max_{t\in\{0,\dots,-T\}}\sup_{x\in B_{M+1}}\|F^{*,N}(x,Z_t)-F^*(x,Z_t)\|]sN​=E[maxt∈{0,…,−T}​supx∈BM+1​​∥F∗,N(x,Zt​)−F∗(x,Zt​)∥] is the approximation error of F∗,NF^{*,N}F∗,N. The input process ZZZ is independent of (A,C,ζ)(A,C,\zeta)(A,C,ζ), Y0Y_0Y0​ is an integrable target, and the loss L≥0L\ge0L≥0 is Lipschitz with constant LLL_LLL​. The echo state event ΩESP\Omega_{\mathrm{ESP}}ΩESP​ of (87) is the event that ∥WFA,C,ζ(x,Zt)∥≤M+1\|WF^{A,C,\zeta}(x,Z_t)\|\le M+1∥WFA,C,ζ(x,Zt​)∥≤M+1 for all x∈BM+1x\in B_{M+1}x∈BM+1​ and t∈{0,…,−T}t\in\{0,\dots,-T\}t∈{0,…,−T}, where FA,C,ζ(x,v)=σ(Ax+Cv+ζ)F^{A,C,\zeta}(x,v)=\sigma(Ax+Cv+\zeta)FA,C,ζ(x,v)=σ(Ax+Cv+ζ).

Formalization targets

Steps of the proof

The milestones are the displayed estimates of the proof, in attack order:

  1. (89): one step of the error recursion on ΩESP\Omega_{\mathrm{ESP}}ΩESP​, E[∥Yt−Xt∗∥1ΩESP]≤E[sup⁡y∥⋯∥]+sN+r E[∥Yt−1−Xt−1∗∥1ΩESP]\mathbb E[\|Y_t-X^*_t\|\mathbb 1_{\Omega_{\mathrm{ESP}}}]\le\mathbb E[\sup_{y}\|\cdots\|]+s_N+r\,\mathbb E[\|Y_{t-1}-X^*_{t-1}\|\mathbb 1_{\Omega_{\mathrm{ESP}}}]E[∥Yt​−Xt∗​∥1ΩESP​​]≤E[supy​∥⋯∥]+sN​+rE[∥Yt−1​−Xt−1∗​∥1ΩESP​​];
  2. (90): splitting into coordinates and symmetrization of the uniform error of the random map;
  3. (91): a deterministic bound on Rademacher averages,
Eεsup⁡y∈BM+1∣∑i=1Nviεiσ((y,z,1)⋅ui)∣≤2Lσ((M+1)(∑ivi2∥ai∥2)1/2+∥z∥(∑ivi2∥ci∥2)1/2+(∑ivi2ζi2)1/2);\mathbb E_\varepsilon\sup_{y\in B_{M+1}}\Big|\sum_{i=1}^N v_i\varepsilon_i\sigma((y,z,1)\cdot u_i)\Big|\le2L_\sigma\Big((M+1)\big(\textstyle\sum_iv_i^2\|a_i\|^2\big)^{1/2}+\|z\|\big(\sum_iv_i^2\|c_i\|^2\big)^{1/2}+\big(\sum_iv_i^2\zeta_i^2\big)^{1/2}\Big);Eε​y∈BM+1​sup​​i=1∑N​vi​εi​σ((y,z,1)⋅ui​)​≤2Lσ​((M+1)(∑i​vi2​∥ai​∥2)1/2+∥z∥(∑i​vi2​∥ci​∥2)1/2+(∑i​vi2​ζi2​)1/2);
  1. (92)–(93): for each fixed input z∈Ddz\in D_dz∈Dd​,
Esup⁡y∈BM+1∥1N∑i=1NWiσ(A(i)y+C(i)z+ζ(i))−F∗,N(y,z)∥≤(M+2+∥z∥)C∗N;\mathbb E\sup_{y\in B_{M+1}}\Big\|\frac1N\sum_{i=1}^NW_i\sigma(A^{(i)}y+C^{(i)}z+\zeta^{(i)})-F^{*,N}(y,z)\Big\|\le\frac{(M+2+\|z\|)C_*}{\sqrt N};Ey∈BM+1​sup​​N1​i=1∑N​Wi​σ(A(i)y+C(i)z+ζ(i))−F∗,N(y,z)​≤N​(M+2+∥z∥)C∗​​;
  1. (96): P(Ω∖ΩESP)≤2(M+2+E[max⁡t∥Zt∥])C∗/N+2sN\mathbb P(\Omega\setminus\Omega_{\mathrm{ESP}})\le2(M+2+\mathbb E[\max_t\|Z_t\|])C_*/\sqrt N+2s_NP(Ω∖ΩESP​)≤2(M+2+E[maxt​∥Zt​∥])C∗​/N​+2sN​.

Goal: Theorem 4

There is a readout WWW, a function of (A,C,ζ)(A,C,\zeta)(A,C,ζ) alone, such that for every δ∈(0,1)\delta\in(0,1)δ∈(0,1) and every ∥Ξ∥≤M\|\Xi\|\le M∥Ξ∥≤M, with probability at least max⁡(1−δ−2C∗(M+2+E[max⁡t∥Zt∥])/N−2sN,0)\max(1-\delta-2C_*(M+2+\mathbb E[\max_t\|Z_t\|])/\sqrt N-2s_N,0)max(1−δ−2C∗​(M+2+E[maxt​∥Zt​∥])/N​−2sN​,0), the event ΩESP\Omega_{\mathrm{ESP}}ΩESP​ holds and

∣R(HWA,C,ζ)−R(H∗)∣≤LLδ[(M+2+max⁡tE∥Zt∥)C∗(1−r)N+sN1−r+2(M+1)rT+1],|\mathcal R(H^{A,C,\zeta}_W)-\mathcal R(H^*)|\le \frac{L_L}{\delta}\Big[\frac{(M+2+\max_t\mathbb E\|Z_t\|)C_*}{(1-r)\sqrt N}+\frac{s_N}{1-r}+2(M+1)r^{T+1}\Big],∣R(HWA,C,ζ​)−R(H∗)∣≤δLL​​[(1−r)N​(M+2+maxt​E∥Zt​∥)C∗​​+1−rsN​​+2(M+1)rT+1],

where R(H)=E[L(H(Z),Y0)]\mathcal R(H)=\mathbb E[L(H(Z),Y_0)]R(H)=E[L(H(Z),Y0​)] is evaluated at fixed network weights.

Significance

The bound separates three sources of error: sampling NNN blocks of random rows (rate 1/N1/\sqrt N1/N​), the approximation of F∗F^*F∗ by the integral map F∗,NF^{*,N}F∗,N (sNs_NsN​), and the finite initialization of the feedback recursion (rT+1r^{T+1}rT+1). Only the readout depends on the target; the internal weights are generated without it. The theorem also bounds the probability that the random feedback map leaves the state ball on which the recursion is controlled, which is the form in which the echo state property enters. Via Theorem 3 (p. 62), which specializes the densities through the paper's Proposition 2, it gives approximation rates for ReLU output-feedback networks.

The paper proves the result on pp. 63–68. No part of it is formalized. A complete development would give machine-checked Rademacher symmetrization and contraction estimates for random features, uniform-over-a-ball bounds for sampled integral maps, and a treatment of finite feedback recursions on product probability spaces, all reusable outside reservoir computing.

Difficulty

A pointwise approximation of F∗F^*F∗ by the sampled map does not control the feedback system, because the next feedback value is itself the random output of the previous update. The comparison must hold uniformly over the state ball BM+1B_{M+1}BM+1​ and over the whole input window, and the event that the recursion leaves the ball must be charged to an explicit probability. The uniform bound requires symmetrization and the Ledoux–Talagrand contraction principle for a supremum over a continuum of states, with per-index contractions; Lipschitz continuity of σ\sigmaσ alone does not supply the vanishing at zero that principle needs. The input is unbounded, so the input dependence must be tracked through ∥z∥\|z\|∥z∥ and integrated at the end.

Formalization scope

States, inputs, outputs and rows are Euclidean spaces (EuclideanSpace); a row is indexed by ({1..N∗}⊔{1..d})⊔{∗}(\{1..N^*\}\sqcup\{1..d\})\sqcup\{\ast\}({1..N∗}⊔{1..d})⊔{∗} and the rows by {1..N}×{1..N∗}\{1..N\}\times\{1..N^*\}{1..N}×{1..N∗}. Time t∈Z−t\in\mathbb Z_-t∈Z−​ is the index −t∈N-t\in\mathbb N−t∈N; the equation (78) is the published ReservoirESN.IsSolution. The rows have law π⊗NN∗\pi^{\otimes NN^*}π⊗NN∗ on their own space and (Z,Y0)(Z,Y_0)(Z,Y0​) lives on a separate probability space; the probability is under the product law, which encodes the independence of §6.1. Signed measures πjk\pi_j^kπjk​ are their Radon–Nikodym densities with respect to π\piπ, with integrability and first-moment hypotheses. C∗C_*C∗​, sNs_NsN​ and E[max⁡t∥Zt∥]\mathbb E[\max_t\|Z_t\|]E[maxt​∥Zt​∥] are extended nonnegative integrals and suprema, converted to reals only under their finiteness hypotheses; the risk integrals are finite under the loss Lipschitz bound, integrable target and input-moment assumption; the supremum in (87) is unfolded. F∗F^*F∗ is assumed jointly measurable, the standing convention that makes sNs_NsN​ and H∗(Z)H^*(Z)H∗(Z) random variables; the standing assumptions d,N∗≥1d,N^*\ge1d,N∗≥1 and M>0M>0M>0 (p. 30) and T≥1T\ge1T≥1 (§6.1) are hypotheses.

Trivialization ruled out. The readout is a measurable function of the rows only and is chosen before δ\deltaδ and Ξ\XiΞ. A readout allowed to look at the input ZZZ would make the claim a different and much weaker statement.

Correction of the print. The goal and milestones (91), (93), (96) assume σ(0)=0\sigma(0)=0σ(0)=0: the contraction principle cited at (91) needs contractions vanishing at zero, while the printed theorem states only that σ\sigmaσ is Lipschitz. ReLU, the paper's application, satisfies it. The goal retains the printed full risk difference. Its proof passes through (88), where an indicator depending on ZZZ is moved inside a risk integral; this step needs further justification. The milestone quotations keep the printed text.

Contributions are welcome on each milestone, on general Rademacher symmetrization and contraction lemmas for suprema over compact parameter sets, on measurability of suprema of continuous random fields, and on the printed form of the risk bound.

Selected references

  • L. Gonon, L. Grigoryeva and J.-P. Ortega, Approximation bounds for random neural networks and reservoir systems, The Annals of Applied Probability 33(1), 2023, 28–69. https://doi.org/10.1214/22-AAP1806
  • M. Ledoux and M. Talagrand, Probability in Banach Spaces: Isoperimetry and Processes, Springer, 1991 (Theorem 4.12, the contraction principle). https://doi.org/10.1007/978-3-642-20212-4
8 thms2 active usersReviewed
Control Theory·Captain: mikedeng1

Input-to-State Stability of Nonlinear Impulsive Systems 2: An Exponential ISS-Lyapunov Function Makes an Impulsive System Uniformly ISS under the Generalized Average Dwell-Time ConditionResearch Paper

Motivation

An impulsive system evolves continuously most of the time and changes state instantaneously at specified impulse times. Reset controllers, sampled interventions, and hybrid models have this shape. A stability estimate for the continuous dynamics alone can fail after many jumps: a jump may enlarge the state, and even a contracting jump can be too sparse to offset an expanding flow. Dashkovskiy and Mironchenko study how a condition on the timing of impulses combines the two effects to yield input-to-state stability (ISS) for nonlinear systems on Banach spaces. Their Theorem 5 treats a generalized average dwell-time condition and asks for one stability estimate shared by every admissible impulse schedule Dashkovskiy and Mironchenko, §3.1, Theorem 5.

The source is the 2012 arXiv v1 preprint, which was subsequently published in SIAM Journal on Control and Optimization in 2013. This mission uses the preprint's page and equation numbers throughout. The goal is posed with a documented correction to the jump hypothesis because the theorem as printed is false under its own Definition 4; the correction is the max-form condition displayed in Proposition 3.2 of the same paper.

Setting

The state xxx lies in a real Banach space XXX, and the input value ξ\xiξ lies in another real Banach space UUU. The continuous transition map ϕc(t,x,u)\phi_c(t,x,u)ϕc​(t,x,u) gives the state after flowing for t≥0t\ge0t≥0 from xxx under an input function uuu. A jump map J(x,ξ)J(x,\xi)J(x,ξ) gives the new state when an impulse occurs. An impulse schedule T=(t1,t2,…)T=(t_1,t_2,\ldots)T=(t1​,t2​,…) is strictly increasing and has no finite accumulation point. Between impulses the trajectory follows ϕc\phi_cϕc​; at tit_iti​ it takes the value J(x(ti−),u(ti−))J(x(t_i^-),u(t_i^-))J(x(ti−​),u(ti−​)). Inputs are bounded and piecewise right-continuous. This is the transition-map view used by the source when it defines the Lie derivative; it does not require an explicit generator of a C0C_0C0​ semigroup in the mission interface Dashkovskiy and Mironchenko, pp. 3–5.

A comparison function in K∞\mathcal K_\inftyK∞​ is continuous, strictly increasing, zero at zero, and unbounded. A function in L\mathcal LL is continuous, strictly decreasing, and tends to zero at infinite time. A function in KL\mathcal{KL}KL is of class K\mathcal KK in its first argument and of class L\mathcal LL in its second argument for every positive first argument. The nonnegative Lyapunov function VVV measures the state through two functions ψ1,ψ2∈K∞\psi_1,\psi_2\in\mathcal K_\inftyψ1​,ψ2​∈K∞​:

ψ1(∥x∥)≤V(x)≤ψ2(∥x∥).\psi_1(\|x\|)\le V(x)\le\psi_2(\|x\|).ψ1​(∥x∥)≤V(x)≤ψ2​(∥x∥).

The continuous rate c∈Rc\in\mathbb Rc∈R and jump rate d∈Rd\in\mathbb Rd∈R enter through V˙u(x)≤−cV(x)\dot V_u(x)\le-cV(x)V˙u​(x)≤−cV(x) whenever V(x)≥γ(∥u(0)∥)V(x)\ge\gamma(\|u(0)\|)V(x)≥γ(∥u(0)∥), and through the max-form jump bound V(J(x,ξ))≤max⁡{e−dV(x),γ(∥ξ∥)}V(J(x,\xi))\le\max\{e^{-d}V(x),\gamma(\|\xi\|)\}V(J(x,ξ))≤max{e−dV(x),γ(∥ξ∥)} for every state and input value. The Lie derivative V˙u\dot V_uV˙u​ is an upper-right Dini derivative, so it can exist as an extended real even where an ordinary derivative does not Dashkovskiy and Mironchenko, (3.3)–(3.6), Proposition 3.2.

For a schedule TTT, let N(t,s)N(t,s)N(t,s) count impulses in (s,t](s,t](s,t]. Given a positive function hhh dominated by some g∈Lg\in\mathcal Lg∈L, the generalized average dwell-time class S[h]S[h]S[h] consists of schedules satisfying

−dN(t,s)−c(t−s)≤log⁡h(t−s)(t≥s≥0).-dN(t,s)-c(t-s)\le\log h(t-s)\qquad(t\ge s\ge0).−dN(t,s)−c(t−s)≤logh(t−s)(t≥s≥0).

This condition permits the schedule to reflect the actual rates ccc and ddd, including cases where one mode is destabilizing Dashkovskiy and Mironchenko, (3.29).

Formalization targets

Corrected Theorem 5

The goal asserts uniform ISS over S[h]S[h]S[h]. One pair β∈KL\beta\in\mathcal{KL}β∈KL and γ′∈K∞\gamma'\in\mathcal K_\inftyγ′∈K∞​ must work for all schedules T∈S[h]T\in S[h]T∈S[h], all initial states, and all admissible inputs bounded by MMM:

∥x(t)∥≤β(∥x0∥,t)+γ′(M)(t≥0).\|x(t)\|\le\beta(\|x_0\|,t)+\gamma'(M)\qquad(t\ge0).∥x(t)∥≤β(∥x0​∥,t)+γ′(M)(t≥0).

The theorem assumes d≠0d\ne0d=0, as printed. The draft goal uses Proposition 3.2's max-form jump bound. Its four milestones retain the source's estimates on an impulse-free flow piece, on an above-threshold excursion, before the first threshold visit, and after such a visit. The source displays are quoted in the milestone list with the preprint's page and equation numbers Dashkovskiy and Mironchenko, pp. 11–13.

Significance

The result gives a common quantitative stability claim for a family of impulse schedules, rather than a separate estimate chosen after seeing each schedule. The common comparison functions matter when a controller or system class permits many possible reset times. The source's generalized condition also records both continuous and jump rates directly, so it covers more than a fixed minimum separation between impulses Dashkovskiy and Mironchenko, §3.1–3.2.

The theorem and its four supporting estimates are currently draft statements, without machine-checked proofs. Completing the mission would formalize the known corrected argument and produce reusable definitions for piecewise inputs, impulse counts, right-continuous trajectories, and upper Dini Lyapunov conditions. Existing published platform definitions supply the comparison classes K\mathcal KK, K∞\mathcal K_\inftyK∞​, and positive-definite functions, and the extended-real upper-right Dini derivative. The mission adds the dynamics and dwell-time layer needed to state this paper's result.

Difficulty

An interval with no impulse supports an exponential flow estimate only while the Lyapunov value stays above the input threshold. A jump can change both the state and which side of that threshold the trajectory occupies. The printed split into V≥γ(M)V\ge\gamma(M)V≥γ(M) and V<γ(M)V<\gamma(M)V<γ(M) has a boundary case: a jump can land exactly at V=γ(M)V=\gamma(M)V=γ(M) without satisfying the multiplicative part of the max-form jump estimate. The excursion milestone therefore uses a strict above-threshold condition after its starting time, and the threshold-visit milestone covers the boundary. Uniformity adds another requirement: the final comparison functions must be chosen before the impulse schedule Dashkovskiy and Mironchenko, proof of Theorem 5, pp. 11–13.

Formalization scope

Lean represents time by real numbers and nonnegative comparison values by R≥0\mathbb R_{\ge0}R≥0​. The state and input spaces are real Banach spaces. The system is encoded by (ϕc,J)(\phi_c,J)(ϕc​,J) with identity, shifted-cocycle, flow-continuity, and zero-equilibrium properties; its solutions are the trajectories assembled from those maps. Initial time is fixed at 000, and the first impulse must occur strictly afterward. This removes an undefined left input limit at the initial instant. The input size is stated by a uniform bound MMM on t≥0t\ge0t≥0, equivalent to the source's supremum norm for monotone gains. The upper-right Dini derivative lives in the extended reals, and N(t,s)N(t,s)N(t,s) counts the left-open, right-closed interval (s,t](s,t](s,t].

The max-form jump hypothesis is a necessary correction: under the printed implication-form clause, take x˙=−x\dot x=-xx˙=−x, V(x)=∣x∣V(x)=|x|V(x)=∣x∣, and a jump that sends x=0x=0x=0 to 111 under any small positive input while satisfying the clause outside the threshold region. Every schedule can satisfy (3.29), yet ISS fails as the input tends to zero. The nontrivial scalar system x˙=−x\dot x=-xx˙=−x with jump x↦x/2x\mapsto x/2x↦x/2 satisfies the chosen system axioms in a sorry-free sanity file. The goal's existential β,γ′\beta,\gamma'β,γ′ precede the quantifier over schedules; the input bound is not an unbounded real supremum, and the derivative is not a junk-valued real limit.

Reusable contributions include analysis of the extended-real Dini derivative along a cocycle, finite impulse counting, and comparison lemmas for the four source estimates. The source's local Theorem 6 and the relations among dwell-time classes are outside this mission.

Selected references

  • S. Dashkovskiy and A. Mironchenko, Input-to-State Stability of Nonlinear Impulsive Systems, arXiv:1212.5481v1, 2012; SIAM Journal on Control and Optimization 51(3), 2013. Preprint; DOI.
  • S. Dashkovskiy, B. S. Rüffer, and F. R. Wirth, Small Gain Theorems for Large Scale Systems and Construction of ISS Lyapunov Functions, arXiv:0901.1842v2, 2009. Preprint.
9 thms2 active usersReviewed
Control Theory·Captain: mikedeng1

Input-to-State Stability of Nonlinear Impulsive Systems 1: An ISS-Lyapunov Function Makes an Impulsive System ISS for Every Impulse Sequence Satisfying the Nonlinear Fixed Dwell-Time ConditionResearch Paper

Motivation

Impulsive systems evolve continuously most of the time and change their state abruptly at isolated instants. They model sampled-data and networked control loops, where a controller acts at transmission times; population and epidemic models with periodic harvesting or vaccination; and mechanical systems with impacts. Their inputs are disturbances, measurement errors or exogenous signals, and the natural robustness notion is input-to-state stability (ISS): the state is bounded by a decaying function of the initial state plus a gain of the input size.

For impulsive systems ISS depends on when the jumps occur. A flow that contracts and jumps that expand (or the reverse) can be stable or unstable depending on how dense the impulse times are. Dwell-time conditions, which restrict the impulse-time sequences, are the standard tool.

S. Dashkovskiy and A. Mironchenko, Input-to-state stability of nonlinear impulsive systems (SIAM J. Control Optim. 51(3), 2013), establish Lyapunov-type sufficient conditions for ISS of nonlinear impulsive systems on Banach spaces. This mission formalizes the first of them, Theorem 1: a nonlinear fixed dwell-time condition, attributed in the paper to Samoilenko and Perestyuk’s monograph on impulsive differential equations, together with an ISS-Lyapunov function, gives ISS for every impulse sequence whose impulses are at least θ\thetaθ apart.

Timeline. Hespanha, Liberzon and Teel (Automatica 2008) proved ISS of finite-dimensional impulsive systems under average dwell-time conditions with exponential ISS-Lyapunov functions. Dashkovskiy and Mironchenko (arXiv 2012, SICON 2013) extended Lyapunov criteria to infinite-dimensional systems and to non-exponential Lyapunov functions (Theorem 1), and to a generalized average dwell-time condition (Theorem 5, the second mission of this series).

Setting

Let XXX (states) and UUU (input values) be Banach spaces. The system is

x˙(t)=Ax(t)+f(x(t),u(t)),t∉T,x(t)=g(x−(t),u−(t)),t∈T,\dot x(t)=Ax(t)+f(x(t),u(t)),\quad t\notin T,\qquad x(t)=g(x^-(t),u^-(t)),\quad t\in T,x˙(t)=Ax(t)+f(x(t),u(t)),t∈/T,x(t)=g(x−(t),u−(t)),t∈T,

where T={t1<t2<⋯ }T=\{t_1<t_2<\cdots\}T={t1​<t2​<⋯} is the sequence of impulse times (no finite accumulation point), x−(t)x^-(t)x−(t) and u−(t)u^-(t)u−(t) are left limits, and inputs uuu belong to Uc=PC([t0,∞),U)U_c=PC([t_0,\infty),U)Uc​=PC([t0​,∞),U), the piecewise right-continuous bounded functions with ∥u∥Uc=sup⁡t≥t0∥u(t)∥\|u\|_{U_c}=\sup_{t\ge t_0}\|u(t)\|∥u∥Uc​​=supt≥t0​​∥u(t)∥. Solutions are assumed to exist and be unique, and f(0,0)=g(0,0)=0f(0,0)=g(0,0)=0f(0,0)=g(0,0)=0.

The transition map ϕc(t,0,x,u)\phi_c(t,0,x,u)ϕc​(t,0,x,u) of the continuous part is the state at time ttt when the state at time 000 was xxx, the input uuu was applied and there were no impulses. The trajectory x(t)=ϕ(t,t0,x0,u)x(t)=\phi(t,t_0,x_0,u)x(t)=ϕ(t,t0​,x0​,u) follows ϕc\phi_cϕc​ between impulses and jumps by ggg at each tkt_ktk​.

Comparison functions: P\mathcal PP (continuous, zero exactly at 000), K\mathcal KK (in P\mathcal PP and strictly increasing), K∞\mathcal K_\inftyK∞​ (unbounded K\mathcal KK), L\mathcal LL (continuous, strictly decreasing to 000), and KL\mathcal{KL}KL. The system is ISS for TTT if, for some β∈KL\beta\in\mathcal{KL}β∈KL and γ∈K∞\gamma\in\mathcal K_\inftyγ∈K∞​,

∥x(t)∥≤β(∥x0∥,t−t0)+γ(∥u∥Uc)for all x0, u, t≥t0.\|x(t)\|\le\beta(\|x_0\|,t-t_0)+\gamma(\|u\|_{U_c})\qquad\text{for all }x_0,\ u,\ t\ge t_0 .∥x(t)∥≤β(∥x0​∥,t−t0​)+γ(∥u∥Uc​​)for all x0​, u, t≥t0​.

The Lie derivative of V:X→R+V:X\to\mathbb R_+V:X→R+​ is the upper right Dini derivative V˙u(x)=lim sup⁡t→+01t(V(ϕc(t,0,x,u))−V(x))\dot V_u(x)=\limsup_{t\to+0}\frac1t\big(V(\phi_c(t,0,x,u))-V(x)\big)V˙u​(x)=limsupt→+0​t1​(V(ϕc​(t,0,x,u))−V(x)). An ISS-Lyapunov function in max form (Proposition 3.1 of the paper) is a continuous VVV with ψ1(∥x∥)≤V(x)≤ψ2(∥x∥)\psi_1(\|x\|)\le V(x)\le\psi_2(\|x\|)ψ1​(∥x∥)≤V(x)≤ψ2​(∥x∥), ψ1,ψ2∈K∞\psi_1,\psi_2\in\mathcal K_\inftyψ1​,ψ2​∈K∞​, and γ∈K∞\gamma\in\mathcal K_\inftyγ∈K∞​, α∈P\alpha\in\mathcal Pα∈P and a flow rate φ\varphiφ such that

V(x)≥γ(∥u(0)∥) ⇒ V˙u(x)≤−φ(V(x)),V(g(x,ξ))≤max⁡{α(V(x)),γ(∥ξ∥)}.V(x)\ge\gamma(\|u(0)\|)\ \Rightarrow\ \dot V_u(x)\le-\varphi(V(x)),\qquad V(g(x,\xi))\le\max\{\alpha(V(x)),\gamma(\|\xi\|)\}.V(x)≥γ(∥u(0)∥) ⇒ V˙u​(x)≤−φ(V(x)),V(g(x,ξ))≤max{α(V(x)),γ(∥ξ∥)}.

The class SθS_\thetaSθ​ consists of impulse sequences with ti+1−ti≥θt_{i+1}-t_i\ge\thetati+1​−ti​≥θ for all iii.

Formalization targets

Goal: Theorem 1 (p. 6), corrected

Let VVV be an ISS-Lyapunov function in max form with φ∈P\varphi\in\mathcal Pφ∈P, and suppose that for some θ,δ>0\theta,\delta>0θ,δ>0

∫aα(a)dsφ(s)≤θ−δfor all a>0.(3.7)\int_a^{\alpha(a)}\frac{ds}{\varphi(s)}\le\theta-\delta\qquad\text{for all }a>0. \tag{3.7}∫aα(a)​φ(s)ds​≤θ−δfor all a>0.(3.7)

Then the system is ISS for every T∈SθT\in S_\thetaT∈Sθ​, with β\betaβ allowed to depend on TTT.

Milestones (proof of Theorem 1, pp. 7–9)

  1. (3.11): on a flow piece with y=V(x(⋅))>0y=V(x(\cdot))>0y=V(x(⋅))>0 and D+y≤−φ(y)D^+y\le-\varphi(y)D+y≤−φ(y), the function F(q)=∫rqds/φ(s)F(q)=\int_r^q ds/\varphi(s)F(q)=∫rq​ds/φ(s) satisfies F(y(t))−F(y(ti))≤−(t−ti)F(y(t))-F(y(t_i))\le-(t-t_i)F(y(t))−F(y(ti​))≤−(t−ti​).
  2. (3.14): for u≡0u\equiv0u≡0, one dwell interval gives F(y(ti+1))−F(y(ti))≤−δF(y(t_{i+1}))-F(y(t_i))\le-\deltaF(y(ti+1​))−F(y(ti​))≤−δ.
  3. zr(ti)→0z_r(t_i)\to0zr​(ti​)→0 (p. 8): a positive sequence along which FFF drops by δ\deltaδ per step tends to 000.
  4. Zero-input decay (p. 8): for u≡0u\equiv0u≡0, V(x(t))≤β2(V(x0),t)V(x(t))\le\beta_2(V(x_0),t)V(x(t))≤β2​(V(x0​),t) with β2∈KL\beta_2\in\mathcal{KL}β2​∈KL.
  5. Invariance of I2I_2I2​ (p. 9): once V(x(t))≤γ(∥u∥)V(x(t))\le\gamma(\|u\|)V(x(t))≤γ(∥u∥), afterwards V(x(t))≤α~(∥u∥)V(x(t))\le\tilde\alpha(\|u\|)V(x(t))≤α~(∥u∥) with α~(r)=max⁡{max⁡0≤s≤γ(r)α(s),γ(r)}\tilde\alpha(r)=\max\{\max_{0\le s\le\gamma(r)}\alpha(s),\gamma(r)\}α~(r)=max{max0≤s≤γ(r)​α(s),γ(r)}.

Significance

The result. Condition (3.7) allows jumps that increase VVV (α(a)>a\alpha(a)>aα(a)>a), provided the flow has time θ\thetaθ to compensate, and it allows any decay rate φ∈P\varphi\in\mathcal Pφ∈P, not only exponential ones. The theorem therefore covers systems with polynomially or more slowly decaying Lyapunov functions, such as the paper's Example 1 (x˙=−x3+u\dot x=-x^3+ux˙=−x3+u with cubic jumps), for which exponential average dwell-time results do not apply. It is also the base of the paper's Remark 3: if jumps do not increase VVV, the system is ISS for every impulse sequence without finite accumulation points.

Formalizing it. The result is proved on paper; no machine-checked version exists. The printed statement is not correct as written (see Formalization scope), so a formal proof also certifies the repaired hypothesis set. The development produces reusable infrastructure: a trajectory semantics for impulsive systems with inputs, a Dini-derivative comparison lemma for D+y≤−φ(y)D^+y\le-\varphi(y)D+y≤−φ(y), and constructions of KL\mathcal{KL}KL bounds from sampled decay estimates.

Difficulty

The decay along the flow is not exponential, so the estimate is carried by the nonlinear time change FFF, and the comparison step (3.11) must be derived from an upper Dini derivative of a merely continuous function, not from a classical derivative. The KL\mathcal{KL}KL bound is built from estimates at the impulse times only; it must be continuous, strictly monotone in both arguments and uniform over all initial states with the same Lyapunov value, and FFF may be bounded below near 000, in which case the trajectory reaches 000 in finite time and F−1F^{-1}F−1 is undefined there. With inputs, the trajectory can leave the sublevel set {V≤γ(∥u∥)}\{V\le\gamma(\|u\|)\}{V≤γ(∥u∥)} only by a jump, and after such a jump the decay of VVV is guaranteed only at the following impulse times, not immediately.

Formalization scope

The system is modelled abstractly by the pair (ϕc,g)(\phi_c,g)(ϕc​,g): a structure with fields flow (ϕc\phi_cϕc​) and jump (ggg), subject to ϕc(0,0,x,u)=x\phi_c(0,0,x,u)=xϕc​(0,0,x,u)=x, the cocycle property under input shifts, continuity in time, and the equilibrium at 000. Mathlib has no C0C_0C0​-semigroups, and every statement of the paper uses AAA and fff only through ϕc\phi_cϕc​. The initial time is t0=0t_0=0t0​=0 (the paper's own reduction (2.2)), and the first impulse is strictly after t0t_0t0​. Impulse times are τ : ℕ → ℝ, 0-based (τ i is ti+1t_{i+1}ti+1​). Comparison functions are maps R≥0→R≥0\mathbb R_{\ge0}\to\mathbb R_{\ge0}R≥0​→R≥0​; P\mathcal PP, K\mathcal KK, K∞\mathcal K_\inftyK∞​ come from the published definition SmallGainISS.Lyapunov.Gains, and the Dini derivative from ProcessingNetworks.LyapunovCriteria.DiniDerivative, valued in extended reals. The ISS estimate uses any bound M≥∥u(t)∥M\ge\|u(t)\|M≥∥u(t)∥ in place of ∥u∥Uc\|u\|_{U_c}∥u∥Uc​​.

Corrected statement. The goal uses the max-form jump bound (3.6) of Proposition 3.1 for all x,ξx,\xix,ξ, which is what the proof uses, instead of Definition 4's implication form: as printed the theorem is false (x˙=−x\dot x=-xx˙=−x, g(x,ξ)=x/2g(x,\xi)=x/2g(x,ξ)=x/2 if ∣ξ∣≤∣x∣|\xi|\le|x|∣ξ∣≤∣x∣ and 111 otherwise, V=∣x∣V=|x|V=∣x∣, x0=0x_0=0x0​=0, u≡εu\equiv\varepsilonu≡ε reaches 111 at the first jump for every ε>0\varepsilon>0ε>0).

Trivializing formalizations are ruled out: β\betaβ and γ\gammaγ are existentially quantified before the initial state and the input, and after the impulse sequence only, as the theorem is non-uniform over SθS_\thetaSθ​ (Remark 2); the Lie derivative is an extended-real lim sup⁡\limsuplimsup, not a real-valued one or a classical derivative; the input norm is a bound, never a supremum; the integral in (3.7) is taken only over segments inside (0,∞)(0,\infty)(0,∞), where 1/φ1/\varphi1/φ is continuous; and a verification file shows that x˙=−x\dot x=-xx˙=−x, g=x/2g=x/2g=x/2, V=∣x∣V=|x|V=∣x∣ and ti=θit_i=\theta iti​=θi satisfy every hypothesis.

Contributions welcome: proofs of any milestone, a general Dini comparison lemma, and the construction of KL\mathcal{KL}KL functions from sampled bounds, which the paper only sketches.

Selected references

  • S. Dashkovskiy, A. Mironchenko, Input-to-state stability of nonlinear impulsive systems, SIAM J. Control Optim. 51(3), 1962–1987, 2013; preprint arXiv:1212.5481v1, 2012. https://arxiv.org/abs/1212.5481
  • J. P. Hespanha, D. Liberzon, A. R. Teel, Lyapunov conditions for input-to-state stability of impulsive systems, Automatica 44(11), 2735–2744, 2008. https://doi.org/10.1016/j.automatica.2008.03.006
  • S. Dashkovskiy, A. Mironchenko, Input-to-state stability of infinite-dimensional control systems, Math. Control Signals Systems 25, 1–35, 2013. https://doi.org/10.1007/s00498-012-0090-2
9 thms2 active usersReviewed
Control Theory·Captain: mikedeng1

Input-to-State Stability of Nonlinear Impulsive Systems 3: Small-Gain Theorem: max_i σ_i⁻¹(V_i(x_i)) Is an ISS-Lyapunov Function for an Interconnection of Impulsive SystemsResearch Paper

Motivation

Large control systems are rarely analysed as a whole. A power grid, a logistics network or a chemical plant is a network of subsystems, each with its own model, coupled through their states. Input-to-state stability (ISS) is the standard notion of robustness for such systems: the state is bounded by a decaying function of the initial state plus a gain of the size of the input. Small-gain theorems give conditions under which ISS of the subsystems, together with a smallness condition on the gains with which the subsystems influence one another, yields ISS of the interconnection. In Lyapunov form they do more: they assemble an ISS-Lyapunov function of the whole network from those of its parts (Jiang, Mareels and Wang 1996; Dashkovskiy, Rüffer and Wirth 2010).

Many networks are also impulsive: their state evolves continuously most of the time and jumps at isolated instants (resets, switching, sampling, batch arrivals in logistics). Dashkovskiy and Mironchenko (arXiv:1212.5481v1, SIAM J. Control Optim. 51(3), 2013, DOI) develop a Lyapunov ISS theory for impulsive systems on Banach spaces. Their Theorem 8 is the small-gain theorem for interconnections of impulsive systems that jump at common times.

Timeline. Jiang, Mareels and Wang (1996) gave the Lyapunov small-gain theorem for two ordinary differential systems. Dashkovskiy, Rüffer and Wirth (2010) extended it to nnn subsystems, with the gain operator Γ\GammaΓ, the small-gain condition and the Ω\OmegaΩ-path through which V=max⁡iσi−1(Vi)V=\max_i\sigma_i^{-1}(V_i)V=maxi​σi−1​(Vi​) is built. Nešić and Teel (CDC 2008) treated hybrid systems, Dashkovskiy and Mironchenko (MCSS 2012) treated infinite-dimensional systems, and Theorem 8 combines both settings for impulsive systems.

Setting

An impulsive system has state space XXX and input values in UUU, both Banach spaces. It is described by two maps:

  • the transition map ϕc(t,0,x,u)\phi_c(t,0,x,u)ϕc​(t,0,x,u) of its continuous part, i.e. the state at time ttt when the system starts at xxx under the input uuu and no jumps occur;
  • the jump map g:X×U→Xg:X\times U\to Xg:X×U→X.

The paper derives ϕc\phi_cϕc​ from x˙=Ax+f(x,u)\dot x=Ax+f(x,u)x˙=Ax+f(x,u) with AAA the generator of a C0C_0C0​-semigroup, but every statement of this mission uses only ϕc\phi_cϕc​ and ggg. Inputs are piecewise right-continuous and bounded. For a function V:X→R+V:X\to\mathbb R_+V:X→R+​, the Lie derivative is the upper right Dini derivative

V˙u(x)=lim⁡t→+0‾ 1t(V(ϕc(t,0,x,u))−V(x)).\dot V_u(x)=\overline{\lim_{t\to+0}}\ \frac1t\big(V(\phi_c(t,0,x,u))-V(x)\big).V˙u​(x)=t→+0lim​​ t1​(V(ϕc​(t,0,x,u))−V(x)).

An interconnection consists of nnn subsystems with state spaces XiX_iXi​. It is one impulsive system on X=X1×⋯×XnX=X_1\times\dots\times X_nX=X1​×⋯×Xn​ with ∥x∥X=∑i∥xi∥\|x\|_X=\sum_i\|x_i\|∥x∥X​=∑i​∥xi​∥. Each subsystem has an ISS-Lyapunov function ViV_iVi​:

  • ψi1(∥xi∥)≤Vi(xi)≤ψi2(∥xi∥)\psi_{i1}(\|x_i\|)\le V_i(x_i)\le\psi_{i2}(\|x_i\|)ψi1​(∥xi​∥)≤Vi​(xi​)≤ψi2​(∥xi​∥);
  • along the flow, ViV_iVi​ decreases at rate φi(Vi)\varphi_i(V_i)φi​(Vi​) whenever Vi(xi)≥max⁡{max⁡jχij(Vj(xj)),χi(∥ξ∥)}V_i(x_i)\ge\max\{\max_j\chi_{ij}(V_j(x_j)),\chi_i(\|\xi\|)\}Vi​(xi​)≥max{maxj​χij​(Vj​(xj​)),χi​(∥ξ∥)};
  • at a jump, Vi(gi(x,ξ))≤max⁡{αi(Vi(xi)),max⁡jχij(Vj(xj)),χi(∥ξ∥)}V_i(g_i(x,\xi))\le\max\{\alpha_i(V_i(x_i)),\max_j\chi_{ij}(V_j(x_j)),\chi_i(\|\xi\|)\}Vi​(gi​(x,ξ))≤max{αi​(Vi​(xi​)),maxj​χij​(Vj​(xj​)),χi​(∥ξ∥)}.

The gains χij\chi_{ij}χij​ form the gain operator Γ(s)i=max⁡jχij(sj)\Gamma(s)_i=\max_j\chi_{ij}(s_j)Γ(s)i​=maxj​χij​(sj​) on R+n\mathbb R^n_+R+n​. The small-gain condition is Γ(s)≱s\Gamma(s)\not\ge sΓ(s)≥s for s≠0s\ne0s=0. An Ω\OmegaΩ-path is a curve σ=(σ1,…,σn)\sigma=(\sigma_1,\dots,\sigma_n)σ=(σ1​,…,σn​) of K∞\mathcal K_\inftyK∞​ functions with Γ(σ(r))<σ(r)\Gamma(\sigma(r))<\sigma(r)Γ(σ(r))<σ(r) componentwise for r>0r>0r>0, whose inverses σi−1\sigma_i^{-1}σi−1​ are locally Lipschitz with derivative bounds on compacts.

Formalization targets

Goal: Theorem 8 in the form of Proposition 3.1

With V(x)=max⁡iσi−1(Vi(xi))V(x)=\max_i\sigma_i^{-1}(V_i(x_i))V(x)=maxi​σi−1​(Vi​(xi​)) and χ(r)=max⁡iσi−1(χi(r))\chi(r)=\max_i\sigma_i^{-1}(\chi_i(r))χ(r)=maxi​σi−1​(χi​(r)):

ψ1(∥x∥X)≤V(x)≤ψ2(∥x∥X),V(x)≥χ(∥ξ∥)⇒V˙u(x)≤−φ(V(x)) (x≠0),\psi_1(\|x\|_X)\le V(x)\le\psi_2(\|x\|_X),\qquad V(x)\ge\chi(\|\xi\|)\Rightarrow\dot V_u(x)\le-\varphi(V(x))\ (x\ne0),ψ1​(∥x∥X​)≤V(x)≤ψ2​(∥x∥X​),V(x)≥χ(∥ξ∥)⇒V˙u​(x)≤−φ(V(x)) (x=0), V(g(x,ξ))≤max⁡{α(V(x)),χ(∥ξ∥)},V(g(x,\xi))\le\max\{\alpha(V(x)),\chi(\|\xi\|)\},V(g(x,ξ))≤max{α(V(x)),χ(∥ξ∥)},

for some ψ1,ψ2∈K∞\psi_1,\psi_2\in\mathcal K_\inftyψ1​,ψ2​∈K∞​ and φ,α∈P\varphi,\alpha\in\mathcal Pφ,α∈P. The rates are existential, so no constant is fixed.

Milestones (proof order)

  1. The continuous part (4.12): the flow estimate above.
  2. α~=max⁡iσi−1∘αi∘σi\tilde\alpha=\max_i\sigma_i^{-1}\circ\alpha_i\circ\sigma_iα~=maxi​σi−1​∘αi​∘σi​ is positive definite.
  3. η=max⁡i,j≠iσi−1∘χij∘σj\eta=\max_{i,j\ne i}\sigma_i^{-1}\circ\chi_{ij}\circ\sigma_jη=maxi,j=i​σi−1​∘χij​∘σj​ satisfies η(r)<r\eta(r)<rη(r)<r for r>0r>0r>0.
  4. The jump estimate: V(g(x,ξ))≤max⁡{α∗(V(x)),η(V(x)),χ(∥ξ∥)}V(g(x,\xi))\le\max\{\alpha^*(V(x)),\eta(V(x)),\chi(\|\xi\|)\}V(g(x,ξ))≤max{α∗(V(x)),η(V(x)),χ(∥ξ∥)} for every α∗∈K\alpha^*\in\mathcal Kα∗∈K with α∗≥α~\alpha^*\ge\tilde\alphaα∗≥α~.

A companion item states Proposition 3.1 (⇒\Rightarrow⇒): the max form of the jump condition, with a gain in K∞\mathcal K_\inftyK∞​, gives an ISS-Lyapunov function in the implication form of Definition 4.

Significance

The theorem reduces a question about a network to questions about its parts and their gains. Together with the dwell-time theorems of the same paper (Theorems 1 and 5), it yields ISS of an impulsive interconnection for classes of impulse sequences, using only Lyapunov functions of the subsystems and the gain matrix. It is also the starting point of the paper's exponential small-gain theorem (Theorem 9).

The result is proved on paper. Its continuous half is quoted from MCSS 2012, whose proof follows Dashkovskiy, Rüffer and Wirth 2010. To our knowledge none of it is machine-checked. A formal proof would provide:

  • Dini-derivative calculus for maxima of finitely many functions composed with locally Lipschitz increasing maps;
  • a reusable interface for comparison functions and Ω\OmegaΩ-paths;
  • a precise statement of what the theorem delivers. Two points of the printed statement need correction (see Formalization scope).

Difficulty

The jump half is order-theoretic and short. The continuous half is the obstacle. VVV is a maximum of compositions σi−1∘Vi\sigma_i^{-1}\circ V_iσi−1​∘Vi​, and σi−1\sigma_i^{-1}σi−1​ is only locally Lipschitz, differentiable almost everywhere. The page's formula φ(r)=min⁡i(σi−1)′(σi(r))φi(σi(r))\varphi(r)=\min_i(\sigma_i^{-1})'(\sigma_i(r))\varphi_i(\sigma_i(r))φ(r)=mini​(σi−1​)′(σi​(r))φi​(σi​(r)) evaluates a derivative that may not exist, and even where it does exist it need not be continuous in rrr.

The obvious argument, "differentiate the active component", does not work as stated. The Dini derivative of a maximum is controlled by the active indices only once one shows that inactive indices stay inactive for short times. That step needs continuity of the flow, and a rate φ\varphiφ that is continuous and positive has to be extracted from derivative bounds that hold only on compacts. Near the origin the compositions can fail to be Lipschitz, which is why the flow estimate is asserted away from x=0x=0x=0.

Formalization scope

  • The system is the pair (ϕc,g)(\phi_c,g)(ϕc​,g), with these axioms: the flow starts at its initial state, satisfies the cocycle law for piecewise-continuous inputs, is continuous in time, and fixes the origin, and g(0,0)=0g(0,0)=0g(0,0)=0. The initial time is 000. Inputs are functions R→U\mathbb R\to UR→U, right-continuous with left limits, finitely many discontinuities on bounded intervals, and bounded on [0,∞)[0,\infty)[0,∞).
  • Values. Comparison functions are maps R≥0→R≥0\mathbb R_{\ge0}\to\mathbb R_{\ge0}R≥0​→R≥0​ from the published SmallGainISS.Lyapunov.Gains definition, which also supplies the Ω\OmegaΩ-path. The Dini derivative is the published diniUpperRight, valued in the extended reals.
  • The product space. XXX is the Pi type over Fin n. Its built-in sup norm is never used; the sum norm is explicit.
  • Hypothesis (4.5) is stated along the components of the interconnection's own flow, which is the instance the proof uses.
  • Corrections to the printed statement, each disclosed in the items:
    • The conclusion is in the max form of Proposition 3.1 (Remark 8), not Definition 4, because χ\chiχ of (4.11) is in K\mathcal KK but not necessarily in K∞\mathcal K_\inftyK∞​.
    • The flow estimate is asserted for x≠0x\ne0x=0. With n=1n=1n=1, x˙=−x+u\dot x=-x+ux˙=−x+u, V1=∣x∣V_1=|x|V1​=∣x∣, σ1(r)=r2\sigma_1(r)=r^2σ1​(r)=r2 and u(t)=min⁡(t,1)u(t)=\min(t,1)u(t)=min(t,1), one gets V˙u(0)=1/2>0\dot V_u(0)=1/\sqrt2>0V˙u​(0)=1/2​>0, so the printed claim at the origin fails.
    • The milestone jump estimate uses the page's monotone majorant α∗≥α~\alpha^*\ge\tilde\alphaα∗≥α~, since α~\tilde\alphaα~ itself need not be increasing.
  • Trivializations ruled out. The Lie derivative is a Dini derivative in the extended reals, not a real-valued limit with junk values. No supremum norm of inputs appears. The system and subsystem predicates are satisfiable by a nontrivial example (two decoupled copies of x˙=−x\dot x=-xx˙=−x with g=x/2g=x/2g=x/2, Vi=∣xi∣V_i=|x_i|Vi​=∣xi​∣, cross gains r/2r/2r/2, σ=id\sigma=\mathrm{id}σ=id), checked in Lean. The rates φ,α\varphi,\alphaφ,α are quantified after the data, as on the page.
  • Contributions welcome: a Dini max rule for finitely many continuous functions; a chain rule for the upper Dini derivative through a locally Lipschitz increasing map; and the construction of a continuous positive minorant of a locally positive function.

Selected references

  • S. Dashkovskiy, A. Mironchenko, Input-to-state stability of nonlinear impulsive systems, arXiv:1212.5481v1, 2012; SIAM J. Control Optim. 51(3), 2013. https://arxiv.org/abs/1212.5481, https://doi.org/10.1137/120881993
  • S. Dashkovskiy, A. Mironchenko, Input-to-state stability of infinite-dimensional control systems, Math. Control Signals Systems, 2012. https://doi.org/10.1007/s00498-012-0090-2
  • S. N. Dashkovskiy, B. S. Rüffer, F. R. Wirth, Small gain theorems for large scale systems and construction of ISS Lyapunov functions, SIAM J. Control Optim. 48(6), 2010. https://arxiv.org/abs/0901.1842
  • Z.-P. Jiang, I. M. Y. Mareels, Y. Wang, A Lyapunov formulation of the nonlinear small-gain theorem for interconnected ISS systems, Automatica 32(8), 1996. https://doi.org/10.1016/0005-1098(96)00051-9
  • D. Nešić, A. R. Teel, A Lyapunov-based small-gain theorem for hybrid ISS systems, Proc. 47th IEEE CDC, 2008 (cited by the paper as [19]; no resolvable link verified).
9 thms2 active usersReviewed
Machine LearningOptimizationProbability·Captain: mikedeng1

Convergence and Dynamical Behavior of the ADAM Algorithm for Nonconvex Stochastic Optimization 5: Decreasing-Step Adam Converges Almost Surely to the Critical Points of FResearch Paper

Motivation

Adam (Kingma and Ba, 2015) is the default optimizer for training neural networks: a stochastic gradient method that keeps an exponential moving average mnm_nmn​ of past gradients and an exponential moving average vnv_nvn​ of their coordinatewise squares, and divides the first by the square root of the second. Its practical success came well before any convergence theory for nonconvex objectives. Reddi, Kale and Kumar (2018) showed that Adam with constant momentum parameters can fail to converge even on convex problems, which made the question of under which parameter schedules Adam provably converges a live one.

Barakat and Bianchi (arXiv:1810.02263, SIAM J. Math. Data Sci. 2021) answer it through the ODE method of stochastic approximation (Benaïm, 1999). This mission takes the paper's almost-sure convergence theorem for Adam with decreasing stepsizes, Theorem 5.2. Under a stepsize schedule in which 1−αn1 - \alpha_n1−αn​ and 1−βn1 - \beta_n1−βn​ shrink in proportion to the stepsize γn\gamma_nγn​, the iterates converge almost surely to the critical points of the objective, provided they stay bounded.

Setting

Let ξ\xiξ be a random variable on a measurable space Ξ\XiΞ with law μ\muμ, let f:Rd×Ξ→Rf : \mathbb R^d \times \Xi \to \mathbb Rf:Rd×Ξ→R be an integrand with gradient ∇f(x,ξ)\nabla f(x, \xi)∇f(x,ξ) in xxx, and set

F(x)=Ef(x,ξ),S(x)=E(∇f(x,ξ)⊙2),S=∇F−1({0}),F(x) = \mathbb E f(x, \xi), \qquad S(x) = \mathbb E\big(\nabla f(x,\xi)^{\odot 2}\big), \qquad \mathcal S = \nabla F^{-1}(\{0\}),F(x)=Ef(x,ξ),S(x)=E(∇f(x,ξ)⊙2),S=∇F−1({0}),

where ⊙2\odot 2⊙2 is the coordinatewise square and S\mathcal SS is the critical set. Let ξ1,ξ2,…\xi_1, \xi_2, \dotsξ1​,ξ2​,… be iid copies of ξ\xiξ on a probability space (Ω,F,P)(\Omega, \mathcal F, \mathbb P)(Ω,F,P).

Algorithm 5.1 takes stepsizes γn>0\gamma_n > 0γn​>0, weights αn,βn∈[0,1]\alpha_n, \beta_n \in [0,1]αn​,βn​∈[0,1] and a constant ε>0\varepsilon > 0ε>0. Starting from x0∈Rdx_0 \in \mathbb R^dx0​∈Rd, m0=v0=0m_0 = v_0 = 0m0​=v0​=0 and r0=rˉ0=0r_0 = \bar r_0 = 0r0​=rˉ0​=0, it computes for n≥1n \ge 1n≥1, with all vector operations coordinatewise:

mn=αnmn−1+(1−αn)∇f(xn−1,ξn),vn=βnvn−1+(1−βn)∇f(xn−1,ξn)⊙2,rn=αnrn−1+(1−αn),rˉn=βnrˉn−1+(1−βn),xn=xn−1−γnm^nε+v^n,m^n=mn/rn,v^n=vn/rˉn.\begin{aligned} m_n &= \alpha_n m_{n-1} + (1-\alpha_n)\nabla f(x_{n-1}, \xi_n), & v_n &= \beta_n v_{n-1} + (1-\beta_n)\nabla f(x_{n-1}, \xi_n)^{\odot 2},\\ r_n &= \alpha_n r_{n-1} + (1 - \alpha_n), & \bar r_n &= \beta_n \bar r_{n-1} + (1 - \beta_n),\\ x_n &= x_{n-1} - \gamma_n \frac{\hat m_n}{\varepsilon + \sqrt{\hat v_n}}, & \hat m_n &= m_n / r_n,\quad \hat v_n = v_n / \bar r_n . \end{aligned}mn​rn​xn​​=αn​mn−1​+(1−αn​)∇f(xn−1​,ξn​),=αn​rn−1​+(1−αn​),=xn−1​−γn​ε+v^n​​m^n​​,​vn​rˉn​m^n​​=βn​vn−1​+(1−βn​)∇f(xn−1​,ξn​)⊙2,=βn​rˉn−1​+(1−βn​),=mn​/rn​,v^n​=vn​/rˉn​.​

The divisions by rnr_nrn​, rˉn\bar r_nrˉn​ are the bias correction.

The stepsizes satisfy Assumption 5.1: γn+1/γn→1\gamma_{n+1}/\gamma_n \to 1γn+1​/γn​→1, ∑nγn=+∞\sum_n \gamma_n = +\infty∑n​γn​=+∞, ∑nγn2<+∞\sum_n \gamma_n^2 < +\infty∑n​γn2​<+∞, and there are a,ba, ba,b with 0<b<4a0 < b < 4a0<b<4a, (1−αn)/γn→a(1-\alpha_n)/\gamma_n \to a(1−αn​)/γn​→a and (1−βn)/γn→b(1-\beta_n)/\gamma_n \to b(1−βn​)/γn​→b. The limiting dynamics is the autonomous ODE z˙=h∞(z)\dot z = h_\infty(z)z˙=h∞​(z) on Z+=Rd×Rd×[0,∞)d\mathcal Z_+ = \mathbb R^d \times \mathbb R^d \times [0,\infty)^dZ+​=Rd×Rd×[0,∞)d, written (ODE∞)(\mathrm{ODE}_\infty)(ODE∞​), with

h∞(x,m,v)=(−mε+v, a(∇F(x)−m), b(S(x)−v)).h_\infty(x, m, v) = \Big( -\frac{m}{\varepsilon + \sqrt v},\ a(\nabla F(x) - m),\ b(S(x) - v) \Big).h∞​(x,m,v)=(−ε+v​m​, a(∇F(x)−m), b(S(x)−v)).

Formalization targets

Goal: Theorem 5.2

Assume Assumption 2.2 (regularity and moments of fff), FFF coercive (2.3), S(x)>0S(x) > 0S(x)>0 coordinatewise (2.4), iid samples (4.1), Assumption 5.1, sup⁡x∈KE∥∇f(x,ξ)∥4<∞\sup_{x\in K}\mathbb E\|\nabla f(x,\xi)\|^4 < \inftysupx∈K​E∥∇f(x,ξ)∥4<∞ on compacts (4.2 i) with p=4p = 4p=4), that F(S)F(\mathcal S)F(S) has empty interior, and that (xn,mn,vn)(x_n, m_n, v_n)(xn​,mn​,vn​) is bounded with probability one. Then, almost surely,

d(xn,S)→0,mn→0,S(xn)−vn→0,d(x_n, \mathcal S) \to 0, \qquad m_n \to 0, \qquad S(x_n) - v_n \to 0,d(xn​,S)→0,mn​→0,S(xn​)−vn​→0,

and if S\mathcal SS is countable, almost surely (xn,mn,vn)→(x∗,0,S(x∗))(x_n, m_n, v_n) \to (x^*, 0, S(x^*))(xn​,mn​,vn​)→(x∗,0,S(x∗)) for some x∗∈Sx^* \in \mathcal Sx∗∈S.

Milestones

  1. Lemma 9.1 i)–ii): rn=1−∏i=1nαir_n = 1 - \prod_{i=1}^n \alpha_irn​=1−∏i=1n​αi​, and rnr_nrn​ increases to 111.
  2. §9.1: in the decomposition zˉn+1=zˉn+γn+1h∞(zˉn)+γn+1χn+1+γn+1ςn+1\bar z_{n+1} = \bar z_n + \gamma_{n+1} h_\infty(\bar z_n) + \gamma_{n+1}\chi_{n+1} + \gamma_{n+1}\varsigma_{n+1}zˉn+1​=zˉn​+γn+1​h∞​(zˉn​)+γn+1​χn+1​+γn+1​ςn+1​ of zˉn=(xn−1,mn,vn)\bar z_n = (x_{n-1}, m_n, v_n)zˉn​=(xn−1​,mn​,vn​), the remainder satisfies ςn→0\varsigma_n \to 0ςn​→0 almost surely.
  3. §9.1: the piecewise-affine interpolation of (zˉn)(\bar z_n)(zˉn​) on the times τn=∑k≤nγk\tau_n = \sum_{k\le n}\gamma_kτn​=∑k≤n​γk​ is almost surely a bounded asymptotic pseudotrajectory of the semiflow of (ODE∞)(\mathrm{ODE}_\infty)(ODE∞​).
  4. Proposition 7.13: (ODE∞)(\mathrm{ODE}_\infty)(ODE∞​) is well posed on Z+\mathcal Z_+Z+​ and defines a semiflow Φ\PhiΦ.
  5. Proposition 7.14 (after Benaïm): the limit set of a relatively compact asymptotic pseudotrajectory of a semiflow with a strict Lyapunov function lies in the set of equilibria.
  6. Proposition 7.15: on the closed hull of the orbits of a compact set, Wδ=V∞−δ⟨∇F(x),m⟩+δ∥S(x)−v∥2W_\delta = V_\infty - \delta\langle\nabla F(x), m\rangle + \delta\|S(x) - v\|^2Wδ​=V∞​−δ⟨∇F(x),m⟩+δ∥S(x)−v∥2 is a strict Lyapunov function for some δ>0\delta > 0δ>0.

Significance

The theorem identifies a regime of Adam's hyperparameters, 1−αn∼aγn1 - \alpha_n \sim a\gamma_n1−αn​∼aγn​ and 1−βn∼bγn1 - \beta_n \sim b\gamma_n1−βn​∼bγn​ with b<4ab < 4ab<4a, in which the algorithm behaves like a gradient method with vanishing noise: the iterates approach critical points, the momentum dies out, and the second-moment estimate converges to S(xn)S(x_n)S(xn​). The condition b<4ab < 4ab<4a ties the two averaging rates together. It is the condition under which the paper's Lyapunov function for the continuous dynamics decreases (Lemma 7.5). The argument structure is also a template for other adaptive methods: once the limiting ODE has a strict Lyapunov function, almost-sure convergence of the iterates follows from the same steps.

The paper proves the result on paper; none of it is machine-checked. A formal proof would also be the first formal instance on Prove2Me of the full ODE method for a concrete stochastic algorithm. That pipeline runs from the iterates to a perturbed Euler scheme, then to an asymptotic pseudotrajectory and a limit-set theorem, and finally to convergence. Benaïm's general results are being formalized separately on the platform (the asymptotic-pseudotrajectory definition this mission reuses comes from that effort), so the two developments meet in milestone 3.

Difficulty

The obvious approach is to treat Adam as stochastic gradient descent with a preconditioner and run a descent-lemma argument on F(xn)F(x_n)F(xn​). This fails because the update direction m^n/(ε+v^n)\hat m_n/(\varepsilon + \sqrt{\hat v_n})m^n​/(ε+v^n​​) is not a descent direction for FFF: mnm_nmn​ lags behind ∇F(xn)\nabla F(x_n)∇F(xn​). Any Lyapunov function has to involve the momentum, and FFF alone does not decrease. The continuous-time energy V∞V_\inftyV∞​ decreases only weakly, and only its perturbation WδW_\deltaWδ​ is strict, and only on compact sets. A second difficulty is that the stepsize-dependent coefficients (1−αn+1)/γn+1(1-\alpha_{n+1})/\gamma_{n+1}(1−αn+1​)/γn+1​ and the bias corrections rnr_nrn​, rˉn\bar r_nrˉn​ make the recursion a non-autonomous perturbation of the Euler scheme of h∞h_\inftyh∞​. The remainder must be shown to vanish along almost every path before the general theory applies. Finally, the abstract limit-set theorem needs the semiflow to be well defined on the closed set Z+\mathcal Z_+Z+​, where h∞h_\inftyh∞​ involves v\sqrt vv​ and is not Lipschitz at v=0v = 0v=0.

Formalization scope

Rd\mathbb R^dRd is EuclideanSpace ℝ (Fin d). The state space Z\mathcal ZZ is the product of three copies with Mathlib's max-of-factors norm, which is equivalent to the Euclidean norm of R3d\mathbb R^{3d}R3d and leaves boundedness and limits unchanged. FFF and SSS are Bochner integrals against the law μ\muμ. Assumption 2.2 makes the integrands integrable, so they are the true expectations. Moments are lower Lebesgue integrals. Algorithm 5.1 is a pathwise recursion adamIter, driven by a random sequence ξ:N→Ω→Ξ\xi : \mathbb N \to \Omega \to \Xiξ:N→Ω→Ξ whose index 000 is unused. The iid hypothesis is iIndepFun with every ξn+1\xi_{n+1}ξn+1​ of law μ\muμ.

Two hypotheses are left implicit on the page and are added explicitly. The first is ε>0\varepsilon > 0ε>0. The second is α1<1\alpha_1 < 1α1​<1 and β1<1\beta_1 < 1β1​<1: Assumption 5.1 iii) permits α1=1\alpha_1 = 1α1​=1, which gives r1=0r_1 = 0r1​=0, and Lean's division by zero returns 000. Lemma 9.1 is stated with γn>0\gamma_n > 0γn​>0 and ∑γn=∞\sum\gamma_n = \infty∑γn​=∞, which its convergence claim needs. Semiflows are Flow ℝ≥0 on the subtype Z+\mathcal Z_+Z+​, and the asymptotic pseudotrajectory and limit set are the published StochApproxDyn.LimitSet definitions. The ODE milestones 4–6 hold for abstract FFF, SSS under Assumptions 7.1–7.2 with 0<b≤4a0 < b \le 4a0<b≤4a, as in the paper's §7.

The goal concerns the iterates of Algorithm 5.1 itself. A statement about trajectories of (ODE∞)(\mathrm{ODE}_\infty)(ODE∞​), or one that replaces almost-sure boundedness by a bound uniform in ω\omegaω together with deterministic gradients, is a different and much weaker theorem and is ruled out. The interior condition on F(S)F(\mathcal S)F(S) and the countability of S\mathcal SS enter exactly as on the page.

A complete development needs the following:

  • well-posedness of the ODE on a closed set with a non-Lipschitz field;
  • the Benaïm machinery: martingale-noise control via Doob's convergence theorem, and the passage from vanishing perturbations to asymptotic pseudotrajectories;
  • the limit-set theorem for strict Lyapunov functions.

The last two are reusable for any stochastic approximation scheme, and contributions to them are welcome independently of Adam.

Selected references

  • A. Barakat, P. Bianchi, Convergence and Dynamical Behavior of the ADAM Algorithm for Nonconvex Stochastic Optimization, SIAM J. Math. Data Sci. 3(1), 2021; arXiv:1810.02263v4. https://arxiv.org/abs/1810.02263
  • M. Benaïm, Dynamics of stochastic approximation algorithms, Séminaire de Probabilités XXXIII, LNM 1709, Springer, 1999. https://doi.org/10.1007/BFb0096509
  • D. P. Kingma, J. Ba, Adam: A Method for Stochastic Optimization, ICLR 2015. https://arxiv.org/abs/1412.6980
  • S. J. Reddi, S. Kale, S. Kumar, On the Convergence of Adam and Beyond, ICLR 2018. https://arxiv.org/abs/1904.09237
16 thms2 active usersReviewed
Convex OptimizationFunctional AnalysisOperations Research+1·Captain: mikedeng1

Tikhonov Regularization of a Second Order Dynamical System with Hessian Driven Damping 1: For α > 3 and ∫ tε(t) dt < +∞ the Trajectory Converges Weakly to a Minimizer of gResearch Paper

Motivation

Minimizing a convex function ggg on a real Hilbert space H\mathcal HH by first-order methods has a continuous-time counterpart: second-order differential equations whose trajectories descend ggg. Su, Boyd and Candès (20) showed that Nesterov's accelerated gradient method is a discretization of x¨+αtx˙+∇g(x)=0\ddot x+\frac{\alpha}{t}\dot x+\nabla g(x)=0x¨+tα​x˙+∇g(x)=0 with α=3\alpha=3α=3, along which g(x(t))−min⁡g=O(1/t2)g(x(t))-\min g=O(1/t^2)g(x(t))−ming=O(1/t2). Two modifications of this equation have been studied separately because each adds a property the plain system lacks.

  • A Hessian-driven damping term β∇2g(x(t))x˙(t)\beta\nabla^2g(x(t))\dot x(t)β∇2g(x(t))x˙(t) (Attouch, Peypouquet, Redont, J. Differential Equations 2016) damps oscillations and, for β>0\beta>0β>0, makes t2∥∇g(x(t))∥2t^2\|\nabla g(x(t))\|^2t2∥∇g(x(t))∥2 integrable, while keeping fast values and weak convergence of trajectories.
  • A Tikhonov regularization term ϵ(t)x(t)\epsilon(t)x(t)ϵ(t)x(t) with ϵ(t)↓0\epsilon(t)\downarrow0ϵ(t)↓0 (Attouch, Chbani, Riahi, J. Math. Anal. Appl. 2018) can steer trajectories to the minimum-norm minimizer.

Boţ, Csetnek and László (arXiv:1911.12845v2, 2020) combine both terms and ask which properties of the two parent systems survive. This mission covers the first of their answers: when ϵ\epsilonϵ decays fast enough, the fast rates and the weak convergence of trajectories are preserved.

Timeline. 2016 (published 2018): weak convergence of trajectories of x¨+αtx˙+∇g(x)=0\ddot x+\frac\alpha t\dot x+\nabla g(x)=0x¨+tα​x˙+∇g(x)=0 for α>3\alpha>3α>3 (Attouch, Chbani, Peypouquet, Redont, Math. Program. 168). 2016: the same with Hessian-driven damping, β>0\beta>0β>0 (Attouch, Peypouquet, Redont). 2018: Tikhonov regularization of that system, with the O(1/t2)O(1/t^2)O(1/t2) rate kept and strong convergence to the minimum-norm minimizer under slow decay of ϵ\epsilonϵ (Attouch, Chbani, Riahi). 2020: both terms together (Boţ, Csetnek, László, this paper).

Setting

Fix a real Hilbert space H\mathcal HH, a starting time t0>0t_0>0t0​>0, parameters α≥3\alpha\ge3α≥3 and β≥0\beta\ge0β≥0, and initial data u0,v0∈Hu_0,v_0\in\mathcal Hu0​,v0​∈H. The General assumption of the paper is:

  • g:H→Rg:\mathcal H\to\mathbb Rg:H→R is convex and twice Fréchet differentiable, ∇g\nabla g∇g is Lipschitz continuous on bounded sets, and argmin⁡g≠∅\operatorname{argmin} g\ne\emptysetargming=∅; min⁡g\min gming denotes its minimal value;
  • ϵ:[t0,+∞)→[0,+∞)\epsilon:[t_0,+\infty)\to[0,+\infty)ϵ:[t0​,+∞)→[0,+∞) is nonincreasing, of class C1C^1C1, and ϵ(t)→0\epsilon(t)\to0ϵ(t)→0 as t→+∞t\to+\inftyt→+∞.

The dynamical system is

x¨(t)+αtx˙(t)+β∇2g(x(t))x˙(t)+∇g(x(t))+ϵ(t)x(t)=0,t≥t0,x(t0)=u0, x˙(t0)=v0.(5)\ddot x(t)+\frac{\alpha}{t}\dot x(t)+\beta\nabla^2g(x(t))\dot x(t)+\nabla g(x(t))+\epsilon(t)x(t)=0,\quad t\ge t_0,\quad x(t_0)=u_0,\ \dot x(t_0)=v_0. \tag{5}x¨(t)+tα​x˙(t)+β∇2g(x(t))x˙(t)+∇g(x(t))+ϵ(t)x(t)=0,t≥t0​,x(t0​)=u0​, x˙(t0​)=v0​.(5)

A global C2C^2C2-solution is a twice continuously differentiable x:[t0,+∞)→Hx:[t_0,+\infty)\to\mathcal Hx:[t0​,+∞)→H satisfying (5) for every t≥t0t\ge t_0t≥t0​. The decay of ϵ\epsilonϵ is controlled by ∫t0+∞tϵ(t) dt<+∞\int_{t_0}^{+\infty}t\epsilon(t)\,dt<+\infty∫t0​+∞​tϵ(t)dt<+∞ together with one of two conditions:

  • (a) there exist a>1a>1a>1 and t1≥t0t_1\ge t_0t1​≥t0​ with ϵ˙(t)≤−aβ2ϵ2(t)\dot\epsilon(t)\le-\frac{a\beta}{2}\epsilon^2(t)ϵ˙(t)≤−2aβ​ϵ2(t) for all t≥t1t\ge t_1t≥t1​;
  • (b) there exist a>0a>0a>0 and t1≥t0t_1\ge t_0t1​≥t0​ with ϵ(t)≤at\epsilon(t)\le\frac atϵ(t)≤ta​ for all t≥t1t\ge t_1t≥t1​.

A curve x(t)x(t)x(t) converges weakly to xˉ\bar xxˉ if ⟨x(t),v⟩→⟨xˉ,v⟩\langle x(t),v\rangle\to\langle\bar x,v\rangle⟨x(t),v⟩→⟨xˉ,v⟩ for every v∈Hv\in\mathcal Hv∈H. The Lean development lives in the namespace TikhonovHDD.Weak, with IsSolution, GenAssumptionG, GenAssumptionEps, CondA, CondB, argmin, minVal and WeakTendstoAtTop for these objects.

Formalization targets

Goal: Theorem 3.5 (p. 15)

Under the General assumption, ∫t0+∞tϵ(t) dt<+∞\int_{t_0}^{+\infty}t\epsilon(t)\,dt<+\infty∫t0​+∞​tϵ(t)dt<+∞ and (a) or (b), if α>3\alpha>3α>3 then every global C2C^2C2-solution of (5) satisfies

∃ xˉ∈argmin⁡g:x(t)⇀xˉ(t→+∞).\exists\,\bar x\in\operatorname{argmin} g:\qquad x(t)\rightharpoonup\bar x\quad(t\to+\infty).∃xˉ∈argming:x(t)⇀xˉ(t→+∞).

Milestones

In the order the argument uses them:

  1. Theorem 2.1 (p. 4): existence and uniqueness of a global C2C^2C2-solution of (5).
  2. Lemma A.2 (p. 29): a bounded-below, locally absolutely continuous FFF with F˙≤G∈L1\dot F\le G\in L^1F˙≤G∈L1 a.e. has a finite limit.
  3. Theorem 3.3 (p. 11), split three ways: for α≥3\alpha\ge3α≥3, g(x(t))−min⁡g=O(1/t2)g(x(t))-\min g=O(1/t^2)g(x(t))−ming=O(1/t2); for α>3\alpha>3α>3, xxx is bounded and t(g(x(t))−min⁡g)t(g(x(t))-\min g)t(g(x(t))−ming), t∥x˙∥2t\|\dot x\|^2t∥x˙∥2, tϵ∥x−x∗∥2t\epsilon\|x-x^*\|^2tϵ∥x−x∗∥2, tϵ∥x∥2∈L1t\epsilon\|x\|^2\in L^1tϵ∥x∥2∈L1; and separately t2∥∇g(x(t))∥2∈L1t^2\|\nabla g(x(t))\|^2\in L^1t2∥∇g(x(t))∥2∈L1.
  4. Lemma A.3 (p. 30): u(t)+tαu˙(t)→uˉu(t)+\frac t\alpha\dot u(t)\to\bar uu(t)+αt​u˙(t)→uˉ with α>0\alpha>0α>0 implies u(t)→uˉu(t)\to\bar uu(t)→uˉ.
  5. Theorem 3.4 (p. 12): for α>3\alpha>3α>3 and every x∗∈argmin⁡gx^*\in\operatorname{argmin} gx∗∈argming, t⟨∇g(x),x−x∗⟩∈L1t\langle\nabla g(x),x-x^*\rangle\in L^1t⟨∇g(x),x−x∗⟩∈L1, lim⁡∥x(t)−x∗∥\lim\|x(t)-x^*\|lim∥x(t)−x∗∥ and lim⁡t⟨x˙+β∇g(x),x−x∗⟩\lim t\langle\dot x+\beta\nabla g(x),x-x^*\ranglelimt⟨x˙+β∇g(x),x−x∗⟩ exist, g(x(t))−min⁡g=o(1/t2)g(x(t))-\min g=o(1/t^2)g(x(t))−ming=o(1/t2), ∥x˙+β∇g(x)∥=o(1/t)\|\dot x+\beta\nabla g(x)\|=o(1/t)∥x˙+β∇g(x)∥=o(1/t), and t2ϵ(t)∥x(t)∥2→0t^2\epsilon(t)\|x(t)\|^2\to0t2ϵ(t)∥x(t)∥2→0.

Significance

The result. Theorem 3.5 shows that the Tikhonov term, when it decays at least as fast as ∫tϵ<∞\int t\epsilon<\infty∫tϵ<∞ requires, does not disturb the asymptotics of the Hessian-damped system: values converge at rate o(1/t2)o(1/t^2)o(1/t2) and trajectories converge weakly to a minimizer. With β=0\beta=0β=0 it recovers the corresponding results for the regularized system without Hessian damping, and with ϵ≡0\epsilon\equiv0ϵ≡0 those for the Hessian-damped system. It is also the boundary case of the paper's second half, where slower decay of ϵ\epsilonϵ is shown to give strong convergence to the minimum-norm minimizer instead.

Formalizing it. The results are proved in the paper; none of them is machine-checked. A formal development would produce reusable pieces: a Lyapunov-energy analysis of second-order systems with time-dependent coefficients, the asymptotic Lemmas A.2 and A.3, and the bridge from "the distance to every minimizer converges and weak cluster points are minimizers" to weak convergence of a curve (the continuous Opial lemma).

Difficulty

The obvious approach, a single Lyapunov function that decreases along trajectories, fails here: the Tikhonov term makes the natural energy Eb\mathcal E_bEb​ only almost nonincreasing, with an error ∝tϵ(t)∥x∗∥2\propto t\epsilon(t)\|x^*\|^2∝tϵ(t)∥x∗∥2 that must be integrated, and the Hessian term produces a cross term −βϵ(t)t2⟨∇g(x),x⟩-\beta\epsilon(t)t^2\langle\nabla g(x),x\rangle−βϵ(t)t2⟨∇g(x),x⟩ that is controlled only by condition (a) or (b). The step from O(1/t2)O(1/t^2)O(1/t2) to o(1/t2)o(1/t^2)o(1/t2) and to the existence of lim⁡∥x(t)−x∗∥\lim\|x(t)-x^*\|lim∥x(t)−x∗∥ cannot be read off a single bounded energy: boundedness of Eb\mathcal E_bEb​ gives rates in OOO, not in ooo, and says nothing directly about ∥x(t)−x∗∥\|x(t)-x^*\|∥x(t)−x∗∥. Weak convergence then requires Opial's lemma, which is not in Mathlib in continuous form. Existence of solutions is itself nontrivial in infinite dimension: the right-hand side involves ∇2g\nabla^2g∇2g, so the system has to be rewritten as a first-order system before the Cauchy–Lipschitz theorem applies.

Formalization scope

  • H\mathcal HH is any real Hilbert space (InnerProductSpace ℝ H, CompleteSpace H); nothing is finite-dimensional, so weak convergence is genuinely weaker than norm convergence. It is stated through inner products with every v∈Hv\in\mathcal Hv∈H; stating it as norm convergence, or testing only some vvv, would change the theorem.
  • Trajectories are maps R→H\mathbb R\to\mathcal HR→H with velocity and acceleration maps; derivatives are one-sided at t0t_0t0​ and values before t0t_0t0​ play no role. Every theorem is stated for every C2C^2C2-solution; Theorem 2.1 shows this class is a singleton, so the hypothesis is not vacuous. A sorry-free check that the hypotheses of the goal can be met (g=0g=0g=0, ϵ=0\epsilon=0ϵ=0, x=0x=0x=0) accompanies the drafts.
  • ∇2g(x)v\nabla^2g(x)v∇2g(x)v is the derivative of ∇g\nabla g∇g at xxx applied to vvv; ϵ˙\dot\epsilonϵ˙ is a derivative map tied to ϵ\epsilonϵ on [t0,+∞)[t_0,+\infty)[t0​,+∞); min⁡g=inf⁡g\min g=\inf gming=infg, attained since argmin⁡g≠∅\operatorname{argmin} g\ne\emptysetargming=∅; L1L^1L1 membership is Lebesgue integrability on [t0,+∞)[t_0,+\infty)[t0​,+∞) (never a comparison of a Bochner integral with a number); OOO, ooo are Asymptotics relations at +∞+\infty+∞.
  • Repair. Theorem 2.1 carries the extra hypothesis "β=0\beta=0β=0 or g∈C2g\in C^2g∈C2". As printed (only twice differentiable ggg) it is false for β>0\beta>0β>0: on R\mathbb RR, g′(x)=2x+x2sin⁡(1/x)g'(x)=2x+x^2\sin(1/x)g′(x)=2x+x2sin(1/x) gives a strongly convex ggg with bounded but discontinuous g′′g''g′′, and the solution from u0=0u_0=0u0​=0, v0=1v_0=1v0​=1 is not C2C^2C2. The paper's own proof uses continuity of ∇2g\nabla^2 g∇2g.
  • Flagged, not repaired. The last claim of Theorem 3.3, t2∥∇g(x(t))∥2∈L1t^2\|\nabla g(x(t))\|^2\in L^1t2∥∇g(x(t))∥2∈L1, is its own item: the paper's argument for it uses a term proportional to β\betaβ, so for β=0\beta=0β=0 the paper gives no proof. No counterexample is known, and the statement is drafted as printed.
  • Referenced, not re-posed. Lemma A.4 (continuous Opial lemma, p. 30), the last step of the goal's proof, is the published InertialAVD.Traj.lemma_A_2 (same hypotheses: SSS nonempty, lim⁡∥x(t)−z∥\lim\|x(t)-z\|lim∥x(t)−z∥ exists for every z∈Sz\in Sz∈S, every weak sequential limit point lies in SSS; same conclusion). It is a reference milestone of this mission; its weak convergence InertialAVD.Traj.WeakTendstoAtTop has the same body as TikhonovHDD.Weak.WeakTendstoAtTop.
  • The model is defined from scratch: the published HessianDamping.DINAVD.Setting concerns a different equation (no ϵx\epsilon xϵx term) and is not reused.
  • Welcome contributions: a general Cauchy–Lipschitz existence theorem for locally Lipschitz first-order systems in Banach spaces on [t0,+∞)[t_0,+\infty)[t0​,+∞) with a blow-up alternative, the continuous Opial lemma, and Lemma A.2 for absolutely continuous functions.

Selected references

  • R.I. Boţ, E.R. Csetnek, S.C. László, Tikhonov regularization of a second order dynamical system with Hessian driven damping, arXiv:1911.12845v2, 2020; published in Math. Program., https://doi.org/10.1007/s10107-020-01528-8. https://arxiv.org/abs/1911.12845v2
  • H. Attouch, J. Peypouquet, P. Redont, Fast convex optimization via inertial dynamics with Hessian driven damping, J. Differential Equations 261(10), 5734–5783, 2016. https://doi.org/10.1016/j.jde.2016.08.020
  • H. Attouch, Z. Chbani, H. Riahi, Combining fast inertial dynamics for convex optimization with Tikhonov regularization, J. Math. Anal. Appl. 457(2), 1065–1094, 2018. https://doi.org/10.1016/j.jmaa.2016.12.017
  • H. Attouch, Z. Chbani, J. Peypouquet, P. Redont, Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity, Math. Program. 168, 123–175, 2018. https://doi.org/10.1007/s10107-016-0992-8
  • W. Su, S. Boyd, E.J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, J. Mach. Learn. Res. 17(153), 1–43, 2016. https://jmlr.org/papers/v17/15-084.html
10 thms2 active usersReviewed
Convex OptimizationFunctional AnalysisOperations Research+1·Captain: mikedeng1

Tikhonov Regularization of a Second Order Dynamical System with Hessian Driven Damping 2: lim inf ‖x(t) − x*‖ = 0 at the Minimum-Norm Minimizer, and x(t) → x* If x(t) Ends In or Out of B(0, ‖x*‖)Research Paper

Motivation

Many methods for minimizing a smooth convex function ggg on a Hilbert space can be read as discretizations of second order ordinary differential equations, and the asymptotic behaviour of the continuous trajectories predicts the behaviour of the iterates. The inertial system with vanishing damping x¨+αtx˙+∇g(x)=0\ddot x+\frac{\alpha}{t}\dot x+\nabla g(x)=0x¨+tα​x˙+∇g(x)=0 is the continuous counterpart of Nesterov's accelerated gradient method (Su, Boyd, Candès 2016); for α>3\alpha>3α>3 its trajectories converge weakly to some minimizer of ggg (Attouch, Chbani, Peypouquet, Redont 2018). Two modifications of this system have been studied separately. A Hessian driven damping term β∇2g(x)x˙\beta\nabla^2g(x)\dot xβ∇2g(x)x˙ reduces oscillations while keeping the fast rate of the values (Attouch, Peypouquet, Redont 2016). A Tikhonov regularization term ϵ(t)x\epsilon(t)xϵ(t)x with ϵ(t)→0\epsilon(t)\to 0ϵ(t)→0 selects a particular minimizer: under suitable decay of ϵ\epsilonϵ, trajectories approach the minimizer of minimum norm in the strong (norm) topology (Attouch, Chbani, Riahi 2018).

Boţ, Csetnek and László (arXiv:1911.12845v2, published in Mathematical Programming 2021) combine both terms and ask which properties of the two separate systems survive. This mission formalizes their strong convergence result, Theorem 4.4.

Setting

Let H\mathcal HH be a real Hilbert space, t0>0t_0>0t0​>0, α≥3\alpha\ge 3α≥3, β≥0\beta\ge0β≥0, and u0,v0∈Hu_0,v_0\in\mathcal Hu0​,v0​∈H. The General assumption of the paper (p. 2) is:

  • g:H→Rg:\mathcal H\to\mathbb Rg:H→R is convex and twice Fréchet differentiable, ∇g\nabla g∇g is Lipschitz continuous on bounded sets, and argmin⁡g≠∅\operatorname{argmin} g\neq\emptysetargming=∅;
  • ϵ:[t0,+∞)→[0,+∞)\epsilon:[t_0,+\infty)\to[0,+\infty)ϵ:[t0​,+∞)→[0,+∞) is nonincreasing, of class C1C^1C1, and lim⁡t→+∞ϵ(t)=0\lim_{t\to+\infty}\epsilon(t)=0limt→+∞​ϵ(t)=0.

A global C2C^2C2-solution of the system

x¨(t)+αtx˙(t)+β∇2g(x(t))x˙(t)+∇g(x(t))+ϵ(t)x(t)=0,t≥t0,x(t0)=u0, x˙(t0)=v0,(5)\ddot x(t)+\frac{\alpha}{t}\dot x(t)+\beta\nabla^2g(x(t))\dot x(t)+\nabla g(x(t))+\epsilon(t)x(t)=0,\quad t\ge t_0,\qquad x(t_0)=u_0,\ \dot x(t_0)=v_0, \tag{5}x¨(t)+tα​x˙(t)+β∇2g(x(t))x˙(t)+∇g(x(t))+ϵ(t)x(t)=0,t≥t0​,x(t0​)=u0​, x˙(t0​)=v0​,(5)

is a twice continuously differentiable curve x:[t0,+∞)→Hx:[t_0,+\infty)\to\mathcal Hx:[t0​,+∞)→H satisfying (5) at every t≥t0t\ge t_0t≥t0​. The set argmin⁡g\operatorname{argmin} gargming is nonempty, closed and convex, so it has a unique element of minimum norm, denoted x∗x^*x∗. The open ball B(0,∥x∗∥)B(0,\|x^*\|)B(0,∥x∗∥) is {y:∥y∥<∥x∗∥}\{y:\|y\|<\|x^*\|\}{y:∥y∥<∥x∗∥}. In the Lean development these objects are GeneralAssumption g t₀ ε ε', IsSolution g α β t₀ ε u₀ v₀ x xd xdd and IsMinNormMinimizer g xstar in the namespace TikhonovHDD.Strong, with min⁡g\min gming written minValue g.

Formalization targets

Goal: Theorem 4.4 (p. 21)

Assume, in addition to the above,

∫t0+∞ϵ(t)t dt<+∞,lim⁡t→+∞βϵ(t)tα3+1∫t0tϵ2(s)sα3+1 ds=0,\int_{t_0}^{+\infty}\frac{\epsilon(t)}{t}\,dt<+\infty,\qquad \lim_{t\to+\infty}\frac{\beta}{\epsilon(t)t^{\frac{\alpha}{3}+1}}\int_{t_0}^{t}\epsilon^2(s)s^{\frac{\alpha}{3}+1}\,ds=0,∫t0​+∞​tϵ(t)​dt<+∞,t→+∞lim​ϵ(t)t3α​+1β​∫t0​t​ϵ2(s)s3α​+1ds=0,

that ϵ˙(t)≤−aβ2ϵ2(t)\dot\epsilon(t)\le-\frac{a\beta}{2}\epsilon^2(t)ϵ˙(t)≤−2aβ​ϵ2(t) for all t≥t1t\ge t_1t≥t1​, for some a>1a>1a>1 and t1≥t0t_1\ge t_0t1​≥t0​, and that lim⁡t→+∞t2ϵ(t)=+∞\lim_{t\to+\infty}t^2\epsilon(t)=+\inftylimt→+∞​t2ϵ(t)=+∞ if α=3\alpha=3α=3, while t2ϵ(t)≥23α(13α−1+βc2)t^2\epsilon(t)\ge\frac23\alpha\left(\frac13\alpha-1+\beta c^2\right)t2ϵ(t)≥32​α(31​α−1+βc2) for large ttt, for some c>0c>0c>0, if α>3\alpha>3α>3. Then

lim inf⁡t→+∞∥x(t)−x∗∥=0,\liminf_{t\to+\infty}\|x(t)-x^*\|=0,t→+∞liminf​∥x(t)−x∗∥=0,

and

lim⁡t→+∞∥x(t)−x∗∥=0\lim_{t\to+\infty}\|x(t)-x^*\|=0t→+∞lim​∥x(t)−x∗∥=0

if there exists T≥t0T\ge t_0T≥t0​ such that {x(t):t≥T}\{x(t):t\ge T\}{x(t):t≥T} stays either in B(0,∥x∗∥)B(0,\|x^*\|)B(0,∥x∗∥) or in its complement.

Milestones

  1. Lemma A.1 (p. 29): for nonnegative continuous integrable fff on (δ,+∞)(\delta,+\infty)(δ,+∞) and nondecreasing φ≥0\varphi\ge 0φ≥0 with φ(t)→+∞\varphi(t)\to+\inftyφ(t)→+∞, 1φ(t)∫δtφ(s)f(s) ds→0\frac1{\varphi(t)}\int_\delta^t\varphi(s)f(s)\,ds\to0φ(t)1​∫δt​φ(s)f(s)ds→0.
  2. Theorem 3.1 (pp. 5–6): for α≥3\alpha\ge3α≥3, g(x(t))→min⁡gg(x(t))\to\min gg(x(t))→ming under either (a) ∫t0+∞ϵ(t)/t dt<+∞\int_{t_0}^{+\infty}\epsilon(t)/t\,dt<+\infty∫t0​+∞​ϵ(t)/tdt<+∞ together with ϵ˙≤−aβ2ϵ2\dot\epsilon\le-\frac{a\beta}{2}\epsilon^2ϵ˙≤−2aβ​ϵ2 eventually, or (b) ϵ(t)≤a/t\epsilon(t)\le a/tϵ(t)≤a/t eventually.
  3. Case I of the proof of Theorem 4.4 (pp. 21–25): the trajectory eventually stays outside the open ball, and x(t)→x∗x(t)\to x^*x(t)→x∗.
  4. Case II (pp. 25–26): the trajectory eventually stays inside the open ball, and x(t)→x∗x(t)\to x^*x(t)→x∗.
  5. Case III (p. 26): the trajectory is inside and outside the ball for arbitrarily large times, and lim inf⁡∥x(t)−x∗∥=0\liminf\|x(t)-x^*\|=0liminf∥x(t)−x∗∥=0.

The three cases are exhaustive, so Cases I–III together give the goal.

Significance

Theorem 4.4 shows that adding Hessian driven damping does not destroy the selection property of Tikhonov regularization: the trajectory comes arbitrarily close to the minimum-norm minimizer, and converges to it in norm whenever it does not oscillate across the sphere ∥y∥=∥x∗∥\|y\|=\|x^*\|∥y∥=∥x∗∥ forever. Since ϵ(t)→0\epsilon(t)\to 0ϵ(t)→0, the system still approaches argmin⁡g\operatorname{argmin} gargming, but the limit is a canonical minimizer determined by ggg alone, not by the initial data. In infinite dimensions this is the difference between weak and strong convergence, a distinction that matters for ill-posed problems and inverse problems, where the minimum-norm solution is the one usually sought. Remark 4.5 of the paper compares the hypotheses with those of Attouch, Chbani and Riahi for the system without Hessian damping: for β=0\beta=0β=0 the lower bound required of t2ϵ(t)t^2\epsilon(t)t2ϵ(t) when α>3\alpha>3α>3 is, in the authors' words, "less tight" than theirs.

The result is proved in the paper; no part of it has a machine-checked proof. Formalizing it requires a Lyapunov-energy argument for a second order ODE in a Hilbert space, the weak lower semicontinuity of convex functions and of the norm, and the passage from weak to strong convergence via convergence of norms. Theorem 3.1 and Lemma A.1 are standalone results reusable for other Tikhonov-regularized inertial systems.

Difficulty

The weak convergence argument for the unregularized system (Opial's lemma) does not identify the limit, and it does not give strong convergence. Tikhonov regularization supplies the identification only through the Tikhonov curve xϵx_{\epsilon}xϵ​, the minimizer of g+ϵ2∥⋅∥2g+\frac{\epsilon}{2}\|\cdot\|^2g+2ϵ​∥⋅∥2, and comparing x(t)x(t)x(t) with xϵ(t)x_{\epsilon(t)}xϵ(t)​ requires an energy whose derivative is controlled with weights tuned to α\alphaα. The Hessian term produces cross terms of the form βϵ(t)t2⟨∇g(x(t)),x(t)⟩\beta\epsilon(t)t^2\langle\nabla g(x(t)),x(t)\rangleβϵ(t)t2⟨∇g(x(t)),x(t)⟩ that are absent from the system without Hessian damping; the integral hypothesis on ϵ2(s)sα/3+1\epsilon^2(s)s^{\alpha/3+1}ϵ2(s)sα/3+1 and the slow-decay condition ϵ˙≤−aβ2ϵ2\dot\epsilon\le-\frac{a\beta}{2}\epsilon^2ϵ˙≤−2aβ​ϵ2 exist to absorb them. A direct energy estimate only works when ∥x(t)∥≥∥x∗∥\|x(t)\|\ge\|x^*\|∥x(t)∥≥∥x∗∥; inside the ball a different argument is required, and when the trajectory crosses the sphere infinitely often neither argument yields convergence of the whole trajectory, only a liminf statement.

Formalization scope

Conventions committed to in Lean:

  • Curves are maps R→H\mathbb R\to\mathcal HR→H; only their values on [t0,+∞)[t_0,+\infty)[t0​,+∞) matter. Derivatives of xxx, x˙\dot xx˙ and ϵ\epsilonϵ are taken within [t0,+∞)[t_0,+\infty)[t0​,+∞) (one-sided at t0t_0t0​) and passed as explicit maps xd, xdd, ε'; x¨\ddot xx¨ and ϵ˙\dot\epsilonϵ˙ are continuous there.
  • ∇g\nabla g∇g is gradient g; ∇2g(x)v\nabla^2g(x)v∇2g(x)v is the Fréchet derivative of gradient g at xxx applied to vvv. "Lipschitz on bounded sets" means Lipschitz on every closed ball centred at 000.
  • min⁡g\min gming is the infimum of the range of ggg, attained because argmin⁡g≠∅\operatorname{argmin} g\neq\emptysetargming=∅.
  • ∫t0+∞ϵ(t)/t dt<+∞\int_{t_0}^{+\infty}\epsilon(t)/t\,dt<+\infty∫t0​+∞​ϵ(t)/tdt<+∞ is Lebesgue integrability of ϵ(t)/t\epsilon(t)/tϵ(t)/t on [t0,+∞)[t_0,+\infty)[t0​,+∞), never a comparison of a Bochner integral with a number. tα/3+1t^{\alpha/3+1}tα/3+1 is the real power.
  • lim inf⁡t→+∞∥x(t)−x∗∥=0\liminf_{t\to+\infty}\|x(t)-x^*\|=0liminft→+∞​∥x(t)−x∗∥=0 is written as: for every δ>0\delta>0δ>0, ∥x(t)−x∗∥<δ\|x(t)-x^*\|<\delta∥x(t)−x∗∥<δ for arbitrarily large ttt. Lean's Filter.liminf is not used, since it returns 000 for a function tending to +∞+\infty+∞.
  • The alternative "in the ball or in its complement" uses one TTT for both branches, with the disjunction outside the universal quantifier. Placing the disjunction inside (∀t≥T\forall t\ge T∀t≥T, ∥x(t)∥<∥x∗∥\|x(t)\|<\|x^*\|∥x(t)∥<∥x∗∥ or ∥x(t)∥≥∥x∗∥\|x(t)\|\ge\|x^*\|∥x(t)∥≥∥x∗∥) would make the hypothesis always true and the strong convergence claim unconditional, which the paper does not prove.
  • Every statement is made for every global C2C^2C2-solution of (5). Existence and uniqueness of that solution (Theorem 2.1 of the paper) is a separate result, formalized in the companion mission on weak convergence; the hypothesis is not vacuous.
  • No positivity of ϵ\epsilonϵ is assumed: it follows from the conditions for α=3\alpha=3α=3 and α>3\alpha>3α>3.
  • Cases I–III carry the full hypothesis list of Theorem 4.4, although Case II uses only part of it.

No statement of the mission has been repaired against the printed text.

A complete development needs: weak lower semicontinuity of convex continuous functions and of the norm on Hilbert spaces; weak sequential compactness of bounded sets; existence of the minimum-norm element of a closed convex set (Mathlib's projection onto closed convex sets); the strongly convex Tikhonov curve and its convergence to x∗x^*x∗; and calculus for energy functionals along C2C^2C2 curves on half-lines. Lemma A.1 and the Tikhonov-curve facts are reusable for every Tikhonov-regularized dynamics. Contributions of proofs of individual milestones, of supporting lemmas, and of alternative arguments are welcome.

Selected references

  • R.I. Boţ, E.R. Csetnek, S.C. László, Tikhonov regularization of a second order dynamical system with Hessian driven damping, arXiv:1911.12845v2, 2020; Mathematical Programming 189, 151–186, 2021. https://arxiv.org/abs/1911.12845v2, https://doi.org/10.1007/s10107-020-01528-8
  • H. Attouch, Z. Chbani, H. Riahi, Combining fast inertial dynamics for convex optimization with Tikhonov regularization, Journal of Mathematical Analysis and Applications 457, 1065–1094, 2018. https://doi.org/10.1016/j.jmaa.2016.12.017
  • H. Attouch, J. Peypouquet, P. Redont, Fast convex optimization via inertial dynamics with Hessian driven damping, Journal of Differential Equations 261(10), 5734–5783, 2016. https://doi.org/10.1016/j.jde.2016.08.020
  • H. Attouch, Z. Chbani, J. Peypouquet, P. Redont, Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity, Mathematical Programming 168, 123–175, 2018. https://doi.org/10.1007/s10107-016-0992-8
  • W. Su, S. Boyd, E.J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, Journal of Machine Learning Research 17(153), 1–43, 2016. https://jmlr.org/papers/v17/15-084.html
7 thms2 active usersReviewed
Convex OptimizationOptimization·Captain: mikedeng1

Fast Convergence of Inertial Dynamics and Algorithms with Asymptotic Vanishing Viscosity 1: For α > 3 Every Trajectory of ẍ + (α/t)ẋ + ∇Φ(x) = 0 Converges Weakly to a Minimizer of ΦResearch Paper

Motivation

Nesterov's accelerated gradient method and its proximal variant FISTA minimize a smooth convex function with a value gap of order O(1/k2)O(1/k^2)O(1/k2) after kkk iterations, against O(1/k)O(1/k)O(1/k) for plain gradient descent. They are among the most widely used first-order methods in large-scale optimization, signal processing and machine learning. Su, Boyd and Candès (JMLR 2016) observed that, for α=3\alpha = 3α=3, the second-order differential equation

x¨(t)+αt x˙(t)+∇Φ(x(t))=0(1)\ddot x(t) + \frac{\alpha}{t}\,\dot x(t) + \nabla\Phi(x(t)) = 0 \tag{1}x¨(t)+tα​x˙(t)+∇Φ(x(t))=0(1)

is a continuous-time limit of Nesterov's scheme, and proved Φ(x(t))−min⁡Φ=O(1/t2)\Phi(x(t)) - \min\Phi = O(1/t^2)Φ(x(t))−minΦ=O(1/t2) for α≥3\alpha \ge 3α≥3. A rate on the values says nothing about the trajectory itself: whether x(t)x(t)x(t) (or the iterates xkx_kxk​) converges at all was a long-standing question. The paper of Attouch, Chbani, Peypouquet and Redont answers it for α>3\alpha > 3α>3: every trajectory of (1) converges weakly to a minimizer of Φ\PhiΦ.

Timeline:

  • 1983 — Nesterov introduces the accelerated gradient method with an O(1/k2)O(1/k^2)O(1/k2) rate on the values.
  • 2000 — Alvarez proves weak convergence of the trajectories of the heavy ball with friction, x¨+γx˙+∇Φ(x)=0\ddot x + \gamma\dot x + \nabla\Phi(x) = 0x¨+γx˙+∇Φ(x)=0, whose damping is constant (SIAM J. Control Optim. 38).
  • 2009 — Beck and Teboulle extend it to composite problems (FISTA), still with a rate on the values only.
  • 2014–2016 — Su, Boyd, Candès identify (1) as the continuous model of Nesterov's method and prove the O(1/t2)O(1/t^2)O(1/t2) rate for α≥3\alpha\ge3α≥3.
  • 2015 — Attouch, Chbani, Peypouquet, Redont prove weak convergence of the trajectories of (1) for α>3\alpha > 3α>3 (this mission), and of the iterates of the corresponding algorithms; Chambolle and Dossal obtain the discrete result independently. The case α=3\alpha = 3α=3 remains open.

Setting

Let H\mathcal HH be a real Hilbert space with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥\|\cdot\|∥⋅∥, and let Φ:H→R\Phi:\mathcal H\to\mathbb RΦ:H→R be a continuously differentiable convex function with gradient ∇Φ\nabla\Phi∇Φ. Fix a damping parameter α>0\alpha>0α>0 and an initial time t0>0t_0>0t0​>0. A solution of (1) on [t0,+∞[[t_0,+\infty[[t0​,+∞[ is a pair of maps x,vx, vx,v from the time axis to H\mathcal HH such that, at every t≥t0t\ge t_0t≥t0​, xxx has derivative v(t)v(t)v(t) and vvv has derivative −αtv(t)−∇Φ(x(t))-\frac{\alpha}{t}v(t) - \nabla\Phi(x(t))−tα​v(t)−∇Φ(x(t)). So v=x˙v=\dot xv=x˙, and x¨\ddot xx¨ satisfies (1). The damping coefficient α/t\alpha/tα/t is singular at 000 and vanishes as t→+∞t\to+\inftyt→+∞; this is why the time origin is positive.

Three functions of time measure the progress of a solution:

  • the global energy W(t)=12∥x˙(t)∥2+Φ(x(t))W(t) = \frac12\|\dot x(t)\|^2 + \Phi(x(t))W(t)=21​∥x˙(t)∥2+Φ(x(t));
  • the anchored distance hz(t)=12∥x(t)−z∥2h_z(t) = \frac12\|x(t)-z\|^2hz​(t)=21​∥x(t)−z∥2 to a point z∈Hz\in\mathcal Hz∈H;
  • when Φ\PhiΦ has a minimizer x∗x^*x∗, the anchored energies, for λ,ξ≥0\lambda,\xi\ge0λ,ξ≥0,
Eλ,ξ(t)=t2(Φ(x(t))−min⁡Φ)+12∥λ(x(t)−x∗)+tx˙(t)∥2+ξ2∥x(t)−x∗∥2.\mathcal E_{\lambda,\xi}(t) = t^2\big(\Phi(x(t))-\min\Phi\big) + \tfrac12\|\lambda(x(t)-x^*) + t\dot x(t)\|^2 + \tfrac{\xi}{2}\|x(t)-x^*\|^2 .Eλ,ξ​(t)=t2(Φ(x(t))−minΦ)+21​∥λ(x(t)−x∗)+tx˙(t)∥2+2ξ​∥x(t)−x∗∥2.

x(t)x(t)x(t) converges weakly to xˉ\bar xxˉ as t→+∞t\to+\inftyt→+∞ if ⟨x(t),y⟩→⟨xˉ,y⟩\langle x(t),y\rangle\to\langle\bar x,y\rangle⟨x(t),y⟩→⟨xˉ,y⟩ for every y∈Hy\in\mathcal Hy∈H. A weak limit point of x(t)x(t)x(t) is the weak limit of a sequence x(sn)x(s_n)x(sn​) with sn→+∞s_n\to+\inftysn​→+∞. argmin⁡Φ\operatorname{argmin}\PhiargminΦ is the set of minimizers of Φ\PhiΦ.

Formalization targets

Goal: Theorem 2.16

If argmin⁡Φ≠∅\operatorname{argmin}\Phi\ne\emptysetargminΦ=∅ and α>3\alpha>3α>3, then for every solution xxx of (1) there is xˉ∈argmin⁡Φ\bar x\in\operatorname{argmin}\Phixˉ∈argminΦ with

x(t)⇀xˉ(t→+∞).x(t)\rightharpoonup\bar x\qquad(t\to+\infty).x(t)⇀xˉ(t→+∞).

The goal asserts only the qualitative conclusion; no rate or constant enters it.

Milestones

  1. Lemma 2.1 (energy dissipation): W˙(t)=−αt∥x˙(t)∥2\dot W(t) = -\frac{\alpha}{t}\|\dot x(t)\|^2W˙(t)=−tα​∥x˙(t)∥2 for t>t0t>t_0t>t0​; WWW is nonincreasing with a limit in R∪{−∞}\mathbb R\cup\{-\infty\}R∪{−∞}, finite when Φ\PhiΦ is bounded below.
  2. (7): h¨z(t)+αth˙z(t)+Φ(x(t))−Φ(z)≤∥x˙(t)∥2\ddot h_z(t) + \frac{\alpha}{t}\dot h_z(t) + \Phi(x(t)) - \Phi(z) \le \|\dot x(t)\|^2h¨z​(t)+tα​h˙z​(t)+Φ(x(t))−Φ(z)≤∥x˙(t)∥2.
  3. Lemma 2.2: ∫t0t1s(W(s)−Φ(z)) ds≤C−1th˙z(t)−32αW(t)\int_{t_0}^t \frac1s(W(s)-\Phi(z))\,ds \le C - \frac1t\dot h_z(t) - \frac{3}{2\alpha}W(t)∫t0​t​s1​(W(s)−Φ(z))ds≤C−t1​h˙z​(t)−2α3​W(t) with an explicit constant CCC.
  4. Theorem 2.3 i), ii) (minimizing property, every α>0\alpha>0α>0): lim⁡W(t)=lim⁡Φ(x(t))=inf⁡Φ∈R∪{−∞}\lim W(t) = \lim \Phi(x(t)) = \inf\Phi\in\mathbb R\cup\{-\infty\}limW(t)=limΦ(x(t))=infΦ∈R∪{−∞}, and every weak limit point of x(t)x(t)x(t) is a minimizer.
  5. Remark 2.6: the Lyapunov inequality for ddtEλ,ξ\frac{d}{dt}\mathcal E_{\lambda,\xi}dtd​Eλ,ξ​, and monotonicity of Eλ,λ(α−λ−1)\mathcal E_{\lambda,\lambda(\alpha-\lambda-1)}Eλ,λ(α−λ−1)​ for α≥3\alpha\ge3α≥3, 2≤λ≤α−12\le\lambda\le\alpha-12≤λ≤α−1.
  6. Theorem 2.14 ii) with (13), (15): for α>3\alpha>3α>3, ∥x(t)−x∗∥2≤E2,2(α−3)(t0)/(α−3)\|x(t)-x^*\|^2 \le \mathcal E_{2,2(\alpha-3)}(t_0)/(\alpha-3)∥x(t)−x∗∥2≤E2,2(α−3)​(t0​)/(α−3) and ∫t0∞t∥x˙(t)∥2 dt≤E2,2(α−3)(t0)/(α−3)\int_{t_0}^{\infty} t\|\dot x(t)\|^2\,dt \le \mathcal E_{2,2(\alpha-3)}(t_0)/(\alpha-3)∫t0​∞​t∥x˙(t)∥2dt≤E2,2(α−3)​(t0​)/(α−3).
  7. Lemma A.4: if tw¨+αw˙≤gt\ddot w + \alpha\dot w \le gtw¨+αw˙≤g a.e. with α>1\alpha>1α>1, g≥0g\ge0g≥0 integrable and www bounded below, then [w˙]+[\dot w]_+[w˙]+​ is integrable and lim⁡w(t)\lim w(t)limw(t) exists.
  8. Lemma A.2 (Opial's lemma, continuous form).

Significance

The result. Theorem 2.16 is the first proof that the trajectories of the continuous Nesterov model converge, not only their values. The paper's discrete analysis parallels the continuous one and yields weak convergence of the iterates of Nesterov-type forward–backward algorithms for α>3\alpha>3α>3 (Theorem 5.3, a companion mission). The minimizing property (Theorem 2.3) holds for every α>0\alpha>0α>0, with no minimizer assumed, and shows that a bounded trajectory exists only if Φ\PhiΦ has a minimizer. Strong convergence results under further geometric assumptions (Theorems 3.1–3.3) build directly on Theorem 2.16.

Formalizing it. All statements are proved on paper. None of them, nor the differential equation (1), is formalized on Prove2Me or in Mathlib; the discrete analogue (weak convergence of the unperturbed accelerated forward–backward iterates) exists on the platform as a separate result. A formal development provides: a reusable encoding of solutions of a non-autonomous second-order ODE in a Hilbert space; Lyapunov arguments with one-sided derivatives on a half-line; a continuous-time Opial lemma, which is the standard tool for weak convergence of evolution equations and of semigroups; and the scalar differential-inequality lemma A.4.

Difficulty

Lyapunov functions such as WWW or Eα−1,0\mathcal E_{\alpha-1,0}Eα−1,0​ give rates on the values but not convergence of x(t)x(t)x(t): a decreasing energy says nothing about where the trajectory goes, and the minimizer set may be a continuum. The natural first idea, showing that ∥x(t)−x∗∥\|x(t)-x^*\|∥x(t)−x∗∥ is eventually monotone as for the gradient flow, fails: the inertial term makes hx∗h_{x^*}hx∗​ oscillate, and (7) controls only th¨+αh˙t\ddot h + \alpha\dot hth¨+αh˙, a second-order quantity. Making it usable requires integrability of t∥x˙(t)∥2t\|\dot x(t)\|^2t∥x˙(t)∥2 on [t0,+∞[[t_0,+\infty[[t0​,+∞[, which is not available from the Su–Boyd–Candès energy and holds only for α>3\alpha>3α>3; the borderline α=3\alpha=3α=3 is open. In infinite dimension, convergence is genuinely weak: bounded sets are not compact, so the argument must identify weak limit points through weak lower semicontinuity of Φ\PhiΦ and conclude through Opial's lemma.

Formalization scope

  • Space. H\mathcal HH is a real inner product space that is complete (InnerProductSpace ℝ H, CompleteSpace H); no finite dimension is assumed, since in finite dimension weak and norm convergence coincide.
  • Potential. Φ:H→R\Phi:\mathcal H\to\mathbb RΦ:H→R with ConvexOn ℝ Set.univ Φ and ContDiff ℝ 1 Φ; ∇Φ\nabla\Phi∇Φ is Mathlib's gradient. Minimizers are points zzz with Φ(z)≤Φ(y)\Phi(z)\le\Phi(y)Φ(z)≤Φ(y) for all yyy; min⁡Φ\min\PhiminΦ is written Φ(x∗)\Phi(x^*)Φ(x∗) for such a point.
  • Solutions. (1) is the first-order system x˙=v\dot x=vx˙=v, v˙=−αtv−∇Φ(x)\dot v=-\frac{\alpha}{t}v-\nabla\Phi(x)v˙=−tα​v−∇Φ(x), with derivatives within [t0,+∞[[t_0,+\infty[[t0​,+∞[ at every t≥t0t\ge t_0t≥t0​ and t0>0t_0>0t0​>0. Existence of solutions is not assumed or proved: every statement concerns a given solution, as in the paper.
  • Limits and integrals. Limits in R∪{−∞}\mathbb R\cup\{-\infty\}R∪{−∞} are taken in EReal, inf⁡Φ\inf\PhiinfΦ as an EReal infimum. Improper integrals ∫t0+∞\int_{t_0}^{+\infty}∫t0​+∞​ carry an explicit integrability conjunct; integrals over [t0,t][t_0,t][t0​,t] are interval integrals of continuous functions.
  • Explicit constants. The constant CCC of Lemma 2.2 and the bounds E2,2(α−3)(t0)/(α−3)\mathcal E_{2,2(\alpha-3)}(t_0)/(\alpha-3)E2,2(α−3)​(t0​)/(α−3) of (13), (15) are stated exactly as the paper computes them.
  • Trivializations ruled out. Weak convergence is not replaced by norm convergence, the derivative relations between xxx, vvv and their energies are part of the hypotheses or conclusions (never a free deriv), and the solution predicate is non-vacuous: the constant trajectory for Φ=0\Phi=0Φ=0 and the explicit solution x(t)=t2x(t)=t^2x(t)=t2 of Example 2.5 satisfy it.
  • Citation. Theorem numbers and pages refer to the Optimization Online preprint 5179 (October 2015), titled "…asymptotic vanishing damping", not to the Mathematical Programming typesetting.

Contributions of reusable infrastructure are welcome, in particular a continuous-time Opial lemma, weak lower semicontinuity of continuous convex functions on a Hilbert space along weakly convergent sequences, and integration-by-parts lemmas for one-sided derivatives on a half-line.

Selected references

  • H. Attouch, Z. Chbani, J. Peypouquet, P. Redont, Fast convergence of inertial dynamics and algorithms with asymptotic vanishing damping, Optimization Online preprint 5179, 2015; published as …vanishing viscosity, Mathematical Programming 168 (2018) 123–175. https://optimization-online.org/wp-content/uploads/2015/10/5179.pdf, https://doi.org/10.1007/s10107-016-0992-8
  • W. Su, S. Boyd, E. J. Candès, A differential equation for modeling Nesterov's accelerated gradient method: theory and insights, Journal of Machine Learning Research 17 (2016) 1–43. https://jmlr.org/papers/v17/15-084.html
  • F. Alvarez, On the minimizing property of a second order dissipative system in Hilbert spaces, SIAM Journal on Control and Optimization 38 (2000) 1102–1119. https://doi.org/10.1137/S0363012998335802
  • Z. Opial, Weak convergence of the sequence of successive approximations for nonexpansive mappings, Bulletin of the AMS 73 (1967) 591–597. https://doi.org/10.1090/S0002-9904-1967-11761-0
  • A. Beck, M. Teboulle, A fast iterative shrinkage-thresholding algorithm for linear inverse problems, SIAM Journal on Imaging Sciences 2 (2009) 183–202. https://doi.org/10.1137/080716542
  • A. Chambolle, Ch. Dossal, On the convergence of the iterates of the "fast iterative shrinkage/thresholding algorithm", Journal of Optimization Theory and Applications 166 (2015) 968–982. https://doi.org/10.1007/s10957-015-0746-4
12 thms2 active usersReviewed
Convex OptimizationOptimization·Captain: mikedeng1

First-Order Optimization Algorithms via Inertial Systems with Hessian Driven Damping IV: For µ-Strongly Convex f, (DIN)2√µ,β Trajectories Satisfy f(x(t)) − min f ≤ Ce^{−√µ(t−t₀)/2}Research Paper

Motivation

Accelerated first-order methods for convex minimization, such as Nesterov's method and Polyak's heavy ball method, are now routinely studied through their continuous-time limits: second-order differential equations whose trajectories descend toward a minimizer. In the time-continuous setting the convergence analysis is a Lyapunov argument, and a good Lyapunov function for the ODE usually suggests one for the algorithm obtained by discretizing it.

Attouch, Chbani, Fadili and Riahi (arXiv:1907.10536v2, Math. Program. 2020) study inertial dynamics with Hessian-driven damping: besides the viscous friction term γx˙\gamma\dot xγx˙, the equation contains a term β∇2f(x(t))x˙(t)\beta\nabla^2 f(x(t))\dot x(t)β∇2f(x(t))x˙(t), which equals βddt∇f(x(t))\beta\frac{d}{dt}\nabla f(x(t))βdtd​∇f(x(t)). This damping is known to reduce the oscillations of the heavy ball trajectory, and because it is a time derivative of the gradient, explicit and implicit time discretizations of it produce first-order algorithms with no Hessian evaluation. This mission covers the strongly convex continuous-time result of the paper, Theorem 7 (§4.1, pp. 19–21). For β=0\beta=0β=0 it reduces to the heavy ball equation with friction 2μ2\sqrt\mu2μ​, whose exponential rate is due to Siegel (arXiv:1903.05671, Theorem 2.2), as the paper's Remark 7 records. For β>0\beta>0β>0, Remark 7 points to a result on a related but different dynamical system by Wilson, Recht and Jordan (arXiv:1611.02635, Theorem 1), whose rate is slightly worse. The algorithms (IPAHD-SC) and (IGAHD-SC) of §5 of the paper are the discrete counterparts of this theorem.

Setting

Let H\mathcal HH be a real Hilbert space with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥\|\cdot\|∥⋅∥. Let f:H→Rf:\mathcal H\to\mathbb Rf:H→R be a convex function of class C2\mathcal C^2C2, with gradient ∇f\nabla f∇f and Hessian ∇2f\nabla^2 f∇2f. For μ>0\mu>0μ>0, fff is μ\muμ-strongly convex (Definition 1) if f−μ2∥⋅∥2f-\frac\mu2\|\cdot\|^2f−2μ​∥⋅∥2 is convex. Such an fff is assumed to have a minimizer x⋆x^\starx⋆, and min⁡Hf=f(x⋆)\min_{\mathcal H} f=f(x^\star)minH​f=f(x⋆).

Fix t0>0t_0>0t0​>0 and a real constant β\betaβ. A solution trajectory of

x¨(t)+2μ x˙(t)+β∇2f(x(t))x˙(t)+∇f(x(t))=0(19)\ddot x(t)+2\sqrt{\mu}\,\dot x(t)+\beta\nabla^2 f(x(t))\dot x(t)+\nabla f(x(t))=0 \tag{19}x¨(t)+2μ​x˙(t)+β∇2f(x(t))x˙(t)+∇f(x(t))=0(19)

is a twice differentiable map x:[t0,+∞[→Hx:[t_0,+\infty[\to\mathcal Hx:[t0​,+∞[→H satisfying the equation at every t≥t0t\ge t_0t≥t0​. This is the dynamic (DIN)γ,β(\mathrm{DIN})_{\gamma,\beta}(DIN)γ,β​ of the paper with the constant viscous damping γ=2μ\gamma=2\sqrt\muγ=2μ​.

The proof uses two auxiliary functions. The first is the Lyapunov function

E(t)=f(x(t))−min⁡Hf+12∥μ(x(t)−x⋆)+x˙(t)+β∇f(x(t))∥2.\mathcal E(t)=f(x(t))-\min_{\mathcal H}f+\tfrac12\big\|\sqrt\mu(x(t)-x^\star)+\dot x(t)+\beta\nabla f(x(t))\big\|^2 .E(t)=f(x(t))−Hmin​f+21​​μ​(x(t)−x⋆)+x˙(t)+β∇f(x(t))​2.

The second is Z(t)=2β(f(x(t))−f(x⋆))+μ∥x(t)−x⋆∥2Z(t)=2\beta(f(x(t))-f(x^\star))+\sqrt\mu\|x(t)-x^\star\|^2Z(t)=2β(f(x(t))−f(x⋆))+μ​∥x(t)−x⋆∥2. Both appear in the milestones under the names lyap and Zfun.

Formalization targets

Goal: Theorem 7 (p. 19)

Assume 0≤β≤12μ0\le\beta\le\frac1{2\sqrt\mu}0≤β≤2μ​1​. Then three statements hold. First, for all t≥t0t\ge t_0t≥t0​,

μ2∥x(t)−x⋆∥2≤f(x(t))−min⁡Hf≤Ce−μ2(t−t0),C:=f(x(t0))−min⁡Hf+μ∥x(t0)−x⋆∥2+∥x˙(t0)+β∇f(x(t0))∥2.\frac\mu2\|x(t)-x^\star\|^2\le f(x(t))-\min_{\mathcal H}f\le C e^{-\frac{\sqrt\mu}{2}(t-t_0)},\qquad C:=f(x(t_0))-\min_{\mathcal H}f+\mu\|x(t_0)-x^\star\|^2+\|\dot x(t_0)+\beta\nabla f(x(t_0))\|^2 .2μ​∥x(t)−x⋆∥2≤f(x(t))−Hmin​f≤Ce−2μ​​(t−t0​),C:=f(x(t0​))−Hmin​f+μ∥x(t0​)−x⋆∥2+∥x˙(t0​)+β∇f(x(t0​))∥2.

Second, there is C1>0C_1>0C1​>0 such that for all t≥t0t\ge t_0t≥t0​

e−μt∫t0teμs∥∇f(x(s))∥2 ds≤C1e−μ2t.e^{-\sqrt\mu t}\int_{t_0}^t e^{\sqrt\mu s}\|\nabla f(x(s))\|^2\,ds\le C_1e^{-\frac{\sqrt\mu}{2}t}.e−μ​t∫t0​t​eμ​s∥∇f(x(s))∥2ds≤C1​e−2μ​​t.

Third,

∫t0∞eμ2t∥x˙(t)∥2 dt<+∞.\int_{t_0}^\infty e^{\frac{\sqrt\mu}{2}t}\|\dot x(t)\|^2\,dt<+\infty .∫t0​∞​e2μ​​t∥x˙(t)∥2dt<+∞.

Milestones

The milestones are the displayed steps of the paper's proof, in order:

  1. the strong convexity inequality ⟨∇f(y),y−x⋆⟩≥f(y)−f(x⋆)+μ2∥y−x⋆∥2\langle\nabla f(y),y-x^\star\rangle\ge f(y)-f(x^\star)+\frac\mu2\|y-x^\star\|^2⟨∇f(y),y−x⋆⟩≥f(y)−f(x⋆)+2μ​∥y−x⋆∥2;
  2. the first differential inequality for E\mathcal EE;
  3. the nonnegativity of μ4X2+β2μY2−βμXY\frac\mu4X^2+\frac{\beta}{2\sqrt\mu}Y^2-\beta\sqrt\mu XY4μ​X2+2μ​β​Y2−βμ​XY;
  4. ddtE+μ2E+μ2∥x˙∥2≤0\frac{d}{dt}\mathcal E+\frac{\sqrt\mu}2\mathcal E+\frac{\sqrt\mu}2\|\dot x\|^2\le0dtd​E+2μ​​E+2μ​​∥x˙∥2≤0;
  5. E(t)≤E(t0)e−μ2(t−t0)\mathcal E(t)\le\mathcal E(t_0)e^{-\frac{\sqrt\mu}2(t-t_0)}E(t)≤E(t0​)e−2μ​​(t−t0​);
  6. the differential inequality for ZZZ.

Companion: the case β=0\beta=0β=0

The last sentence of Theorem 7 states that for β=0\beta=0β=0, f(x(t))−min⁡f=O(e−μt)f(x(t))-\min f=\mathcal O(e^{-\sqrt\mu t})f(x(t))−minf=O(e−μ​t). The paper gives no proof of it and attributes it to Siegel. It is a separate item, listed as the last milestone, and is not part of the goal.

Significance

Theorem 7 gives exponential decay, at the rate e−μ2te^{-\frac{\sqrt\mu}2 t}e−2μ​​t, of the values and of the distance to the minimizer for the whole range 0≤β≤1/(2μ)0\le\beta\le1/(2\sqrt\mu)0≤β≤1/(2μ​) of Hessian damping. It also gives an averaged exponential decay of ∥∇f(x(t))∥2\|\nabla f(x(t))\|^2∥∇f(x(t))∥2, which the authors describe as new in the literature, and weighted integrability of the squared velocity. These estimates guide the design of the strongly convex algorithms of §5, whose linear rates q=1/(1+12μs)q=1/(1+\frac12\sqrt{\mu s})q=1/(1+21​μs​) mirror the continuous rate.

Formalizing it builds machine-checked continuous-time Lyapunov arguments in a Hilbert space: differentiation of energy functions along a trajectory that is only one-sidedly differentiable at t0t_0t0​, the chain rule through ∇f\nabla f∇f (the Hessian term), and Grönwall-type integration of differential inequalities. To our knowledge none of Theorem 7 has a machine-checked proof; the paper's proof is complete apart from the gap at β=0\beta=0β=0 in part (ii) noted under Difficulty.

Difficulty

The algebra of the first differential inequality is a direct but long expansion, and the quadratic form is where the upper bound on β\betaβ enters. The main analytic steps are elsewhere. First, the energy must be shown differentiable along the trajectory, which requires the derivative of t↦∇f(x(t))t\mapsto\nabla f(x(t))t↦∇f(x(t)), a chain rule through the Fréchet derivative of the gradient. Second, the differential inequalities must be integrated on [t0,+∞[[t_0,+\infty[[t0​,+∞[ with one-sided derivatives at t0t_0t0​. Third, part (ii) must be derived from the ZZZ-inequality. The paper's derivation divides by β2\beta^2β2, so it covers only β>0\beta>0β>0. At β=0\beta=0β=0 part (ii) is still true, but it needs a separate argument, for example local Lipschitz continuity of ∇f\nabla f∇f near x⋆x^\starx⋆ together with the convergence x(t)→x⋆x(t)\to x^\starx(t)→x⋆ from part (i). A proof that only follows the printed text does not cover the case β=0\beta = 0β=0.

Formalization scope

  • Space and function. H\mathcal HH is a real inner product space that is complete. fff is ConvexOn ℝ univ and ContDiff ℝ 2, ∇f\nabla f∇f is Mathlib's gradient f, and the Hessian applied to vvv at xxx is fderiv ℝ (gradient f) x v.
  • Strong convexity is Definition 1 verbatim, with μ>0\mu>0μ>0 as a separate hypothesis. Convexity of fff is kept from the standing hypothesis (H) of p. 2 even though strong convexity implies it.
  • The minimizer. argmin⁡f≠∅\operatorname{argmin}f\neq\emptysetargminf=∅ is a point xstar with f(x⋆)≤f(y)f(x^\star)\le f(y)f(x⋆)≤f(y) for all yyy. min⁡f\min fminf is written f xstar.
  • The trajectory is a triple x,x˙,x¨:R→Hx,\dot x,\ddot x:\mathbb R\to\mathcal Hx,x˙,x¨:R→H. At every t≥t0t\ge t_0t≥t0​, xxx has derivative x˙(t)\dot x(t)x˙(t) and x˙\dot xx˙ has derivative x¨(t)\ddot x(t)x¨(t) within [t0,+∞[[t_0,+\infty[[t0​,+∞[, and (19) holds. Values before t0t_0t0​ play no role, and x˙(t0)\dot x(t_0)x˙(t0​) in the constant CCC is the right derivative. β\betaβ is a real constant and t0>0t_0>0t0​>0, as in (H).
  • Derivatives in milestones are stated as the existence of a number that is the one-sided derivative and satisfies the inequality. Such a number is unique.
  • Integrals. Part (ii) is an interval integral of a function continuous on [t0,t][t_0,t][t0​,t]. The "Moreover" clause is stated as integrability on [t0,+∞[[t_0,+\infty[[t0​,+∞[ of the nonnegative integrand. The constant C1C_1C1​ is existentially quantified after the trajectory, so it may depend on it, as on the page.
  • Ruling out trivial readings. The goal never mentions E\mathcal EE or ZZZ: its conclusions are about f(x(t))f(x(t))f(x(t)), ∥x(t)−x⋆∥\|x(t)-x^\star\|∥x(t)−x⋆∥, ∇f(x(t))\nabla f(x(t))∇f(x(t)) and x˙(t)\dot x(t)x˙(t) only. The solution predicate is satisfiable: the constant trajectory at x⋆x^\starx⋆ satisfies it.
  • Infrastructure needed: the chain rule for ∇f∘x\nabla f\circ x∇f∘x with one-sided derivatives, differentiation of ∥⋅∥2\|\cdot\|^2∥⋅∥2 and ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ along curves, and a Grönwall-type lemma u′≤−cu⇒u(t)≤u(t0)e−c(t−t0)u'\le-cu\Rightarrow u(t)\le u(t_0)e^{-c(t-t_0)}u′≤−cu⇒u(t)≤u(t0​)e−c(t−t0​) on [t0,∞)[t_0,\infty)[t0​,∞) with one-sided derivatives. These are reusable for the other continuous-time missions of the series. Contributions of these general lemmas are welcome as separate theorems.

Selected references

  • H. Attouch, Z. Chbani, J. Fadili, H. Riahi, First-order optimization algorithms via inertial systems with Hessian driven damping, Math. Program. (2020); arXiv:1907.10536v2. https://arxiv.org/abs/1907.10536
  • J. W. Siegel, Accelerated first-order methods: differential equations and Lyapunov functions, 2019. https://arxiv.org/abs/1903.05671
  • A. C. Wilson, B. Recht, M. I. Jordan, A Lyapunov analysis of momentum methods in optimization, J. Mach. Learn. Res. 22 (2021); arXiv:1611.02635. https://arxiv.org/abs/1611.02635
  • B. T. Polyak, Some methods of speeding up the convergence of iteration methods, USSR Comput. Math. Math. Phys. 4 (1964). https://doi.org/10.1016/0041-5553(64)90137-5
9 thms2 active usersReviewed
PreviousPage 1 of 4Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me