Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Dynamical Systems

164 missions · 68 completed

Missions

Open96Completed68All164
Graph TheoryProbability·Captain: wurtle

The free uniform spanning forest is a factor of IIDResearch Paper

Motivation

A uniform spanning tree of a finite connected graph is a spanning tree chosen uniformly at random. On an infinite graph one takes limits along finite pieces: the free uniform spanning forest (FUSF) is the weak limit of uniform spanning trees of an increasing sequence of finite connected subgraphs, with no boundary identification. Uniform spanning forests connect random walks, electrical networks, determinantal processes and ℓ2\ell^2ℓ2-Betti numbers of groups.

A random object on a graph is a factor of IID if it can be produced by one measurable rule from independent uniform labels on the vertices, in a way that commutes with all graph symmetries. Such representations are the measure-theoretic analogue of local algorithms, and they are central in ergodic theory of group actions. Whether the FUSF is a factor of IID was raised by Lyons at Oberwolfach in 2013, and Timár's 2025 paper describes the unrestricted question as open.

Timeline

  • 1991. Pemantle constructs infinite-volume uniform spanning trees on Zd\mathbb Z^dZd (Ann. Probab., 1991; arXiv:math/0404043).
  • 2001. Benjamini, Lyons, Peres and Schramm develop the general theory of free and wired uniform spanning forests; on transient graphs the wired forest is a factor of IID via Wilson's algorithm rooted at infinity (doi:10.1214/aop/1008956321).
  • 2003. Lyons develops determinantal probability measures on countable sets (doi:10.1007/s10240-003-0016-0).
  • 2009. Borcea, Brändén and Liggett introduce strongly Rayleigh measures and their negative-dependence theory (doi:10.1090/S0894-0347-08-00618-8).
  • 2013. Lyons discusses the FUSF factor question for Cayley graphs (doi:10.4171/OWR/2013/42).
  • 2016. Lyons and Thom prove Bernoulli isomorphism for equivariant determinantal measures on amenable Cayley graphs and ask a broader determinantal factor question (doi:10.1017/etds.2014.70).
  • 2022. Nam, Sly and Zhang give FIID codings of free Ising measures on regular trees through Brownian-driven systems (doi:10.1007/s00220-021-04260-2).
  • 2025. Timár proves FIID representability of the free forest on recurrent and invariantly amenable unimodular random graphs (doi:10.1007/s11856-025-2884-1).

The source of this mission, an OpenAI preprint dated September 25, 2026, proves the unrestricted statement with one rule for all graphs.

Setting

Let GGG be an infinite, connected, locally finite, simple, undirected graph. For a finite connected subgraph HHH, let USTH\mathrm{UST}_HUSTH​ be the uniform law on spanning trees of HHH. For finite connected subgraphs H1⊆H2⊆⋯H_1\subseteq H_2\subseteq\cdotsH1​⊆H2​⊆⋯ whose edges exhaust E(G)E(G)E(G), the laws USTHn\mathrm{UST}_{H_n}USTHn​​ (edges outside HnH_nHn​ absent) converge weakly; the limit FUSFG\mathrm{FUSF}_GFUSFG​ on {0,1}E(G)\{0,1\}^{E(G)}{0,1}E(G) does not depend on the exhaustion (Proposition 2.2).

A rule Φ(G,U,e)∈{0,1}\Phi(G,U,e)\in\{0,1\}Φ(G,U,e)∈{0,1} takes a graph, real vertex labels U=(Uv)U=(U_v)U=(Uv​) and an edge. It is equivariant if Φ(σG,σU,σe)=Φ(G,U,e)\Phi(\sigma G,\sigma U,\sigma e)=\Phi(G,U,e)Φ(σG,σU,σe)=Φ(G,U,e) for every isomorphism σ\sigmaσ, and root independent if it uses no distinguished vertex.

A law μ\muμ on {0,1}F\{0,1\}^F{0,1}F, FFF finite, is strongly Rayleigh if ∑xμ(x)∏izixi≠0\sum_x\mu(x)\prod_iz_i^{x_i}\ne0∑x​μ(x)∏i​zixi​​=0 whenever all Im⁡zi>0\operatorname{Im}z_i>0Imzi​>0; on a countable set, every finite marginal must be strongly Rayleigh.

Formalization targets

Milestones (strongly Rayleigh processes, Section 6)

  • Lemma 6.1: for strongly Rayleigh μ\muμ and tilts μh\mu_hμh​, ∂pi/∂hj=Cov⁡μh(Xi,Xj)\partial p_i/\partial h_j=\operatorname{Cov}_{\mu_h}(X_i,X_j)∂pi​/∂hj​=Covμh​​(Xi​,Xj​) and ∑j∣∂pi/∂hj∣≤2pi(1−pi)≤12\sum_j|\partial p_i/\partial h_j|\le2p_i(1-p_i)\le\tfrac12∑j​∣∂pi​/∂hj​∣≤2pi​(1−pi​)≤21​.
  • Theorem 1.3: an invariant strongly Rayleigh law on {0,1}Γ\{0,1\}^\Gamma{0,1}Γ, Γ\GammaΓ a countable group, is an equivariant factor of IID.
  • Inputs to Corollary 1.4: finite determinantal laws with 0≤K≤I0\le K\le I0≤K≤I exist and are strongly Rayleigh; on a countable set the determinantal law of a positive contraction exists and is unique.
  • Corollary 1.4: invariant determinantal laws on countable groups are factors of IID, in particular when Kgh,gk=Kh,kK_{gh,gk}=K_{h,k}Kgh,gk​=Kh,k​.

Goal: Theorem 1.1

∃ Φ Borel, equivariant, root independent:∀G,{e:Φ(G,U,e)=1}∼FUSFGfor IID Uniform[0,1] U.\exists\ \Phi\ \text{Borel, equivariant, root independent}:\quad \forall G,\quad \{e:\Phi(G,U,e)=1\}\sim\mathrm{FUSF}_G\quad\text{for IID Uniform}[0,1]\ U.∃ Φ Borel, equivariant, root independent:∀G,{e:Φ(G,U,e)=1}∼FUSFG​for IID Uniform[0,1] U.

The Lean statement OAI.Problem336.fusf_is_factor_iid is open on the platform.

Significance

Theorem 1.1 answers the FUSF factor question without amenability, transience, unimodularity, degree bounds or moment assumptions, and with a single rule for all graphs; Corollary 1.2 gives the factor statement under every unimodular random graph law. Theorem 1.3 and Corollary 1.4 extend the method to all invariant strongly Rayleigh and determinantal processes on countable groups, addressing the regular-action case of the Lyons–Thom question. The paper asserts an ordinary Borel factor, not a finitary one.

The result is proved in an OpenAI preprint; it has not been peer reviewed, and no machine-checked proof exists. Formalization would also provide uniform spanning trees, the free forest limit, strongly Rayleigh measures and determinantal laws as reusable Lean objects.

Difficulty

Previous constructions use structure that is absent in general: Wilson's algorithm works for the wired forest on transient graphs, and Timár's construction needs monotone limits along a hyperfinite exhaustion. A factor must produce one exact sample of the infinite-volume law while controlling all edges jointly, and equivariance forbids any choice of root or ordering. The paper's route observes the forest through independent Brownian noises and must show that the posterior drift has a uniformly Lipschitz response to the observations even when the fields are unbounded over the graph.

Formalization scope

  • Graphs are coded on vertex set N\mathbb NN by symmetric irreflexive ℕ → ℕ → Bool; edges are pairs u<vu<vu<v; a connected graph on N\mathbb NN is automatically infinite. Equivariance is invariance under every permutation of N\mathbb NN applied to graph, labels and edge.
  • RuleBorel is joint measurability of Φ\PhiΦ in the product σ-algebras.
  • IsVertexIID requires the label coordinates to have independent Uniform[0,1][0,1][0,1] finite-dimensional laws (with s=∅s=\varnothings=∅ this forces a probability measure).
  • HasFUSFLaw asks that every cylinder probability (edges in AAA present, edges in BBB absent) be the limit of the corresponding uniform-spanning-tree ratio along every exhaustion by finite connected subgraphs covering all edges.
  • The strongly Rayleigh and determinantal milestones use ProbabilityMeasure (Γ → Bool), left translation (τga)h=ag−1h(\tau_ga)_h=a_{g^{-1}h}(τg​a)h​=ag−1h​, i.i.d. labels in Set.Icc 0 1 via Measure.infinitePi, and Hermitian kernels with 0≤⟨c,Kc⟩≤∥c∥20\le\langle c,Kc\rangle\le\|c\|^20≤⟨c,Kc⟩≤∥c∥2 on finitely supported vectors.

A complete development needs the matrix-tree theorem and Kirchhoff formulas, weak limits on {0,1}E\{0,1\}^{E}{0,1}E, Brownian motion and a Borel Picard iteration for the decoder, and the Borcea–Brändén–Liggett theory. Contributions formalizing Proposition 2.2 (free exhaustion limit), Lemma 2.3 (finite-field forest response) and Proposition 4.2 (sampling from independent Brownian paths) are welcome.

Selected references

  • OpenAI, The free uniform spanning forest is a factor of IID, preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-free-uniform-spanning-forest-is-a-factor-of-IID-September-25-2026/The-free-uniform-spanning-forest-is-a-factor-of-IID-September-25-2026.pdf
  • I. Benjamini, R. Lyons, Y. Peres, O. Schramm, Uniform spanning forests, Ann. Probab., 2001. https://doi.org/10.1214/aop/1008956321
  • R. Lyons, ℓ²-Betti numbers, cost, and the free uniform spanning forest, Oberwolfach Reports, 2013. https://doi.org/10.4171/OWR/2013/42
  • Á. Timár, Factor of iid's through stochastic domination, Israel J. Math., 2025. https://doi.org/10.1007/s11856-025-2884-1
  • R. Lyons, A. Thom, Invariant coupling of determinantal measures on sofic groups, Ergodic Theory Dynam. Systems, 2016. https://doi.org/10.1017/etds.2014.70
  • R. Lyons, Determinantal probability measures, Publ. Math. IHÉS, 2003. https://doi.org/10.1007/s10240-003-0016-0
  • J. Borcea, P. Brändén, T. M. Liggett, Negative dependence and the geometry of polynomials, J. Amer. Math. Soc., 2009. https://doi.org/10.1090/S0894-0347-08-00618-8
  • D. Nam, A. Sly, L. Zhang, Ising model on trees and factors of IID, Comm. Math. Phys., 2022. https://doi.org/10.1007/s00220-021-04260-2
  • R. Pemantle, Choosing a spanning tree for the integer lattice uniformly, Ann. Probab., 1991. https://arxiv.org/abs/math/0404043
9 thms1 active userReviewed
Probability·Captain: wurtle

Rokhlin's multiple-mixing problem for one transformationResearch Paper

Motivation

Mixing is the basic notion of asymptotic independence in ergodic theory: a measure-preserving transformation TTT is mixing if the event AAA at time 000 and the event BBB at time nnn become independent as n→∞n\to\inftyn→∞. Mixing of order kkk asks the same for kkk events at times whose gaps all tend to infinity. In 1949 Rokhlin introduced higher-order mixing and asked whether mixing (order 222) already implies mixing of order 333, and hence of all orders. The question has been one of the oldest in ergodic theory. It matters because higher-order mixing is the property used to prove multiple recurrence and independence statements, and because for actions of Z2\mathbb Z^2Z2 the analogous implication is false.

Timeline

  • 1949. Rokhlin introduces higher-order mixing, proves it for ergodic endomorphisms of compact abelian groups, and raises the question for general transformations (mathnet).
  • 1967. Furstenberg introduces joinings and disjointness, the language in which failure of higher-order mixing appears as a non-product pairwise-independent joining (doi:10.1007/BF01692494).
  • 1978. Ledrappier gives a mixing Z2\mathbb Z^2Z2-action that is not mixing of order 333 (Un champ markovien peut être d'entropie nulle et mélangeant, C. R. Acad. Sci. Paris).
  • 1984. Kalikow proves that twofold mixing implies threefold mixing for rank-one transformations (doi:10.1017/S014338570000242X).
  • 1991. Host proves mixing of all orders for mixing systems with singular spectrum (doi:10.1007/BF02773866).
  • 1993. Ryzhikov proves mixing of all orders for mixing finite-rank actions (doi:10.1007/BF01085983).
  • 2006. de la Rue explains why Ledrappier-type "three-dot" counterexamples cannot exist in one dimension (doi:10.1007/s00574-006-0024-z).
  • 2008. Janvresse and de la Rue show that certain pairwise-independent joinings force positive entropy (doi:10.1017/S0143385707000958).
  • 2024. Bergelson and Zelada show that strongly mixing systems are mixing of all orders along a large set of layouts (doi:10.1017/etds.2023.63); Kanigowski and Ravotti prove multiple mixing for shearing flows (arXiv:2410.13686); Ryzhikov surveys 75 years of the problem (arXiv:2411.07234).

The source of this mission, an OpenAI preprint dated September 23, 2026, claims an affirmative answer for a single invertible transformation.

Setting

Let (Ω,F,μ)(\Omega,\mathcal F,\mu)(Ω,F,μ) be a probability space and T:Ω→ΩT:\Omega\to\OmegaT:Ω→Ω an invertible measurable map with measurable inverse that preserves μ\muμ. TTT is mixing if for all A,B∈FA,B\in\mathcal FA,B∈F

μ(A∩T−nB)⟶μ(A) μ(B)(∣n∣→∞, n∈Z).\mu(A\cap T^{-n}B)\longrightarrow\mu(A)\,\mu(B)\qquad(|n|\to\infty,\ n\in\mathbb Z).μ(A∩T−nB)⟶μ(A)μ(B)(∣n∣→∞, n∈Z).

For k≥2k\ge2k≥2, TTT is mixing of order kkk if for all A1,…,Ak∈FA_1,\dots,A_k\in\mathcal FA1​,…,Ak​∈F

μ(⋂i=1kT−tiAi)⟶∏i=1kμ(Ai)\mu\Bigl(\bigcap_{i=1}^{k}T^{-t_i}A_i\Bigr)\longrightarrow\prod_{i=1}^{k}\mu(A_i)μ(i=1⋂k​T−ti​Ai​)⟶i=1∏k​μ(Ai​)

whenever t1<⋯<tkt_1<\dots<t_kt1​<⋯<tk​ and min⁡i(ti+1−ti)→∞\min_i(t_{i+1}-t_i)\to\inftymini​(ti+1​−ti​)→∞; by invariance one may take t1=0t_1=0t1​=0. The order counts the number of sets (so order kkk is "multiplicity k−1k-1k−1" in Rokhlin's and Ryzhikov's convention).

Formalization targets

Goal: Theorem 1.1

If TTT is an invertible mixing probability-preserving transformation, then for every k≥3k\ge3k≥3 and all measurable A1,…,AkA_1,\dots,A_kA1​,…,Ak​,

μ(A1∩T−n1A2∩⋯∩T−(n1+⋯+nk−1)Ak)⟶∏i=1kμ(Ai)as min⁡(n1,…,nk−1)→∞,\mu\bigl(A_1\cap T^{-n_1}A_2\cap\cdots\cap T^{-(n_1+\cdots+n_{k-1})}A_k\bigr)\longrightarrow\prod_{i=1}^{k}\mu(A_i)\quad\text{as}\ \min(n_1,\dots,n_{k-1})\to\infty,μ(A1​∩T−n1​A2​∩⋯∩T−(n1​+⋯+nk−1​)Ak​)⟶i=1∏k​μ(Ai​)as min(n1​,…,nk−1​)→∞,

the nin_ini​ ranging over positive integers. No standardness or countable-generation assumption is made on (Ω,F,μ)(\Omega,\mathcal F,\mu)(Ω,F,μ). The Lean statement OAI.Rokhlin.mixing_all_finite_orders is open on the platform.

Significance

The theorem resolves Rokhlin's multiple-mixing problem for one transformation: mixing implies mixing of all orders, with no structural hypothesis (rank, spectrum, algebraic form). It explains the difference between Z\mathbb ZZ and Z2\mathbb Z^2Z2: Ledrappier's example shows the implication fails for several commuting generators. The paper also derives the conclusion for mixing endomorphisms and for mixing flows with strongly continuous Koopman operators (Corollary 8.1).

The result is claimed in an OpenAI preprint; it has not been peer reviewed and no machine-checked proof exists. Given the age and prominence of the problem, an independent formal verification would be valuable.

Difficulty

A failure of threefold mixing produces, in the limit, a joining of three copies of the system that is pairwise independent but not the product. Pairwise independence alone does not force a joining to be a product, so soft joining arguments do not suffice; earlier positive results used rank, spectral or algebraic structure to exclude such joinings. A reduction to zero entropy is available (positive-entropy parts are handled separately), but in zero entropy the non-product joining must be ruled out with no structural information about TTT. In addition, the general (non-standard) probability space prevents direct use of disintegration and Rokhlin–Halmos-type tools without first reducing to a separable factor.

Formalization scope

  • Ω\OmegaΩ carries an arbitrary MeasurableSpace; μ\muμ has IsProbabilityMeasure; TTT is a MeasurableEquiv with MeasurePreserving T μ μ.
  • timeMap T n is the nnn-th power of TTT as a permutation, n∈Zn\in\mathbb Zn∈Z; IsMixing μ T uses the filter comap Int.natAbs atTop on Z\mathbb ZZ.
  • MixingOfOrder μ T k: for every family of measurable sets indexed by Fin k, the measure of ⋂iT−layoutTime(i)Ai\bigcap_i T^{-\mathrm{layoutTime}(i)}A_i⋂i​T−layoutTime(i)Ai​ tends to ∏iμ(Ai)\prod_i\mu(A_i)∏i​μ(Ai​) along atTop on Fin (k-1) → ℕ+, where layoutTime gives the partial sums of the gaps.
  • The theorem is stated for every k≥3k\ge3k≥3; the case k=2k=2k=2 is the hypothesis.

A complete development needs joinings, factor maps and entropy (Pinsker factor), measurable selection or a reduction to standard spaces, and the paper's array and operator machinery. Contributions formalizing the reduction steps (Proposition 2.1, zero-entropy witness) or classical special cases (Kalikow's rank-one theorem) are welcome.

Selected references

  • OpenAI, Rokhlin's multiple-mixing problem for one transformation, preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Rokhlins-multiple-mixing-problem-for-one-transformation-September-23-2026/paper.pdf
  • V. A. Rokhlin, On endomorphisms of compact commutative groups, Izv. Akad. Nauk SSSR Ser. Mat., 1949. https://www.mathnet.ru/eng/im3198
  • T. de la Rue, 2-fold and 3-fold mixing: why 3-dot-type counterexamples are impossible in one dimension, Bull. Braz. Math. Soc., 2006. https://doi.org/10.1007/s00574-006-0024-z
  • S. A. Kalikow, Twofold mixing implies threefold mixing for rank one transformations, Ergodic Theory Dynam. Systems, 1984. https://doi.org/10.1017/S014338570000242X
  • B. Host, Mixing of all orders and pairwise independent joinings of systems with singular spectrum, Israel J. Math., 1991. https://doi.org/10.1007/BF02773866
  • V. V. Ryzhikov, Joinings and multiple mixing of finite rank actions, Funct. Anal. Appl., 1993. https://doi.org/10.1007/BF01085983
  • V. V. Ryzhikov, Multiple mixing, 75 years of Rokhlin's problem, preprint, 2024. https://arxiv.org/abs/2411.07234
  • H. Furstenberg, Disjointness in ergodic theory, minimal sets, and a problem in Diophantine approximation, Math. Systems Theory, 1967. https://doi.org/10.1007/BF01692494
2 thms1 active userReviewed
Functional AnalysisHarmonic Analysis·Captain: wurtle

A smooth three-torus diffeomorphism with simple Lebesgue spectrumResearch Paper

Motivation: Banach's simple Lebesgue-spectrum problem

A measure-preserving transformation TTT of a probability space acts on square-integrable functions by the Koopman operator UTg=g∘TU_Tg=g\circ TUT​g=g∘T, a unitary operator. Its spectral type (discrete, singular continuous, absolutely continuous) and its multiplicity are basic invariants of ergodic theory. The Lebesgue spectrum is the spectral type of the shift on ℓ2(Z)\ell^2(\mathbb Z)ℓ2(Z), the type of Bernoulli shifts and other strongly chaotic systems, where it occurs with infinite multiplicity. Banach's problem asks whether Lebesgue spectrum can occur with multiplicity one: is there a transformation whose Koopman operator on the orthogonal complement of the constants is unitarily equivalent to multiplication by www on L2(S1)L^2(S^1)L2(S1)? Equivalently, is there a single function whose bilateral orbit under UTU_TUT​ is an orthonormal basis of the mean-zero space? The problem combines spectral theory with the construction of explicit dynamics, and a smooth example would show this spectral behavior is compatible with the regularity of differentiable dynamics.

Timeline

  • 1949 — Rokhlin asks for ergodic automorphisms with simple, or at least finite-multiplicity, Lebesgue spectrum (Uspekhi Mat. Nauk 1949, §4, no. 7).
  • 1960 — Ulam records a real-line form of the question attributed to Banach (A Collection of Mathematical Problems, Interscience, 1960, §6, p. 76).
  • 1970 — Anosov and Katok introduce approximation-by-conjugation constructions of smooth ergodic diffeomorphisms (Trudy MMO 1970).
  • 1978 — Helson and Parry construct cocycles over aperiodic transformations with associated Lebesgue spectrum (Ark. Mat. 1978).
  • 1984 — Mathew and Nadkarni construct a transformation with a Lebesgue component of multiplicity two (Bull. LMS 1984).
  • 1999 — Guenais connects Morse cocycles with flat polynomials and constructs a group action with simple spectrum of mixed type (ETDS 1999).
  • 2001 — Fayad constructs C∞C^\inftyC∞ volume-preserving torus diffeomorphisms with simple (not Lebesgue) spectrum (J. LMS 2001).
  • 2020–2023 — Prikhod'ko constructs a finite-measure flow with simple Lebesgue spectrum (Sb. Math. 2020); Fayad–Forni–Kanigowski (JAMS 2021) and Abdedou–Fayad–Kessi (DCDS 2023) obtain smooth flows with countable Lebesgue multiplicity; el Abdalaoui presents an infinite-measure conservative example (arXiv:1508.06439). None of these gives a probability-preserving map with simple Lebesgue spectrum on the whole mean-zero space.
  • 2026 — The OpenAI preprint A smooth three-torus diffeomorphism with simple Lebesgue spectrum (OpenAI Math Release, September 23, 2026) claims a C∞C^\inftyC∞ volume-preserving diffeomorphism of T3\mathbb T^3T3 with this property. It has not been peer reviewed and its theorem is not formally verified.

Setting

Let T=R/Z\mathbb T=\mathbb R/\mathbb ZT=R/Z and let μ\muμ be normalized Lebesgue (Haar) measure on T3\mathbb T^3T3. A bijection T:T3→T3T:\mathbb T^3\to\mathbb T^3T:T3→T3 is a C∞C^\inftyC∞ diffeomorphism if TTT and T−1T^{-1}T−1 lift locally to C∞C^\inftyC∞ maps of R3\mathbb R^3R3. It is volume preserving if μ(T−1A)=μ(A)\mu(T^{-1}A)=\mu(A)μ(T−1A)=μ(A) for every measurable AAA. Let L02(T3,μ)L^2_0(\mathbb T^3,\mu)L02​(T3,μ) be the closed subspace of complex square-integrable functions with integral zero, and UTg=g∘TU_Tg=g\circ TUT​g=g∘T. Let mmm be Haar measure on the circle and w(z)=e2πizw(z)=e^{2\pi i z}w(z)=e2πiz the first Fourier character.

In Lean (namespace OAI.ThreeTorus), the torus is Fin 3 → UnitAddCircle with the product Haar measure, smoothness is local smooth lifting on Fin 3 → ℝ, L02L^2_0L02​ is the subspace meanZero of Lp ℂ 2 μ, and MainConclusion packages the theorem below.

Formalization targets

Goal: smooth simple Lebesgue spectrum (Theorem 1.1)

There exist a C∞C^\inftyC∞ volume-preserving diffeomorphism TTT of T3\mathbb T^3T3 and a real-valued f∈L02(T3,μ)f\in L^2_0(\mathbb T^3,\mu)f∈L02​(T3,μ) such that

{ f∘Tn:n∈Z } is an orthonormal basis of L02(T3,μ);\{\,f\circ T^n : n\in\mathbb Z\,\}\ \text{is an orthonormal basis of } L^2_0(\mathbb T^3,\mu);{f∘Tn:n∈Z} is an orthonormal basis of L02​(T3,μ);

moreover TTT is ergodic, and there is a unitary W:L02(T3,μ)→L2(S1,m)W:L^2_0(\mathbb T^3,\mu)\to L^2(S^1,m)W:L02​(T3,μ)→L2(S1,m) with

W(g∘T)=w⋅W(g)for all g∈L02.W(g\circ T)=w\cdot W(g)\qquad\text{for all } g\in L^2_0 .W(g∘T)=w⋅W(g)for all g∈L02​.

The goal is published on the platform with status Open.

Significance

The result itself. The theorem answers the probability-preserving form of Banach's problem, with the strongest kind of example: the invariant measure is the standard smooth volume on a compact manifold, the map is C∞C^\inftyC∞, and the conclusion covers the whole mean-zero space, both spectral type and multiplicity. Earlier work produced Lebesgue components, Lebesgue spectrum of higher multiplicity, simple spectrum of other types, flows, or infinite-measure examples; time-ttt maps of simple-Lebesgue flows have infinite multiplicity, so they do not answer the question. The source also derives from it mixing (of all orders, using a separate companion multiple-mixing theorem), zero Kolmogorov–Sinai entropy (via Rokhlin's finite-multiplicity entropy theorem) and vanishing Lyapunov exponents (Corollary 6.1, p. 28).

Formalizing it. The statement exercises Mathlib's LpL^pLp spaces, Haar measure on the additive circle, ergodicity and Fourier characters together. A formal proof would certify a long quantitative construction (successive smooth passages, stationary-phase estimates, Fourier signals) whose convergence must be checked simultaneously in the C∞C^\inftyC∞ topology and in spectral norms.

Difficulty

Smooth constructions by successive conjugation (Anosov–Katok type) naturally produce maps with singular or discrete spectral behavior, because each approximating map is close to a rotation or an integrable twist with pure point or very structured spectrum. Lebesgue spectral type requires the spectral measure of every function to be absolutely continuous with the right density, and simplicity requires a single orbit to span the whole space. Making both hold in the limit, while keeping the limit map C∞C^\inftyC∞, requires controlling spectral densities at every scale and approximating every target function by translates of one fixed vector — the step where generic perturbation arguments give no control.

Formalization scope

  • The torus is Fin 3 → UnitAddCircle with Measure.pi of AddCircle.haarAddCircle; TTT is an Equiv.Perm with Smooth T and Smooth T.symm (local C∞C^\inftyC∞ lifts), and MeasurePreserving T μ μ.
  • L02L^2_0L02​ is the complex subspace of Lp ℂ 2 μ with zero integral; fff is real-valued almost everywhere. The orbit vn=f∘Tnv_n=f\circ T^nvn​=f∘Tn is required to be orthonormal with dense span, i.e. a Hilbert basis indexed by Z\mathbb ZZ.
  • The spectral model is stated with an explicit linear isometric equivalence W : H₀ ≃ₗᵢ[ℂ] CircleH intertwining composition with TTT and multiplication by fourier 1. Ergodicity is Mathlib's Ergodic T μ.
  • Mixing, zero entropy and Lyapunov exponents (Section 6) are not part of the goal.
  • Needed infrastructure: stationary-phase estimates, spectral measures of Koopman operators, smooth volume-preserving changes of coordinates on the torus. Spectral-theory infrastructure for Koopman operators is reusable throughout ergodic theory.

Selected references

  • V. A. Rokhlin, Selected topics from the metric theory of dynamical systems, Uspekhi Mat. Nauk 4 (1949). https://www.mathnet.ru/eng/rm8607
  • S. M. Ulam, A Collection of Mathematical Problems, Interscience Tracts in Pure and Applied Mathematics 8, 1960.
  • D. V. Anosov and A. B. Katok, New examples in smooth ergodic theory. Ergodic diffeomorphisms, Trudy Moskov. Mat. Obshch. 23 (1970). https://www.mathnet.ru/eng/mmo237
  • H. Helson and W. Parry, Cocycles and spectra, Ark. Mat. 16 (1978). https://doi.org/10.1007/BF02385994
  • J. Mathew and M. G. Nadkarni, A measure preserving transformation whose spectrum has Lebesgue component of multiplicity two, Bull. London Math. Soc. 16 (1984). https://doi.org/10.1112/blms/16.4.402
  • M. Guenais, Morse cocycles and simple Lebesgue spectrum, Ergodic Theory Dynam. Systems 19 (1999). https://doi.org/10.1017/S0143385799126579
  • B. R. Fayad, Partially mixing and locally rank one smooth transformations and flows on the torus Td\mathbb T^dTd, d≥3d\ge3d≥3, J. London Math. Soc. 64 (2001). https://doi.org/10.1112/S0024610701002447
  • A. A. Prikhod'ko, On ergodic flows with simple Lebesgue spectrum, Sb. Math. 211 (2020). https://doi.org/10.1070/SM8147
  • B. Fayad, G. Forni and A. Kanigowski, Lebesgue spectrum of countable multiplicity for conservative flows on the torus, J. Amer. Math. Soc. 34 (2021). https://doi.org/10.1090/jams/970
  • OpenAI, A smooth three-torus diffeomorphism with simple Lebesgue spectrum, OpenAI Math Release preprint, September 23, 2026 (Theorem 1.1, p. 1). https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-smooth-three-torus-diffeomorphism-with-simple-Lebesgue-spectrum-September-23-2026/paper.pdf
2 thms1 active userReviewed
Analysis·Captain: wurtle

Two limit cycles for quintic Liénard systemsResearch Paper

Motivation

A limit cycle of a planar vector field is a periodic orbit that is isolated among periodic orbits. The second part of Hilbert's sixteenth problem asks how many limit cycles a polynomial vector field of a given degree can have, and it is open even for quadratic fields. The classical Liénard systems

x˙=y−F(x),y˙=−x,\dot x=y-F(x),\qquad \dot y=-x,x˙=y−F(x),y˙​=−x,

equivalent to the oscillator equation x′′+F′(x) x′+x=0x''+F'(x)\,x'+x=0x′′+F′(x)x′+x=0, are the most studied restricted family. In 1977 Lins, de Melo and Pugh conjectured that for deg⁡F=n\deg F=ndegF=n the maximum number of limit cycles is ⌊(n−1)/2⌋\lfloor (n-1)/2\rfloor⌊(n−1)/2⌋. The conjecture is now known to fail for n≥6n\ge6n≥6, holds for n≤4n\le4n≤4, and degree five was the remaining undecided case, where it predicts exactly two.

This mission asks for a formal proof of the degree-five bound and its sharpness, as stated in an OpenAI preprint dated September 24, 2026 (source). The preprint has not been peer reviewed and its claims have not been independently verified; on the platform the Lean goal is open.

Background

  • 1975 — Rychkov proves the two-cycle bound for odd quintic FFF (Differ. Uravn. 11, 1975).
  • 1977 — Lins, de Melo and Pugh formulate the ⌊(n−1)/2⌋\lfloor(n-1)/2\rfloor⌊(n−1)/2⌋ conjecture (LNM 597).
  • 2007 — Dumortier, Panazzolo and Roussarie find four cycles with deg⁡F=7\deg F=7degF=7 (Proc. AMS 2007).
  • 2011 — De Maesschalck and Dumortier find ⌊(n−1)/2⌋+2\lfloor(n-1)/2\rfloor+2⌊(n−1)/2⌋+2 cycles for every n≥6n\ge6n≥6 (JDE 2011); De Maesschalck and Huzak later obtain at least n−2n-2n−2 (JDDE 2015).
  • 2012 — Li and Llibre prove at most one limit cycle for deg⁡F=4\deg F=4degF=4 (JDE 2012).
  • 2014 — Li and Lu bound by two the cyclicity of nondegenerate slow–fast cycles in degree five (JDE 2014), a limiting-regime result.
  • 2017 — Llibre and Zhang survey the conjecture (Expo. Math. 2017).
  • September 2026 — The OpenAI preprint claims the unrestricted degree-five bound of two (Theorem 1.1, p. 1).

Setting

For a real polynomial FFF (the primitive of the damping), consider the vector field VF(x,y)=(y−F(x), −x)V_F(x,y)=(y-F(x),\,-x)VF​(x,y)=(y−F(x),−x) on R2\mathbb R^2R2. A solution is a differentiable z:R→R2z:\mathbb R\to\mathbb R^2z:R→R2 with z′(t)=VF(z(t))z'(t)=V_F(z(t))z′(t)=VF​(z(t)) for all ttt. A periodic orbit is the image of a nonconstant solution that is periodic with some period T>0T>0T>0. A limit cycle is a periodic orbit CCC having an open neighbourhood UUU such that every periodic orbit contained in UUU equals CCC. Limit cycles are counted as sets: once each, regardless of multiplicity, stability or hyperbolicity. The periodic orbits of a centre are not limit cycles.

Formalization targets

Goal: Theorem 1.1 (p. 1)

For every real polynomial FFF with deg⁡F≤5\deg F\le5degF≤5,

#{C⊂R2: C is a limit cycle of VF} ≤ 2,\#\{C\subset\mathbb R^2:\ C\ \text{is a limit cycle of }V_F\}\ \le\ 2,#{C⊂R2: C is a limit cycle of VF​} ≤ 2,

and some FFF with deg⁡F≤5\deg F\le5degF≤5 has exactly two limit cycles. No parity, coefficient-sign, hyperbolicity or amplitude restriction is imposed.

Significance

The result itself. It decides the last open degree of the Lins–de Melo–Pugh conjecture in the affirmative, so the conjecture is true exactly for deg⁡F≤5\deg F\le5degF≤5. Unlike the slow–fast result of Li and Lu, it bounds all cycles of every quintic system, including degenerate (multiple) ones and cycles of large amplitude. The preprint also corrects a proposed four-cycle quintic example from the literature by identifying it with a family known to have exactly two periodic solutions (p. 2).

Formalizing it. The statement uses only polynomials, ODE solutions and planar topology, so it is well suited to formal verification, and it would be one of the first machine-checked global limit-cycle bounds for a nonlinear family. The proof's general comparison results for smooth profiles (Propositions 5.2 and 5.3, pp. 32–34) and the global quadratic fit (Theorem 3.6, p. 18) are independent of the polynomial application and reusable.

Difficulty

Small-amplitude (Hopf/Melnikov) calculations only control cycles near the origin or near a perturbation of a centre; they say nothing about distant cycles. The even coefficients of FFF prevent the reduction to the odd quintic family settled by Rychkov. Generic-perturbation arguments that remove multiple cycles cannot be used, since the count must include degenerate cycles. The preprint keeps the two half-orbits separate, writes each as an arch in coordinates u=x2/2u=x^2/2u=x2/2 valid at every amplitude, fits each arch by a quadratic comparison profile (Theorem 3.6), and controls how the fitted parameters move with width through a Schwarzian-type model inequality (Theorem 4.1, p. 20). Periodic orbits then become zeros of a single matching function (Proposition 2.5, p. 10), whose isolated zeros are bounded using an integrating factor (Section 6).

Formalization scope

  • The plane is ℝ × ℝ; vectorField F z = (z.2 - F.eval z.1, -z.1) with F : Polynomial ℝ and F.degree ≤ 5 (this includes constants and the zero polynomial, which have no limit cycles).
  • IsSolution requires HasDerivAt at every real time; IsPeriodicOrbit asks for a solution, a period T > 0, non-constancy, and C = range z.
  • IsLimitCycle F C is a periodic orbit with an open U ⊇ C such that every periodic orbit C' ⊆ U equals C.
  • Counting uses Set.encard on the set of limit cycles, so infinitely many would give ⊤; the goal asks for ≤ 2 for every admissible F and = 2 for some.
  • Neither conjunct is vacuous: the lower bound requires two actual distinct isolated periodic orbits.

Welcome contributions: existence and smooth dependence of return maps for planar polynomial flows, and the energy-identity first-order return calculation used for sharpness (Section 7, p. 39).

Selected references

  • OpenAI, Two limit cycles for quintic Liénard systems, OpenAI Math Release preprint, September 24, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/two-limit-cycles-for-quintic-lienard-systems-September-24-2026/two-limit-cycles-for-quintic-lienard-systems-September-24-2026.pdf
  • A. Lins, W. de Melo, C. C. Pugh, On Liénard's equation, in Geometry and Topology, LNM 597, Springer, 1977, 335–357. https://doi.org/10.1007/BFb0085364
  • G. S. Rychkov, The maximal number of limit cycles of the system ẏ=−x, ẋ=y−Σa_i x^{2i+1} is equal to two, Differ. Uravn. 11 (1975), 390–391. https://www.mathnet.ru/eng/de2400
  • F. Dumortier, D. Panazzolo, R. Roussarie, More limit cycles than expected in Liénard equations, Proc. AMS 135 (2007). https://doi.org/10.1090/S0002-9939-07-08688-1
  • P. De Maesschalck, F. Dumortier, Classical Liénard equations of degree n≥6 can have ⌊(n−1)/2⌋+2 limit cycles, J. Differential Equations 250 (2011). https://doi.org/10.1016/j.jde.2010.12.003
  • P. De Maesschalck, R. Huzak, Slow divergence integrals in classical Liénard equations near centers, J. Dyn. Differ. Equ. 27 (2015). https://doi.org/10.1007/s10884-014-9358-1
  • C. Li, J. Llibre, Uniqueness of limit cycles for Liénard differential equations of degree four, J. Differential Equations 252 (2012). https://doi.org/10.1016/j.jde.2011.11.002
  • C. Li, K. Lu, Slow divergence integral and its application to classical Liénard equations of degree 5, J. Differential Equations 257 (2014). https://doi.org/10.1016/j.jde.2014.08.015
  • J. Llibre, X. Zhang, Limit cycles of the classical Liénard differential systems: a survey on the Lins Neto, de Melo and Pugh's conjecture, Expo. Math. 35 (2017). https://doi.org/10.1016/j.exmath.2016.12.001
  • K. Odani, Existence of exactly N periodic solutions for Liénard systems, Funkcial. Ekvac. 39 (1996). https://doi.org/10.24546/0100499900
2 thms1 active userReviewed
AnalysisControl Theory·Captain: mikedeng1

Small Gain Theorems for Large Scale Systems and Construction of ISS Lyapunov Functions 2: Under the Small Gain Condition Γ_μ ≱ id, an Ω-Path ExistsResearch Paper

Why paths in the positive orthant matter for networks

A large control system is often built from many subsystems Σ1,…,Σn\Sigma_1,\dots,\Sigma_nΣ1​,…,Σn​, each of which is input-to-state stable (ISS) with respect to the states of the others. Whether the interconnection is again ISS is decided by a small gain condition on the matrix of interconnection gains. For two subsystems this goes back to Jiang, Teel and Praly (1994) and to the Lyapunov version of Jiang, Mareels and Wang (1996). For nnn subsystems, Dashkovskiy, Rüffer and Wirth formulated the condition as a property Γμ≱id\Gamma_\mu\not\ge\mathrm{id}Γμ​≥id of a monotone operator on R+n\mathbb R^n_+R+n​ (2007). Rüffer's thesis (2007) and the paper on which this mission is based (arXiv:0901.1842, SIAM J. Control Optim. 2010) turned it into a Lyapunov construction.

The construction needs a geometric object: a path σ\sigmaσ in the positive orthant, unbounded in every coordinate, along which the gain operator strictly decreases every component. For a linear gain matrix this is a Perron vector. For nonlinear gains, its existence is the first of the paper's two main results (Theorem 5.2). This mission formalizes that theorem and the lemmas of §8 that prove it. The companion mission formalizes the second main result, the Lyapunov function built from such a path.

Setting

Write R+=[0,∞)\mathbb R_+=[0,\infty)R+​=[0,∞). Vectors in R+n\mathbb R^n_+R+n​ are compared componentwise: v≤wv\le wv≤w means vi≤wiv_i\le w_ivi​≤wi​ for all iii, and v<wv<wv<w means vi<wiv_i<w_ivi​<wi​ for all iii. A function γ:R+→R+\gamma:\mathbb R_+\to\mathbb R_+γ:R+​→R+​ is of class K\mathcal KK if it is continuous, strictly increasing and γ(0)=0\gamma(0)=0γ(0)=0, and of class K∞\mathcal K_\inftyK∞​ if it is moreover unbounded.

A gain matrix is Γ=(γij)i,j=1n\Gamma=(\gamma_{ij})_{i,j=1}^nΓ=(γij​)i,j=1n​ with γij∈K∪{0}\gamma_{ij}\in\mathcal K\cup\{0\}γij​∈K∪{0} and γii≡0\gamma_{ii}\equiv0γii​≡0. A monotone aggregation function (MAF) is a continuous μ:R+n→R+\mu:\mathbb R^n_+\to\mathbb R_+μ:R+n​→R+​ with μ(s)>0\mu(s)>0μ(s)>0 for s≠0s\ne0s=0, μ(x)<μ(y)\mu(x)<\mu(y)μ(x)<μ(y) whenever x<yx<yx<y, and μ(x)→∞\mu(x)\to\inftyμ(x)→∞ as ∥x∥→∞\|x\|\to\infty∥x∥→∞. Typical examples are sums and maxima. Given MAFs μ1,…,μn\mu_1,\dots,\mu_nμ1​,…,μn​, the gain operator is

Γμ(s)i=μi(γi1(s1),…,γin(sn)),s∈R+n.\Gamma_\mu(s)_i=\mu_i\big(\gamma_{i1}(s_1),\dots,\gamma_{in}(s_n)\big),\qquad s\in\mathbb R^n_+ .Γμ​(s)i​=μi​(γi1​(s1​),…,γin​(sn​)),s∈R+n​.

The paper assumes from p. 8 on that μi\mu_iμi​, restricted to the coordinates of the nonzero entries of row iii, still has the strict monotonicity (Remark 2.6). The small gain condition (SGC) is Γμ≱id\Gamma_\mu\not\ge\mathrm{id}Γμ​≥id: for every s≠0s\ne0s=0, at least one component of Γμ(s)\Gamma_\mu(s)Γμ​(s) is strictly smaller than the corresponding component of sss. The set

Ω(Γμ)={s∈R+n:Γμ(s)<s}\Omega(\Gamma_\mu)=\{s\in\mathbb R^n_+:\Gamma_\mu(s)<s\}Ω(Γμ​)={s∈R+n​:Γμ​(s)<s}

collects the points that every component of Γμ\Gamma_\muΓμ​ strictly decreases.

An Ω\OmegaΩ-path (Definition 5.1) is a continuous σ:R+→R+n\sigma:\mathbb R_+\to\mathbb R^n_+σ:R+​→R+n​ with every component σi∈K∞\sigma_i\in\mathcal K_\inftyσi​∈K∞​ such that (i) each σi−1\sigma_i^{-1}σi−1​ is locally Lipschitz on (0,∞)(0,\infty)(0,∞); (ii) on every compact K⊂(0,∞)K\subset(0,\infty)K⊂(0,∞) the derivatives of all σi−1\sigma_i^{-1}σi−1​, where they exist, lie in [c,C][c,C][c,C] for constants 0<c<C0<c<C0<c<C depending on KKK only; and (iii) σ(r)∈Ω(Γμ)\sigma(r)\in\Omega(\Gamma_\mu)σ(r)∈Ω(Γμ​) for all r>0r>0r>0.

Formalization targets

Goal: Theorem 5.2

Let Γ\GammaΓ be a gain matrix and μ\muμ a compatible vector of MAFs. Assume one of: (i) Γμ\Gamma_\muΓμ​ is linear with spectral radius less than one; (ii) Γ\GammaΓ is irreducible and Γμ≱id\Gamma_\mu\not\ge\mathrm{id}Γμ​≥id; (iii) μ=max⁡\mu=\maxμ=max and Γμ≱id\Gamma_\mu\not\ge\mathrm{id}Γμ​≥id; (iv) the entries of Γ\GammaΓ are bounded and Γμ≱id\Gamma_\mu\not\ge\mathrm{id}Γμ​≥id. Then

∃ σ an Ω-path withΓμ(σ(r))<σ(r)∀r>0.\exists\,\sigma\ \text{an }\Omega\text{-path with}\quad\Gamma_\mu(\sigma(r))<\sigma(r)\quad\forall r>0 .∃σ an Ω-path withΓμ​(σ(r))<σ(r)∀r>0.

In cases (i)–(iii) the entries are in K∞∪{0}\mathcal K_\infty\cup\{0\}K∞​∪{0}, and in case (iv) they are in (K∖K∞)∪{0}(\mathcal K\setminus\mathcal K_\infty)\cup\{0\}(K∖K∞​)∪{0}.

Milestones

The milestones follow §8 in the order the proof uses them.

  • Bounded gains: Lemmas 8.1–8.3, where iterates of a point of Ω\OmegaΩ tend to 000 and the polygon through them stays in Ω\OmegaΩ; and Proposition 8.4, which is case (iv).
  • Technical lemmas: Lemmas 8.5–8.7 on diagonal operators diag(ρ)\mathrm{diag}(\rho)diag(ρ) and the decay set Ψ={s:Γμ(s)≤s}\Psi=\{s:\Gamma_\mu(s)\le s\}Ψ={s:Γμ​(s)≤s}.
  • Topological statements: Proposition 8.8, path-connectedness of Ψ\PsiΨ; Proposition 8.10, where Ω\OmegaΩ meets every simplex Sr={s:∑si=r}S_r=\{s:\sum s_i=r\}Sr​={s:∑si​=r}; and Proposition 8.9, where Ψ∞=⋂kΓμk(Ψ)\Psi_\infty=\bigcap_k\Gamma_\mu^k(\Psi)Ψ∞​=⋂k​Γμk​(Ψ) is unbounded.
  • Irreducible case: the scaling step quoted from Rüffer's earlier work, and Theorem 8.11, which is case (ii).
  • Maximum case: Theorem 8.14, case (iii) in its cycle-condition form.
  • Linear case: the Perron step of §8.5, case (i).

Significance

An Ω\OmegaΩ-path turns a small gain condition into a Lyapunov function. If each ViV_iVi​ is an ISS Lyapunov function of Σi\Sigma_iΣi​, then V(x)=max⁡iσi−1(Vi(xi))V(x)=\max_i\sigma_i^{-1}(V_i(x_i))V(x)=maxi​σi−1​(Vi​(xi​)) is one for the network (Theorem 5.3). So Theorem 5.2 is the step that makes the small gain condition a certificate of network stability, and the corollaries of §5–§7 (sums, maxima, neural networks) all pass through it.

The results are published and proved on paper. None is machine-checked: no proof assistant library contains MAFs, gain operators, the sets Ω\OmegaΩ and Ψ\PsiΨ, or Ω\OmegaΩ-paths. The paper cites three ingredients without proof: Lemma 8.6, Proposition 8.9 and the scaling step of Theorem 8.11. It also gives Theorem 8.14 only as a sketch. Formalizing them closes those gaps in one place.

Difficulty

For bounded gains the problem is easy: far out, every point of a large ray lies in Ω\OmegaΩ, and the only work is the descent to the origin. With K∞\mathcal K_\inftyK∞​ entries, Γμ\Gamma_\muΓμ​ is unbounded and no ray need stay in Ω\OmegaΩ. Following the image of a single point fails, because forward iterates go to 000, not to infinity. The paper instead uses backward orbits inside Ψ∞\Psi_\inftyΨ∞​. That this set is nonempty and unbounded is a fixed-point argument of Knaster–Kuratowski–Mazurkiewicz type (Propositions 8.9 and 8.10), not a monotonicity argument. A second obstacle is strictness. A backward orbit is only ≤\le≤-increasing, while Definition 5.1 needs strictly increasing components with derivative bounds. This is where the diagonal scalings of Lemmas 8.6–8.7 enter.

Formalization scope

R+\mathbb R_+R+​ is ℝ≥0 and R+n\mathbb R^n_+R+n​ is Fin n → ℝ≥0, with subsystems indexed from 000. The strict order <<< is a named predicate (SLt), never Lean's < on functions, which means "≤\le≤ and ≠\ne=". The small gain condition is ∀ s ≠ 0, ¬ s ≤ T s. The inverses σi−1\sigma_i^{-1}σi−1​ are carried as explicit two-sided inverses, and derivatives are ordinary real derivatives at points r>0r>0r>0 where they exist. Compatibility (Remark 2.6) and γii≡0\gamma_{ii}\equiv0γii​≡0 are hypotheses of every statement about Γμ\Gamma_\muΓμ​. Irreducibility is the matrix-power form of p. 12, which Mathlib's Matrix.isIrreducible_iff_exists_pow_pos connects to Matrix.IsIrreducible. The spectral-radius hypothesis says that every complex eigenvalue has modulus <1<1<1. The 1-norm defines SrS_rSr​.

Hypotheses made explicit or corrected:

  • Theorem 5.2's header types Γ\GammaΓ in K∞∪{0}\mathcal K_\infty\cup\{0\}K∞​∪{0} while (iv) needs bounded entries, so each case carries its own entry class.
  • Case (iv) is stated as printed, without "no zero rows".
  • Proposition 8.10 prints "T(s)≱sT(s)\not\ge sT(s)≥s for all s∈R+ns\in\mathbb R^n_+s∈R+n​". No map satisfies this at s=0s=0s=0, so it is stated for s≠0s\ne0s=0.
  • Propositions 8.9 and 8.10 assume n≥1n\ge1n≥1.

A path with Γμ(σ(r))≤σ(r)\Gamma_\mu(\sigma(r))\le\sigma(r)Γμ​(σ(r))≤σ(r), or with Lean's < on functions, is not an Ω\OmegaΩ-path. Such a reading would make the goal follow from the origin alone, and it is ruled out.

Needed infrastructure: comparison-function calculus (inverses and compositions of K∞\mathcal K_\inftyK∞​ functions), piecewise linear interpolation in R+n\mathbb R^n_+R+n​ with Lipschitz inverse bounds, and a KKM-type argument on the simplex. The first two are reusable well beyond this mission. Contributions of any milestone, proofs of the cited ingredients (Lemma 8.6, Proposition 8.9, Proposition 8.10, the scaling step of Theorem 8.11) and a full proof of Theorem 8.14 are welcome.

Selected references

  • S. N. Dashkovskiy, B. S. Rüffer, F. R. Wirth, Small Gain Theorems for Large Scale Systems and Construction of ISS Lyapunov Functions, arXiv:0901.1842v2, 2009; SIAM J. Control Optim. 48(6), 2010. https://arxiv.org/abs/0901.1842 , https://doi.org/10.1137/090746483
  • S. Dashkovskiy, B. S. Rüffer, F. R. Wirth, An ISS small gain theorem for general networks, Math. Control Signals Systems 19 (2007), pp. 93–122.
  • B. S. Rüffer, Monotone dynamical systems, graphs, and stability of large-scale interconnected systems, PhD thesis, Universität Bremen, 2007. http://nbn-resolving.de/urn:nbn:de:gbv:46-diss000109058
  • B. S. Rüffer, Monotone inequalities, dynamical systems, and paths in the positive orthant of Euclidean n-space, Positivity, 2009/2010. https://doi.org/10.1007/s11117-009-0016-5
  • Z.-P. Jiang, I. M. Y. Mareels, Y. Wang, A Lyapunov formulation of the nonlinear small-gain theorem for interconnected ISS systems, Automatica 32 (1996), pp. 1211–1215.
18 thms1 active userReviewed
AnalysisControl Theory·Captain: mikedeng1

Small Gain Theorems for Large Scale Systems and Construction of ISS Lyapunov Functions 1: Rescaling Along an Ω-Path Gives the Network ISS Lyapunov Function maxᵢ σᵢ⁻¹(Vᵢ(xᵢ))Research Paper

Motivation

Large engineered systems — power grids, chemical plants, logistics and communication networks — are usually modelled as many interacting subsystems. A stability certificate for the whole network is rarely available directly, but each subsystem can often be analysed on its own, treating the states of its neighbours as disturbances. Input-to-state stability (ISS), introduced by Sontag (Sontag 1989), is the robustness notion that makes this decomposition work: it bounds the state by a decaying function of the initial condition plus a gain of the input. A small-gain theorem states that if the gains by which the subsystems influence each other are "small" in a suitable sense, the interconnection is again ISS.

Timeline. Jiang, Teel and Praly proved a nonlinear small-gain theorem for two ISS systems in trajectory form (1994), and Jiang, Mareels and Wang gave its Lyapunov version for two subsystems (1996). Dashkovskiy, Rüffer and Wirth extended the trajectory version to nnn subsystems with the condition Γ≱id\Gamma\not\ge\mathrm{id}Γ≥id on a nonlinear gain operator (2007). The paper of this mission (arXiv:0901.1842, SIAM J. Control Optim. 48(6), 2010) gives the Lyapunov version for nnn subsystems with general monotone aggregation of the gains, and constructs the network's ISS Lyapunov function explicitly.

Setting

The network consists of n≥1n\ge 1n≥1 subsystems

Σi: x˙i=fi(x1,…,xn,u),xi∈RNi, u∈RM,\Sigma_i:\ \dot x_i=f_i(x_1,\dots,x_n,u),\qquad x_i\in\mathbb R^{N_i},\ u\in\mathbb R^M,Σi​: x˙i​=fi​(x1​,…,xn​,u),xi​∈RNi​, u∈RM,

with overall state x=(x1T,…,xnT)T∈RNx=(x_1^T,\dots,x_n^T)^T\in\mathbb R^Nx=(x1T​,…,xnT​)T∈RN and dynamics x˙=f(x,u)\dot x=f(x,u)x˙=f(x,u), f=(f1,…,fn)f=(f_1,\dots,f_n)f=(f1​,…,fn​). ∥⋅∥\|\cdot\|∥⋅∥ is the Euclidean norm.

A function γ:R+→R+\gamma:\mathbb R_+\to\mathbb R_+γ:R+​→R+​ is of class K\mathcal KK if it is continuous, strictly increasing and γ(0)=0\gamma(0)=0γ(0)=0, and of class K∞\mathcal K_\inftyK∞​ if moreover unbounded. A positive definite function α:R+→R+\alpha:\mathbb R_+\to\mathbb R_+α:R+​→R+​ is continuous with α(r)=0\alpha(r)=0α(r)=0 only at r=0r=0r=0. A Lyapunov function candidate V:Rd→R+V:\mathbb R^d\to\mathbb R_+V:Rd→R+​ is continuous, satisfies ψ1(∥x∥)≤V(x)≤ψ2(∥x∥)\psi_1(\|x\|)\le V(x)\le\psi_2(\|x\|)ψ1​(∥x∥)≤V(x)≤ψ2​(∥x∥) for some ψ1,ψ2∈K∞\psi_1,\psi_2\in\mathcal K_\inftyψ1​,ψ2​∈K∞​, and is locally Lipschitz away from the origin.

A candidate VVV is an ISS Lyapunov function for x˙=f(x,u)\dot x=f(x,u)x˙=f(x,u) if there are γ∈K\gamma\in\mathcal Kγ∈K and a positive definite α\alphaα with

V(x)≥γ(∥u∥) ⟹ ∇V(x)f(x,u)≤−α(∥x∥)V(x)\ge\gamma(\|u\|)\ \Longrightarrow\ \nabla V(x)f(x,u)\le-\alpha(\|x\|)V(x)≥γ(∥u∥) ⟹ ∇V(x)f(x,u)≤−α(∥x∥)

at every point of differentiability of VVV.

On R+n\mathbb R^n_+R+n​, v<wv<wv<w means vi<wiv_i<w_ivi​<wi​ for every iii. A monotone aggregation function (MAF) μ:R+m→R+\mu:\mathbb R^m_+\to\mathbb R_+μ:R+m​→R+​ is continuous, positive off the origin, strictly increasing for this strict order, and unbounded as ∥s∥→∞\|s\|\to\infty∥s∥→∞. Subsystem Σi\Sigma_iΣi​ has an ISS Lyapunov function ViV_iVi​ with gains γij∈K∞∪{0}\gamma_{ij}\in\mathcal K_\infty\cup\{0\}γij​∈K∞​∪{0}, γiu∈K∪{0}\gamma_{iu}\in\mathcal K\cup\{0\}γiu​∈K∪{0} and MAF μi\mu_iμi​ on R+n+1\mathbb R^{n+1}_+R+n+1​ if, wherever ViV_iVi​ is differentiable,

Vi(xi)≥μi(γi1(V1(x1)),…,γin(Vn(xn)),γiu(∥u∥)) ⟹ ∇Vi(xi)fi(x,u)≤−αi(∥xi∥).V_i(x_i)\ge\mu_i\big(\gamma_{i1}(V_1(x_1)),\dots,\gamma_{in}(V_n(x_n)),\gamma_{iu}(\|u\|)\big)\ \Longrightarrow\ \nabla V_i(x_i)f_i(x,u)\le-\alpha_i(\|x_i\|).Vi​(xi​)≥μi​(γi1​(V1​(x1​)),…,γin​(Vn​(xn​)),γiu​(∥u∥)) ⟹ ∇Vi​(xi​)fi​(x,u)≤−αi​(∥xi​∥).

The diagonal gains vanish, γii≡0\gamma_{ii}\equiv0γii​≡0. The gain operators are

Γ‾μ(s,r)i=μi(γi1(s1),…,γin(sn),γiu(r)),Γμ(s)=Γ‾μ(s,0).\overline\Gamma_\mu(s,r)_i=\mu_i\big(\gamma_{i1}(s_1),\dots,\gamma_{in}(s_n),\gamma_{iu}(r)\big),\qquad\Gamma_\mu(s)=\overline\Gamma_\mu(s,0).Γμ​(s,r)i​=μi​(γi1​(s1​),…,γin​(sn​),γiu​(r)),Γμ​(s)=Γμ​(s,0).

An Ω-path with respect to Γμ\Gamma_\muΓμ​ is a continuous σ:R+→R+n\sigma:\mathbb R_+\to\mathbb R^n_+σ:R+​→R+n​ with every σi∈K∞\sigma_i\in\mathcal K_\inftyσi​∈K∞​, such that each σi−1\sigma_i^{-1}σi−1​ is locally Lipschitz on (0,∞)(0,\infty)(0,∞), its derivative lies in [c,C][c,C][c,C], 0<c<C0<c<C0<c<C, at its points of differentiability in any compact K⊂(0,∞)K\subset(0,\infty)K⊂(0,∞) (constants depending on KKK only), and Γμ(σ(r))<σ(r)\Gamma_\mu(\sigma(r))<\sigma(r)Γμ​(σ(r))<σ(r) for all r>0r>0r>0.

Formalization targets

Goal: Theorem 5.3

Assume each ViV_iVi​ is an ISS Lyapunov function for Σi\Sigma_iΣi​ with gains Γ\GammaΓ, γiu\gamma_{iu}γiu​ and MAFs μi\mu_iμi​; σ\sigmaσ is an Ω-path with respect to Γμ\Gamma_\muΓμ​; φ∈K∞\varphi\in\mathcal K_\inftyφ∈K∞​ satisfies

Γ‾μ(σ(r),φ(r))<σ(r)∀r>0;\overline\Gamma_\mu(\sigma(r),\varphi(r))<\sigma(r)\qquad\forall r>0;Γμ​(σ(r),φ(r))<σ(r)∀r>0;

and each fif_ifi​ is continuous. Then

V(x)=max⁡i=1,…,nσi−1(Vi(xi))V(x)=\max_{i=1,\dots,n}\sigma_i^{-1}(V_i(x_i))V(x)=i=1,…,nmax​σi−1​(Vi​(xi​))

is an ISS Lyapunov function for the network, with gain φ−1\varphi^{-1}φ−1:

V(x)≥φ−1(∥u∥) ⟹ ∇V(x)f(x,u)≤−α(∥x∥)V(x)\ge\varphi^{-1}(\|u\|)\ \Longrightarrow\ \nabla V(x)f(x,u)\le-\alpha(\|x\|)V(x)≥φ−1(∥u∥) ⟹ ∇V(x)f(x,u)≤−α(∥x∥)

for a positive definite α\alphaα. The rate α\alphaα is existential and is not fixed by the statement.

Milestones

The milestones follow the proof on pp. 14–15:

  1. VVV is a Lyapunov function candidate.
  2. The maximum rule (5.7) for Clarke generalized gradients.
  3. The chain of inequalities showing that the subsystem trigger holds strictly at every active index.
  4. The Clarke-gradient form (5.8) of the subsystem decrease.
  5. The chain rule for σi−1∘Vi\sigma_i^{-1}\circ V_iσi−1​∘Vi​, with multipliers bounded away from zero.
  6. Positivity of the rate: active blocks on a sphere stay away from the origin.
  7. The uniform decrease (5.9).

Significance

The result. Theorem 5.3 converts a small-gain condition into an explicit Lyapunov function for the network. Combined with the converse ISS Lyapunov theorem, it gives ISS of the interconnection, and with zero input it gives global asymptotic stability. It covers additive, maximum-type and multiplicative aggregation of gains, and it handles nnn subsystems without iterating a two-system result. A second main result of the paper (Theorem 5.2, a separate mission) supplies the Ω-path from the condition Γμ≱id\Gamma_\mu\not\ge\mathrm{id}Γμ​≥id. Together they reduce the stability of a network to a property of its gain operator.

Formalizing it. The result is proved on paper. As far as we know, no ISS notion, small-gain theorem or monotone aggregation framework has been machine-checked in Lean. This mission produces a Lean statement of the construction, and of its nonsmooth-analysis steps, against which a complete proof can be checked. It also corrects a misprint in the theorem's implication (see Formalization scope).

Difficulty

The function VVV is a maximum of rescaled functions and is not differentiable on the set where two indices are active, even when every ViV_iVi​ is smooth. The subsystem hypotheses only control derivatives at points where the corresponding ViV_iVi​ is differentiable. At a point where VVV is differentiable, the active ViV_iVi​ may not be. So the obvious argument — differentiate the active branch and apply (2.7) — fails, and the decrease must be transported through generalized gradients. A second obstacle is uniformity: the rate α\alphaα must depend on ∥x∥\|x\|∥x∥ alone. This requires the lower derivative bound in the Ω-path definition and a compactness argument on spheres. Dropping the lower bound breaks the theorem, because σi−1\sigma_i^{-1}σi−1​ could flatten and remove the decrease.

Formalization scope

Blocks are EuclideanSpace ℝ (Fin (N i)). The network state is the L2L^2L2 product PiLp 2 (the Euclidean norm, not the sup norm), and the input is EuclideanSpace ℝ (Fin M). Subsystems are indexed by Fin n (0-based) with n≥1n\ge1n≥1. Gains, MAFs, Ω-paths and rates live on ℝ≥0. Lyapunov functions are real-valued with an explicit nonnegativity clause. The strict order on R+n\mathbb R^n_+R+n​ is a named predicate, not Lean's Pi <. The inverses σi−1\sigma_i^{-1}σi−1​ and φ−1\varphi^{-1}φ−1 are explicit arguments with both compositions the identity. Every derivative is guarded by a differentiability hypothesis. Clarke's generalized gradient (2.5) is the published ClarkeGradients.Shared.generalizedGradient on the blocks, and the same definition restated on a general Hilbert space for RN\mathbb R^NRN and R\mathbb RR.

Implicit hypotheses made explicit:

  • Continuity of every fif_ifi​. It is the regularity behind the equivalence of the derivative form (2.4) and the Clarke form (2.6) of the decrease condition, which the proof uses.
  • γii≡0\gamma_{ii}\equiv0γii​≡0. The paper's convention.
  • Compatibility of Γ\GammaΓ and μ\muμ. Remark 2.6, the standing assumption from p. 8 on; it imposes nothing on a zero row of Γ\GammaΓ.

Corrected statement. The printed implication (5.5) has the trigger V(x)≥max⁡iφ−1(γiu(∥u∥))V(x)\ge\max_i\varphi^{-1}(\gamma_{iu}(\|u\|))V(x)≥maxi​φ−1(γiu​(∥u∥)). With Γ‾μ\overline\Gamma_\muΓμ​ as defined in (2.9), and as the paper's corollaries use it, that implication is false. A counterexample is one subsystem x˙=−x+u/6\dot x=-x+u/6x˙=−x+u/6 with V1=∣x∣V_1=|x|V1​=∣x∣, γ1u(s)=s/10\gamma_{1u}(s)=s/10γ1u​(s)=s/10, μ1(a,b)=a+2b\mu_1(a,b)=a+2bμ1​(a,b)=a+2b and σ=φ=id\sigma=\varphi=\mathrm{id}σ=φ=id, at x=1x=1x=1, u=10u=10u=10. The proof's chain of inequalities writes φ(r)\varphi(r)φ(r) where (2.9) gives γiu(φ(r))\gamma_{iu}(\varphi(r))γiu​(φ(r)). The goal keeps (2.9) and uses the trigger V(x)≥φ−1(∥u∥)V(x)\ge\varphi^{-1}(\|u\|)V(x)≥φ−1(∥u∥), under which the proof closes.

The hypotheses are jointly satisfiable. An example is n=2n=2n=2 with Vi(xi)=∥xi∥V_i(x_i)=\|x_i\|Vi​(xi​)=∥xi​∥, μi=max⁡\mu_i=\maxμi​=max, γ12=γ21=s/4\gamma_{12}=\gamma_{21}=s/4γ12​=γ21​=s/4, γiu=s/2\gamma_{iu}=s/2γiu​=s/2, σ(r)=(r,r)\sigma(r)=(r,r)σ(r)=(r,r), φ=id\varphi=\mathrm{id}φ=id and dynamics fi=−xif_i=-x_ifi​=−xi​. The conclusion is a decrease inequality at the points of differentiability of VVV for an existential positive definite rate, so it cannot be met by a vacuous choice: α\alphaα must be positive away from zero. Trajectory-level ISS (Theorem 2.3, cited by the paper) and the corollaries that conclude ISS are out of scope.

Reusable infrastructure: comparison classes, monotone aggregation functions, gain operators and Ω-paths (shared with the Ω-path mission), and the maximum and chain rules for Clarke gradients. Proofs of the nonsmooth calculus milestones are welcome independently of the goal.

Selected references

  • S. N. Dashkovskiy, B. S. Rüffer, F. R. Wirth, Small Gain Theorems for Large Scale Systems and Construction of ISS Lyapunov Functions, SIAM J. Control Optim. 48(6), 2010; preprint arXiv:0901.1842v2. https://arxiv.org/abs/0901.1842
  • S. Dashkovskiy, B. S. Rüffer, F. R. Wirth, An ISS small gain theorem for general networks, Math. Control Signals Systems 19, 2007. https://doi.org/10.1007/s00498-007-0014-8
  • Z.-P. Jiang, A. R. Teel, L. Praly, Small-gain theorem for ISS systems and applications, Math. Control Signals Systems 7, 1994. https://doi.org/10.1007/BF01211469
  • Z.-P. Jiang, I. M. Y. Mareels, Y. Wang, A Lyapunov formulation of the nonlinear small-gain theorem for interconnected ISS systems, Automatica 32(8), 1996. https://doi.org/10.1016/0005-1098(96)00051-9
  • E. D. Sontag, Smooth stabilization implies coprime factorization, IEEE Trans. Automat. Control 34(4), 1989. https://doi.org/10.1109/9.28018
  • F. H. Clarke, Optimization and Nonsmooth Analysis, Wiley, 1983. https://doi.org/10.1137/1.9781611971309
11 thms1 active userReviewed
Control TheoryOperations Research·Captain: mikedeng1

Dynamic Instabilities and Stabilization Methods in Distributed Real-Time Scheduling of Manufacturing Systems 2: Stable and Unstable Modes Coexist Under Clearing on a Two-Part-Type SystemResearch Paper

Motivation

Flexible manufacturing systems are often scheduled by simple distributed rules: each machine looks only at its own buffers and decides, in real time, which part type to work on next. Switching from one part type to another costs a set-up time during which the machine produces nothing, so a natural rule is to work on a buffer until it is empty and only then switch. Perkins and Kumar (IEEE Trans. Automat. Control 34, 1989; reference [18] of the paper) showed that such clearing policies, and in particular clear-a-fraction policies, keep every buffer bounded on acyclic systems whenever each machine has spare capacity. Whether the same holds when material flows around a cycle of machines was left open.

Kumar and Seidman (IEEE TAC 35(3), 1990) answered it negatively by two examples. Example 1 is a single re-entrant part type. Example 2, the subject of this mission, has two part types, neither of which ever revisits a machine, and shows two further phenomena: instability without re-entrance, and the coexistence, for one and the same system, of a bounded periodic regime and an unbounded one, selected only by the initial state.

Setting

A manufacturing system has part types ppp arriving at rates dpd_pdp​ and machines mmm. Parts of type ppp follow a fixed route; at stage iii they wait in buffer bp,ib_{p,i}bp,i​ at machine μp,i\mu_{p,i}μp,i​, and processing one of them takes τp,i\tau_{p,i}τp,i​. Switching a machine from buffer bbb to buffer b′b'b′ takes the set-up time δb,b′\delta_{b,b'}δb,b′​. Flows are continuous: xb(t)x_b(t)xb​(t) is the level of buffer bbb, ub(t)u_b(t)ub​(t) and yb(t)y_b(t)yb​(t) are its cumulative input and output, and

xb(t)=xb(0)+ub(t)−yb(t)≥0.x_b(t)=x_b(0)+u_b(t)-y_b(t)\ge 0 .xb​(t)=xb​(0)+ub​(t)−yb​(t)≥0.

A machine works in runs: a set-up for a buffer, then processing it at rate 1/τb1/\tau_b1/τb​ while it is nonempty, and at the rate of its inflow while it is empty. A clearing policy (Definition 1) keeps a machine on a buffer bbb until the first time that bbb is empty and another of its buffers is nonempty, and then sets it up for one of those. The system is stable if sup⁡0≤t<∞xb(t)<∞\sup_{0\le t<\infty}x_b(t)<\inftysup0≤t<∞​xb​(t)<∞ for every buffer bbb.

Example 2 (Fig. 3) has two part types with d1=d2=1d_1=d_2=1d1​=d2​=1 and two machines. Part type 1 visits buffer 1 at machine 1 and then buffer 2 at machine 2; part type 2 visits buffer 3 at machine 2 and then buffer 4 at machine 1. Processing times are τ1,…,τ4\tau_1,\dots,\tau_4τ1​,…,τ4​ and setting up to buffer kkk takes δk>0\delta_k>0δk​>0. The parameters satisfy the capacity condition (1), τ1+τ4<1\tau_1+\tau_4<1τ1​+τ4​<1 and τ2+τ3<1\tau_2+\tau_3<1τ2​+τ3​<1, and

τ2+τ4>1,δ1+δ41−τ1−τ4=δ2+δ31−τ2−τ3=:η,δ4<(1−τ3−τ4)η,δ2<(1−τ1−τ2)η,\tau_2+\tau_4>1,\qquad \frac{\delta_1+\delta_4}{1-\tau_1-\tau_4}=\frac{\delta_2+\delta_3}{1-\tau_2-\tau_3}=:\eta,\qquad \delta_4<(1-\tau_3-\tau_4)\eta,\qquad \delta_2<(1-\tau_1-\tau_2)\eta,τ2​+τ4​>1,1−τ1​−τ4​δ1​+δ4​​=1−τ2​−τ3​δ2​+δ3​​=:η,δ4​<(1−τ3​−τ4​)η,δ2​<(1−τ1​−τ2​)η,

conditions (7)–(10). The paper's feasible instance is (τ1,τ2,τ3,τ4,δ1,δ2,δ3,δ4)=(14,12,14,23,130,15,120,120)(\tau_1,\tau_2,\tau_3,\tau_4,\delta_1,\delta_2,\delta_3,\delta_4)=(\tfrac14,\tfrac12,\tfrac14,\tfrac23,\tfrac1{30},\tfrac15,\tfrac1{20},\tfrac1{20})(τ1​,τ2​,τ3​,τ4​,δ1​,δ2​,δ3​,δ4​)=(41​,21​,41​,32​,301​,51​,201​,201​), with η=1\eta=1η=1. For this system there is exactly one clearing policy.

Formalization targets

Goal: stable and unstable modes coexist

For every parameter set satisfying (1) and (7)–(10):

from x(0)=(0,η,0,η), set-ups (b1,b3): a clearing trajectory exists, and every one is bounded;∃ ξ0 ∀ ξ≥ξ0, from x(0)=(ξ,0,0,0), set-ups (b4,b3): a clearing trajectory exists, and every one has sup⁡t≥0x1(t)=+∞.\begin{aligned} &\text{from } x(0)=(0,\eta,0,\eta),\ \text{set-ups } (b_1,b_3):\ \text{a clearing trajectory exists, and every one is bounded;}\\ &\exists\,\xi_0\ \forall\,\xi\ge\xi_0,\ \text{from } x(0)=(\xi,0,0,0),\ \text{set-ups } (b_4,b_3):\ \text{a clearing trajectory exists, and every one has } \sup_{t\ge0}x_1(t)=+\infty . \end{aligned}​from x(0)=(0,η,0,η), set-ups (b1​,b3​): a clearing trajectory exists, and every one is bounded;∃ξ0​ ∀ξ≥ξ0​, from x(0)=(ξ,0,0,0), set-ups (b4​,b3​): a clearing trajectory exists, and every one has t≥0sup​x1​(t)=+∞.​

Milestones

  1. Case 1, periodic regime: under (1) and (8)–(10), every clearing trajectory from (0,η,0,η)(0,\eta,0,\eta)(0,η,0,η), (b1,b3)(b_1,b_3)(b1​,b3​) satisfies x(η)=(0,η,0,η)x(\eta)=(0,\eta,0,\eta)x(η)=(0,η,0,η) with the same set-ups.
  2. Case 2, Stage 8: under (1) and (7), for large ξ\xiξ, with t9=(ξ+τ2−1(δ1+δ2))/(τ2−1−1)t_9=(\xi+\tau_2^{-1}(\delta_1+\delta_2))/(\tau_2^{-1}-1)t9​=(ξ+τ2−1​(δ1​+δ2​))/(τ2−1​−1): x(t9)=(0,0,t9−δ1,0)x(t_9)=(0,0,t_9-\delta_1,0)x(t9​)=(0,0,t9​−δ1​,0), machine 1 set up for buffer 1, machine 2 for buffer 2.
  3. Case 2, full cycle: under (1) and (7), for large ξ\xiξ, at an explicit time t17t_{17}t17​, x(t17)=(λξ+α,0,0,0)x(t_{17})=(\lambda\xi+\alpha,0,0,0)x(t17​)=(λξ+α,0,0,0) with set-ups (b4,b3)(b_4,b_3)(b4​,b3​), where λ=τ2τ4/((1−τ2)(1−τ4))>1\lambda=\tau_2\tau_4/((1-\tau_2)(1-\tau_4))>1λ=τ2​τ4​/((1−τ2​)(1−τ4​))>1.

Significance

The result shows that stability of a scheduling policy is a property of the initial state as well as of the system: the same parameters admit a bounded periodic orbit and an orbit along which the backlog of buffer 1 is multiplied by λ>1\lambda>1λ>1 in every cycle. The capacity condition (1) holds throughout, so the instability does not come from overload: spare capacity is lost because one machine starves the other. The example also shows that a cycle in the machine graph suffices, without any part type revisiting a machine. Sections IV and V of the paper respond to this by giving a stronger capacity condition under which clear-a-fraction policies are stable, and a supervisory mechanism that stabilizes any policy.

The paper's argument is a stage-by-stage computation of a piecewise-linear trajectory. It has not been machine-checked. A formalization fixes what a clearing trajectory is (including the switching instants at which a buffer is empty but just starting to fill), proves that the trajectories exist and are determined by the initial state, and checks the paper's closed forms. One printed constant is wrong: the offset α\alphaα of the full cycle lacks a final −δ3-\delta_3−δ3​, and the milestone states the corrected value.

Difficulty

The computations within each stage are linear algebra. The difficulty is the event structure. Every stage depends on the order in which the two machines' events occur: whether machine 1 clears buffer 1 before machine 2 has finished its set-ups, whether buffer 2 is still nonempty when buffer 1 empties, and so on. These orderings hold only for ξ\xiξ large, or only because (8) holds with equality and (9)–(10) hold strictly. The periodic regime depends on exact synchronization. In Case 2, a machine processing an empty buffer at the reduced rate must not be forced off it while its other buffer is empty and not yet fed. A proof must also establish existence of each trajectory, not only compute it.

Formalization scope

  • Model. The general system has part types Fin P, machines Fin M, buffers as pairs (p,i)(p,i)(p,i) with Lean index iii for paper stage i+1i+1i+1, real time, and no transport delay or assembly (as in the paper). Example 2 is an instance of this general model, with machines 1, 2 as Lean 0, 1.
  • Runs. Each machine follows a sequence of runs. Run 0 is on the initial set-up and has no set-up phase. Run k≥1k\ge1k≥1 has a set-up phase of length δβk−1,βk\delta_{\beta_{k-1},\beta_k}δβk−1​,βk​​, followed by a processing phase. Runs are never cut during a set-up. If there are infinitely many runs, their start times tend to ∞\infty∞. There is no idling outside runs: a machine serving an empty buffer passes on its inflow.
  • Set-up times. They depend only on the target buffer, and δb,b=0\delta_{b,b}=0δb,b​=0 is never used.
  • Processing law. The rate cap is yb(t)−yb(s)≤(1/τb)⋅y_b(t)-y_b(s)\le(1/\tau_b)\cdotyb​(t)−yb​(s)≤(1/τb​)⋅(processing time of bbb in [s,t][s,t][s,t]). Rate is exactly 1/τb1/\tau_b1/τb​ while the machine is processing a nonempty buffer.
  • Clearing. "Nonempty" in Definition 1 is read as demanding: positive level, or cumulative input strictly increasing from that instant. Under the literal reading the paper's own switching instants would not be "first times", and no clearing trajectory would exist from these initial states. The no-early-exit condition is imposed on the open processing interval.
  • Set up for bbb at ttt. At t>0t>0t>0 this refers to the run whose interval (sk,sk+1](s_k,s_{k+1}](sk​,sk+1​] contains ttt.
  • Ruling out trivial formalizations. The goal asserts existence of a clearing trajectory in both modes, so neither "every trajectory is bounded" nor "every trajectory is unbounded" can hold vacuously. η\etaη is computed from the data rather than pinned by hypotheses, and (8) is an equality.

Contributions welcome: existence and uniqueness of clearing trajectories for the two-machine instance, the event-ordering lemmas for large ξ\xiξ, the restart (time-shift) property of trajectories, and the three milestones.

Selected references

  • P. R. Kumar and T. I. Seidman, Dynamic instabilities and stabilization methods in distributed real-time scheduling of manufacturing systems, IEEE Transactions on Automatic Control 35(3):289–298, 1990. https://doi.org/10.1109/9.50339
  • J. R. Perkins and P. R. Kumar, Stable, distributed, real-time scheduling of flexible manufacturing/assembly/disassembly systems, IEEE Transactions on Automatic Control 34:139–148, February 1989 (reference [18] of the paper).
8 thms1 active userReviewed
Control TheoryOperations Research·Captain: mikedeng1

Dynamic Instabilities and Stabilization Methods in Distributed Real-Time Scheduling of Manufacturing Systems 4: A Run-Truncating Priority-Queue Supervisor Keeps Every Buffer Bounded When ρₘ < 1Research Paper

Motivation

A flexible manufacturing system routes several part types through a set of machines; a machine that switches from one kind of part to another must spend a set-up time first. Each machine has to decide, in real time and from local information only, which of its waiting buffers to work on and for how long. Long runs waste little time on set-ups but starve other buffers; short runs do the opposite.

Kumar and Seidman (IEEE TAC 35(3), 1990) showed in §III of the paper that natural distributed rules (clearing policies, which keep processing a buffer until it is empty) can be unstable when parts revisit machines, even though every machine has enough capacity. Their §IV gives a sufficient condition for a subclass of such rules to be stable, which is stricter than the capacity condition. §V, the subject of this mission, asks for something stronger: a simple, distributed mechanism that a supervisor can add to any scheduling policy and that makes the system stable whenever the capacity condition alone holds.

Timeline. Perkins and Kumar (1989) proved that the capacity condition is sufficient for the existence of some stabilizing policy, and that every clear-a-fraction policy is stable on acyclic systems. Kumar and Seidman (1990) gave the instability examples for nonacyclic systems and the universal supervisor formalized here.

Setting

There are PPP part types and MMM machines. Part type ppp arrives at rate dp>0d_p>0dp​>0 and follows a route of npn_pnp​ operations; operation iii is done by machine μp,i\mu_{p,i}μp,i​ and takes τp,i>0\tau_{p,i}>0τp,i​>0 per part. Parts awaiting operation iii wait in buffer bp,ib_{p,i}bp,i​, with level xp,i(t)≥0x_{p,i}(t)\ge 0xp,i​(t)≥0. Machine mmm serves Bm={bp,i:μp,i=m}B_m=\{b_{p,i}:\mu_{p,i}=m\}Bm​={bp,i​:μp,i​=m}, and switching from bbb to b′b'b′ costs δb,b′≥0\delta_{b,b'}\ge 0δb,b′​≥0. Flows are continuous: a machine processing a nonempty buffer bp,ib_{p,i}bp,i​ drains it at rate 1/τp,i1/\tau_{p,i}1/τp,i​, the output feeds bp,i+1b_{p,i+1}bp,i+1​ instantly, and a machine on an empty buffer passes its inflow through. Each machine works in runs: a set-up, then a processing phase on one buffer.

The load of machine mmm and the capacity condition are

ρm:=∑(p,i): μp,i=mdpτp,i<1(1≤m≤M).(1)\rho_m:=\sum_{(p,i):\,\mu_{p,i}=m}d_p\tau_{p,i}<1\qquad(1\le m\le M). \tag{1}ρm​:=(p,i):μp,i​=m∑​dp​τp,i​<1(1≤m≤M).(1)

The system is stable if sup⁡0≤t<∞xp,i(t)<∞\sup_{0\le t<\infty}x_{p,i}(t)<\inftysup0≤t<∞​xp,i​(t)<∞ for every buffer.

The supervisor picks γm\gamma_mγm​ with

γm(1−ρm)>∑b∈Bmmax⁡b′∈Bmδb′,b(24)\gamma_m(1-\rho_m)>\sum_{b\in B_m}\max_{b'\in B_m}\delta_{b',b} \tag{24}γm​(1−ρm​)>b∈Bm​∑​b′∈Bm​max​δb′,b​(24)

and thresholds zp,i≥0z_{p,i}\ge0zp,i​≥0. It truncates every processing run of bp,ib_{p,i}bp,i​ at γmdpτp,i\gamma_m d_p\tau_{p,i}γm​dp​τp,i​; it keeps a first-come first-served queue QmQ_mQm​ of the buffers that are not being processed and whose level exceeds zp,iz_{p,i}zp,i​; when a run ends and Qm≠∅Q_m\ne\emptysetQm​=∅, the head of QmQ_mQm​ is processed next, for exactly γmdpτp,i\gamma_m d_p\tau_{p,i}γm​dp​τp,i​ unless it clears earlier. When QmQ_mQm​ is empty the underlying policy is free. Write ζm:=γm(1−ρm)−∑b∈Bmmax⁡b′∈Bmδb′,b>0\zeta_m:=\gamma_m(1-\rho_m)-\sum_{b\in B_m}\max_{b'\in B_m}\delta_{b',b}>0ζm​:=γm​(1−ρm​)−∑b∈Bm​​maxb′∈Bm​​δb′,b​>0 (26) and βp,i(t):=∑j≤iτp,ixp,j(t)\beta_{p,i}(t):=\sum_{j\le i}\tau_{p,i}x_{p,j}(t)βp,i​(t):=∑j≤i​τp,i​xp,j​(t), the backlog of part type ppp for machine μp,i\mu_{p,i}μp,i​.

Formalization targets

Goal: Theorem 2

Under (1), (24) and z≥0z\ge 0z≥0, every supervised trajectory, from every initial state, satisfies

sup⁡0≤t<∞xp,i(t)<+∞for all p,i.\sup_{0\le t<\infty}x_{p,i}(t)<+\infty\qquad\text{for all }p,i.0≤t<∞sup​xp,i​(t)<+∞for all p,i.

The bound is allowed to depend on the trajectory; no uniformity in the initial state is claimed.

Milestones: Lemma 1

  1. A buffer that enters QmQ_mQm​ at tint_{\rm in}tin​ completes its next run by tin+γm−ζmt_{\rm in}+\gamma_m-\zeta_mtin​+γm​−ζm​ (25).
  2. If it enters QmQ_mQm​ with xp,i(tin)≥γmdpx_{p,i}(t_{\rm in})\ge\gamma_m d_pxp,i​(tin​)≥γm​dp​, that run lowers the backlog: βp,i(tcomplete)≤βp,i(tin)−ζmdpτp,i\beta_{p,i}(t_{\rm complete})\le\beta_{p,i}(t_{\rm in})-\zeta_m d_p\tau_{p,i}βp,i​(tcomplete​)≤βp,i​(tin​)−ζm​dp​τp,i​.
  3. A buffer that enters QmQ_mQm​ at tint_{\rm in}tin​ and stays above max⁡(γmdp,zp,i)\max(\gamma_md_p,z_{p,i})max(γm​dp​,zp,i​) (strictly above zp,iz_{p,i}zp,i​ after tint_{\rm in}tin​) up to t′t't′ has t′−tin≤(1+βp,i(tin)/(ζmdpτp,i))(γm−ζm)t'-t_{\rm in}\le(1+\beta_{p,i}(t_{\rm in})/(\zeta_md_p\tau_{p,i}))(\gamma_m-\zeta_m)t′−tin​≤(1+βp,i​(tin​)/(ζm​dp​τp,i​))(γm​−ζm​).
  4. Any interval on which xp,i≥gp,i:=max⁡(γmdp,zp,i)+γmdpx_{p,i}\ge g_{p,i}:=\max(\gamma_md_p,z_{p,i})+\gamma_md_pxp,i​≥gp,i​:=max(γm​dp​,zp,i​)+γm​dp​ has length at most ap,i+cp,iβp,i(t)a_{p,i}+c_{p,i}\beta_{p,i}(t)ap,i​+cp,i​βp,i​(t).

Significance

The theorem separates two concerns of real-time scheduling. The underlying policy can be tuned for performance (low set-up overhead, short buffers) without any stability analysis; the supervisor guarantees stability under exactly the condition that is necessary for it. The mechanism is distributed: each machine uses only its own buffer levels. With z=0z=0z=0 it enforces FCFS with truncated runs; with large zzz and γ\gammaγ it never intervenes on a policy that is already stable, so the degree of intervention is tunable. Combined with the §III instability examples, it shows that instability of clearing policies is a design defect that a local safeguard removes.

The result is proved in the paper; to our knowledge it has no machine-checked proof. This mission produces a formal model of continuous-flow manufacturing systems with set-up times and runs, a formal definition of the supervisor, and the four parts of Lemma 1 as reusable statements about it. Part 3) is stated with a corrected hypothesis (see Formalization scope).

Difficulty

The underlying policy is arbitrary, so no structure of the trajectory between interventions can be used: the policy may idle on empty buffers, switch at will, and re-select a buffer as soon as its run is truncated. The natural approach of bounding the total work at a machine fails, because work arrives at machine mmm from upstream machines whose behaviour depends on mmm itself through re-entrant routes, so a machine-by-machine argument is circular. A further difficulty is that the supervisor acts only on buffers above their thresholds, so a buffer can be ignored for as long as it sits at or below zp,iz_{p,i}zp,i​; any bound has to account for the time spent below the threshold and for repeated re-entries into QmQ_mQm​, with a set-up paid at each.

Formalization scope

  • Model. Part types Fin P, machines Fin M, buffers Σ p, Fin (n p); paper index iii is Lean index i−1i-1i−1. Time is real with t≥0t\ge0t≥0. Set-up times satisfy δb,b=0\delta_{b,b}=0δb,b​=0: a set-up is paid only on a switch. No transport delays or assembly, as in the paper.
  • Runs. Each machine is always in a run (no idling outside runs); a run is never cut during its set-up; run starts do not accumulate; zero-length runs are allowed. Processing is at rate at most 1/τb1/\tau_b1/τb​ and only in a processing phase of bbb, and at exactly 1/τb1/\tau_b1/τb​ while bbb is nonempty.
  • Queue. Membership of QmQ_mQm​ is determined by the trajectory: not on the current run and level strictly above zbz_bzb​. The FCFS key is the start of the current sojourn; ties, including the initial queue at time 000, are broken arbitrarily, so every initial queue order is covered. A buffer whose run just ended is in QmQ_mQm​ at that instant if its level exceeds zbz_bzb​.
  • Lemma 1. Parts 1)–3) assume, as the page does, that the buffer enters QmQ_mQm​ at tint_{\rm in}tin​. Part 3) adds xp,i>zp,ix_{p,i}>z_{p,i}xp,i​>zp,i​ on (tin,t′](t_{\rm in},t'](tin​,t′]: with the printed non-strict hypothesis the buffer can sit at exactly zp,iz_{p,i}zp,i​, never be re-queued, and wait arbitrarily long. In 4), cp,ic_{p,i}cp,i​ is (γm−ζm)/(ζmdpτp,i)(\gamma_m-\zeta_m)/(\zeta_md_p\tau_{p,i})(γm​−ζm​)/(ζm​dp​τp,i​).
  • Ruled out. The base policy is not restricted to clearing, CAF or any fixed rule, the system is not restricted to few machines or acyclic routes, and the hypothesis of the goal is (24), not ζm>0\zeta_m>0ζm​>0. A non-vacuity witness (one machine, one buffer) shows the class of supervised trajectories is nonempty.
  • Reusable. The trajectory model (runs, set-ups, processing law) is the same as in the other missions of this series and applies to any distributed scheduling policy with set-ups.

Contributions welcome: proofs of the Lemma 1 parts, and lemmas on the model (Lipschitz continuity of levels, monotonicity of a buffer's level while it is not processed).

Selected references

  • P. R. Kumar and T. I. Seidman, Dynamic instabilities and stabilization methods in distributed real-time scheduling of manufacturing systems, IEEE Trans. Automat. Control 35(3), 289–298, 1990. https://doi.org/10.1109/9.50339
  • J. R. Perkins and P. R. Kumar, Stable, distributed, real-time scheduling of flexible manufacturing/assembly/disassembly systems, IEEE Trans. Automat. Control 34(2), 139–148, 1989. https://doi.org/10.1109/9.21085
8 thms1 active userReviewed
Control TheoryOperations ResearchOptimization·Captain: mikedeng1

Homogeneous Approximation, Recursive Observer Design, and Output Feedback: Global Asymptotic Stabilization of a Chain of Integrators by a Homogeneous-in-the-Bi-Limit Output FeedbackResearch Paper

Motivation

Many nonlinear control systems behave like a chain of integrators, x˙1=x2,…,x˙n=u\dot x_1=x_2,\dots,\dot x_n=ux˙1​=x2​,…,x˙n​=u, with additional terms that are small either near the origin or far from it. Designs based on weighted homogeneity handle such systems by making the closed loop invariant under a dilation, which gives robustness to perturbations that are dominated by the homogeneous part (Rosier, Homogeneous Lyapunov function for homogeneous continuous vector field, Systems & Control Letters, 1992, doi:10.1016/0167-6911(92)90078-7). A single homogeneous approximation, however, describes the system only at one scale. A perturbation that is negligible near the origin may dominate at infinity, and a design tuned to the origin can then fail globally.

Andrieu, Praly and Astolfi (arXiv:0903.0298v1; SIAM J. Control Optim., 2008, doi:10.1137/060675861) introduce homogeneity in the bi-limit: a function or vector field has one homogeneous approximation near the origin and another, possibly with different weights and degree, at infinity. They develop the basic calculus of this notion, a converse Lyapunov theorem for it, a recursive observer and a recursive state feedback for the chain of integrators, and combine them into a global output feedback. This mission formalizes that output-feedback result and the chain of results it rests on.

Setting

For a weight r=(r1,…,rn)r=(r_1,\dots,r_n)r=(r1​,…,rn​) with all ri>0r_i>0ri​>0 and λ>0\lambda>0λ>0, the dilation is λr⋄x=(λr1x1,…,λrnxn)\lambda^r\diamond x=(\lambda^{r_1}x_1,\dots,\lambda^{r_n}x_n)λr⋄x=(λr1​x1​,…,λrn​xn​). A continuous function ϕ:Rn→R\phi:\mathbb R^n\to\mathbb Rϕ:Rn→R is homogeneous in the 0-limit with triple (r0,d0,ϕ0)(r_0,d_0,\phi_0)(r0​,d0​,ϕ0​), degree d0≥0d_0\ge0d0​≥0, if ϕ0\phi_0ϕ0​ is continuous and not identically zero and, for every compact C⊆Rn∖{0}C\subseteq\mathbb R^n\setminus\{0\}C⊆Rn∖{0} and every ε>0\varepsilon>0ε>0, there is λ0>0\lambda_0>0λ0​>0 such that

max⁡x∈C∣ϕ(λr0⋄x)λd0−ϕ0(x)∣≤εfor all λ∈(0,λ0].\max_{x\in C}\left|\frac{\phi(\lambda^{r_0}\diamond x)}{\lambda^{d_0}}-\phi_0(x)\right|\le\varepsilon\qquad\text{for all }\lambda\in(0,\lambda_0].x∈Cmax​​λd0​ϕ(λr0​⋄x)​−ϕ0​(x)​≤εfor all λ∈(0,λ0​].

Homogeneity in the ∞-limit with triple (r∞,d∞,ϕ∞)(r_\infty,d_\infty,\phi_\infty)(r∞​,d∞​,ϕ∞​) is the same statement for all λ≥λ∞\lambda\ge\lambda_\inftyλ≥λ∞​. A vector field f=(f1,…,fn)f=(f_1,\dots,f_n)f=(f1​,…,fn​) is homogeneous with triple (r,d,f0)(r,\mathfrak d,f_0)(r,d,f0​), d∈R\mathfrak d\in\mathbb Rd∈R, when each fif_ifi​ is homogeneous with triple (r,d+ri,f0,i)(r,\mathfrak d+r_i,f_{0,i})(r,d+ri​,f0,i​) and d+ri≥0\mathfrak d+r_i\ge0d+ri​≥0. Bi-limit means both at once.

For the chain of integrators, Snx=(x2,…,xn,0)TS_n x=(x_2,\dots,x_n,0)^TSn​x=(x2​,…,xn​,0)T and Bn=(0,…,0,1)TB_n=(0,\dots,0,1)^TBn​=(0,…,0,1)T. Given degrees d0,d∞∈(−1,1n−1)\mathfrak d_0,\mathfrak d_\infty\in(-1,\frac1{n-1})d0​,d∞​∈(−1,n−11​), the weights are

r0,i=1−d0(n−i),r∞,i=1−d∞(n−i),i=1,…,n.r_{0,i}=1-\mathfrak d_0(n-i),\qquad r_{\infty,i}=1-\mathfrak d_\infty(n-i),\qquad i=1,\dots,n .r0,i​=1−d0​(n−i),r∞,i​=1−d∞​(n−i),i=1,…,n.

The output feedback studied is

x˙=Snx+Bnu,y=x1,X^˙n=L(SnX^n+Bnϕn(X^n)+K1(x1−x^1)),u=Lnϕn(X^n),\dot x=S_nx+B_nu,\quad y=x_1,\qquad \dot{\hat{\mathfrak X}}_n=L\bigl(S_n\hat{\mathfrak X}_n+B_n\phi_n(\hat{\mathfrak X}_n)+K_1(x_1-\hat x_1)\bigr),\quad u=L^n\phi_n(\hat{\mathfrak X}_n),x˙=Sn​x+Bn​u,y=x1​,X^˙n​=L(Sn​X^n​+Bn​ϕn​(X^n​)+K1​(x1​−x^1​)),u=Lnϕn​(X^n​),

with a gain L>0L>0L>0, a state feedback ϕn:Rn→R\phi_n:\mathbb R^n\to\mathbb Rϕn​:Rn→R and an output-injection vector field K1:Rn→RnK_1:\mathbb R^n\to\mathbb R^nK1​:Rn→Rn, where K1(s)K_1(s)K1​(s) means K1(s,0,…,0)K_1(s,0,\dots,0)K1​(s,0,…,0). Its homogeneous approximations are the same closed loop with (ϕn,0,K1,0)(\phi_{n,0},K_{1,0})(ϕn,0​,K1,0​) and with (ϕn,∞,K1,∞)(\phi_{n,\infty},K_{1,\infty})(ϕn,∞​,K1,∞​) in place of (ϕn,K1)(\phi_n,K_1)(ϕn​,K1​).

Formalization targets

Goal: Theorem 5.1

For n≥2n\ge2n≥2 and d0,d∞∈(−1,1n−1)\mathfrak d_0,\mathfrak d_\infty\in(-1,\frac1{n-1})d0​,d∞​∈(−1,n−11​) there exist ϕn\phi_nϕn​, homogeneous in the bi-limit with triples (r0,1+d0,ϕn,0)(r_0,1+\mathfrak d_0,\phi_{n,0})(r0​,1+d0​,ϕn,0​) and (r∞,1+d∞,ϕn,∞)(r_\infty,1+\mathfrak d_\infty,\phi_{n,\infty})(r∞​,1+d∞​,ϕn,∞​), and K1K_1K1​, homogeneous in the bi-limit with triples (r0,d0,K1,0)(r_0,\mathfrak d_0,K_{1,0})(r0​,d0​,K1,0​) and (r∞,d∞,K1,∞)(r_\infty,\mathfrak d_\infty,K_{1,\infty})(r∞​,d∞​,K1,∞​), such that

∀L>0:0∈R2n is globally asymptotically stable for the closed loop and for both of its homogeneous approximations.\forall L>0:\quad 0\in\mathbb R^{2n}\text{ is globally asymptotically stable for the closed loop and for both of its homogeneous approximations.}∀L>0:0∈R2n is globally asymptotically stable for the closed loop and for both of its homogeneous approximations.

The pair (ϕn,K1)(\phi_n,K_1)(ϕn​,K1​) is fixed before LLL. No constant appears in the goal.

Milestones

  1. Proposition 2.10 (composition) and Proposition 2.12 (integration along a coordinate) preserve homogeneity in the limit.
  2. Lemma 2.13: for homogeneous η\etaη and γ≥0\gamma\ge0γ≥0 with η<0\eta<0η<0 where γ=0\gamma=0γ=0, η−cγ<0\eta-c\gamma<0η−cγ<0 off the origin for all large ccc, simultaneously for both approximations.
  3. Theorem 2.20: a converse Lyapunov theorem, giving a C1C^1C1 proper Lyapunov function whose gradient is homogeneous in the bi-limit.
  4. Theorem 3.1 and display (3.12): the recursive observer, an output injection K1K_1K1​ making E˙=SnE+K1(e1)\dot E=S_nE+K_1(e_1)E˙=Sn​E+K1​(e1​) and its approximations globally asymptotically stable.
  5. Theorem 4.1 and display (4.9): the recursive state feedback, a ϕn\phi_nϕn​ making X˙=SnX+Bnϕn(X)\dot{\mathfrak X}=S_n\mathfrak X+B_n\phi_n(\mathfrak X)X˙=Sn​X+Bn​ϕn​(X) and its approximations globally asymptotically stable.

Significance

The theorem gives a single dynamic output feedback for the chain of integrators that is homogeneous with prescribed degrees near the origin and at infinity, and that stabilizes globally for every gain L>0L>0L>0. Because the degrees at the two ends are independent, the same design can be matched to perturbations of different orders at small and large amplitudes; the paper derives from it output-feedback stabilizers for systems in feedback and feedforward form (Corollaries 5.2 and 5.3), which are outside this mission. The converse Lyapunov theorem (Theorem 2.20) and the key lemma (Lemma 2.13) are general tools for any vector field homogeneous in the bi-limit.

The results are proved in the paper; none of them, nor the notion of homogeneity in the bi-limit, has a machine-checked proof. The platform has a definition of global asymptotic stability for continuous vector fields (from the series on Chitour, Ushirobira, Efimov and Perruquetti's prescribed-time stabilization) and Mathlib has the needed analysis, but there is no converse Lyapunov theorem and no theory of weighted homogeneous vector fields. A complete formalization would supply both.

Difficulty

Lyapunov arguments for homogeneous systems usually compare a function with its homogeneous approximation on the unit sphere and then scale. With homogeneity in the bi-limit the comparison holds only for small or for large dilation parameters, with no control at intermediate scales, and the two approximations have different weights, so no single dilation brings the whole space to a compact set. Each statement has to hold for the system and for both approximations at once. Theorem 2.20 additionally requires a converse Lyapunov theorem for continuous, non-Lipschitz vector fields whose solutions need not be unique, so a flow map is not available. Finally, the gain LLL in the goal is arbitrary: an argument that only works for LLL large enough proves a weaker statement.

Formalization scope

Points of Rn\mathbb R^nRn are functions Fin n → ℝ, with the paper's coordinate xix_ixi​ at index i−1i-1i−1; the closed loop lives on Fin (n + n) → ℝ with xxx first and X^n\hat{\mathfrak X}_nX^n​ second. Real powers are Real.rpow; the signed power is wr=sign⁡(w)∣w∣rw^r=\operatorname{sign}(w)|w|^rwr=sign(w)∣w∣r. Every clause of Definitions 2.1, 2.3 and 2.5 is kept: positive weights, nonnegative function degrees, continuity, approximating functions not identically zero, uniformity on compact subsets of Rn∖{0}\mathbb R^n\setminus\{0\}Rn∖{0}. Dropping any of them makes the goal weaker than the paper's.

Global asymptotic stability reuses the published ChitourPrescribedTime.FixedTime.GloballyAsymptoticallyStable on the Euclidean space, applied to the time-invariant field: the origin is an equilibrium, every initial state has a solution on [0,∞)[0,\infty)[0,∞), and stability and uniform attractivity hold for every solution. The mission adds that no solution escapes to infinity in finite time, so that every solution is covered; for continuous autonomous fields this is the textbook notion. Positive and negative definiteness, properness (V→∞V\to\inftyV→∞ along the cocompact filter), C1C^1C1 and partial derivatives (Fréchet derivative on a basis vector) are defined in the mission's definition files.

Corrections and readings, each disclosed in the item concerned:

  • Proposition 2.10 is false as printed. The composite approximation ζ0∘ϕ0\zeta_0\circ\phi_0ζ0​∘ϕ0​ can vanish identically, and in the ∞-limit a degree-0 outer function fails. Both extra hypotheses are added.
  • (5.2) prints K1(x1−x^1)K_1(x_1-\hat x_1)K1​(x1​−x^1​) while (3.3) and (5.9) use x^1−x1\hat x_1-x_1x^1​−x1​. The goal keeps the printed sign; since K1K_1K1​ is existential, the two readings are equivalent.
  • In Theorem 3.1 the hypothesis "GAS for these systems" covers (3.5) and both approximations, as the proof uses. In Theorem 4.1 the implicit ψi0,ψi∞\psi_{i0},\psi_{i\infty}ψi0​,ψi∞​ are existential C1C^1C1 functions, and αi+1>1\alpha_{i+1}>1αi+1​>1 is kept as printed. (4.4) and (4.9) lack the time-derivative dots.

A formalization in which the closed loop is replaced by its linearization, the homogeneity predicate is weakened to pointwise convergence, or the quantifier on LLL is moved before ϕn\phi_nϕn​ and K1K_1K1​, proves a different statement and does not close the goal. Contributions welcome: a library of weighted dilations and homogeneous functions, the converse Lyapunov theorem, and proofs of the milestones in any order.

Selected references

  • V. Andrieu, L. Praly, A. Astolfi, Homogeneous Approximation, Recursive Observer Design, and Output Feedback, arXiv:0903.0298v1, 2009 (SIAM J. Control Optim. 47(4), 2008). https://arxiv.org/abs/0903.0298
  • L. Rosier, Homogeneous Lyapunov function for homogeneous continuous vector field, Systems & Control Letters 19(6), 1992. https://doi.org/10.1016/0167-6911(92)90078-7
  • A. Bacciotti, L. Rosier, Liapunov Functions and Stability in Control Theory, Springer, 2nd ed., 2005. https://doi.org/10.1007/b139028
12 thms1 active userReviewed
Control TheoryOperations Research·Captain: mikedeng1

Dynamic Instabilities and Stabilization Methods in Distributed Real-Time Scheduling of Manufacturing Systems 1: Clearing Policies Are Unstable on a Re-Entrant Two-Machine Line, Even Without Set-UpsResearch Paper

Motivation

A flexible manufacturing system is a set of machines through which parts of several types travel along fixed routes; each machine serves several buffers and must pay a set-up time whenever it switches from one buffer to another. Real-time scheduling decides, as the system evolves, which buffer each machine works on. Perkins and Kumar (IEEE Trans. Automat. Control 34, 1989) introduced simple distributed policies for this problem, of which the most natural is the clearing policy: a machine keeps working on a buffer until it is empty, and only then switches. They proved that every clear-a-fraction policy, a subclass of clearing policies, keeps every buffer bounded on acyclic systems whenever each machine has spare capacity, and left open whether clear-a-fraction policies stabilize all systems in which material flows around cycles.

Kumar and Seidman (IEEE Trans. Automat. Control 35(3), 1990, doi:10.1109/9.50339) answered no. Their Example 1 is a single part type that visits two machines in the order 1, 2, 2, 1. Every machine has spare capacity, yet under the clearing policy the buffer levels grow without bound, and they do so even when all set-up times are zero, so the instability comes from machines starving each other rather than from time lost to set-ups. Until then, instability had been suspected to require positive set-up times. Shortly afterwards Lu and Kumar exhibited instability of a static buffer-priority rule in a re-entrant network (IEEE Trans. Automat. Control 36, 1991); together these examples started the study of stability of multiclass queueing networks.

Setting

A manufacturing system has part types ppp arriving at rates dp>0d_p > 0dp​>0. Parts of type ppp follow a route of length npn_pnp​: their iii-th operation is at machine μp,i\mu_{p,i}μp,i​, and they wait for it in buffer bp,ib_{p,i}bp,i​, where each part needs processing time τp,i>0\tau_{p,i} > 0τp,i​>0. Machine mmm serves the buffers Bm={b:μb=m}B_m = \{b : \mu_b = m\}Bm​={b:μb​=m}, and switching from bbb to b′b'b′ costs set-up time δb,b′≥0\delta_{b,b'} \ge 0δb,b′​≥0.

Flows are continuous (fluid). The level of buffer bbb at time t≥0t \ge 0t≥0 is xb(t)=xb(0)+ub(t)−yb(t)≥0x_b(t) = x_b(0) + u_b(t) - y_b(t) \ge 0xb​(t)=xb​(0)+ub​(t)−yb​(t)≥0, where yb(t)y_b(t)yb​(t) is its cumulative output and ub(t)u_b(t)ub​(t) its cumulative input: dptd_p tdp​t for the first buffer of a route, and the output of the preceding buffer otherwise. Each machine works in runs: run kkk is a set-up phase of length δβk−1,βk\delta_{\beta_{k-1},\beta_k}δβk−1​,βk​​ followed by a processing phase on buffer βk\beta_kβk​, during which the buffer is drained at rate 1/τb1/\tau_b1/τb​ while it is nonempty and passed through at its inflow rate when it is empty. The system is stable if sup⁡0≤t<∞xb(t)<∞\sup_{0 \le t < \infty} x_b(t) < \inftysup0≤t<∞​xb​(t)<∞ for every buffer.

A clearing policy (Definition 1) is one in which a machine processing bbb continues until the first time that bbb is empty and some other buffer of the same machine is nonempty, and then commences a set-up for one of the nonempty buffers.

Example 1. One part type arrives at rate d=1d = 1d=1 and visits machine 1, machine 2, machine 2 and machine 1; its buffers are 1,2,3,41, 2, 3, 41,2,3,4, so B1={1,4}B_1 = \{1, 4\}B1​={1,4} and B2={2,3}B_2 = \{2, 3\}B2​={2,3}. Processing times are τ1,…,τ4>0\tau_1, \dots, \tau_4 > 0τ1​,…,τ4​>0, and δk\delta_kδk​ is the time to set up to buffer kkk. The parameters satisfy the critical condition and the capacity condition

τ2+τ4>1,τ1+τ4<1,τ2+τ3<1.(3–5)\tau_2 + \tau_4 > 1, \qquad \tau_1 + \tau_4 < 1, \qquad \tau_2 + \tau_3 < 1. \tag{3–5}τ2​+τ4​>1,τ1​+τ4​<1,τ2​+τ3​<1.(3–5)

The initial state is x(0)=(ξ,0,0,0)x(0) = (\xi, 0, 0, 0)x(0)=(ξ,0,0,0), with machine 1 set up for buffer 4 and machine 2 set up for buffer 3. Write

λ=τ41−τ2>1,α=(τ4+1)(δ1+δ2)1−τ2+δ3(τ4+1)+δ4,β=τ4(δ1+δ2)1−τ2+τ4δ3+δ4.\lambda = \frac{\tau_4}{1-\tau_2} > 1, \quad \alpha = \frac{(\tau_4+1)(\delta_1+\delta_2)}{1-\tau_2} + \delta_3(\tau_4+1) + \delta_4, \quad \beta = \frac{\tau_4(\delta_1+\delta_2)}{1-\tau_2} + \tau_4\delta_3 + \delta_4.λ=1−τ2​τ4​​>1,α=1−τ2​(τ4​+1)(δ1​+δ2​)​+δ3​(τ4​+1)+δ4​,β=1−τ2​τ4​(δ1​+δ2​)​+τ4​δ3​+δ4​.

Formalization targets

Goal: Example 1, both cases

Assume (3)–(5).

  1. If δ1,…,δ4>0\delta_1, \dots, \delta_4 > 0δ1​,…,δ4​>0, there is ξ0\xi_0ξ0​ such that for every ξ≥ξ0\xi \ge \xi_0ξ≥ξ0​ (ξ>0\xi > 0ξ>0) a clearing trajectory from (ξ,0,0,0)(\xi, 0, 0, 0)(ξ,0,0,0) exists, and every such trajectory has
sup⁡0≤t<∞x1(t)=+∞.\sup_{0 \le t < \infty} x_1(t) = +\infty.0≤t<∞sup​x1​(t)=+∞.
  1. If δ1=⋯=δ4=0\delta_1 = \dots = \delta_4 = 0δ1​=⋯=δ4​=0, the same holds for every ξ>0\xi > 0ξ>0.

Milestone: the Case 1 cycle map

For ξ\xiξ large enough, every clearing trajectory from (ξ,0,0,0)(\xi, 0, 0, 0)(ξ,0,0,0) reaches, at T1=(λ+τ2/(1−τ2))ξ+αT_1 = (\lambda + \tau_2/(1-\tau_2))\xi + \alphaT1​=(λ+τ2​/(1−τ2​))ξ+α,

x(T1)=(λξ+β,0,0,0),x(T_1) = (\lambda\xi + \beta, 0, 0, 0),x(T1​)=(λξ+β,0,0,0),

with machines 1 and 2 again set up for buffers 4 and 3.

Milestone: the Case 2 magnification

With zero set-up times and any ξ>0\xi > 0ξ>0, every clearing trajectory reaches, at t5=(τ2+τ4)ξ/(1−τ2)t_5 = (\tau_2+\tau_4)\xi/(1-\tau_2)t5​=(τ2​+τ4​)ξ/(1−τ2​),

x(t5)=(λξ,0,0,0),x(t_5) = (\lambda\xi, 0, 0, 0),x(t5​)=(λξ,0,0,0),

with machines 1 and 2 again set up for buffers 4 and 3.

Significance

The example shows that the condition ρm<1\rho_m < 1ρm​<1 on every machine, which is necessary for stability and sufficient for the existence of some stabilizing policy, does not make natural distributed policies stable once material flows around a cycle. The throughput of the line falls to 1/(τ2+τ4)<11/(\tau_2+\tau_4) < 11/(τ2​+τ4​)<1 part per unit time although each machine could handle the demand. This motivates the paper's two positive results: sufficient conditions under which clear-a-fraction policies are stable (Theorem 1), and a supervisory mechanism that stabilizes any policy (Theorem 2), which are the subjects of the other missions of this series. The example is also an early instance of the phenomenon later studied as instability of multiclass fluid networks under work-conserving policies.

The paper's argument is a stage-by-stage computation of piecewise linear trajectories. No machine-checked version of it exists. A formal proof has to make precise what the paper leaves to the reader: that the clearing rule determines the trajectory, that the stage formulas are what that trajectory does, and that the cycle can be restarted. The formal model of runs, set-ups and the clearing rule built here is the same as in the other missions of the series.

Difficulty

The arithmetic of each cycle is routine once the trajectory is known. The difficulty is in the universal quantifier: the claim covers every clearing trajectory, and the clearing rule is defined implicitly, through "the first time thereafter" at which a buffer is empty and another one is nonempty. At several switching instants the buffer a machine switches to is empty and only starts to fill at that instant, and with zero set-up times a machine may begin a run at an instant where the switching condition already holds. Showing that each switch happens exactly when the paper says, and that the fluid levels then follow the printed formulas (including the reduced rate of a machine working on an empty buffer), is a uniqueness argument for a hybrid system, not a simulation. The existence half asks for the converse: an explicit trajectory, defined for all time, with infinitely many runs whose start times tend to infinity.

Formalization scope

  • Time is real (t≥0t \ge 0t≥0); flows are fluid; there are no transport delays or assembly.
  • The system is a general structure (part types Fin P, machines Fin M, buffers ⟨p, i⟩ with i : Fin (n p), paper index iii = Lean index i+1i+1i+1), instantiated as Example 1 with d=1d = 1d=1, route (1,2,2,1)(1,2,2,1)(1,2,2,1), and δb,b′=δb′\delta_{b,b'} = \delta_{b'}δb,b′​=δb′​ for b≠b′b \ne b'b=b′; staying on a buffer costs nothing.
  • A trajectory is a schedule of runs per machine (possibly finitely many, the last lasting forever), with only finitely many run starts in any bounded interval. Processing obeys a rate cap (yby_byb​ grows at most at rate 1/τb1/\tau_b1/τb​, and only while machine μb\mu_bμb​ is in a processing phase of bbb) and runs at full rate while the buffer is nonempty.
  • In Definition 1, a target buffer counts as "nonempty" when it is demanding: positive level, or inflow starting at that instant. The no-early-exit condition is imposed on the open processing interval. Under the literal reading (positive level) or a closed interval, the paper's own trajectories are not clearing, and the goal would hold vacuously; the existence clause in the goal rules out that trivialization.
  • "Set up for buffer bbb at time TTT" means the run in force on (sk,sk+1](s_k, s_{k+1}](sk​,sk+1​].
  • Unboundedness is stated for buffer 1: for every CCC there is t≥0t \ge 0t≥0 with x1(t)>Cx_1(t) > Cx1​(t)>C; "ξ\xiξ large enough" is ∃ξ0,∀ξ≥ξ0\exists \xi_0, \forall \xi \ge \xi_0∃ξ0​,∀ξ≥ξ0​.

Useful contributions include lemmas about fluid trajectories that do not depend on the example (continuity of levels, the pass-through rate on an empty buffer, restarting a trajectory at a run boundary), which also serve the other missions of the series.

Selected references

  • P. R. Kumar and T. I. Seidman, Dynamic instabilities and stabilization methods in distributed real-time scheduling of manufacturing systems, IEEE Trans. Automat. Control 35(3), 289–298, 1990. https://doi.org/10.1109/9.50339
  • J. R. Perkins and P. R. Kumar, Stable, distributed, real-time scheduling of flexible manufacturing/assembly/disassembly systems, IEEE Trans. Automat. Control 34, 139–148, 1989 (reference [18] of the paper).
  • S. H. Lu and P. R. Kumar, Distributed scheduling based on due dates and buffer priorities, IEEE Trans. Automat. Control 36, 1991.
7 thms1 active userReviewed
Geometry & TopologySymplectic Geometry·Captain: Mazecto

Hryniewicz's Criterion: Disk-like Global Sections of Dynamically Convex Reeb Flows on S³Research Paper

Motivation

A global surface of section reduces a flow on a closed 3-manifold to an area-preserving map of a surface. It is a compact embedded surface whose boundary consists of periodic orbits, whose interior is transverse to the flow, and which every other trajectory hits infinitely often in forward and backward time. Poincaré introduced the idea for the restricted three-body problem. Once a section is a disk, results on area-preserving disk maps (Brouwer, Franks) give periodic orbits and other structure for the whole flow.

For Hamiltonian flows on star-shaped energy surfaces in R4\mathbb{R}^4R4, equivalently Reeb flows on the tight 3-sphere, it is natural to ask which periodic orbits bound such a disk. Hryniewicz's criterion answers this for dynamically convex flows, with no genericity assumption. The answer is purely topological: a periodic orbit bounds a disk-like global section exactly when it is unknotted with self-linking number −1-1−1. The criterion is used in celestial mechanics: Joung and van Koert apply it to validated periodic orbits of the restricted three-body problem (arXiv:2407.19159).

Timeline.

  • 1998. Hofer, Wysocki and Zehnder prove that every dynamically convex contact form on S3S^3S3 has some periodic orbit P0P_0P0​, with Conley–Zehnder index 333, that bounds a disk-like global section. That disk is a page of an open book adapted to the flow. Strictly convex energy surfaces in R4\mathbb{R}^4R4 are dynamically convex (Ann. of Math. 148).
  • 2008/2012. Hryniewicz proves the "unknotted, self-linking −1-1−1" characterization in the non-degenerate case (arXiv:0812.4076).
  • 2010/2011. Hryniewicz and Salomão treat non-degenerate tight contact forms on S3S^3S3. Two extra conditions appear there: μCZ≥3\mu_{CZ}\ge 3μCZ​≥3, and linking with every orbit of index 222 (arXiv:1006.0049).
  • 2011/2014. Hryniewicz removes non-degeneracy for dynamically convex forms (arXiv:1105.2077, Theorem 1.7). In the same paper, Theorem 1.8 shows that any orbit coming from a fixed point of the first-return map of a disk-like section is again such a binding.
  • 2012. Albers, Fish, Frauenfelder, Hofer and van Koert use this circle of ideas to get disk-like sections in the planar circular restricted three-body problem (arXiv:1103.3881).

Setting

Use coordinates x=(q1,p1,q2,p2)x=(q_1,p_1,q_2,p_2)x=(q1​,p1​,q2​,p2​) on R4\mathbb{R}^4R4, the Liouville form λ0=12∑j(qj dpj−pj dqj)\lambda_0=\tfrac12\sum_j (q_j\,dp_j-p_j\,dq_j)λ0​=21​∑j​(qj​dpj​−pj​dqj​) and the symplectic form ω0=dλ0=∑jdqj∧dpj\omega_0=d\lambda_0=\sum_j dq_j\wedge dp_jω0​=dλ0​=∑j​dqj​∧dpj​.

Let H:R4→RH:\mathbb{R}^4\to\mathbb{R}H:R4→R be smooth and set S=H−1(1)S=H^{-1}(1)S=H−1(1). Assume that every ray from the origin meets SSS exactly once, and that it crosses SSS transversally:

dH(x) x>0(x∈S).dH(x)\,x>0\qquad(x\in S).dH(x)x>0(x∈S).

Then SSS is a strictly star-shaped hypersurface diffeomorphic to S3S^3S3. Every contact form on S3S^3S3 that matters below arises this way, up to diffeomorphism (see Formalization scope).

The Hamiltonian vector field XHX_HXH​ is defined by ιXHω0=−dH\iota_{X_H}\omega_0=-dHιXH​​ω0​=−dH. With this sign, λ0(XH)=12 dH(x) x>0\lambda_0(X_H)=\tfrac12\,dH(x)\,x>0λ0​(XH​)=21​dH(x)x>0 on SSS. So XH∣SX_H|_SXH​∣S​ is a positive multiple of the Reeb vector field of the contact form λ0∣S\lambda_0|_Sλ0​∣S​, and its orbits are the Reeb orbits reparametrized. A periodic orbit P=(x,T)P=(x,T)P=(x,T) is a solution with x(T)=x(0)x(T)=x(0)x(T)=x(0) and T>0T>0T>0. It is prime when TTT is its least positive period. The contact structure is ξ=ker⁡λ0∣S\xi=\ker\lambda_0|_Sξ=kerλ0​∣S​.

  • Conley–Zehnder index. Fix the global frame of ξ\xiξ given by the quaternionic rotations of ∇H\nabla H∇H. Along PPP, the linearized flow restricted to ξ\xiξ is a path φ:[0,1]→Sp(1)\varphi:[0,1]\to Sp(1)φ:[0,1]→Sp(1) with φ(0)=I\varphi(0)=Iφ(0)=I. The winding interval I(φ)I(\varphi)I(φ) collects the total rotations of all nonzero vectors, measured in turns. Then μCZ(P)\mu_{CZ}(P)μCZ​(P) is the lower semicontinuous index of Hryniewicz's §2.1.1. In particular,
μCZ(P)≥3  ⟺  min⁡I(φ)>1,\mu_{CZ}(P)\ge 3 \iff \min I(\varphi)>1,μCZ​(P)≥3⟺minI(φ)>1,

that is, every nonzero transverse vector turns by more than one full turn.

  • Dynamical convexity. The flow is dynamically convex if μCZ(P)≥3\mu_{CZ}(P)\ge 3μCZ​(P)≥3 for every periodic orbit PPP in SSS, prime or multiply covered.
  • Disk-like global surface of section. A smoothly embedded closed disk D⊂SD\subset SD⊂S such that ∂D=x(R)\partial D=x(\mathbb{R})∂D=x(R) for a periodic orbit PPP, XHX_HXH​ is transverse to D∖∂DD\setminus\partial DD∖∂D, and every trajectory not contained in ∂D\partial D∂D meets DDD at arbitrarily large positive and negative times. Then PPP bounds DDD.
  • Unknotted. PPP is unknotted if x(R)x(\mathbb{R})x(R) is the boundary of some smoothly embedded closed disk in SSS.
  • Self-linking number. Push xxx off itself along the global frame of ξ\xiξ to a disjoint loop x′x'x′. Then
sl⁡(P)=lk⁡(x,x′)∈Z,\operatorname{sl}(P)=\operatorname{lk}(x,x')\in\mathbb{Z},sl(P)=lk(x,x′)∈Z,

the linking number in S≅S3S\cong S^3S≅S3, with SSS oriented as the boundary of the star-shaped domain it bounds. This agrees with Hryniewicz's Definition 1.5, which uses a section of ξ\xiξ over a spanning disk.

Formalization targets

Goal: Hryniewicz's criterion (Theorem 1.7, first sentence)

For every dynamically convex strictly star-shaped SSS and every prime periodic orbit Pˉ\bar PPˉ:

Pˉ bounds a disk-like global surface of section  ⟺  Pˉ is unknotted and sl⁡(Pˉ)=−1.\bar P \text{ bounds a disk-like global surface of section} \iff \bar P \text{ is unknotted and } \operatorname{sl}(\bar P)=-1.Pˉ bounds a disk-like global surface of section⟺Pˉ is unknotted and sl(Pˉ)=−1.

The statement fixes no constants and no non-degeneracy, and it covers every dynamically convex star-shaped surface.

Stronger: adapted open book (Theorem 1.7, second sentence)

If Pˉ\bar PPˉ is unknotted with sl⁡(Pˉ)=−1\operatorname{sl}(\bar P)=-1sl(Pˉ)=−1, then S∖xˉ(R)S\setminus \bar x(\mathbb{R})S∖xˉ(R) fibres smoothly over R/Z\mathbb{R}/\mathbb{Z}R/Z. Every fibre is the interior of a disk-like global surface of section whose oriented boundary is Pˉ\bar PPˉ.

Further: new bindings from fixed points (Theorem 1.8)

Let D0D_0D0​ be any disk-like global section. Every periodic orbit through a fixed point of the first-return map of D0∖∂D0D_0\setminus\partial D_0D0​∖∂D0​ is unknotted, has self-linking number −1-1−1, and so bounds the page of an adapted open book.

Significance

The result. The criterion turns a dynamical question into a topological check. It does not depend on whether the orbit is degenerate, and degenerate orbits are what one meets at bifurcations and on symmetric levels. Every periodic orbit in a strictly convex energy surface that is unknotted with sl⁡=−1\operatorname{sl}=-1sl=−1 is a binding, so the flow is organised by many open books at once. Theorem 1.8 makes this concrete: the Hamiltonian flow twists around two different bindings, ∂D0\partial D_0∂D0​ and ∂D1\partial D_1∂D1​. In applications, numerically validated orbits become analytic global sections without a separate non-degeneracy check (Joung–van Koert, Theorems 1.2 and 1.5).

Formalizing it. The theorem is proved, in a 50-page paper that relies on Hofer–Wysocki–Zehnder's theory of pseudo-holomorphic curves in symplectizations. It has no machine-checked proof. Mathlib has no Conley–Zehnder index, no self-linking number, no linking number of curves in S3S^3S3, and no global surfaces of section. A Lean statement fixes every sign and orientation convention involved: the sign of XHX_HXH​, the orientation of SSS, which push-off defines sl⁡\operatorname{sl}sl, and the index of degenerate orbits. Each of these is easy to get wrong in prose. Formal proofs of the parts that use no holomorphic curves are valuable on their own: the necessity direction, the description of the index by winding intervals, and the explicit ellipsoid examples.

Difficulty

The obvious route is to approximate the contact form by non-degenerate forms λk→λ\lambda_k\to\lambdaλk​→λ that keep Pˉ\bar PPˉ as an orbit, and then apply the non-degenerate theorems. This fails. The λk\lambda_kλk​ need not be dynamically convex. They can have orbits of very high action with μCZ=2\mu_{CZ}=2μCZ​=2 that are not linked with Pˉ\bar PPˉ, so the Hryniewicz–Salomão criterion does not apply to λk\lambda_kλk​ (Hryniewicz, p. 4). The families of planes that would give the pages for λk\lambda_kλk​ have to be controlled directly as k→∞k\to\inftyk→∞, and this is not a formal limit argument.

A second obstruction is genuinely global. A disk spanning Pˉ\bar PPˉ and transverse to the flow in its interior is easy to produce when sl⁡(Pˉ)=−1\operatorname{sl}(\bar P)=-1sl(Pˉ)=−1. Showing that every trajectory returns to it is the whole content of the theorem, and no local or perturbative argument gives it.

For the formalization, nothing in the proof of sufficiency avoids finite-energy pseudo-holomorphic planes: Fredholm theory, asymptotic analysis, bubbling-off and compactness all enter. None of this exists in Lean.

Formalization scope

  • Ambient space. R4\mathbb{R}^4R4 is Fin 4 → ℝ with coordinates ordered (q1,p1,q2,p2)(q_1,p_1,q_2,p_2)(q1​,p1​,q2​,p2​). λ0\lambda_0λ0​, ω0\omega_0ω0​ and XHX_HXH​ are defined explicitly, with the sign conventions above.
  • Energy surfaces. Star-shaped surfaces are smooth (ContDiff ℝ ⊤) functions HHH with the ray condition and dH(x)x>0dH(x)x>0dH(x)x>0 on H−1(1)H^{-1}(1)H−1(1). The Reeb flow of a general dynamically convex form on S3S^3S3 reduces to this case, up to diffeomorphism and positive time change: such a form is tight (Hofer–Wysocki–Zehnder), and every tight form on S3S^3S3 comes from a star-shaped hypersurface (Eliashberg 1992). That reduction is not part of the targets. Hryniewicz makes the same reduction (§3, first paragraph).
  • Flow. The flow is the flow of XHX_HXH​, not of the Reeb field. All notions in the targets are invariant under positive time change. Periodic orbits are solutions of x˙=XH(x)\dot x=X_H(x)x˙=XH​(x) on all of R\mathbb{R}R. "Prime" means the recorded period is least.
  • Index. μCZ≥3\mu_{CZ}\ge 3μCZ​≥3 is encoded by the winding-interval condition in the global quaternionic frame, with degenerate orbits included. Multiply covered orbits are included in dynamical convexity.
  • Disks. Disks are smooth embeddings of the closed unit disk (injective, with injective differential up to the boundary). The return condition demands hits at arbitrarily large positive and negative times.
  • Ruling out vacuous encodings. A version without the two-sided return condition, with a dynamical-convexity predicate that no surface satisfies, or with sl⁡\operatorname{sl}sl that is not a linking number of the push-off, proves a different theorem. The ellipsoid milestone below is a non-vacuity check on the definitions.
  • Infrastructure. A complete development needs the following.
    • Reusable beyond this mission: the Conley–Zehnder index of paths in Sp(1)Sp(1)Sp(1), the linking number of disjoint loops in S3S^3S3 (or in R3\mathbb{R}^3R3 after stereographic projection), and global flows of vector fields on compact level sets.
    • Specific to this proof: contact topology of spanning disks (characteristic foliations, elimination of singularities), and finite-energy planes in R×S3\mathbb{R}\times S^3R×S3 with their Fredholm, asymptotic and compactness theory.
  • Contributions welcome. The definition layer, the index and linking-number libraries, the ellipsoid examples, Lemma 2.1, the necessity direction, Lemma 3.12, and any sub-step of the holomorphic-curve argument stated as an independent lemma.

Selected references

  • H. Hofer, K. Wysocki, E. Zehnder, The dynamics on three-dimensional strictly convex energy surfaces, Ann. of Math. 148 (1998), 197–289. https://doi.org/10.2307/120994
  • U. L. Hryniewicz, Fast finite-energy planes in symplectizations and applications, Trans. Amer. Math. Soc. 364 (2012), 1859–1931. https://arxiv.org/abs/0812.4076
  • U. L. Hryniewicz, P. A. S. Salomão, On the existence of disk-like global sections for Reeb flows on the tight 3-sphere, Duke Math. J. 160 (2011), 415–465. https://arxiv.org/abs/1006.0049
  • U. L. Hryniewicz, Systems of global surfaces of section for dynamically convex Reeb flows on the 3-sphere, J. Symplectic Geom. 12 (2014), 791–862. https://arxiv.org/abs/1105.2077
  • U. L. Hryniewicz, P. A. S. Salomão, Global surfaces of section for Reeb flows in dimension three and beyond, Proc. ICM 2018 (extended version). https://arxiv.org/abs/1712.01925
  • P. Albers, J. W. Fish, U. Frauenfelder, H. Hofer, O. van Koert, Global surfaces of section in the planar restricted 3-body problem, Arch. Ration. Mech. Anal. 204 (2012), 273–284. https://arxiv.org/abs/1103.3881
  • C. Joung, O. van Koert, Computational symplectic topology and symmetric orbits in the restricted three-body problem, Nonlinearity 38 (2025), 025015. https://arxiv.org/abs/2407.19159
  • Y. Eliashberg, Contact 3-manifolds twenty years since J. Martinet's work, Ann. Inst. Fourier 42 (1992), 165–192. https://doi.org/10.5802/aif.1288
39 thms1 active userReviewed
AnalysisOperations ResearchOptimization·Captain: mikedeng1

The Łojasiewicz Inequality for Nonsmooth Subanalytic Functions with Applications to Subgradient Dynamical Systems III: Bounded Subgradient Trajectories Converge with Łojasiewicz RatesResearch Paper

Motivation

Many optimization algorithms are discretizations of a continuous-time descent: the gradient flow x˙=−∇f(x)\dot x=-\nabla f(x)x˙=−∇f(x) for smooth objectives, and its nonsmooth analogue, the subgradient dynamical system, for objectives with kinks or constraints. A basic question about such a flow is whether a bounded trajectory actually converges, rather than merely accumulating on a continuum of critical points, and how fast. For real-analytic fff this was settled by Łojasiewicz through his gradient inequality, which forces bounded gradient trajectories to have finite length. Without some such structure the answer is negative: there are smooth functions whose bounded gradient trajectories spiral forever around a circle of critical points.

Bolte, Daniilidis and Lewis (SIAM J. Optim. 17 (2007) 1205–1223) extended the Łojasiewicz inequality to nonsmooth subanalytic functions, possibly taking the value +∞+\infty+∞, by replacing ∥∇f∥\|\nabla f\|∥∇f∥ with the least norm of a limiting subgradient. Section 4 of the paper turns this inequality into convergence results for subgradient trajectories of convex and lower-C2C^2C2 functions. This mission formalizes that section. The same "Łojasiewicz argument" later became the Kurdyka–Łojasiewicz framework behind convergence proofs for proximal, alternating and splitting algorithms (Attouch–Bolte 2009; Bolte–Sabach–Teboulle 2014).

Timeline. Łojasiewicz (1963, 1984) proved the gradient inequality for real-analytic functions and finite length of bounded analytic gradient trajectories. Kurdyka (Ann. Inst. Fourier 1998) extended it to C1C^1C1 functions definable in an o-minimal structure. Kurdyka, Mostowski and Parusiński (2000) proved Thom's gradient conjecture for analytic functions. Bolte, Daniilidis and Lewis (2007) gave the nonsmooth subanalytic version and the trajectory results formalized here.

Setting

Let f:Rn→R∪{+∞}f:\mathbb R^n\to\mathbb R\cup\{+\infty\}f:Rn→R∪{+∞} with domain dom⁡f={x:f(x)<+∞}\operatorname{dom} f=\{x: f(x)<+\infty\}domf={x:f(x)<+∞}. The Fréchet subdifferential ∂^f(x)\hat\partial f(x)∂^f(x) is the set of x∗x^*x∗ with lim inf⁡y→x, y≠x(f(y)−f(x)−⟨x∗,y−x⟩)/∥y−x∥≥0\liminf_{y\to x,\,y\neq x}\big(f(y)-f(x)-\langle x^*,y-x\rangle\big)/\|y-x\|\ge0liminfy→x,y=x​(f(y)−f(x)−⟨x∗,y−x⟩)/∥y−x∥≥0. The limiting subdifferential ∂f(x)\partial f(x)∂f(x) is the set of limits of xk∗∈∂^f(xk)x_k^*\in\hat\partial f(x_k)xk∗​∈∂^f(xk​) with xk→xx_k\to xxk​→x and f(xk)→f(x)f(x_k)\to f(x)f(xk​)→f(x). The nonsmooth slope is mf(x)=inf⁡{∥x∗∥:x∗∈∂f(x)}m_f(x)=\inf\{\|x^*\|: x^*\in\partial f(x)\}mf​(x)=inf{∥x∗∥:x∗∈∂f(x)}, equal to +∞+\infty+∞ when ∂f(x)=∅\partial f(x)=\emptyset∂f(x)=∅, and crit⁡f={x:0∈∂f(x)}\operatorname{crit} f=\{x: 0\in\partial f(x)\}critf={x:0∈∂f(x)} is the set of critical points.

The standing assumptions of Section 4 are:

  • (H1)(\mathcal H1)(H1) fff is either lower semicontinuous and convex, or lower-C2C^2C2 with dom⁡f=Rn\operatorname{dom} f=\mathbb R^ndomf=Rn. Lower-C2C^2C2 means that near each point f=max⁡s∈SF(⋅,s)f=\max_{s\in S}F(\cdot,s)f=maxs∈S​F(⋅,s) for a compact space SSS and a jointly continuous FFF with jointly continuous first and second xxx-derivatives.
  • (H2)(\mathcal H2)(H2) fff is somewhere finite and bounded from below.
  • (H3)(\mathcal H3)(H3) fff is subanalytic: its graph is locally the projection of a bounded set defined by finitely many real-analytic equalities and strict inequalities.

A trajectory of the subgradient system (G)(\mathcal G)(G) is an absolutely continuous curve x:[0,T)→Rnx:[0,T)\to\mathbb R^nx:[0,T)→Rn, T∈(0,+∞]T\in(0,+\infty]T∈(0,+∞], with x˙(t)+∂f(x(t))∋0\dot x(t)+\partial f(x(t))\ni0x˙(t)+∂f(x(t))∋0 for almost every ttt and ∂f(x(t))≠∅\partial f(x(t))\neq\emptyset∂f(x(t))=∅ for every ttt. It is maximal if it admits no extension to a longer interval. The Łojasiewicz inequality holds around aaa with exponent θ\thetaθ if ∣f−f(a)∣θ/mf|f-f(a)|^\theta/m_f∣f−f(a)∣θ/mf​ is bounded near aaa, with 00=10^0=100=1 and ∞/∞=0/0=0\infty/\infty=0/0=0∞/∞=0/0=0. A Łojasiewicz exponent at a∈dom⁡fa\in\operatorname{dom} fa∈domf is any such θ∈[0,1)\theta\in[0,1)θ∈[0,1).

Formalization targets

Goal: Theorem 4.7

Under (H1)(\mathcal H1)(H1)–(H3)(\mathcal H3)(H3), every bounded maximal trajectory xxx is defined on [0,+∞)[0,+\infty)[0,+∞) and converges to a critical point aaa. For every Łojasiewicz exponent θ\thetaθ at aaa there are k,k′>0k,k'>0k,k′>0 and t0≥0t_0\ge0t0​≥0 such that for t≥t0t\ge t_0t≥t0​

∥x(t)−a∥≤{k (t+1)−1−θ2θ−1,θ∈(12,1),k e−k′t,θ=12,\|x(t)-a\|\le \begin{cases} k\,(t+1)^{-\frac{1-\theta}{2\theta-1}}, & \theta\in(\tfrac12,1),\\[2pt] k\,e^{-k't}, & \theta=\tfrac12,\end{cases}∥x(t)−a∥≤{k(t+1)−2θ−11−θ​,ke−k′t,​θ∈(21​,1),θ=21​,​

and for θ∈[0,12)\theta\in[0,\tfrac12)θ∈[0,21​), x(t)=ax(t)=ax(t)=a for all large ttt. The constants are existential, so the goal survives any later sharpening of them.

Milestones

  1. Corollary 4.1(i): for almost every ttt, ddtf(x(t))=⟨x˙(t),x∗⟩\frac{d}{dt}f(x(t))=\langle\dot x(t),x^*\rangledtd​f(x(t))=⟨x˙(t),x∗⟩ for every x∗∈∂f(x(t))x^*\in\partial f(x(t))x∗∈∂f(x(t)).
  2. Corollary 4.1(iii): every trajectory extends to a maximal one on [0,+∞)[0,+\infty)[0,+∞) with x˙∈L2\dot x\in L^2x˙∈L2.
  3. Corollary 4.2: ∥x˙(t)∥=mf(x(t))\|\dot x(t)\|=m_f(x(t))∥x˙(t)∥=mf​(x(t)) and ddtf(x(t))=−mf(x(t))2\frac{d}{dt}f(x(t))=-m_f(x(t))^2dtd​f(x(t))=−mf​(x(t))2 almost everywhere.
  4. Inequality (20): the Łojasiewicz inequality holds around every point of dom⁡∂f\operatorname{dom}\partial fdom∂f.
  5. Theorem 4.5: bounded maximal trajectories have finite length ∫0∞∥x˙∥<∞\int_0^\infty\|\dot x\|<\infty∫0∞​∥x˙∥<∞ and converge to a critical point.
  6. The tail bound ∫t∞∥x˙∥≤c1−θ(f(x(t))−f(a))1−θ\int_t^\infty\|\dot x\|\le\frac{c}{1-\theta}(f(x(t))-f(a))^{1-\theta}∫t∞​∥x˙∥≤1−θc​(f(x(t))−f(a))1−θ.
  7. Inequality (27): ∫t∞∥x˙∥≤c1/θ1−θ∥x˙(t)∥(1−θ)/θ\int_t^\infty\|\dot x\|\le\frac{c^{1/\theta}}{1-\theta}\|\dot x(t)\|^{(1-\theta)/\theta}∫t∞​∥x˙∥≤1−θc1/θ​∥x˙(t)∥(1−θ)/θ for almost every large ttt.

Significance

Theorem 4.5 says that for convex or lower-C2C^2C2 subanalytic objectives, including constrained problems through indicator functions of subanalytic sets, the subgradient flow never oscillates indefinitely: bounded trajectories converge to one critical point. Theorem 4.7 adds rates that depend only on the Łojasiewicz exponent at the limit: exponential at θ=12\theta=\tfrac12θ=21​, polynomial above it, finite time below it. These are continuous-time templates for the convergence analyses of proximal and splitting methods under the Kurdyka–Łojasiewicz property.

On the formalization side, the results are proved on paper but, to our knowledge, not formalized in any proof assistant. A development would provide reusable infrastructure: a Lean notion of a trajectory of a differential inclusion on [0,T)[0,T)[0,T), a chain rule for f∘xf\circ xf∘x along absolutely continuous curves, and a comparison lemma for the differential inequality σ˙≤−Lσα\dot\sigma\le-L\sigma^\alphaσ˙≤−Lσα. The analysis of Section 4 uses subanalyticity only through inequality (20), so Theorems 4.5 and 4.7 can be attacked with (20) as an imported milestone, independently of the subanalytic geometry.

Difficulty

Compactness gives cluster points of a bounded trajectory, and the decrease of fff gives convergence of f(x(t))f(x(t))f(x(t)). Neither gives convergence of x(t)x(t)x(t). The usual first idea, that ∫0∞∥x˙∥2<∞\int_0^\infty\|\dot x\|^2<\infty∫0∞​∥x˙∥2<∞ forces convergence, fails, since square-integrable speed allows infinite length. The difficulty is to control ∫∥x˙∥\int\|\dot x\|∫∥x˙∥ rather than ∫∥x˙∥2\int\|\dot x\|^2∫∥x˙∥2. That needs a lower bound on the slope in terms of the function gap near the cluster point, which is exactly what (20) supplies, plus a trapping argument showing the tail of the trajectory stays in the ball where (20) holds. In the nonsmooth setting the chain rule itself is nontrivial: f∘xf\circ xf∘x is differentiable almost everywhere with derivative ⟨x˙,x∗⟩\langle\dot x,x^*\rangle⟨x˙,x∗⟩ for every x∗∈∂f(x(t))x^*\in\partial f(x(t))x∗∈∂f(x(t)), which relies on ∂f=∂^f\partial f=\hat\partial f∂f=∂^f for convex and lower-C2C^2C2 functions. Global existence on [0,+∞)[0,+\infty)[0,+∞) (Corollary 4.1(iii)) must also be established before any asymptotic statement makes sense.

Formalization scope

Space Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n). Functions take values in EReal; "bounded from below" by a real number excludes −∞-\infty−∞. The limiting subdifferential is the published NonconvexSplitting.Shared.LimitingSubdiff, and convexity is the published MoreauProx.Characterization.EConvex (convex epigraph). The slope mfm_fmf​ is valued in [0,+∞][0,+\infty][0,+∞]. The Łojasiewicz inequality is encoded as ∣f(y)−f(a)∣θ≤C∥v∥|f(y)-f(a)|^\theta\le C\|v\|∣f(y)−f(a)∣θ≤C∥v∥ for yyy near aaa and every v∈∂f(y)v\in\partial f(y)v∈∂f(y), which is the bounded ratio under the paper's conventions. Times are real numbers and T∈[0,+∞]T\in[0,+\infty]T∈[0,+∞]. Curves are functions R→Rn\mathbb R\to\mathbb R^nR→Rn whose values outside [0,T)[0,T)[0,T) are irrelevant. "Absolutely continuous on [0,T)[0,T)[0,T)" means absolutely continuous on every compact [0,b]⊆[0,T)[0,b]\subseteq[0,T)[0,b]⊆[0,T). Velocities appear only "for almost every ttt". Lengths are lower Lebesgue integrals ∫−∥x˙∥\int^-\|\dot x\|∫−∥x˙∥ in [0,+∞][0,+\infty][0,+∞], never Bochner integrals (which would vanish for a non-integrable speed).

Two trivializations are ruled out. Maximality is a hypothesis and T=+∞T=+\inftyT=+∞ is a conclusion: assuming T=+∞T=+\inftyT=+∞ would narrow the theorem, and dropping maximality would make it false. Rates are claimed for every Łojasiewicz exponent at the limit, not for one chosen exponent. Corollary 4.1(iii) is stated as "defined on R+\mathbb R_+R+​ with x^˙∈L2\dot{\hat x}\in L^2x^˙∈L2", because the printed x^∈W1,2(R+)\hat x\in W^{1,2}(\mathbb R_+)x^∈W1,2(R+​) would fail for any trajectory with nonzero limit.

Needed infrastructure: absolutely continuous curves and their a.e. derivatives (Mathlib's AbsolutelyContinuousOnInterval), chain rules for convex and lower-C2C^2C2 functions, existence and uniqueness for monotone differential inclusions (Brézis), and an ODE comparison principle. Contributions to any of these are reusable well beyond this mission.

Selected references

  • J. Bolte, A. Daniilidis, A. Lewis, The Łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems, SIAM J. Optim. 17(4) (2007) 1205–1223. https://doi.org/10.1137/050644641
  • H. Brézis, Opérateurs maximaux monotones et semi-groupes de contractions dans les espaces de Hilbert, North-Holland, 1973.
  • J.-P. Aubin, A. Cellina, Differential Inclusions, Springer, 1984. https://doi.org/10.1007/978-3-642-69512-4
  • R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 1998. https://doi.org/10.1007/978-3-642-02431-3
  • K. Kurdyka, On gradients of functions definable in o-minimal structures, Ann. Inst. Fourier 48 (1998) 769–783. https://doi.org/10.5802/aif.1638
  • H. Attouch, J. Bolte, On the convergence of the proximal algorithm for nonsmooth functions involving analytic features, Math. Program. 116 (2009) 5–16. https://doi.org/10.1007/s10107-007-0133-5
17 thms1 active userReviewed
Partial Differential Equations·Captain: shivm

Catalytic Reaction–Diffusion: Global Attraction of the Positive Equilibrium (AIM 416)Open Problem

Motivation

Nguyen and Tang study the irreversible catalytic network A+B→B+C\mathcal A+\mathcal B\to\mathcal B+\mathcal CA+B→B+C, B+C→A+B\mathcal B+\mathcal C\to\mathcal A+\mathcal BB+C→A+B, a simple reaction–diffusion system with both a positive and a boundary equilibrium (catalyst used up). They settle every mass regime but one and leave it as a conjecture (AIM problem 416).

Timeline. 2021: Fellner–Morgan–Tang give global classical solutions with uniform bounds. 2026: Nguyen–Tang prove convergence for M1<M2M_1<M_2M1​<M2​ and M1≥2M2M_1\ge2M_2M1​≥2M2​ and local results in between, conjecturing global attraction there.

Setting

On a bounded connected smooth domain Ω⊂Rn\Omega\subset\mathbb R^nΩ⊂Rn with ∣Ω∣=1|\Omega|=1∣Ω∣=1 and d1,d2,d3>0d_1,d_2,d_3>0d1​,d2​,d3​>0:

at−d1Δa=b(c−a),bt−d2Δb=b(c−a),ct−d3Δc=−b(c−a),a_t-d_1\Delta a=b(c-a),\quad b_t-d_2\Delta b=b(c-a),\quad c_t-d_3\Delta c=-b(c-a),at​−d1​Δa=b(c−a),bt​−d2​Δb=b(c−a),ct​−d3​Δc=−b(c−a),

with homogeneous Neumann conditions and strictly positive C2C^2C2 compatible initial data. The masses M1=∫Ω(a0+c0)M_1=\int_\Omega(a_0+c_0)M1​=∫Ω​(a0​+c0​), M2=∫Ω(b0+c0)M_2=\int_\Omega(b_0+c_0)M2​=∫Ω​(b0​+c0​) are conserved. The equilibria are the positive one (M12, M2−M12, M12)(\frac{M_1}2,\,M_2-\frac{M_1}2,\,\frac{M_1}2)(2M1​​,M2​−2M1​​,2M1​​) and the boundary one (M1−M2, 0, M2)(M_1-M_2,\,0,\,M_2)(M1​−M2​,0,M2​).

Formalization target

If M2≤M1<2M2M_2\le M_1<2M_2M2​≤M1​<2M2​, every classical solution converges uniformly on Ω\OmegaΩ to the positive equilibrium (no rate required).

Significance

This is the last open regime of Nguyen–Tang's stability analysis. Strict positivity is essential: with b0≡0b_0\equiv0b0​≡0 the solution stays away from the positive equilibrium.

Difficulty

For M1≥M2M_1\ge M_2M1​≥M2​ there is no positive lower bound on ∫Ωb\int_\Omega b∫Ω​b, so entropy dissipation can degenerate near the boundary equilibrium (b=0b=0b=0), and the local results do not exclude trajectories approaching it.

Formalization scope

Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n) and Δ\DeltaΔ is Mathlib's Laplacian. The domain is Ω={φ<0}\Omega=\{\varphi<0\}Ω={φ<0} for a C∞C^\inftyC∞ function φ\varphiφ with ∇φ≠0\nabla\varphi\ne0∇φ=0 on {φ=0}\{\varphi=0\}{φ=0}; the Neumann condition is the derivative within Ω‾\overline\OmegaΩ in the direction ∇φ\nabla\varphi∇φ. Solutions are continuous on [0,∞)×Ω‾[0,\infty)\times\overline\Omega[0,∞)×Ω and C1,2C^{1,2}C1,2 for t>0t>0t>0, and L∞L^\inftyL∞ convergence is TendstoUniformlyOn. The goal quantifies over classical solutions; their existence is proved in the literature (Fellner–Morgan–Tang; Nguyen–Tang, Theorem 2.1) but is not part of this statement.

Selected references

  • T. L. Nguyen, B. Q. Tang, Stability analysis of irreversible chemical reaction-diffusion systems with boundary equilibria, Z. Angew. Math. Phys. 77, 2026, 199. DOI
  • K. Fellner, J. Morgan, B. Q. Tang, Uniform-in-time bounds for quadratic reaction-diffusion systems with mass dissipation in higher dimensions, DCDS-S 14, 2021, 635–651. DOI
  • AIM open problems list, problem 416. github.com/MColbrook/AIM
5 thms1 active userReviewed
Analysis·Captain: mikedeng1

Ordinary Differential Equations and Dynamical Systems VIII: Stable Manifolds and the Hartman–Grobman TheoremTextbook

Motivation

The first step in analysing a nonlinear differential equation x˙=f(x)\dot x = f(x)x˙=f(x) near an equilibrium is usually to replace fff by its derivative there and study the linear system x˙=Ax\dot x = Axx˙=Ax, which can be solved explicitly. This step is justified only if the linearization predicts the qualitative behaviour of the nonlinear system correctly. The Hartman–Grobman theorem makes that precise. If no eigenvalue of AAA lies on the imaginary axis, then near the equilibrium the nonlinear flow is a continuous deformation of the linear flow etAe^{tA}etA. The phase portrait, including which solutions approach the equilibrium and which leave it, is the linear one up to a homeomorphism.

The theorem was proved independently by D. M. Grobman (1959) and P. Hartman (1960, Proc. AMS 11). C. Pugh gave the proof by a global contraction argument (1969, Amer. J. Math. 91) that most textbooks follow, including this one.

This mission formalizes the Hartman–Grobman part of Chapters 9 and 10 of Teschl, Ordinary Differential Equations and Dynamical Systems (AMS Graduate Studies in Mathematics 140, 2012; author's preliminary version): the linear stable and unstable subspaces, the conjugacy lemma for maps, and the theorem for flows and for maps.

Setting

Let n∈Nn \in \mathbb{N}n∈N and let AAA be a real n×nn \times nn×n matrix. Its eigenvalues αj\alpha_jαj​ are the complex numbers zzz with Av=zvAv = zvAv=zv for some nonzero v∈Cnv \in \mathbb{C}^nv∈Cn. For a set S⊆CS \subseteq \mathbb{C}S⊆C, the spectral subspace ES(A)⊆RnE_S(A) \subseteq \mathbb{R}^nES​(A)⊆Rn is the set of real vectors lying in the sum of the generalized eigenspaces Ker⁡(A−αj)aj\operatorname{Ker}(A - \alpha_j)^{a_j}Ker(A−αj​)aj​ with αj∈S\alpha_j \in Sαj​∈S, where aja_jaj​ is the algebraic multiplicity.

For the linear flow etAe^{tA}etA, the stable subspace is E+=E{Re⁡z<0}(A)E^+ = E_{\{\operatorname{Re} z < 0\}}(A)E+=E{Rez<0}​(A) and the unstable subspace is E−=E{Re⁡z>0}(A)E^- = E_{\{\operatorname{Re} z > 0\}}(A)E−=E{Rez>0}​(A). AAA is hyperbolic (for flows) if no eigenvalue has zero real part. For the linear map x↦Axx \mapsto Axx↦Ax, the contracting and expanding subspaces are E+(A)=E{∣z∣<1}(A)E^+(A) = E_{\{|z| < 1\}}(A)E+(A)=E{∣z∣<1}​(A) and E−(A)=E{∣z∣>1}(A)E^-(A) = E_{\{|z| > 1\}}(A)E−(A)=E{∣z∣>1}​(A), and AAA is hyperbolic (for maps) if no eigenvalue lies on the unit circle.

A vector field is a C1C^1C1 map f:M→Rnf : M \to \mathbb{R}^nf:M→Rn on an open set M⊆RnM \subseteq \mathbb{R}^nM⊆Rn. Its flow Φ(t,x)\Phi(t, x)Φ(t,x) is the maximal solution of x˙=f(x)\dot x = f(x)x˙=f(x), x(0)=xx(0) = xx(0)=x, defined for ttt in the maximal interval Ix∋0I_x \ni 0Ix​∋0. A point x0x_0x0​ with f(x0)=0f(x_0) = 0f(x0​)=0 is a fixed point. It is hyperbolic if the Jacobian matrix A=dfx0A = df_{x_0}A=dfx0​​ is hyperbolic. Two flows Φ,Ψ\Phi, \PsiΦ,Ψ are topologically conjugate if there is a homeomorphism ϕ\phiϕ of Rn\mathbb{R}^nRn with ϕ∘Φt=Ψt∘ϕ\phi \circ \Phi_t = \Psi_t \circ \phiϕ∘Φt​=Ψt​∘ϕ.

Formalization targets

Goal: Theorem 9.9 (Hartman–Grobman)

Let 0∈M0 \in M0∈M be a hyperbolic fixed point of the C1C^1C1 vector field fff, with A=df0A = df_0A=df0​ and flow Φ\PhiΦ. Then there are a homeomorphism ϕ(x)=x+h(x)\phi(x) = x + h(x)ϕ(x)=x+h(x) of Rn\mathbb{R}^nRn, with hhh bounded, and a neighborhood UUU of 000 such that

ϕ(etAx)=Φ(t,ϕ(x)),t∈Iϕ(x),\phi\big(e^{tA} x\big) = \Phi\big(t, \phi(x)\big), \qquad t \in I_{\phi(x)},ϕ(etAx)=Φ(t,ϕ(x)),t∈Iϕ(x)​,

for all xxx and ttt with esAx∈Ue^{sA}x \in UesAx∈U for every sss between 000 and ttt.

Milestones

In attack order:

  1. Theorem 9.2: E±E^\pmE± are invariant under etAe^{tA}etA and ∣etAx±∣≤Ce∓tα∣x±∣|e^{tA}x^\pm| \le C e^{\mp t\alpha}|x^\pm|∣etAx±∣≤Ce∓tα∣x±∣ for ±t≥0\pm t \ge 0±t≥0, for every α\alphaα below the relevant spectral gap.
  2. Lemma 9.7: for AAA invertible and hyperbolic for maps, a norm adapted to AAA, and bounded ggg with small Lipschitz constant, there is a unique bounded continuous hhh with
(id+h)∘A=(A+g)∘(id+h),(\mathrm{id} + h) \circ A = (A + g) \circ (\mathrm{id} + h),(id+h)∘A=(A+g)∘(id+h),

and id+h\mathrm{id} + hid+h is a homeomorphism when A+gA + gA+g is invertible. 3. Corollary 9.8: such a conjugating homeomorphism of the form identity plus bounded is unique. 4. Theorem 10.4 (Hartman–Grobman for maps): a C1C^1C1 local diffeomorphism with a hyperbolic fixed point 000 satisfies ϕ∘A=f∘ϕ\phi \circ A = f \circ \phiϕ∘A=f∘ϕ near 000, with A=df0A = df_0A=df0​. 5. Theorem 9.10: two hyperbolic linear flows whose stable and unstable subspaces have equal dimensions are topologically conjugate.

Significance

The result itself. Hartman–Grobman reduces the local topological classification of hyperbolic equilibria to linear algebra. Together with Theorem 9.10 it shows that, near a hyperbolic fixed point, a C1C^1C1 vector field is determined up to local topological conjugacy by two integers: the dimensions of the stable and unstable subspaces. In particular, stability and instability of a hyperbolic equilibrium can be read off the eigenvalues of the Jacobian.

Formalizing it. Mathlib has the matrix exponential, generalized eigenspaces and homeomorphisms. It has no hyperbolic splitting of a matrix, no conjugacy theory for flows or maps, and no local flow of an ODE with maximal intervals; none of these results has a machine-checked proof on this platform. The mission builds the linear hyperbolic layer (spectral subspaces with exponential rates), the functional-analytic conjugacy lemma, and the local theorems on top of them.

Difficulty

The naive idea is to conjugate the nonlinear flow to its linearization directly on a small ball. That fails because a small ball is not invariant: orbits of a saddle leave every neighborhood of the fixed point, and a conjugacy defined only on the ball cannot be propagated along them. The book's route first makes the problem global and then solves a functional equation. Solving it requires an operator-norm estimate on a space of bounded continuous functions, with a norm on Rn\mathbb{R}^nRn adapted to the hyperbolic splitting.

A second difficulty is passing from one time to all times. A conjugacy for the time-one map has to be upgraded to one for the whole flow, which needs a uniqueness statement (Corollary 9.8) and control of the derivative of the flow through the variational equation. Throughout, the flow is local, so every identity Φ(t,ϕ(x))=…\Phi(t, \phi(x)) = \dotsΦ(t,ϕ(x))=… also carries the claim that ttt lies in the maximal interval of ϕ(x)\phi(x)ϕ(x).

Formalization scope

The state space is Fin n → ℝ; matrices are Matrix (Fin n) (Fin n) ℝ, etAe^{tA}etA is NormedSpace.exp (t • A) acting by mulVec, and eigenvalues are those of the complexified matrix. The subspaces E±E^\pmE± are defined spectrally, exactly as the book's (9.2), with the book's sign convention (+++ is the stable or contracting side for both flows and maps). The flow is local and enters through IsMaximalFlow f M I Φ, the unique maximal integral curves on an open phase space MMM. No completeness is assumed.

Conventions and quantifier readings:

  • Smoothness. "Differentiable vector field" in Theorem 9.9 is read as C1C^1C1 on MMM, since the proof uses continuity of ∂f/∂x\partial f/\partial x∂f/∂x. "Local diffeomorphism" in Theorem 10.4 is read as C1C^1C1 with invertible derivative everywhere.
  • Local conjugacy. "In a sufficiently small neighborhood of 000" is made explicit as ∃ U∈N(0)\exists\, U \in \mathcal{N}(0)∃U∈N(0), chosen after ϕ\phiϕ. For flows, the identity is required along every linear orbit segment {esAx:s between 0 and t}\{e^{sA}x : s \text{ between } 0 \text{ and } t\}{esAx:s between 0 and t} contained in UUU, for both signs of ttt, together with t∈Iϕ(x)t \in I_{\phi(x)}t∈Iϕ(x)​. For maps, it is required for all x∈Ux \in Ux∈U.
  • Constants. "Some C>0C > 0C>0 depending on α\alphaα" (Theorem 9.2) is ∀α ∃C>0 ∀t ∀x\forall \alpha\ \exists C > 0\ \forall t\ \forall x∀α ∃C>0 ∀t ∀x.
  • Adapted norm. Lemma 9.7's "choose a norm such that α=max⁡(∥A−−1∥,∥A+∥)<1\alpha = \max(\|A_-^{-1}\|, \|A_+\|) < 1α=max(∥A−−1​∥,∥A+​∥)<1" is a norm NNN passed as a parameter, with the two operator bounds as hypotheses. The lemma also assumes that the projections onto E±E^\pmE± do not increase NNN. The book's proof uses this when it bounds ∥L−1∥≤2/(1−α)\|L^{-1}\| \le 2/(1-\alpha)∥L−1∥≤2/(1−α), and the norms it constructs satisfy it. This is the one hypothesis added to a printed statement.

A trivializing formalization is ruled out. The conjugacy at the single point 000, or at t=0t = 0t=0 only, holds for every ϕ\phiϕ (both sides are 000, respectively ϕ(x)\phi(x)ϕ(x)). The goal instead fixes ϕ\phiϕ and UUU first and requires the identity on every orbit segment inside UUU, with Φ\PhiΦ the maximal flow of fff rather than an arbitrary map.

Needed infrastructure:

  • the hyperbolic splitting Rn=E+⊕E−\mathbb{R}^n = E^+ \oplus E^-Rn=E+⊕E− with exponential estimates and adapted norms;
  • Neumann series and contraction arguments on the Banach space of bounded continuous functions;
  • smooth cut-off of the nonlinearity;
  • differentiability of the flow in the initial condition (variational equation) and Gronwall's inequality;
  • maximal solutions of C1C^1C1 ODEs.

The linear layer and the conjugacy lemma are reusable for the stable manifold theorem, for periodic orbits (Chapter 12) and for the horseshoe (Chapter 13). Standalone contributions of those layers are welcome.

Selected references

  • G. Teschl, Ordinary Differential Equations and Dynamical Systems, Graduate Studies in Mathematics 140, AMS, 2012; author's preliminary version, Chapters 9–10, pp. 253–290. https://www.mat.univie.ac.at/~gerald/ftp/book-ode/ode.pdf (published book: https://doi.org/10.1090/gsm/140)
  • P. Hartman, A lemma in the theory of structural stability of differential equations, Proceedings of the AMS 11 (1960), 610–620. https://doi.org/10.1090/S0002-9939-1960-0121542-7
  • D. M. Grobman, Homeomorphism of systems of differential equations, Doklady Akademii Nauk SSSR 128 (1959), 880–881.
  • C. C. Pugh, On a theorem of P. Hartman, American Journal of Mathematics 91 (1969), 363–367. https://doi.org/10.2307/2373513
11 thms1 active userReviewed
Analysis·Captain: mikedeng1

Ordinary Differential Equations and Dynamical Systems III: The Frobenius Method and Fuchs's TheoremTextbook

Motivation

Many linear differential equations of mathematical physics have coefficients with singular points. Examples are the Bessel equation z2u′′+zu′+(z2−ν2)u=0z^2u'' + zu' + (z^2 - \nu^2)u = 0z2u′′+zu′+(z2−ν2)u=0, which comes from separating variables in the Laplace and wave equations in cylindrical coordinates, and the Legendre, hypergeometric and confluent hypergeometric equations. Near a singular point the usual power-series method breaks down, and the practical question is how solutions behave as zzz approaches the singularity. Evaluating special functions, matching asymptotics and computing connection coefficients all depend on the answer.

For second-order equations the answer goes back to Lazarus Fuchs (Zur Theorie der linearen Differentialgleichungen mit veränderlichen Coefficienten, J. reine angew. Math. 66 (1866), 121–160, doi:10.1515/crll.1866.66.121) and to Georg Frobenius (Ueber die Integration der linearen Differentialgleichungen durch Reihen, J. reine angew. Math. 76 (1873), 214–235, doi:10.1515/crll.1873.76.214). Frobenius's generalized power-series ansatz u=zα∑jhjzju = z^\alpha \sum_j h_j z^ju=zα∑j​hj​zj is known as the Frobenius method. This mission follows Chapter 4 of G. Teschl, Ordinary Differential Equations and Dynamical Systems (AMS Graduate Studies in Mathematics 140, 2012, doi:10.1090/gsm/140), in the author's preliminary version.

Setting

All functions are complex-valued functions of a complex variable zzz, and derivatives are complex derivatives. The object is the second-order linear equation

u′′(z)+p(z) u′(z)+q(z) u(z)=0(4.20)u''(z) + p(z)\,u'(z) + q(z)\,u(z) = 0 \qquad (4.20)u′′(z)+p(z)u′(z)+q(z)u(z)=0(4.20)

near the point z=0z = 0z=0, where the coefficients may be singular. A function fff that is holomorphic on a punctured disc 0<∣z∣<r0 < |z| < r0<∣z∣<r has a pole of order at most kkk at 000 if zkf(z)z^k f(z)zkf(z) extends to a function analytic at 000. The point 000 is a regular singular point of (4.20) if ppp has a pole of order at most one and qqq a pole of order at most two there:

p(z)=1z∑j≥0pjzj,q(z)=1z2∑j≥0qjzj,∣z∣<R.(4.30)p(z) = \frac1z\sum_{j\ge0} p_j z^j, \qquad q(z) = \frac1{z^2}\sum_{j\ge0} q_j z^j, \qquad |z| < R. \qquad (4.30)p(z)=z1​j≥0∑​pj​zj,q(z)=z21​j≥0∑​qj​zj,∣z∣<R.(4.30)

In Lean these hypotheses are functions P,QP, QP,Q holomorphic on ∣z∣<R|z| < R∣z∣<R with zp(z)=P(z)zp(z) = P(z)zp(z)=P(z) and z2q(z)=Q(z)z^2q(z) = Q(z)z2q(z)=Q(z) for 0<∣z∣<R0 < |z| < R0<∣z∣<R. The general notion is TeschlODE.Frobenius.HasPoleOfOrderAtMost f k.

The indicial equation is α2+(p0−1)α+q0=0\alpha^2 + (p_0 - 1)\alpha + q_0 = 0α2+(p0​−1)α+q0​=0. Its roots, the characteristic exponents, are

α1,2=12(1−p0±(p0−1)2−4q0),(4.37)\alpha_{1,2} = \tfrac12\Big(1 - p_0 \pm \sqrt{(p_0-1)^2 - 4q_0}\Big), \qquad (4.37)α1,2​=21​(1−p0​±(p0​−1)2−4q0​​),(4.37)

where the square root is the principal branch, so that Re⁡α1≥Re⁡α2\operatorname{Re}\alpha_1 \ge \operatorname{Re}\alpha_2Reα1​≥Reα2​. In Lean they are charExponents p₀ q₀.

The functions zα=eαlog⁡zz^\alpha = e^{\alpha\log z}zα=eαlogz and log⁡z\log zlogz are single-valued only after a branch cut is chosen. As the book does, solutions are considered on the slit punctured disc {0<∣z∣<R}∖(−∞,0]\{0 < |z| < R\} \setminus (-\infty, 0]{0<∣z∣<R}∖(−∞,0] (slitDisc R), using the principal branches. A solution of (4.20) on an open set DDD is IsSolution p q D u. A fundamental system is a pair of solutions that are linearly independent over C\mathbb{C}C on DDD.

Formalization targets

Goal: Fuchs's theorem (Theorem 4.5)

Let 000 be a regular singular point as in (4.30), with P,QP, QP,Q holomorphic on ∣z∣<R|z| < R∣z∣<R, 0<R≤∞0 < R \le \infty0<R≤∞. Let α1,α2\alpha_1, \alpha_2α1​,α2​ be the characteristic exponents of p0=P(0)p_0 = P(0)p0​=P(0), q0=Q(0)q_0 = Q(0)q0​=Q(0). Then there are functions h1,h2h_1, h_2h1​,h2​, holomorphic on the whole disc ∣z∣<R|z| < R∣z∣<R with h1(0)=h2(0)=1h_1(0) = h_2(0) = 1h1​(0)=h2​(0)=1, such that on {0<∣z∣<R}∖(−∞,0]\{0<|z|<R\}\setminus(-\infty,0]{0<∣z∣<R}∖(−∞,0] the following holds.

  • Case 1. If α1−α2∉N0\alpha_1 - \alpha_2 \notin \mathbb{N}_0α1​−α2​∈/N0​, then uj(z)=zαjhj(z)u_j(z) = z^{\alpha_j}h_j(z)uj​(z)=zαj​hj​(z) for j=1,2j = 1, 2j=1,2 form a fundamental system.
  • Case 2. If α1−α2=m∈N0\alpha_1 - \alpha_2 = m \in \mathbb{N}_0α1​−α2​=m∈N0​, then for some c∈Cc \in \mathbb{C}c∈C, with c≠0c \ne 0c=0 when m=0m = 0m=0,
u1(z)=zα1h1(z),u2(z)=zα2h2(z)+clog⁡(z) u1(z)u_1(z) = z^{\alpha_1}h_1(z), \qquad u_2(z) = z^{\alpha_2}h_2(z) + c\log(z)\,u_1(z)u1​(z)=zα1​h1​(z),u2​(z)=zα2​h2​(z)+clog(z)u1​(z)

form a fundamental system.

The requirement that hjh_jhj​ be holomorphic on the full disc is the book's statement that the radius of convergence of hjh_jhj​ is at least the smaller of the radii of convergence of ppp and qqq.

Milestones

In attack order:

  1. Theorem 4.1. For fff analytic and bounded on the bidisc {∣z−z0∣<ε,∣w−w0∣<δ}\{|z-z_0|<\varepsilon, |w-w_0|<\delta\}{∣z−z0​∣<ε,∣w−w0​∣<δ} with M=sup⁡∣f∣M = \sup|f|M=sup∣f∣, the problem w′=f(z,w)w' = f(z,w)w′=f(z,w), w(z0)=w0w(z_0) = w_0w(z0​)=w0​ has a unique analytic solution on ∣z−z0∣<min⁡(ε,δ/M)|z - z_0| < \min(\varepsilon, \delta/M)∣z−z0​∣<min(ε,δ/M).
  2. Lemma 4.4. For ppp holomorphic on 0<∣z∣<R0<|z|<R0<∣z∣<R, the equation u′+p(z)u=0u' + p(z)u = 0u′+p(z)u=0 has a solution zαh(z)z^\alpha h(z)zαh(z) with hhh analytic at 000 and h(0)=1h(0) = 1h(0)=1 if and only if ppp has at most a first-order pole. In that case α=−lim⁡z→0zp(z)\alpha = -\lim_{z\to0} zp(z)α=−limz→0​zp(z), and hhh has radius of convergence at least RRR.
  3. Theorem 4.7. For AAA, bbb analytic on a simply connected domain Ω\OmegaΩ, the problem w′=A(z)w+b(z)w' = A(z)w + b(z)w′=A(z)w+b(z), w(z0)=w0w(z_0) = w_0w(z0​)=w0​ has a unique solution on all of Ω\OmegaΩ. Its power series at z0z_0z0​ converges on the largest disc about z0z_0z0​ contained in Ω\OmegaΩ.
  4. Theorem 4.6 (Fuchs, converse). For p,qp, qp,q holomorphic on a punctured disc, (4.20) has a fundamental system of the form in Theorem 4.5 if and only if ppp and zqzqzq have at most first-order poles.

Significance

Theorem 4.5 is the basic structural theorem for linear equations at a regular singular point. It determines the leading behaviour zαjz^{\alpha_j}zαj​ of each solution from two numbers read off the coefficients. It says exactly when a logarithm can occur, and it guarantees that the series part converges on the full disc on which the coefficients converge. Theorem 4.6 shows that the regular-singular hypothesis cannot be weakened. The series expansions of Bessel functions JνJ_\nuJν​, of Legendre functions and of the hypergeometric function F(a,b,c;z)F(a,b,c;z)F(a,b,c;z), and the logarithmic second solutions for integer order, are all instances of the theorem. The theorem is also the local ingredient of the classification of Fuchsian equations, including the Riemann PPP-symbol.

Mathlib has holomorphic functions, power series with radius of convergence, the principal complex power and logarithm, and a real-variable ODE layer. It has no complex-analytic existence theorem for differential equations and no Frobenius theory. The results here are classical and proved in the book, but to our knowledge none of them has a machine-checked proof. The platform has real-variable regular-singular estimates (the RegularSingular namespace), which are a different setting. A formal Theorem 4.5 would give a foundation for formal special-function theory, for example Bessel functions defined as solutions of their equation.

Difficulty

The formal power-series computation is mechanical: substitute zα∑hjzjz^\alpha\sum h_jz^jzα∑hj​zj, compare coefficients, and read off the indicial equation and a recursion for the hjh_jhj​. The difficulty is everything around it. First, the recursion for the second exponent breaks down exactly when α1−α2∈N0\alpha_1 - \alpha_2 \in \mathbb{N}_0α1​−α2​∈N0​, and the form of the second solution changes there. Whether a logarithm really appears depends on a compatibility condition that can go either way when m≥1m \ge 1m≥1. Second, the claim is about actual solutions on a slit domain, not formal series. This needs convergence estimates for the recursion and the principal branches of zαz^\alphazα and log⁡z\log zlogz. Third, the radius claim asks for convergence on the whole disc of the coefficients, not just on some small disc. Fourth, linear independence of the two solutions has to be proved on the slit domain.

Milestones 1 and 3 need the complex analogues of Picard iteration and analytic continuation, which Mathlib does not supply for differential equations.

Formalization scope

Namespace TeschlODE.Frobenius. Complex derivatives are HasDerivAt/deriv/DifferentiableAt ℂ, and holomorphy on a set is DifferentiableOn ℂ. Radii are ENNReal, so R=∞R = \inftyR=∞ is allowed. Discs are Metric.eball 0 R. Powers and logarithms are Mathlib's principal Complex.cpow and Complex.log, used only on slitDisc R = Metric.eball 0 R ∩ Complex.slitPlane. On the full punctured disc these functions are discontinuous along the negative axis, and the theorem would be false there. "Fundamental system" is linear independence over C\mathbb{C}C on the solution domain. Without independence Case 1 would hold trivially with u2=u1u_2 = u_1u2​=u1​. "α1−α2∈N0\alpha_1 - \alpha_2 \in \mathbb{N}_0α1​−α2​∈N0​" is ∃ m : ℕ, α₁ - α₂ = m. The book's "the constant ccc might be zero unless m=0m=0m=0" is the clause m=0⇒c≠0m = 0 \Rightarrow c \ne 0m=0⇒c=0.

Quantifier readings:

  • "Analytic near z=0z = 0z=0" is strengthened to holomorphic on the whole disc of radius RRR, as the book's radius claim asserts.
  • "Poles of order at most one and two" is given explicitly: P,QP, QP,Q holomorphic on ∣z∣<R|z|<R∣z∣<R with zp=Pzp = Pzp=P, z2q=Qz^2q = Qz2q=Q on 0<∣z∣<R0<|z|<R0<∣z∣<R.
  • In Theorem 4.1, the case M=0M = 0M=0 is read as ε0=ε\varepsilon_0 = \varepsilonε0​=ε. The supremum is over the nonempty bidisc, and a boundedness hypothesis is included.
  • In Lemma 4.4, "a solution of the form (4.29)" means one on some slit punctured disc of positive radius. The book's "the radii are the same" is corrected to "at least": h(z)=1−zh(z) = 1 - zh(z)=1−z, p(z)=1/(1−z)p(z) = 1/(1-z)p(z)=1/(1−z) is a counterexample to equality.
  • In Theorem 4.6, "as in the previous theorem" means the form (4.49) for some exponents and some ccc (Case 1 is c=0c = 0c=0), on some slit punctured disc of radius 0<ρ≤R0 < \rho \le R0<ρ≤R.
  • In Theorem 4.7, "simply connected domain" is IsOpen Ω together with SimplyConnectedSpace Ω. "The largest disc" has radius Metric.infEDist z₀ Ωᶜ.

The trivializing formalization, with the two solutions not required to be linearly independent or with hjh_jhj​ unconstrained away from 000, is ruled out by the independence clause and by requiring hjh_jhj​ to be holomorphic on the whole disc with hj(0)=1h_j(0) = 1hj​(0)=1.

A full development needs the following: the complex Picard iteration, analytic continuation along paths (the monodromy theorem), Cauchy-type estimates for recursively defined power series, and the calculus of zαz^\alphazα and log⁡z\log zlogz on the slit plane. The definitions slitDisc, IsSolution, charExponents and HasPoleOfOrderAtMost can be reused for the Bessel, Legendre and hypergeometric equations (Problems 4.5–4.18 of the book). Contributions such as a general complex-analytic ODE existence theorem are welcome.

Selected references

  • G. Teschl, Ordinary Differential Equations and Dynamical Systems, Graduate Studies in Mathematics 140, AMS, 2012, doi:10.1090/gsm/140; author's preliminary version, Chapter 4, mat.univie.ac.at/~gerald/ftp/book-ode/.
  • L. Fuchs, Zur Theorie der linearen Differentialgleichungen mit veränderlichen Coefficienten, J. reine angew. Math. 66 (1866), 121–160, doi:10.1515/crll.1866.66.121.
  • G. Frobenius, Ueber die Integration der linearen Differentialgleichungen durch Reihen, J. reine angew. Math. 76 (1873), 214–235, doi:10.1515/crll.1873.76.214.
  • E. L. Ince, Ordinary Differential Equations, Longmans, Green and Co., 1926 (Dover reprint 1956), Chapters XV–XVI.
9 thms1 active userReviewed
AnalysisControl Theory·Captain: mikedeng1

Stabilization for a Perturbed Chain of Integrators in Prescribed Time II: Fixed-Time and Prescribed-Time Stability of the Varying-Degree Homogeneous FeedbackResearch Paper

Motivation

Many control tasks come with a deadline: a consensus protocol or a regulation task must reach its target by a time fixed in advance, whatever the initial condition. Prescribed-time stabilization asks for a feedback law that brings every trajectory of a control system to the equilibrium by a user-chosen time TTT. The basic test case is the chain of integrators x1(n)=ux_1^{(n)}=ux1(n)​=u, the normal form of every single-input feedback-linearizable system.

Two routes to prescribed-time stabilization exist. Time-varying gains that blow up as t→Tt\to Tt→T (Song, Wang, Holloway and Krstić, Automatica 2017) are fragile under measurement noise. Fixed-time stabilization gives a settling time bounded uniformly over all initial conditions, and a time rescaling then turns the uniform bound into any prescribed TTT. Chitour, Ushirobira and Bouhemou (SIAM J. Control Optim. 2020) follow the second route with an explicit, continuous feedback. It combines Hong's backstepping homogeneous controller (Systems Control Lett. 2002) with a degree of homogeneity that depends on the state (Harmouche, Laghrouche, Chitour and Hamerlain, Int. J. Control 2017). A continuity device of Lopez-Ramirez, Efimov, Polyakov and Perruquetti (Int. J. Robust Nonlinear Control 2018) makes that degree a continuous function of the state. This mission formalizes the construction and its main results, §4.1–4.2 of the paper.

Setting

Fix n≥1n\ge1n≥1 and write x=(x1,…,xn)∈Rnx=(x_1,\dots,x_n)\in\mathbb R^nx=(x1​,…,xn​)∈Rn with the Euclidean norm. Let JnJ_nJn​ be the nnn-th Jordan block (Jnei=ei−1J_ne_i=e_{i-1}Jn​ei​=ei−1​, e0=0e_0=0e0​=0). The pure chain of integrators (31) is

x˙=Jnx+u en.\dot x=J_nx+u\,e_n .x˙=Jn​x+uen​.

For y∈Ry\in\mathbb Ry∈R and a>0a>0a>0 write ⌈y⌋a=sign⁡(y)∣y∣a\lceil y\rfloor^a=\operatorname{sign}(y)|y|^a⌈y⌋a=sign(y)∣y∣a. Given gains ℓ1,…,ℓn>0\ell_1,\dots,\ell_n>0ℓ1​,…,ℓn​>0 and κ∈[−12n,12n]\kappa\in[-\tfrac1{2n},\tfrac1{2n}]κ∈[−2n1​,2n1​], set rj=1+(j−1)κr_j=1+(j-1)\kapparj​=1+(j−1)κ and βj=(2+κ)/rj+1−1\beta_j=(2+\kappa)/r_{j+1}-1βj​=(2+κ)/rj+1​−1. Define v0=0v_0=0v0​=0 and

vj=−ℓj⌈⌈xj⌋βj−1−⌈vj−1⌋βj−1⌋rj+κrjβj−1.v_j=-\ell_j\Big\lceil\lceil x_j\rfloor^{\beta_{j-1}}-\lceil v_{j-1}\rfloor^{\beta_{j-1}}\Big\rfloor^{\frac{r_j+\kappa}{r_j\beta_{j-1}}} .vj​=−ℓj​⌈⌈xj​⌋βj−1​−⌈vj−1​⌋βj−1​⌋rj​βj−1​rj​+κ​.

The homogeneous feedback is ωκH(x)=vn(x)\omega^H_\kappa(x)=v_n(x)ωκH​(x)=vn​(x) (Definition 23). The associated Lyapunov function is

Vκ(x)=∑j=1n∣xj∣βj−1+1−∣vj−1∣βj−1+1βj−1+1−⌈vj−1⌋βj−1(xj−vj−1),V_\kappa(x)=\sum_{j=1}^n\frac{|x_j|^{\beta_{j-1}+1}-|v_{j-1}|^{\beta_{j-1}+1}}{\beta_{j-1}+1}-\lceil v_{j-1}\rfloor^{\beta_{j-1}}(x_j-v_{j-1}),Vκ​(x)=j=1∑n​βj−1​+1∣xj​∣βj−1​+1−∣vj−1​∣βj−1​+1​−⌈vj−1​⌋βj−1​(xj​−vj−1​),

and (36) is the decay inequality V˙κ≤−CVκ1+α(κ)\dot V_\kappa\le-CV_\kappa^{1+\alpha(\kappa)}V˙κ​≤−CVκ1+α(κ)​, with α(κ)=κ/(2+κ)\alpha(\kappa)=\kappa/(2+\kappa)α(κ)=κ/(2+κ) and one constant CCC for all κ\kappaκ in the range.

For m∈(0,1)m\in(0,1)m∈(0,1) and κ0∈(0,12n)\kappa_0\in(0,\tfrac1{2n})κ0​∈(0,2n1​), the state-dependent degree κ(x)\kappa(x)κ(x) of (49) equals κ0\kappa_0κ0​ where V0(x)>1+mV_0(x)>1+mV0​(x)>1+m and −κ0-\kappa_0−κ0​ where V0(x)<1−mV_0(x)<1-mV0​(x)<1−m, and it interpolates linearly in V0V_0V0​ in between. The closed-loop controller is ωκ(x)H(x)\omega^H_{\kappa(x)}(x)ωκ(x)H​(x). With B<aκ={Vκ<a}B^\kappa_{<a}=\{V_\kappa<a\}B<aκ​={Vκ​<a}, let r(m,κ0)r(m,\kappa_0)r(m,κ0​) be the largest rrr with B<rκ0⊆B<1+m0B^{\kappa_0}_{<r}\subseteq B^0_{<1+m}B<rκ0​​⊆B<1+m0​, and r(m,−κ0)r(m,-\kappa_0)r(m,−κ0​) the smallest rrr with B<r−κ0⊇B<1−m0B^{-\kappa_0}_{<r}\supseteq B^0_{<1-m}B<r−κ0​​⊇B<1−m0​. Set

T∗(m,κ0)=1C(r(m,κ0)−α(κ0)α(κ0)−2ln⁡(2m)+r(m,−κ0)−α(−κ0)−α(−κ0)).T^\ast(m,\kappa_0)=\frac1C\Big(\frac{r(m,\kappa_0)^{-\alpha(\kappa_0)}}{\alpha(\kappa_0)}-2\ln(2m)+\frac{r(m,-\kappa_0)^{-\alpha(-\kappa_0)}}{-\alpha(-\kappa_0)}\Big).T∗(m,κ0​)=C1​(α(κ0​)r(m,κ0​)−α(κ0​)​−2ln(2m)+−α(−κ0​)r(m,−κ0​)−α(−κ0​)​).

Finally Dλr=diag⁡(λn−i+1)D^{\mathbf r}_\lambda=\operatorname{diag}(\lambda^{n-i+1})Dλr​=diag(λn−i+1) is the dilation of (5).

A system is globally fixed-time stable with settling time at most TTT if the origin is an equilibrium, solutions exist from every initial state, it is Lyapunov stable, and every solution vanishes for all t≥Tt\ge Tt≥T (Definition 1 with Ω=Rn\Omega=\mathbb R^nΩ=Rn).

Formalization targets

Goal: Theorem 30 (p. 1038)

Let the gains and C>0C>0C>0 satisfy (36). There are m∈(0,1)m\in(0,1)m∈(0,1) and κ0∈(0,12n)\kappa_0\in(0,\tfrac1{2n})κ0​∈(0,2n1​) such that, for every T>0T>0T>0 and every λ>0\lambda>0λ>0 with

λ ≥ T∗(m,κ0)/T,\lambda\ \ge\ T^\ast(m,\kappa_0)/T,λ ≥ T∗(m,κ0​)/T,

the feedback u=ωκ(Dλrx)H(Dλrx)u=\omega^H_{\kappa(D^{\mathbf r}_\lambda x)}(D^{\mathbf r}_\lambda x)u=ωκ(Dλr​x)H​(Dλr​x) makes (31) globally fixed-time stable with settling time at most TTT.

Milestones

  • Proposition 24 (p. 1034): gains exist for which (36) holds uniformly in κ\kappaκ, VκV_\kappaVκ​ is C1C^1C1, positive definite and r(κ)\mathbf r(\kappa)r(κ)-homogeneous of degree 2+κ2+\kappa2+κ, and ωκH\omega^H_\kappaωκH​ is globally asymptotically stabilizing.
  • Lemma 31 (p. 1038): on the shell B1−m,1+mκB^\kappa_{1-m,1+m}B1−m,1+mκ​, ∣xj∣|x_j|∣xj​∣ and ∣vj∣|v_j|∣vj​∣ are bounded uniformly in κ\kappaκ.
  • Lemma 32 (p. 1039): on that shell, ∣ωκH−ω0H∣|\omega^H_\kappa-\omega^H_0|∣ωκH​−ω0H​∣ and ∣Vκ−V0∣|V_\kappa-V_0|∣Vκ​−V0​∣ are at most a constant times ∣κ∣min⁡(1,rn)|\kappa|^{\min(1,r_n)}∣κ∣min(1,rn​).
  • Proposition 33 (p. 1040): for every mmm there is κ0(m)>0\kappa_0(m)>0κ0​(m)>0 below which the closed loop is fixed-time stable, with an explicit settling-time bound that coincides with (52) for m≤(17−3)/4m\le(\sqrt{17}-3)/4m≤(17​−3)/4.
  • Theorem 28 (pp. 1036–1037): with an input gain b(t)∈[b‾,bˉ]b(t)\in[\underline b,\bar b]b(t)∈[b​,bˉ] and the feedback ωκ(x)H(x)/b‾\omega^H_{\kappa(x)}(x)/\underline bωκ(x)H​(x)/b​, the closed loop is globally fixed-time stable with settling time at most T∗(m,κ0)T^\ast(m,\kappa_0)T∗(m,κ0​).

Significance

The result gives a static, continuous state feedback for the chain of integrators with an explicit settling-time bound. It is robust to a bounded uncertain input gain, and the rescaled controller meets any prescribed deadline. Unlike time-varying designs, the gains stay bounded, which is what the paper's ISS analysis in §4.3 builds on. The constants in (52) are explicit in terms of CCC and the radii r(m,±κ0)r(m,\pm\kappa_0)r(m,±κ0​), so the rescaling factor λ\lambdaλ is computable.

The results are proved on paper; no machine-checked proof is known. A formalization would check the parameter bookkeeping of the construction: index shifts, exponents, the three-phase settling-time estimate, and the interplay of two different dilations. It would also produce reusable definitions of Carathéodory solutions and of finite-, fixed- and prescribed-time stability, which the platform does not yet have.

Difficulty

The obvious argument uses the Lyapunov function Vκ(x)V_{\kappa(x)}Vκ(x)​ for the varying-degree controller. That fails: κ\kappaκ depends on xxx, so Vκ(x)(x)V_{\kappa(x)}(x)Vκ(x)​(x) acquires a term from the derivative of κ\kappaκ. The proof instead handles three regions separately, with Vκ0V_{\kappa_0}Vκ0​​ outside B1+m0B^0_{1+m}B1+m0​, V0V_0V0​ on the shell B1−m,1+m0B^0_{1-m,1+m}B1−m,1+m0​, and V−κ0V_{-\kappa_0}V−κ0​​ inside B1−m0B^0_{1-m}B1−m0​. On the shell the controller is a perturbation of the linear one, and bounding that perturbation needs uniform Hölder estimates in κ\kappaκ (Lemmas 31–32). The closed loop is only continuous, so solutions need not be unique and every stability claim is about all solutions. Proposition 24 itself is a recursive gain construction whose constants must be uniform in κ\kappaκ.

Formalization scope

States are EuclideanSpace ℝ (Fin n); the paper's index j∈{1,…,n}j\in\{1,\dots,n\}j∈{1,…,n} is j.val + 1. Solutions are Carathéodory solutions on [0,∞)[0,\infty)[0,∞) in integral form, with integrability stated. Every stability property quantifies over all solutions, and existence of a solution from each initial state is part of Lyapunov stability. ⌈y⌋a\lceil y\rfloor^a⌈y⌋a is read as sign⁡(y)∣y∣a\operatorname{sign}(y)|y|^asign(y)∣y∣a; the paper never defines it. V˙\dot VV˙ is the Fréchet derivative applied to the vector field. r(m,κ0)r(m,\kappa_0)r(m,κ0​) and r(m,−κ0)r(m,-\kappa_0)r(m,−κ0​) are the supremum and infimum of the admissible radii.

Hypotheses and readings that differ from the page:

  • The gains and CCC in Theorems 28 and 30 and Proposition 33 are data satisfying (36), not existentially chosen. An unconstrained ∃C\exists C∃C would make (52) false, and Proposition 24 shows (36) is satisfiable.
  • bbb is assumed measurable in Theorem 28.
  • "Adapted" is the feedback divided by b‾\underline bb​, as the page says.
  • Corrected printed slips:
    • (51) lacks ene_nen​.
    • Theorem 30 writes κ0∈(0,1/n)\kappa_0\in(0,1/n)κ0​∈(0,1/n); Theorem 28's (0,12n)(0,\tfrac1{2n})(0,2n1​) is used.
    • Proposition 33 prints κ0(m)∈[−12n,−12n]\kappa_0(m)\in[-\tfrac1{2n},-\tfrac1{2n}]κ0​(m)∈[−2n1​,−2n1​]; the value is positive and at most 12n\tfrac1{2n}2n1​.
    • (37) prints βi−1\beta_{i-1}βi−1​ for βj−1\beta_{j-1}βj−1​.
    • The proof of Lemma 32 prints the exponent of (33) as (rj+1)/(rjβj−1)(r_j+1)/(r_j\beta_{j-1})(rj​+1)/(rj​βj−1​); (33) is used.
  • Lemma 32's maxima are read pointwise, with rn=rn(κ)r_n=r_n(\kappa)rn​=rn​(κ).
  • In Proposition 33 the middle term −2ln⁡(2m)-2\ln(2m)−2ln(2m) of (52) is replaced by max⁡(−2ln⁡(2m), 2ln⁡1+m1−m)\max(-2\ln(2m),\,2\ln\frac{1+m}{1-m})max(−2ln(2m),2ln1−m1+m​): the page's crossing-time estimate −2ln⁡(2m)/C-2\ln(2m)/C−2ln(2m)/C is justified only for m≤(17−3)/4m\le(\sqrt{17}-3)/4m≤(17​−3)/4, where the two bounds coincide.
  • "Explicit" constants are stated as existing.

A formalization in which (36) is dropped, or CCC is chosen freely, or a trajectory is only required to exist, would be trivial or false. Any trivializing reading of this kind is ruled out: stability is required of every solution, and CCC is tied to (36).

Needed infrastructure: signed powers and their Hölder estimates (42), differentiability of VκV_\kappaVκ​, weighted homogeneity, Carathéodory existence for continuous right-hand sides, and comparison lemmas for V˙≤−cV1+α\dot V\le-cV^{1+\alpha}V˙≤−cV1+α. The stability definitions and the comparison lemmas are reusable beyond this mission. Contributions of any of these are welcome.

Selected references

  • Y. Chitour, R. Ushirobira, H. Bouhemou, Stabilization for a Perturbed Chain of Integrators in Prescribed Time, SIAM J. Control Optim. 58(2), 1022–1048, 2020. https://doi.org/10.1137/19M1285937
  • Y. Hong, Finite-time stabilization and stabilizability of a class of controllable systems, Systems Control Lett. 46, 231–236, 2002. https://doi.org/10.1016/S0167-6911(02)00119-6
  • M. Harmouche, S. Laghrouche, Y. Chitour, M. Hamerlain, Stabilisation of perturbed chains of integrators using Lyapunov-based homogeneous controllers, Int. J. Control 90, 2631–2640, 2017. https://doi.org/10.1080/00207179.2016.1262967
  • F. Lopez-Ramirez, D. Efimov, A. Polyakov, W. Perruquetti, Fixed-time output stabilization and fixed-time estimation of a chain of integrators, Int. J. Robust Nonlinear Control 28, 4647–4665, 2018. https://doi.org/10.1002/rnc.4275
  • Y. Song, Y. Wang, J. Holloway, M. Krstić, Time-varying feedback for regulation of normal-form nonlinear systems in prescribed finite time, Automatica 83, 243–251, 2017. https://doi.org/10.1016/j.automatica.2017.06.008
  • S. P. Bhat, D. S. Bernstein, Geometric homogeneity with applications to finite-time stability, Math. Control Signals Systems 17, 101–127, 2005. https://doi.org/10.1007/s00498-005-0151-x
11 thms1 active userReviewed
Control TheoryOperations ResearchProbability+1·Captain: mikedeng1

Stabilization of Hybrid Systems by Feedback Control Based on Discrete-Time State Observations II: Mean-Square and Almost Sure Exponential StabilityResearch Paper

Motivation

Many engineered systems switch between a finite number of operating modes at random times: a power grid after a line failure, a networked controller whose links drop, a manufacturing plant whose machines break down and are repaired. A standard model for such systems is a hybrid stochastic differential equation, also called an SDE with Markovian switching: the state follows an Itô equation whose coefficients depend on a mode that evolves as a continuous-time Markov chain. The monograph of Mao and Yuan (Stochastic Differential Equations with Markovian Switching, 2006) develops the stability theory of these equations.

A controller that stabilizes such a system usually needs the current state. In practice the state is sampled: it is observed at times 0,τ,2τ,…0,\tau,2\tau,\dots0,τ,2τ,… and the control is held between observations. Mao (Automatica 49, 2013) showed that, under a global Lipschitz condition on the drift and diffusion, a feedback control based on discrete-time observations makes a hybrid SDE mean-square exponentially stable when τ\tauτ is small enough. You, Liu, Lu, Mao and Qiu (SIAM J. Control Optim. 53(2), 2015) replaced that condition by local Lipschitz continuity plus linear growth, gave an explicit bound (3.5) on the admissible observation interval, and proved H∞H_\inftyH∞​-stability, asymptotic stability, and, in Section 4, exponential stability in mean square and almost surely with an explicit rate. This mission formalizes that exponential stability result, Theorem 4.2, and the steps of its proof.

Setting

Let (Ω,F,{Ft}t≥0,P)(\Omega,\mathcal F,\{\mathcal F_t\}_{t\ge0},\mathbb P)(Ω,F,{Ft​}t≥0​,P) be a probability space with a filtration satisfying the usual conditions (increasing, right-continuous, F0\mathcal F_0F0​ contains the null sets). On it live an mmm-dimensional {Ft}\{\mathcal F_t\}{Ft​}-Brownian motion www and a right-continuous {Ft}\{\mathcal F_t\}{Ft​}-Markov chain rrr on S={1,…,N}S=\{1,\dots,N\}S={1,…,N} with generator Γ=(γij)\Gamma=(\gamma_{ij})Γ=(γij​) (γij≥0\gamma_{ij}\ge0γij​≥0 for i≠ji\ne ji=j, zero row sums), independent of www. Fix τ>0\tau>0τ>0 and the sampling time δt=[t/τ]τ\delta_t=[t/\tau]\tauδt​=[t/τ]τ. The controlled system is

dx(t)=(f(x(t),r(t),t)+u(x(δt),r(t),t))dt+g(x(t),r(t),t) dw(t),x(0)=x0, r(0)=r0,(2.1)dx(t)=\big(f(x(t),r(t),t)+u(x(\delta_t),r(t),t)\big)dt+g(x(t),r(t),t)\,dw(t),\qquad x(0)=x_0,\ r(0)=r_0,\tag{2.1}dx(t)=(f(x(t),r(t),t)+u(x(δt​),r(t),t))dt+g(x(t),r(t),t)dw(t),x(0)=x0​, r(0)=r0​,(2.1)

with f,u:Rn×S×R+→Rnf,u:\mathbb R^n\times S\times\mathbb R_+\to\mathbb R^nf,u:Rn×S×R+​→Rn and g:Rn×S×R+→Rn×mg:\mathbb R^n\times S\times\mathbb R_+\to\mathbb R^{n\times m}g:Rn×S×R+​→Rn×m.

The hypotheses are:

  • Assumption 2.1: f,gf,gf,g locally Lipschitz in xxx, and ∣f(x,i,t)∣≤K1∣x∣|f(x,i,t)|\le K_1|x|∣f(x,i,t)∣≤K1​∣x∣, ∣g(x,i,t)∣≤K2∣x∣|g(x,i,t)|\le K_2|x|∣g(x,i,t)∣≤K2​∣x∣ (∣g∣|g|∣g∣ the trace norm).
  • Assumption 2.2: ∣u(x,i,t)−u(y,i,t)∣≤K3∣x−y∣|u(x,i,t)-u(y,i,t)|\le K_3|x-y|∣u(x,i,t)−u(y,i,t)∣≤K3​∣x−y∣ and u(0,i,t)=0u(0,i,t)=0u(0,i,t)=0.
  • Assumption 3.1: there are U∈C2,1(Rn×S×R+;R+)U\in C^{2,1}(\mathbb R^n\times S\times\mathbb R_+;\mathbb R_+)U∈C2,1(Rn×S×R+​;R+​) and λ1,λ2>0\lambda_1,\lambda_2>0λ1​,λ2​>0 with LU(x,i,t)+λ1∣Ux(x,i,t)∣2≤−λ2∣x∣2\mathcal LU(x,i,t)+\lambda_1|U_x(x,i,t)|^2\le-\lambda_2|x|^2LU(x,i,t)+λ1​∣Ux​(x,i,t)∣2≤−λ2​∣x∣2, where
LU=Ut+Ux[f+u]+12trace⁡[gTUxxg]+∑jγijU(x,j,t).\mathcal LU=U_t+U_x[f+u]+\tfrac12\operatorname{trace}[g^TU_{xx}g]+\sum_j\gamma_{ij}U(x,j,t).LU=Ut​+Ux​[f+u]+21​trace[gTUxx​g]+j∑​γij​U(x,j,t).
  • Assumption 4.1: c1∣x∣2≤U(x,i,t)≤c2∣x∣2c_1|x|^2\le U(x,i,t)\le c_2|x|^2c1​∣x∣2≤U(x,i,t)≤c2​∣x∣2 with c1,c2>0c_1,c_2>0c1​,c2​>0.
  • Condition (3.5): λ2>τK32λ1[2τ(K12+2K32)+K22]\lambda_2>\frac{\tau K_3^2}{\lambda_1}\big[2\tau(K_1^2+2K_3^2)+K_2^2\big]λ2​>λ1​τK32​​[2τ(K12​+2K32​)+K22​] and τ≤14K3\tau\le\frac1{4K_3}τ≤4K3​1​.

Put θ=K32/λ1\theta=K_3^2/\lambda_1θ=K32​/λ1​, λ=λ2−θτ[2τ(K12+2K32)+K22]\lambda=\lambda_2-\theta\tau[2\tau(K_1^2+2K_3^2)+K_2^2]λ=λ2​−θτ[2τ(K12​+2K32​)+K22​] (positive by (3.5)), and

H1=θτ(2τ(K12+2K32)+K22)+24θτ4K341−6τ2K32,H2=12θτ2K32(τK12+K22)1−6τ2K32.H_1=\theta\tau\big(2\tau(K_1^2+2K_3^2)+K_2^2\big)+\frac{24\theta\tau^4K_3^4}{1-6\tau^2K_3^2},\qquad H_2=\frac{12\theta\tau^2K_3^2(\tau K_1^2+K_2^2)}{1-6\tau^2K_3^2}.H1​=θτ(2τ(K12​+2K32​)+K22​)+1−6τ2K32​24θτ4K34​​,H2​=1−6τ2K32​12θτ2K32​(τK12​+K22​)​.

In Lean these are Assumption21, Assumption22, C21, LU, Assumption31, Assumption41, Condition35, theta, lam, H1, H2, rateEquationLHS; the basis is HybridSetup, the Itô integral IsItoIntegral, the sampling time delta, solutions SolvesSampledHybridSDE, and the functional (4.7) Vbar, all in the namespace You2015.Expo.

Formalization targets

Goal: Theorem 4.2 (exponential stability)

Under the hypotheses above, the equation

2τγe2τγ(H1+τH2)+γc2=λ(4.4)2\tau\gamma e^{2\tau\gamma}(H_1+\tau H_2)+\gamma c_2=\lambda\tag{4.4}2τγe2τγ(H1​+τH2​)+γc2​=λ(4.4)

has a unique root γ>0\gamma>0γ>0, and every solution of (2.1) satisfies

lim sup⁡t→∞1tlog⁡(E∣x(t)∣2)≤−γ,lim sup⁡t→∞1tlog⁡∣x(t)∣≤−γ2a.s.\limsup_{t\to\infty}\frac1t\log\big(\mathbb E|x(t)|^2\big)\le-\gamma,\qquad\limsup_{t\to\infty}\frac1t\log|x(t)|\le-\frac\gamma2\quad\text{a.s.}t→∞limsup​t1​log(E∣x(t)∣2)≤−γ,t→∞limsup​t1​log∣x(t)∣≤−2γ​a.s.

for all x0∈Rnx_0\in\mathbb R^nx0​∈Rn, r0∈Sr_0\in Sr0​∈S.

Milestones, in the order the proof uses them

  1. (3.15) E∣x(t)−x(δt)∣2≤2E∫δtt[τ∣f+u(x(δs),⋅)∣2+∣g∣2]ds\mathbb E|x(t)-x(\delta_t)|^2\le2\mathbb E\int_{\delta_t}^t[\tau|f+u(x(\delta_s),\cdot)|^2+|g|^2]dsE∣x(t)−x(δt​)∣2≤2E∫δt​t​[τ∣f+u(x(δs​),⋅)∣2+∣g∣2]ds.
  2. Theorem 3.2 (H∞H_\inftyH∞​-stability): ∫0∞E∣x(s)∣2ds<∞\int_0^\infty\mathbb E|x(s)|^2ds<\infty∫0∞​E∣x(s)∣2ds<∞.
  3. (3.21) E∣x(s)−x(δs)∣2≤3(τK12+K22)1−6τ2K32∫δssE∣x(z)∣2dz+6τ2K321−6τ2K32E∣x(s)∣2\mathbb E|x(s)-x(\delta_s)|^2\le\frac{3(\tau K_1^2+K_2^2)}{1-6\tau^2K_3^2}\int_{\delta_s}^s\mathbb E|x(z)|^2dz+\frac{6\tau^2K_3^2}{1-6\tau^2K_3^2}\mathbb E|x(s)|^2E∣x(s)−x(δs​)∣2≤1−6τ2K32​3(τK12​+K22​)​∫δs​s​E∣x(z)∣2dz+1−6τ2K32​6τ2K32​​E∣x(s)∣2.
  4. (4.11) EVˉ(x^z,r^z,z)≤(H1+τH2)∫z−2τzE∣x(y)∣2dy\mathbb E\bar V(\hat x_z,\hat r_z,z)\le(H_1+\tau H_2)\int_{z-2\tau}^z\mathbb E|x(y)|^2dyEVˉ(x^z​,r^z​,z)≤(H1​+τH2​)∫z−2τz​E∣x(y)∣2dy for z≥2τz\ge2\tauz≥2τ.
  5. (4.14) c1eγtE∣x(t)∣2≤Cc_1e^{\gamma t}\mathbb E|x(t)|^2\le Cc1​eγtE∣x(t)∣2≤C for t≥2τt\ge2\taut≥2τ.
  6. (4.14) ⇒\Rightarrow⇒ (4.3), the mean-square-to-almost-sure transfer cited from Mao–Yuan [23, Theorem 8.8].

Significance

The result. Theorem 4.2 gives a quantitative guarantee: a controller that samples the state every τ\tauτ units makes the switching system decay exponentially, with a rate γ\gammaγ computable from the constants of the assumptions. Asymptotic stability (Section 3 of the paper) says nothing about how fast trajectories settle; the rate is what a designer trades against the sampling cost when choosing τ\tauτ. The almost sure statement concerns individual trajectories, which is what an operator observes.

Formalizing it. The results are proved in the paper; none of them is machine-checked. Mathlib has real Brownian motion but no Itô integral, no stochastic differential equations and no continuous-time Markov chains. The mission therefore also produces a definition layer: a filtration under the usual conditions, a multidimensional {Ft}\{\mathcal F_t\}{Ft​}-Brownian motion, an {Ft}\{\mathcal F_t\}{Ft​}-Markov chain with a given generator, the L2L^2L2 Itô integral of vector-valued integrands, and the solution notion of an SDE with Markovian switching and a sampled-state delay. A related but different layer exists on Prove2Me for Ethier–Kurtz (EthierKurtz_IsStandardBrownian, EthierKurtz_HasBrownianItoIntegral, EthierKurtz_SolvesBrownianSDE); it has no mode switching and no sampled state, so it cannot express (2.1). Formalization also checks the constants: it found that the printed H1H_1H1​ in (4.5) disagrees with the paper's own derivation (see below).

Difficulty

Equation (2.1) is a stochastic differential delay equation whose delay t−δtt-\delta_tt−δt​ is bounded but jumps at every observation time, so the delay-equation stability theorems that require a differentiable delay with derivative below one (Mao–Yuan, p. 285) do not apply. A Lyapunov function of the current state alone leaves the term Ux[u(x(t))−u(x(δt))]U_x[u(x(t))-u(x(\delta_t))]Ux​[u(x(t))−u(x(δt​))], which has no sign and depends on the path over a whole observation interval. An exponential rate requires controlling this delay term with an exponential weight, and the weight inflates the delay contribution by a factor e2τγe^{2\tau\gamma}e2τγ; the rate equation (4.4) records exactly this balance. The almost sure part does not follow from the mean-square part by Chebyshev's inequality at fixed times alone: a pathwise bound needs control of the supremum of ∣x∣|x|∣x∣ over each unit interval, which involves the martingale part of the solution.

Formalization scope

Conventions committed to in Lean:

  • The state space is EuclideanSpace ℝ (Fin n), so ∣x∣|x|∣x∣ is the Euclidean norm; the explicit constants in (3.5), (3.21), (4.5) depend on it. The diffusion ggg is given by its mmm columns and ∣g∣2=∑k∣gk∣2|g|^2=\sum_k|g_k|^2∣g∣2=∑k​∣gk​∣2 (trace norm). Modes are Fin N (0-based). Time is ℝ≥0; time integrals are over subsets of R\mathbb RR at s.toNNReal.
  • Every expectation of a nonnegative quantity (E∣x∣2\mathbb E|x|^2E∣x∣2, EVˉ\mathbb E\bar VEVˉ) and every time integral of one is a lower Lebesgue integral in [0,∞][0,\infty][0,∞], so a non-integrable process cannot produce a junk value 000.
  • Logarithms. The paper's log⁡\loglog takes the value −∞-\infty−∞ at 000. For a finite a(t)≥0a(t)\ge0a(t)≥0, lim sup⁡t→∞1tlog⁡a(t)≤−γ\limsup_{t\to\infty}\frac1t\log a(t)\le-\gammalimsupt→∞​t1​loga(t)≤−γ is stated in the equivalent form "for every γ′<γ\gamma'<\gammaγ′<γ, eventually a(t)≤e−γ′ta(t)\le e^{-\gamma't}a(t)≤e−γ′t". Lean's Real.log 0 = 0 never enters. In (4.3) the almost-sure quantifier is outside the quantifier over γ′\gamma'γ′.
  • Correction of (4.5). The page prints the last term of H1H_1H1​ as 24τ3K34/(1−6τ2K32)24\tau^3K_3^4/(1-6\tau^2K_3^2)24τ3K34​/(1−6τ2K32​). Substituting (3.21) into (4.9), as the proof does, gives 24θτ4K34/(1−6τ2K32)24\theta\tau^4K_3^4/(1-6\tau^2K_3^2)24θτ4K34​/(1−6τ2K32​) (the same computation reproduces the printed H2H_2H2​). The mission uses the corrected H1H_1H1​ in the goal, (4.11) and (4.14). With the printed value the claimed rate could exceed what the proof yields whenever θτ>1\theta\tau>1θτ>1.
  • "The unique root" is a conjunct of the goal (∃! γ>0\exists!\,\gamma>0∃!γ>0); the stability conclusions are stated for every positive root. "(so λ>0\lambda>0λ>0)" is a consequence of (3.5), not a hypothesis. (4.4) is kept as an equality.
  • "The solution of (2.1)" is read as every process satisfying the solution definition: progressively measurable, almost surely continuous paths, E∣x(t)∣2<∞\mathbb E|x(t)|^2<\inftyE∣x(t)∣2<∞ for each ttt, and for each ttt, almost surely, the integral equation with Itô integrals in the L2L^2L2 sense. Existence and uniqueness (cited from Mao–Yuan on p. 908) are not asserted.
  • "An mmm-dimensional Brownian motion" and "a Markov chain with generator Γ\GammaΓ" are read in the Mao–Yuan framework the paper cites: an {Ft}\{\mathcal F_t\}{Ft​}-Brownian motion with independent coordinates and increments independent of the past, and an {Ft}\{\mathcal F_t\}{Ft​}-Markov chain with transition matrix etΓe^{t\Gamma}etΓ. The usual conditions are kept as hypotheses.
  • "Locally Lipschitz" is uniform in the mode and time on each ball. C2,1C^{2,1}C2,1 carries its derivatives Ut,Ux,UxxU_t,U_x,U_{xx}Ut​,Ux​,Uxx​ as witnesses tied to UUU by derivative relations and joint continuity.
  • "τ>0\tau>0τ>0 sufficiently small for (3.5)" means every τ>0\tau>0τ>0 satisfying both inequalities of (3.5). U,λ1,λ2,c1,c2,τU,\lambda_1,\lambda_2,c_1,c_2,\tauU,λ1​,λ2​,c1​,c2​,τ are data. The constant CCC of (4.14) is chosen after x0x_0x0​, r0r_0r0​, the solution and γ\gammaγ, and before ttt.
  • (3.15), (3.21) and the transfer (4.14) ⇒\Rightarrow⇒ (4.3) are stated under fewer hypotheses than the surrounding proof has (Assumptions 2.1, 2.2, τ>0\tau>0τ>0, and for (3.21) τ≤1/(4K3)\tau\le1/(4K_3)τ≤1/(4K3​)), because their derivations use no more. Vˉ\bar VVˉ of (4.7) is used only for z≥2τz\ge2\tauz≥2τ, where no extension of the solution to negative times is needed. Other misprints on the page (g(x,i,s)=f(x,i,0)g(x,i,s)=f(x,i,0)g(x,i,s)=f(x,i,0) on p. 909, V(x^0,r^0,t)V(\hat x_0,\hat r_0,t)V(x^0​,r^0​,t) for V(x^0,r^0,0)V(\hat x_0,\hat r_0,0)V(x^0​,r^0​,0) on p. 918, the swapped ∨,∧\vee,\wedge∨,∧ on p. 907) are not formalized.

A trivializing formalization is ruled out: the expectations are not Bochner integrals, log⁡0\log 0log0 is never evaluated, the goal asserts that the rate equation has exactly one positive root (so the stability clauses are not vacuous), the solution notion admits the true solution and requires path continuity, and the derivative witnesses of UUU are tied to UUU. A sorry-free local check confirms that Assumptions 2.1, 2.2, 4.1, condition (3.5) and λ>0\lambda>0λ>0 hold for n=m=N=1n=m=N=1n=m=N=1, f=g=0f=g=0f=g=0, u(x)=−xu(x)=-xu(x)=−x, U=∣x∣2U=|x|^2U=∣x∣2, K1=K2=K3=1K_1=K_2=K_3=1K1​=K2​=K3​=1, λ1=1/4\lambda_1=1/4λ1​=1/4, λ2=1\lambda_2=1λ2​=1, c1=c2=1c_1=c_2=1c1​=c2​=1, τ=1/10\tau=1/10τ=1/10; for these data LU+λ1∣Ux∣2=−∣x∣2\mathcal LU+\lambda_1|U_x|^2=-|x|^2LU+λ1​∣Ux​∣2=−∣x∣2 by hand.

Welcome contributions: the Itô isometry and Itô's formula for the L2L^2L2 integral defined here, a generalized Itô formula for functions of a Markov-modulated Itô process, the Burkholder–Davis–Gundy inequality, and the Borel–Cantelli argument that turns mean-square exponential decay into almost sure decay. These are reusable far beyond this mission. Section 3 of the paper (asymptotic stability) is a separate mission of the same series.

Selected references

  • S. You, W. Liu, J. Lu, X. Mao, Q. Qiu, Stabilization of Hybrid Systems by Feedback Control Based on Discrete-Time State Observations, SIAM J. Control Optim. 53(2), 905–925, 2015. https://doi.org/10.1137/140985779
  • X. Mao, C. Yuan, Stochastic Differential Equations with Markovian Switching, Imperial College Press, 2006. https://doi.org/10.1142/p473
  • X. Mao, Stabilization of continuous-time hybrid stochastic differential equations by discrete-time feedback control, Automatica 49(12), 3677–3681, 2013. https://doi.org/10.1016/j.automatica.2013.09.005
13 thms1 active userReviewed
ProbabilityReinforcement LearningStochastic Systems·Captain: mikedeng1

The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning II: Mean-Square Error under Bounded StepsizesResearch Paper

Motivation

Stochastic approximation is the family of recursive algorithms that locate a zero of a vector field hhh from noisy evaluations of it. Temporal-difference learning, Q-learning, actor–critic methods and stochastic gradient descent are all instances. In practice these algorithms are often run with a constant or bounded, non-vanishing stepsize: the iterate keeps adapting to new data and never freezes, at the price of never converging exactly. The natural question for such a scheme is quantitative: how far from the target does the iterate stay in the long run, and how does that distance scale with the stepsize?

Borkar and Meyn (SIAM J. Control Optim. 38(2), 2000) answer both halves of the question under one set of hypotheses. First, stability of a "fluid" ODE obtained by scaling hhh at infinity implies that the iterates have bounded second moments, with no a priori boundedness or projection assumption. Second, if the ODE x˙=h(x)\dot x = h(x)x˙=h(x) has a globally exponentially stable equilibrium x∗x^*x∗, the asymptotic mean-square error is of the order of the largest stepsize. The first result replaced the usual stochastic-Lyapunov-function verification in reinforcement-learning applications (Section 3 of the paper). This mission formalizes the bounded-stepsize branch of the paper. A companion mission (… I: Stability and Almost-Sure Convergence under Tapering Stepsizes) covers the vanishing-stepsize branch.

Setting

Fix d≥1d \ge 1d≥1 and a Lipschitz vector field h:Rd→Rdh : \mathbb{R}^d \to \mathbb{R}^dh:Rd→Rd. The stochastic approximation recursion (1.1) is

X(n+1)=X(n)+a(n)[h(X(n))+M(n+1)],n≥0,X(n+1) = X(n) + a(n)\big[h(X(n)) + M(n+1)\big], \qquad n \ge 0,X(n+1)=X(n)+a(n)[h(X(n))+M(n+1)],n≥0,

with a deterministic step sequence {a(n)}\{a(n)\}{a(n)} and a noise sequence {M(n)}\{M(n)\}{M(n)} on a probability space (Ω,F,P)(\Omega, \mathcal F, \mathsf P)(Ω,F,P). The associated ODE (1.2) is x˙=h(x)\dot x = h(x)x˙=h(x).

  • The scaled fields are hr(x)=r−1h(rx)h_r(x) = r^{-1} h(rx)hr​(x)=r−1h(rx). Assumption (A1) asks that hhh be Lipschitz, that hr(x)→h∞(x)h_r(x) \to h_\infty(x)hr​(x)→h∞​(x) for every xxx as r→∞r \to \inftyr→∞, and that the origin be an asymptotically stable equilibrium of the fluid ODE x˙=h∞(x)\dot x = h_\infty(x)x˙=h∞​(x).
  • Let Fn=σ(X(0),…,X(n))\mathcal F_n = \sigma(X(0), \dots, X(n))Fn​=σ(X(0),…,X(n)). Assumption (A2) asks that {M(n)}\{M(n)\}{M(n)} be a martingale difference sequence, E[M(n+1)∣Fn]=0\mathsf E[M(n+1) \mid \mathcal F_n] = 0E[M(n+1)∣Fn​]=0, with conditional second moments E[∥M(n+1)∥2∣Fn]≤C0(1+∥X(n)∥2)\mathsf E[\|M(n+1)\|^2 \mid \mathcal F_n] \le C_0(1 + \|X(n)\|^2)E[∥M(n+1)∥2∣Fn​]≤C0​(1+∥X(n)∥2) for a constant C0C_0C0​.
  • Assumption (BS), bounded stepsizes: 0<α‾≤a(n)≤αˉ<10 < \underline\alpha \le a(n) \le \bar\alpha < 10<α​≤a(n)≤αˉ<1 for all nnn, with α‾<αˉ\underline\alpha < \bar\alphaα​<αˉ.
  • The error (2.2) is e(n)=∥X(n)−x∗∥e(n) = \|X(n) - x^*\|e(n)=∥X(n)−x∗∥.

An equilibrium x∗x^*x∗ of (1.2) is globally asymptotically stable if it is Lyapunov stable and attracts every solution. It is globally exponentially asymptotically stable if there are bbb and δ>0\delta > 0δ>0 with ∥x(t)−x∗∥≤b e−δt∥x(0)−x∗∥\|x(t) - x^*\| \le b\,e^{-\delta t}\|x(0) - x^*\|∥x(t)−x∗∥≤be−δt∥x(0)−x∗∥ for every solution.

The proofs compare the iterates with ODE solutions on a time grid: t(n)=∑i<na(i)t(n) = \sum_{i<n} a(i)t(n)=∑i<n​a(i), blocks T(j)=t(m(j))T(j) = t(m(j))T(j)=t(m(j)) of length about TTT, the interpolated path ψ\psiψ of the iterates, its rescaled version ϕj=ψ/r(j)\phi_j = \psi/r(j)ϕj​=ψ/r(j) with r(j)=max⁡(1,∥X(m(j))∥)r(j) = \max(1, \|X(m(j))\|)r(j)=max(1,∥X(m(j))∥), and the ODE solutions ψ^\hat\psiψ^​, ϕ^j\hat\phi_jϕ^​j​ restarted at each block.

Formalization targets

Goal: Theorem 2.3(ii)

Under (A1), (A2) and (BS), if x∗x^*x∗ is a globally asymptotically and globally exponentially asymptotically stable equilibrium of (1.2), there are α∗>0\alpha^* > 0α∗>0 and b2<∞b_2 < \inftyb2​<∞ such that for all 0<αˉ≤α∗0 < \bar\alpha \le \alpha^*0<αˉ≤α∗ and every initial condition X(0)X(0)X(0),

lim sup⁡n→∞E[e(n)2]≤b2 αˉ.\limsup_{n \to \infty} \mathsf E\big[e(n)^2\big] \le b_2\, \bar\alpha .n→∞limsup​E[e(n)2]≤b2​αˉ.

The constant b2b_2b2​ is uniform in the stepsizes and in X(0)X(0)X(0). No rate constant is fixed: only the linear dependence on αˉ\bar\alphaαˉ is asserted.

Milestones

  1. Lemma 4.7. For fixed T>0T > 0T>0 there is C2C_2C2​, independent of the stepsizes, with E[∥ϕj(t)−ϕ^j(t)∥2∣Fm(j)]≤C2αˉ\mathsf E[\|\phi_j(t) - \hat\phi_j(t)\|^2 \mid \mathcal F_{m(j)}] \le C_2\bar\alphaE[∥ϕj​(t)−ϕ^​j​(t)∥2∣Fm(j)​]≤C2​αˉ and E[∥ϕj(t)∥2∣Fm(j)]≤C2\mathsf E[\|\phi_j(t)\|^2 \mid \mathcal F_{m(j)}] \le C_2E[∥ϕj​(t)∥2∣Fm(j)​]≤C2​ on every block.
  2. Theorem 2.1(ii). There are α∗>0\alpha^* > 0α∗>0 and C1C_1C1​ with lim sup⁡nE∥X(n)∥2≤C1\limsup_n \mathsf E\|X(n)\|^2 \le C_1limsupn​E∥X(n)∥2≤C1​ whenever αˉ<α∗\bar\alpha < \alpha^*αˉ<α∗.
  3. Lemma 4.8. For αˉ≤α∗\bar\alpha \le \alpha^*αˉ≤α∗, sup⁡t≥0E∥ψ^(t)−ψ(t)∥2≤C3αˉ\sup_{t \ge 0} \mathsf E\|\hat\psi(t) - \psi(t)\|^2 \le C_3 \bar\alphasupt≥0​E∥ψ^​(t)−ψ(t)∥2≤C3​αˉ.

Significance

The result. Theorem 2.1(ii) says that a stability property of a deterministic ODE at infinity controls a stochastic recursion in mean square, uniformly over initial conditions. Theorem 2.3(ii) turns this into an error bound: with a non-vanishing stepsize the iterate does not converge, but its mean-square distance from x∗x^*x∗ is eventually O(αˉ)O(\bar\alpha)O(αˉ). This is the quantitative justification for constant-stepsize stochastic approximation in reinforcement learning and adaptive control, and it is the starting point of the trade-off between bias (small stepsize) and speed (large stepsize) discussed in Section 2.2 of the paper.

Formalizing it. The results are proved in the paper, partly by sketch: Lemma 4.8's proof refers to "familiar arguments using the Bellman–Gronwall lemma", and the paper writes several bounds as O(αˉ)O(\bar\alpha)O(αˉ). A formal proof makes every constant and its dependence explicit, which the paper's quantifier order leaves partly implicit (see the scope section). No machine-checked proof of these results, or of any stochastic-approximation stability theorem in this generality, is known to exist.

Difficulty

The natural first argument, that the iterates track the ODE and the ODE converges, needs the iterates to be bounded. Bounded iterates are exactly what is being proved, so the argument is circular. The paper breaks the circularity by rescaling: on each block the iterate is divided by r(j)r(j)r(j), so that on large scales it tracks the fluid ODE, whose stability contracts the norm by a fixed factor per block. Making this work in mean square requires conditional second-moment estimates that are uniform in the stepsize and the scale (Lemma 4.7). A second difficulty is that the stepsize does not vanish: the tracking error per block does not go to zero, and the goal's content is precisely that it is of order αˉ\bar\alphaαˉ with a constant that does not depend on αˉ\bar\alphaαˉ.

Formalization scope

  • The state space is EuclideanSpace ℝ (Fin d). ODE solutions are forward solutions: continuous on [0,∞)[0,\infty)[0,∞) with right derivatives. Stability notions are the standard ones, with exponential stability in the form the proof of Theorem 2.3(ii) uses.
  • The filtration is the natural filtration of the iterates. (A2) includes integrability of M(n+1)M(n+1)M(n+1) and ∥M(n+1)∥2\|M(n+1)\|^2∥M(n+1)∥2 so that the conditional expectations are meaningful. Each theorem quantifies over every probability space, every measurable process satisfying (1.1) and (A2), and every deterministic X(0)X(0)X(0).
  • Second moments, suprema and lim sup⁡\limsuplimsup are computed in [0,∞][0,\infty][0,∞], so a bound is a genuine finiteness claim.
  • Constant placement. α∗\alpha^*α∗, C1C_1C1​ and b2b_2b2​ depend only on hhh, h∞h_\inftyh∞​, C0C_0C0​ (and x∗x^*x∗). C2C_2C2​ depends in addition on TTT, and C3C_3C3​ on TTT and X(0)X(0)X(0). None depends on the stepsizes. Theorem 2.3's page text puts b2b_2b2​ after α\alphaα. Read literally, that would allow b2=C1/αˉb_2 = C_1/\bar\alphab2​=C1​/αˉ and make the goal a restatement of Theorem 2.1(ii). The formal goal fixes b2b_2b2​ before the stepsizes and the initial condition, as the proof (16C3αˉ16C_3\bar\alpha16C3​αˉ) gives. α∗\alpha^*α∗ is existential in Theorem 2.3(ii) and Lemma 4.8 rather than tied to Theorem 2.1(ii)'s witness.
  • The proof objects ψ^\hat\psiψ^​, ϕ^j\hat\phi_jϕ^​j​ are characterized by predicates (initial value, continuity, ODE on the block). Lemmas 4.7 and 4.8 hold for every function satisfying them.
  • Not included: Theorem 2.3(i) (its proof chooses a radius depending on αˉ\bar\alphaαˉ), Theorem 2.4 and the Markov-chain results of Section 4.3, and the asynchronous extension (Theorem 2.5). The deterministic ODE lemmas 4.1–4.4 belong to the companion mission.

Useful infrastructure, reusable beyond this mission: Bellman–Gronwall inequalities in discrete time (Lemma 4.3 of the paper), stability of scaled ODEs, and conditional second-moment estimates for martingale-difference-driven recursions. Contributions of any of these as separate lemmas are welcome.

Selected references

  • V. S. Borkar and S. P. Meyn, The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning, SIAM J. Control Optim. 38(2):447–469, 2000. https://doi.org/10.1137/S0363012997331639
  • M. Benaïm, Dynamics of stochastic approximation algorithms, Séminaire de Probabilités XXXIII, Lecture Notes in Math. 1709, Springer, 1999. https://doi.org/10.1007/BFb0096509
  • H. J. Kushner and G. G. Yin, Stochastic Approximation and Recursive Algorithms and Applications, 2nd ed., Springer, 2003. https://doi.org/10.1007/b97441
7 thms1 active userReviewed
Number TheoryProbability·Captain: mysticflounder

Tao 2022: Almost All Collatz Orbits Attain Almost Bounded ValuesResearch Paper

Motivation

The Collatz map sends an even positive integer nnn to n/2n/2n/2 and an odd one to 3n+13n+13n+1. The Collatz conjecture asserts that every orbit of this map eventually reaches 111. It remains an open problem.

Because the conjecture is open, a large part of the literature proves weaker statements that hold for almost all starting values. These results bound how small an orbit gets, not whether it reaches 111. They are the strongest unconditional evidence for the conjecture. Terence Tao's 2022 theorem is the strongest result of this type: outside a set of logarithmic density zero, every orbit drops below any prescribed function that tends to infinity, however slowly (Tao 2022).

Timeline

Attributions follow the survey in Tao 2022, Section 1. Here Colmin⁡(N)\mathrm{Col}_{\min}(N)Colmin​(N) is the least value in the orbit of NNN.

  • 1976 to 1979, Terras and Everett. Colmin⁡(N)<N\mathrm{Col}_{\min}(N) < NColmin​(N)<N for almost all NNN, in natural density.
  • 1979, Allouche. Colmin⁡(N)<Nθ\mathrm{Col}_{\min}(N) < N^{\theta}Colmin​(N)<Nθ for almost all NNN, for every θ>0.869\theta > 0.869θ>0.869.
  • 1994, Korec. The same bound for every θ>log⁡3/log⁡4≈0.7924\theta > \log 3/\log 4 \approx 0.7924θ>log3/log4≈0.7924.
  • 2019 preprint, 2022 publication, Tao. The power NθN^{\theta}Nθ is replaced by any f(N)→∞f(N) \to \inftyf(N)→∞, in logarithmic density instead of natural density (Forum of Mathematics, Pi 10, e12).
  • 2026, ProofAtlas. A complete machine-checked proof of Tao's theorem in Lean 4 is published (formalization record).

Setting

Let collatzStep:N→N\mathrm{collatzStep} : \mathbb{N} \to \mathbb{N}collatzStep:N→N be

collatzStep(n)={n/2n even,3n+1n odd.\mathrm{collatzStep}(n) = \begin{cases} n/2 & n \text{ even},\\ 3n+1 & n \text{ odd}. \end{cases}collatzStep(n)={n/23n+1​n even,n odd.​

Write collatzStep[k]\mathrm{collatzStep}^{[k]}collatzStep[k] for the kkk-fold iterate, with collatzStep[0](n)=n\mathrm{collatzStep}^{[0]}(n) = ncollatzStep[0](n)=n. The orbit of nnn is the set of values collatzStep[k](n)\mathrm{collatzStep}^{[k]}(n)collatzStep[k](n) for k≥0k \ge 0k≥0. It includes nnn itself.

The Syracuse map acts on odd integers. It sends an odd nnn to the odd part of 3n+13n+13n+1, which is syracuseStep(n)=(3n+1)/2ν2(3n+1)\mathrm{syracuseStep}(n) = (3n+1)/2^{\nu_2(3n+1)}syracuseStep(n)=(3n+1)/2ν2​(3n+1). The Syracuse orbit minimum syracuseOrbitMin(n)\mathrm{syracuseOrbitMin}(n)syracuseOrbitMin(n) is the least value syracuseStep[k](n)\mathrm{syracuseStep}^{[k]}(n)syracuseStep[k](n) over k≥0k \ge 0k≥0.

For a set AAA of positive integers and a real cutoff x≥2x \ge 2x≥2, the logarithmic mass of AAA up to xxx is

weightedLogMassReal(x)=1log⁡x∑1≤n≤xn∈A1n.\mathrm{weightedLogMassReal}(x) = \frac{1}{\log x} \sum_{\substack{1 \le n \le x \\ n \in A}} \frac{1}{n}.weightedLogMassReal(x)=logx1​1≤n≤xn∈A​∑​n1​.

A set of positive integers has logarithmic density ddd when this quantity tends to ddd as x→∞x \to \inftyx→∞. Since ∑n≤x1/n=log⁡x+O(1)\sum_{n \le x} 1/n = \log x + O(1)∑n≤x​1/n=logx+O(1), all positive integers together have logarithmic density 111, and the odd positive integers have logarithmic density 1/21/21/2.

A function f:N→Rf : \mathbb{N} \to \mathbb{R}f:N→R tends to infinity on positive inputs when for every real MMM there is an NNN such that f(n)>Mf(n) > Mf(n)>M for all n≥Nn \ge Nn≥N with n>0n > 0n>0.

Formalization targets

Goal: Tao's Theorem 1.3

For every fff that tends to infinity on positive inputs,

lim⁡x→∞1log⁡x∑1≤n≤x∃k, collatzStep[k](n)<f(n)1n=1.\lim_{x \to \infty} \frac{1}{\log x} \sum_{\substack{1 \le n \le x \\ \exists k,\ \mathrm{collatzStep}^{[k]}(n) < f(n)}} \frac{1}{n} = 1.x→∞lim​logx1​1≤n≤x∃k, collatzStep[k](n)<f(n)​∑​n1​=1.

This is the Lean theorem collatz_almost_bounded_logarithmic. It fixes no rate and no constant, so later improvements do not invalidate it.

Syracuse form: Tao's Theorem 1.6

For every fff that tends to infinity on odd positive inputs, the odd nnn whose Syracuse orbit contains a value below f(n)f(n)f(n) have logarithmic density 1/21/21/2, which is all of the odd integers. This is syracuse_almost_bounded_logarithmic.

Quantitative form: Tao's Theorem 3.1

There are constants C,c>0C, c > 0C,c>0 such that for all real M≥2M \ge 2M≥2 and x≥2x \ge 2x≥2,

1log⁡x∑1≤n≤x, n oddsyracuseOrbitMin(n)>M1n≤C(log⁡M)c.\frac{1}{\log x} \sum_{\substack{1 \le n \le x,\ n \text{ odd} \\ \mathrm{syracuseOrbitMin}(n) > M}} \frac{1}{n} \le \frac{C}{(\log M)^{c}}.logx1​1≤n≤x, n oddsyracuseOrbitMin(n)>M​∑​n1​≤(logM)cC​.

This is syracuse_uniform_logarithmic_tail_bound. The three targets are listed from weakest to strongest. In Tao's paper, the goal and Theorem 1.6 both follow from Theorem 3.1.

Significance

The result. Theorem 1.3 improves the earlier almost-all bounds on Collatz orbit minima from a power of NNN to any function that tends to infinity. For example, Colmin⁡(N)<log⁡log⁡log⁡log⁡N\mathrm{Col}_{\min}(N) < \log\log\log\log NColmin​(N)<loglogloglogN for almost all NNN. The theorem does not settle the conjecture. A single divergent orbit or nontrivial cycle is not excluded, because its predecessors form a set with bounded orbit minima.

The formalization. The theorem is proved, and a complete formalization already exists. The ProofAtlas record Tao's Almost-Bounded Collatz Orbits proves the statement taoAlmostBoundedColMin_checked with the same step map and an orbit that includes its starting value. That package has 397 first-party Lean files and about 124,000 source lines. ProofAtlas records a passing build with no sorry and the axiom profile propext, Classical.choice, Quot.sound. The source is released under the Apache-2.0 licence at commit d53c8de00056fb05999e44589f2399d7efa026e4, with copyright held by Advameg, Inc. It was built with Lean v4.30.0-rc2.

The remaining work for this mission is therefore a port, not new mathematics. The existing Lean development must be moved to Lean v4.33.1 and Mathlib 0df444a, and then connected to the goal statement above.

Difficulty

The mathematical difficulty is already resolved in the existing proof. The classical first-descent argument shows that a typical orbit drops below its starting value. Repeating that argument fails, because after one descent the new value is no longer distributed like a random integer of its size, and the error compounds at each repetition. That is why earlier results stop at a power bound NθN^{\theta}Nθ.

The difficulty of this mission is engineering. The port moves a development of about 124,000 lines forward across three minor Lean releases and the corresponding Mathlib changes. Lemma renames, deprecations, and changes in tactic behaviour must be repaired file by file without changing any statement.

Formalization scope

  • Step map. collatzStep n = if Even n then n / 2 else 3 * n + 1, so collatzStep(0)=0\mathrm{collatzStep}(0) = 0collatzStep(0)=0. This is the same definition as in the ProofAtlas source.
  • Orbit. The witness kkk ranges over all natural numbers, including k=0k = 0k=0.
  • Density. The goal uses weightedLogMassReal: a real cutoff xxx, the natural indices 0≤n≤⌊x⌋0 \le n \le \lfloor x \rfloor0≤n≤⌊x⌋, weights 1/n1/n1/n, and normalization by log⁡x\log xlogx. The ProofAtlas statement instead uses integer cutoffs and normalization by the harmonic sum ∑n≤N1/n\sum_{n \le N} 1/n∑n≤N​1/n. A short bridge between the two normalizations is part of the required work.
  • Threshold. The hypothesis on fff constrains only positive inputs. The value f(0)f(0)f(0) is irrelevant.
  • Non-triviality. The case k=0k = 0k=0 alone covers only inputs with n<f(n)n < f(n)n<f(n). For slowly growing fff this set is finite, so the goal is not satisfied by the starting value.

The goal is already reduced, through accepted proofs, to the single open statement syracuse_uniform_logarithmic_tail_bound. Two routes therefore close the mission. The first is to port the ProofAtlas development and prove the goal directly through the density bridge. The second is to prove Theorem 3.1 in its stated form. Contributions welcome include ported modules as reusable solutions, the density bridge, and a proof of Theorem 3.1. Every ported file must keep the Apache-2.0 notice and attribution to the ProofAtlas source.

Selected references

  • Terence Tao, Almost all orbits of the Collatz map attain almost bounded values, Forum of Mathematics, Pi 10 (2022), e12. https://doi.org/10.1017/fmp.2022.8 and https://arxiv.org/abs/1909.03562
  • ProofAtlas, Tao's Almost-Bounded Collatz Orbits, Lean 4 formalization, source commit d53c8de00056fb05999e44589f2399d7efa026e4, Apache-2.0, 2026. https://proofatlas.ai/formalizations/tao-almost-bounded-orbits/
  • Jeffrey C. Lagarias (editor), The Ultimate Challenge: The 3x+1 Problem, American Mathematical Society, 2010. https://bookstore.ams.org/MBK/78
7 thms1 active userReviewed
Control TheoryOperations ResearchProbability+1·Captain: mikedeng1

Stabilization of Hybrid Systems by Feedback Control Based on Discrete-Time State Observations I: Almost Sure Asymptotic StabilityResearch Paper

Motivation

Many engineered systems switch between a finite number of operating modes at random times: a power grid after a line failure, a networked controller whose links drop, a manufacturing plant whose machines break down and are repaired. A standard model for such systems is a hybrid stochastic differential equation, also called an SDE with Markovian switching: the state follows an Itô equation whose coefficients depend on a mode that evolves as a continuous-time Markov chain. The monograph of Mao and Yuan (Stochastic Differential Equations with Markovian Switching, 2006) develops the stability theory of these equations.

A controller that stabilizes such a system usually needs the current state. In practice the state is sampled: it is observed at times 0,τ,2τ,…0,\tau,2\tau,\dots0,τ,2τ,… and the control is held between observations. Mao (Automatica 49, 2013) showed that, under a global Lipschitz condition on the drift and diffusion, a feedback control based on discrete-time observations stabilizes a hybrid SDE in the sense of mean-square exponential stability when τ\tauτ is small enough. You, Liu, Lu, Mao and Qiu (SIAM J. Control Optim. 53(2), 2015) replaced that condition by local Lipschitz continuity plus linear growth, gave an explicit bound (3.5) on the admissible observation interval τ\tauτ, and proved H∞H_\inftyH∞​-stability, mean-square asymptotic stability, almost sure asymptotic stability and exponential stability of the controlled system. This mission formalizes the almost sure asymptotic stability result, Theorem 3.4, and the results it is built on.

Setting

Let (Ω,F,{Ft}t≥0,P)(\Omega,\mathcal F,\{\mathcal F_t\}_{t\ge0},\mathbb P)(Ω,F,{Ft​}t≥0​,P) be a probability space with a filtration satisfying the usual conditions (increasing, right-continuous, F0\mathcal F_0F0​ contains the null sets). On it live an mmm-dimensional {Ft}\{\mathcal F_t\}{Ft​}-Brownian motion www and a right-continuous {Ft}\{\mathcal F_t\}{Ft​}-Markov chain rrr on S={1,…,N}S=\{1,\dots,N\}S={1,…,N} with generator Γ=(γij)\Gamma=(\gamma_{ij})Γ=(γij​) (γij≥0\gamma_{ij}\ge0γij​≥0 for i≠ji\ne ji=j, zero row sums), independent of www. Fix τ>0\tau>0τ>0 and the sampling time δt=[t/τ]τ\delta_t=[t/\tau]\tauδt​=[t/τ]τ, the last observation time up to ttt. The controlled system is

dx(t)=(f(x(t),r(t),t)+u(x(δt),r(t),t))dt+g(x(t),r(t),t) dw(t),x(0)=x0, r(0)=r0,(2.1)dx(t)=\big(f(x(t),r(t),t)+u(x(\delta_t),r(t),t)\big)dt+g(x(t),r(t),t)\,dw(t),\qquad x(0)=x_0,\ r(0)=r_0,\tag{2.1}dx(t)=(f(x(t),r(t),t)+u(x(δt​),r(t),t))dt+g(x(t),r(t),t)dw(t),x(0)=x0​, r(0)=r0​,(2.1)

with f,u:Rn×S×R+→Rnf,u:\mathbb R^n\times S\times\mathbb R_+\to\mathbb R^nf,u:Rn×S×R+​→Rn and g:Rn×S×R+→Rn×mg:\mathbb R^n\times S\times\mathbb R_+\to\mathbb R^{n\times m}g:Rn×S×R+​→Rn×m. The feedback uuu sees the state only at the observation times.

The hypotheses are:

  • Assumption 2.1: f,gf,gf,g locally Lipschitz in xxx, and ∣f(x,i,t)∣≤K1∣x∣|f(x,i,t)|\le K_1|x|∣f(x,i,t)∣≤K1​∣x∣, ∣g(x,i,t)∣≤K2∣x∣|g(x,i,t)|\le K_2|x|∣g(x,i,t)∣≤K2​∣x∣ (∣g∣|g|∣g∣ the trace norm).
  • Assumption 2.2: ∣u(x,i,t)−u(y,i,t)∣≤K3∣x−y∣|u(x,i,t)-u(y,i,t)|\le K_3|x-y|∣u(x,i,t)−u(y,i,t)∣≤K3​∣x−y∣ and u(0,i,t)=0u(0,i,t)=0u(0,i,t)=0.
  • Assumption 3.1: there are U∈C2,1(Rn×S×R+;R+)U\in C^{2,1}(\mathbb R^n\times S\times\mathbb R_+;\mathbb R_+)U∈C2,1(Rn×S×R+​;R+​) and λ1,λ2>0\lambda_1,\lambda_2>0λ1​,λ2​>0 with LU(x,i,t)+λ1∣Ux(x,i,t)∣2≤−λ2∣x∣2\mathcal LU(x,i,t)+\lambda_1|U_x(x,i,t)|^2\le-\lambda_2|x|^2LU(x,i,t)+λ1​∣Ux​(x,i,t)∣2≤−λ2​∣x∣2, where
LU=Ut+Ux[f+u]+12trace⁡[gTUxxg]+∑jγijU(x,j,t).\mathcal LU=U_t+U_x[f+u]+\tfrac12\operatorname{trace}[g^TU_{xx}g]+\sum_j\gamma_{ij}U(x,j,t).LU=Ut​+Ux​[f+u]+21​trace[gTUxx​g]+j∑​γij​U(x,j,t).
  • Condition (3.5): λ2>τK32λ1[2τ(K12+2K32)+K22]\lambda_2>\frac{\tau K_3^2}{\lambda_1}\big[2\tau(K_1^2+2K_3^2)+K_2^2\big]λ2​>λ1​τK32​​[2τ(K12​+2K32​)+K22​] and τ≤14K3\tau\le\frac1{4K_3}τ≤4K3​1​.

In Lean these are Assumption21, Assumption22, C21, LU, Assumption31, Condition35, in the namespace You2015.Asymp; the basis is HybridSetup, the Itô integral IsItoIntegral, the sampling time delta, and solutions SolvesSampledHybridSDE, in the namespace You2015.Shared shared with the companion mission.

Formalization targets

Goal: Theorem 3.4 (almost sure asymptotic stability)

Under the hypotheses above, every solution of (2.1) satisfies

lim⁡t→∞x(t)=0a.s.\lim_{t\to\infty}x(t)=0\quad\text{a.s.}t→∞lim​x(t)=0a.s.

for all x0∈Rnx_0\in\mathbb R^nx0​∈Rn and r0∈Sr_0\in Sr0​∈S. No rate is claimed; the statement is the qualitative convergence of almost every path.

Milestones, in the order the proof uses them

  1. (3.15) E∣x(t)−x(δt)∣2≤2E∫δtt[τ∣f+u(x(δs),⋅)∣2+∣g∣2]ds\mathbb E|x(t)-x(\delta_t)|^2\le2\mathbb E\int_{\delta_t}^t[\tau|f+u(x(\delta_s),\cdot)|^2+|g|^2]dsE∣x(t)−x(δt​)∣2≤2E∫δt​t​[τ∣f+u(x(δs​),⋅)∣2+∣g∣2]ds.
  2. Theorem 3.2 (H∞H_\inftyH∞​-stability): ∫0∞E∣x(s)∣2ds<∞\int_0^\infty\mathbb E|x(s)|^2ds<\infty∫0∞​E∣x(s)∣2ds<∞.
  3. (3.21) E∣x(s)−x(δs)∣2≤3(τK12+K22)1−6τ2K32∫δssE∣x(z)∣2dz+6τ2K321−6τ2K32E∣x(s)∣2\mathbb E|x(s)-x(\delta_s)|^2\le\frac{3(\tau K_1^2+K_2^2)}{1-6\tau^2K_3^2}\int_{\delta_s}^s\mathbb E|x(z)|^2dz+\frac{6\tau^2K_3^2}{1-6\tau^2K_3^2}\mathbb E|x(s)|^2E∣x(s)−x(δs​)∣2≤1−6τ2K32​3(τK12​+K22​)​∫δs​s​E∣x(z)∣2dz+1−6τ2K32​6τ2K32​​E∣x(s)∣2.
  4. (3.23) sup⁡t≥0E∣x(t)∣2<∞\sup_{t\ge0}\mathbb E|x(t)|^2<\inftysupt≥0​E∣x(t)∣2<∞.
  5. ∣E∣x(t2)∣2−E∣x(t1)∣2∣≤C(t2−t1)|\mathbb E|x(t_2)|^2-\mathbb E|x(t_1)|^2|\le C(t_2-t_1)∣E∣x(t2​)∣2−E∣x(t1​)∣2∣≤C(t2​−t1​).
  6. Theorem 3.3: lim⁡t→∞E∣x(t)∣2=0\lim_{t\to\infty}\mathbb E|x(t)|^2=0limt→∞​E∣x(t)∣2=0.
  7. (3.24)–(3.25): E∫0∞∣x(t)∣2dt<∞\mathbb E\int_0^\infty|x(t)|^2dt<\inftyE∫0∞​∣x(t)∣2dt<∞ and lim inf⁡t→∞∣x(t)∣=0\liminf_{t\to\infty}|x(t)|=0liminft→∞​∣x(t)∣=0 a.s.
  8. (3.28): P(∃t:∣x(t)∣≥h)≤C/h2\mathbb P(\exists t:|x(t)|\ge h)\le C/h^2P(∃t:∣x(t)∣≥h)≤C/h2 for h>∣x0∣h>|x_0|h>∣x0​∣.

Significance

The result. Theorem 3.4 says that a controller sampling the state at rate 1/τ1/\tau1/τ makes almost every trajectory of the switching system converge to the equilibrium, with an explicit, checkable bound (3.5) on τ\tauτ. Mean-square convergence (Theorem 3.3) does not imply almost sure convergence in general, and a single trajectory is what an operator observes, so the pathwise statement is the one relevant to a deployed system. Condition (3.5) is stated in terms of the constants of Assumptions 2.1, 2.2 and 3.1, so for a concrete system (Section 6 of the paper) it gives a numerical bound on the observation interval.

Formalizing it. The results are proved in the paper; none of them is machine-checked. Mathlib has real Brownian motion but no Itô integral, no stochastic differential equations and no continuous-time Markov chains. The mission therefore also produces a reusable definition layer: a filtration under the usual conditions, a multidimensional {Ft}\{\mathcal F_t\}{Ft​}-Brownian motion, an {Ft}\{\mathcal F_t\}{Ft​}-Markov chain with a given generator, the L2L^2L2 Itô integral of vector-valued integrands, and the solution notion of an SDE with Markovian switching and a sampled-state delay. A related but different layer exists on Prove2Me for Ethier–Kurtz (EthierKurtz_IsStandardBrownian, EthierKurtz_HasBrownianItoIntegral, EthierKurtz_SolvesBrownianSDE); it has no mode switching and no sampled state, so it cannot express (2.1).

Difficulty

Equation (2.1) is a stochastic differential delay equation with the delay t−δtt-\delta_tt−δt​, which is bounded but jumps at every observation time and has derivative 111 in between. The stability theorems for hybrid delay equations in the literature require a differentiable delay with derivative less than one (Mao–Yuan, p. 285), so they do not apply. Applying LU\mathcal LULU directly to U(x(t),r(t),t)U(x(t),r(t),t)U(x(t),r(t),t) leaves the term Ux[u(x(t))−u(x(δt))]U_x[u(x(t))-u(x(\delta_t))]Ux​[u(x(t))−u(x(δt​))], which has no sign and depends on the path over a whole observation interval, so a Lyapunov function of the current state alone does not close the argument.

For the goal, the natural first idea, deducing almost sure convergence from E∣x(t)∣2→0\mathbb E|x(t)|^2\to0E∣x(t)∣2→0 or from ∫0∞∣x(t)∣2dt<∞\int_0^\infty|x(t)|^2dt<\infty∫0∞​∣x(t)∣2dt<∞ a.s., fails: both are compatible with paths that make ever shorter excursions away from 000. The obstacle is to exclude infinitely many excursions of a fixed size, which neither moment statement controls.

Formalization scope

Conventions committed to in Lean:

  • The state space is EuclideanSpace ℝ (Fin n), so ∣x∣|x|∣x∣ is the Euclidean norm; the explicit constants in (3.5) and (3.21) depend on it. The diffusion ggg is given by its mmm columns and ∣g∣2=∑k∣gk∣2|g|^2=\sum_k|g_k|^2∣g∣2=∑k​∣gk​∣2 (trace norm). Modes are Fin N (0-based). Time is ℝ≥0; time integrals are over subsets of R\mathbb RR at s.toNNReal.
  • Every expectation E∣⋅∣2\mathbb E|\cdot|^2E∣⋅∣2 and every time integral of a nonnegative quantity is a lower Lebesgue integral in [0,∞][0,\infty][0,∞], so a non-integrable process cannot produce a junk value 000.
  • "The solution of (2.1)" is read as every process satisfying the solution definition: progressively measurable, almost surely continuous paths, E∣x(t)∣2<∞\mathbb E|x(t)|^2<\inftyE∣x(t)∣2<∞ for each ttt, and for each ttt, almost surely, the integral equation with Itô integrals in the L2L^2L2 sense. Existence and uniqueness (cited from Mao–Yuan on p. 908) are not asserted.
  • "An mmm-dimensional Brownian motion" and "a Markov chain with generator Γ\GammaΓ" are read in the Mao–Yuan framework the paper cites: an {Ft}\{\mathcal F_t\}{Ft​}-Brownian motion with independent coordinates and increments independent of the past, and an {Ft}\{\mathcal F_t\}{Ft​}-Markov chain with transition matrix etΓe^{t\Gamma}etΓ. The usual conditions are kept as hypotheses.
  • "Locally Lipschitz" is uniform in the mode and time on each ball. C2,1C^{2,1}C2,1 carries its derivatives Ut,Ux,UxxU_t,U_x,U_{xx}Ut​,Ux​,Uxx​ as witnesses tied to UUU by derivative relations and joint continuity.
  • "τ>0\tau>0τ>0 sufficiently small for (3.5)" means every τ>0\tau>0τ>0 satisfying both inequalities of (3.5). U,λ1,λ2,τU,\lambda_1,\lambda_2,\tauU,λ1​,λ2​,τ are data of each statement. The paper's "CCC denotes a positive constant" is an existential chosen after x0x_0x0​, r0r_0r0​ and the solution, and before the time variables and hhh.
  • (3.15) and (3.21) are stated under fewer hypotheses than the surrounding proof has (Assumptions 2.1, 2.2, τ>0\tau>0τ>0, and for (3.21) τ≤1/(4K3)\tau\le1/(4K_3)τ≤1/(4K3​)), because their derivations use no more. Misprints on the page (for example g(x,i,s)=f(x,i,0)g(x,i,s)=f(x,i,0)g(x,i,s)=f(x,i,0) on p. 909 and the swapped definitions of ∨,∧\vee,\wedge∨,∧ on p. 907) are not formalized.

A trivializing formalization is ruled out: the expectations are not Bochner integrals (which vanish for non-integrable integrands), the solution notion admits the true solution and requires path continuity, the derivative witnesses of UUU are tied to UUU, and a sorry-free check shows that the data hypotheses (Assumptions 2.1, 2.2, 3.1, C2,1C^{2,1}C2,1, (3.5)) are satisfiable, for example by n=m=N=1n=m=N=1n=m=N=1, f=g=0f=g=0f=g=0, u(x)=−xu(x)=-xu(x)=−x, U=∣x∣2U=|x|^2U=∣x∣2, λ1=1/4\lambda_1=1/4λ1​=1/4, λ2=1\lambda_2=1λ2​=1, τ=1/10\tau=1/10τ=1/10.

Welcome contributions: the Itô isometry and Itô's formula for the L2L^2L2 integral defined here, a generalized Itô formula for functions of a Markov-modulated Itô process, and Doob's maximal inequality in continuous time. These are reusable far beyond this mission. Section 4 of the paper (exponential stability) is a separate mission of the same series.

Selected references

  • S. You, W. Liu, J. Lu, X. Mao, Q. Qiu, Stabilization of Hybrid Systems by Feedback Control Based on Discrete-Time State Observations, SIAM J. Control Optim. 53(2), 905–925, 2015. https://doi.org/10.1137/140985779
  • X. Mao, C. Yuan, Stochastic Differential Equations with Markovian Switching, Imperial College Press, 2006. https://doi.org/10.1142/p473
  • X. Mao, Stabilization of continuous-time hybrid stochastic differential equations by discrete-time feedback control, Automatica 49(12), 3677–3681, 2013. https://doi.org/10.1016/j.automatica.2013.09.005
13 thms1 active userReviewed
CombinatoricsFormal Verification·Captain: Rizwan G Mir

Bound L4: 33,070,982 <= R Reversible Binary 2D Moore RulesOpen Problem

Bound L4L_4L4​: 33,070,982≤R33,070,982 \le R33,070,982≤R

This mission formalizes the lower bound 33,070,982≤R33,070,982 \le R33,070,982≤R on the number of reversible binary cellular automata on the 3×33 \times 33×3 Moore neighborhood. Extending the conserved-landscape marker families to both centered and off-centered rules.

1 thm1 active userReviewed
PreviousPage 4 of 4Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me