A Case Study on Stochastic Games on Large Graphs in Mean Field and Sparse Regimes I: An Explicit Markovian Nash Equilibrium on Every Finite Transitive GraphResearch Paper
Motivation
Mean field games describe Nash equilibria of large populations in which every player interacts with every other player symmetrically, through the empirical distribution of all states. Many systems of interest are not of this kind: agents in a network interact only with their neighbours, and the interaction structure is a graph rather than a complete graph. Understanding when equilibria on large graphs behave like mean field equilibria, and when they do not, requires models in which the equilibrium on a finite graph can be computed exactly.
Lacker and Soret (arXiv:2005.14102v2, Math. Oper. Res. 2022) introduced such a model: a linear–quadratic flocking game on an arbitrary finite graph, in which each player steers a Brownian particle and pays a terminal penalty for being far from the average of her neighbours. For vertex-transitive graphs they solved the game in closed form, up to a scalar ODE, with an equilibrium that depends on the graph only through the spectrum of its Laplacian. This mission formalizes that finite-graph result, Theorem 2.5 of the paper. Its large-graph consequences are the subject of missions II and III of this series.
Setting
Let be a finite simple graph on vertices , with adjacency matrix and degree matrix . When has no isolated vertices its random-walk Laplacian is
is transitive if for every two vertices there is a graph automorphism mapping to . A transitive graph is regular, so its Laplacian is symmetric, with eigenvalues in .
Fix a horizon , a noise level and a cost constant . Each vertex is a player with state
driven by independent Brownian motions , from a non-random initial state . A Markovian control is a Borel function of time and the full state vector with at most linear growth. Player minimises
A profile is a Markovian Nash equilibrium if no player can lower her cost by switching unilaterally to another Markovian control.
The equilibrium is built from
Formalization targets
Goal: Theorem 2.5
For a finite transitive graph without isolated vertices:
- is well defined and continuously differentiable on , and the ODE has a unique solution .
- is a Markovian Nash equilibrium for every initial state.
- For every , the equilibrium state is Gaussian with
- The average equilibrium cost satisfies
All four parts are in the goal statement.
Milestones
The milestones follow the paper's proof in §2.2, §3 and §4.
- Graph-spectral facts. Transitive graphs are regular with symmetric (§2.2). The spectrum of lies in (Remark 2.4). The eigenvalue distribution has mean ((3.2)), and (§2.3).
- The ODE. Bounds on and its first two derivatives (Proposition 3.1), and well-posedness of with explicit bounds (Proposition 3.2).
- Symmetry. Commutation of with automorphism matrices, and constancy of the diagonal of equivariant matrices (Lemma 4.1).
- The Riccati system. The properties of (§4.4 (i)–(iii)), the reduction of the Nash PDE system to matrix Riccati equations (Lemma 4.2), and the verification that the explicit solve them (§4.4).
- Law and value. The fundamental matrix (§4.5) and the averaged value identity (§4.6).
Significance
The result. Theorem 2.5 is one of the few explicit Nash equilibria of a stochastic differential game on a non-complete graph. Two features of it are not visible in mean field theory. The equilibrium controls are nonlocal: each player reacts to the whole state vector, not only to her neighbours. The whole equilibrium (law, value, controls) depends on the graph only through the spectrum of . The second feature drives the paper's later results. Weak convergence of the eigenvalue distributions yields limits of the equilibrium, and these separate the dense regime, where the mean field approximation is valid, from the sparse regime, where it is not.
Formalizing it. The result is proved in the paper; nothing here is open. No machine-checked version of it or of its ingredients exists: the random-walk Laplacian of a graph, linear–quadratic stochastic differential games, verification theorems for Nash systems, and Gaussian laws of linear SDEs with time-dependent coefficients. The mission produces a checked statement of the equilibrium together with reusable layers: spectral facts about , an ODE analysis for , and a Riccati reduction for quadratic Nash systems.
Difficulty
Three steps resist a direct approach.
- The verification theorem. The paper passes from a classical solution of the Nash system (4.1) to a Nash equilibrium by appeal to a standard verification argument. Over the full class of Borel controls with linear growth, this requires Itô's formula for the quadratic value functions, together with integrability of the deviated state processes.
- The Riccati system. The coupled matrix equations (4.6) have no general closed-form solution. The explicit solution exists only because transitivity forces for every . That identity has to be derived from the action of the automorphism group (Lemma 4.1), not from regularity alone.
- The law of the state. It requires solving a linear SDE with a time-dependent matrix and identifying its Gaussian law, a step for which the library has little support.
Formalization scope
Lean conventions:
- Vertices. The vertex set is
Fin n, so the paper's become . The state space is the platform'sEthierKurtz.SDEState n(Euclidean ). - The Laplacian. is the random-walk Laplacian , not Mathlib's .
- Time and controls. Time is real. Controls are Borel on with linear growth on ; their values off are never used.
- Solutions of (2.1). A solution is a pathwise strong solution on a probability space that the solution itself carries, adapted to the completed Brownian filtration. Costs are compared across solutions; this is faithful because (2.1) has a unique strong solution.
- Costs are -valued lower Lebesgue integrals. They are converted to reals only after their finiteness is asserted.
- Existence of the equilibrium state. The goal also asserts that the equilibrium state equation has a solution, so that the Nash property cannot hold vacuously.
- Derivatives. is written as its ODE value . The ODE is solved on with one-sided derivatives at the endpoints, and uniqueness is agreement on .
- Matrix conventions. Covariance integrals are entrywise. Gaussian laws are Mathlib's
multivariateGaussian. - Added hypotheses. is added to three milestones that are false on the empty graph.
A formalization that fixes , restricts deviations to linear controls, drops the existence of the equilibrium state process, or replaces by is not this theorem.
Infrastructure that a complete development needs:
- symmetric-matrix spectral calculus for and for the matrix functions and ;
- differentiation under the integral for ;
- Picard–Lindelöf and Grönwall on ;
- Itô's formula for quadratic functions of a diffusion with additive noise;
- the Gaussian law of for deterministic .
The spectral, ODE and Riccati layers are reusable beyond this mission. Proofs of individual milestones are welcome; so are general verification theorems for linear–quadratic games.
Selected references
- D. Lacker, A. Soret, A case study on stochastic games on large graphs in mean field and sparse regimes, arXiv:2005.14102v2, 2021; Math. Oper. Res. 47(2), 2022. https://arxiv.org/abs/2005.14102
- F. Chung, Spectral Graph Theory, CBMS Regional Conference Series in Mathematics 92, AMS, 1997. https://doi.org/10.1090/cbms/092
- R. Carmona, F. Delarue, Probabilistic Theory of Mean Field Games with Applications I, Springer, 2018. https://doi.org/10.1007/978-3-319-58920-6
- A. Veretennikov, On strong solutions and explicit formulas for solutions of stochastic integral equations, Math. USSR-Sb. 39(3), 1981. https://doi.org/10.1070/SM1981v039n03ABEH001522