A Label-State Formulation of Stochastic Graphon Games and Approximate Equilibria on Large Networks: Graphon Equilibrium Controls Give n-Player ε-Nash Equilibria With Average Error → 0Research Paper
Motivation
Large games on networks arise whenever many agents interact only with their neighbors: firms in a supply network, banks linked by exposures, users of a congested service, or individuals in an epidemic. A Nash equilibrium of an -player stochastic differential game with heterogeneous interactions is a fixed point over coupled control problems, and computing one is out of reach for large . Mean field game theory resolves this when interactions are symmetric, by passing to a single representative player facing a population distribution. It does not apply when each player sees a different weighted, directed neighborhood.
Graphon games replace the population by a continuum of players indexed by a label , with interaction strengths given by a kernel . D. Lacker and A. Soret (arXiv:2204.09642) formulate stochastic graphon games in label-state form: one typical player carries a uniform random label together with its state , and an equilibrium is a flow of joint laws . This mission formalizes their approximation theorem, which says that such an equilibrium yields approximate Nash equilibria for every large network whose interaction matrices converge to .
Timeline. Graphons, the limits of dense graph sequences, are surveyed by Lovász (2012). Caines and Huang (arXiv:1810.11234, 2018) introduced graphon mean field games in which each node carries a subpopulation. Carmona, Cooney, Graves and Laurière (arXiv:1910.03983) studied static graphon games, and Aurell, Carmona and Laurière (arXiv:2003.11896) the linear-quadratic stochastic case, handling a continuum of independent Brownian motions through Fubini extensions. Lacker and Soret (2022) replaced the continuum of players by one random label, which removes that measurability problem and admits unbounded, non-symmetric kernels and sparse networks.
Setting
Fix dimensions , a horizon , a compact metric action space , and bounded continuous coefficients , , running reward and terminal reward , where ranges over the finite nonnegative measures with the weak topology. is Lipschitz, with , and is convex.
-player game. Player chooses a measurable feedback , and with independent Brownian motions. A nonnegative interaction matrix with zero diagonal defines the neighborhood empirical measure , and player maximizes .
Kernels. A kernel is a nonnegative integrable on , neither bounded nor symmetric in general. With and , the step kernel of is on . in the strong operator topology if for every bounded . A measure on is mapped to .
Graphon game. A typical player has with , uses , and faces the measure . A flow is a -equilibrium with control if maximizes and .
Errors. Player receives a label , uses and starts from . Its error is the largest gain from a unilateral deviation .
Formalization targets
Goal: Theorem 3.6
If has a tight version, in the strong operator topology, , and are independent, then
Milestones
- Lemma 4.1: continuity of on measures with uniform first marginal.
- (6.1) and (6.4): averaging over labels, and a uniform bound on .
- Theorem 6.1: a law of large numbers for neighborhood empirical measures.
- Remark 4.6 (4.10) and (5.1): Markovian controls achieve the relaxed value.
- Lemma 5.1 and Lemma 7.1: optimality survives freezing the label, so deviations gain nothing against the graphon limit.
- The tightness claim of p.34 and the decomposition (7.4).
Significance
The theorem lets one solve a single label-state equilibrium problem and use its feedback on any large network close to , including sparse Erdős–Rényi graphs rescaled by and random-walk Laplacians, both covered because kernels may be unbounded. The approximation holds in an averaged sense over players and random labels, which the paper shows is the natural mode under strong operator convergence alone. Stronger modes (Theorems 3.9 and 3.13) need continuity assumptions.
The result is proved on paper. To our knowledge none of it is formalized. A formal proof requires a law of large numbers for weighted empirical measures, the equality of Markovian and relaxed values for controlled diffusions, and a tightness estimate for SDE laws. The relaxed-control layer is reusable for any mean field game formalization.
Difficulty
The obvious argument decomposes into an optimality term and two empirical-measure errors. The optimality term fails naively: the deviation may depend on all states, so it is not a control of the graphon game, and is optimal only for the random label, not for each fixed label. Both gaps are closed through the relaxed formulation, (4.10) and (5.1), which is a Markovian projection theorem. The empirical-measure terms require a law of large numbers under strong operator convergence with unbounded weights, where only controls the variance.
Formalization scope
States live in as Fin d → ℝ, paths in , time is read on , and is FiniteMeasure. Solutions of the state equations are relations: a filtered probability space, independent -Brownian motions, continuous adapted states and Itô integrals (Peng1990_SMP_Stochastic). Statements quantify over all solutions, which are unique in law under the standing assumptions. is valued in , and is the outer integral, so that a non-measurable error cannot be read as zero. is set to zero on the null set of labels where its mass is infinite. The initial disintegration is a fixed Markov kernel with .
The equilibrium hypothesis is Definition 3.1 exactly. Weakening it, for instance by requiring optimality only against deterministic initial states, would make the goal vacuous, and the formalization does not do so. Contributions are welcome on the Markovian projection, on tightness of controlled diffusions, and on weak convergence in .
Selected references
- D. Lacker, A. Soret, A Label-State Formulation of Stochastic Graphon Games and Approximate Equilibria on Large Networks, arXiv:2204.09642v1, 2022; Mathematics of Operations Research, 2023. https://arxiv.org/abs/2204.09642
- P. E. Caines, M. Huang, Graphon Mean Field Games and the GMFG Equations, arXiv:1810.11234, 2018. https://arxiv.org/abs/1810.11234
- R. Carmona, D. Cooney, C. Graves, M. Laurière, Stochastic Graphon Games: I. The Static Case, Mathematics of Operations Research, 2022. https://arxiv.org/abs/1910.03983
- A. Aurell, R. Carmona, M. Laurière, Stochastic Graphon Games: II. The Linear-Quadratic Case, Applied Mathematics & Optimization, 2022. https://arxiv.org/abs/2003.11896
- L. Lovász, Large Networks and Graph Limits, AMS Colloquium Publications 60, 2012. https://doi.org/10.1090/coll/060