Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Graph Theory

345 missions · 143 completed

Missions

Open202Completed143All345
CombinatoricsLinear OptimizationOperations Research·Captain: Shuze Chen

Flows in Networks III: The Circulation TheoremTextbook

Motivation

Many questions in operations research and combinatorics ask whether a system of linear inequalities on a network has a solution: can the demands at a set of warehouses be met from the supplies at a set of factories through roads of limited capacity; is there a nonnegative matrix with bounded entries whose row and column sums lie between given limits; can a periodic schedule be met when every activity has a minimum and a maximum rate. Chapter II of L. R. Ford, Jr. and D. R. Fulkerson's Flows in Networks (RAND Report R-375-PR, 1962; Princeton University Press, 1962, doi:10.1515/9781400875184) answers these questions by feasibility theorems: a system of flow constraints has a solution exactly when a family of inequalities, one for each set of nodes, holds.

The history in the chapter's first three sections is short. D. Gale proved the supply-demand theorem in 1957 (A theorem on flows in networks, Pacific J. Math. 7 (1957) 1073–1082). A. J. Hoffman proved the circulation theorem, with lower and upper bounds on every arc, in 1960 (Some recent applications of the theory of linear inequalities to extremal combinatorial analysis, Proc. Sympos. Appl. Math. 10, AMS, 1960), originally through the separation theorem for convex sets. Ford and Fulkerson derive all of these, and the two-sided variants, from the max flow min cut theorem of their Chapter I.

Setting

A network [N;A][N; \mathcal A][N;A] is a finite set NNN of nodes together with a set A\mathcal AA of ordered pairs (x,y)(x, y)(x,y) of distinct nodes, the arcs; there is at most one arc from xxx to yyy, but both (x,y)(x, y)(x,y) and (y,x)(y, x)(y,x) may be arcs. Each arc carries a real capacity c(x,y)≥0c(x, y) \ge 0c(x,y)≥0. For a real function ggg on the arcs and node sets X,Y⊆NX, Y \subseteq NX,Y⊆N,

g(X,Y)=∑(x,y)∈A, x∈X, y∈Yg(x,y),g(X, Y) = \sum_{(x, y) \in \mathcal A,\ x \in X,\ y \in Y} g(x, y),g(X,Y)=(x,y)∈A, x∈X, y∈Y∑​g(x,y),

so f(x,N)f(x, N)f(x,N) is the total of fff on arcs leaving xxx and f(N,x)f(N, x)f(N,x) the total on arcs entering xxx. For a node set XXX, Xˉ=N−X\bar X = N - XXˉ=N−X; for a node function aaa, a(X)=∑x∈Xa(x)a(X) = \sum_{x \in X} a(x)a(X)=∑x∈X​a(x).

In §§1–2 the nodes are partitioned into sources SSS, intermediate nodes RRR and sinks TTT (any of them may be empty). Sources carry a supply a(x)≥0a(x) \ge 0a(x)≥0, sinks a demand b(x)≥0b(x) \ge 0b(x)≥0. A function fff on the arcs is a feasible flow for the supply-demand problem when the net outflow f(x,N)−f(N,x)f(x, N) - f(N, x)f(x,N)−f(N,x) is at most a(x)a(x)a(x) at every source, zero at every intermediate node, the net inflow f(N,x)−f(x,N)f(N, x) - f(x, N)f(N,x)−f(x,N) is at least b(x)b(x)b(x) at every sink, and 0≤f≤c0 \le f \le c0≤f≤c on every arc.

In §3 there are no distinguished nodes. A lower bound function ℓ\ellℓ with 0≤ℓ≤c0 \le \ell \le c0≤ℓ≤c is given on the arcs, and a feasible circulation is a function fff on the arcs with

f(x,N)−f(N,x)=0  (x∈N),ℓ(x,y)≤f(x,y)≤c(x,y)  ((x,y)∈A).f(x, N) - f(N, x) = 0 \ \ (x \in N), \qquad \ell(x, y) \le f(x, y) \le c(x, y) \ \ ((x, y) \in \mathcal A).f(x,N)−f(N,x)=0  (x∈N),ℓ(x,y)≤f(x,y)≤c(x,y)  ((x,y)∈A).

Formalization targets

Goal: Hoffman's circulation theorem (Chapter II, Theorem 3.1, p. 26)

For a network with capacities ccc and lower bounds 0≤ℓ≤c0 \le \ell \le c0≤ℓ≤c, a feasible circulation exists if and only if

c(X,Xˉ)≥ℓ(Xˉ,X)for all X⊆N.c(X, \bar X) \ge \ell(\bar X, X) \quad \text{for all } X \subseteq N.c(X,Xˉ)≥ℓ(Xˉ,X)for all X⊆N.

Milestones

  1. Theorem 1.1 (p. 4), Gale's supply-demand theorem. The supply-demand constraints are feasible if and only if b(T∩Xˉ)−a(S∩Xˉ)≤c(X,Xˉ)b(T \cap \bar X) - a(S \cap \bar X) \le c(X, \bar X)b(T∩Xˉ)−a(S∩Xˉ)≤c(X,Xˉ) for every X⊆NX \subseteq NX⊆N.
  2. Corollary 1.2 (p. 7). They are feasible if and only if for every T′⊆TT' \subseteq TT′⊆T some flow respecting the supplies, conservation and capacities delivers fT′(N,T′)−fT′(T′,N)≥b(T′)f_{T'}(N, T') - f_{T'}(T', N) \ge b(T')fT′​(N,T′)−fT′​(T′,N)≥b(T′).
  3. Theorem 2.1 (p. 21). With two-sided bounds 0≤a≤a′0 \le a \le a'0≤a≤a′ on the net outflow at sources and 0≤b≤b′0 \le b \le b'0≤b≤b′ on the net inflow at sinks, feasibility holds if and only if, for all X⊆NX \subseteq NX⊆N,
c(X,Xˉ)≥b(T∩Xˉ)−a′(S∩Xˉ),c(X,Xˉ)≥a(S∩X)−b′(T∩X).c(X, \bar X) \ge b(T \cap \bar X) - a'(S \cap \bar X), \qquad c(X, \bar X) \ge a(S \cap X) - b'(T \cap X).c(X,Xˉ)≥b(T∩Xˉ)−a′(S∩Xˉ),c(X,Xˉ)≥a(S∩X)−b′(T∩X).
  1. Corollary 2.2 (p. 22). The two-sided system is feasible if and only if each of the two one-sided systems (lower bound at sources with upper bound at sinks; upper bound at sources with lower bound at sinks) is feasible.
  2. Corollary 2.3 (p. 23). For 0≤ai≤ai′0 \le a_i \le a'_i0≤ai​≤ai′​, 0≤bj≤bj′0 \le b_j \le b'_j0≤bj​≤bj′​, cij≥0c_{ij} \ge 0cij​≥0: if one m×nm \times nm×n matrix meets ai≤∑jfija_i \le \sum_j f_{ij}ai​≤∑j​fij​, ∑ifij≤bj′\sum_i f_{ij} \le b'_j∑i​fij​≤bj′​ and another meets ∑jfij≤ai′\sum_j f_{ij} \le a'_i∑j​fij​≤ai′​, bj≤∑ifijb_j \le \sum_i f_{ij}bj​≤∑i​fij​, both with 0≤fij≤cij0 \le f_{ij} \le c_{ij}0≤fij​≤cij​, then a single matrix meets all four row and column limits with 0≤fij≤cij0 \le f_{ij} \le c_{ij}0≤fij​≤cij​.
  3. Theorem 3.2 (p. 28). With node bounds a≤a′a \le a'a≤a′ (no sign condition) on the net inflow f(N,x)−f(x,N)f(N, x) - f(x, N)f(N,x)−f(x,N) at every node and arc bounds 0≤ℓ≤c0 \le \ell \le c0≤ℓ≤c, feasibility holds if and only if
c(X,Xˉ)≥ℓ(Xˉ,X)+max⁡ [a(Xˉ),−a′(X)]for all X⊆N.c(X, \bar X) \ge \ell(\bar X, X) + \max\,[a(\bar X), -a'(X)] \quad \text{for all } X \subseteq N.c(X,Xˉ)≥ℓ(Xˉ,X)+max[a(Xˉ),−a′(X)]for all X⊆N.

With a=a′=0a = a' = 0a=a′=0 this is the goal.

Significance

The circulation theorem is the most general of the chapter's feasibility criteria for directed networks: the supply-demand theorem, the existence of sss–ttt flows between lower and upper arc bounds (Chapter I, §9), and the transportation-matrix criterion of Corollary 2.3 all follow from it or from its extension, Theorem 3.2, by adjoining arcs, and the rest of Chapter II applies them to systems of distinct representatives and (0, 1)-matrices.

All results of the mission have been proved for more than sixty years. None of them, in this form, is formalized on Prove2Me: the platform has decomposition results for circulations and max flow min cut statements in other conventions, but no Gale or Hoffman feasibility criterion. The mission produces machine-checked versions of the six numbered results and the goal over one shared notion of network, in the book's notation.

Difficulty

Necessity is the routine half of every theorem. Sufficiency asks for a flow built from a family of 2∣N∣2^{|N|}2∣N∣ inequalities, one per node set, and constructing a flow arc by arc or node by node with local repairs gives no argument that the repairs stop or that all constraints hold at once. The statements also differ in ways that are easy to get wrong: §§1–2 bound the net outflow at sources but the net inflow at sinks, §3 bounds the net inflow everywhere, the node bounds of Theorem 3.2 carry no sign condition and may be negative, and Theorem 2.1 needs two inequalities per node set rather than one. Real-valued data rule out any argument by induction on integer flow values without a separate limiting step.

Formalization scope

Nodes form a Fintype with decidable equality; arcs are a Finset (N × N) with no loops; capacities and flows are real functions N→N→RN \to N \to \mathbb RN→N→R. A flow is required to vanish off A\mathcal AA, and every sum g(X,Y)g(X, Y)g(X,Y) runs over arcs only, so the values of ccc and ℓ\ellℓ off A\mathcal AA never matter. Supplies, demands and node bounds are real functions on all of NNN whose values enter only through sums over the sets the book names (S∩XˉS \cap \bar XS∩Xˉ, T∩XT \cap XT∩X, …). The partition S,R,TS, R, TS,R,T is three pairwise disjoint Finsets covering NNN. XXX ranges over all subsets of NNN, including ∅\emptyset∅ and NNN. Each section's sign convention is copied: §§1–2 bound the net outflow at sources and the net inflow at sinks, §3 bounds the net inflow. Corollary 2.3 is stated for real matrices indexed by Fin m × Fin n. All data are finite reals; no integrality is assumed.

Feasibility is always stated as the existence of a function on the arcs satisfying the book's displayed constraints. Defining feasibility through the cut condition itself, or through a linear-programming solver predicate, would make every theorem definitional and is ruled out.

Beyond the paper. One variant is posed beside the faithful goal: [Strengthened] Theorem 3.1, the circulation theorem for any real lower bound ℓ≤c\ell \le cℓ≤c without ℓ≥0\ell \ge 0ℓ≥0 (capacities stay nonnegative). The substitution g=f−ℓg = f - \ellg=f−ℓ reduces it to a supply-demand problem with nonnegative capacities c−ℓc - \ellc−ℓ, whose Gale condition is c(X,Xˉ)≥ℓ(Xˉ,X)c(X, \bar X) \ge \ell(\bar X, X)c(X,Xˉ)≥ℓ(Xˉ,X) regardless of the sign of ℓ\ellℓ; it implies the faithful statement.

A complete development needs Chapter I's max flow min cut theorem in some form (or the linear-programming duality theorem, or Farkas' lemma), the manipulation of arc sums over node sets, and the auxiliary-network constructions. The definitions of networks, arc sums and partitions are reusable by the later Chapter II missions. Proofs of any milestone, of the variant, and alternative proofs through LP duality are welcome.

Selected references

  • L. R. Ford, Jr. and D. R. Fulkerson, Flows in Networks, The RAND Corporation, Report R-375-PR, 1962; Princeton University Press, 1962. doi:10.1515/9781400875184
  • D. Gale, A theorem on flows in networks, Pacific Journal of Mathematics 7 (1957), 1073–1082. doi:10.2140/pjm.1957.7.1073
  • A. J. Hoffman, Some recent applications of the theory of linear inequalities to extremal combinatorial analysis, Proceedings of Symposia in Applied Mathematics 10, American Mathematical Society, 1960, 113–127.
  • L. R. Ford, Jr. and D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8 (1956), 399–404. doi:10.4153/CJM-1956-045-5
8 thms1 active userReviewed
CombinatoricsConvex OptimizationOperations Research+1·Captain: Shuze Chen

Lectures on Modern Convex Optimization VI: Nesterov's π/2 Theorem for Semidefinite RelaxationsTextbook

Motivation

Many combinatorial and nonconvex problems can be written as the maximization or minimization of a quadratic form under quadratic constraints. Such problems are NP-hard in general, but each has a semidefinite relaxation: a convex problem over positive semidefinite matrices, solvable to any accuracy in polynomial time, whose optimal value bounds the original one. The relaxation is useful exactly to the extent that this bound is tight, and the quality of the bound is measured by an explicit approximation ratio.

Lecture 4 of Ben-Tal and Nemirovski, Lectures on Modern Convex Optimization (SIAM, 2001), develops this theory from first principles and proves the two classical ratios. The history it follows:

  • N. Z. Shor (1987) introduced the semidefinite relaxation scheme for quadratically constrained problems that §4.3.1 describes.
  • M. X. Goemans and D. P. Williamson (J. ACM 42, 1995, doi:10.1145/227683.227684) proved that for MAXCUT with nonnegative weights the semidefinite relaxation is within a factor 0.87856…0.87856\ldots0.87856… of the maximum cut.
  • Yu. Nesterov (1998, doi:10.1080/10556789808805690) proved that for the maximization of any positive semidefinite quadratic form over the vertices of the cube {−1,1}n\{-1,1\}^n{−1,1}n the relaxation is within a factor 2/π2/\pi2/π.
  • Nesterov and Y. Ye, and A. Nemirovski, C. Roos and T. Terlaky (doi:10.1007/s101070050100), extended such bounds to systems of quadratic inequalities, with factors π/2\pi/2π/2 (commuting constraints) and 2ln⁡(2∑iRank⁡Bi)2\ln(2\sum_i \operatorname{Rank} B_i)2ln(2∑i​RankBi​) (general convex constraints).

This mission formalizes the book's statements of these results.

Setting

Let AAA be a real symmetric n×nn\times nn×n matrix and let SnS_nSn​ be the set of vectors x∈Rnx \in \mathbb R^nx∈Rn with every coordinate equal to +1+1+1 or −1-1−1. The quadratic sign problem (4.3.17) is

OPT=max⁡x∈SnxTAx,\mathrm{OPT} = \max_{x\in S_n} x^TAx,OPT=x∈Sn​max​xTAx,

and its semidefinite relaxation (4.3.18) is

SDP=max⁡{Tr⁡(AX):X=XT⪰0, Xii=1, i=1,…,n},\mathrm{SDP} = \max\{\operatorname{Tr}(AX) : X = X^T \succeq 0,\ X_{ii} = 1,\ i = 1,\dots,n\},SDP=max{Tr(AX):X=XT⪰0, Xii​=1, i=1,…,n},

where X⪰0X \succeq 0X⪰0 means that XXX is symmetric positive semidefinite. Every x∈Snx \in S_nx∈Sn​ gives the feasible matrix X=xxTX = xx^TX=xxT, which is why SDP≥OPT\mathrm{SDP} \ge \mathrm{OPT}SDP≥OPT. For a matrix XXX, asin⁡[X]\operatorname{asin}[X]asin[X] denotes the matrix with entries asin⁡(Xij)\operatorname{asin}(X_{ij})asin(Xij​).

The MAXCUT problem (4.3.14) with weights aij=aji≥0a_{ij} = a_{ji} \ge 0aij​=aji​≥0 is max⁡{14∑i,jaij(1−xixj):xi2=1}\max\{\tfrac14\sum_{i,j}a_{ij}(1 - x_ix_j) : x_i^2 = 1\}max{41​∑i,j​aij​(1−xi​xj​):xi2​=1}, with relaxation (4.3.15) max⁡{14∑i,jaij(1−Xij):X=XT⪰0, Xii=1}\max\{\tfrac14\sum_{i,j}a_{ij}(1 - X_{ij}) : X = X^T \succeq 0,\ X_{ii} = 1\}max{41​∑i,j​aij​(1−Xij​):X=XT⪰0, Xii​=1}. The constant α=0.87856…\alpha = 0.87856\ldotsα=0.87856… is the largest α\alphaα with acos⁡(x)/π≥α⋅12(1−x)\operatorname{acos}(x)/\pi \ge \alpha\cdot\tfrac12(1 - x)acos(x)/π≥α⋅21​(1−x) for all x∈[−1,1]x \in [-1, 1]x∈[−1,1].

The general quadratically constrained problem (4.3.5) minimizes f0(x)=xTA0x+2b0Tx+c0f_0(x) = x^TA_0x + 2b_0^Tx + c_0f0​(x)=xTA0​x+2b0T​x+c0​ subject to fi(x)=xTAix+2biTx+ci=0f_i(x) = x^TA_ix + 2b_i^Tx + c_i = 0fi​(x)=xTAi​x+2biT​x+ci​=0, i=1,…,mi = 1, \dots, mi=1,…,m. Its Lagrangian lower bound (4.3.9) and Shor's relaxation (4.3.11) are semidefinite programs built from the bordered matrices Aˉi=(cibiTbiAi)\bar A_i = \begin{pmatrix} c_i & b_i^T\\ b_i & A_i\end{pmatrix}Aˉi​=(ci​bi​​biT​Ai​​).

Finally, the setting (SL.??) of the exercises takes a system xTBix≤dix^TB_ix \le d_ixTBi​x≤di​, i=1,…,mi = 1,\dots,mi=1,…,m, with di≥0d_i \ge 0di​≥0, the value f∗=max⁡{xTAx:xTBix≤di}f^* = \max\{x^TAx : x^TB_ix \le d_i\}f∗=max{xTAx:xTBi​x≤di​}, the relaxation value F∗=max⁡{Tr⁡(AX):Tr⁡(BiX)≤di, X⪰0}F^* = \max\{\operatorname{Tr}(AX) : \operatorname{Tr}(B_iX) \le d_i,\ X \succeq 0\}F∗=max{Tr(AX):Tr(Bi​X)≤di​, X⪰0}, and the dual (SDD) min⁡{∑iλidi:∑iλiBi⪰A, λ≥0}\min\{\sum_i\lambda_id_i : \sum_i\lambda_iB_i \succeq A,\ \lambda \ge 0\}min{∑i​λi​di​:∑i​λi​Bi​⪰A, λ≥0}.

Formalization targets

Goal: Nesterov's theorem (Theorem 4.3.2, p. 173)

For every positive semidefinite AAA,

SDP≥OPT≥2π SDP[2π=0.6366…].\mathrm{SDP} \ge \mathrm{OPT} \ge \frac{2}{\pi}\,\mathrm{SDP} \qquad \Big[\tfrac2\pi = 0.6366\ldots\Big].SDP≥OPT≥π2​SDP[π2​=0.6366…].

The constant 2/π2/\pi2/π is the book's, stated exactly.

Milestones

  1. Simple lemma (p. 163): xTAx+2bTx+c≥0x^TAx + 2b^Tx + c \ge 0xTAx+2bTx+c≥0 for all xxx if and only if (cbTbA)⪰0\begin{pmatrix} c & b^T\\ b & A\end{pmatrix} \succeq 0(cb​bTA​)⪰0.
  2. Proposition 4.3.1 (p. 163): the optimal value of (4.3.9) is at most that of (4.3.5).
  3. Proposition 4.3.2 (p. 164): the optimal value of Shor's relaxation (4.3.11) is at most that of (4.3.5).
  4. Theorem 4.3.1 (p. 171, Goemans–Williamson): OPT≤SDP\mathrm{OPT} \le \mathrm{SDP}OPT≤SDP and α⋅SDP≤OPT\alpha\cdot\mathrm{SDP} \le \mathrm{OPT}α⋅SDP≤OPT for MAXCUT, α=0.87856…\alpha = 0.87856\ldotsα=0.87856….
  5. Lemma 4.3.1 (p. 174): for every feasible XXX of (4.3.18), OPT≥2π∑i,jaijasin⁡(Xij)\mathrm{OPT} \ge \frac2\pi\sum_{i,j}a_{ij}\operatorname{asin}(X_{ij})OPT≥π2​∑i,j​aij​asin(Xij​), and consequently OPT≥2πmax⁡{Tr⁡(Aasin⁡[X])∣X⪰0, Xii=1}\mathrm{OPT} \ge \frac2\pi\max\{\operatorname{Tr}(A\operatorname{asin}[X]) \mid X \succeq 0,\ X_{ii} = 1\}OPT≥π2​max{Tr(Aasin[X])∣X⪰0, Xii​=1} (4.3.19).
  6. Nesterov's observation (p. 174): asin⁡[X]⪰X\operatorname{asin}[X] \succeq Xasin[X]⪰X for every positive semidefinite XXX with ∣Xij∣≤1|X_{ij}| \le 1∣Xij​∣≤1.
  7. Proposition 4.10.5 (pp. 314–315, Nesterov–Ye): if the BiB_iBi​ commute, the system is strictly feasible, some nonnegative combination of the BiB_iBi​ is positive definite and A⪰0A \succeq 0A⪰0, then f∗≥0f^* \ge 0f∗≥0, (SDD) is solvable with optimal value F∗F^*F∗, and F∗≤π2f∗F^* \le \frac\pi2 f^*F∗≤2π​f∗.
  8. Proposition 4.10.6 (p. 315, Nemirovski–Roos–Terlaky): if Bi⪰0B_i \succeq 0Bi​⪰0, di>0d_i > 0di​>0 and ∑iBi≻0\sum_iB_i \succ 0∑i​Bi​≻0, then f∗≥0f^* \ge 0f∗≥0, (SDD) is solvable with optimal value F∗F^*F∗, and F∗≤2ln⁡(2∑i=1mRank⁡(Bi))f∗F^* \le 2\ln\big(2\sum_{i=1}^m\operatorname{Rank}(B_i)\big)f^*F∗≤2ln(2∑i=1m​Rank(Bi​))f∗.

Significance

Nesterov's theorem was the first constant-factor guarantee for semidefinite relaxation of a quadratic program whose objective is not a cut function, and it holds for every positive semidefinite form, including those arising in graph partitioning and in robust optimization. Together with the Goemans–Williamson theorem it underlies the matrix cube theorem and the approximate S-lemma later in the book, and the general logarithmic bound of Proposition 4.10.6 is the template for many approximation results in robust and chance-constrained optimization.

All statements of this mission are proved in the literature. On Prove2Me, a Goemans–Williamson statement exists in another form (the expected value of Gaussian rounding against the integer optimum, with constant 0.8780.8780.878), and a constant-factor bound for the same objects as the goal exists with a much weaker constant (2K2K2K with K≤288K \le 288K≤288, via Grothendieck's inequality). Neither the factor 2/π2/\pi2/π nor the exact constant 0.87856…0.87856\ldots0.87856… nor the bounds of Propositions 4.10.5–4.10.6 has a machine-checked statement or proof. Formalizing them also yields reusable infrastructure: optimal values of semidefinite programs as explicit predicates, the elliptope {X⪰0,Xii=1}\{X \succeq 0, X_{ii} = 1\}{X⪰0,Xii​=1}, and entrywise matrix functions.

Difficulty

The upper bounds (SDP≥OPT\mathrm{SDP} \ge \mathrm{OPT}SDP≥OPT, Propositions 4.3.1–4.3.2) are the routine part. The lower bounds compare a continuous relaxation with a discrete optimum, and the book's constants (2/π2/\pi2/π, 0.87856…0.87856\ldots0.87856…, π/2\pi/2π/2, 2ln⁡(2∑iRank⁡Bi)2\ln(2\sum_i\operatorname{Rank}B_i)2ln(2∑i​RankBi​)) leave no slack: an argument that loses any constant factor proves a different theorem. No feasible matrix of the relaxation is in general close to a rank-one matrix xxTxx^TxxT with x∈Snx \in S_nx∈Sn​, so the obvious idea of reading a sign vector off an optimal XXX directly gives no factor at all. The objects involved also go beyond what Mathlib packages: optimal values of semidefinite programs, entrywise transcendental functions of matrices, and, for Propositions 4.10.5–4.10.6, duality between (SDP) and (SDD).

Formalization scope

Vectors are Fin n → ℝ, matrices Matrix (Fin n) (Fin n) ℝ, and X⪰0X \succeq 0X⪰0 is Mathlib's Matrix.PosSemidef, which includes symmetry. The (n+1)×(n+1)(n+1)\times(n+1)(n+1)×(n+1) matrices of §4.3.1 are indexed by Unit ⊕ Fin n. Optimal values are never a bare sSup: a maximization's optimal value enters as the hypothesis that a real number is the least upper bound of the objective over the feasible set, and these sets are nonempty and bounded, so the hypotheses are satisfiable for every instance. The optimal values of §4.3.1, which can be ±∞\pm\infty±∞, are infima and suprema in EReal. The constant 0.87856…0.87856\ldots0.87856… is defined as the exact infimum inf⁡−1≤x<12acos⁡(x)/(π(1−x))\inf_{-1\le x<1} 2\operatorname{acos}(x)/(\pi(1-x))inf−1≤x<1​2acos(x)/(π(1−x)), never a decimal. The ratio 1≥OPT/SDP≥0.87856…1 \ge \mathrm{OPT}/\mathrm{SDP} \ge 0.87856\ldots1≥OPT/SDP≥0.87856… of (4.3.16) is stated in product form, OPT≤SDP\mathrm{OPT} \le \mathrm{SDP}OPT≤SDP and α⋅SDP≤OPT\alpha\cdot\mathrm{SDP} \le \mathrm{OPT}α⋅SDP≤OPT: with Lean's convention x/0=0x/0 = 0x/0=0, a ratio would make the all-zero-weight instance meaningless, and the product form rules out that trivialization. The book's standing conditions (symmetric data; di≥0d_i \ge 0di​≥0 in (SL.??)) are explicit hypotheses.

Contributions welcome: compactness of the elliptope {X⪰0, Xii=1}\{X \succeq 0,\ X_{ii} = 1\}{X⪰0, Xii​=1} and attainment of SDP values, rotation-invariant measures on spheres in Fin n → ℝ, entrywise functions of positive semidefinite matrices (Mathlib has the Schur product theorem, Matrix.PosSemidef.hadamard), and conic duality for (SDP)/(SDD). These are reusable well beyond this chapter.

Beyond the paper. One sharpness probe accompanies the goal: Nesterov's theorem with "A⪰0A \succeq 0A⪰0" weakened to "AAA symmetric". It is false (finding F3: for n=1n = 1n=1, A=(−1)A = (-1)A=(−1), OPT=SDP=−1\mathrm{OPT} = \mathrm{SDP} = -1OPT=SDP=−1 and −2π≤−1-\tfrac2\pi \le -1−π2​≤−1 fails); its disproof is the sought outcome.

Selected references

  • A. Ben-Tal, A. Nemirovski, Lectures on Modern Convex Optimization: Analysis, Algorithms, and Engineering Applications, SIAM/MPS, 2001, §4.3 and §4.10. doi:10.1137/1.9780898718829
  • M. X. Goemans, D. P. Williamson, Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming, J. ACM 42 (1995), 1115–1145. doi:10.1145/227683.227684
  • Yu. Nesterov, Semidefinite relaxation and nonconvex quadratic optimization, Optimization Methods and Software 9 (1998), 141–160. doi:10.1080/10556789808805690
  • A. Nemirovski, C. Roos, T. Terlaky, On maximization of quadratic form over intersection of ellipsoids with common center, Mathematical Programming 86 (1999), 463–473. doi:10.1007/s101070050100
12 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

Traceability Technology Adoption in Supply Chain Networks: The Least-Costly Seed Set Problem Has an Exact Linear Programming Reformulation Whose Size Is Fixed-Parameter Tractable in TreewidthResearch Paper

Motivation

Supply-chain traceability depends on firms adopting a technology together. A firm may benefit only after enough other firms in a shared supply chain have adopted; a supply chain may in turn become traceable only when a threshold number of its firms participate. Selecting firms to seed therefore couples many local adoption decisions. Blaettchen, Calmon, and Hall model this coupling as a network diffusion problem and ask for a least-cost seed set that eventually activates every firm Blaettchen, Calmon, and Hall, 2024. Their model permits overlapping supply chains and firm-specific benefits and costs, so it describes more than a single threshold rule on an ordinary graph.

The paper establishes an exact linear programming reformulation whose size depends exponentially on treewidth but only linearly on the numbers of firms and supply chains, up to parameter factors Theorem 2. This mission records that mathematical claim as a cost-independent extended formulation, together with source propositions describing the diffusion correspondence and the first binary formulation.

Setting

Let NFN_FNF​ contain nnn firms and let NSCN_{SC}NSC​ contain mmm supply chains. Supply chain jjj comprises the hyperedge ej⊆NFe_j\subseteq N_Fej​⊆NF​. Firm iii has an adoption cost ci>0c_i>0ci​>0 and receives a nonnegative integral benefit rjir_{ji}rji​ from an incident supply chain jjj once enough of that chain's firms are active. The chain's threshold satisfies 2≤θj≤∣ej∣2\le\theta_j\le|e_j|2≤θj​≤∣ej​∣. The paper assumes that each firm's total incident benefit can cover its adoption cost. A seed set S0S_0S0​ is active at time zero; every later set StS_tSt​ retains the already active firms and adds a firm iii when

ci≤∑j: i∈ej, ∣St∩ej∣≥θj−1rji.c_i\le\sum_{j:\ i\in e_j,\ |S_t\cap e_j|\ge\theta_j-1}r_{ji}.ci​≤j: i∈ej​, ∣St​∩ej​∣≥θj​−1∑​rji​.

A seed set fully activates the network if St=NFS_t=N_FSt​=NF​ at some finite time. Given real seeding costs wiw_iwi​, the optimization value is

OPT⁡(w)=min⁡{∑i∈Swi:S⊆NF fully activates the network}.(1)\operatorname{OPT}(w)=\min\left\{\sum_{i\in S}w_i:S\subseteq N_F\text{ fully activates the network}\right\}.\tag{1}OPT(w)=min{i∈S∑​wi​:S⊆NF​ fully activates the network}.(1)

The auxiliary graph G′G'G′ has a firm vertex for each iii and a supply-chain vertex for each jjj, joined when i∈eji\in e_ji∈ej​. Its directed weighted version sends weight 111 from a firm to a supply-chain vertex and weight rjir_{ji}rji​ in the reverse direction. Firm thresholds are cic_ici​; supply-chain thresholds are θj−1\theta_j-1θj​−1. A weighted linear-threshold update activates vertices whose total incoming weight from active vertices reaches their threshold. Proposition 1 identifies the firms active after ttt original steps with those active after 2t2t2t auxiliary-graph steps Proposition 1, p. 10.

A tree decomposition is a tree of vertex bags that covers every vertex, places each graph edge or hyperedge in a bag, and keeps the bags containing one vertex connected along the tree. Its width is the largest bag size minus one. Write ω\omegaω for an upper bound on the treewidth of the original hypergraph and ϑmax⁡=max⁡(max⁡ici,max⁡j(θj−1))\vartheta_{\max}=\max(\max_i c_i,\max_j(\theta_j-1))ϑmax​=max(maxi​ci​,maxj​(θj​−1)) Definition 2, p. 13; Proposition 9, p. 18.

Formalization targets

Exact LP reformulation

The target is one finite linear system Az≥bAz\ge bAz≥b, where z=(x,y)z=(x,y)z=(x,y) has visible seed coordinates x∈Rnx\in\mathbb R^nx∈Rn and auxiliary coordinates yyy. The system is chosen from the adoption instance and is independent of www. Its projection onto xxx is exactly the convex hull of fully activating seed indicators:

proj⁡x{(x,y):Az≥b}=conv⁡{1S:S fully activates}.\operatorname{proj}_x\{(x,y):Az\ge b\}=\operatorname{conv}\{\mathbf1_S:S\text{ fully activates}\}.projx​{(x,y):Az≥b}=conv{1S​:S fully activates}.

Consequently, minimizing ∑iwixi\sum_iw_ix_i∑i​wi​xi​ over the same LP yields OPT⁡(w)\operatorname{OPT}(w)OPT(w) for every real www. One absolute constant C>0C>0C>0, placed before all instances and treewidth parameters, bounds the total number of variables and constraints by

2C(ω+1)2(ϑmax⁡+1)C(ω+1)C(n+m+1).2^{C(\omega+1)^2}(\vartheta_{\max}+1)^{C(\omega+1)}C(n+m+1).2C(ω+1)2(ϑmax​+1)C(ω+1)C(n+m+1).

This is the 2O(ω2)ϑmax⁡O(ω)O(n+m)2^{O(\omega^2)}\vartheta_{\max}^{O(\omega)}O(n+m)2O(ω2)ϑmaxO(ω)​O(n+m) form stated immediately after Theorem 2 p. 18. The source's more detailed displayed bracket is not used as the target because its fixed exponents do not match the asymptotic bound obtained from the propositions cited in the proof.

Supporting results

The milestones follow the proof of Theorem 2 on p. 41. Proposition 1 and Corollary 1 identify the adoption process with a weighted threshold process on G′G'G′. Proposition 5 gives a binary program (4) whose feasible seed vectors are exactly the fully activating seed sets. Proposition 7 replaces its global acyclicity constraints by constraints inside the bags of a tree decomposition of G′G'G′, formulation (5). Proposition 8 splits the long covering constraints of (5) into partial sums along a rooted binary decomposition, formulation (10). Proposition 9 bounds the treewidth of the intersection graph of (10) by O(ω′2+ω′log⁡2ϑmax⁡)O(\omega'^2+\omega'\log_2\vartheta_{\max})O(ω′2+ω′log2​ϑmax​), where ω′\omega'ω′ is the width of the decomposition of G′G'G′. Proposition 3 gives tw⁡(G′)≤tw⁡(G)+1\operatorname{tw}(G')\le\operatorname{tw}(G)+1tw(G′)≤tw(G)+1, and Proposition 4 is the bounded-treewidth LP theorem for binary programs pp. 10–18.

Significance

An exact LP gives the same optimum for every seeding-cost vector while keeping the constraints fixed. The size guarantee explains why a structurally sparse supply-chain network can admit a formulation far smaller than a generic enumeration of seed sets. It also separates the economics of choosing www from the combinatorics of diffusion: once the network formulation is built, different cost scenarios use the same feasible region Theorem 2 and §5.3.

The paper proves the theorem, citing Proposition 4 from Laurent (2009) and Bienstock and Muñoz (2018). Neither Theorem 2 nor Proposition 4 has a machine-checked proof on Prove2Me. The remaining work is to formalize the paper's chain of reformulations and the cited LP theorem. The tree decomposition definitions are already published as reusable Prove2Me objects from Robertson and Seymour. The diffusion model, the binary formulation, and their relationship to an LP extended formulation are the new formal objects here.

Difficulty

The first binary program represents the activation order but connects variables across many firm–supply-chain pairs. Its intersection graph has treewidth at least nm−1nm-1nm−1, even when the underlying supply-chain graph is sparse Proposition 6, p. 16. Applying a bounded-treewidth LP theorem directly to that program therefore loses the desired parameter bound. The source introduces a more local formulation tied to a tree decomposition, and controlling the intersection graph of that formulation is the central difficulty. Formulation (10) as printed is not exactly right: the bit count (6) is one bit short, so that an instance with c1=2c_1=2c1​=2 loses its optimal seed set, and the root inequalities (10c), (10g) use an undeclared variable. The targets use the bit ranges of the integer program (11) in the proof of Proposition 8 and the partial sum uuu at each subtree root.

Formalization scope

The Lean instance uses Fin n for firms, Fin m for supply chains, and natural numbers for benefits, adoption costs, and thresholds. The auxiliary graph is a simple graph on the disjoint union of these two finite types; the diffusion update retains active vertices and uses the paper's weak inequality at the threshold. Hypergraph treewidth requires every entire hyperedge in some bag and uses the published Robertson–Seymour tree decomposition predicate for the primal graph. Graph treewidth for G′G'G′ uses the corresponding published bound predicate.

The paper treats connectedness as without loss of generality. Here it means that the incidence graph G′G'G′ is connected and is included with the other standing assumptions. The gcd normalization discussed in §3.1 is a preprocessing convention, not a hypothesis. The finite family of successful seed sets always contains the all-firm set, so OPT is a genuine finite minimum. The formulation counts both auxiliary variables and inequalities. The additive shifts in the size bound handle small values of nnn, mmm, ω\omegaω, and ϑmax⁡\vartheta_{\max}ϑmax​; they do not change the asymptotic claim. The LP is quantified before www, and its projection is specified, excluding a trivial LP selected separately for each cost vector.

Formulations (4), (5) and (10) are binary feasibility predicates over natural-number variables bounded by one; the adoption inequality ci(1−si)≤⋯c_i(1-s_i)\le\cdotsci​(1−si​)≤⋯ is written as ci≤⋯+cisic_i\le\cdots+c_is_ici​≤⋯+ci​si​. Constraints (5c), (5d), (10i), (10j) range over distinct vertices of a bag (with i=ji=ji=j the printed (5c) would be infeasible). A rooted binary tree decomposition is a published tree decomposition together with a root, a parent map and at most two children per node; the subtree root z0pz_0^pz0p​ is the node of the subtree nearest the root. The partitions JziJ^i_zJzi​, IzjI^j_zIzj​ are arbitrary data with the properties stated on p. 17, which are all the proofs use. Proposition 7 is stated for every tree decomposition of G′G'G′; binarity is not needed there.

The generic finite linear-system and intersection-graph definitions can be reused beyond this paper. Contributions are welcome at every milestone; Proposition 4 is a general result on binary programs and is the most widely reusable.

Selected references

  • Paul Blaettchen, André P. Calmon, and George Hall, Traceability Technology Adoption in Supply Chain Networks, Management Science, 2024; preprint arXiv:2104.14818v4 (2023). arXiv
  • Neil Robertson and Paul D. Seymour, Graph Minors. V. Excluding a Planar Graph, Journal of Combinatorial Theory, Series B 41, 1986. DOI
  • Monique Laurent, Sums of Squares, Moment Matrices and Optimization over Polynomials, in Emerging Applications of Algebraic Geometry, IMA Vol. 149, Springer, 2009. DOI
  • Daniel Bienstock and Gonzalo Muñoz, LP Formulations for Polynomial Optimization Problems, SIAM Journal on Optimization 28(2), 2018. DOI
17 thms1 active userReviewed
CombinatoricsOperations Research·Captain: mikedeng1

Bounding Residence Times for Atomic Dynamic Routings: If No Later Entrant Leaves the Subnetwork First, an Agent Exits by Time r0 plus the Longest Path Length plus the Earlier Agents Still InsideResearch Paper

Motivation

In atomic dynamic routing, indivisible agents (vehicles, packets, travellers) enter a network over time and travel along fixed routes. Each road admits a limited number of agents per unit of time, so agents queue at its entrance. A basic question for traffic models, packet-switching networks and dynamic routing games is how long an agent can stay in the network, its residence time. Upper bounds on residence times are what make it possible to bound queue lengths and the price of anarchy in dynamic routing games.

Greedy packet scheduling, where an edge never idles while packets wait for it, was studied by Cidon, Kutten, Mansour and Peleg (SIAM J. Comput. 1995), who showed that cycles can make delays large, and by Mansour and Patt-Shamir (J. Algorithms 1993), who bounded delivery times when every route is a shortest path. Cao, Chen, Chen and Wang (MOR 2022) prove a bound for arbitrary routes on acyclic networks. It holds under any rule that decides which waiting agent may leave next, and agents may keep entering forever. Their Theorem 1 is the goal of this mission. The paper then uses it to show that equilibria of three dynamic routing games on series-parallel networks have bounded queues (§6).

Setting

A network G=(V,E)G=(V,E)G=(V,E) is a finite directed multigraph (parallel edges allowed) that is acyclic. Every edge has unit length and unit capacity. A path is a sequence of edges, each starting where the previous one ends. LvwL_{vw}Lvw​ is the number of edges of a longest vvv-www path.

Time is discrete, 0,1,2,…0,1,2,\dots0,1,2,…. Agents form a set Δ\DeltaΔ, possibly infinite. At each time finitely many agents enter. Agent iii enters at time rir_iri​ at his origin oio_ioi​ and follows a fixed route, a nonempty oio_ioi​-did_idi​ path. The tail of each edge holds a buffer. Two rules govern the dynamics:

  • (A1) an agent reaching a vertex that is not his destination enters the buffer of his next edge at once;
  • (A2) at every integer time, whenever a buffer is nonempty, exactly one agent leaves it and reaches the head of the edge one time unit later; the others wait.

No rule says which agent leaves. Every choice consistent with (A2) is an admissible run. An agent exits GGG on reaching his destination. His residence time is his exit time minus his entry time (Definition 1).

Fix a focal agent ζ\zetaζ with entry time rrr. GζG_\zetaGζ​ is the subnetwork formed by all oζo_\zetaoζ​-dζd_\zetadζ​ paths. For an integer time r0r_0r0​:

  • Aζ,pA_{\zeta,p}Aζ,p​ is the set of agents who enter after time rrr and use an edge of GζG_\zetaGζ​;
  • Bζ,p(r0)B_{\zeta,p}(r_0)Bζ,p​(r0​) is the set of agents i≠ζi\neq\zetai=ζ who entered by time rrr, are still inside GGG at time r0r_0r0​, and use an edge of GζG_\zetaGζ​.

An agent exits GζG_\zetaGζ​ when he reaches the head of the last edge of his route lying in GζG_\zetaGζ​.

Formalization targets

Goal: Theorem 1 (p. 7)

For every admissible run and every integer r0≥rr_0\ge rr0​≥r: if no agent of Aζ,pA_{\zeta,p}Aζ,p​ exits GζG_\zetaGζ​ before ζ\zetaζ exits GGG, then

tζ ≤ r0+Loζdζ+∣Bζ,p(r0)∣,t_\zeta\ \le\ r_0+L_{o_\zeta d_\zeta}+\bigl|B_{\zeta,p}(r_0)\bigr|,tζ​ ≤ r0​+Loζ​dζ​​+​Bζ,p​(r0​)​,

where tζt_\zetatζ​ is the exit time of ζ\zetaζ.

Milestones (§3.2, p. 9)

When ζ\zetaζ is still inside GGG at r0r_0r0​, the proof follows tokens: imaginary markers that ζ\zetaζ produces from time r0r_0r0​ on, and that travel with the agents leaving buffers ((s1), (s2), p. 8). The milestones are the paper's statements about them, with L=LoζdζL=L_{o_\zeta d_\zeta}L=Loζ​dζ​​:

  1. (p1) each agent holds at most one token, and a buffer never contains more tokens than agents;
  2. (p2) the agent leaving ζ\zetaζ's buffer always holds exactly one token;
  3. (p3) after r0r_0r0​, ζ\zetaζ produces a new token only while he waits;
  4. Claim 1 the induction step of Lemma 1 at the vertices where token kkk departs right after a smaller token;
  5. Lemma 1 token kkk departs every vertex vvv of its trail inside GζG_\zetaGζ​ by time r0+(L−Lvdζ+k−1)r_0+(L-L_{vd_\zeta}+k-1)r0​+(L−Lvdζ​​+k−1);
  6. token exit token kkk exits GζG_\zetaGζ​ by time r0+(L+k−1)r_0+(L+k-1)r0​+(L+k−1).

Significance

The result. The bound does not depend on the rule that selects the leaving agent, so it covers every queueing discipline at once: FIFO, global agent priorities, and the edge-priority rules of earlier dynamic routing games. With r0=rr_0=rr0​=r and no later entrants on GζG_\zetaGζ​, it gives Corollary 1: the residence time of ζ\zetaζ is at most Loζdζ+∣Bζ,p(r)∣L_{o_\zeta d_\zeta}+|B_{\zeta,p}(r)|Loζ​dζ​​+∣Bζ,p​(r)∣. Example 1 (p. 8) shows that the bound can be attained. The freedom in r0r_0r0​ is what §6 uses to show that queue lengths stay bounded at equilibria of dynamic routing games on series-parallel networks.

Formalizing it. The theorem is proved on paper. No machine-checked version is known to exist, and the platform has no rule-free model of atomic dynamic routing. The mission adds that model: a run is a set of leave times constrained by (A1)–(A2), not a fixed simulation. It also adds the multi-token process and the paper's chain of statements leading to Theorem 1.

Difficulty

The obvious argument is wrong. One might reason that ζ\zetaζ travels at most LoζdζL_{o_\zeta d_\zeta}Loζ​dζ​​ edges and each earlier agent delays him at most once, giving the bound at once. The paper notes (p. 7) that this intuition fails even with two agents: a single agent can delay ζ\zetaζ more than ∣Δ∣|\Delta|∣Δ∣ times, because delays propagate through other buffers. Bounding the total therefore means tracking chains of delays across the network rather than charging each delay to one agent.

Formally, the hard parts are:

  • the run is only constrained, not determined;
  • the token process is defined by recursion over time, using the unique leaver of each buffer;
  • (p1)–(p3) are invariants proved by induction on time;
  • Lemma 1 combines induction on the token index with longest-path inequalities in an acyclic graph.

Formalization scope

  • Model. Network V E (tail and head maps) with finite V, E and a hypothesis Acyclic: no nonempty closed walk. Paths are edge lists. longest v w is the supremum of path lengths in N\mathbb NN; it is a maximum wherever it is used.

  • Runs. RunData holds entry times, routes, origins and destinations, and leave times leave i j in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞} for the jjj-th edge of iii's route, numbered from 000. IsADR states that:

    • routes are nonempty origin–destination paths;
    • finitely many agents enter per time;
    • nobody leaves a buffer before entering it;
    • (A2) holds, as unique existence of the leaver of each nonempty buffer at each time.

    Agents form an arbitrary type and may be infinitely many. An agent may never be served (leave time ∞\infty∞), as in the paper, so the theorem also asserts that ζ\zetaζ exits.

  • Derived objects. Exit times, GζG_\zetaGζ​, Aζ,pA_{\zeta,p}Aζ,p​, Bζ,p(r0)B_{\zeta,p}(r_0)Bζ,p​(r0​) and the exit time from GζG_\zetaGζ​ are definitions computed from the run, never free parameters. ∣Bζ,p(r0)∣|B_{\zeta,p}(r_0)|∣Bζ,p​(r0​)∣ is Set.ncard of a set that is finite under IsADR.

  • Tokens. The token milestones assume that ζ\zetaζ is inside GGG at r0r_0r0​, as §3.1 requires when starting the construction. Tokens are indexed from 111. A new token gets index one plus the number produced so far. Bounds with subtraction are written additively over N\mathbb NN, e.g. s+Lvdζ+1≤r0+L+ks+L_{vd_\zeta}+1\le r_0+L+ks+Lvdζ​​+1≤r0​+L+k, which is the same inequality over the integers.

  • Ruled out. None of these is used, since each proves a different statement: a fixed tie-breaking rule (FIFO or priorities), exit times as free parameters, finitely many agents, or dropping acyclicity, which Remark 2 shows is necessary.

Contributions welcome: proofs of the token invariants, of Lemma 1, and of the goal. The network and run definitions can be reused for the paper's other results (Theorem 2 on uniform capacities, the routing games of §5–6).

Selected references

  • Z. Cao, B. Chen, X. Chen, C. Wang, Bounding residence times for atomic dynamic routings, Mathematics of Operations Research, 2022 (accepted manuscript: WRAP 160244). https://doi.org/10.1287/moor.2021.1242 , https://wrap.warwick.ac.uk/160244
  • Y. Mansour, B. Patt-Shamir, Greedy packet scheduling on shortest paths, Journal of Algorithms 14(3):449–465, 1993.
  • I. Cidon, S. Kutten, Y. Mansour, D. Peleg, Greedy packet scheduling, SIAM Journal on Computing 24(1):148–157, 1995.
  • T. Harks, B. Peis, D. Schmand, B. Tauer, L. Vargas Koch, Competitive packet routing with priority lists, ACM Transactions on Economics and Computation 6(1):4:1–4:26, 2018.
10 thms1 active userReviewed
🏆Completed
Captain: marwahaha

OpenAI Ten Proofs 10: Extremal graph counterexamplesResearch Paper

Extremal graph counterexamples, from the OpenAI Ten Proofs formalization. The source already contains machine-checked proofs; this mission organizes its headline result and additional Comparator targets for reuse.

Write ex⁡(n,F)\operatorname{ex}(n,F)ex(n,F) for the maximum number of edges in an nnn-vertex simple graph containing no subgraph copy of FFF, with value 000 if there is no eligible graph; a copy is an injective edge-preserving map and need not be induced. For a finite family F\mathcal FF of finite simple graphs, each encoded on {0,…,q−1}\{0,\ldots,q-1\}{0,…,q−1} for its own q∈Nq\in\mathbb Nq∈N, let EF(n)E_{\mathcal F}(n)EF​(n) be the maximum edge count over simple graphs on {0,…,n−1}\{0,\ldots,n-1\}{0,…,n−1} containing no copy of any member of F\mathcal FF, again taking 000 for an empty collection. There exist a nonempty such family F\mathcal FF and real constants c,C>0c,C>0c,C>0 such that every member is connected, bipartite, and not acyclic; for each F∈FF\in\mathcal FF∈F, cn4/3≤ex⁡(n,F)c n^{4/3}\le\operatorname{ex}(n,F)cn4/3≤ex(n,F) for all sufficiently large natural nnn, with a threshold that may depend on FFF; for every n∈Nn\in\mathbb Nn∈N and every simple graph GGG on {0,…,n−1}\{0,\ldots,n-1\}{0,…,n−1} containing no copy of any member, ∣E(G)∣16≤Cn21|E(G)|^{16}\le C n^{21}∣E(G)∣16≤Cn21; and for every n∈Nn\in\mathbb Nn∈N, EF(n)16≤Cn21E_{\mathcal F}(n)^{16}\le C n^{21}EF​(n)16≤Cn21. These last two bounds use the same CCC and include n=0n=0n=0. The conclusions also include 0<1/480<1/480<1/48 and 21/16=4/3−1/4821/16=4/3-1/4821/16=4/3−1/48, as equalities and inequalities of real numbers. No member F∈FF\in\mathcal FF∈F and real constant D>0D>0D>0 satisfy ex⁡(n,F)≤DEF(n)\operatorname{ex}(n,F)\le D E_{\mathcal F}(n)ex(n,F)≤DEF​(n) for all sufficiently large nnn. Moreover, the assertion that every nonempty finite family of finite simple graphs whose members each contain a cycle admits such a member and constant is false.

Additional targets:

  • Asymptotic separation for a noncompact graph family.
  • Failure of compactness for cyclic graph families.
  • Two-degenerate graph with extremal exponent above 3/2.
  • Failure of the bipartite degeneracy extremal bound.

The formalization uses Lean 4.33.1 with Mathlib revision 0df444a360eaa60ab8c11dca51a86af692955474. Its goal and milestone statements retain the validated source statements and their conventions.

Sources: Lean formalization, J_CompactnessConjecture.json, J_TwoDegenerateGraphs.json.

Planned collection: OAI Ten Proofs (oai-ten-proofs).

6 thms1 active userReviewed
🏆Completed
Captain: marwahaha

OpenAI Ten Proofs 09: Multicolor triangle Ramsey numbersResearch Paper

Multicolor triangle Ramsey numbers, from the OpenAI Ten Proofs formalization. The source already contains machine-checked proofs; this mission organizes its headline result and additional Comparator targets for reuse.

For each k∈Nk\in\mathbb Nk∈N, let R(k)R(k)R(k) be the infimum in N\mathbb NN of the integers nnn such that every labeling of the edges of the complete simple graph on {0,…,n−1}\{0,\ldots,n-1\}{0,…,n−1} by kkk colors has a monochromatic triangle; equivalently, no such labeling has every color graph free of a three-vertex clique. This is the least such nnn when the set is nonempty, with infimum 000 for an empty set. Both of the following hold: for every integer k≥2k\ge 2k≥2, (16e38 k1/3log⁡k)k≤R(k)\left(\frac{1}{6e^{38}}\,\frac{k^{1/3}}{\log k}\right)^k\le R(k)(6e381​logkk1/3​)k≤R(k), where all quantities in the inequality are real; and R(k)1/k→+∞R(k)^{1/k}\to+\inftyR(k)1/k→+∞ as k→∞k\to\inftyk→∞, meaning that for each real MMM there is K∈NK\in\mathbb NK∈N such that R(k)1/k≥MR(k)^{1/k}\ge MR(k)1/k≥M whenever k≥Kk\ge Kk≥K. The root sequence is defined also at k=0k=0k=0 using real division 1/0=01/0=01/0=0, so that term equals 111 and does not affect the limit.

Additional targets:

  • Divergence of multicolor triangle Ramsey roots.
  • Eventual logarithmic Ramsey coefficient bounds.
  • Logarithmic Ramsey growth has order k log k.

The formalization uses Lean 4.33.1 with Mathlib revision 0df444a360eaa60ab8c11dca51a86af692955474. Its goal and milestone statements retain the validated source statements and their conventions.

Sources: Lean formalization, I_MulticolorTriangleRamsey.json.

Planned collection: OAI Ten Proofs (oai-ten-proofs).

5 thms1 active userReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Atomic Dynamic Flow Games: Adaptive vs. Nonadaptive Agents: Every Game of Nonadaptive Agents Admits an Iteratively Dominant Nash EquilibriumResearch Paper

Motivation

Traffic, packet and evacuation networks are often studied with atomic dynamic flows: individual agents move through a network over time, queue at congested links, and each wants to reach its destination as early as possible. The deterministic queuing (Vickrey) model makes the queue at every link explicit: a link has a capacity, and agents beyond it wait in a queue. In the atomic, discrete-time version, simultaneous arrivals at a queue must be ordered by some tie-breaking rule, and that rule decides whether the resulting routing game has an equilibrium.

Hoefer, Mirrokni, Röglin and Teng (2009, 2011) and Werth, Holzhauser and Krumke (2014) studied atomic routing over time in deterministic queuing models, and found non-existence of equilibria and computational hardness in several variants; Harks, Peis, Schmand, Tauer and Vargas Koch (2018) studied competitive packet routing with priority lists. Scarsini, Schröder and Tomala (Operations Research, 2018) proved that a Nash equilibrium exists when priorities are placed on agents, in single-origin, single-destination networks. Cao, Chen, Chen and Wang (Operations Research 2021) showed that with agent priorities and several origins an equilibrium can fail to exist (their Example 3, a rock–paper–scissors cycle). They proposed instead to break ties by edge priorities at each vertex, and proved that equilibria then always exist. This mission formalizes that existence theorem.

Setting

A network instance consists of the following data.

  • A finite acyclic directed multigraph G=(V,E)G=(V,E)G=(V,E) with a destination ddd; every vertex has a path to ddd. Every edge has unit capacity and unit length.
  • At each vertex vvv, a complete priority order ≺v\prec_v≺v​ on the edges entering vvv.
  • At time 000, an initial ranked queue Qe0Q^0_eQe0​ on each edge eee.
  • At each time r≥1r\ge1r≥1 and vertex vvv, a finite ranked set Δr,v\Delta_{r,v}Δr,v​ of agents entering at origin vvv.

The agent set Δ\DeltaΔ is the disjoint union of all these, and may be infinite.

Each agent iii chooses at time 000 a path PiP_iPi​ from his starting vertex to ddd. For i∈Qe0i\in Q^0_ei∈Qe0​ the path must begin with eee; this is his strategy set Pi\mathcal P_iPi​. At every time unit only the head of the queue on an edge leaves it, and it reaches the head of the edge one unit later. Agents entering an edge are ranked by the edge-priority DQ rule, applied in this order:

  • (R0) initial-queue order;
  • (R1) an earlier entry ranks higher;
  • (R2) among simultaneous entries through different edges, higher priority under ≺ue\prec_{u_e}≺ue​​ ranks higher;
  • (R3) an agent starting at ueu_eue​ ranks above through-traffic entering at the same time;
  • (R4) agents with the same origin keep their original ranks.

tiv(p)t^v_i(p)tiv​(p) denotes the time agent iii reaches vertex vvv under the profile ppp, and is ∞\infty∞ if he never does.

The normal-form game ΓN\Gamma^NΓN has players Δ\DeltaΔ, strategies Pi\mathcal P_iPi​, and cost tidt^d_itid​. A profile ppp is a Nash equilibrium (NE) if tid(p)≤tid(Pi′,p−i)t^d_i(p)\le t^d_i(P'_i,p_{-i})tid​(p)≤tid​(Pi′​,p−i​) for all iii and Pi′∈PiP'_i\in\mathcal P_iPi′​∈Pi​. It is an iteratively dominant NE (IDNE) if the agents can be reindexed 1,2,…1,2,\dots1,2,… such that for every kkk, every vertex vvv on PkP_kPk​ and every profile qqq of the agents outside [k]={1,…,k}[k]=\{1,\dots,k\}[k]={1,…,k},

tkv(p[k],q)=min⁡{tjv(p[k−1],r):j∉[k−1], r a profile of Δ∖[k−1]}.t^v_k(p_{[k]},q)=\min\{t^v_j(p_{[k-1]},r): j\notin[k-1],\ r \text{ a profile of }\Delta\setminus[k-1]\}.tkv​(p[k]​,q)=min{tjv​(p[k−1]​,r):j∈/[k−1], r a profile of Δ∖[k−1]}.

Formalization targets

Goal: Theorem 1 (p. 12)

every ΓN admits a path profile p that is an IDNE, and hence an NE.\text{every } \Gamma^N \text{ admits a path profile } p \text{ that is an IDNE, and hence an NE.}every ΓN admits a path profile p that is an IDNE, and hence an NE.

The goal makes no finiteness assumption on Δ\DeltaΔ and fixes no constants.

Milestones

  1. Selection step (§4.1, p. 14). Given the first k−1k-1k−1 agents of the construction, the pruning (S1)–(S3) leaves exactly one candidate pair (j,Pj)(j,P_j)(j,Pj​).
  2. Lemma EC.2 (p. ec6). For the selected (k,Pk)(k,P_k)(k,Pk​), any S⊆Δ∖[k−1]S\subseteq\Delta\setminus[k-1]S⊆Δ∖[k−1], j∈Sj\in Sj∈S, v∈Pkv\in P_kv∈Pk​ and any profile qqq,
tkv(p[k],qS∖{k})=ℓkv[ ⁣[k−1] ⁣]≤tjv(p[k−1],qS).t^v_k(p_{[k]},q_{S\setminus\{k\}})=\ell^v_k[\![k-1]\!]\le t^v_j(p_{[k-1]},q_S).tkv​(p[k]​,qS∖{k}​)=ℓkv​[[k−1]]≤tjv​(p[k−1]​,qS​).
  1. Reindexing (p. ec3). The selection can be iterated so that every agent receives an index.
  2. Theorem EC.2 (p. ec8). The profile so constructed (a special IDNE) is an IDNE.
  3. IDNE ⇒ NE (§4.1, p. 11).

Significance

The result. Theorem 1 gives an equilibrium for every network with edge priorities: multiple origins, initial queues and an unbounded stream of inflows are all allowed. With agent priorities, equilibrium can fail to exist in exactly this setting. The IDNE carries more structure than an NE. Arrival times along each agent's path are independent of later agents' choices, and no agent who enters later at the same origin overtakes an earlier one. The paper uses these properties in its study of subgame-perfect equilibria for adaptive agents (p. 12; §5).

Formalizing it. The result is proved in the paper; nothing here is open mathematically. To our knowledge no part of it is formalized in any proof assistant. The mission produces:

  • a reusable, executable model of discrete-time deterministic queuing with priority tie-breaking;
  • a formal proof of the constructive existence argument.

The paper proves Lemma EC.2 in a transformed game ΓˉN\bar\Gamma^NΓˉN on an infinite graph (Lemma EC.1). The mission instead states everything directly in ΓN\Gamma^NΓN, so a complete development must either carry out the transfer or reprove the lemma natively. For infinitely many agents, the claim that every agent is eventually indexed (milestone 3) is asserted in the paper without a separate argument; the formal proof has to supply one.

Difficulty

The obvious argument fails at the no speed-up property. Adding agents to a network can make some other agent arrive earlier. The paper's Example 4 (pp. 15–16) has such a chain effect: removing an agent delays another. So the claim that agent kkk's arrival times are unaffected by everyone after him is not monotonicity of congestion. It holds only for the specific order and paths produced by the selection procedure, and it must be proved by an induction that carries invariance (equality in (EC.2)) and domination (inequality in (EC.2)) together.

The tie-breaking is the second difficulty. The selection compares candidates backwards from ddd: by arrival time, then by incoming-edge priority, then one edge further back. The argument has to show that this order matches the queue rule (R0)–(R4) at every vertex, including (R3) for agents starting mid-network.

Formalization scope

Everything lives in the namespace AtomicDynFlow.IDNE.

  • Network and agents. Instance V E A carries the graph as finite types V, E with tail, head, d, and the priorities as lists inc v of incoming edges, highest priority first. Initial queues Q0 e are listed head first, and inflows inflow r v highest original rank first. The standing hypotheses are fields:

    • acyclicity, as a height function;
    • reachability of ddd;
    • no inflow at time 000;
    • every agent lies in exactly one source list.

    The agent type A is arbitrary and may be infinite.

  • Dynamics. queue π s e is a computable, list-based simulation of the queue on each edge at each time, under a partial profile π : A → Option (List E), where none means the agent is absent. arrival π i v : ℕ∞ is tivt^v_itiv​, with ⊤ for ∞\infty∞ (p. ec4). The starting-vertex time is 000 for initial-queue agents and rrr for Δr,v\Delta_{r,v}Δr,v​ (Algorithm 1, Step 2).

  • Equilibria. The reindexing of Definition 2 is an injective σ:Δ→N\sigma:\Delta\to\mathbb Nσ:Δ→N whose range is an initial segment, with agent aaa receiving index σ(a)+1\sigma(a)+1σ(a)+1. Definition 2 quantifies over every vertex of the path, the starting vertex included.

  • Selection. The pruning (S1)–(S3) is a backward pairwise comparison of candidate pairs (Before, IsSelected). Milestones 2 and 4 are ΓN\Gamma^NΓN-native versions of the e-companion statements, and Lemma EC.1 is not formalized.

Ruled out. Three encodings would trivialize the goal, and none is used:

  • arrival times that ignore queuing, under which every profile would be an IDNE;
  • a profile in which removed agents are frozen rather than absent;
  • a reindexing that skips agents.

A sorry-free check of the paper's Example 2 shows that agent iii waits at y1y_1y1​ and reaches ddd at time 666, and that removing agent ggg lets him arrive at 555.

Welcome contributions: proofs of the milestones in any order. Milestone 5 needs only the definitions. Milestones 1 and 2 are the technical core, and general lemmas about the queue simulation (FIFO within an edge, monotonicity in entry times) are reusable throughout.

Selected references

  • Z. Cao, B. Chen, X. Chen, C. Wang, Atomic dynamic flow games: adaptive versus nonadaptive agents, Operations Research, 2021; accepted manuscript Oct. 2020, WRAP 143835. https://doi.org/10.1287/opre.2021.2105
  • M. Scarsini, M. Schröder, T. Tomala, Dynamic atomic congestion games with seasonal flows, Operations Research 66(2):327–339, 2018.
  • T. Werth, M. Holzhauser, S. Krumke, Atomic routing in a deterministic queuing model, Operations Research Perspectives 1(1):18–41, 2014.
  • T. Harks, B. Peis, D. Schmand, B. Tauer, L. Vargas Koch, Competitive packet routing with priority lists, ACM Transactions on Economics and Computation 6(1):4, 2018.
  • M. Hoefer, V. S. Mirrokni, H. Röglin, S.-H. Teng, Competitive routing over time, Theoretical Computer Science 412(39):5420–5432, 2011.
  • W. Vickrey, Congestion theory and transport investment, American Economic Review 59(2):251–260, 1969.
9 thms1 active userReviewed
Linear OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Linear Programming and Community Detection 6: The LP Relaxation Fails w.h.p. in the Very Dense and Dense SBM Above Explicit ThresholdsResearch Paper

Motivation

Community detection asks for a hidden partition of the nodes of a graph from its edges. Its simplest probabilistic benchmark is the two-community stochastic block model (SBM), in which the minimum bisection problem is the maximum a posteriori estimator. That problem is NP-hard, so convex relaxations are used in its place, and the question is when a relaxation still returns the hidden partition exactly. For semidefinite relaxations this question has sharp answers (Abbe, Bandeira, Hall 2016; Bandeira 2018). Del Pia, Khajavirad and Kunisky (arXiv:2006.03213v2) ask the same question for the most common linear programming relaxation of minimum bisection, the metric relaxation. They show that it recovers the planted bisection in very dense graphs when p−q>1/2p-q>1/2p−q>1/2 (their Theorem 6). This mission is their converse in the very dense and dense regimes, Theorem 7: above explicit thresholds the LP fails with high probability.

Setting

The node set is V={1,…,n}V=\{1,\dots,n\}V={1,…,n}, nnn even. A bisection is a partition V=V1⊔V2V=V_1\sqcup V_2V=V1​⊔V2​ with ∣V1∣=∣V2∣=n/2|V_1|=|V_2|=n/2∣V1​∣=∣V2​∣=n/2. The cut vector xˉ∈{0,1}(n2)\bar x\in\{0,1\}^{\binom n2}xˉ∈{0,1}(2n​) of V1,V2V_1,V_2V1​,V2​ has xˉij=1\bar x_{ij}=1xˉij​=1 exactly when iii and jjj lie on different sides. For a graph GGG with adjacency indicators aija_{ij}aij​, the metric relaxation is

(LP-P)min⁡x∑i<jaijxijs.t.xij≤xik+xjk,xij+xik+xjk≤2,∑i<jxij=n24,\text{(LP-P)}\qquad \min_x \sum_{i<j}a_{ij}x_{ij}\quad\text{s.t.}\quad x_{ij}\le x_{ik}+x_{jk},\quad x_{ij}+x_{ik}+x_{jk}\le2,\quad \sum_{i<j}x_{ij}=\frac{n^2}{4},(LP-P)xmin​i<j∑​aij​xij​s.t.xij​≤xik​+xjk​,xij​+xik​+xjk​≤2,i<j∑​xij​=4n2​,

over x∈R(n2)x\in\mathbb R^{\binom n2}x∈R(2n​), with the first family over distinct i,j,ki,j,ki,j,k with i<ji<ji<j and the second over i<j<ki<j<ki<j<k. The LP recovers the planted bisection if xˉ\bar xxˉ is its unique optimal solution.

In the SBM Gn,p,q\mathcal G_{n,p,q}Gn,p,q​ a bisection V1,V2V_1,V_2V1​,V2​ is first drawn uniformly at random; then each pair on the same side is an edge with probability ppp and each pair across with probability qqq, independently, with p>qp>qp>q. The Erdős–Rényi graph Gn,p\mathcal G_{n,p}Gn,p​ has every pair an edge with probability ppp. The dense scaling (20) is p=αn−ωp=\alpha n^{-\omega}p=αn−ω, q=βn−ωq=\beta n^{-\omega}q=βn−ω with α>β>0\alpha>\beta>0α>β>0, 0≤ω<10\le\omega<10≤ω<1; ω=0\omega=0ω=0 is the very dense regime. An event holds with high probability (w.h.p.) if its probability tends to 111 as n→∞n\to\inftyn→∞.

For a graph GGG, ρG(i,j)\rho_G(i,j)ρG​(i,j) is the shortest-path distance (+∞+\infty+∞ across components), ρmax⁡(G)=max⁡i,jρG(i,j)\rho_{\max}(G)=\max_{i,j}\rho_G(i,j)ρmax​(G)=maxi,j​ρG​(i,j) is the diameter, and ρavg(G)=2n2∑i<jρG(i,j)\rho_{\mathrm{avg}}(G)=\frac2{n^2}\sum_{i<j}\rho_G(i,j)ρavg​(G)=n22​∑i<j​ρG​(i,j) is the average distance. EEE is the edge set of GGG, E0E_0E0​ the set of edges across the planted bisection.

Formalization targets

Goal: Theorem 7 (pp. 15–16)

Let p=αn−ωp=\alpha n^{-\omega}p=αn−ω, q=βn−ωq=\beta n^{-\omega}q=βn−ω with α>β>0\alpha>\beta>0α>β>0, ω∈[0,1)\omega\in[0,1)ω∈[0,1), and α,β<1\alpha,\beta<1α,β<1 if ω=0\omega=0ω=0. If one of

  1. ω=0\omega=0ω=0 and β>max⁡{3−α−(3−α)2−4α2, 2α−1}\beta>\max\big\{\tfrac{3-\alpha-\sqrt{(3-\alpha)^2-4\alpha}}2,\ 2\alpha-1\big\}β>max{23−α−(3−α)2−4α​​, 2α−1} (22),
  2. ω∈(0,1)\omega\in(0,1)ω∈(0,1), 11−ω∉N\tfrac1{1-\omega}\notin\mathbb N1−ω1​∈/N and β>α/(2⌈11−ω⌉−1)\beta>\alpha/(2\lceil\tfrac1{1-\omega}\rceil-1)β>α/(2⌈1−ω1​⌉−1) (23),
  3. ω=12\omega=\tfrac12ω=21​ and β>max⁡{1−2e−α22−e−α2,13+2e−α2}α\beta>\max\big\{\tfrac{1-2e^{-\alpha^2}}{2-e^{-\alpha^2}},\tfrac1{3+2e^{-\alpha^2}}\big\}\alphaβ>max{2−e−α21−2e−α2​,3+2e−α21​}α (24),
  4. ω∈(0,1)\omega\in(0,1)ω∈(0,1), 11−ω∈N∖{2}\tfrac1{1-\omega}\in\mathbb N\setminus\{2\}1−ω1​∈N∖{2} and β>α/(21−ω−1+2e−α1/(1−ω))\beta>\alpha/\big(\tfrac2{1-\omega}-1+2e^{-\alpha^{1/(1-\omega)}}\big)β>α/(1−ω2​−1+2e−α1/(1−ω)) (25)

holds, then

lim⁡n→∞P(V1,G)∼Gn,p,q[(LP-P) does not recover V1,V2]=1.\lim_{n\to\infty}\mathbb P_{(V_1,G)\sim\mathcal G_{n,p,q}}\big[\text{(LP-P) does not recover }V_1,V_2\big]=1.n→∞lim​P(V1​,G)∼Gn,p,q​​[(LP-P) does not recover V1​,V2​]=1.

Milestones

  1. (26), p. 16: for p,q=Ω(log⁡n/n)p,q=\Omega(\log n/n)p,q=Ω(logn/n) with lim⁡q/p∈(0,1]\lim q/p\in(0,1]limq/p∈(0,1], the ratio ∣E0∣/∣E∣|E_0|/|E|∣E0​∣/∣E∣ lies in (1±ϵ) q/(p+q)(1\pm\epsilon)\,q/(p+q)(1±ϵ)q/(p+q) w.h.p.
  2. Proposition 11, p. 28: a coupling of Gn,q\mathcal G_{n,q}Gn,q​, Gn,q,p\mathcal G_{n,q,p}Gn,q,p​ and Gn,p\mathcal G_{n,p}Gn,p​ in which the three graphs are nested.
  3. Proposition 12, p. 28: w.h.p. ρmax⁡(Gn,αn−ω)=1+⌊11−ω⌋\rho_{\max}(\mathcal G_{n,\alpha n^{-\omega}})=1+\lfloor\frac1{1-\omega}\rfloorρmax​(Gn,αn−ω​)=1+⌊1−ω1​⌋.
  4. Proposition 14, p. 29 (Shimizu): w.h.p. ρavg(Gn,αn−ω)∈((1−ϵ)μ,(1+ϵ)μ)\rho_{\mathrm{avg}}(\mathcal G_{n,\alpha n^{-\omega}})\in((1-\epsilon)\mu,(1+\epsilon)\mu)ρavg​(Gn,αn−ω​)∈((1−ϵ)μ,(1+ϵ)μ), where μ=⌈11−ω⌉+1{11−ω∈N}e−α1/(1−ω)\mu=\lceil\frac1{1-\omega}\rceil+\mathbf 1\{\frac1{1-\omega}\in\mathbb N\}e^{-\alpha^{1/(1-\omega)}}μ=⌈1−ω1​⌉+1{1−ω1​∈N}e−α1/(1−ω).
  5. Propositions 16, 17, 18, pp. 29–30: the diameter of the very dense and dense SBM, and lower bounds on its average distance, in the three cases ω=0\omega=0ω=0, 11−ω∉N\frac1{1-\omega}\notin\mathbb N1−ω1​∈/N and 11−ω∈N\frac1{1-\omega}\in\mathbb N1−ω1​∈N.

Significance

Theorem 6 and Theorem 7 together bracket the success region of the metric relaxation in the very dense regime: recovery for p−q>1/2p-q>1/2p−q>1/2, failure above the curve (22). In the dense regime, Theorem 7 gives explicit linear thresholds β>c(ω,α) α\beta>c(\omega,\alpha)\,\alphaβ>c(ω,α)α above which the LP fails. The proof reduces failure to a deterministic distance criterion (Theorem 5, posed in mission 4 of this series) and turns asymptotic distance distributions of random graphs into statements about an LP.

The results are proved in the paper, partly by citing Bollobás's diameter theorems and Shimizu's average-distance theorem; none of them has a machine-checked proof. Formalizing the mission yields, besides Theorem 7, the diameter and average distance of dense Erdős–Rényi graphs (Propositions 12 and 14) and the monotone coupling between Erdős–Rényi graphs and the SBM (Proposition 11), each of which is usable beyond this paper. The coupling and (26) are also the inputs of the logarithmic-degree result (Theorem 8, mission 7).

Difficulty

The deterministic half is short: once ∣E0∣/∣E∣|E_0|/|E|∣E0​∣/∣E∣, ρmax⁡\rho_{\max}ρmax​ and ρavg\rho_{\mathrm{avg}}ρavg​ are pinned down, the case computations (28)–(29) reduce to inequalities between explicit expressions in α\alphaα, β\betaβ and ω\omegaω. The difficulty is the random-graph input. The diameter of Gn,p\mathcal G_{n,p}Gn,p​ for p=αn−ωp=\alpha n^{-\omega}p=αn−ω needs the second-moment analysis of the number of pairs at distance greater than ddd (Bollobás, Corollaries 10.11–10.12), and the average distance needs the finer limit law for path counts at the critical exponent 11−ω∈N\frac1{1-\omega}\in\mathbb N1−ω1​∈N, where the constant e−α1/(1−ω)e^{-\alpha^{1/(1-\omega)}}e−α1/(1−ω) appears. A first-moment argument gives only one side of each estimate. Concentration of ∣E∣|E|∣E∣ and ∣E0∣|E_0|∣E0​∣ (26) is a Hoeffding bound, but it must hold uniformly over the random planted bisection.

Formalization scope

Nodes are Fin n and graphs SimpleGraph (Fin n). A bisection is its side V1V_1V1​ with 2∣V1∣=n2|V_1|=n2∣V1​∣=n. The LP variable is a symmetric, zero-diagonal array Fin n → Fin n → ℝ, with no box constraints, so uniqueness is uniqueness over R(n2)\mathbb R^{\binom n2}R(2n​). Probabilities are finite sums over all graphs (and all bisections for the SBM). Edge probabilities are clamped into [0,1][0,1][0,1], which affects only finitely many nnn. SBM limits run over even n=2mn=2mn=2m. Distances are in ℕ∞ and ρavg\rho_{\mathrm{avg}}ρavg​ in [0,∞][0,\infty][0,∞], so disconnected samples have infinite diameter and average distance; no real truncation is used.

Disclosed choices:

  • Theorem 7 adds α>β\alpha>\betaα>β, the SBM's standing assumption p>qp>qp>q (§4, p. 13), also assumed by Proposition 18 and (26).
  • (26) is posed for p=αs(n)p=\alpha s(n)p=αs(n), q=βs(n)q=\beta s(n)q=βs(n) with s(n)≥clog⁡n/ns(n)\ge c\log n/ns(n)≥clogn/n and αs(n)≤1\alpha s(n)\le1αs(n)≤1 eventually. Then q/p=β/αq/p=\beta/\alphaq/p=β/α, which avoids the printed "lim⁡p/q∈(0,1]\lim p/q\in(0,1]limp/q∈(0,1]", a slip for q/pq/pq/p.
  • Proposition 11 is posed as printed, with middle law Gn,q,p\mathcal G_{n,q,p}Gn,q,p​ (within qqq, across ppp).

Two encodings would make the statements trivial, and both are excluded. Unnormalized LP variables would make uniqueness false. Reading ρ\rhoρ in R\mathbb RR via toReal would make the upper bounds hold for disconnected graphs.

The deterministic distance criterion (Theorem 5) is posed in mission 4 and is not restated. Contributions are welcome on the coupling, Hoeffding-type concentration of edge counts, and the Erdős–Rényi distance asymptotics. These are reusable for any finite random-graph development.

Selected references

  • A. Del Pia, A. Khajavirad, D. Kunisky, Linear Programming and Community Detection, Mathematics of Operations Research, 2023; arXiv:2006.03213v2. https://arxiv.org/abs/2006.03213
  • E. Abbe, A. S. Bandeira, G. Hall, Exact recovery in the stochastic block model, IEEE Trans. Inf. Theory 62 (2016) 471–487. https://arxiv.org/abs/1405.3267
  • A. S. Bandeira, Random Laplacian matrices and convex relaxations, Found. Comput. Math. 18 (2018) 345–379. https://arxiv.org/abs/1504.03987
  • B. Bollobás, Random Graphs, 2nd ed., Cambridge Studies in Advanced Mathematics 73, Cambridge University Press, 2001. https://doi.org/10.1017/CBO9780511814068
  • N. Shimizu, The average distance of dense homogeneous random graphs, Mathematical Engineering Technical Report, Department of Mathematical Informatics, The University of Tokyo, November 2017 (Theorem 1; reference [38] of the paper). https://www.keisu.t.u-tokyo.ac.jp/research/techrep/
14 thms1 active userReviewed
Linear OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Linear Programming and Community Detection 7: The LP Relaxation Fails w.h.p. in the Logarithmic-Degree SBMResearch Paper

Motivation

The stochastic block model (SBM) is the standard benchmark for community detection: a random graph whose vertices are split into hidden communities, with denser connections inside a community than across. For two equal communities, the best possible estimator of the hidden partition is the minimum bisection problem, which is NP-hard in the worst case. Its tractable relaxations are therefore compared by asking for which edge densities they still recover the hidden partition exactly.

For semidefinite programming the answer is complete in the logarithmic-degree regime: Abbe, Bandeira and Hall (arXiv:1405.3267) located the information-theoretic threshold α−β=2\sqrt\alpha-\sqrt\beta=\sqrt2α​−β​=2​, and the SDP relaxation was shown to reach it by Hajek, Wu and Xu (arXiv:1412.6156) and by Bandeira (arXiv:1504.03987). Linear programming relaxations are cheaper and widely used in combinatorial optimization, but their behaviour on the SBM was not known. Del Pia, Khajavirad and Kunisky (arXiv:2006.03213, Mathematics of Operations Research, 2023) study the most common one, the metric relaxation. This mission formalizes their result for the logarithmic-degree regime (Theorem 8): there the LP relaxation fails to recover the hidden partition with high probability, at every choice of the parameters.

Setting

Let V={1,…,n}V=\{1,\dots,n\}V={1,…,n} with nnn even. A bisection is a partition V=V1⊔V2V=V_1\sqcup V_2V=V1​⊔V2​ with ∣V1∣=∣V2∣=n/2|V_1|=|V_2|=n/2∣V1​∣=∣V2​∣=n/2; its cost in a graph GGG is the number of edges between V1V_1V1​ and V2V_2V2​. Given a fixed planted bisection V1,V2V_1,V_2V1​,V2​, an optimization problem recovers it if its unique optimal solution corresponds to V1,V2V_1,V_2V1​,V2​.

The cut vector xˉ∈{0,1}(n2)\bar x\in\{0,1\}^{\binom n2}xˉ∈{0,1}(2n​) of V1,V2V_1,V_2V1​,V2​ has xˉij=1\bar x_{ij}=1xˉij​=1 exactly when i,ji,ji,j lie on different sides. With aij=1a_{ij}=1aij​=1 for edges and 000 otherwise, the metric relaxation is

(LP-P)min⁡x∑i<jaijxij  s.t.  xij≤xik+xjk,  xij+xik+xjk≤2,  ∑i<jxij=n24,\text{(LP-P)}\quad \min_x \sum_{i<j}a_{ij}x_{ij}\ \ \text{s.t.}\ \ x_{ij}\le x_{ik}+x_{jk},\ \ x_{ij}+x_{ik}+x_{jk}\le2,\ \ \sum_{i<j}x_{ij}=\frac{n^2}{4},(LP-P)xmin​i<j∑​aij​xij​  s.t.  xij​≤xik​+xjk​,  xij​+xik​+xjk​≤2,  i<j∑​xij​=4n2​,

the first family over distinct i,j,ki,j,ki,j,k and the second over i<j<ki<j<ki<j<k, with xji:=xijx_{ji}:=x_{ij}xji​:=xij​. Every bisection's cut vector is feasible.

The distance ρG(i,j)\rho_G(i,j)ρG​(i,j) is the length of a shortest iii–jjj path (+∞+\infty+∞ across components). The diameter is ρmax⁡(G)=max⁡i,jρG(i,j)\rho_{\max}(G)=\max_{i,j}\rho_G(i,j)ρmax​(G)=maxi,j​ρG​(i,j) and the average distance is ρavg(G)=2n2∑i<jρG(i,j)\rho_{\mathrm{avg}}(G)=\frac{2}{n^2}\sum_{i<j}\rho_G(i,j)ρavg​(G)=n22​∑i<j​ρG​(i,j).

The Erdős–Rényi model Gn,p\mathcal G_{n,p}Gn,p​ draws each edge independently with probability ppp. The SBM Gn,p,q\mathcal G_{n,p,q}Gn,p,q​ chooses a bisection V1,V2V_1,V_2V1​,V2​ uniformly at random, then draws each pair inside a side with probability ppp and each pair across with probability qqq, independently, where p>qp>qp>q. The logarithmic-degree regime (21) is

p=αlog⁡nn,q=βlog⁡nn,α>β>0.p=\alpha\frac{\log n}{n},\qquad q=\beta\frac{\log n}{n},\qquad \alpha>\beta>0 .p=αnlogn​,q=βnlogn​,α>β>0.

An event AnA_nAn​ holds with high probability if P[An]→1\mathbb P[A_n]\to1P[An​]→1 as n→∞n\to\inftyn→∞.

Formalization targets

Goal: Theorem 8 (p. 18)

α>β>0 ⟹ lim⁡n→∞PGn,p,q[(LP-P) does not recover V1,V2]=1.\alpha>\beta>0\ \Longrightarrow\ \lim_{n\to\infty}\mathbb P_{\mathcal G_{n,p,q}}\big[\text{(LP-P) does not recover }V_1,V_2\big]=1 .α>β>0 ⟹ n→∞lim​PGn,p,q​​[(LP-P) does not recover V1​,V2​]=1.

Milestones

  1. The threshold of [2] (p. 14, strict cases): if α−β>2\sqrt\alpha-\sqrt\beta>\sqrt2α​−β​>2​, the minimum bisection problem recovers V1,V2V_1,V_2V1​,V2​ with high probability; if α−β<2\sqrt\alpha-\sqrt\beta<\sqrt2α​−β​<2​, it does not.
  2. Proposition 13 (p. 29): for α>1\alpha>1α>1 and G∼Gn,αlog⁡n/nG\sim\mathcal G_{n,\alpha\log n/n}G∼Gn,αlogn/n​, ρmax⁡(G)∈((1−ϵ)log⁡nlog⁡log⁡n,(1+ϵ)log⁡nlog⁡log⁡n)\rho_{\max}(G)\in\big((1-\epsilon)\frac{\log n}{\log\log n},(1+\epsilon)\frac{\log n}{\log\log n}\big)ρmax​(G)∈((1−ϵ)loglognlogn​,(1+ϵ)loglognlogn​) with high probability.
  3. Proposition 15 (p. 29, Theorem 1 of Chung–Lu): for α>1\alpha>1α>1, ρavg(G)∈((1−ϵ)log⁡nlog⁡pn,(1+ϵ)log⁡nlog⁡pn)\rho_{\mathrm{avg}}(G)\in\big((1-\epsilon)\frac{\log n}{\log pn},(1+\epsilon)\frac{\log n}{\log pn}\big)ρavg​(G)∈((1−ϵ)logpnlogn​,(1+ϵ)logpnlogn​) with high probability.
  4. Proposition 19 (p. 30): for α>β>0\alpha>\beta>0α>β>0 with α+β2>1\frac{\alpha+\beta}{2}>12α+β​>1 and G∼Gn,p,qG\sim\mathcal G_{n,p,q}G∼Gn,p,q​,
(1−ϵ)log⁡nlog⁡log⁡n≤ρavg(G)≤ρmax⁡(G)≤(1+ϵ)log⁡nlog⁡log⁡n(1-\epsilon)\frac{\log n}{\log\log n}\le\rho_{\mathrm{avg}}(G)\le\rho_{\max}(G)\le(1+\epsilon)\frac{\log n}{\log\log n}(1−ϵ)loglognlogn​≤ρavg​(G)≤ρmax​(G)≤(1+ϵ)loglognlogn​

with high probability.

Two results the proof of Theorem 8 uses are posed in sibling missions of this series and are not restated here: Theorem 5 (a distance-based non-recovery criterion for (LP-P), mission 4) and the coupling Proposition 11 together with the crossing-edge count (26) (mission 6).

Significance

The result. Theorem 8 separates linear from semidefinite programming on a natural statistical problem. In the logarithmic regime the SDP relaxation recovers the planted bisection whenever any method can, while the metric LP fails with high probability for all α>β>0\alpha>\beta>0α>β>0, including parameters far above the information-theoretic threshold. The paper's Theorem 6 shows that in the very dense regime (constant p,qp,qp,q) the LP does succeed when p−q>1/2p-q>1/2p−q>1/2; Theorem 8 shows that at logarithmic degree no such window exists.

Formalizing it. The theorem is proved in the paper, modulo results cited from the random-graph literature. Nothing in this mission is machine-checked yet. Formalization adds a precise account of what the cited distance asymptotics assert; Proposition 19's upper bound is justified in the paper only by reference to "a standard result on the diameter of the SBM" obtained by adapting an argument of Abbe's survey, so a complete proof of it is new work. Propositions 13 and 15 are classical facts about Erdős–Rényi graphs that have no formal proof in any library known to the curators, and are reusable well beyond community detection.

Difficulty

The LP side of the argument is deterministic and finite. The difficulty is probabilistic. The distance results require tight control of breadth-first neighbourhood growth in sparse random graphs near the connectivity threshold, where the average degree is only logarithmic, with error terms small enough to pin the diameter to a (1±ϵ)(1\pm\epsilon)(1±ϵ) window. A first-moment estimate of path counts gives only one side of each bound. In the SBM the two edge probabilities make neighbourhood growth inhomogeneous, so the Erdős–Rényi results do not transfer verbatim. The threshold of [2] is a separate sharp large-deviation statement, at the level of individual vertices' in- and out-degrees.

Formalization scope

Vertices are Fin n (0-based); graphs are SimpleGraph (Fin n). A bisection is recorded by its side V1V_1V1​ with 2∣V1∣=n2|V_1|=n2∣V1​∣=n. The LP variable is a symmetric, zero-diagonal array x:V×V→Rx:V\times V\to\mathbb Rx:V×V→R, which is a point of R(n2)\mathbb R^{\binom n2}R(2n​); no box constraints are added. LP recovery means that the planted cut vector is the unique optimal solution; minimum-bisection recovery means that every bisection of cost at most the planted one is the planted unordered partition. Distances are in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞} and the average distance in [0,∞][0,\infty][0,∞], so a disconnected sample has infinite diameter. The random-graph laws are finite sums over all graphs; the SBM averages over all bisections. Edge probabilities are clamped into [0,1][0,1][0,1], which matters only for the finitely many nnn with αlog⁡n/n>1\alpha\log n/n>1αlogn/n>1. "With high probability" is a limit of probabilities equal to 111; for the SBM the limit runs along n=2mn=2mn=2m. Logarithms are natural.

Disclosed choices relative to the printed statements: Theorem 8 prints only α,β>0\alpha,\beta>0α,β>0, and α>β\alpha>\betaα>β is added as the SBM's standing assumption p>qp>qp>q (p. 13) and that of (21). The threshold of [2] is printed as an "if and only if"; only the two strict implications are posed, and the boundary α−β=2\sqrt\alpha-\sqrt\beta=\sqrt2α​−β​=2​ is left out.

The statements cannot be satisfied vacuously: the laws are genuine probability distributions for every nnn, the events compare extended-valued distances without truncation, and recovery requires uniqueness over all real feasible points of (LP-P). An encoding with an empty or degenerate feasible set, or with distances truncated to finite reals, would change the theorems and is excluded.

A complete development needs: Erdős–Rényi and SBM laws, breadth-first exploration bounds for sparse random graphs, the coupling of the SBM between two Erdős–Rényi graphs (mission 6), the LP non-recovery criterion (mission 4), and the information-theoretic threshold of [2]. Contributions on the random-graph distance asymptotics are reusable on their own and especially welcome.

Selected references

  • A. Del Pia, A. Khajavirad, D. Kunisky, Linear Programming and Community Detection, Mathematics of Operations Research, 2023. https://arxiv.org/abs/2006.03213 (v2 is the cited version)
  • E. Abbe, A. S. Bandeira, G. Hall, Exact recovery in the stochastic block model, IEEE Transactions on Information Theory 62:471–487, 2016. https://arxiv.org/abs/1405.3267
  • E. Abbe, Community detection and stochastic block models: recent developments, Journal of Machine Learning Research 18:1–86, 2018. https://arxiv.org/abs/1703.10146
  • F. Chung, L. Lu, The diameter of sparse random graphs, Advances in Applied Mathematics 26(4):257–279, 2001. https://doi.org/10.1006/aama.2001.0720
  • F. Chung, L. Lu, The average distances in random graphs with given expected degrees, PNAS 99(25):15879–15882, 2002. https://doi.org/10.1073/pnas.252631999
  • B. Hajek, Y. Wu, J. Xu, Achieving exact cluster recovery threshold via semidefinite programming, IEEE Transactions on Information Theory 62(5):2788–2797, 2016. https://arxiv.org/abs/1412.6156
  • A. S. Bandeira, Random Laplacian matrices and convex relaxations, Foundations of Computational Mathematics 18(2):345–379, 2018. https://arxiv.org/abs/1504.03987
10 thms1 active userReviewed
CombinatoricsLinear OptimizationOperations Research+2·Captain: mikedeng1

Linear Programming and Community Detection 5: The LP Relaxation Recovers the Planted Bisection w.h.p. in the Very Dense SBM When p − q > 1/2Research Paper

Motivation

The stochastic block model (SBM), introduced by Holland, Laskey and Leinhardt (1983), is the standard random model for networks with community structure, and the basic benchmark for community-detection algorithms (Abbe 2018). In its two-community form the nodes are split into two equal halves, edges inside a half appear with probability ppp, and edges across with probability q<pq<pq<p. The task of exact recovery is to identify the hidden halves from the graph alone.

The maximum a posteriori estimator for this model is the minimum bisection problem (find a balanced cut with the fewest crossing edges), which is NP-hard in general. Abbe, Bandeira and Hall (2016) determined when it recovers the planted bisection, and showed that a semidefinite relaxation is as good as the integer program. Del Pia, Khajavirad and Kunisky (arXiv:2006.03213, Mathematics of Operations Research 2023) ask the same question for the cheapest standard relaxation: the metric linear programming relaxation, defined by triangle inequalities. This mission is their positive result in the very dense regime.

Setting

Let V={1,…,n}V=\{1,\dots,n\}V={1,…,n} with nnn even. A bisection is a partition V=V1∪V2V=V_1\cup V_2V=V1​∪V2​ with ∣V1∣=∣V2∣=n/2|V_1|=|V_2|=n/2∣V1​∣=∣V2​∣=n/2. For a graph G=(V,E)G=(V,E)G=(V,E) let aij=1a_{ij}=1aij​=1 if (i,j)∈E(i,j)\in E(i,j)∈E and 000 otherwise. The metric relaxation (LP-P) is

min⁡x∈R(n2) ∑i<jaijxijs.t.xij≤xik+xjk,xij+xik+xjk≤2,∑i<jxij=n24,\min_{x\in\mathbb R^{\binom n2}}\ \sum_{i<j}a_{ij}x_{ij}\quad\text{s.t.}\quad x_{ij}\le x_{ik}+x_{jk},\quad x_{ij}+x_{ik}+x_{jk}\le 2,\quad \sum_{i<j}x_{ij}=\frac{n^2}{4},x∈R(2n​)min​ i<j∑​aij​xij​s.t.xij​≤xik​+xjk​,xij​+xik​+xjk​≤2,i<j∑​xij​=4n2​,

the first constraint for all distinct i,j,ki,j,ki,j,k with i<ji<ji<j, the second for all i<j<ki<j<ki<j<k, and xji:=xijx_{ji}:=x_{ij}xji​:=xij​. The cut vector xˉ\bar xxˉ of a bisection has xˉij=0\bar x_{ij}=0xˉij​=0 for i,ji,ji,j on the same side and xˉij=1\bar x_{ij}=1xˉij​=1 otherwise. (LP-P) recovers the planted bisection when xˉ\bar xxˉ is its unique optimal solution.

In the Erdős–Rényi model Gn,p\mathcal G_{n,p}Gn,p​ every pair of nodes is an edge independently with probability ppp. In the SBM Gn,p,q\mathcal G_{n,p,q}Gn,p,q​ a bisection V1,V2V_1,V_2V1​,V2​ is first chosen uniformly at random; then pairs inside V1V_1V1​ or inside V2V_2V2​ are edges with probability ppp, pairs between them with probability qqq, all independently. Gn,0,q\mathcal G_{n,0,q}Gn,0,q​ is the random bipartite graph across a random bisection. An event occurs with high probability (w.h.p.) if its probability tends to 111 as n→∞n\to\inftyn→∞. The graph is very dense when ppp and qqq are constants.

For a finite graph G=(V,E)G=(V,E)G=(V,E) and b∈Z≥0Vb\in\mathbb Z_{\ge0}^Vb∈Z≥0V​, a bbb-factor (or fff-factor) is a set F⊆EF\subseteq EF⊆E with exactly bvb_vbv​ edges of FFF at each node vvv; N(U,U′)N(U,U')N(U,U′) counts edges with one endpoint in UUU and one in U′U'U′; dmin⁡d_{\min}dmin​, dmax⁡d_{\max}dmax​ are the minimum and maximum degrees; and the node connectivity κ(G)\kappa(G)κ(G) is the minimum number of nodes whose deletion disconnects GGG (the number of nodes, for a complete graph).

Formalization targets

Goal: Theorem 6 (p. 15)

For constants 0<q<p<10<q<p<10<q<p<1,

p−q>12 ⟹ PG∼Gn,p,q[(LP-P) recovers the planted bisection]→n→∞1.p-q>\tfrac12\ \Longrightarrow\ \mathbb P_{G\sim\mathcal G_{n,p,q}}\big[\text{(LP-P) recovers the planted bisection}\big]\xrightarrow[n\to\infty]{}1 .p−q>21​ ⟹ PG∼Gn,p,q​​[(LP-P) recovers the planted bisection]n→∞​1.

Milestones

  1. Proposition 6 (p. 20): for G∼G2m,0,qG\sim\mathcal G_{2m,0,q}G∼G2m,0,q​ there is C>0C>0C>0 with dmax⁡≤qm+Cmlog⁡md_{\max}\le qm+C\sqrt{m\log m}dmax​≤qm+Cmlogm​ w.h.p.
  2. Proposition 5 (p. 20; Schrijver, Cor. 21.4a): a bipartite graph has a bbb-factor iff N(U,U)≥b(U)−12b(V)N(U,U)\ge b(U)-\frac12 b(V)N(U,U)≥b(U)−21​b(V) for every U⊆VU\subseteq VU⊆V.
  3. Proposition 3 (p. 14): there is Creg,2>0C_{\mathrm{reg},2}>0Creg,2​>0 such that for every q∈(0,1)q\in(0,1)q∈(0,1), w.h.p. G∼Gn,0,qG\sim\mathcal G_{n,0,q}G∼Gn,0,q​ is a subgraph of a regular bipartite graph with the same bipartition, of degree dreg=qn2+Creg,2n2log⁡n2d_{\mathrm{reg}}=\frac{qn}2+C_{\mathrm{reg},2}\sqrt{\frac n2\log\frac n2}dreg​=2qn​+Creg,2​2n​log2n​​ (rounded down).
  4. Proposition 8 (p. 24): for G∼Gn,pG\sim\mathcal G_{n,p}G∼Gn,p​ there is C>0C>0C>0 with dmin⁡≥pn−Cnlog⁡nd_{\min}\ge pn-C\sqrt{n\log n}dmin​≥pn−Cnlogn​ w.h.p.
  5. Proposition 9 (p. 24; Bollobás–Thomason): for G∼Gn,pG\sim\mathcal G_{n,p}G∼Gn,p​, κ(G)=dmin⁡\kappa(G)=d_{\min}κ(G)=dmin​ w.h.p.
  6. Proposition 7 (p. 24; Tutte's fff-factor theorem).
  7. Proposition 4 (p. 14): there is Creg,1>0C_{\mathrm{reg},1}>0Creg,1​>0 such that for every p∈(0,1)p\in(0,1)p∈(0,1), w.h.p. G∼Gn,pG\sim\mathcal G_{n,p}G∼Gn,p​ contains a spanning regular subgraph of degree dreg=pn−Creg,1nlog⁡nd_{\mathrm{reg}}=pn-C_{\mathrm{reg},1}\sqrt{n\log n}dreg​=pn−Creg,1​nlogn​ (rounded up to an even integer).

The deterministic recovery criterion that the goal also depends on, Theorem 4 of the paper (regular sandwiching with din−dout≥n/4d_{\mathrm{in}}-d_{\mathrm{out}}\ge n/4din​−dout​≥n/4), is the goal of mission 3 of this series and is not restated here.

Significance

The result. Theorem 6 is the only positive recovery guarantee for the metric LP in the random setting of the paper. Together with the failure results of Theorems 7 and 8 (missions 6 and 7), it locates the LP strictly between trivial and information-theoretically optimal: it recovers in a region of constant p,qp,qp,q, but not up to the threshold p>qp>qp>q that the minimum bisection problem and its SDP relaxation reach. Propositions 3 and 4, that dense random graphs sit inside, and contain, regular graphs of nearly their average degree, are of independent interest in random graph theory, as the authors note.

Formalizing it. The result is proved in the paper; none of it is machine-checked. The mission also requires three classical theorems that are not in Mathlib: the bbb-factor criterion for bipartite graphs, Tutte's fff-factor theorem (Mathlib has only the perfect-matching case f≡1f\equiv 1f≡1), and the Bollobás–Thomason theorem κ=dmin⁡\kappa=d_{\min}κ=dmin​ for random graphs, together with degree concentration for Gn,p\mathcal G_{n,p}Gn,p​ and the bipartite SBM. Each is reusable well beyond this paper.

Difficulty

The obvious argument for recovery is to exhibit a dual certificate for (LP-P), which needs regularity of the communities and of the cross edges; a random graph is not regular. The paper bridges the gap by sandwiching the random graph between regular graphs of nearly equal degree, and that step is where the difficulty lies: the existence of a regular sub- or supergraph is a global combinatorial property, characterized by factor theorems with exponentially many conditions, each of which must hold simultaneously with high probability. Degree concentration alone, the first idea, controls only the singleton conditions. Tutte's fff-factor theorem and the bipartite bbb-factor criterion are themselves substantial combinatorial theorems, and the connectivity statement of Bollobás and Thomason is a deep result on random graphs.

Formalization scope

Nodes are Fin n (0-based). A bisection is a Finset V1V_1V1​ with 2∣V1∣=n2|V_1|=n2∣V1​∣=n. Points of R(n2)\mathbb R^{\binom n2}R(2n​) are symmetric arrays with zero diagonal; (LP-P) has no box constraints 0≤x≤10\le x\le10≤x≤1 (they are implied by the constraints and adding them would change the LP). Recovery means: xˉ\bar xxˉ is optimal and every optimal solution equals xˉ\bar xxˉ.

The random-graph laws are finite: a probability is a weighted sum over all graphs on Fin n, with independent edge weights, and for the SBM an average over all bisections; the event may depend on the drawn bisection. Edge probabilities are clamped into [0,1][0,1][0,1], which is the identity on the parameters used here. "With high probability" is Tendsto … atTop (𝓝 1), along n=2mn=2mn=2m for the SBM. The standing assumption p>qp>qp>q is not built into the law, so that Gn,0,q\mathcal G_{n,0,q}Gn,0,q​ is the case p=0p=0p=0.

Disclosed readings: the printed dregd_{\mathrm{reg}}dreg​ of Propositions 3 and 4 is not an integer; Proposition 3 is posed with degree ⌊dreg⌋\lfloor d_{\mathrm{reg}}\rfloor⌊dreg​⌋ and Proposition 4 with 2⌈dreg/2⌉2\lceil d_{\mathrm{reg}}/2\rceil2⌈dreg​/2⌉, the least even integer ≥dreg\ge d_{\mathrm{reg}}≥dreg​ (the proof assumes dregd_{\mathrm{reg}}dreg​ even). κ(Kn)=n\kappa(K_n)=nκ(Kn​)=n as on p. 24. Quantifier order follows each page: in Propositions 3 and 4 the constant precedes the probability parameter, in Propositions 6 and 8 it follows it; no constant depends on nnn.

A statement in which "with high probability" is replaced by a positive probability or an eventual bound, in which the bisection is fixed rather than random, or in which the regular degree is compared with an irrational real (an empty event) is not this mission's target.

Infrastructure needed: the finite random-graph laws, Hoeffding-type concentration over them, the two factor theorems, and node connectivity. Proofs of any milestone, and of the classical results as general graph theory, are welcome.

Selected references

  • A. Del Pia, A. Khajavirad, D. Kunisky, Linear Programming and Community Detection, Mathematics of Operations Research, 2023; arXiv:2006.03213v2. https://arxiv.org/abs/2006.03213
  • E. Abbe, A. S. Bandeira, G. Hall, Exact Recovery in the Stochastic Block Model, IEEE Transactions on Information Theory 62(1), 2016. https://arxiv.org/abs/1405.3267
  • E. Abbe, Community Detection and Stochastic Block Models: Recent Developments, Journal of Machine Learning Research 18, 2018. https://arxiv.org/abs/1703.10146
  • P. W. Holland, K. B. Laskey, S. Leinhardt, Stochastic Blockmodels: First Steps, Social Networks 5(2), 1983. https://doi.org/10.1016/0378-8733(83)90021-7
  • W. T. Tutte, The Factors of Graphs, Canadian Journal of Mathematics 4, 1952. https://doi.org/10.4153/CJM-1952-028-2
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003 (Corollary 21.4a).
  • B. Bollobás, A. Thomason, Random Graphs of Small Order, in Random Graphs '83, North-Holland Mathematics Studies 118, 1985 (Theorem 1).
  • A. Frieze, M. Karoński, Introduction to Random Graphs, Cambridge University Press, 2016 (Chapter 3). https://doi.org/10.1017/CBO9781316339831
10 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Load Balancing Under Strict Compatibility Constraints 3: Inhomogeneous Random Graphs with Edge Probabilities Satisfying (3.5) Are Almost Surely Proportionally Sparse and SubcriticalResearch Paper

Motivation

Large-scale computing systems route incoming tasks to servers through dispatchers, one per task type. A task can only run on a server that holds the data or software it needs, so the set of admissible pairs forms a bipartite compatibility graph between task types and servers. Full flexibility (every server can serve every type) gives the best load balancing but requires each server to store everything. A central question is how sparse the compatibility graph can be while keeping the performance of the fully flexible system.

For the power-of-ddd policy JSQ(ddd) (an arriving task samples ddd compatible servers and joins the shortest of their queues), Rutten and Mukherjee (arXiv:2008.07562v2, Math. Oper. Res. 2023) identify two deterministic graph conditions, proportional sparsity and subcriticality, under which the occupancy process has the same mean-field limit and the same steady-state limit as in the fully flexible system (their Theorem 3.4). They then show that natural random designs satisfy both conditions almost surely. This mission covers the second random design: task types with inhomogeneous levels of flexibility, where each edge incident to task type www is present independently with its own probability pw(N)p_w(N)pw​(N) (Theorem 3.6 of the paper).

Earlier work on JSQ-type policies with constrained compatibility includes the stability analyses of Bramson (Ann. Appl. Probab. 2011) and of Cardinaels, Borst and van Leeuwaarden (Queueing Syst. 2019), to which subcriticality is equivalent for a fixed system (Remark 3 of the paper), and the mean-field analysis of the supermarket model on graphs by Budhiraja, Mukherjee and Wu (Ann. Appl. Probab. 2019), whose load condition is stronger than the condition (A.19) used here (Remark 11 of the paper).

Setting

For each N≥1N \ge 1N≥1 there are a set VNV_NVN​ of NNN servers and a set WNW_NWN​ of M(N)≥1M(N) \ge 1M(N)≥1 dispatchers. A compatibility graph is GN=(VN,WN,EN)G_N = (V_N, W_N, E_N)GN​=(VN​,WN​,EN​) with EN⊆VN×WNE_N \subseteq V_N \times W_NEN​⊆VN​×WN​, and the neighbourhood of www is Nw={v:(v,w)∈EN}N_w = \{v : (v, w) \in E_N\}Nw​={v:(v,w)∈EN​}.

Proportional sparsity (Definition 3.1). For every ε>0\varepsilon > 0ε>0,

sup⁡U⊆VN1M(N)∣{w∈WN:∣∣Nw∩U∣∣Nw∣−∣U∣N∣≥ε}∣→0.\sup_{U \subseteq V_N} \frac{1}{M(N)} \Bigl| \Bigl\{ w \in W_N : \Bigl| \frac{|N_w \cap U|}{|N_w|} - \frac{|U|}{N} \Bigr| \ge \varepsilon \Bigr\} \Bigr| \to 0 .U⊆VN​sup​M(N)1​​{w∈WN​:​∣Nw​∣∣Nw​∩U∣​−N∣U∣​​≥ε}​→0.

Every set UUU of servers is seen by all but a vanishing fraction of dispatchers in roughly its global proportion.

Subcriticality (Definition 3.3). For each NNN, www and nonempty U⊆VNU \subseteq V_NU⊆VN​ there is a probability distribution γwU\gamma^U_wγwU​ on UUU such that, with kw=min⁡(d,∣Nw∣)k_w = \min(d, |N_w|)kw​=min(d,∣Nw​∣),

lim sup⁡N→∞max⁡v∈VNNM(N)∑w∈WN(∣Nw∣kw)−1∑U⊆Nw, ∣U∣=kwγwU(v)≤1.\limsup_{N \to \infty} \max_{v \in V_N} \frac{N}{M(N)} \sum_{w \in W_N} \binom{|N_w|}{k_w}^{-1} \sum_{U \subseteq N_w,\ |U| = k_w} \gamma^U_w(v) \le 1 .N→∞limsup​v∈VN​max​M(N)N​w∈WN​∑​(kw​∣Nw​∣​)−1U⊆Nw​, ∣U∣=kw​∑​γwU​(v)≤1.

Some static routing of sampled sets loads no server asymptotically beyond its capacity.

The random graph. Given edge probabilities pw(N)∈(0,1]p_w(N) \in (0, 1]pw​(N)∈(0,1], the graph GNG_NGN​ contains each pair (v,w)(v, w)(v,w) independently with probability pw(N)p_w(N)pw​(N). Write pˉ(N)=min⁡wpw(N)\bar p(N) = \min_{w} p_w(N)pˉ​(N)=minw​pw​(N) and ∥p(N)−1∥2−2=(∑wpw(N)−2)−1\|p(N)^{-1}\|_2^{-2} = (\sum_w p_w(N)^{-2})^{-1}∥p(N)−1∥2−2​=(∑w​pw​(N)−2)−1. Only the law of each GNG_NGN​ is prescribed; the graphs for different NNN may be coupled arbitrarily, and "almost surely" refers to any such coupling.

Formalization targets

Goal: Theorem 3.6 (graph part)

If, as N→∞N \to \inftyN→∞,

Nln⁡M(N)+ln⁡N pˉ(N)→∞,M(N) pˉ(N)→∞,ln⁡NM(N)2∑w∈WN1pw(N)2→0,(3.5)\frac{N}{\ln M(N) + \ln N}\, \bar p(N) \to \infty, \qquad M(N)\, \bar p(N) \to \infty, \qquad \frac{\ln N}{M(N)^2} \sum_{w \in W_N} \frac{1}{p_w(N)^2} \to 0, \qquad (3.5)lnM(N)+lnNN​pˉ​(N)→∞,M(N)pˉ​(N)→∞,M(N)2lnN​w∈WN​∑​pw​(N)21​→0,(3.5)

then almost surely {GN}\{G_N\}{GN​} is proportionally sparse and satisfies the subcriticality condition.

Milestones

  1. Lemma B.1. If pˉ(N)=ω(1/N)\bar p(N) = \omega(1/N)pˉ​(N)=ω(1/N) and pˉ(N)=ω(1/M(N))\bar p(N) = \omega(1/M(N))pˉ​(N)=ω(1/M(N)), then {GN}\{G_N\}{GN​} is proportionally sparse almost surely.
  2. The (A.19) reduction. For any graph sequence and d≥1d \ge 1d≥1,
lim sup⁡N→∞max⁡v∈VNNM(N)∑w∈WN1{(v,w)∈EN}∣Nw∣≤1(A.19)\limsup_{N \to \infty} \max_{v \in V_N} \frac{N}{M(N)} \sum_{w \in W_N} \frac{\mathbb 1\{(v, w) \in E_N\}}{|N_w|} \le 1 \qquad \text{(A.19)}N→∞limsup​v∈VN​max​M(N)N​w∈WN​∑​∣Nw​∣1{(v,w)∈EN​}​≤1(A.19)

implies subcriticality. 3. Lemma B.2. If pˉ(N)=ω((ln⁡M(N)+ln⁡N)/N)\bar p(N) = \omega((\ln M(N) + \ln N)/N)pˉ​(N)=ω((lnM(N)+lnN)/N) and ∥p(N)−1∥2−2=ω(ln⁡N/M(N)2)\|p(N)^{-1}\|_2^{-2} = \omega(\ln N / M(N)^2)∥p(N)−1∥2−2​=ω(lnN/M(N)2), then {GN}\{G_N\}{GN​} satisfies the subcriticality condition almost surely.

The goal is the conjunction of Lemmas B.1 and B.2 under (3.5).

Significance

Combined with Theorem 3.4 of the paper, the goal says that JSQ(ddd) on a random compatibility graph with dispatcher-dependent flexibility behaves, in the large-system limit and in steady state, like JSQ(ddd) on the complete bipartite graph. Condition (3.5) allows the least flexible task type to be compatible with only about ln⁡(M(N)N)\ln(M(N)N)ln(M(N)N) times a diverging factor of servers in expectation, far below NNN, and allows strongly heterogeneous flexibility levels as long as the spread measured by ∑wpw(N)−2\sum_w p_w(N)^{-2}∑w​pw​(N)−2 is controlled. Remark 8 of the paper notes that for M(N)=NM(N) = NM(N)=N and equal probabilities, p(N)=o(ln⁡N/N)p(N) = o(\ln N / N)p(N)=o(lnN/N) leaves a dispatcher isolated with probability tending to one, so the growth conditions are close to necessary.

The result is proved in the paper (Appendix B). As far as is known, none of it has been machine-checked. A formal proof requires a quantitative Chernoff bound for binomial tails, a bounded-differences (Azuma–Hoeffding) inequality for functions of independent Bernoulli variables, a union bound over all 2N2^N2N subsets of servers, and the first Borel–Cantelli lemma in a setting where only per-NNN marginal laws are fixed.

Difficulty

Proportional sparsity quantifies over every subset UUU of the NNN servers. A concentration estimate for one fixed UUU, or one fixed dispatcher, is not enough: whatever bound is used must survive a union over 2N2^N2N subsets, so a merely vanishing failure probability per dispatcher does not suffice.

Subcriticality is a maximum over all servers of a sum whose terms 1{(v,w)∈EN}/∣Nw∣\mathbb 1\{(v, w) \in E_N\}/|N_w|1{(v,w)∈EN​}/∣Nw​∣ are not independent: ∣Nw∣|N_w|∣Nw​∣ depends on the edge (v,w)(v, w)(v,w) itself, and a term is unbounded in the regime where ∣Nw∣|N_w|∣Nw​∣ is small. A direct concentration inequality for this sum therefore does not apply, and the logarithmic factors in (3.5) reflect the need to control all M(N)M(N)M(N) neighbourhood sizes and all NNN servers at once.

Independence across NNN is not available, so almost-sure statements cannot use the second Borel–Cantelli lemma or any law of large numbers along NNN; every bound must be summable in NNN.

Formalization scope

  • Servers are Fin N, dispatchers Fin (M N) with 0 < M N assumed, and a graph is a Finset (Fin N × Fin (M N)).
  • Edge probabilities are reals with 0<pw(N)≤10 < p_w(N) \le 10<pw​(N)≤1 (implicit in the paper). The random graph is a family of measurable maps XN:Ω→{0,1}VN×WNX_N : \Omega \to \{0,1\}^{V_N \times W_N}XN​:Ω→{0,1}VN​×WN​ on one probability space whose image law is the product of Bernoulli(pw(N))(p_w(N))(pw​(N)) laws. No assumption links different NNN.
  • Every "lim sup⁡≤1\limsup \le 1limsup≤1" is stated as "for every ε>0\varepsilon > 0ε>0, eventually, for every server, ≤1+ε\le 1 + \varepsilon≤1+ε"; the supremum over UUU in (3.1) as "for all ε,δ>0\varepsilon, \delta > 0ε,δ>0, eventually, for every UUU, at most δM(N)\delta M(N)δM(N) bad dispatchers". Both are exact equivalents.
  • Ratios use real division; ∣Nw∣=0|N_w| = 0∣Nw​∣=0 gives ratio 000, harmless for a limit condition. At N=1N = 1N=1 the logarithms in (3.5) and Lemma B.2 can make a denominator 000; this affects finitely many NNN.
  • Proportional sparsity does not include connectivity: these graphs are disconnected with positive probability for every NNN, so requiring connectivity would make the goal false.
  • Subcriticality is Definition 3.3 with two repairs: distributions are required only for nonempty UUU, and the normalisation is (∣Nw∣min⁡(d,∣Nw∣))\binom{|N_w|}{\min(d, |N_w|)}(min(d,∣Nw​∣)∣Nw​∣​) instead of the printed (∣Nw∣d)\binom{|N_w|}{d}(d∣Nw​∣​), which is 000 when ∣Nw∣<d|N_w| < d∣Nw​∣<d, an event of positive probability here. The two agree when ∣Nw∣≥d|N_w| \ge d∣Nw​∣≥d.
  • d≥2d \ge 2d≥2 as in the model. Under d=0d = 0d=0 the subcriticality predicate would be trivially true; the statements exclude it.
  • Only the graph part of Theorem 3.6 is posed; "Consequently, the conclusions of Theorem 3.4 hold" belongs to the mean-field mission of this series.

A complete development needs binomial Chernoff bounds, a bounded-differences inequality and Borel–Cantelli for summable bounds; these are reusable for other random-graph statements. Proofs of the deterministic (A.19) reduction and of either lemma are welcome independently.

Selected references

  • M. Rutten, D. Mukherjee, Load Balancing Under Strict Compatibility Constraints, arXiv:2008.07562v2, 2020; Math. Oper. Res. 48 (2023). https://arxiv.org/abs/2008.07562
  • M. Bramson, Stability of join the shortest queue networks, Ann. Appl. Probab. 21(4):1568–1625, 2011. https://doi.org/10.1214/10-AAP726
  • A. Budhiraja, D. Mukherjee, R. Wu, Supermarket model on graphs, Ann. Appl. Probab. 29(3):1740–1777, 2019. https://arxiv.org/abs/1712.07607
  • E. Cardinaels, S. C. Borst, J. S. H. van Leeuwaarden, Job assignment in large-scale service systems with affinity relations, Queueing Syst. 93(3–4):227–268, 2019.
  • S. Janson, T. Łuczak, A. Ruciński, Random Graphs, Wiley, 2000. https://doi.org/10.1002/9781118032718
7 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Load Balancing Under Strict Compatibility Constraints 2: Random Graphs with Server Degree c(N) → ∞ and Nc(N)/(M(N) ln N) → ∞ Are Almost Surely Proportionally Sparse and SubcriticalResearch Paper

Motivation

In large data centres, an incoming task often cannot run on every server: its data, software or licences sit on only some of the machines. Such strict compatibility constraints are modelled by a bipartite graph between task types (dispatchers) and servers. For the fully flexible system, in which every task can go to every server, the JSQ(ddd) policy (sample ddd servers at random and join the shortest queue) is described in the large-system limit by the mean-field ODE of Vvedenskaya, Dobrushin and Karpelevich (1996) and Mitzenmacher (1996). Rutten and Mukherjee (arXiv:2008.07562, Math. Oper. Res. 2023) identify two graph conditions, proportional sparsity and subcriticality, under which JSQ(ddd) on a sparse compatibility graph has the same mean-field limit and the same steady state as the fully flexible system (their Theorem 3.4).

The two conditions are useful in system design only if there are natural graph families that satisfy them. A storage designer controls the server degree: the number of task types a server can process is roughly proportional to the data it must store. Theorem 3.5 of the paper answers this design question for random graphs. If every server stores data for c(N)c(N)c(N) task types chosen uniformly at random, then c(N)→∞c(N)\to\inftyc(N)→∞ together with a mild density condition suffices, even when c(N)c(N)c(N) is negligible compared with the number M(N)M(N)M(N) of task types. This mission formalizes Theorem 3.5's graph-theoretic content and the chain of lemmas in Appendix A that proves it.

Setting

A system with NNN servers VN={1,…,N}V_N=\{1,\dots,N\}VN​={1,…,N} and M(N)M(N)M(N) dispatchers WN={1,…,M(N)}W_N=\{1,\dots,M(N)\}WN​={1,…,M(N)} has a compatibility graph GN=(VN,WN,EN)G_N=(V_N,W_N,E_N)GN​=(VN​,WN​,EN​) with EN⊆VN×WNE_N\subseteq V_N\times W_NEN​⊆VN​×WN​. The neighbourhood of a dispatcher www is Nw={v:(v,w)∈EN}\mathcal N_w=\{v:(v,w)\in E_N\}Nw​={v:(v,w)∈EN​}; that of a server vvv is Nv={w:(v,w)∈EN}\mathcal N_v=\{w:(v,w)\in E_N\}Nv​={w:(v,w)∈EN​}.

Proportional sparsity (Definition 3.1): for every ε>0\varepsilon>0ε>0,

sup⁡U⊆VN∣{w∈WN:∣∣Nw∩U∣∣Nw∣−∣U∣N∣≥ε}∣/M(N)→0.\sup_{U\subseteq V_N}\Big|\Big\{w\in W_N:\Big|\tfrac{|\mathcal N_w\cap U|}{|\mathcal N_w|}-\tfrac{|U|}{N}\Big|\ge\varepsilon\Big\}\Big|\Big/M(N)\to0 .U⊆VN​sup​​{w∈WN​:​∣Nw​∣∣Nw​∩U∣​−N∣U∣​​≥ε}​/M(N)→0.

In words, for every set UUU of servers, all but a vanishing fraction of the dispatchers see UUU in roughly the proportion ∣U∣/N|U|/N∣U∣/N.

Subcriticality (Definition 3.3) with sample size d≥2d\ge2d≥2: there are probability distributions γwU\gamma^U_wγwU​ on the sets U⊆VNU\subseteq V_NU⊆VN​ such that

lim sup⁡N→∞max⁡v∈VNNM(N)∑w∈WN(∣Nw∣kw)−1∑U⊆Nw, ∣U∣=kwγwU(v)≤1,kw=min⁡(d,∣Nw∣).\limsup_{N\to\infty}\max_{v\in V_N}\frac{N}{M(N)}\sum_{w\in W_N}\binom{|\mathcal N_w|}{k_w}^{-1}\sum_{U\subseteq\mathcal N_w,\ |U|=k_w}\gamma^U_w(v)\le1,\qquad k_w=\min(d,|\mathcal N_w|).N→∞limsup​v∈VN​max​M(N)N​w∈WN​∑​(kw​∣Nw​∣​)−1U⊆Nw​, ∣U∣=kw​∑​γwU​(v)≤1,kw​=min(d,∣Nw​∣).

Think of a static policy that routes a task arriving at www to a server in a sampled set UUU according to γwU\gamma^U_wγwU​. The condition says that no server receives more than its fair share of load. Its uniform-weight special case is condition (A.19):

lim sup⁡N→∞max⁡v∈VNNM(N)∑w∈WN1{(v,w)∈EN}∣Nw∣≤1.\limsup_{N\to\infty}\max_{v\in V_N}\frac{N}{M(N)}\sum_{w\in W_N}\frac{\mathbb 1\{(v,w)\in E_N\}}{|\mathcal N_w|}\le1 .N→∞limsup​v∈VN​max​M(N)N​w∈WN​∑​∣Nw​∣1{(v,w)∈EN​}​≤1.

The random graph. Let 1≤c(N)≤M(N)1\le c(N)\le M(N)1≤c(N)≤M(N). For each NNN, each server independently chooses its neighbourhood Nv\mathcal N_vNv​ uniformly among the c(N)c(N)c(N)-subsets of WNW_NWN​, so every server has degree exactly c(N)c(N)c(N). All graphs live on one probability space, but only the law of each GNG_NGN​ is prescribed; the joint law across different NNN is arbitrary.

Formalization targets

Goal: Theorem 3.5 (graph part)

If c(N)→∞c(N)\to\inftyc(N)→∞ and Nc(N)/(M(N)ln⁡N)→∞Nc(N)/(M(N)\ln N)\to\inftyNc(N)/(M(N)lnN)→∞, then almost surely

{GN}N≥1 is proportionally sparseand{GN}N≥1 satisfies the subcriticality condition.\{G_N\}_{N\ge1}\ \text{is proportionally sparse}\quad\text{and}\quad\{G_N\}_{N\ge1}\ \text{satisfies the subcriticality condition.}{GN​}N≥1​ is proportionally sparseand{GN​}N≥1​ satisfies the subcriticality condition.

Milestones, in the order of the proof in Appendix A

  1. Lemma A.1. If XN∼Bin(N,p(N))X_N\sim\mathrm{Bin}(N,p(N))XN​∼Bin(N,p(N)) and p(N)→0p(N)\to0p(N)→0, then for each δ∈(0,1/2)\delta\in(0,1/2)δ∈(0,1/2) there are N0≥1N_0\ge1N0​≥1 and a>0a>0a>0 with P(XN≥δN)≤(a p(N)δ)N\mathbb P(X_N\ge\delta N)\le(a\,p(N)^\delta)^NP(XN​≥δN)≤(ap(N)δ)N for N≥N0N\ge N_0N≥N0​.
  2. Lemma A.2. Let BN(X)B_N(X)BN​(X) be the set of servers whose number of neighbours in XXX deviates from c(N)∣X∣/M(N)c(N)|X|/M(N)c(N)∣X∣/M(N) by at least εc(N)∣X∣/M(N)\varepsilon c(N)|X|/M(N)εc(N)∣X∣/M(N). If c(N)→∞c(N)\to\inftyc(N)→∞ and Nc(N)/M(N)→∞Nc(N)/M(N)\to\inftyNc(N)/M(N)→∞, then for 0<ε≤3/20<\varepsilon\le3/20<ε≤3/2, 0<δ<1/20<\delta<1/20<δ<1/2 and η>0\eta>0η>0, almost surely eventually ∣BN(X)∣≤δN|B_N(X)|\le\delta N∣BN​(X)∣≤δN for all XXX with ∣X∣≥ηM(N)|X|\ge\eta M(N)∣X∣≥ηM(N).
  3. Lemma A.3. Under the same growth conditions, almost surely eventually at most δM(N)\delta M(N)δM(N) dispatchers have ∣Nw∣≤(1−ε)Nc(N)/M(N)|\mathcal N_w|\le(1-\varepsilon)Nc(N)/M(N)∣Nw​∣≤(1−ε)Nc(N)/M(N).
  4. Proposition A.4. Under the same growth conditions, {GN}\{G_N\}{GN​} is proportionally sparse almost surely.
  5. (A.19) reduction (p. 34). For any graph sequence, (A.19) implies subcriticality.
  6. Lemma A.5. If Nc(N)/(M(N)ln⁡N)→∞Nc(N)/(M(N)\ln N)\to\inftyNc(N)/(M(N)lnN)→∞, then {GN}\{G_N\}{GN​} satisfies (A.19) almost surely.

Significance

The result. Theorem 3.5 shows that the performance of the fully flexible JSQ(ddd) system, in the mean-field limit and in steady state, can be achieved with a server degree c(N)c(N)c(N) that grows arbitrarily slowly. The only requirement is that each dispatcher's mean degree Nc(N)/M(N)Nc(N)/M(N)Nc(N)/M(N) grow faster than ln⁡N\ln NlnN. Each server then needs to store data for only c(N)c(N)c(N) task types, a vanishing fraction of the M(N)M(N)M(N) types. The ln⁡N\ln NlnN threshold matches the scale below which some dispatchers have too few neighbours to share the load evenly.

Formalizing it. The result is proved in the paper, and no part of it has been machine-checked. The mission produces reusable statements about random bipartite graphs with fixed left degree: hypergeometric concentration over all large dispatcher sets, the degree lower tail, and a Borel–Cantelli argument without independence across NNN. It also produces a deterministic reduction from subcriticality to (A.19). That reduction is shared with Theorem 3.6 of the same paper (inhomogeneous random graphs). The printed proof of Lemma A.5 has a gap: (A.23) bounds the probability that some dispatcher has low degree by N1−a2/2N^{1-a^2/2}N1−a2/2, but the union over M(N)M(N)M(N) dispatchers gives M(N)N−a2/2M(N)N^{-a^2/2}M(N)N−a2/2. This is not summable when M(N)M(N)M(N) grows faster than every polynomial, which the hypotheses allow. A complete formal proof must close this gap or show that low-degree dispatchers contribute too little to matter.

Difficulty

Every statement is almost sure along the whole sequence, but the graphs for different NNN may be coupled arbitrarily, so no strong law over NNN is available. Each a.s. claim needs a failure probability that is summable in NNN, followed by the first Borel–Cantelli lemma. Proportional sparsity quantifies over all 2N2^N2N server sets UUU, and Lemma A.2 over all 2M(N)2^{M(N)}2M(N) dispatcher sets XXX. The obvious argument would concentrate each ∣Nw∩U∣|\mathcal N_w\cap U|∣Nw​∩U∣ separately and take a union bound. It fails because ∣Nw∣|\mathcal N_w|∣Nw​∣ is only of order Nc(N)/M(N)Nc(N)/M(N)Nc(N)/M(N), which may be far smaller than NNN and M(N)M(N)M(N), so per-dispatcher tails cannot absorb an eNe^{N}eN or eM(N)e^{M(N)}eM(N) union. Uniform control over all large sets XXX (Lemma A.2) is therefore the crux. For subcriticality, the difficulty is that the maximum over vvv runs over NNN servers while the minimum degree runs over M(N)M(N)M(N) dispatchers.

Formalization scope

  • Servers are Fin N, dispatchers Fin (M N); a graph is a Finset (Fin N × Fin (M N)), and a random graph is a measurable random adjacency matrix Fin N → Fin (M N) → Bool (the space {0,1}N×M(N)\{0,1\}^{N\times M(N)}{0,1}N×M(N) of p. 13).
  • The law of each random matrix is prescribed pointwise: every matrix with all row sums equal to c(N)c(N)c(N) has probability (M(N)c(N))−N\binom{M(N)}{c(N)}^{-N}(c(N)M(N)​)−N. This is the uniform, independent-over-servers choice. No independence across NNN is assumed. A formalization that assumes independent graphs for different NNN proves a weaker theorem.
  • Hypotheses 1≤c(N)≤M(N)1\le c(N)\le M(N)1≤c(N)≤M(N) for every NNN, d≥2d\ge2d≥2, and the growth conditions as real limits (Tendsto … atTop atTop). ln⁡N\ln NlnN is Real.log, so the ratio is 000 at N=1N=1N=1, which does not affect a limit.
  • Proportional sparsity is the limit condition (3.1) as "for every ε,δ>0\varepsilon,\delta>0ε,δ>0, eventually, for every UUU, at most δM(N)\delta M(N)δM(N) bad dispatchers". The connectivity in Definition 3.1 is not included, because the random graphs are disconnected for small NNN. A dispatcher with ∣Nw∣=0|\mathcal N_w|=0∣Nw​∣=0 gives the ratio 0/0=00/0=00/0=0 in Lean.
  • Subcriticality constrains γwU\gamma^U_wγwU​ only for nonempty UUU and normalises by (∣Nw∣min⁡(d,∣Nw∣))\binom{|\mathcal N_w|}{\min(d,|\mathcal N_w|)}(min(d,∣Nw​∣)∣Nw​∣​). The paper's (∣Nw∣d)\binom{|\mathcal N_w|}{d}(d∣Nw​∣​) is 1/01/01/0 when ∣Nw∣<d|\mathcal N_w|<d∣Nw​∣<d, and the empty UUU admits no distribution. With the literal definition the goal would be false. Both "lim sup⁡≤1\limsup\le1limsup≤1" conditions are written as "for every ε>0\varepsilon>0ε>0, eventually at most 1+ε1+\varepsilon1+ε".
  • Not formalized: the sentence "Consequently, the conclusions of Theorem 3.4 hold", which composes this mission's goal with the mean-field mission of this series.
  • Infrastructure that is welcome and reusable: hypergeometric and binomial Chernoff bounds in a form usable with Finset.powersetCard, and Borel–Cantelli for eventually-uniform statements over families of finite sets.

Selected references

  • D. Rutten and D. Mukherjee, Load Balancing Under Strict Compatibility Constraints, Math. Oper. Res., 2023; arXiv:2008.07562v2. https://arxiv.org/abs/2008.07562
  • A. Budhiraja, D. Mukherjee and R. Wu, Supermarket model on graphs, Ann. Appl. Probab. 29(3):1740–1777, 2019. https://doi.org/10.1214/18-AAP1437
  • M. Bramson, Stability of join the shortest queue networks, Ann. Appl. Probab. 21(4):1568–1625, 2011. https://doi.org/10.1214/10-AAP726
  • S. Janson, T. Łuczak and A. Ruciński, Random Graphs, Wiley, 2000. https://doi.org/10.1002/9781118032718
  • N. D. Vvedenskaya, R. L. Dobrushin and F. I. Karpelevich, Queueing system with selection of the shortest of two queues: an asymptotic approach, Probl. Inf. Transm. 32(1):15–27, 1996.
  • M. Mitzenmacher, The power of two choices in randomized load balancing, IEEE Trans. Parallel Distrib. Syst. 12(10):1094–1104, 2001. https://doi.org/10.1109/71.963420
10 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

Linear Programming and Community Detection 3: The Metric LP Relaxation Recovers the Planted Bisection When d_in − d_out ≥ n/4 Under Regular SandwichingResearch Paper

Motivation

The minimum bisection problem asks, for a graph G=(V,E)G=(V,E)G=(V,E) on an even number nnn of vertices, for a split of VVV into two halves of size n/2n/2n/2 that cuts as few edges as possible. It is NP-hard, and it is also the maximum a posteriori estimator for the two-community stochastic block model, the standard random model of networks with community structure. A tractable surrogate is a convex relaxation. Semidefinite relaxations of minimum bisection are known to recover a planted community structure under near-optimal conditions; Del Pia, Khajavirad and Kunisky (arXiv:2006.03213, Mathematics of Operations Research, 2023) ask the same question for the cheaper and more classical linear programming relaxation, the metric relaxation obtained by outer-approximating the cut polytope by triangle inequalities.

This mission covers the deterministic, sufficient side of their analysis (§3.1 of the paper): explicit conditions on a graph with a planted bisection under which the LP relaxation returns exactly that bisection. These conditions are the input to the paper's probabilistic recovery theorem for the very dense block model (Theorem 6).

Setting

Let V={1,…,n}V=\{1,\dots,n\}V={1,…,n}. A bisection is a partition V1,V2V_1,V_2V1​,V2​ of VVV with ∣V1∣=∣V2∣=n/2|V_1|=|V_2|=n/2∣V1​∣=∣V2​∣=n/2. A fixed but unknown bisection is the planted bisection. Write G1=G[V1]G_1=G[V_1]G1​=G[V1​] and G2=G[V2]G_2=G[V_2]G2​=G[V2​] for the subgraphs induced on the two sides, and G0G_0G0​ for the bipartite graph of the edges with one end on each side. Two degree parameters describe the instance: dind_{\mathrm{in}}din​, a degree inside the communities, and doutd_{\mathrm{out}}dout​, a degree across them. A graph is ddd-regular if every vertex has exactly ddd neighbours.

The cut vector xˉ∈{0,1}(n2)\bar x\in\{0,1\}^{\binom n2}xˉ∈{0,1}(2n​) of the planted bisection has xˉij=0\bar x_{ij}=0xˉij​=0 for i,ji,ji,j on the same side and xˉij=1\bar x_{ij}=1xˉij​=1 otherwise. With aij=1a_{ij}=1aij​=1 if (i,j)∈E(i,j)\in E(i,j)∈E and 000 otherwise, and the convention xji=xijx_{ji}=x_{ij}xji​=xij​, the metric relaxation is

(LP-P)min⁡x∑1≤i<j≤naijxijs.t.xij≤xik+xjkdistinct i,j,k, i<j,(1)xij+xik+xjk≤21≤i<j<k≤n,(2)∑i<jxij=n2/4.(3)\text{(LP-P)}\qquad \min_x \sum_{1\le i<j\le n} a_{ij}x_{ij}\quad\text{s.t.}\quad \begin{aligned} &x_{ij}\le x_{ik}+x_{jk} && \text{distinct } i,j,k,\ i<j, &(1)\\ &x_{ij}+x_{ik}+x_{jk}\le 2 && 1\le i<j<k\le n, &(2)\\ &\textstyle\sum_{i<j}x_{ij}=n^2/4. && &(3) \end{aligned}(LP-P)xmin​1≤i<j≤n∑​aij​xij​s.t.​xij​≤xik​+xjk​xij​+xik​+xjk​≤2∑i<j​xij​=n2/4.​​distinct i,j,k, i<j,1≤i<j<k≤n,​(1)(2)(3)​

The LP recovers the planted bisection if xˉ\bar xxˉ is an optimal solution and the only one.

Formalization targets

Goal: Theorem 4 (p. 12)

Assume G1G_1G1​ and G2G_2G2​ contain dind_{\mathrm{in}}din​-regular subgraphs on the same node sets, and G0G_0G0​ is a subgraph of a doutd_{\mathrm{out}}dout​-regular bipartite graph with the same bipartition. Then

din−dout ≥ n4⟹(LP-P) recovers the planted bisection.d_{\mathrm{in}}-d_{\mathrm{out}}\ \ge\ \frac n4\quad\Longrightarrow\quad \text{(LP-P) recovers the planted bisection.}din​−dout​ ≥ 4n​⟹(LP-P) recovers the planted bisection.

Milestones

  1. Proposition 1 (p. 7). If G1,G2G_1,G_2G1​,G2​ are dind_{\mathrm{in}}din​-regular with din∈{1,…,n/2−1}d_{\mathrm{in}}\in\{1,\dots,n/2-1\}din​∈{1,…,n/2−1}, G0G_0G0​ is doutd_{\mathrm{out}}dout​-regular with dout∈{0,…,n/2}d_{\mathrm{out}}\in\{0,\dots,n/2\}dout​∈{0,…,n/2}, n≥4n\ge4n≥4, and din−dout≥n/4−1d_{\mathrm{in}}-d_{\mathrm{out}}\ge n/4-1din​−dout​≥n/4−1, then xˉ\bar xxˉ is optimal for (LP-P).
  2. Theorem 3 (pp. 9–10), Mangasarian's criterion: for an LP min⁡{c⊤x:Ax=b, Cx≥d}\min\{c^\top x: Ax=b,\ Cx\ge d\}min{c⊤x:Ax=b, Cx≥d} with primal optimum xˉ\bar xxˉ and dual optimum (uˉ,vˉ)(\bar u,\bar v)(uˉ,vˉ), xˉ\bar xxˉ is the unique optimum if and only if Ax=0Ax=0Ax=0, CKx=0C_Kx=0CK​x=0, CLx≥0C_Lx\ge0CL​x≥0 has no nonzero solution, where KKK and LLL are the active constraints with positive and zero multiplier.
  3. Proposition 2 (p. 10). For regular G1,G2,G0G_1,G_2,G_0G1​,G2​,G0​ as above, din−dout≥n/4d_{\mathrm{in}}-d_{\mathrm{out}}\ge n/4din​−dout​≥n/4 implies recovery.
  4. Lemma 2 (p. 11). Recovery survives deleting crossing edges.
  5. Lemma 3 (p. 11). Recovery survives adding edges inside V1V_1V1​ or V2V_2V2​.

Significance

Theorem 4 is a deterministic certificate: any graph that can be sandwiched between a regular within-community graph and a regular across-community graph with a degree gap of n/4n/4n/4 is solved exactly by a polynomial-size LP. For regular instances the threshold is tight: for 8∣n8\mid n8∣n and any din−dout≤n/4−1d_{\mathrm{in}}-d_{\mathrm{out}}\le n/4-1din​−dout​≤n/4−1 in range, the paper's Theorem 2 constructs regular graphs on which even the exact minimum bisection fails to recover the planted bisection. The sandwich form is what makes the result usable for random graphs: the paper's Theorem 6 shows that in the very dense block model with constant edge probabilities p>qp>qp>q and p−q>1/2p-q>1/2p−q>1/2 the sandwich hypotheses hold with high probability, so the LP recovers the communities.

None of these statements has, to our knowledge, a machine-checked proof. A complete development gives a verified dual certificate for the metric polytope, a verified version of Mangasarian's uniqueness criterion for linear programs in the general form Ax=bAx=bAx=b, Cx≥dCx\ge dCx≥d (useful well beyond this paper), and the monotonicity lemmas that transfer LP recovery between graphs.

Difficulty

Optimality of xˉ\bar xxˉ (Proposition 1) needs an explicit dual solution of (LP-P), with one multiplier per triangle inequality, and the bookkeeping that verifies the dual equality constraint for every pair i<ji<ji<j in six cases. Optimality alone is not recovery: the obvious argument, exhibiting a dual solution, says nothing about other optima, and the LP has many fractional feasible points. Uniqueness requires a strictly complementary structure and a separate argument that the linear system attached to the active constraints has only the zero solution; on the page this step uses Dirac's theorem on Hamiltonian cycles inside each community. Finally, the passage from regular to sandwiched graphs is not a perturbation statement: adding or deleting edges changes the objective, and the lemmas rely on the bounds 0≤xij≤10\le x_{ij}\le 10≤xij​≤1, which are implied by the triangle inequalities rather than imposed.

Formalization scope

Vertices are Fin n (0-based), a graph is a SimpleGraph (Fin n), and a bisection is a finset V1 with 2 * V1.card = n; the other side is its complement. A point of R(n2)\mathbb R^{\binom n2}R(2n​) is an array x : Fin n → Fin n → ℝ that is symmetric with zero diagonal, and these two conditions are part of LP feasibility. Recovery is optimality of the cut vector together with equality of every optimal solution to it. Regularity of G1G_1G1​ and G2G_2G2​ with one common degree is "every vertex has exactly dind_{\mathrm{in}}din​ neighbours on its own side"; regularity of G0G_0G0​ is "every vertex has exactly doutd_{\mathrm{out}}dout​ neighbours on the other side". Degree conditions are compared in R\mathbb RR.

Committed readings:

  • Theorem 4 is posed for arbitrary integers din,doutd_{\mathrm{in}},d_{\mathrm{out}}din​,dout​ satisfying the sandwich hypotheses. The page names them the minimum and maximum degrees, but the paper's Theorem 6 applies Theorem 4 with other integers; the literal reading is a special case.
  • The two dind_{\mathrm{in}}din​-regular subgraphs of G1G_1G1​ and G2G_2G2​ are encoded as a single graph with no crossing edges.
  • Proposition 1 carries the standing assumptions of §3.1.1 (n≥4n\ge4n≥4 and the degree ranges). Proposition 2 and Theorem 4 carry no range hypotheses: they are implied by the remaining hypotheses for n≥4n\ge4n≥4, the hypotheses are unsatisfiable at n=2n=2n=2, and the conclusion is trivial at n=0n=0n=0.
  • Lemma 2's strict inclusion E(G~0)⊂E(G0)E(\tilde G_0)\subset E(G_0)E(G~0​)⊂E(G0​) is posed as ⊆\subseteq⊆, since equality is trivial.
  • Theorem 3 renames the cost vector ppp to ccc and the number of variables nnn to NNN.

Two encodings would trivialize the mission and are ruled out: an array xxx without symmetry and zero diagonal (its unconstrained entries make uniqueness false), and an LP with added box constraints 0≤x≤10\le x\le10≤x≤1 (a different polytope). Dirac's theorem, used inside the proof of Proposition 2, is posed separately on the platform (AppliedComb.Graphs.dirac) and is not restated here. Contributions welcome: the dual certificate of Proposition 1, a general-purpose proof of Theorem 3 from LP duality, and the two monotonicity lemmas.

Selected references

  • A. Del Pia, A. Khajavirad, D. Kunisky, Linear Programming and Community Detection, Mathematics of Operations Research, 2023; arXiv:2006.03213v2. https://arxiv.org/abs/2006.03213
  • O. L. Mangasarian, Uniqueness of solution in linear programming, Linear Algebra and its Applications 25 (1979), 151–162. https://doi.org/10.1016/0024-3795(79)90014-4
  • G. A. Dirac, Some theorems on abstract graphs, Proceedings of the London Mathematical Society s3-2 (1952), 69–81. https://doi.org/10.1112/plms/s3-2.1.69
  • M. M. Deza, M. Laurent, Geometry of Cuts and Metrics, Springer, 1997. https://doi.org/10.1007/978-3-642-04295-9
7 thms1 active userReviewed
CombinatoricsOperations Research·Captain: mikedeng1

Linear Programming and Community Detection 2: The Minimum Bisection Recovery Condition d_in − d_out > n/4 − 1 Is TightResearch Paper

Why minimum bisection recovery matters

The minimum bisection problem partitions an even-sized graph into two equally large groups while cutting as few edges as possible. In community detection, a graph may have been generated around an unknown, balanced pair of groups. The statistical question is whether an optimizer can identify that planted partition from the edges. Before studying random graph models or relaxations, it is useful to know which properties of a single observed graph suffice for recovery and whether those properties can be weakened.

Del Pia, Khajavirad and Kunisky express a deterministic sufficient condition through two vertex-degree parameters. Their Theorem 1 says that minimum bisection recovers the planted partition when the smallest within-community degree exceeds the largest cross-community degree by more than n/4−1n/4-1n/4−1. Theorem 2 supplies graphs at or below that boundary where recovery fails. Thus the degree difference has a sharp worst-case boundary within the theorem's stated size and degree ranges. This mission formalizes that second, tightness result.

Graphs, bisections, and degrees

Let G=(V,E)G=(V,E)G=(V,E) be a simple undirected graph with nnn vertices. A bisection is a partition V1,V2V_1,V_2V1​,V2​ of VVV with ∣V1∣=∣V2∣=n/2|V_1|=|V_2|=n/2∣V1​∣=∣V2​∣=n/2. Its cut cost is the number of edges with one endpoint in each side. The planted bisection is a designated partition regarded as the answer the optimizer should recover. Since exchanging V1V_1V1​ and V2V_2V2​ leaves the partition unchanged, uniqueness is always understood up to this exchange.

For each vertex vvv, count its neighbors on its own side of the planted bisection and its neighbors on the opposite side. Write din(v)d_{\mathrm{in}}(v)din​(v) and dout(v)d_{\mathrm{out}}(v)dout​(v) for these counts. The two parameters of the planted graph are

din=min⁡v∈Vdin(v),dout=max⁡v∈Vdout(v).d_{\mathrm{in}}=\min_{v\in V}d_{\mathrm{in}}(v),\qquad d_{\mathrm{out}}=\max_{v\in V}d_{\mathrm{out}}(v).din​=v∈Vmin​din​(v),dout​=v∈Vmax​dout​(v).

Minimum bisection recovers the planted partition if every bisection with cost at most that of the planted one is the planted partition, up to swapping its sides. This formulation requires both optimality and uniqueness. If the planted bisection costs more than a competitor, recovery fails; it also fails when a distinct bisection ties it. These definitions follow §2 of the pinned preprint.

Formalization targets

Existence of regular graph pieces

Lemma 1 supplies two finite-graph existence statements. For positive even ttt, a simple ddd-regular bipartite graph exists on ttt vertices with t/2t/2t/2 vertices per side whenever 0≤d≤t/20\le d\le t/20≤d≤t/2. For the same ttt, a simple ddd-regular graph exists whenever 0≤d≤t−10\le d\le t-10≤d≤t−1. The bipartite part includes the edgeless graph at d=0d=0d=0 and the complete bipartite graph at d=t/2d=t/2d=t/2. The second part includes the edgeless and complete graphs at its own endpoints.

Tightness of the recovery threshold

The mission's goal is Theorem 2. For every positive multiple of eight nnn and every pair of nonnegative integers satisfying

din≤n2−1,dout≤n2,din−dout≤n4−1,d_{\mathrm{in}}\le \frac n2-1,\qquad d_{\mathrm{out}}\le \frac n2,\qquad d_{\mathrm{in}}-d_{\mathrm{out}}\le \frac n4-1,din​≤2n​−1,dout​≤2n​,din​−dout​≤4n​−1,

there exist a graph GGG on nnn vertices and a planted bisection with those exact parameters for which minimum bisection does not recover the planted partition. The inequalities delimit the claimed family; the goal does not assert failure for every graph with those degrees. The word “exact” matters because a construction with merely smaller within-side degrees or larger cross-side degrees would not establish tightness for the requested parameter pair.

What the result establishes

Together with the paper's Theorem 1, the goal locates the worst-case threshold for recovery by minimum bisection: a strictly larger degree difference guarantees recovery, while every admissible parameter pair at or below the boundary occurs in a counterexample. This separates a guarantee about all graphs with given degree extrema from a claim about a particular graph. It also gives a deterministic baseline for comparing the behavior of the paper's linear programming relaxation and stochastic block model, whose recovery guarantees concern different optimization procedures and graph distributions.

The theorem is proved in the cited paper; the task here is to state its graph model, parameter extrema, and recovery conclusion in Lean with the same quantifiers and boundary cases, then obtain a machine-checked proof. The regular-graph existence lemma is independently reusable for other finite graph constructions. The definition layer can also support later exact-recovery statements for the same paper after the series' graph conventions are consolidated.

The obstacle to a direct argument

A strict threshold being sufficient does not itself show that it is necessary. At equality, an inequality used in a recovery guarantee no longer forces a unique optimum, but that leaves open whether a graph with the prescribed degree extrema actually has a competing bisection. Every requested pair (din,dout)(d_{\mathrm{in}},d_{\mathrm{out}})(din​,dout​) must be realized by a genuine simple graph, including the degree endpoints, and the competing partition must be balanced and distinct even after sides are exchanged. The proof therefore needs graph existence and degree bookkeeping as well as a comparison of cut costs. The page states one numbered supporting lemma, Lemma 1; its two clauses are the mission's milestone.

Formalization scope

Vertices are represented by Fin n, indexed from zero rather than the paper's 1,…,n1,\ldots,n1,…,n. A side of a bisection is a Finset; its complement represents the other side. Graphs are Mathlib SimpleGraph values, and cut cost counts each undirected crossing edge once by ordering its endpoints. The within and across degrees are filtered neighbor counts. Their minimum and maximum range over all vertices, matching the paper. An empty vertex type receives a conventional zero degree extremum, while Theorem 2 requires n>0n>0n>0.

The bounds involving n/2−1n/2-1n/2−1 and n/4−1n/4-1n/4−1 are compared in the reals, so natural-number subtraction cannot truncate a negative difference. The hypothesis 8∣n8\mid n8∣n makes n/4n/4n/4 an integer in the theorem's actual domain. Lemma 1 uses positive even ttt, with Mathlib's regular-degree predicate and a bisection set witnessing equal bipartition sizes. Its bound t−1t-1t−1 is safe in natural numbers because t>0t>0t>0.

The formal goal requires a witness graph whose minimum within-side degree equals the requested dind_{\mathrm{in}}din​ and whose maximum across-side degree equals the requested doutd_{\mathrm{out}}dout​. It also requires an actual planted bisection and failure of uniqueness up to complement. Replacing either equality with a loose degree bound, or allowing a non-bisection witness, would make the claim easier and lose the paper's result. Contributions toward finite regular graph constructions, exact degree calculations, and cut-cost comparisons are within scope.

Selected references

  • A. Del Pia, A. Khajavirad and D. Kunisky, Linear Programming and Community Detection, Mathematics of Operations Research, 2023; pinned source: arXiv:2006.03213v2, §2, pp. 3–6, especially Lemma 1 and Theorem 2 on p. 5.
3 thms1 active userReviewed
CombinatoricsOperations Research·Captain: mikedeng1

Linear Programming and Community Detection 1: Minimum Bisection Recovers the Planted Bisection When d_in − d_out > n/4 − 1Research Paper

Motivation

Community detection asks for a partition of the vertices of a graph into groups that are densely connected inside and sparsely connected across. In its simplest form there are two communities of equal size, and the natural combinatorial formulation is the minimum bisection problem: among all ways of splitting the vertex set into two halves, find one that cuts the fewest edges. The problem is NP-hard in general, yet on graphs that genuinely contain two well-separated communities one expects it to return exactly those communities. For the two-community stochastic block model, minimum bisection is the maximum a posteriori estimator, so understanding when it returns the hidden partition is the baseline against which convex relaxations are compared.

Del Pia, Khajavirad and Kunisky (arXiv:2006.03213v2, Mathematics of Operations Research 2023) study this question deterministically, without a random graph model, in terms of two worst-case degree parameters. Their Theorem 1 gives a sufficient condition for the minimum bisection problem to recover the hidden partition, and Theorem 2 shows the condition cannot be weakened. The rest of the paper compares this with the metric linear programming relaxation of minimum bisection. This mission formalizes Theorem 1.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a simple graph on V={1,…,n}V=\{1,\dots,n\}V={1,…,n}. A bisection of VVV is a partition of VVV into two sets of equal cardinality n/2n/2n/2; it exists only for even nnn. Its cost is the number of edges with one end in each set. The minimum bisection problem asks for a bisection of minimum cost.

A fixed bisection V1,V2V_1,V_2V1​,V2​, unknown to the solver, is the planted bisection. Write G[V1]G[V_1]G[V1​] and G[V2]G[V_2]G[V2​] for the subgraphs induced on the two sides and G0=(V,E0)G_0=(V,E_0)G0​=(V,E0​) for the bipartite graph of edges between them. Two parameters measure how well the planted bisection separates the graph:

  • dind_{\mathrm{in}}din​, the minimum degree of the nodes of G[V1]∪G[V2]G[V_1]\cup G[V_2]G[V1​]∪G[V2​]: every vertex has at least dind_{\mathrm{in}}din​ neighbours on its own side;
  • doutd_{\mathrm{out}}dout​, the maximum degree of the nodes of G0G_0G0​: no vertex has more than doutd_{\mathrm{out}}dout​ neighbours on the other side.

An optimization problem recovers the planted bisection if its unique optimal solution corresponds to the planted bisection. For minimum bisection a solution is an unordered partition, so this means: every bisection whose cost is at most that of V1,V2V_1,V_2V1​,V2​ is the partition {V1,V2}\{V_1,V_2\}{V1​,V2​} itself.

Formalization targets

Goal: Theorem 1 (p. 4)

din−dout>n4−1⟹the minimum bisection problem recovers the planted bisection.d_{\mathrm{in}} - d_{\mathrm{out}} > \frac n4 - 1 \quad\Longrightarrow\quad \text{the minimum bisection problem recovers the planted bisection.}din​−dout​>4n​−1⟹the minimum bisection problem recovers the planted bisection.

The hypothesis is the only one; no connectivity, regularity or lower bound on nnn is assumed.

Milestones: the three inequalities of the proof (p. 5)

Fix a second bisection V~1,V~2\tilde V_1,\tilde V_2V~1​,V~2​ and set U1=V1∩V~1U_1=V_1\cap\tilde V_1U1​=V1​∩V~1​, t=∣U1∣t=|U_1|t=∣U1​∣, U2=V2∩V~2U_2=V_2\cap\tilde V_2U2​=V2​∩V~2​, W1=V1∩V~2W_1=V_1\cap\tilde V_2W1​=V1​∩V~2​, W2=V2∩V~1W_2=V_2\cap\tilde V_1W2​=V2​∩V~1​. Let RRR be the edges between U1U_1U1​ and W2W_2W2​ or between W1W_1W1​ and U2U_2U2​, SSS the edges between U1U_1U1​ and W1W_1W1​ or between U2U_2U2​ and W2W_2W2​. The paper's proof combines

∣S∣≤∣R∣  when V~1,V~2 is optimal,∣R∣≤2t dout,∣S∣≥2t (din−t+1).|S|\le|R| \ \text{ when } \tilde V_1,\tilde V_2 \text{ is optimal},\qquad |R|\le 2t\,d_{\mathrm{out}},\qquad |S|\ge 2t\,(d_{\mathrm{in}}-t+1).∣S∣≤∣R∣  when V~1​,V~2​ is optimal,∣R∣≤2tdout​,∣S∣≥2t(din​−t+1).

The last two hold for every pair of bisections.

Significance

Theorem 1 is a purely combinatorial certificate of exact recovery: it applies to any graph, random or not, and its two parameters are computable in linear time. Together with Theorem 2 of the same paper, which shows that for every nnn divisible by eight and every admissible din,doutd_{\mathrm{in}}, d_{\mathrm{out}}din​,dout​ with din−dout≤n/4−1d_{\mathrm{in}}-d_{\mathrm{out}}\le n/4-1din​−dout​≤n/4−1 some graph is not recovered, it determines exactly which degree pairs guarantee recovery. The paper then shows that the metric LP relaxation recovers under the nearly identical condition din−dout≥n/4d_{\mathrm{in}}-d_{\mathrm{out}}\ge n/4din​−dout​≥n/4 with an additional regularity assumption, so the LP loses almost nothing against the NP-hard problem in this deterministic regime.

The theorem and its proof are published, and the proof is elementary. To our knowledge no machine-checked version exists. Formalizing it fixes a reusable Lean vocabulary for planted bisections (bisections as Finsets, intra- and inter-community degrees, cut cost, recovery up to swapping the sides). The later missions of this series, on the LP relaxation and on the stochastic block model, use the same vocabulary.

Difficulty

The argument is short, and the work lies in the bookkeeping. The obvious contrapositive step, "an optimal bisection different from the planted one cuts at most as many edges", only compares two totals. The proof has to split those totals into the six edge classes between the four sets U1,U2,W1,W2U_1,U_2,W_1,W_2U1​,U2​,W1​,W2​, and it relies on the identity ∣U2∣=∣U1∣|U_2|=|U_1|∣U2​∣=∣U1​∣, valid for any two bisections. The lower bound on ∣S∣|S|∣S∣ needs a double-counting step: the degrees inside G[V1]G[V_1]G[V1​] of the vertices of U1U_1U1​ sum to at least t dint\,d_{\mathrm{in}}tdin​, and edges inside U1U_1U1​ account for at most t(t−1)t(t-1)t(t−1) of that sum. In Lean the edge classes are filters over ordered pairs i<ji<ji<j, so each identity between them is a statement about disjoint unions of finite sets. The quantity din−t+1d_{\mathrm{in}}-t+1din​−t+1 can be negative, so the integer arithmetic must not truncate.

Formalization scope

  • Vertices are Fin n (0-based, the paper's {1,…,n}\{1,\dots,n\}{1,…,n}), graphs are SimpleGraph (Fin n), and a bisection is a Finset V1 with 2 * V1.card = n, the other side being V1ᶜ. The second bisection V~1\tilde V_1V~1​ of the proof is a Finset W, with V~2\tilde V_2V~2​ = Wᶜ.
  • Degrees. dIn is the minimum over all vertices of the number of same-side neighbours (defined as 000 when n=0n=0n=0), and dOut is the maximum over all vertices of the number of other-side neighbours. They are the paper's parameters, not free integers.
  • Recovery is ∀ S, IsBisection n S → cutCost G S ≤ cutCost G V1 → S = V1 ∨ S = V1ᶜ. Requiring S = V1 alone would make the theorem false, since V2V_2V2​ has the same cost.
  • Arithmetic. The hypothesis of Theorem 1 is compared in R\mathbb RR (n/4n/4n/4 is real division, and din−doutd_{\mathrm{in}}-d_{\mathrm{out}}din​−dout​ is not truncated), and the lower bound on ∣S∣|S|∣S∣ is stated in Z\mathbb ZZ. A natural-number encoding would change both statements, and the formalization rules it out.
  • Edge classes. ∣R∣|R|∣R∣, ∣S∣|S|∣S∣, ∣T∣|T|∣T∣ are sums of counts of edges between pairs of the disjoint sets U1,U2,W1,W2U_1,U_2,W_1,W_2U1​,U2​,W1​,W2​. Since these classes are pairwise disjoint, the sums equal the cardinalities of the unions.
  • Milestone 1 assumes, as the page does, that V~1,V~2\tilde V_1,\tilde V_2V~1​,V~2​ is an optimal bisection. The paper's normalizations ∣U1∣≤n/4|U_1|\le n/4∣U1​∣≤n/4 and U1≠∅U_1\ne\emptysetU1​=∅ are not needed for any milestone and are not assumed.

The definitions are finite and decidable in principle and need nothing beyond Mathlib's SimpleGraph and Finset. Contributions of proofs of the three milestones and of the goal are welcome. Lemmas expressing the cut cost of V1V_1V1​ as ∣R∣+∣T∣|R|+|T|∣R∣+∣T∣ and that of V~1\tilde V_1V~1​ as ∣S∣+∣T∣|S|+|T|∣S∣+∣T∣ are useful intermediate results.

Selected references

  • A. Del Pia, A. Khajavirad, D. Kunisky, Linear Programming and Community Detection, Mathematics of Operations Research, 2023; arXiv:2006.03213v2 (2022). https://arxiv.org/abs/2006.03213
  • E. Abbe, A. S. Bandeira, G. Hall, Exact recovery in the stochastic block model, IEEE Transactions on Information Theory 62(1), 2016. https://doi.org/10.1109/TIT.2015.2490670
  • M. R. Garey, D. S. Johnson, L. Stockmeyer, Some simplified NP-complete graph problems, Theoretical Computer Science 1(3), 1976. https://doi.org/10.1016/0304-3975(76)90059-1
5 thms1 active userReviewed
CombinatoricsLinear OptimizationOperations Research·Captain: mikedeng1

Dynamic Matching: Characterizing and Achieving Constant Regret II: In (SPP)-Acyclic Networks the Static Planning Solution Is Given by Surplus Vectors in {−1, 0, 1}ⁿResearch Paper

Motivation

Centralized markets such as kidney exchanges, ride-sharing platforms and online labor markets match agents who arrive over time. Kerimov, Ashlagi and Gurvich (SSRN 3824407; Management Science, 2023, doi:10.1287/mnsc.2021.01215) study such a market with nnn agent types and ddd feasible multi-way matches. Their main result is that, when a fluid linear program called the static-planning problem (SPP) has a unique non-degenerate solution, a periodic resolving policy keeps the regret against the hindsight optimum bounded by a constant of order 1/ϵ1/\epsilon1/ϵ at all times, where the general position gap ϵ\epsilonϵ is the smallest positive basic variable of (SPP).

The constant 1/ϵ1/\epsilon1/ϵ is only informative if one can say what ϵ\epsilonϵ is. Section 5 of the paper does this for a class of networks it calls (SPP)-acyclic: there the optimal solution of (SPP) is an explicit signed sum of arrival rates, so ϵ\epsilonϵ is an imbalance between sums of arrival probabilities. This mission formalizes that structural result and the lemmas it rests on. It needs no probability: only the combinatorics of the network and linear programming.

Setting

A matching network has agent types A={1,…,n}\mathcal A = \{1,\dots,n\}A={1,…,n} and matches M={1,…,d}\mathcal M = \{1,\dots,d\}M={1,…,d}. Match mmm uses one agent of each type in a set A(m)\mathcal A(m)A(m) with ∣A(m)∣≥2|\mathcal A(m)| \ge 2∣A(m)∣≥2, every type belongs to some match, and the matching matrix M∈{0,1}n×dM \in \{0,1\}^{n\times d}M∈{0,1}n×d has Mim=1M_{im} = 1Mim​=1 iff i∈A(m)i \in \mathcal A(m)i∈A(m). Arrival probabilities λ\lambdaλ satisfy λi>0\lambda_i > 0λi​>0, ∑iλi=1\sum_i \lambda_i = 1∑i​λi​=1, and match values satisfy rm>0r_m > 0rm​>0.

The matching network graph G\mathcal GG is the bipartite graph whose vertices are the types and the matches, with an edge between type iii and match mmm iff i∈A(m)i \in \mathcal A(m)i∈A(m).

For a right-hand side b∈Rnb \in \mathbb R^nb∈Rn, the static-planning problem is

max⁡ r⋅zs.t.Mz+s=b,z∈R≥0d, s∈R≥0n,\max\ r\cdot z\quad\text{s.t.}\quad Mz + s = b,\quad z \in \mathbb R^d_{\ge 0},\ s \in \mathbb R^n_{\ge 0},max r⋅zs.t.Mz+s=b,z∈R≥0d​, s∈R≥0n​,

and (SPP) is the case b=λb = \lambdab=λ. For a solution (z∗,s∗)(z^*, s^*)(z∗,s∗) write M+={m:zm∗>0}\mathcal M_+ = \{m : z^*_m > 0\}M+​={m:zm∗​>0} (active matches), M0=M∖M+\mathcal M_0 = \mathcal M \setminus \mathcal M_+M0​=M∖M+​ (redundant matches), Q+={j:sj∗>0}\mathcal Q_+ = \{j : s^*_j > 0\}Q+​={j:sj∗​>0} and Q0=A∖Q+\mathcal Q_0 = \mathcal A \setminus \mathcal Q_+Q0​=A∖Q+​.

The network satisfies the general position condition (GP) if (SPP) has a unique optimal solution (z∗,s∗)(z^*, s^*)(z∗,s∗) and it is non-degenerate: ∣M+∣+∣Q+∣=n|\mathcal M_+| + |\mathcal Q_+| = n∣M+​∣+∣Q+​∣=n. The optimal basis matrix B\mathcal BB is formed by the columns of MMM indexed by M+\mathcal M_+M+​ and the unit vectors eje_jej​, j∈Q+j \in \mathcal Q_+j∈Q+​.

The (SPP)-residual graph is G\mathcal GG with the redundant matches removed, and the network is (SPP)-acyclic if it satisfies GP and its (SPP)-residual graph has no cycle.

Formalization targets

Goal: Theorem 5.1 (p. 25)

Assume GP and (SPP)-acyclicity. Then there are vectors yl∈{−1,0,1}ny^l \in \{-1,0,1\}^nyl∈{−1,0,1}n, l∈M+∪Q+l \in \mathcal M_+ \cup \mathcal Q_+l∈M+​∪Q+​, with

zm∗=ymλ>0 (m∈M+),sj∗=yjλ>0 (j∈Q+),z^*_m = y^m\lambda > 0\ (m \in \mathcal M_+),\qquad s^*_j = y^j\lambda > 0\ (j \in \mathcal Q_+),zm∗​=ymλ>0 (m∈M+​),sj∗​=yjλ>0 (j∈Q+​),

and every right-hand side λ~>0\tilde\lambda > 0λ~>0 with ylλ~>0y^l\tilde\lambda > 0ylλ~>0 for all lll has, as its unique optimal solution, zm=ymλ~z_m = y^m\tilde\lambdazm​=ymλ~ on M+\mathcal M_+M+​, sj=yjλ~s_j = y^j\tilde\lambdasj​=yjλ~ on Q+\mathcal Q_+Q+​, and zero elsewhere.

Milestones

  1. (4), p. 20. Under GP, B\mathcal BB is invertible and (zM+∗,sQ+∗)=B−1λ>0(z^*_{\mathcal M_+}, s^*_{\mathcal Q_+}) = \mathcal B^{-1}\lambda > 0(zM+​∗​,sQ+​∗​)=B−1λ>0.
  2. §4.2, p. 20. Under GP the same basis remains optimal for every λ~>0\tilde\lambda > 0λ~>0 with ∥λ~−λ∥∞≤ζ0\|\tilde\lambda - \lambda\|_\infty \le \zeta_0∥λ~−λ∥∞​≤ζ0​, for some ζ0>0\zeta_0 > 0ζ0​>0.
  3. Lemma C.1, p. 44. A connected acyclic matching network graph has at least n−d+1n - d + 1n−d+1 leaves; under GP with M0=∅\mathcal M_0 = \emptysetM0​=∅ and a connected acyclic residual graph, ∣Q+∣=n−d|\mathcal Q_+| = n - d∣Q+​∣=n−d and some over-demanded queue takes part in exactly one match.

A further theorem item, Lemma 5.1 (p. 24), states that under GP a network with only two-way matches, in which every cycle contains an even number of matches, is (SPP)-acyclic.

Significance

Theorem 5.1 turns the regret constant of the paper's main theorem into a quantity one can read off the data: every positive basic variable, and therefore ϵ\epsilonϵ, is ∑iyiλi\sum_i y_i\lambda_i∑i​yi​λi​ with coefficients in {−1,0,1}\{-1,0,1\}{−1,0,1}. Its second sentence describes the whole region of right-hand sides on which the same basis stays optimal, an open polyhedral cone cut out by the inequalities ylλ~>0y^l\tilde\lambda > 0ylλ~>0, which is how the paper relates GP to the arrival rates in §5.1.

On the formal side, the mission builds a reusable model of the matching network, its bipartite incidence graph and the static-planning linear program with a variable right-hand side. Prove2Me does not yet contain the structural theory of optimal bases of such programs. Theorem 5.1 and its milestones are proved in the paper (Appendix C and §4.2); none of them is machine-checked yet.

Difficulty

The representation z∗=B−1λz^* = \mathcal B^{-1}\lambdaz∗=B−1λ holds for every network in general position, so the content of the theorem lies in two places.

  • The entries of B−1\mathcal B^{-1}B−1. Inverses of 0/10/10/1 matrices have arbitrary rational entries in general: the triangle network (three types, matches {1,2},{2,3},{1,3}\{1,2\},\{2,3\},\{1,3\}{1,2},{2,3},{1,3}) has an optimal basis whose inverse has entries ±12\pm\tfrac12±21​. The claim needs the acyclic structure of the residual graph in an essential way.
  • The second sentence. Exhibiting numbers yly^lyl with ylλ=zl∗y^l\lambda = z^*_lylλ=zl∗​ is trivial and says nothing. The statement requires the same vectors to produce the unique optimal solution for a whole open set of right-hand sides, which forces them to be the rows of B−1\mathcal B^{-1}B−1. This step therefore also involves the optimality conditions of (SPP) and the uniqueness part of GP.

Formalization scope

Types are Fin n, matches Fin d, both 0-based. The topology is the structure MatchingNetwork with the fields ∣A(m)∣≥2|\mathcal A(m)| \ge 2∣A(m)∣≥2 and "every type is in a match"; λ\lambdaλ and rrr are separate vectors with the standing predicates λi>0\lambda_i > 0λi​>0, ∑iλi=1\sum_i\lambda_i = 1∑i​λi​=1 and rm>0r_m > 0rm​>0, which are hypotheses of every theorem. The optimal solution (z∗,s∗)(z^*, s^*)(z∗,s∗) is an argument together with the GP hypothesis, never a default or a choice. The graph is a SimpleGraph on Fin n ⊕ Fin d; the residual graph keeps redundant matches as isolated vertices, which affects neither acyclicity nor the degrees of type vertices. The column index type of B\mathcal BB is M+⊔Q+\mathcal M_+ \sqcup \mathcal Q_+M+​⊔Q+​, and the inverse is a two-sided inverse over these index types, not Matrix.inv, which is 000 on singular matrices.

Conventions the statements commit to:

  • in Theorem 5.1, "induces the optimal solution" is read as the unique optimal solution, and λ~\tilde\lambdaλ~ is any positive vector, not necessarily summing to one;
  • "for all sufficiently small ζ0\zeta_0ζ0​" in milestone 2 is the existence of one ζ0>0\zeta_0 > 0ζ0​>0;
  • Lemma C.1's count of n−d+1n - d + 1n−d+1 leaves is stated without natural-number subtraction;
  • Lemma C.1's second half carries the standing reduction of Appendix C (M0=∅\mathcal M_0 = \emptysetM0​=∅, one connected component) as hypotheses;
  • "every cycle contains an even number of matches" in Lemma 5.1 is stated as "every cycle of the bipartite graph has length divisible by 4".

The paper's own text says "all entries of YYY are either −1-1−1, 000, or −1-1−1" (p. 25); this is read as −1-1−1, 000 or 111, as in the theorem's statement.

A formalization that keeps only the first sentence of Theorem 5.1, or that lets the vectors yly^lyl be unrelated to the basis, is trivially satisfiable and is not the theorem.

Needed infrastructure: optimality conditions for linear programs in equality form (reduced costs, uniqueness of a non-degenerate optimum), Mathlib's acyclic graphs and trees (SimpleGraph.IsAcyclic, IsTree.card_edgeFinset), and degree counting on bipartite graphs. The paper proves Theorem 5.1 in Appendix C by an explicit construction along paths of the residual graph; any correct argument is welcome. Lemmas on the inverse of a basis matrix whose bipartite row–column graph is a forest would be reusable well beyond this mission.

Selected references

  • S. Kerimov, I. Ashlagi, I. Gurvich, Dynamic Matching: Characterizing and Achieving Constant Regret, SSRN 3824407 (version of September 14, 2022); Management Science (2023). https://ssrn.com/abstract=3824407, https://doi.org/10.1287/mnsc.2021.01215
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997, §5.1 (sensitivity analysis of an optimal basis).
10 thms1 active userReviewed
Information TheoryProbabilityStatistics·Captain: mikedeng1

Partial Recovery in the Graph Alignment Problem I: If D(P‖Q)/α = o(log n/n), No Algorithm Recovers a Fraction α of a Correlated Erdős–Rényi AlignmentResearch Paper

Motivation

Graph alignment asks for the correspondence between the vertices of two graphs that are noisy copies of each other with hidden labels. It arises in the de-anonymization of social networks, where an anonymized friendship graph is matched against a public one (Narayanan–Shmatikov 2009), and in computational biology, where protein–protein interaction networks of related species are aligned. The standard random model is the correlated Erdős–Rényi model of Pedarsani–Grossglauser 2011, for which exact recovery thresholds are known (Cullina–Kiyavash 2016) and almost-exact recovery is known to be impossible when nqs=O(1)nqs=O(1)nqs=O(1) (Cullina–Kiyavash–Mittal–Poor 2018).

Hall and Massoulié (arXiv:2007.00533) study the weaker goal of partial recovery: output a permutation that agrees with the hidden one on a constant fraction α\alphaα of the vertices. This mission formalizes their impossibility theorem; a companion mission (II) formalizes their possibility theorem.

Setting

Fix nnn and scalars 0≤q<s≤10\le q<s\le10≤q<s≤1. A parent graph G∼G(n,q/s)G\sim G(n,q/s)G∼G(n,q/s) is copied twice and each copy keeps every edge independently with probability sss, giving graphs GAG_AGA​ and GB′G_{B'}GB′​ with adjacency matrices AAA and B′B'B′. Every unordered pair {i,j}\{i,j\}{i,j} of distinct vertices independently carries the pair (Aij,Bij′)∈{0,1}2(A_{ij},B'_{ij})\in\{0,1\}^2(Aij​,Bij′​)∈{0,1}2 with law PPP (equation (3)):

p00=1−2q+qs,p01=p10=q(1−s),p11=qs.p_{00}=1-2q+qs,\qquad p_{01}=p_{10}=q(1-s),\qquad p_{11}=qs .p00​=1−2q+qs,p01​=p10​=q(1−s),p11​=qs.

Two independent edges of G(n,q)G(n,q)G(n,q) have law QQQ (equation (4)):

q00=1−2q+q2,q01=q10=q(1−q),q11=q2.q_{00}=1-2q+q^2,\qquad q_{01}=q_{10}=q(1-q),\qquad q_{11}=q^2 .q00​=1−2q+q2,q01​=q10​=q(1−q),q11​=q2.

The Kullback–Leibler divergence is D(P∥Q)=∑x∈{0,1}2P(x)log⁡P(x)Q(x)D(P\|Q)=\sum_{x\in\{0,1\}^2}P(x)\log\frac{P(x)}{Q(x)}D(P∥Q)=∑x∈{0,1}2​P(x)logQ(x)P(x)​.

A hidden permutation π∗\pi^*π∗ of the vertices, drawn uniformly from the n!n!n! permutations, relabels GB′G_{B'}GB′​ into GBG_BGB​: Bπ∗(i)π∗(j)=Bij′B_{\pi^*(i)\pi^*(j)}=B'_{ij}Bπ∗(i)π∗(j)​=Bij′​. An algorithm sees only (A,B)(A,B)(A,B) and returns a permutation π^\hat\piπ^, possibly at random. Its quality is the overlap

β(π^,π∗)=1n∑i=1n1π^(i)=π∗(i).\beta(\hat\pi,\pi^*)=\frac1n\sum_{i=1}^n\mathbf 1_{\hat\pi(i)=\pi^*(i)} .β(π^,π∗)=n1​i=1∑n​1π^(i)=π∗(i)​.

The mutual information I(π∗;(A,B))I(\pi^*;(A,B))I(π∗;(A,B)) is that of the joint law of π∗\pi^*π∗ and the observation, and Mα=max⁡π∗∣{π∣β(π,π∗)≥α}∣M_\alpha=\max_{\pi^*}|\{\pi\mid\beta(\pi,\pi^*)\ge\alpha\}|Mα​=maxπ∗​∣{π∣β(π,π∗)≥α}∣ counts the permutations that are α\alphaα-close to a given one, out of M=n!M=n!M=n!.

Formalization targets

Goal: Theorem 2.1 (p. 8)

Let αn∈(0,1)\alpha_n\in(0,1)αn​∈(0,1), bounded below by a constant c>0c>0c>0 for large nnn. If

D(P∥Q)αn=o(log⁡nn),\frac{D(P\|Q)}{\alpha_n}=o\Big(\frac{\log n}{n}\Big),αn​D(P∥Q)​=o(nlogn​),

then for every sequence of algorithms,

P[β(π^,π∗)<αn]→1(n→∞).\mathbb P\big[\beta(\hat\pi,\pi^*)<\alpha_n\big]\to1\qquad(n\to\infty).P[β(π^,π∗)<αn​]→1(n→∞).

Milestones

  1. Theorem 3.1 (generalized Fano inequality): P[d(Z^,Z)>d]≥1−I(Z;X^)+1log⁡(M/Md)\mathbb P[d(\hat Z,Z)>d]\ge1-\frac{I(Z;\hat X)+1}{\log(M/M_d)}P[d(Z^,Z)>d]≥1−log(M/Md​)I(Z;X^)+1​ for any Markov chain Z→X^→Z^Z\to\hat X\to\hat ZZ→X^→Z^ with ZZZ uniform.
  2. Corollary 3.2: P(β(π^,π∗)<α)≥1−I(π∗;(A,B))+1log⁡(M/Mα)\mathbb P(\beta(\hat\pi,\pi^*)<\alpha)\ge1-\frac{I(\pi^*;(A,B))+1}{\log(M/M_\alpha)}P(β(π^,π∗)<α)≥1−log(M/Mα​)I(π∗;(A,B))+1​.
  3. Proposition 3.3: M/Mα=Ω(⌈nα⌉!)M/M_\alpha=\Omega(\lceil n\alpha\rceil!)M/Mα​=Ω(⌈nα⌉!).
  4. Inequality (8): I(π∗;(A,B))≤Eπ∗[D(P((A,B)=⋅∣π∗) ∥ Q)]I(\pi^*;(A,B))\le\mathbb E_{\pi^*}\big[D(\mathbb P((A,B)=\cdot\mid\pi^*)\,\|\,\mathcal Q)\big]I(π∗;(A,B))≤Eπ∗​[D(P((A,B)=⋅∣π∗)∥Q)], with Q\mathcal QQ the law of two independent G(n,q)G(n,q)G(n,q) graphs.
  5. The display after (8), p. 13: I(π∗;(A,B))≤(n2)D(P∥Q)I(\pi^*;(A,B))\le\binom n2D(P\|Q)I(π∗;(A,B))≤(2n​)D(P∥Q).

Significance

The theorem gives a sufficient condition, in terms of a single per-pair divergence, under which no algorithm (efficient or not) recovers even a fraction α\alphaα of the alignment. Together with the companion possibility result (Theorem 2.3: partial recovery is possible when nqsnqsnqs exceeds an explicit constant under sparsity conditions), it brackets the partial-recovery threshold; the paper's Corollary 2.2 specializes it to nqs=o(1)nqs=o(1)nqs=o(1) in the regime n−k≤q=o(n−1/2)n^{-k}\le q=o(n^{-1/2})n−k≤q=o(n−1/2).

On the formal side, the mission produces a finite, self-contained model of correlated random graphs with a planted permutation, a generalized Fano inequality for finite hypothesis classes with an arbitrary distance, and the bound of mutual information by a product divergence. The Fano inequality and the mutual-information bounds are reusable for other information-theoretic lower bounds (community detection, planted matching, testing). The paper proves the results on paper; none of them is formalized, and no Fano inequality is proved on the platform.

Difficulty

The Fano inequality (Theorem 3.1) is cited from Lemma 20 of Banerjee–Hegde–Massoulié (2012) and not proved in the paper, and the entropy calculus it rests on is not in Mathlib in a finite, real-valued form. The counting step (Proposition 3.3) concerns rencontres numbers; the paper uses the asymptotic Dn,k∼e−1n!/k!D_{n,k}\sim e^{-1}n!/k!Dn,k​∼e−1n!/k!, which is valid only for fixed kkk, while the statement needs control uniform in kkk. Bounding I(π∗;(A,B))I(\pi^*;(A,B))I(π∗;(A,B)) requires relating the conditional law of the observation, a relabelled product law, to the unlabelled reference law Q\mathcal QQ on a space of 4n24^{n^2}4n2 matrix pairs, most of which have probability zero.

A natural first idea for the goal, taking α\alphaα arbitrary as printed, fails: if αn=1/n\alpha_n=1/nαn​=1/n, the identity algorithm succeeds whenever π∗\pi^*π∗ has a fixed point, with probability tending to 1−e−11-e^{-1}1−e−1, even when the divergence condition holds. The argument needs log⁡(M/Mα)\log(M/M_\alpha)log(M/Mα​) to grow like nαnlog⁡nn\alpha_n\log nnαn​logn, which needs αn\alpha_nαn​ bounded below.

Formalization scope

Vertices are Fin n; a vertex pair is an off-diagonal element of Sym2 (Fin n); an edge state is a Bool × Bool with first coordinate AAA, second B′B'B′. The probability of a configuration is the product of PPP over pairs, and BBB is computed through π∗−1\pi^{*-1}π∗−1. Every probability is a finite sum; logarithms are natural. Standing assumptions on the parameters are 0≤q<s≤10\le q<s\le10≤q<s≤1 (pp. 5 and 7); the remark "we assume s<1s<1s<1" of p. 6 is not used and not imposed.

Algorithms are real stochastic kernels from the observed pair (A,B)(A,B)(A,B) to permutations, so randomized algorithms are included and deterministic ones are the 0/1 kernels. The algorithm's argument is the observation only: it does not see π∗\pi^*π∗ or GB′G_{B'}GB′​. Mutual information and Kullback–Leibler divergence are defined as finite sums (Lean's 0⋅log⁡0=00\cdot\log 0=00⋅log0=0).

Hypotheses added relative to the page, each disclosed in the item's note:

  • Theorem 2.1: αn≥c>0\alpha_n\ge c>0αn​≥c>0 for large nnn (the printed statement is false for αn→0\alpha_n\to0αn​→0 fast).
  • Theorem 3.1 and Corollary 3.2: Md<MM_d<MMd​<M (resp. Mα<n!M_\alpha<n!Mα​<n!), without which log⁡(M/Md)=0\log(M/M_d)=0log(M/Md​)=0 and the bound is meaningless.
  • Theorem 3.1: the observation space is finite; no metric axioms on ddd are assumed.

Proposition 3.3 reads (nα)!(n\alpha)!(nα)! as ⌈nα⌉!\lceil n\alpha\rceil!⌈nα⌉!.

Trivializing formalizations are ruled out: the algorithm cannot be given π∗\pi^*π∗ (an oracle wins) or nothing (the statement becomes empty); the little-ooo hypothesis is a limit of a ratio, not an inequality; the configuration law is built from (3) and sums to 1, not chosen by the solver.

Infrastructure a complete development needs: finite entropy and mutual information with the chain rule and data processing; Gibbs' inequality; derangement and rencontres counts (numDerangements in Mathlib); Stirling-type lower bounds on log⁡k!\log k!logk!. Contributions are welcome on each milestone independently; the Fano inequality is the piece with the widest reuse.

The source is the arXiv preprint v5 (13 Jan 2022); its numbering is used throughout.

Selected references

  • G. Hall, L. Massoulié, Partial Recovery in the Graph Alignment Problem, arXiv:2007.00533v5, 2022; Operations Research, 2023. https://arxiv.org/abs/2007.00533
  • P. Pedarsani, M. Grossglauser, On the privacy of anonymized networks, KDD 2011. https://doi.org/10.1145/2020408.2020596
  • D. Cullina, N. Kiyavash, Improved achievability and converse bounds for Erdős–Rényi graph matching, SIGMETRICS 2016. https://arxiv.org/abs/1602.01042
  • D. Cullina, N. Kiyavash, P. Mittal, H. V. Poor, Partial recovery of Erdős–Rényi graph alignment via k-core alignment, arXiv:1809.03553, 2018. https://arxiv.org/abs/1809.03553
  • S. Banerjee, N. Hegde, L. Massoulié, The price of privacy in untrusted recommendation engines, Allerton 2012, pp. 920–927 (Lemma 20: the generalized Fano inequality); cited as [3] in the paper.
  • A. Narayanan, V. Shmatikov, De-anonymizing social networks, IEEE S&P 2009. https://doi.org/10.1109/SP.2009.22
  • T. M. Cover, J. A. Thomas, Elements of Information Theory, 2nd ed., Wiley, 2006. https://doi.org/10.1002/047174882X
8 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Lightning Network Economics: Topology II: A Lightning Network with Average Degree Above 2g₊⁻¹(2·disc) Contains a Hermetizable SetResearch Paper

Why hubs appear in payment-channel networks

The Lightning Network (LN) is a layer-two payment system for Bitcoin. Two parties open a payment channel by locking funds on the blockchain and can then pay each other off-chain; payments between parties without a common channel are routed along paths of channels. Locking funds is costly, and the amount a channel needs grows with the net flow it has to carry. Guasoni, Huberman and Shikhelman (SSRN 4439190, version of February 3, 2023; published in Management Science, 2024) ask which network topologies support a given pattern of payments at least cost, using only qualitative properties of the channel cost derived in their earlier work on channel sizing (Guasoni, Huberman and Shikhelman, Lightning Network Economics: Channels, 2022, cited in the paper as [GHS22]).

One of the paper's central findings is that adding a new hub node, and routing the traffic of a group of nodes through it, reduces cost in a broad class of networks. This explains, from cost considerations alone, why hub-and-spoke structures emerge in deployed payment-channel networks. This mission formalizes the deterministic sufficient condition for that phenomenon (Theorem 3.8) and the chain of lemmas in Appendix B.1 that proves it.

Setting

Fix a finite set VVV of nodes. A Lightning Network is an anti-symmetric real matrix Λ=(λi,j)i,j∈V\Lambda=(\lambda_{i,j})_{i,j\in V}Λ=(λi,j​)i,j∈V​: λu,v\lambda_{u,v}λu,v​ is the net flow from uuu to vvv in the channel between them, λu,v=−λv,u\lambda_{u,v}=-\lambda_{v,u}λu,v​=−λv,u​, and λu,v=0\lambda_{u,v}=0λu,v​=0 means there is no channel.

A channel cost is a function c:R→R+c:\mathbb R\to\mathbb R_+c:R→R+​ that is strictly increasing on [0,∞)[0,\infty)[0,∞) (MO), even (SY), zero at zero (CI), and strictly subadditive, c(x+y)<c(x)+c(y)c(x+y)<c(x)+c(y)c(x+y)<c(x)+c(y) for x,y>0x,y>0x,y>0 (SA). It satisfies (SA+) with a nonnegative, strictly increasing g+g_+g+​ on [0,∞)[0,\infty)[0,∞) if c(kx)<kg+(k) c(x)c(kx)<\tfrac{k}{g_+(k)}\,c(x)c(kx)<g+​(k)k​c(x) for all k>1k>1k>1, x>0x>0x>0: when the flow of a channel grows kkk-fold, its cost grows by at most k/g+(k)k/g_+(k)k/g+​(k). The cost of the network is c(G)=12∑i,jc(λi,j)c(G)=\tfrac12\sum_{i,j}c(\lambda_{i,j})c(G)=21​∑i,j​c(λi,j​).

For a node vvv and a set UUU of nodes, dU(v)d_U(v)dU​(v) is the number of channels of vvv into UUU, sU(v)s_U(v)sU​(v) the smallest and SU(v)S_U(v)SU​(v) the largest absolute flow of these channels, δ(U)=min⁡v∈UdU(v)\delta(U)=\min_{v\in U}d_U(v)δ(U)=minv∈U​dU​(v) the minimum degree, and disc(U)=max⁡vc(SU(v))/c(sU(v))\mathrm{disc}(U)=\max_v c(S_U(v))/c(s_U(v))disc(U)=maxv​c(SU​(v))/c(sU​(v)) the discrepancy, the maximum over nodes of UUU with a channel in UUU. For U=VU=VU=V these are d(v)d(v)d(v), s(v)s(v)s(v), S(v)S(v)S(v), δ(G)\delta(G)δ(G), disc(G)\mathrm{disc}(G)disc(G), and dˉ(G)=∑vd(v)/∣V∣\bar d(G)=\sum_v d(v)/|V|dˉ(G)=∑v​d(v)/∣V∣ is the average degree.

The hermetization of UUU deletes all channels among nodes of UUU, adds a new node v0v_0v0​, and joins each i∈Ui\in Ui∈U to v0v_0v0​ by a channel carrying ∑j∈Uλi,j\sum_{j\in U}\lambda_{i,j}∑j∈U​λi,j​, its net flow towards UUU; every node keeps its net flow. UUU is hermetizable if hermetization strictly reduces the cost, and the network is hermetizable if some UUU is.

Formalization targets

Goal: Theorem 3.8 (existence part)

Under (MO)–(SA+), every network with at least one channel and

dˉ(G)  >  2 g+−1(2 disc(G))\bar d(G)\;>\;2\,g_+^{-1}\big(2\,\mathrm{disc}(G)\big)dˉ(G)>2g+−1​(2disc(G))

is hermetizable. The cost function and g+g_+g+​ are arbitrary subject to the axioms.

Milestones

  1. Lemma B.1. A nonempty UUU is hermetizable if dU(i)>g+−1(2c(SU(i))/c(sU(i)))d_U(i)>g_+^{-1}\big(2c(S_U(i))/c(s_U(i))\big)dU​(i)>g+−1​(2c(SU​(i))/c(sU​(i))) for every i∈Ui\in Ui∈U.
  2. Lemma B.2. A nonempty UUU is hermetizable if δ(U)≥g+−1(2 disc(U))\delta(U)\ge g_+^{-1}\big(2\,\mathrm{disc}(U)\big)δ(U)≥g+−1​(2disc(U)).
  3. Lemma B.4. A finite graph of average degree at least 2d2d2d, d>0d>0d>0, has a nonempty induced subgraph G′G'G′ with δ(G′)>d\delta(G')>dδ(G′)>d.
  4. Lemma B.3 (the peeling procedure). Repeatedly deleting every vertex with at most ttt neighbours among the remaining vertices returns the largest vertex set inducing minimum degree >t>t>t; it is empty exactly when no such set exists.

Significance

Theorem 3.8 turns a qualitative property of channel costs into a checkable topological criterion: if a network is dense relative to how unequal its channel flows are, a cost-reducing hub exists. The paper uses it to argue that such restructuring is profitable for an intermediary who charges part of the savings, and its probabilistic companion (Theorem 3.9) shows that random networks whose channel costs have light tails are hermetizable with high probability. The degree-to-subgraph Lemma B.4 is a standard tool of extremal graph theory (Diestel, Graph Theory, Prop. 1.2.2), and Lemma B.3 is the classical kkk-core peeling.

Mathematically the result is proved in the paper. None of it is formalized: Lean's Mathlib has minimum degree and induced subgraphs but neither Lemma B.4 nor the correctness of kkk-core peeling, and there is no formal model of payment-channel networks or of hermetization. The mission produces that model, machine-checked versions of the Appendix B.1 lemmas, and a statement of Theorem 3.8 under axioms that are actually satisfiable (see below).

Difficulty

The cost comparison in Lemma B.1 is node by node: the channels of a node inside UUU are replaced by one channel to the hub carrying their sum. The obvious bound on the hub channel's cost uses only monotonicity and subadditivity, and that is too weak: a single channel carrying the sum of ddd flows can cost almost as much as the ddd channels it replaces, while the deleted channels are each shared by two nodes. The quantitative axiom (SA+) is what makes the comparison strict, and the discrepancy controls how unequal the replaced flows may be.

Passing from the average degree of the whole network to a subnetwork in which every node has high degree is the second step, and it must keep track of the fact that the discrepancy of an induced subnetwork can be smaller but never larger than that of the network. Lemma B.4 needs an argument that the deletion process cannot exhaust the graph; a counting argument that treats every deleted vertex alike loses exactly the margin needed.

Formalization scope

Nodes form an arbitrary finite type V; the network is Λ : V → V → ℝ with anti-symmetry IsLN. The hub is the extra element none of Option V. The cost is the 12∑i,j\tfrac12\sum_{i,j}21​∑i,j​ form. In Lemmas B.1 and B.2 all degree data are those of the subnetwork induced on UUU; in Theorem 3.8 those of the whole network. s(v)s(v)s(v) has the junk value 000 for a node without channels, so every statement assumes the relevant nodes have a channel, and the discrepancy is a maximum over nodes having a channel.

Two axioms are corrected from the printed page and the correction is part of the statement. (SA) is printed for x>y≥0x>y\ge0x>y≥0, which at y=0y=0y=0 reads c(x)<c(x)c(x)<c(x)c(x)<c(x); it is stated for all x,y>0x,y>0x,y>0, the form the paper's Appendix D verifies. (SA+) is printed for all k∈R+k\in\mathbb R_+k∈R+​, which fails at x=0x=0x=0 and, for the paper's own example cost, at every k≤1k\le1k≤1; it is stated for k>1k>1k>1, x>0x>0x>0. Under the printed axioms every theorem would hold vacuously.

g+g_+g+​ is strictly increasing but not assumed onto, so g+−1g_+^{-1}g+−1​ is replaced throughout by the equivalent g+g_+g+​-form: d>g+−1(y)d>g_+^{-1}(y)d>g+−1​(y) becomes g+(d)>yg_+(d)>yg+​(d)>y, as in the paper's own proof of Lemma B.1. Theorem 3.8 therefore assumes g+(dˉ(G)/2)>2 disc(G)g_+(\bar d(G)/2)>2\,\mathrm{disc}(G)g+​(dˉ(G)/2)>2disc(G) and, explicitly, that the network has a channel (implied by the printed hypothesis). Lemma B.4 adds d>0d>0d>0 and reads "average degree 2d2d2d" as "at least 2d2d2d", as its proof does. The polynomial-time clause of Theorem 3.8 and the O(V+E)O(V+E)O(V+E) bound of Lemma B.3 are complexity claims and are not formalized; Lemma B.3 is posed as correctness of the procedure in its proof, which finds minimum degree >t>t>t (the printed statement says ≥t\ge t≥t).

Formalizations that would trivialize the mission are excluded: a specific cost such as c(x)=2(B∣x∣/r)1/2c(x)=2(B|x|/r)^{1/2}c(x)=2(B∣x∣/r)1/2 or a specific g+g_+g+​; hermetizability defined by the per-node inequality instead of the cost comparison; Theorem 3.8 with the empty set allowed to witness hermetizability (the strict cost decrease rules it out); Lemma B.4 without nonemptiness; and Lemma B.3 as "there exists an algorithm".

The definitions (network, cost axioms, degree data, hermetization, peeling) are reusable by the companion missions on this paper. Proofs of any milestone are welcome, Lemma B.4 and Lemma B.3 being independent of the network model.

Selected references

  • P. Guasoni, G. Huberman, C. Shikhelman, Lightning Network Economics: Topology, SSRN working paper 4439190, version of February 3, 2023, https://ssrn.com/abstract=4439190; published in Management Science, 2024, https://doi.org/10.1287/mnsc.2023.03872 (theorem numbers here follow the SSRN version).
  • P. Guasoni, G. Huberman, C. Shikhelman, Lightning Network Economics: Channels, 2022 (cited in the paper as [GHS22]; no stable link is given there).
  • R. Diestel, Graph Theory, 5th ed., Springer, 2017, Proposition 1.2.2. https://doi.org/10.1007/978-3-662-53622-3
  • J. Poon, T. Dryja, The Bitcoin Lightning Network: Scalable Off-Chain Instant Payments, 2015. https://lightning.network/lightning-network-paper.pdf
10 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

Lightning Network Economics: Topology I: A Cost-Minimizing Lightning Network Is Bipartite, with All Net Flows from One Side to the OtherResearch Paper

Why the topology of payment-channel networks matters

The Lightning Network (LN) is a second-layer payment system for Bitcoin. Instead of recording every payment on the blockchain, two parties lock funds in a payment channel and settle many payments off-chain; payments between parties without a common channel are routed along paths of channels. Locking funds is costly, and the amount a channel needs grows with the net flow it carries. Which channel topology supports a given pattern of payments at least total cost is therefore an economic design question for the network's participants.

Guasoni, Huberman and Shikhelman (SSRN 4439190, 2023; published in Management Science, 2024) study this question for a general cost function, assuming only a few qualitative properties derived in their earlier work on channel economics ([GHS22], Lightning Network Economics: Channels). This mission covers §3.1 of the paper, local channel reconfiguration: a relaying node can be bypassed at lower cost, odd cycles are never optimal, and a cost-minimizing network is bipartite with every net flow going from one side to the other. Three companion missions (II–IV of this series) cover hermetization by a routing hub (§3.2) and bounds on the global minimal cost (§3.3).

Setting

Let VVV be a finite set of nodes. A payment flow is a vector F=(fi)i∈VF=(f_i)_{i\in V}F=(fi​)i∈V​ of net flows with ∑ifi=0\sum_i f_i=0∑i​fi​=0. A Lightning Network on VVV is an anti-symmetric real matrix Λ=(λu,v)u,v∈V\Lambda=(\lambda_{u,v})_{u,v\in V}Λ=(λu,v​)u,v∈V​, λu,v=−λv,u\lambda_{u,v}=-\lambda_{v,u}λu,v​=−λv,u​, where λu,v\lambda_{u,v}λu,v​ is the net flow from uuu to vvv in the channel between them and λu,v=0\lambda_{u,v}=0λu,v​=0 means there is no channel. The network supports FFF if

∑j∈Vλi,j=fifor every i∈V.\sum_{j\in V}\lambda_{i,j}=f_i\qquad\text{for every } i\in V .j∈V∑​λi,j​=fi​for every i∈V.

A channel cost function is c:R→R≥0c:\mathbb R\to\mathbb R_{\ge0}c:R→R≥0​ with

  • (MO) c(x)>c(y)c(x)>c(y)c(x)>c(y) for x>y≥0x>y\ge 0x>y≥0;
  • (SY) c(−x)=c(x)c(-x)=c(x)c(−x)=c(x);
  • (CI) c(0)=0c(0)=0c(0)=0;
  • (SA) c(x+y)<c(x)+c(y)c(x+y)<c(x)+c(y)c(x+y)<c(x)+c(y) for x,y>0x,y>0x,y>0.

The cost of a network is c(Λ)=12∑i,jc(λi,j)c(\Lambda)=\tfrac12\sum_{i,j}c(\lambda_{i,j})c(Λ)=21​∑i,j​c(λi,j​), the sum of ccc over its channels. A network is cost-minimizing for FFF if it supports FFF and no Lightning Network on the same node set VVV that supports FFF has smaller cost.

The paper's channel notation: uv→λ\overrightarrow{uv}^{\lambda}uvλ is a channel with net flow λ\lambdaλ from uuu to vvv, and axy↔b{}^{a}\overleftrightarrow{xy}^{b}axy​b is a channel in which yyy sends aaa and xxx sends bbb, so the net flow from xxx to yyy is b−ab-ab−a.

Formalization targets

Goal: Corollary 3.3

If Λ\LambdaΛ is cost-minimizing for FFF, there is a set A⊆VA\subseteq VA⊆V with B=V∖AB=V\setminus AB=V∖A such that the channel graph (i∼ji\sim ji∼j iff λi,j≠0\lambda_{i,j}\ne0λi,j​=0) is bipartite with parts A,BA,BA,B, and

λi,j>0 ⟹ i∈A, j∈B.\lambda_{i,j}>0\ \Longrightarrow\ i\in A,\ j\in B .λi,j​>0 ⟹ i∈A, j∈B.

The statement is conditional and does not assert that a minimizer exists.

Milestones

  1. Theorem 3.1. For distinct u,v,wu,v,wu,v,w and λ1,λ2>0\lambda_1,\lambda_2>0λ1​,λ2​>0, the structure uv→λ1,vw→λ2\overrightarrow{uv}^{\lambda_1},\overrightarrow{vw}^{\lambda_2}uvλ1​,vwλ2​ is not cost-minimizing; if λ1≤λ2\lambda_1\le\lambda_2λ1​≤λ2​ the structure uw→λ1,λ1vw↔λ2\overrightarrow{uw}^{\lambda_1},{}^{\lambda_1}\overleftrightarrow{vw}^{\lambda_2}uwλ1​,λ1​vwλ2​ supports the same flow at strictly lower cost, and if λ1≥λ2\lambda_1\ge\lambda_2λ1​≥λ2​ so does λ2uv↔λ1,uw→λ2{}^{\lambda_2}\overleftrightarrow{uv}^{\lambda_1},\overrightarrow{uw}^{\lambda_2}λ2​uvλ1​,uwλ2​.
  2. The in-and-out claim (proof of Corollary 3.2). In an arbitrary network supporting FFF, if λu,v>0\lambda_{u,v}>0λu,v​>0 and λv,w>0\lambda_{v,w}>0λv,w​>0 for some u,v,wu,v,wu,v,w, the network is not cost-minimizing.
  3. Corollary 3.2. A network containing a cycle of odd length is not cost-minimizing.
  4. Corollary 3.11 (a sibling corollary of Theorem 3.1, not on the path to the goal). If fi1,fi2>0>fj1,fj2f_{i_1},f_{i_2}>0>f_{j_1},f_{j_2}fi1​​,fi2​​>0>fj1​​,fj2​​ for distinct i1≠i2i_1\ne i_2i1​=i2​, j1≠j2j_1\ne j_2j1​=j2​, no star network is cost-minimizing.

Significance

Corollary 3.3 says that in an optimal Lightning Network every node is a pure sender or a pure receiver, and that no node relays payments. This sits in tension with the observed LN, which is organized around large routing hubs; the paper reconciles the two in §3.2 by allowing new nodes. Corollary 3.11 shows that the star, the intuitive candidate for a cheapest topology, is optimal only with a single net payer or a single net payee.

The results are proved in the paper, with short arguments in its Appendix A, and they have no machine-checked proof. This mission adds a precise version of the model, in which the meaning of "cost-minimizing", the sign conventions and the corrected cost axioms are fixed, and a formal proof of the chain Theorem 3.1 → odd cycles → bipartite structure for an arbitrary cost function satisfying the axioms.

Difficulty

Theorem 3.1 on its own is a two-line computation. The difficulty is in applying it inside an arbitrary network. When uuu and www already share a channel, adding λ1\lambda_1λ1​ or λ2\lambda_2λ2​ to it requires c(a+b)≤c(a)+c(b)c(a+b)\le c(a)+c(b)c(a+b)≤c(a)+c(b) for reals of either sign. That inequality is not among the axioms and has to be derived from them. The odd-cycle step needs a pigeonhole argument on channel orientations around a cycle. The bipartite step needs either König's characterization of bipartite graphs or a direct construction of the parts from the flow directions. The naive formalization that re-states Theorem 3.1 only for a network with exactly two channels does not reach the corollaries.

Formalization scope

  • The node set is an arbitrary finite type V, not {1,…,n}\{1,\dots,n\}{1,…,n}. The matrix is Λ : V → V → ℝ, because λ is a Lean keyword.
  • Sign convention. Support is the row-sum display ∑jλi,j=fi\sum_j\lambda_{i,j}=f_i∑j​λi,j​=fi​ of §2.1, under which a net payer has fi>0f_i>0fi​>0. The paper's examples (§2, Figure 1, proof of Theorem 3.1) use the opposite sign. Every statement here is invariant under F↦−FF\mapsto-FF↦−F, and Theorem 3.1 is stated with "the same flow" given by Supports, which is independent of the sign.
  • Cost is the form 12∑i,jc(λi,j)\tfrac12\sum_{i,j}c(\lambda_{i,j})21​∑i,j​c(λi,j​), which needs no order on VVV.
  • Cost-minimizing compares with networks on the same node set VVV; a network with an added hub (§3.2) is not an alternative.
  • Axiom correction (SA). The paper prints (SA) as "c(x+y)<c(x)+c(y)c(x+y)<c(x)+c(y)c(x+y)<c(x)+c(y) for x>y≥0x>y\ge0x>y≥0", which fails at y=0y=0y=0, so every theorem would hold vacuously. The formalization uses x,y>0x,y>0x,y>0, the form verified in Appendix D. The stronger axiom (SA+) is not used in this mission.
  • Cycles are injective maps Fin k → V, k≥3k\ge3k≥3 odd, with cyclic successor finRotate k. A channel is a nonzero entry in either direction.
  • Bipartite is Mathlib's SimpleGraph.IsBipartiteWith A Aᶜ on the channel graph, with the flow-direction clause stated separately as the stronger content.
  • The star is the network whose only channels join each i≠hi\ne hi=h to the hub hhh with net flow fif_ifi​; Corollary 3.11 assumes ∑ifi=0\sum_i f_i=0∑i​fi​=0.

Trivializing formalizations are ruled out: the cost function is arbitrary subject to the axioms (no ∣x∣\sqrt{|x|}∣x∣​ or linear cost); cost-minimization ranges over all networks on VVV, not over a fixed edge set; VVV is not fixed to three nodes; the in-and-out claim is stated for arbitrary networks; and AAA and BBB are complementary, so they cannot overlap.

König's theorem is in Mathlib (SimpleGraph.two_colorable_iff_forall_loop_even) and proved on the platform (FamousTheorems.two_colorable_iff_no_odd_cycle_6b), so it is not posed here. The derived two-sided subadditivity of ccc, and a lemma rerouting a relayed flow inside an arbitrary network, are reusable in the other missions of the series. Contributions of such auxiliary lemmas are welcome.

Selected references

  • P. Guasoni, G. Huberman, C. Shikhelman, Lightning Network Economics: Topology, SSRN working paper 4439190, version of February 3, 2023. https://ssrn.com/abstract=4439190 (published in Management Science, 2024, https://doi.org/10.1287/mnsc.2023.03872).
  • P. Guasoni, G. Huberman, C. Shikhelman, Lightning Network Economics: Channels, working paper, 2022 ([GHS22] in the paper; the source of the cost axioms).
  • D. Kőnig, Theorie der endlichen und unendlichen Graphen, Akademische Verlagsgesellschaft, Leipzig, 1936.
  • J. Poon, T. Dryja, The Bitcoin Lightning Network: Scalable Off-Chain Instant Payments, 2015 (as cited in the paper). https://lightning.network/lightning-network-paper.pdf
8 thms1 active userReviewed
ProbabilityStatistics·Captain: mikedeng1

Change-Point Detection in Dynamic Networks with Missing Links I: Changes of Energy of Order (ω_n/T)^{1/2} at a Known Time Cannot Be Detected by Any Level-α Test with Type II Error Below βResearch Paper

Motivation

Networks observed over time — contact networks, communication graphs, brain connectivity recorded in sessions, trade networks — often change their structure abruptly at an unknown or suspected moment. Detecting such a change point from a sequence of snapshots is a basic statistical task, and in practice the snapshots are incomplete: some pairs of nodes are never queried, or their interaction is not recorded. Enikeeva and Klopp (arXiv:2106.14470, Operations Research, 2025) study this problem for inhomogeneous random graphs with missing links in the framework of minimax hypothesis testing (Ingster and Suslina, 2003). They give a test based on the spectral norm of a matrix CUSUM statistic that detects every change above a threshold (their Theorem 1), and a lower bound showing that changes of smaller order cannot be detected by any test (their Theorem 2). This mission formalizes the lower bound for a change at a known time.

Setting

There are nnn vertices and TTT time points. At time ttt one observes a symmetric 0/10/10/1 matrix YtY^tYt with zero diagonal, whose entries YijtY^t_{ij}Yijt​, i<ji<ji<j, are independent over pairs and over time with

Yijt∼Bernoulli(ΠijΘijt).Y^t_{ij}\sim\mathrm{Bernoulli}(\Pi_{ij}\Theta^t_{ij}).Yijt​∼Bernoulli(Πij​Θijt​).

Here Θt\Theta^tΘt is the matrix of connection probabilities (symmetric, entries in [0,1][0,1][0,1], zero diagonal) and Π\PiΠ the sampling matrix: pair (i,j)(i,j)(i,j) is observed with probability Πij>0\Pi_{ij}>0Πij​>0, and Πii=1\Pi_{ii}=1Πii​=1. The product Π⊙Θ\Pi\odot\ThetaΠ⊙Θ is entrywise. Sparsity is measured by the column norm ∥M∥1,∞=max⁡j∑i∣Mij∣\|M\|_{1,\infty}=\max_j\sum_i|M_{ij}|∥M∥1,∞​=maxj​∑i​∣Mij​∣, and the null class is

Sn(ωn)={(Θ,Π):∥Π⊙Θ∥1,∞≤ωn},\mathcal S_n(\omega_n)=\{(\Theta,\Pi):\|\Pi\odot\Theta\|_{1,\infty}\le\omega_n\},Sn​(ωn​)={(Θ,Π):∥Π⊙Θ∥1,∞​≤ωn​},

so ωn\omega_nωn​ bounds the expected observed degree.

Under the null hypothesis every snapshot has the same Θ0\Theta^0Θ0. Under the alternative with a change at time τ∈{1,…,T−1}\tau\in\{1,\dots,T-1\}τ∈{1,…,T−1}, snapshots 1,…,τ1,\dots,\tau1,…,τ have Θb\Theta^bΘb and snapshots τ+1,…,T\tau+1,\dots,Tτ+1,…,T have Θa\Theta^aΘa. With q(x)=x(1−x)q(x)=\sqrt{x(1-x)}q(x)=x(1−x)​, the energy of the change is q(τ/T)∥Π⊙(Θa−Θb)∥2→2q(\tau/T)\|\Pi\odot(\Theta^a-\Theta^b)\|_{2\to2}q(τ/T)∥Π⊙(Θa−Θb)∥2→2​, the spectral norm of the observed jump weighted by the position of the change. The alternative class Wn,Tτ(ωn,R)\mathcal W^\tau_{n,T}(\omega_n,R)Wn,Tτ​(ωn​,R) is the set of pairs (Θa,Π),(Θb,Π)(\Theta^a,\Pi),(\Theta^b,\Pi)(Θa,Π),(Θb,Π) in Sn(ωn)\mathcal S_n(\omega_n)Sn​(ωn​) with energy at least RRR.

A test ψ\psiψ is any {0,1}\{0,1\}{0,1}-valued function of the observations. Its type I error α(ψ)\alpha(\psi)α(ψ) is the supremum of P{ψ=1}\mathrm P\{\psi=1\}P{ψ=1} over the null class, and its type II error β(ψ,R)\beta(\psi,R)β(ψ,R) the supremum of P{ψ=0}\mathrm P\{\psi=0\}P{ψ=0} over the alternative class (Definition 1). Fix levels α∈(0,1)\alpha\in(0,1)α∈(0,1), β∈(0,1−α]\beta\in(0,1-\alpha]β∈(0,1−α], and put η=α+β\eta=\alpha+\betaη=α+β and Cη=log⁡(1+4(1−η)2)C_\eta=\log(1+4(1-\eta)^2)Cη​=log(1+4(1−η)2).

Formalization targets

Goal: undetectable energies at a known change point

With εn=(2Cη)1/4ωn−1/2\varepsilon_n=(2C_\eta)^{1/4}\omega_n^{-1/2}εn​=(2Cη​)1/4ωn−1/2​, ρ~n=(1−εn)ωn/(n−1)\tilde\rho_n=(1-\varepsilon_n)\omega_n/(n-1)ρ~​n​=(1−εn​)ωn​/(n−1) and

μn=TR2ωn⋅1(1−ρ~n)(n−1)(1−εn),\mu_n=\frac{TR^2}{\omega_n}\cdot\frac{1}{(1-\tilde\rho_n)(n-1)(1-\varepsilon_n)},μn​=ωn​TR2​⋅(1−ρ~​n​)(n−1)(1−εn​)1​,

if 42Cη≤ωn≤(n−1)/24\sqrt{2C_\eta}\le\omega_n\le(n-1)/242Cη​​≤ωn​≤(n−1)/2, R>0R>0R>0,

μn(n−1)<12and12μn2 n(n−1)1−2μn(n−1)≤Cη,\mu_n(n-1)<\tfrac12\qquad\text{and}\qquad\frac{\tfrac12\mu_n^2\,n(n-1)}{1-2\mu_n(n-1)}\le C_\eta,μn​(n−1)<21​and1−2μn​(n−1)21​μn2​n(n−1)​≤Cη​,

then every test with α(ψ)≤α\alpha(\psi)\le\alphaα(ψ)≤α has β(ψ,R)≥β\beta(\psi,R)\ge\betaβ(ψ,R)≥β. For η<1\eta<1η<1 this covers every R≤cη(ωn/T)1/2R\le c_\eta(\omega_n/T)^{1/2}R≤cη​(ωn​/T)1/2 with cη>0c_\eta>0cη​>0 depending only on η\etaη, so the minimax detection boundary is at least of order (ωn/T)1/2(\omega_n/T)^{1/2}(ωn​/T)1/2. The statement fixes no asymptotic regime: it holds for every nnn, TTT, τ\tauτ and ωn\omega_nωn​ in range.

Milestones

  1. Lemma 7 (p. 34): second moments of Bernoulli likelihood ratios.
  2. Display (25) (p. 33): the mixture lower bound β(ψ,R)≥1−12∥p1−p0∥1−α≥1−12χ2(p1,p0)1/2−α\beta(\psi,R)\ge1-\tfrac12\|p_1-p_0\|_1-\alpha\ge1-\tfrac12\chi^2(p_1,p_0)^{1/2}-\alphaβ(ψ,R)≥1−21​∥p1​−p0​∥1​−α≥1−21​χ2(p1​,p0​)1/2−α.
  3. Step 1 (pp. 34–35): the paper's priors live on Sn(ωn)\mathcal S_n(\omega_n)Sn​(ωn​) and Wn,Tτ(ωn,R)\mathcal W^\tau_{n,T}(\omega_n,R)Wn,Tτ​(ωn​,R).
  4. Display (27) (p. 36): the second moment of the likelihood ratio is at most Eζexp⁡(12μn∑i≠jζiζj)\mathrm E_\zeta\exp(\tfrac12\mu_n\sum_{i\ne j}\zeta_i\zeta_j)Eζ​exp(21​μn​∑i=j​ζi​ζj​).
  5. Step 4 (p. 36): the Cortinovis–Kressner bound on the Laplace transform of a Rademacher chaos.
  6. Display on p. 37: the second moment is at most exp⁡{12μn2n(n−1)/(1−2μn(n−1))}\exp\{\tfrac12\mu_n^2n(n-1)/(1-2\mu_n(n-1))\}exp{21​μn2​n(n−1)/(1−2μn​(n−1))}.

Significance

The lower bound is the half of the minimax result that cannot be obtained by exhibiting a procedure: it says that no test, however computed, separates the hypotheses below energy of order (ωn/T)1/2(\omega_n/T)^{1/2}(ωn​/T)1/2. Combined with the matrix CUSUM test of Theorem 1, which succeeds above 42(1+ϵ)(ωn/T)1/24\sqrt2(1+\epsilon)(\omega_n/T)^{1/2}42​(1+ϵ)(ωn​/T)1/2 plus a logarithmic term, it identifies the detection rate for a known change point. It also shows that missing links enter only through ωn\omega_nωn​, the bound on observed degrees.

The result is proved in the paper; nothing in it is machine-checked. A formalization adds a checked statement of the minimax testing framework for a finite random-graph model (tests, type I and II errors over composite classes, the lower bound condition), a checked version of the second moment method for mixtures, and a checked Rademacher-chaos moment bound. While preparing the statements, two displays of the printed proof were found to be false as printed (see Formalization scope); the formal goal records the bound the corrected argument gives.

Difficulty

The minimax type II error is a supremum over a composite alternative class and an infimum over all level-α\alphaα tests, and neither can be handled directly. The lower bound requires choosing priors that sit inside both classes, reducing to a χ2\chi^2χ2-divergence between two mixtures of product Bernoulli laws over 2n2^n2n sign vectors, and bounding the resulting exponential moment of a quadratic form in Rademacher signs. The last step is where the naive argument fails: a Gaussian-type bound on Eexp⁡(μ ζTAζ)\mathrm E\exp(\mu\,\zeta^{\mathsf T}A\zeta)Eexp(μζTAζ) that ignores ∥A∥2→2\|A\|_{2\to2}∥A∥2→2​ is false when A=1n1nT−idnA=\mathbf 1_n\mathbf 1_n^{\mathsf T}-\mathrm{id}_nA=1n​1nT​−idn​, whose spectral norm is n−1n-1n−1; the exponential moment is finite only when μn(n−1)\mu_n(n-1)μn​(n−1) stays below a constant.

Formalization scope

The observation space is finite: one Boolean per time point and pair i<ji<ji<j, with 0-based time in Lean. Probabilities are finite sums of products of Bernoulli weights; no measure theory is used, and a test is any Boolean function of the observation. The type I and II errors are real suprema of sets of probabilities in [0,1][0,1][0,1]; the level condition ranges over the whole null class, every sampling matrix included. Sampling matrices carry the standing assumptions Πii=1\Pi_{ii}=1Πii​=1, Πij>0\Pi_{ij}>0Πij​>0 of §2. The spectral norm is the published HighDimProb.RandomMatrices.matrixOpNorm; sign vectors are Boolean vectors mapped to ±1\pm1±1, and Rademacher expectations are averages over 2n2^n2n vectors.

Departures from the printed text, all disclosed in the statements:

  • The goal is stated in the form "for every RRR in the range, every level-α\alphaα test has type II error at least β\betaβ" (the paper's lower bound condition, p. 9), not through the infimum Rn,τ∗\mathcal R^*_{n,\tau}Rn,τ∗​ of Definition 3.
  • The paper's Step 4 bound (p. 36) and the first display of p. 37 are false as printed for large nnn, because the spectral norm n−1n-1n−1 of 1n1nT−idn\mathbf 1_n\mathbf 1_n^{\mathsf T}-\mathrm{id}_n1n​1nT​−idn​ is dropped. Step 4 is stated for ∥A∥2→2≤1\|A\|_{2\to2}\le1∥A∥2→2​≤1. The p. 37 display is stated for μn(n−1)<1/2\mu_n(n-1)<1/2μn​(n−1)<1/2, with denominator 1−2μn(n−1)1-2\mu_n(n-1)1−2μn​(n−1). The goal's condition on RRR is the one this corrected bound gives, in place of the printed (29) and the constant (2Cη)1/4(2C_\eta)^{1/4}(2Cη​)1/4, which the corrected argument does not reach.
  • Two hypotheses are added, ωn≥42Cη\omega_n\ge4\sqrt{2C_\eta}ωn​≥42Cη​​ and ωn≤(n−1)/2\omega_n\le(n-1)/2ωn​≤(n−1)/2, so that the paper's prior entries lie in [0,1][0,1][0,1].

Trivializing encodings are ruled out: the tests are unrestricted, the alternative class is nonempty for every admissible RRR (milestone 3), and a lower bound on a supremum cannot hold vacuously on an empty class. When η=1\eta=1η=1 the hypotheses cannot hold for R>0R>0R>0, matching the paper, where β=1−α\beta=1-\alphaβ=1−α is the trivial boundary.

The development needs elementary finite probability over product spaces, Cauchy–Schwarz for the χ2\chi^2χ2 step, and a Rademacher-chaos exponential moment bound; the last is reusable well beyond this mission. Proofs of any milestone, and of the goal from the milestones, are welcome.

Selected references

  • F. Enikeeva and O. Klopp, Change-point detection in dynamic networks with missing links, Operations Research, 2025. arXiv:2106.14470v2
  • Yu. I. Ingster and I. A. Suslina, Nonparametric Goodness-of-Fit Testing Under Gaussian Models, Lecture Notes in Statistics 169, Springer, 2003. doi:10.1007/978-0-387-21580-8
  • A. Cortinovis and D. Kressner, On randomized trace estimates for indefinite matrices with an application to determinants, Foundations of Computational Mathematics, 2021. arXiv:2005.10009
  • A. S. Bandeira and R. van Handel, Sharp nonasymptotic bounds on the norm of random matrices with independent entries, Annals of Probability 44(4), 2016. arXiv:1408.6185
10 thms1 active userReviewed
Markov ChainOperations ResearchProbability·Captain: mikedeng1

Opinion Dynamics on Directed Complex Networks 1: On Graph Sequences Admitting a Strong Coupling, the Typical Stationary Opinion Converges to the Root Opinion R* of the Local Weak LimitResearch Paper

Opinions on large directed social networks

Linear models of opinion formation go back to DeGroot (DeGroot 1974), in which every individual repeatedly replaces their opinion by a weighted average of the opinions of the people they listen to, and to Friedkin and Johnsen (Friedkin–Johnsen 1990), who added a persistent internal opinion. Fraiman, Lin and Olvera-Cravioto (arXiv:2209.00969v2, Mathematics of Operations Research, 2025) add a random external (media) signal whose law may depend on the individual's attributes, which models selective exposure, and ask what the opinions look like on a large random social network. The answer is the behaviour of a typical individual, a uniformly chosen vertex: its stationary opinion converges in law to the opinion of the root of the network's local weak limit, and the empirical distribution of all stationary opinions converges to the same law. Questions such as consensus or polarization are then questions about one limiting random variable, independent of the particular realization of the network.

This mission formalizes that main result (Theorem 2) together with the fixed-graph stationarity theorem it rests on (Theorem 1).

Setting

A vertex-weighted directed graph on a vertex set VVV gives each vertex iii an in-degree di−d_i^-di−​, an ordered list of inbound neighbours ℓ(i,1),…,ℓ(i,di−)\ell(i,1),\dots,\ell(i,d_i^-)ℓ(i,1),…,ℓ(i,di−​) and weights c(i,r)∈[0,1]c(i,r)\in[0,1]c(i,r)∈[0,1] with ∑rc(i,r)=c\sum_r c(i,r)=c∑r​c(i,r)=c whenever di−>0d_i^->0di−​>0. The parameters satisfy c∈[0,1)c\in[0,1)c∈[0,1), d∈(0,1]d\in(0,1]d∈(0,1], c+d≤1c+d\le1c+d≤1. The opinions Ri(k)∈[−1,1]R_i^{(k)}\in[-1,1]Ri(k)​∈[−1,1] evolve by recursion (1),

Ri(k+1)=∑r=1di−c(i,r) Rℓ(i,r)(k)+Wi(k)+(1−c−d)Ri(k),k≥0,R_i^{(k+1)}=\sum_{r=1}^{d_i^-}c(i,r)\,R^{(k)}_{\ell(i,r)}+W_i^{(k)}+(1-c-d)R_i^{(k)},\qquad k\ge0,Ri(k+1)​=r=1∑di−​​c(i,r)Rℓ(i,r)(k)​+Wi(k)​+(1−c−d)Ri(k)​,k≥0,

where the external signals Wi(k)W_i^{(k)}Wi(k)​ are independent, i.i.d. in time given the vertex mark, and bounded by ∣Wi(k)∣≤d+c−∑rc(i,r)|W_i^{(k)}|\le d+c-\sum_rc(i,r)∣Wi(k)​∣≤d+c−∑r​c(i,r). With the operator Δf(i)=∑rc(i,r)f(ℓ(i,r))+(1−c−d)f(i)\Delta f(i)=\sum_rc(i,r)f(\ell(i,r))+(1-c-d)f(i)Δf(i)=∑r​c(i,r)f(ℓ(i,r))+(1−c−d)f(i) this reads R(k+1)=ΔR(k)+W(k)R^{(k+1)}=\Delta R^{(k)}+W^{(k)}R(k+1)=ΔR(k)+W(k). The stationary vector is R=∑r≥0ΔrW(r)R=\sum_{r\ge0}\Delta^rW^{(r)}R=∑r≥0​ΔrW(r).

The full mark of a vertex is Xi=(Ai,Qi,Si,Di−,C(i,1),C(i,2),… )\mathbf X_i=(\mathbf A_i,Q_i,S_i,D_i^-,C(i,1),C(i,2),\dots)Xi​=(Ai​,Qi​,Si​,Di−​,C(i,1),C(i,2),…): a generic attribute, an internal opinion, a stubbornness label, the in-degree and the weights. Marks are compared by the metric

ρ(x,x~)=ρ′(a,a~)+∣q−q~∣+∣s−s~∣+∣d−−d~−∣+∑j∣cj1(d−≥j)−c~j1(d~−≥j)∣.\rho(\mathbf x,\tilde{\mathbf x})=\rho'(\mathbf a,\tilde{\mathbf a})+|q-\tilde q|+|s-\tilde s|+|d^--\tilde d^-|+\sum_j|c_j\mathbb 1(d^-\ge j)-\tilde c_j\mathbb 1(\tilde d^-\ge j)|.ρ(x,x~)=ρ′(a,a~)+∣q−q~​∣+∣s−s~∣+∣d−−d~−∣+j∑​∣cj​1(d−≥j)−c~j​1(d~−≥j)∣.

A random graph sequence G(Vn,En;An)G(V_n,E_n;\mathscr A_n)G(Vn​,En​;An​) has vertex set Vn={1,…,n}V_n=\{1,\dots,n\}Vn​={1,…,n} and attributes An={Yi=(Ai,Qi,Si)}\mathscr A_n=\{\mathbf Y_i=(\mathbf A_i,Q_i,S_i)\}An​={Yi​=(Ai​,Qi​,Si​)}; edges and weights are random given the attributes. The conditional expectation En[⋅]=E[⋅∣An]E_n[\cdot]=E[\cdot\mid\mathscr A_n]En​[⋅]=E[⋅∣An​] conditions on the attributes only. The in-component of depth kkk of a vertex vvv is the set of vertices with a directed path of length at most kkk to vvv. The sequence admits a strong coupling (Definition 4) with a rooted marked graph G(X)\mathcal G(\boldsymbol{\mathcal X})G(X) if, for two independent uniform vertices In,JnI_n,J_nIn​,Jn​, every depth k≥1k\ge1k≥1 and every ϵ>0\epsilon>0ϵ>0, there are two independent copies of G(X)\mathcal G(\boldsymbol{\mathcal X})G(X) whose depth-kkk root in-components are, with conditional probability tending to one in probability, isomorphic to those of InI_nIn​ and JnJ_nJn​, with all marks ϵ\epsilonϵ-close in ρ\rhoρ and the two in-components of InI_nIn​ and JnJ_nJn​ disjoint. The Wasserstein distance is d1(μ,ν)=inf⁡{E∣X−Y∣:X∼μ,Y∼ν}d_1(\mu,\nu)=\inf\{E|X-Y|:X\sim\mu,Y\sim\nu\}d1​(μ,ν)=inf{E∣X−Y∣:X∼μ,Y∼ν}.

Formalization targets

Goal: Theorem 2

Assume a strong coupling, d>0d>0d>0, and a signal kernel ν(x)\nu(\mathbf x)ν(x) with d1(ν(x),ν(x~))≤Kρ(x,x~)d_1(\nu(\mathbf x),\nu(\tilde{\mathbf x}))\le K\rho(\mathbf x,\tilde{\mathbf x})d1​(ν(x),ν(x~))≤Kρ(x,x~). Then there are laws LkL_kLk​ of (R(0),…,R(k))(\mathcal R^{(0)},\dots,\mathcal R^{(k)})(R(0),…,R(k)) and L∗L^*L∗ of R∗\mathcal R^*R∗, not depending on nnn, with

max⁡0≤r≤kE[∣RIn(r)−R(r)∣∣An]→P0,1n∑i=1nf(Ri(k))→PEf(R(k)),\max_{0\le r\le k}E\bigl[|R^{(r)}_{I_n}-\mathcal R^{(r)}|\bigm|\mathscr A_n\bigr]\xrightarrow{P}0,\qquad \frac1n\sum_{i=1}^nf(R_i^{(k)})\xrightarrow{P}E f(\mathcal R^{(k)}),0≤r≤kmax​E[∣RIn​(r)​−R(r)∣​An​]P​0,n1​i=1∑n​f(Ri(k)​)P​Ef(R(k)), E[∣RIn−R∗∣∣An]→P0,1n∑i=1nf(Ri)→PEf(R∗),E\bigl[|R_{I_n}-\mathcal R^*|\bigm|\mathscr A_n\bigr]\xrightarrow{P}0,\qquad \frac1n\sum_{i=1}^nf(R_i)\xrightarrow{P}E f(\mathcal R^*),E[∣RIn​​−R∗∣​An​]P​0,n1​i=1∑n​f(Ri​)P​Ef(R∗),

for every continuous fff on [−1,1][-1,1][−1,1], and R(k)⇒R∗\mathcal R^{(k)}\Rightarrow\mathcal R^*R(k)⇒R∗ geometrically fast:

d1(law R(k),law R∗)≤(1−d)k(2d+2).d_1\bigl(\mathrm{law}\,\mathcal R^{(k)},\mathrm{law}\,\mathcal R^*\bigr)\le(1-d)^k\Bigl(\frac2d+2\Bigr).d1​(lawR(k),lawR∗)≤(1−d)k(d2​+2).

Milestones

  1. ∥Δ∥∞≤1−d\|\Delta\|_\infty\le1-d∥Δ∥∞​≤1−d (proof of Theorem 1, p. 22).
  2. Theorem 1 (p. 5): on a fixed locally finite graph, R(k)⇒RR^{(k)}\Rightarrow RR(k)⇒R at a geometric rate, with a limit that does not depend on R(0)R^{(0)}R(0).
  3. Theorem 2(1) (p. 8): the fixed-time statement.

A supporting statement of the proposal, not a milestone, is the tail bound ∥R−B(k)∥∞≤2∑r>k(1−d)r\|R-B^{(k)}\|_\infty\le2\sum_{r>k}(1-d)^r∥R−B(k)∥∞​≤2∑r>k​(1−d)r for B(k)=∑r≤kΔrW(r)B^{(k)}=\sum_{r\le k}\Delta^rW^{(r)}B(k)=∑r≤k​ΔrW(r) (proof of Theorem 2, p. 28).

Significance

Theorem 2 reduces the stationary opinion distribution of a large network to a single random variable R∗\mathcal R^*R∗ attached to the local limit. When the limit is a marked Galton–Watson tree, R∗\mathcal R^*R∗ has an explicit series representation whose mean and variance are computed in closed form later in the paper (the other two missions of this series), and these formulas are what explain consensus and polarization. Strong couplings exist ([Olvera-Cravioto 2022], cited on p. 8 of the paper) for Erdős–Rényi graphs, the Chung–Lu and Norros–Reittu models, the configuration model, stochastic block models and preferential attachment graphs, so the theorem applies to most random graph models used for social networks.

The result is proved in the paper; nothing in it has been formalized. On Prove2Me this is the first statement of a strong coupling, a form of local weak convergence for directed marked graphs, and of a stochastic recursion on a random graph. The definitions of in-components, the coupling event and the strong coupling are reusable for any local-limit statement about directed random graphs, and the contraction and time-reversal milestones are reusable for linear stochastic recursions.

Difficulty

The fixed-graph part is a contraction argument, but the coupled object is not the opinion process itself: R(k)R^{(k)}R(k) does not converge almost surely, and only its time reversal B(k)B^{(k)}B(k) does. The main difficulty is Theorem 2. A local limit controls one neighbourhood at a time, while the empirical averages need two uniformly chosen vertices to be asymptotically independent, which a one-vertex limit statement does not give. The errors in weights, signals and initial opinions enter at every vertex of a depth-kkk neighbourhood, and the statements condition only on the attributes, with edges and weights integrated out. The stationary statement then requires an interchange of n→∞n\to\inftyn→∞ and k→∞k\to\inftyk→∞ that is uniform in nnn.

Formalization scope

All random objects of the mmm-th model live on one probability space, and the mmm-th graph has m+1m+1m+1 vertices (the paper's Gm+1G_{m+1}Gm+1​), so a uniform vertex always exists. Signals are written Wi(k)=ζ(Xi,Ui(k))W_i^{(k)}=\zeta(\mathbf X_i,U_i^{(k)})Wi(k)​=ζ(Xi​,Ui(k)​) and initial opinions Ri(0)=φ(Xi,Vi)R_i^{(0)}=\varphi(\mathbf X_i,V_i)Ri(0)​=φ(Xi​,Vi​) with i.i.d. uniforms independent of the graph: this quantile representation is equivalent in law to the paper's conditionally i.i.d. signals. Neighbour indices are 0-based. The conditional quantities given An\mathscr A_nAn​ are regular conditional distributions given the attribute vector, and "random variables whose distribution does not depend on An\mathscr A_nAn​" are encoded by fixed limit laws, with the paper's E[∣⋅∣∣An]→0E[|\cdot|\mid\mathscr A_n]\to0E[∣⋅∣∣An​]→0 read as d1d_1d1​ convergence in probability of the conditional laws, which is equivalent. Theorem 1 is stated on countably many vertices, with its geometric rate given as an explicit bound for 1-Lipschitz test functions of finitely many coordinates.

Disclosed choices: the strong coupling is stated on the given space with measurable events inside the coupling events (the event "an isomorphism exists" need not be measurable), with isomorphisms that preserve the order of inbound neighbours (which the proof uses), and through its second bullet, which implies the first. The paper's conditional independence of weight vectors given An\mathscr A_nAn​ is not imposed. The strong coupling also requires the depth-kkk in-components of InI_nIn​ and JnJ_nJn​ to be disjoint on the coupling event: the proof of Theorem 7 uses this, and without it Definition 4 admits a graph whose vertices all listen to a single hub, whose shared signals keep 1n∑if(Ri(k))\frac1n\sum_if(R_i^{(k)})n1​∑i​f(Ri(k)​) random. The page puts no condition on R(0)R^{(0)}R(0) beyond conditional independence of the signals, but Theorem 2(1) at time 000 is false then (take R(0)≡(−1)nR^{(0)}\equiv(-1)^nR(0)≡(−1)n); the statement assumes a d1d_1d1​-Lipschitz initial kernel with the same KKK, which covers the paper's own simulations. The geometric rate uses the constant of the proof.

Trivializing readings are excluded: every tsum is absolutely summable under the hypotheses, conditional laws are regular conditional distributions of measurable random variables, the averages have no division by zero, and the limit laws are forced onto [−1,1][-1,1][−1,1] by the convergence, so no integral defaults to 000. Theorem 7 of the paper (the two-vertex coupling) is not a milestone. Contributions of proofs of any milestone, and of general lemmas on regular conditional distributions and Wasserstein couplings, are welcome.

Selected references

  • N. Fraiman, T.-C. Lin and M. Olvera-Cravioto, Opinion dynamics on directed complex networks, Mathematics of Operations Research, 2025; preprint arXiv:2209.00969v2, 2024. https://arxiv.org/abs/2209.00969v2
  • M. H. DeGroot, Reaching a consensus, Journal of the American Statistical Association 69 (1974), 118–121. https://doi.org/10.1080/01621459.1974.10480137
  • N. E. Friedkin and E. C. Johnsen, Social influence and opinions, Journal of Mathematical Sociology 15 (1990), 193–206. https://doi.org/10.1080/0022250X.1990.9990069
  • M. Olvera-Cravioto, Strong couplings for static locally tree-like random graphs, Journal of Applied Probability 59(4) (2022), 1261–1285 (reference [33] of the paper, where the random graph models admitting strong couplings are listed).
8 thms1 active userReviewed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Flow Allocation Games 2: In Unit-Ranking Games Every Strong Equilibrium Has Total Flow at Least the Optimum Divided by the Min-Max Cycle Length dResearch Paper

Motivation

Financial networks are webs of liabilities: firm uuu owes firm vvv an amount c(u,v)c_{(u,v)}c(u,v)​, and every firm holds some external assets. When firms cannot pay in full, how much money actually moves through the network depends on how each firm splits its available funds among its creditors. The classical clearing model of Eisenberg and Noe (2001) fixes this split by a proportional rule. Flow allocation games, introduced by Bertschinger, Hoefer and Schmand (arXiv:1908.01714, Mathematics of Operations Research, 2025), make it strategic: every firm chooses how to allocate whatever it receives, and the resulting payments are the clearing state of the chosen strategies.

Because money that circulates comes back, the total amount of flow in such a network is driven by cycles, and cycles require several firms to cooperate. The natural solution concept is therefore the strong equilibrium, which is stable against joint deviations of coalitions. The paper shows that in unit-ranking games a strong equilibrium maximizing total flow always exists (Theorem 9, price of stability 111). This mission concerns the other side: how much total flow can the worst strong equilibrium lose, and which structural parameter of the network controls the loss.

Setting

A flow allocation game Γ=(G,(bv)v∈V,(ce)e∈E)\Gamma=(G,(b_v)_{v\in V},(c_e)_{e\in E})Γ=(G,(bv​)v∈V​,(ce​)e∈E​) consists of a finite directed graph G=(V,E)G=(V,E)G=(V,E) (parallel edges allowed), a fixed supply bv∈N0b_v\in\mathbb N_0bv​∈N0​ at each node and a capacity ce∈N0c_e\in\mathbb N_0ce​∈N0​ on each edge. Every node is a player. E+(v)E^+(v)E+(v) and E−(v)E^-(v)E−(v) denote the outgoing and incoming edges of vvv, and cv+=∑e∈E+(v)cec_v^+=\sum_{e\in E^+(v)}c_ecv+​=∑e∈E+(v)​ce​.

In a unit-ranking game, player vvv chooses for each edge e∈E+(v)e\in E^+(v)e∈E+(v) a non-decreasing function ae:N0→N0a_e:\mathbb N_0\to\mathbb N_0ae​:N0​→N0​ with ae(y)≤cea_e(y)\le c_eae​(y)≤ce​ and ∑e∈E+(v)ae(y)=min⁡{cv+,y}\sum_{e\in E^+(v)}a_e(y)=\min\{c_v^+,y\}∑e∈E+(v)​ae​(y)=min{cv+​,y}: given a total supply yyy, it forwards all of it until its outgoing edges are full, one unit at a time according to a ranking of unit capacities. A flow fff is feasible for a profile a\mathbf aa if f(v,w)=a(v,w)(fv)f_{(v,w)}=a_{(v,w)}(f_v)f(v,w)​=a(v,w)​(fv​) with fv=bv+∑e∈E−(v)fef_v=b_v+\sum_{e\in E^-(v)}f_efv​=bv​+∑e∈E−(v)​fe​. The clearing state f^\hat ff^​ is the coordinatewise largest feasible flow; player vvv's utility is uv(a)=∑e∈E+(v)f^eu_v(\mathbf a)=\sum_{e\in E^+(v)}\hat f_euv​(a)=∑e∈E+(v)​f^​e​, and the total flow is

Flow(a)=∑e∈Ef^e.\mathrm{Flow}(\mathbf a)=\sum_{e\in E}\hat f_e .Flow(a)=e∈E∑​f^​e​.

A profile is a strong equilibrium if no non-empty coalition C⊆VC\subseteq VC⊆V can jointly switch to other unit-ranking strategies so that every member of CCC strictly gains.

The circulation network G′G'G′ adds an auxiliary node sss with edges (v,s)(v,s)(v,s) of unbounded capacity and (s,v)(s,v)(s,v) of capacity bvb_vbv​ for every vvv. An optimal circulation f∗f^*f∗ of G′G'G′ maximizes ∑e∈E′fe∗\sum_{e\in E'}f^*_e∑e∈E′​fe∗​. A decomposition C(f∗)={C1,…,Ck}\mathcal C(f^*)=\{C_1,\dots,C_k\}C(f∗)={C1​,…,Ck​} of f∗f^*f∗ into cycles of unit flow is a list of simple directed cycles of G′G'G′ that uses each edge exactly as often as f∗f^*f∗ has units on it. The parameter of this mission is

d=min⁡f∗, C(f∗) max⁡Ci∈C(f∗)∣Ci∣,d=\min_{f^*,\ \mathcal C(f^*)}\ \max_{C_i\in\mathcal C(f^*)}|C_i| ,d=f∗, C(f∗)min​ Ci​∈C(f∗)max​∣Ci​∣,

the smallest possible size of the longest cycle, over all decompositions of all optimal circulations; sizes count auxiliary edges.

Formalization targets

Goal: Theorem 16 (p. 30)

In unit-ranking games, the price of anarchy for strong equilibria in terms of Flow is at most ddd: for every strong equilibrium a\mathbf aa and every unit-ranking profile a′\mathbf a'a′,

Flow(a′)≤d⋅Flow(a).\mathrm{Flow}(\mathbf a')\le d\cdot\mathrm{Flow}(\mathbf a).Flow(a′)≤d⋅Flow(a).

The statement fixes no constant beyond the structural parameter ddd and holds for all capacities and supplies.

Milestones (proof of Theorem 16, p. 30)

  1. An optimal circulation yields the optimal total flow, and
Flow(a∗)=∑Ci∈C(f∗)∣Ci∣−2∑vbv≤∑Ci∈C(f∗)d.\mathrm{Flow}(\mathbf a^*)=\sum_{C_i\in\mathcal C(f^*)}|C_i|-2\sum_{v}b_v\le\sum_{C_i\in\mathcal C(f^*)}d .Flow(a∗)=Ci​∈C(f∗)∑​∣Ci​∣−2v∑​bv​≤Ci​∈C(f∗)∑​d.
  1. In a strong equilibrium every simple cycle of GGG contains an edge with f^e=ce\hat f_e=c_ef^​e​=ce​.
  2. Flow(a)\mathrm{Flow}(\mathbf a)Flow(a) is at least the number of cycles of C(f∗)\mathcal C(f^*)C(f∗) that avoid sss.

Companions

  • Theorem 16 for games without fixed supplies (b≡0b\equiv0b≡0), the setting of Propositions 15 and 17.
  • Proposition 17 (p. 30). For every d≥2d\ge2d≥2 there is a unit-ranking game with parameter ddd and a strong equilibrium a\mathbf aa with Flow(a)>0\mathrm{Flow}(\mathbf a)>0Flow(a)>0 and (d−1) Flow(a)≤Flow(a∗)(d-1)\,\mathrm{Flow}(\mathbf a)\le\mathrm{Flow}(\mathbf a^*)(d−1)Flow(a)≤Flow(a∗).

Significance

The bound identifies the length of the circulating cycles as the quantity that governs the efficiency of coalition-stable payment behaviour. In networks whose optimal circulation decomposes into short cycles, such as bilateral or triangular netting of liabilities, every strong equilibrium clears at least a 1/d1/d1/d fraction of the optimal total payments; Proposition 17 shows that long cycles genuinely cost efficiency, so the bound is tight up to one. For pure Nash equilibria no such bound exists (Proposition 15, the price of anarchy is unbounded), so the result separates coalitional from unilateral stability.

The results are proved on paper; none of them is machine-checked. A formalization adds a precise account of the model (clearing state as a supremum of feasible flows, unit-ranking strategies as functions on N0\mathbb N_0N0​, cycle decompositions of the circulation network) and checks a proof whose last step, as printed, needs repair. The printed last display, Flow(a)≥∑Ci∈C(f∗)1\mathrm{Flow}(\mathbf a)\ge\sum_{C_i\in\mathcal C(f^*)}1Flow(a)≥∑Ci​∈C(f∗)​1, does not hold for cycles passing through the auxiliary node sss: with a single node vvv, bv=1b_v=1bv​=1 and no outgoing edges, C(f∗)={(s,v,s)}\mathcal C(f^*)=\{(s,v,s)\}C(f∗)={(s,v,s)} but Flow(a)=0\mathrm{Flow}(\mathbf a)=0Flow(a)=0. The theorem itself is not contradicted by this example, and the printed argument is complete for games without fixed supplies. The cycles through the auxiliary node need a separate count, which is part of the work this mission asks for.

Difficulty

The upper bound compares an arbitrary strong equilibrium with an optimum that may look nothing like it. The obvious approach, counting the units of each optimal cycle that also carry equilibrium flow, fails: the clearing state is a fixed point of all strategies at once, so whether a unit reaches an edge depends on decisions all around the network, and the equilibrium may route its flow along entirely different cycles. A single player cannot complete a cycle on its own, which is why the Nash price of anarchy is unbounded; any argument has to use coalitional deviations, and a deviation changes the clearing state globally, so its effect on each member's utility must be controlled through the fixed point.

The second difficulty is the auxiliary node. A cycle of the optimal decomposition that passes through sss contains a node that is not a player, so no coalition of players can claim it, and the unit of flow it represents may sit on an auxiliary edge that Flow\mathrm{Flow}Flow does not count. These cycles are exactly where the printed argument stops short.

Formalization scope

Supplies, capacities, strategies and flows are natural numbers, as the paper prescribes for unit-ranking games. The graph is a finite type of nodes VVV and a finite type of edges EEE with tail and head maps, so parallel edges and loops are allowed. The clearing state is the coordinatewise sSup of the feasible flows. Coalitions are non-empty, and deviations range over unit-ranking profiles. Optimal circulations are optimal among integral circulations. Cycles of G′G'G′ are lists of edges with pairwise distinct start nodes, and decompositions are lists of cycles counted with multiplicity. Nodes of G′G'G′ are Option V, with none the node sss.

The price of anarchy is stated multiplicatively, Flow(a′)≤d⋅Flow(a)\mathrm{Flow}(\mathbf a')\le d\cdot\mathrm{Flow}(\mathbf a)Flow(a′)≤d⋅Flow(a), with no division, so a zero-flow equilibrium cannot satisfy the goal vacuously through a junk quotient. The parameter ddd enters as a hypothesis, "some decomposition of some optimal circulation has all cycles of size at most ddd", which is equivalent to the bound for the min-max ddd and avoids an infimum that would be 000 on an empty set. In Proposition 17 the strong equilibrium is required to have positive flow, since otherwise the lower bound would hold trivially.

Not formalized: the complexity results of the paper, the bounds for other quality measures (Proposition 18) and for Nash equilibria (Proposition 15). A complete development needs the integral version of the lattice theorem for feasible flows (Theorem 2), the existence of a Flow-optimal profile from the proof of Theorem 9, and integral cycle decomposition of circulations; the last two are reusable beyond this mission. Contributions are welcome on each milestone, on a separate count for cycles through sss, and on the explicit construction of Proposition 17.

Selected references

  • N. Bertschinger, M. Hoefer, D. Schmand, Flow Allocation Games, Mathematics of Operations Research, 2025; preprint arXiv:1908.01714v3, 2023. https://arxiv.org/abs/1908.01714
  • L. Eisenberg, T. H. Noe, Systemic Risk in Financial Systems, Management Science 47(2), 236–249, 2001. https://doi.org/10.1287/mnsc.47.2.236.9835
7 thms1 active userReviewed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Flow Allocation Games 1: Every Unit-Ranking Game Has a Strong Equilibrium That Maximizes the Total FlowResearch Paper

Motivation

Financial firms owe each other money. When some firms cannot meet their obligations, the payments that actually clear in the network are a fixed point: what a firm can pay depends on what it receives, which depends on what others can pay. Eisenberg and Noe (Management Science, 2001) introduced this clearing model under a fixed pro-rata payment rule. Later work asked what happens when firms choose how to pay their creditors, which turns the clearing problem into a game.

Bertschinger, Hoefer and Schmand (arXiv:1908.01714v3; Mathematics of Operations Research, 2025) study this game in an abstract form, the flow allocation game. Each node of a directed network receives a fixed external supply plus whatever flows in, and decides how to split its total supply among its outgoing edges, subject to edge capacities. Each node wants to maximize its own total outflow (its payments, which in the financial reading is what keeps it solvent). The paper's first main result is that, when strategies rank single units of flow, there is always a strong equilibrium, stable against every coalition, which is at the same time socially optimal for the total flow.

Timeline:

  • 2001: Eisenberg and Noe, clearing payments under pro-rata rules, existence of a greatest clearing vector.
  • 2018: Csóka and Herings (Management Science): decentralized clearing with integral monotone allocation rules; the feasible flows form a complete lattice (restated for all monotone profiles as Theorem 2 of the present paper).
  • 2019–2025: Bertschinger, Hoefer and Schmand, strategic allocation; existence of optimal strong equilibria for unit-ranking strategies (Theorem 9), strong price of anarchy bounded by the min-max cycle length (Theorem 16), hardness results for other welfare functions and for edge-ranking strategies.

Setting

A flow allocation game Γ=(G,(bv)v∈V,(ce)e∈E)\Gamma = (G, (b_v)_{v\in V}, (c_e)_{e\in E})Γ=(G,(bv​)v∈V​,(ce​)e∈E​) consists of a finite directed multigraph G=(V,E)G = (V, E)G=(V,E), a fixed supply bv∈N0b_v \in \mathbb N_0bv​∈N0​ at each node and a capacity ce∈N0c_e \in \mathbb N_0ce​∈N0​ on each edge. E+(v)E^+(v)E+(v) and E−(v)E^-(v)E−(v) are the outgoing and incoming edges of vvv, and cv+=∑e∈E+(v)cec^+_v = \sum_{e\in E^+(v)} c_ecv+​=∑e∈E+(v)​ce​.

Every node is a player. A strategy profile a=(ae)e∈E\mathbf a = (a_e)_{e\in E}a=(ae​)e∈E​ assigns to each edge an allocation function ae:N0→N0a_e : \mathbb N_0 \to \mathbb N_0ae​:N0​→N0​: when the tail of eee has total supply yyy, it forwards ae(y)a_e(y)ae​(y) units on eee. The profile is unit-ranking if for all yyy, eee, vvv: ae(y)≤cea_e(y) \le c_eae​(y)≤ce​ (1); ∑e∈E+(v)ae(y)≤y\sum_{e\in E^+(v)} a_e(y) \le y∑e∈E+(v)​ae​(y)≤y (2); ∑e∈E+(v)ae(y)=min⁡{cv+,y}\sum_{e\in E^+(v)} a_e(y) = \min\{c^+_v, y\}∑e∈E+(v)​ae​(y)=min{cv+​,y} (no fraud, (3)); and each aea_eae​ is non-decreasing (5). Equivalently, every node ranks the single units of its outgoing capacity.

A flow f∈N0E\mathbf f \in \mathbb N_0^Ef∈N0E​ gives node vvv the total supply fv=bv+∑e∈E−(v)fef_v = b_v + \sum_{e\in E^-(v)} f_efv​=bv​+∑e∈E−(v)​fe​, and is feasible for a\mathbf aa if f(v,w)=a(v,w)(fv)f_{(v,w)} = a_{(v,w)}(f_v)f(v,w)​=a(v,w)​(fv​) on every edge (4). The clearing state f^\hat{\mathbf f}f^ of a\mathbf aa is the coordinatewise supremum of the feasible flows. Player vvv's utility is uv(a)=∑e∈E+(v)f^eu_v(\mathbf a) = \sum_{e\in E^+(v)} \hat f_euv​(a)=∑e∈E+(v)​f^​e​, and the total flow is Flow(a)=∑e∈Ef^e\mathrm{Flow}(\mathbf a) = \sum_{e\in E} \hat f_eFlow(a)=∑e∈E​f^​e​.

A unit-ranking profile a\mathbf aa is a strong equilibrium if no non-empty coalition C⊆VC \subseteq VC⊆V has a joint deviation aC′\mathbf a'_CaC′​ such that (aC′,a−C)(\mathbf a'_C, \mathbf a_{-C})(aC′​,a−C​) is unit-ranking and uv(aC′,a−C)>uv(a)u_v(\mathbf a'_C, \mathbf a_{-C}) > u_v(\mathbf a)uv​(aC′​,a−C​)>uv​(a) for all v∈Cv \in Cv∈C.

The circulation network G′G'G′ adds a node sss, an uncapacitated edge (v,s)(v, s)(v,s) and an edge (s,v)(s, v)(s,v) of capacity bvb_vbv​ for every vvv. An optimal circulation f∗f^*f∗ maximizes the total flow over all edges of G′G'G′.

Formalization targets

Goal: Theorem 9 (first sentence)

∃ a:a is a strong equilibrium  and  Flow(a′)≤Flow(a) for every unit-ranking a′.\exists\, \mathbf a:\quad \mathbf a \text{ is a strong equilibrium} \ \text{ and } \ \mathrm{Flow}(\mathbf a') \le \mathrm{Flow}(\mathbf a) \text{ for every unit-ranking } \mathbf a'.∃a:a is a strong equilibrium  and  Flow(a′)≤Flow(a) for every unit-ranking a′.

Milestones (in the order of the proof)

  1. Theorem 2 (p. 12, integral version p. 13): for a monotone profile the feasible flows form a non-empty complete lattice; the clearing state is its greatest element.
  2. Proposition 5 (p. 17): a feasible flow, with the non-forwarded flow max⁡{0,fv−cv+}\max\{0, f_v - c^+_v\}max{0,fv​−cv+​} sent to sss, is a circulation of G′G'G′, and ∑vmax⁡{0,fv−cv+}=∑vbv\sum_v \max\{0, f_v - c^+_v\} = \sum_v b_v∑v​max{0,fv​−cv+​}=∑v​bv​.
  3. Proof of Theorem 9, p. 23, first display: an optimal circulation saturates every (s,v)(s, v)(s,v) and
∑e∈E′fe∗=2∑vbv+Flow(f∗)≥2∑vbv+Flow(a).\sum_{e\in E'} f^*_e = 2\sum_v b_v + \mathrm{Flow}(f^*) \ge 2\sum_v b_v + \mathrm{Flow}(\mathbf a).e∈E′∑​fe∗​=2v∑​bv​+Flow(f∗)≥2v∑​bv​+Flow(a).
  1. Proof of Theorem 9, p. 23: with thresholds τe=fe∗\tau_e = f^*_eτe​=fe∗​ and arbitrary rankings, the threshold-ranking profile a∗\mathbf a^*a∗ is unit-ranking and its clearing state is f∗f^*f∗.
  2. Proof of Theorem 9, pp. 23–24: a profitable coalitional deviation from a unit-ranking profile produces a cycle of GGG on which the new clearing state carries strictly more flow.

Companion: Corollary 12

For every flow-monotone QQQ (if f^>f^′\hat{\mathbf f} > \hat{\mathbf f}'f^>f^′ then Q(a)≥Q(a′)Q(\mathbf a) \ge Q(\mathbf a')Q(a)≥Q(a′)) there is a strong equilibrium maximizing QQQ over all unit-ranking profiles.

Significance

Strong equilibria rarely exist in network games, and when they do they are usually not efficient. Theorem 9 gives both at once: every unit-ranking game has a strong equilibrium, and one of them maximizes the total flow, so the price of stability for Flow\mathrm{Flow}Flow is 111. Corollary 12 extends this to every flow-monotone welfare function, including egalitarian welfare, Nash social welfare and the number of solvent firms. In the financial reading, a coalition of firms cannot jointly reorder its payments to make every member better off, and the stable payment pattern can be chosen to clear the largest possible volume of debt.

The results are proved in the paper and, to our knowledge, have no machine-checked proof. Formalizing them yields a reusable Lean development of clearing states (the Knaster–Tarski structure of feasible flows), the circulation representation of feasible flows, and integral maximum circulations with a cycle-augmentation argument. The second mission of this series (strong price of anarchy, Theorem 16) builds on the same model.

Difficulty

The obvious argument fails at the deviation step. After a coalition deviates, the clearing state of the new profile is an implicit object: the greatest fixed point of a map that mixes the deviators' new strategies with everyone else's old ones. Nothing ties it pointwise to the optimal circulation, and comparing utilities alone gives no contradiction, because a deviator's gain can be paid for by flow that appears elsewhere in the network. The increase of flow has to be traced through deviators and non-deviators alike, and the two kinds of node obey different constraints.

A second difficulty is that the threshold profile built from an optimal circulation f∗f^*f∗ has clearing state exactly f∗f^*f∗. The clearing state is a supremum over all feasible flows, so it is not enough that f∗f^*f∗ is feasible. The claim depends on optimality: for a circulation that is not optimal it is false, as a two-node cycle carrying one unit on edges of capacity two already shows.

Formalization scope

All data are natural numbers: supplies, capacities, strategies ae:N→Na_e : \mathbb N \to \mathbb Nae​:N→N and flows, as the paper prescribes for unit-ranking games (p. 13). The graph is a finite type of edges with tail and head maps, so multi-edges and self-loops are allowed. A profile is one function on edges. The clearing state is the coordinatewise sSup in N\mathbb NN; the definition does not assume that the supremum is a feasible flow, which is milestone 1. Optimal circulations are optimal among integral circulations, which the paper justifies by integrality of capacities (p. 23). Natural-number subtraction is used only where it is the page's max⁡{0,⋅}\max\{0,\cdot\}max{0,⋅}.

Coalitions are non-empty. With C=∅C = \emptysetC=∅ the condition "every member strictly gains" holds vacuously and no profile would be a strong equilibrium; the paper reads it the same way (Proposition 4, Proposition 17). Deviations must again be unit-ranking profiles; the broader deviations of Remark 10 are not formalized. The maximization in the goal ranges over all unit-ranking profiles, not over threshold-ranking ones. A goal maximizing only over threshold profiles, or one that drops the optimality conjunct, is a strictly weaker theorem and is ruled out.

Out of scope: the second sentence of Theorem 9 (polynomial-time computation and polynomial-space representation) and the polynomial-space sentence of Corollary 12. Both need a model of computation. The threshold representation behind them is milestone 4.

A complete development needs: Knaster–Tarski on a finite product of intervals (Mathlib's OrderHom fixed-point lattice), flow conservation bookkeeping on finite multigraphs, existence of integral optimal circulations, and extraction of a cycle from an infinite backward walk in a finite graph. The last two are reusable beyond this mission. Proofs of any milestone, and sorry-free lemmas about clearing states, are welcome.

Selected references

  • N. Bertschinger, M. Hoefer, D. Schmand, Flow Allocation Games, Mathematics of Operations Research, 2025. Preprint arXiv:1908.01714v3, 2023. https://arxiv.org/abs/1908.01714v3
  • L. Eisenberg, T. H. Noe, Systemic Risk in Financial Systems, Management Science 47(2), 236–249, 2001. https://doi.org/10.1287/mnsc.47.2.236.9835
  • P. Csóka, P. J.-J. Herings, Decentralized Clearing in Financial Networks, Management Science 64(10), 4681–4699, 2018. https://doi.org/10.1287/mnsc.2017.2847
  • A. Tarski, A lattice-theoretical fixpoint theorem and its applications, Pacific Journal of Mathematics 5(2), 285–309, 1955. https://doi.org/10.2140/pjm.1955.5.285
8 thms1 active userReviewed
Control TheoryDynamical SystemsLinear algebra·Captain: mikedeng1

Sub/Super-Stochastic Matrix with Applications to Bipartite Tracking Control over Signed Networks 3: ψ < 1/(τd_M), Structural Balance and Leader Reachability Give Asynchronous Bipartite TrackingResearch Paper

Motivation

Networks of agents that interact both cooperatively and competitively are modelled by signed graphs: a positive edge weight means that one agent moves towards another, a negative weight means that it moves towards the other's opposite. Since Altafini's work on consensus over antagonistic networks (IEEE TAC 2013), the standard target on such networks has been bipartite consensus or bipartite tracking: the agents split into two camps that converge to values of equal size and opposite sign. With a leader, the camp containing the leader tracks the leader's state and the other camp tracks its negative.

Most analyses assume that all agents update at the same instants. In practice agents sample and communicate on their own clocks. Shi, Zheng, Shao and Cheng (arXiv:2004.01867v2, SIAM J. Control Optim. 2021) handle this asynchronous setting with a matrix tool: products of sub-stochastic matrices (nonnegative, row sums at most one) whose row-sum deficits propagate along the communication graph. This mission formalizes their first application, bipartite tracking of first-order agents with a static leader (§3).

Setting

There is one leader v0v_0v0​ and nnn followers v1,…,vnv_1,\dots,v_nv1​,…,vn​. Follower weights form a matrix A=[aij]∈Rn×n\mathcal A=[a_{ij}]\in\mathbb R^{n\times n}A=[aij​]∈Rn×n: the edge (vj,vi)(v_j,v_i)(vj​,vi​) exists iff aij≠0a_{ij}\neq 0aij​=0, cooperative if aij>0a_{ij}>0aij​>0, competitive if aij<0a_{ij}<0aij​<0. The number ai0a_{i0}ai0​ is the weight of the leader edge (v0,vi)(v_0,v_i)(v0​,vi​), which exists iff ai0≠0a_{i0}\ne 0ai0​=0. The digraph G~\tilde{\mathcal G}G~​ consists of the followers' digraph, the leader and the leader edges.

  • C1 (structural balance). The agents split as V1∪V2\mathcal V_1\cup\mathcal V_2V1​∪V2​ with v0∈V1v_0\in\mathcal V_1v0​∈V1​, every weight inside a set is ≥0\ge 0≥0 and every weight between the sets is ≤0\le 0≤0.
  • C2 (leader reachability). Every follower is reached from v0v_0v0​ by a directed path in G~\tilde{\mathcal G}G~​.

Time is discrete with step size τ>0\tau>0τ>0. Follower viv_ivi​ communicates only at its own instants s0iτ<s1iτ<⋯s^i_0\tau<s^i_1\tau<\cdotss0i​τ<s1i​τ<⋯ with s0i=0s^i_0=0s0i​=0 and

sk+1i−ski≤h(2.10)s^i_{k+1}-s^i_k\le h\qquad(2.10)sk+1i​−ski​≤h(2.10)

for a constant h∈Z+h\in\mathbb Z_+h∈Z+​. Positions xi(k)∈Rpx_i(k)\in\mathbb R^pxi​(k)∈Rp evolve by x0(k+1)=x0(k)x_0(k+1)=x_0(k)x0​(k+1)=x0​(k) and xi(k+1)=xi(k)+τui(k)x_i(k+1)=x_i(k)+\tau u_i(k)xi​(k+1)=xi​(k)+τui​(k), with the asynchronous protocol

ui(k)=ψ∑vj∈Ni∣aij∣[sgn⁡(aij)xj(k)−xi(k)]+ψ∣ai0∣[sgn⁡(ai0)x0(k)−xi(k)]u_i(k)=\psi\sum_{v_j\in\mathcal N_i}|a_{ij}|\big[\operatorname{sgn}(a_{ij})x_j(k)-x_i(k)\big]+\psi|a_{i0}|\big[\operatorname{sgn}(a_{i0})x_0(k)-x_i(k)\big]ui​(k)=ψvj​∈Ni​∑​∣aij​∣[sgn(aij​)xj​(k)−xi​(k)]+ψ∣ai0​∣[sgn(ai0​)x0​(k)−xi​(k)]

at the instants of viv_ivi​, and ui(k)=0u_i(k)=0ui​(k)=0 otherwise. Here ψ>0\psi>0ψ>0 is a gain. Bipartite tracking (Definition 3.1) means ∥xi(k)−x0(k)∥→0\|x_i(k)-x_0(k)\|\to 0∥xi​(k)−x0​(k)∥→0 for vi∈V1v_i\in\mathcal V_1vi​∈V1​ and ∥xi(k)+x0(k)∥→0\|x_i(k)+x_0(k)\|\to 0∥xi​(k)+x0​(k)∥→0 for vi∈V2v_i\in\mathcal V_2vi​∈V2​. With dM=max⁡i(∑vj∈Ni∣aij∣+∣ai0∣)d_M=\max_i\big(\sum_{v_j\in\mathcal N_i}|a_{ij}|+|a_{i0}|\big)dM​=maxi​(∑vj​∈Ni​​∣aij​∣+∣ai0​∣), the gain condition is

ψ<1τdM.(3.7)\psi<\frac{1}{\tau d_M}.\qquad(3.7)ψ<τdM​1​.(3.7)

In the error coordinates ei=xi−x0e_i=x_i-x_0ei​=xi​−x0​ on V1\mathcal V_1V1​ and ei=−xi−x0e_i=-x_i-x_0ei​=−xi​−x0​ on V2\mathcal V_2V2​, the closed loop is e(k+1)=(M(k)⊗Ip)e(k)e(k+1)=(M(k)\otimes I_p)e(k)e(k+1)=(M(k)⊗Ip​)e(k) with M(k)=In−τψD(k)−τψB(k)+τψ∣A(k)∣M(k)=I_n-\tau\psi\mathcal D(k)-\tau\psi\mathcal B(k)+\tau\psi|\mathcal A(k)|M(k)=In​−τψD(k)−τψB(k)+τψ∣A(k)∣, where only the rows of followers active at time kτk\taukτ differ from the identity.

Formalization targets

Goal: Theorem 3.3, sufficiency

ψ<1τdM,  C1,  C2 ⟹ lim⁡k→∞∥xi(k)−x0(k)∥=0 (vi∈V1),lim⁡k→∞∥xi(k)+x0(k)∥=0 (vi∈V2),\psi<\frac1{\tau d_M},\ \ \mathrm{C1},\ \ \mathrm{C2}\ \Longrightarrow\ \lim_{k\to\infty}\|x_i(k)-x_0(k)\|=0\ (v_i\in\mathcal V_1),\quad \lim_{k\to\infty}\|x_i(k)+x_0(k)\|=0\ (v_i\in\mathcal V_2),ψ<τdM​1​,  C1,  C2 ⟹ k→∞lim​∥xi​(k)−x0​(k)∥=0 (vi​∈V1​),k→∞lim​∥xi​(k)+x0​(k)∥=0 (vi​∈V2​),

for every choice of instants satisfying (2.10) and every initial state.

Milestones

  1. Theorem 2.4 1): a product Fq⋯F1F_q\cdots F_1Fq​⋯F1​ of sub-stochastic matrices is sub-stochastic.
  2. Theorem 2.4 2): with positive diagonals, if every row i2i_2i2​ is fed through [Fs2]i2i1>0[F_{s_2}]_{i_2i_1}>0[Fs2​​]i2​i1​​>0 by a row i1i_1i1​ with Λi1[Fs1]<1\Lambda_{i_1}[F_{s_1}]<1Λi1​​[Fs1​​]<1, s1<s2s_1<s_2s1​<s2​, then ∥∏s=1qFs∥∞<1\|\prod_{s=1}^qF_s\|_\infty<1∥∏s=1q​Fs​∥∞​<1 and ρ(∏s=1qFs)<1\rho(\prod_{s=1}^qF_s)<1ρ(∏s=1q​Fs​)<1.
  3. The matrices M(k)M(k)M(k) (p. 15): under (3.7) they are sub-stochastic with positive diagonals, and Λi[M(k)]<1\Lambda_i[M(k)]<1Λi​[M(k)]<1 exactly when viv_ivi​ hears the leader at kτk\taukτ.
  4. Error system (3.6): under C1, ei(k+1)=∑j[M(k)]ijej(k)e_i(k+1)=\sum_j[M(k)]_{ij}e_j(k)ei​(k+1)=∑j​[M(k)]ij​ej​(k).
  5. Lemma 3.2: under (3.7), C1 and C2, ∥∏s=kk+Ph−1M(s)∥∞<1\big\|\prod_{s=k}^{k+Ph-1}M(s)\big\|_\infty<1​∏s=kk+Ph−1​M(s)​∞​<1 for every kkk, where P=max⁡id(v0,vi)P=\max_i d(v_0,v_i)P=maxi​d(v0​,vi​) is the largest directed distance from the leader.

Significance

The theorem says that asynchrony costs nothing qualitatively: as long as every follower communicates at least once every hhh steps and the gain respects (3.7), the network reaches bipartite tracking under the same topological conditions C1 and C2 as in the synchronous case. No common clock, dwell-time condition or joint connectivity of the switching graphs is required. The same product argument is reused in the rest of the paper for second-order and general linear agents, delays and switching topologies, so the milestones here are the base case of that series.

The result is proved in the paper; it has not been formalized. Formalizing it produces a checked theory of products of sub-stochastic matrices with row-sum deficits (Theorem 2.4), which applies to positive switched systems in general, and a reusable encoding of signed digraphs with a leader, structural balance and asynchronous protocols.

Difficulty

Each single matrix M(k)M(k)M(k) is only marginally stable: its rows of followers that do not hear the leader at time kτk\taukτ sum to exactly one, so no single step contracts, and the spectral radius of an individual M(k)M(k)M(k) may equal one. Contraction appears only in products, and only once a deficit created at a leader edge has had time to travel along the paths of C2, one edge per window of hhh steps; this requires that deficits never disappear again, which is where positive diagonals (from (3.7)) enter. The passage from "every window product has ∥⋅∥∞<1\|\cdot\|_\infty<1∥⋅∥∞​<1" to convergence also needs a uniform bound below one over all windows; the paper's (3.14) uses it without comment. The bound holds because M(k)M(k)M(k) depends on kkk only through the set of active followers, so the window products range over a finite set.

Formalization scope

Followers are Fin n (0-based) and the leader is not an index; aija_{ij}aij​ is a i j and ai0a_{i0}ai0​ is b i. Positions lie in EuclideanSpace ℝ (Fin p); the paper's norm is unspecified and all norms on Rp\mathbb R^pRp give the same limits. Eigenvalues are complex: ρ(F)<1\rho(F)<1ρ(F)<1 means every element of spectrum ℂ of the complexified matrix has modulus <1<1<1. ∥F∥∞\|F\|_\infty∥F∥∞​ is the largest absolute row sum. Products multiply later factors on the left. sgn⁡\operatorname{sgn}sgn is Real.sign. The maxima dMd_MdM​ and PPP are given as values with IsGreatest hypotheses over exactly the printed sets, and (3.7) is kept as printed. C1 is stated for the partition V1={v0}∪V1\mathcal V_1=\{v_0\}\cup V_1V1​={v0​}∪V1​, V2=\mathcal V_2=V2​= the remaining followers; fixing the leader in V1\mathcal V_1V1​ is the paper's "with no loss of generality" convention. Definition 3.1 is stated for that same partition.

Only the "if" half of Theorem 3.3 is a target. Definition 3.1 presupposes the partition of C1, so necessity of C1 has no formal meaning, and the printed necessity argument is an informal case discussion. Theorem 2.4 2) is stated with one (i1,s1,s2)(i_1,s_1,s_2)(i1​,s1​,s2​) per row i2i_2i2​, as its proof and the example on p. 8 use it; this is implied by the literal reading.

Three formalizations would trivialize the goal and are ruled out: a protocol in which every follower updates at every step (the synchronous special case, which drops the asynchronous instants); dropping the sign conditions of C1, or leaving the leader's side free, under which the followers of V2\mathcal V_2V2​ need not approach −x0-x_0−x0​; and a goal stated about the error system (3.6) instead of the agents' positions xix_ixi​.

The development needs finite matrix products, the ∞-norm bound on eigenvalues (Gershgorin), and elementary walk reachability in digraphs. All of these exist in Mathlib in some form. Contributions are welcome on every milestone. The product theorem 2.4 does not depend on the network model and is reusable for positive switched systems.

Selected references

  • L. Shi, W. X. Zheng, J. Shao, Y. Cheng, Sub/super-stochastic matrix with applications to bipartite tracking control over signed networks, arXiv:2004.01867v2, 2020; SIAM J. Control Optim. 59 (2021). https://arxiv.org/abs/2004.01867, https://doi.org/10.1137/19M1239982
  • C. Altafini, Consensus problems on networks with antagonistic interactions, IEEE Trans. Automat. Control 58(4), 2013. https://doi.org/10.1109/TAC.2012.2224251
9 thms1 active userReviewed
Combinatorics·Captain: mikedeng1

Stability Results on the Circumference of a Graph 2: A 2-Connected G with δ ≥ k, Circumference 10 ≤ c < n and e(G) > max{f(n,k+1,c), f(n,⌊c/2⌋−1,c)} Lies in W_{n,k,c}, W_{n,⌊c/2⌋,c}, X∪Y or Z_{n,k,c}Research Paper

Motivation

How many edges can a graph have if it contains no long cycle? This Turán-type question for the circumference goes back to Erdős and Gallai (1959), who showed that an nnn-vertex graph with circumference ccc has at most c(n−1)/2c(n-1)/2c(n−1)/2 edges. For 2-connected graphs the answer is exact and the extremal graphs are known, so the natural next question is stability: what does a graph look like when its edge count is just below the extremal value? Such statements are the standard input for exact results via the stability method, and for counting and spectral variants of the original problem.

Timeline.

  • 1959. Erdős and Gallai prove e(G)≤c(G)(n−1)/2e(G)\le c(G)(n-1)/2e(G)≤c(G)(n−1)/2.
  • 1976. Woodall asks for a bound for 2-connected graphs that also takes the minimum degree kkk into account: e(G)≤max⁡{f(n,k,c),f(n,⌊c/2⌋,c)}e(G)\le\max\{f(n,k,c),f(n,\lfloor c/2\rfloor,c)\}e(G)≤max{f(n,k,c),f(n,⌊c/2⌋,c)} when c(G)=c≤n−1c(G)=c\le n-1c(G)=c≤n−1 and δ(G)≥k\delta(G)\ge kδ(G)≥k.
  • 1977. Kopylov proves the case without minimum degree, the bound max⁡{f(n,2,c),f(n,⌊c/2⌋,c)}\max\{f(n,2,c),f(n,\lfloor c/2\rfloor,c)\}max{f(n,2,c),f(n,⌊c/2⌋,c)} for 2-connected graphs. His proof can be modified to settle Woodall's question.
  • 2016–2018. Füredi, Kostochka, Verstraëte and Luo prove the stability version of Kopylov's theorem for 10≤c≤n−110\le c\le n-110≤c≤n−1. Above max⁡{f(n,3,c),f(n,⌊c/2⌋−1,c)}\max\{f(n,3,c),f(n,\lfloor c/2\rfloor-1,c)\}max{f(n,3,c),f(n,⌊c/2⌋−1,c)} edges, GGG lies in Wn,2,cW_{n,2,c}Wn,2,c​ or Wn,⌊c/2⌋,cW_{n,\lfloor c/2\rfloor,c}Wn,⌊c/2⌋,c​, or, for odd ccc, in a member of two families Xn,c\mathcal X_{n,c}Xn,c​, Yn,c\mathcal Y_{n,c}Yn,c​.
  • 2016–2017. Li and Ning, and independently Füredi, Kostochka and Luo, prove the stability version of Erdős's minimum-degree theorem for non-Hamiltonian graphs.
  • 2017–2020. Ma and Ning prove a stability version of Woodall's bound for every minimum degree kkk (arXiv:1708.00704; Combinatorica 2020). It unifies both previous stability results.

Setting

All graphs are finite and simple, with vertex set {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1}. The circumference c(G)c(G)c(G) is the length (number of edges) of a longest cycle. GGG is 2-connected if it has at least three vertices and stays connected after deleting any one vertex. δ(G)\delta(G)δ(G) is the minimum degree and e(G)e(G)e(G) the number of edges.

For k≤⌊c/2⌋k\le\lfloor c/2\rfloork≤⌊c/2⌋, the graph Wn,k,cW_{n,k,c}Wn,k,c​ is a clique Kc−k+1K_{c-k+1}Kc−k+1​ together with n−(c−k+1)n-(c-k+1)n−(c−k+1) further vertices, each joined to the same kkk vertices of the clique. It has nnn vertices, minimum degree kkk, circumference ccc, and

f(n,k,c)=(c−k+12)+k (n−c+k−1)f(n,k,c)=\binom{c-k+1}{2}+k\,(n-c+k-1)f(n,k,c)=(2c−k+1​)+k(n−c+k−1)

edges. The graph Zn,k,cZ_{n,k,c}Zn,k,c​ is the union of a clique Kc−k+1K_{c-k+1}Kc−k+1​ and n−(c−k+1)k−1\frac{n-(c-k+1)}{k-1}k−1n−(c−k+1)​ cliques Kk+1K_{k+1}Kk+1​, any two of the cliques sharing the same two vertices. The families Xn,c\mathcal X_{n,c}Xn,c​ and Yn,c\mathcal Y_{n,c}Yn,c​ consist of graphs on A∪B∪XA\cup B\cup XA∪B∪X (resp. A∪B∪YA\cup B\cup YA∪B∪Y) with AAA a clique of size ⌊c/2⌋\lfloor c/2\rfloor⌊c/2⌋, BBB stable and AAA complete to BBB. In Xn,c\mathcal X_{n,c}Xn,c​ every vertex of XXX has exactly two neighbours, the same a∈Aa\in Aa∈A and b∈Bb\in Bb∈B. In Yn,c\mathcal Y_{n,c}Yn,c​, YYY carries a star forest whose stars all attach to the same two vertices a,b∈Aa,b\in Aa,b∈A in a prescribed way.

The proof works with the CCC-closure G‾\overline GG of a cycle CCC. It is obtained by replacing G[C]G[C]G[C] by its (c+1)(c+1)(c+1)-closure, which repeatedly joins non-adjacent pairs of G[C]G[C]G[C] whose degree sum is at least c+1c+1c+1. A cycle is locally maximal if every longer cycle uses at least three edges between V(C)V(C)V(C) and the rest of the graph.

Formalization targets

Goal: Theorem 1.7

Let k≥2k\ge2k≥2 and let GGG be 2-connected on nnn vertices with δ(G)≥k\delta(G)\ge kδ(G)≥k and circumference ccc, 10≤c≤n−110\le c\le n-110≤c≤n−1. If

e(G)>max⁡{f(n,k+1,c), f(n,⌊c/2⌋−1,c)},e(G)>\max\{f(n,k+1,c),\ f(n,\lfloor c/2\rfloor-1,c)\},e(G)>max{f(n,k+1,c), f(n,⌊c/2⌋−1,c)},

then G⊆Wn,k,cG\subseteq W_{n,k,c}G⊆Wn,k,c​, or G⊆Wn,⌊c/2⌋,cG\subseteq W_{n,\lfloor c/2\rfloor,c}G⊆Wn,⌊c/2⌋,c​, or (k=2k=2k=2, ccc odd, and GGG is a subgraph of a member of Xn,c∪Yn,c\mathcal X_{n,c}\cup\mathcal Y_{n,c}Xn,c​∪Yn,c​), or (k≥3k\ge3k≥3 and G⊆Zn,k,cG\subseteq Z_{n,k,c}G⊆Zn,k,c​).

Stronger: Theorem 1.9

For a longest cycle CCC, the same hypotheses give one of four alternatives. Either G‾≅Wn,k,c\overline G\cong W_{n,k,c}G≅Wn,k,c​; or G⊆Wn,⌊c/2⌋,cG\subseteq W_{n,\lfloor c/2\rfloor,c}G⊆Wn,⌊c/2⌋,c​; or the X∪Y\mathcal X\cup\mathcal YX∪Y alternative holds; or k≥3k\ge3k≥3 and G‾≅Zn,k,c\overline G\cong Z_{n,k,c}G≅Zn,k,c​.

Milestones

The milestones follow the paper's proof.

  • Theorem 1.9 splits into Theorem 1.12, for many edges off CCC, and Theorem 4.1, for many edges on CCC.
  • Theorem 4.1 combines Lemmas 2.7, 2.8 and 2.11 on closures with the structural Lemmas 4.2, 4.3 and 4.4.
  • Two arithmetic facts about fff and h(n,k)=(n−k2)+k(k−1)h(n,k)=\binom{n-k}{2}+k(k-1)h(n,k)=(2n−k​)+k(k−1), and Lemmas 2.5, 2.6 and 2.10, support these.

Significance

The theorem describes every 2-connected graph whose edge count comes within one step of Woodall's extremal bound in either parameter. At k=2k=2k=2 it recovers the theorem of Füredi, Kostochka, Luo and Verstraëte exactly. At c=n−1c=n-1c=n−1 it refines the Li–Ning / Füredi–Kostochka–Luo stability theorem for non-Hamiltonian 2-connected graphs. It also gives Corollary 1.8 for 3-connected graphs, where only the two WWW graphs remain. Theorem 1.9 goes further and identifies the extremal configurations exactly, up to the closure.

On the formal side, Mathlib has walks, cycles, Hamiltonian paths and cycles, clique numbers and graph embeddings. It has no circumference theory, no Bondy–Chvátal closure, no Hamiltonian-connectedness and none of the classical extremal results the proof cites (Dirac, Bondy, Chvátal, Erdős–Gallai, Fan). No result of this mission is known to have a machine-checked proof. The mission asks for the paper's proof, or any other proof, of the goal; for its refinement, Theorem 1.9; and for the closure and attachment lemmas on the way.

Difficulty

The obvious approach is to delete a low-degree vertex and induct, as in the classical proofs of Erdős–Gallai type bounds. It does not reach stability. Deleting a vertex can destroy 2-connectivity, and the extremal family changes with kkk: the threshold f(n,k+1,c)f(n,k+1,c)f(n,k+1,c) moves with the minimum degree, and the new graph Zn,k,cZ_{n,k,c}Zn,k,c​ appears only for k≥3k\ge3k≥3.

The edges inside V(C)V(C)V(C) are the hard part. A longest cycle gives no direct control over G[C]G[C]G[C]. The paper's route needs two non-trivial reductions:

  • a closure that keeps longest path lengths (Lemma 2.6), applied to a locally maximal cycle so that G‾[C]\overline G[C]G[C] becomes highly structured;
  • a degree-sequence dichotomy derived from Chvátal's Hamiltonicity theorem (Lemmas 2.10, 2.11).

After that, Lemma 4.2 is four pages of degree-sequence casework, and Lemma 4.4 is a ten-claim structural argument.

Formalization scope

Vertices are Fin n and graphs are Mathlib SimpleGraphs. Further conventions:

  • "G⊆HG\subseteq HG⊆H" is an embedding (⊑, a subgraph up to relabelling), and "G‾=W\overline G=WG=W" or "G∈{W,Z}G\in\{W,Z\}G∈{W,Z}" is a graph isomorphism.
  • "Circumference ccc" means a cycle of length ccc exists and no cycle is longer; "longest cycle" is defined by comparison with all cycles. Neither is a supremum, which would be 000 on acyclic graphs.
  • ⌊c/2⌋\lfloor c/2\rfloor⌊c/2⌋ is natural-number division. fff and hhh are natural-number expressions that are exact in every range used.
  • The kkk-closure is the least kkk-closed supergraph, which equals the page's recursive closure. A companion sanity file proves that it contains GGG, is kkk-closed, and lies below every kkk-closed supergraph.
  • Hamiltonian-connected quantifies over distinct pairs.
  • Lemma 2.5's bounds are stated in Z\mathbb ZZ.

Added hypothesis: k≥2k\ge2k≥2 in Theorems 1.7, 1.9, 4.1 and Lemma 4.4. As printed, the theorems claim every kkk, but they fail at k=1k=1k=1: a member of X18,11\mathcal X_{18,11}X18,11​ with ∣X∣=2|X|=2∣X∣=2 is 2-connected, has circumference 111111 and 69>6869>6869>68 edges, yet lies in neither W18,1,11W_{18,1,11}W18,1,11​ nor W18,5,11W_{18,5,11}W18,5,11​. Zn,k,cZ_{n,k,c}Zn,k,c​ also divides by k−1k-1k−1. Lemma 4.3 has no minimum-degree hypothesis and is stated for every kkk.

Trivializations ruled out.

  • The page's alternatives "if k=2k=2k=2 and ccc is odd, then …" and "if k≥3k\ge3k≥3, then …" are encoded as conjunctions. As implications they would hold vacuously.
  • The Zn,k,cZ_{n,k,c}Zn,k,c​ alternatives carry the divisibility (k−1)∣n−(c−k+1)(k-1)\mid n-(c-k+1)(k−1)∣n−(c−k+1), so no truncated last block is admitted.
  • Equalities of graphs are isomorphisms, never containments.
  • The closure cannot be replaced by an arbitrary closed supergraph such as the complete graph.

Infrastructure. A complete development needs:

  • closure and Pósa-rotation arguments;
  • Chvátal's degree-sequence theorem;
  • Dirac's and Bondy's circumference bounds;
  • Fan's long-path theorem;
  • the Fan–Lv–Wang edge-switching lemma;
  • Erdős–Gallai for paths.

All of these are reusable well beyond this mission, and contributions of any of them are welcome. Theorem 1.12 is also the goal of the companion mission on the stability of Bondy's theorem.

Selected references

  • J. Ma, B. Ning, Stability results on the circumference of a graph, Combinatorica 40 (2020); arXiv:1708.00704v2. https://arxiv.org/abs/1708.00704, https://doi.org/10.1007/s00493-019-3843-4
  • G. N. Kopylov, Maximal paths and cycles in a graph, Dokl. Akad. Nauk SSSR 234 (1977), 19–21.
  • D. R. Woodall, Maximal circuits of graphs I, Acta Math. Acad. Sci. Hungar. 28 (1976), 77–80.
  • Z. Füredi, A. Kostochka, R. Luo, J. Verstraëte, Stability in the Erdős–Gallai theorem on cycles and paths, II, Discrete Math. 341 (2018), 1253–1263.
  • Z. Füredi, A. Kostochka, J. Verstraëte, Stability in the Erdős–Gallai theorems on cycles and paths, J. Combin. Theory Ser. B 121 (2016), 197–228.
  • J. A. Bondy, V. Chvátal, A method in graph theory, Discrete Math. 15 (1976), 111–135. https://doi.org/10.1016/0012-365X(76)90078-9
  • G. Fan, X. Lv, P. Wang, Cycles in 2-connected graphs, J. Combin. Theory Ser. B 92 (2004), 379–394.
  • P. Erdős, T. Gallai, On maximal paths and circuits of graphs, Acta Math. Acad. Sci. Hungar. 10 (1959), 337–356. https://doi.org/10.1007/BF02024498
19 thms1 active userReviewed
PreviousPage 9 of 14Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me