Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Linear algebra

222 missions · 132 completed

Missions

Open90Completed132All222
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

When Is Society Susceptible to Manipulation?: Under Any Principal Interference, Beliefs in a Mixed DeGroot–Bayesian Network Converge Almost Surely to (I − W)⁻¹(BU∞ ⊙ θ)Research Paper

Motivation

Misinformation campaigns target specific people in a social network and rely on the network to spread what they plant. Whether such a campaign can succeed depends on how people combine what they see themselves with what their neighbours believe. Mostagir, Ozdaglar and Siderius (SSRN 3474643; Management Science, 2022, doi:10.1287/mnsc.2021.4265) model a network in which a strategic principal injects slanted news into chosen agents. Some agents are Bayesian and know the truth; the rest are DeGroot agents who average their own news-based opinion with their neighbours' beliefs.

The paper asks when society as a whole can be manipulated. Every later result in it — which agents the principal targets, which networks resist manipulation, how the answer depends on the network's density — is a statement about the agents' long-run beliefs. Its Theorem 2 supplies those beliefs in closed form, and that closed form is the subject of this mission.

DeGroot updating (DeGroot, 1974) and its combination with personal Bayesian updates (Jadbabaie, Molavi, Sandroni and Tahbaz-Salehi, 2012) are standard models of non-Bayesian social learning. Stubborn agents in averaging dynamics were studied by Acemoglu, Como, Fagnani and Ozdaglar (2013). The present model adds a principal who corrupts the signals of targeted agents.

Setting

There are nnn agents and a binary state y∈{S,R}y\in\{S,R\}y∈{S,R} with prior q=P(y=S)∈(0,1)q=\mathbb P(y=S)\in(0,1)q=P(y=S)∈(0,1). Agent iii has a signal quality pi∈[1/2,1)p_i\in[1/2,1)pi​∈[1/2,1). At each time τ=1,2,…\tau=1,2,\dotsτ=1,2,… agent iii receives a signal si,τ∈{S,R}s_{i,\tau}\in\{S,R\}si,τ​∈{S,R}:

  • Organic news equals the state with probability pip_ipi​: P(si,τ=S∣y=S)=P(si,τ=R∣y=R)=pi\mathbb P(s_{i,\tau}=S\mid y=S)=\mathbb P(s_{i,\tau}=R\mid y=R)=p_iP(si,τ​=S∣y=S)=P(si,τ​=R∣y=R)=pi​.
  • The principal fixes an influence state y^\hat yy^​ and an influence strategy x=(x1,…,xn)∈{0,1}n\mathbf x=(x_1,\dots,x_n)\in\{0,1\}^nx=(x1​,…,xn​)∈{0,1}n. A targeted agent (xi=1x_i=1xi​=1) receives the principal's message y^\hat yy^​ with probability λ∗/(λ+λ∗)\lambda^*/(\lambda+\lambda^*)λ∗/(λ+λ∗) and organic news with probability λ/(λ+λ∗)\lambda/(\lambda+\lambda^*)λ/(λ+λ∗). Here λ>0\lambda>0λ>0 and λ∗>0\lambda^*>0λ∗>0 are the intensities of the organic and the principal's news. An untargeted agent receives only organic news.

Agent iii's signals are independent over time. Its personal experience is the posterior it would compute taking every signal at face value. With zi,tS,zi,tRz^S_{i,t},z^R_{i,t}zi,tS​,zi,tR​ the numbers of SSS and RRR signals among si,1,…,si,ts_{i,1},\dots,s_{i,t}si,1​,…,si,t​,

BUi(S∣hi,t)=pizi,tS(1−pi)zi,tRqpizi,tS(1−pi)zi,tRq+pizi,tR(1−pi)zi,tS(1−q),\mathrm{BU}_i(S\mid h_{i,t})=\frac{p_i^{z^S_{i,t}}(1-p_i)^{z^R_{i,t}}q}{p_i^{z^S_{i,t}}(1-p_i)^{z^R_{i,t}}q+p_i^{z^R_{i,t}}(1-p_i)^{z^S_{i,t}}(1-q)},BUi​(S∣hi,t​)=pizi,tS​​(1−pi​)zi,tR​q+pizi,tR​​(1−pi​)zi,tS​(1−q)pizi,tS​​(1−pi​)zi,tR​q​,

and BUi(R∣hi,t)=1−BUi(S∣hi,t)\mathrm{BU}_i(R\mid h_{i,t})=1-\mathrm{BU}_i(S\mid h_{i,t})BUi​(R∣hi,t​)=1−BUi​(S∣hi,t​).

A set BBB of agents is Bayesian. A Bayesian agent knows yyy and always believes it. Each DeGroot agent i∉Bi\notin Bi∈/B has weights θi≥0\theta_i\ge0θi​≥0 and αij≥0\alpha_{ij}\ge0αij​≥0 with θi+∑jαij=1\theta_i+\sum_j\alpha_{ij}=1θi​+∑j​αij​=1. For a state y′y'y′, its belief πi,t(y′∣y)\pi_{i,t}(y'\mid y)πi,t​(y′∣y) follows the DeGroot update

πi,t+1=θi BUi(y′∣hi,t+1)+∑j=1nαij πj,t.\pi_{i,t+1}=\theta_i\,\mathrm{BU}_i(y'\mid h_{i,t+1})+\sum_{j=1}^n\alpha_{ij}\,\pi_{j,t}.πi,t+1​=θi​BUi​(y′∣hi,t+1​)+j=1∑n​αij​πj,t​.

The influence matrix W\mathbf WW has zero rows for Bayesian agents and row (αij)j(\alpha_{ij})_j(αij​)j​ for DeGroot agents. The vector θ=(1B,θm+1,…,θn)\boldsymbol\theta=(\mathbf 1_B,\theta_{m+1},\dots,\theta_n)θ=(1B​,θm+1​,…,θn​) has entry 111 on Bayesians. The unweighted graph G∗G^*G∗ has a link i→ji\to ji→j when iii listens to jjj; for a DeGroot agent this means αij>0\alpha_{ij}>0αij​>0.

Assumption 1 (pp. 10–11):

  • (i) pi<(λ∗+λ)/(2λ)p_i<(\lambda^*+\lambda)/(2\lambda)pi​<(λ∗+λ)/(2λ) for every agent;
  • (ii) G∗G^*G∗ is strongly connected;
  • (iii) a DeGroot agent has θi>0\theta_i>0θi​>0 exactly when pi>1/2p_i>1/2pi​>1/2;
  • (iv) some agent has pi>1/2p_i>1/2pi​>1/2.

Formalization targets

Goal: Theorem 2 (p. 11)

Under Assumption 1, for every principal action x∗\mathbf x^*x∗, each DeGroot agent's personal experience converges almost surely to a constant BUi(hi,∞(x∗))(y′∣y)\mathrm{BU}_i(h_{i,\infty}(\mathbf x^*))(y'\mid y)BUi​(hi,∞​(x∗))(y′∣y), and

πt(y′∣y)→a.s.(I−W)−1(BU(h∞(x∗))(y′∣y)⊙θ),\boldsymbol\pi_t(y'\mid y)\xrightarrow{\text{a.s.}}(\mathbf I-\mathbf W)^{-1}\big(\mathrm{BU}(\mathbf h_\infty(\mathbf x^*))(y'\mid y)\odot\boldsymbol\theta\big),πt​(y′∣y)a.s.​(I−W)−1(BU(h∞​(x∗))(y′∣y)⊙θ),

where the Bayesian entries of the vector BU(h∞(x∗))\mathrm{BU}(\mathbf h_\infty(\mathbf x^*))BU(h∞​(x∗)) are the correct belief. The goal does not fix the constants: the paper computes them only later (display (2), p. 12).

Milestones

  1. Lemma 3 (p. 45): the spectral radius of W\mathbf WW is strictly less than 111.
  2. Proof of Theorem 2 (p. 47): I−W\mathbf I-\mathbf WI−W and its DeGroot block I−ADD\mathbf I-\mathbf A_{DD}I−ADD​ are invertible.
  3. §3.2 (p. 11): BUi(hi,t)\mathrm{BU}_i(h_{i,t})BUi​(hi,t​) converges almost surely to a constant.
  4. Proof of Theorem 2 (p. 47): if ut→u∞\mathbf u_t\to\mathbf u_\inftyut​→u∞​ and πt+1=ut+1+Wπt\boldsymbol\pi_{t+1}=\mathbf u_{t+1}+\mathbf W\boldsymbol\pi_tπt+1​=ut+1​+Wπt​, then πt→π∞=(I−W)−1u∞\boldsymbol\pi_t\to\boldsymbol\pi_\infty=(\mathbf I-\mathbf W)^{-1}\mathbf u_\inftyπt​→π∞​=(I−W)−1u∞​, the solution of π∞=u∞+Wπ∞\boldsymbol\pi_\infty=\mathbf u_\infty+\mathbf W\boldsymbol\pi_\inftyπ∞​=u∞​+Wπ∞​.

Significance

Theorem 2 reduces the paper's manipulation question to linear algebra. A DeGroot agent ends up believing the wrong state exactly when the corresponding entry of (I−W)−1(BU∞⊙θ)(\mathbf I-\mathbf W)^{-1}(\mathrm{BU}_\infty\odot\boldsymbol\theta)(I−W)−1(BU∞​⊙θ) crosses a threshold. The principal's targeting problem then becomes a combinatorial problem over x∗\mathbf x^*x∗ in which the network enters only through (I−W)−1(\mathbf I-\mathbf W)^{-1}(I−W)−1. The paper's DeGroot centrality (Proposition 2) and its results on dense and sparse networks all start from this formula.

On formalization: the paper proves Theorem 2, but no machine-checked version exists. The mission's statements also record two places where the written argument needs repair. The text attributes the almost-sure convergence of BUi\mathrm{BU}_iBUi​ to the martingale convergence theorem, but BUi\mathrm{BU}_iBUi​ is a face-value posterior and not a martingale under the corrupted signal law. The proof's step from small increments of πt\boldsymbol\pi_tπt​ to convergence of πt\boldsymbol\pi_tπt​ is also not valid as written. Both claims are true under Assumption 1, and a complete development supplies correct arguments. The supporting results — spectral radius below one for a substochastic matrix with leakage reachable from every row, and convergence of linear recursions with convergent input — are reusable beyond this paper.

Difficulty

Two steps resist the obvious arguments.

First, BUi(S∣hi,t)\mathrm{BU}_i(S\mid h_{i,t})BUi​(S∣hi,t​) is a function of the drift zi,tS−zi,tRz^S_{i,t}-z^R_{i,t}zi,tS​−zi,tR​ of a random walk. Its limit exists only if the walk is transient or pi=1/2p_i=1/2pi​=1/2. For a targeted agent the walk's step law mixes the principal's message with organic news. For one boundary value of pip_ipi​ the step has mean zero, the walk is recurrent and BUi\mathrm{BU}_iBUi​ oscillates forever. Assumption 1(i) excludes exactly that value. A proof must use it; a martingale argument does not apply.

Second, W\mathbf WW is substochastic but not strictly so: a DeGroot row sums to 1−θi1-\theta_i1−θi​, which equals 111 whenever pi=1/2p_i=1/2pi​=1/2. A row-sum bound alone gives ρ(W)≤1\rho(\mathbf W)\le1ρ(W)≤1, not <1<1<1. Strict inequality needs every DeGroot agent to reach, in the weighted graph, an agent that leaks weight — a Bayesian or a DeGroot agent with θi>0\theta_i>0θi​>0. This uses the interaction of Assumption 1 (ii), (iii) and (iv), with Bayesian agents' outgoing links playing no role in W\mathbf WW.

Formalization scope

Agents are Fin n and the Bayesian set is a Finset. Time is discrete, and the history at time ttt is the signals at times 1,…,t1,\dots,t1,…,t. The state space is a two-element inductive type. The signals are random variables on a probability space (Ω,P)(\Omega,P)(Ω,P). Each agent's sequence is independent over time with the law above; signals of different agents may be dependent. This is deliberate: in the paper all targeted agents receive the same principal stream, so cross-agent independence would exclude the paper's own model. The principal's action is pure (x∗∈{0,1}n\mathbf x^*\in\{0,1\}^nx∗∈{0,1}n), as §3.2 allows without loss of generality. The DeGroot initial belief can be any value in [0,1][0,1][0,1], and the conclusion holds for every such initial belief on one almost-sure event. "Spectral radius" is Mathlib's spectralRadius ℂ of the complexified matrix. (I−W)−1(\mathbf I-\mathbf W)^{-1}(I−W)−1 is Mathlib's matrix inverse; no invertibility hypothesis is added, because Assumption 1 implies it. In the graph G∗G^*G∗, a DeGroot agent's links are exactly its positive weights; Bayesian agents' links are free.

The personal experience is the explicit face-value posterior of the given signal process, and the conclusion of the goal includes its almost-sure convergence to the constants used in the limit. The goal therefore cannot be met by an abstract learning rule or a free limit vector.

A complete development needs:

  • the strong law of large numbers (available in Mathlib) applied to the signal counts;
  • a Perron–Frobenius-type spectral bound for substochastic matrices on a strongly connected graph;
  • convergence of πt+1=ut+1+Wπt\boldsymbol\pi_{t+1}=\mathbf u_{t+1}+\mathbf W\boldsymbol\pi_tπt+1​=ut+1​+Wπt​ when ρ(W)<1\rho(\mathbf W)<1ρ(W)<1.

Contributions of any of these, as standalone lemmas, are welcome.

Selected references

  • M. Mostagir, A. Ozdaglar, J. Siderius, When Is Society Susceptible to Manipulation?, SSRN preprint 3474643 (version of 2020-06-08); Management Science 68(10), 2022. https://ssrn.com/abstract=3474643, https://doi.org/10.1287/mnsc.2021.4265
  • M. H. DeGroot, Reaching a Consensus, Journal of the American Statistical Association 69(345), 1974. https://doi.org/10.1080/01621459.1974.10480137
  • A. Jadbabaie, P. Molavi, A. Sandroni, A. Tahbaz-Salehi, Non-Bayesian Social Learning, Games and Economic Behavior 76(1), 2012. https://doi.org/10.1016/j.geb.2012.06.001
  • D. Acemoglu, G. Como, F. Fagnani, A. Ozdaglar, Opinion Fluctuations and Disagreement in Social Networks, Mathematics of Operations Research 38(1), 2013. https://doi.org/10.1287/moor.1120.0570
6 thms2 active usersReviewed
🏆Completed
Machine LearningStatistics·Captain: mikedeng1

A Robust Spectral Clustering Algorithm for Sub-Gaussian Mixture Models with Outliers 2: Spectral Rounding Without Outliers Gives Σ|S_k|/n_k ≤ 64(2+ε)‖X⁰ − X̂‖₁/n²minResearch Paper

Motivation

Spectral clustering recovers group labels from a similarity matrix: compute its leading eigenvectors, embed each point as a row of the eigenvector matrix, and cluster the rows with k-means. It is a standard last step of convex-relaxation methods for clustering, which first estimate a clustering matrix XXX (with Xij=1X_{ij} = 1Xij​=1 when iii and jjj belong to the same cluster) and then have to turn the estimate back into labels.

Srivastava, Sarkar and Hanasusanto (arXiv:1912.07546v3; Operations Research 71(1), 2023) estimate XXX by a linear program on a thresholded Gaussian kernel and then round it this way (Algorithm 1, steps 3–4). Their Theorem 2 controls the error of the rounding step in terms of the ℓ1\ell_1ℓ1​ error of the estimate. The argument follows Lei and Rinaldo (Ann. Statist. 43(1), 2015), who analysed spectral clustering for stochastic block models with a polynomial-time (1+ϵ)(1+\epsilon)(1+ϵ)-approximate k-means step, combined with the Davis–Kahan theorem in the form of Yu, Wang and Samworth (Biometrika 102(2), 2015). The same pattern, "matrix estimation error ⇒ eigenvector error ⇒ misclassification count", recurs throughout the analysis of SDP and spectral methods for community detection and mixture models.

Setting

There are nnn points and rrr clusters. A fixed labelling φ:[n]→[r]\varphi : [n] \to [r]φ:[n]→[r] gives clusters Ck={i:φ(i)=k}C_k = \{i : \varphi(i) = k\}Ck​={i:φ(i)=k} of sizes nk≥1n_k \ge 1nk​≥1, and nmin⁡=min⁡knkn_{\min} = \min_k n_knmin​=mink​nk​. The true clustering matrix is Xij0=1X^0_{ij} = 1Xij0​=1 if φ(i)=φ(j)\varphi(i) = \varphi(j)φ(i)=φ(j) and 000 otherwise. Its scaled membership matrix is

U0=Z0 Diag(1/n1,…,1/nr),Uik0={1/nkφ(i)=k,0otherwise.U^0 = Z^0\,\mathrm{Diag}(1/\sqrt{n_1},\dots,1/\sqrt{n_r}),\qquad U^0_{ik} = \begin{cases} 1/\sqrt{n_k} & \varphi(i) = k,\\ 0 & \text{otherwise.}\end{cases}U0=Z0Diag(1/n1​​,…,1/nr​​),Uik0​={1/nk​​0​φ(i)=k,otherwise.​

The estimate X^∈Rn×n\hat X \in \mathbb R^{n\times n}X^∈Rn×n is any symmetric matrix with entries in [0,1][0,1][0,1]. Spectral rounding takes a matrix U^∈Rn×r\hat U \in \mathbb R^{n\times r}U^∈Rn×r of orthonormal eigenvectors of X^\hat XX^ for its rrr largest eigenvalues (ties broken arbitrarily), and runs k-means on the rows of U^\hat UU^. A membership matrix Θ∈Mn,r\Theta \in \mathbb M_{n,r}Θ∈Mn,r​ is a {0,1}\{0,1\}{0,1}-matrix with exactly one 111 per row; a pair (Θ^,B^)(\hat\Theta, \hat B)(Θ^,B^) with B^∈Rr×r\hat B \in \mathbb R^{r\times r}B^∈Rr×r is a (1+ϵ)(1+\epsilon)(1+ϵ)-approximate k-means solution on the rows of U^\hat UU^ if

∥U^−Θ^B^∥F2≤(1+ϵ)min⁡Θ∈Mn,r, B∈Rr×r∥U^−ΘB∥F2.\|\hat U - \hat\Theta\hat B\|_F^2 \le (1+\epsilon)\min_{\Theta\in\mathbb M_{n,r},\, B\in\mathbb R^{r\times r}}\|\hat U - \Theta B\|_F^2 .∥U^−Θ^B^∥F2​≤(1+ϵ)Θ∈Mn,r​,B∈Rr×rmin​∥U^−ΘB∥F2​.

Let OOO be an optimal rotation, an orthogonal r×rr\times rr×r matrix minimising ∥U^−U0O∥F\|\hat U - U^0O\|_F∥U^−U0O∥F​. With viv_ivi​ and vˉi\bar v_ivˉi​ the rows of U0OU^0OU0O and Θ^B^\hat\Theta\hat BΘ^B^, the misclassified set of cluster kkk is

Sk={i∈Ck:∥vˉi−vi∥≥12nk}.\mathcal S_k = \Big\{ i \in C_k : \|\bar v_i - v_i\| \ge \tfrac{1}{2\sqrt{n_k}} \Big\}.Sk​={i∈Ck​:∥vˉi​−vi​∥≥2nk​​1​}.

Norms: ∥A∥1=∑i,j∣Aij∣\|A\|_1 = \sum_{i,j}|A_{ij}|∥A∥1​=∑i,j​∣Aij​∣ (entrywise), ∥A∥F2=∑i,jAij2\|A\|_F^2 = \sum_{i,j}A_{ij}^2∥A∥F2​=∑i,j​Aij2​.

Formalization targets

Goal: Theorem 2, (15), without outliers

For every X^\hat XX^, U^\hat UU^, (Θ^,B^)(\hat\Theta,\hat B)(Θ^,B^) and optimal OOO as above and every ϵ>0\epsilon > 0ϵ>0,

∑k∈[r]∣Sk∣nk  ≤  64(2+ϵ) ∥X0−X^∥1nmin⁡2.\sum_{k\in[r]}\frac{|\mathcal S_k|}{n_k} \;\le\; 64(2+\epsilon)\,\frac{\|X^0 - \hat X\|_1}{n_{\min}^2}.k∈[r]∑​nk​∣Sk​∣​≤64(2+ϵ)nmin2​∥X0−X^∥1​​.

Milestones

  1. Davis–Kahan (Theorem 3, case s=1s=1s=1): an eigengap ggg of a symmetric Σ\SigmaΣ below its top rrr eigenvalues gives an orthogonal O^\hat OO^ with ∥U−U^O^∥F≤23/2∥Σ^−Σ∥F/g\|U - \hat U\hat O\|_F \le 2^{3/2}\|\hat\Sigma - \Sigma\|_F/g∥U−U^O^∥F​≤23/2∥Σ^−Σ∥F​/g.
  2. Eigenstructure of X0X^0X0: U0U^0U0 consists of top-rrr eigenvectors of X0X^0X0 with eigenvalues n1,…,nrn_1,\dots,n_rn1​,…,nr​, and X0X^0X0 vanishes on the orthogonal complement, so the eigengap is nmin⁡n_{\min}nmin​.
  3. (G.6)(iii): ∥A−B∥F2≤∥A−B∥1\|A - B\|_F^2 \le \|A - B\|_1∥A−B∥F2​≤∥A−B∥1​ for matrices with entries in [0,1][0,1][0,1].
  4. (G.6): ∥U^−U0O∥F2≤8∥X^−X0∥1/nmin⁡2\|\hat U - U^0 O\|_F^2 \le 8\|\hat X - X^0\|_1/n_{\min}^2∥U^−U0O∥F2​≤8∥X^−X0∥1​/nmin2​.
  5. Lemma 5, (G.4) (Lei–Rinaldo): for V=Θ∗B∗V = \Theta^*B^*V=Θ∗B∗ and a (1+ϵ)(1+\epsilon)(1+ϵ)-approximate k-means solution on any V^\hat VV^, ∑k∣Sk∣δk2≤4(4+2ϵ)∥V−V^∥F2\sum_k |\mathcal S_k|\delta_k^2 \le 4(4+2\epsilon)\|V - \hat V\|_F^2∑k​∣Sk​∣δk2​≤4(4+2ϵ)∥V−V^∥F2​.
  6. Centre separation: the rows of B∗=Diag(1/nk)OB^* = \mathrm{Diag}(1/\sqrt{n_k})OB∗=Diag(1/nk​​)O satisfy ∥bl∗−bk∗∥=1/nk+1/nl\|b^*_l - b^*_k\| = \sqrt{1/n_k + 1/n_l}∥bl∗​−bk∗​∥=1/nk​+1/nl​​.

Companion: permutation recovery

If 64(2+ϵ)∥X0−X^∥1/nmin⁡2≤164(2+\epsilon)\|X^0 - \hat X\|_1/n_{\min}^2 \le 164(2+ϵ)∥X0−X^∥1​/nmin2​≤1, the k-means labels agree with φ\varphiφ up to one permutation of [r][r][r] on every point outside ⋃kSk\bigcup_k\mathcal S_k⋃k​Sk​.

Significance

Inequality (15) separates the analysis of the algorithm into an estimation part (how close X^\hat XX^ is to X0X^0X0 in ℓ1\ell_1ℓ1​, Theorem 1 of the paper) and a purely deterministic rounding part. Any estimator of the clustering matrix with entries in [0,1][0,1][0,1] — the Robust-LP, the SDP relaxations of Peng–Wei or Amini–Levina, a thresholded kernel — inherits a misclassification bound from its ℓ1\ell_1ℓ1​ error through this one statement, with an explicit constant. The companion statement shows that the sets Sk\mathcal S_kSk​ really are the misclassified points.

The result is proved on paper; none of it is formalized. Mathlib has the spectral theorem for Hermitian matrices but no eigenspace perturbation bound of Davis–Kahan type, and the platform has no k-means approximation lemma for membership matrices. A machine-checked Davis–Kahan theorem in Frobenius norm and a machine-checked Lei–Rinaldo lemma are reusable well beyond this paper: they are the two standard ingredients of every spectral clustering guarantee for block models and mixtures.

Difficulty

The k-means part is elementary but bookkeeping-heavy: the comparison point in the (1+ϵ)(1+\epsilon)(1+ϵ) bound must be a feasible k-means solution, which is why the true embedding U0OU^0OU0O has to factor as a membership matrix times a centre matrix. The main obstacle is the Davis–Kahan step. The naive route through individual eigenvectors fails when eigenvalues of X^\hat XX^ or of X0X^0X0 are repeated (here X0X^0X0 has eigenvalue nkn_knk​ with multiplicity whenever cluster sizes coincide), and only the subspace is stable; the bound must be stated up to an orthogonal matrix and proved for the whole eigenspace, with no ordering or separation assumption on the eigenvalues of X^\hat XX^.

Formalization scope

Points are Fin n, clusters Fin r, matrices Matrix ι κ ℝ; the norms are explicit sums, not Mathlib's matrix norm instances. The labelling φ\varphiφ is fixed; membership matrices are encoded by assignments a:[n]→[r]a : [n]\to[r]a:[n]→[r], and "≤(1+ϵ)min⁡\le (1+\epsilon)\min≤(1+ϵ)min" by "≤(1+ϵ)⋅\le (1+\epsilon)\cdot≤(1+ϵ)⋅ the cost of every assignment and every centre matrix". "Top-rrr eigenvectors" is variational: orthonormal columns, eigenvector equations, and every Rayleigh quotient on the orthogonal complement at most each selected eigenvalue. nmin⁡n_{\min}nmin​ is a finite minimum and requires r≥1r \ge 1r≥1.

Departures from the printed text, each disclosed in the item concerned:

  • No outliers (m=0m = 0m=0). The printed Theorem 2 allows outliers; it is false for m≥1m \ge 1m≥1, because the outlier rows of U0U^0U0 are zero, so the true embedding is not k-means feasible and Lemma 5 does not apply. A counterexample with two clusters of size M>256M > 256M>256, one isolated outlier and ϵ=2\epsilon = 2ϵ=2 violates (15).
  • No probability, no ϵˉ\bar\epsilonϵˉ, no separation condition. (15) is deterministic in ∥X0−X^∥1\|X^0 - \hat X\|_1∥X0−X^∥1​; the printed probabilistic hypotheses only feed Theorem 1 into the permutation claim.
  • The printed nmin⁡>rn_{\min} > rnmin​>r is replaced by the weaker nk≥1n_k \ge 1nk​≥1.
  • Davis–Kahan is stated for the leading eigenspace (s=1s = 1s=1), the only case used.
  • In Lemma 5 the thresholds are required to satisfy δk≥0\delta_k \ge 0δk​≥0, which the page leaves implicit; for a negative δk\delta_kδk​ the bound (G.4) fails at V^=V\hat V = VV^=V.

The goal quantifies over every optimal rotation OOO, not over some orthogonal matrix chosen afterwards (which could make Sk\mathcal S_kSk​ empty), and over every top-eigenvector matrix and every approximate k-means solution; a formalization that fixes U^\hat UU^ to good eigenvectors, compares only against the true labels, or drops the eigenvalue-dominance clause (allowing bottom eigenvectors) proves a different and partly false statement.

Contributions welcome: Davis–Kahan in Frobenius norm for symmetric real matrices (general sss included), the Lei–Rinaldo lemma in full, and the eigenstructure of block-constant matrices.

Selected references

  • P. R. Srivastava, P. Sarkar, G. A. Hanasusanto, A Robust Spectral Clustering Algorithm for Sub-Gaussian Mixture Models with Outliers, arXiv:1912.07546v3, 2021; Operations Research 71(1), 2023. https://arxiv.org/abs/1912.07546
  • J. Lei, A. Rinaldo, Consistency of spectral clustering in stochastic block models, Annals of Statistics 43(1), 215–237, 2015. https://doi.org/10.1214/14-AOS1274
  • Y. Yu, T. Wang, R. J. Samworth, A useful variant of the Davis–Kahan theorem for statisticians, Biometrika 102(2), 315–323, 2015. https://doi.org/10.1093/biomet/asv008
  • C. Davis, W. M. Kahan, The rotation of eigenvectors by a perturbation. III, SIAM Journal on Numerical Analysis 7(1), 1–46, 1970. https://doi.org/10.1137/0707001
8 thms2 active usersReviewed
🏆Completed
Optimization·Captain: mikedeng1

A Robust Spectral Clustering Algorithm for Sub-Gaussian Mixture Models with Outliers 3: Binary PSD Rank-r Lifting (4) Is Equivalent to Robust Cluster Assignment (3)Research Paper

Why this formulation matters

Clustering separates observations into groups whose members resemble one another. In kernel clustering, a matrix KKK records a similarity score for each pair of observations, and an assignment seeks groups with high total within-group similarity. Real data can also contain outliers, observations that should not be assigned to any cluster. Srivastava, Sarkar, and Hanasusanto use a binary assignment program that permits those unassigned observations and then express the same exact problem through a matrix of pairwise co-memberships. The relationship is stated as Proposition 1 of their preprint. It is the algebraic starting point for the tractable relaxations introduced immediately after the proposition in §3.

The two exact programs have different variables. The assignment program describes each observation's cluster directly. The lifted program records whether each pair belongs to the same cluster. The latter representation makes positive semidefiniteness and rank explicit, and it is the one the paper relaxes to obtain its semidefinite program. A precise equivalence matters because a relaxation of the wrong feasible set would no longer be a relaxation of the stated assignment problem.

The two finite matrix programs

Let NNN be the number of observations and rrr the number of available clusters. A binary assignment matrix Z∈{0,1}N×rZ\in\{0,1\}^{N\times r}Z∈{0,1}N×r has one row per observation and one column per cluster. In formulation (3), each row sums to at most one. A row with one nonzero entry assigns its observation to that cluster; a zero row leaves the observation unassigned. Thus the same matrix represents both inliers and outliers. Cluster sizes need not be equal, and unused cluster columns are allowed.

The clustering matrix X=ZZ⊤X=ZZ^\topX=ZZ⊤ has one row and column per observation. Its entry XijX_{ij}Xij​ is one when observations iii and jjj share a cluster and zero otherwise, including when either observation has a zero assignment row. Formulation (4) asks instead for an N×NN\times NN×N matrix XXX whose entries lie in {0,1}\{0,1\}{0,1}, that is positive semidefinite, and whose rank is at most rrr. The rank bound limits the number of distinct nonzero cluster directions. Positive semidefiniteness is a property of the full real matrix, including its symmetry; it is not merely a condition on its diagonal.

Let K∈RN×NK\in\mathbb R^{N\times N}K∈RN×N be the similarity matrix, γ∈R\gamma\in\mathbb Rγ∈R a penalty parameter, and ENE_NEN​ the all-ones N×NN\times NN×N matrix. The entrywise Frobenius inner product is ⟨A,B⟩=∑i,jAijBij\langle A,B\rangle=\sum_{i,j}A_{ij}B_{ij}⟨A,B⟩=∑i,j​Aij​Bij​. The programs maximize, respectively, ⟨K−γEN,ZZ⊤⟩\langle K-\gamma E_N,ZZ^\top\rangle⟨K−γEN​,ZZ⊤⟩ over feasible ZZZ and ⟨K−γEN,X⟩\langle K-\gamma E_N,X\rangle⟨K−γEN​,X⟩ over feasible XXX. Both have a feasible zero matrix, even at the boundary values N=0N=0N=0 and r=0r=0r=0.

Formalization targets

The goal is Proposition 1, stated with its factor and rotation. If X∗X^*X∗ is an optimal matrix for (4), there must exist G∈RN×rG\in\mathbb R^{N\times r}G∈RN×r and an orthogonal O∈Rr×rO\in\mathbb R^{r\times r}O∈Rr×r such that Z∗=GOZ^*=GOZ∗=GO is feasible and optimal for (3), with

X∗=GG⊤,⟨K−γEN,Z∗Z∗⊤⟩=⟨K−γEN,X∗⟩.X^*=GG^\top,\qquad \langle K-\gamma E_N,Z^*Z^{*\top}\rangle =\langle K-\gamma E_N,X^*\rangle.X∗=GG⊤,⟨K−γEN​,Z∗Z∗⊤⟩=⟨K−γEN​,X∗⟩.

Here “feasible and optimal” includes the zero-one entry condition, the row-sum bound, and comparison with every feasible assignment matrix. The objective identity alone would say little: once the Gram factorization and orthogonality hold, it follows algebraically. The substantive result is the existence of an assignment-compatible rotation of a factor of every lifted optimum.

The milestone list follows the five claims in Appendix B of the preprint: lifting a feasible assignment to a feasible XXX without changing its value; factoring a rank-bounded positive semidefinite XXX through rrr columns; classifying factor rows as zero or unit vectors; showing that distinct nonzero rows are orthogonal; and rotating those rows into assignment coordinates. These statements address both directions of the feasible-set correspondence used by Proposition 1.

What the result supplies

The proposition says that the matrix constraints in (4) describe the same exact clustering choices as the assignment constraints in (3), up to a choice of orthogonal coordinates for the factor. A lifted optimum therefore represents an assignment optimum rather than merely a matrix with the same numerical objective. Conversely, an assignment can always be lifted to a matrix accepted by (4). The paper can then drop the binary or rank constraints to obtain relaxations while keeping a clear exact program as their reference point; see §3 of the preprint.

The proposition is proved in the source paper. This mission seeks a machine-checked proof of that known claim and reusable finite-matrix results about binary positive semidefinite Gram matrices. In particular, the factorization and row-structure milestones can be used beyond spectral clustering whenever a zero-one Gram matrix appears with a rank bound. The Lean declarations here are proposed statements; their sorry proofs remain for solvers to complete.

Where the difficulty lies

The forward implication is immediate once a valid assignment matrix is given: its Gram matrix is positive semidefinite and has rank at most the number of cluster columns. The reverse implication carries the mathematical work. Positive semidefiniteness and low rank alone produce a real factor, but the factor need not have zero-one entries. A generic factor rotation also need not yield one-hot rows. The zero-one condition on every Gram entry is what constrains the relative positions of the nonzero rows strongly enough to recover assignment directions. The result must work when several observations share a direction, when some rows vanish, and when fewer than rrr clusters are occupied.

Formalization scope

The formalization uses Mathlib matrices indexed by Fin N and Fin r over R\mathbb RR. Feasibility of (3) is entrywise membership in {0,1}\{0,1\}{0,1} together with row sums at most one. Feasibility of (4) is entrywise membership in {0,1}\{0,1\}{0,1}, Matrix.PosSemidef, and Matrix.rank ≤ r. The objectives use the explicit sum of entrywise products, so no operator norm or alternate matrix inner product enters the statement. Global optimality is defined by comparison against the corresponding whole feasible set. The factor GGG has exactly rrr columns, and the rotation belongs to the real orthogonal group of dimension rrr.

The paper obtains KKK from a Gaussian kernel and takes γ∈(0,1)\gamma\in(0,1)γ∈(0,1) for the clustering application. Proposition 1 and Appendix B use only the displayed algebraic programs, so the formal statement permits arbitrary real KKK and γ\gammaγ. No probability model, symmetry assumption on KKK, positive dimension assumption, or nonempty-cluster condition is needed. The boundary cases N=0N=0N=0 and r=0r=0r=0 retain their literal meanings. The formalization cannot assume that a feasible XXX is already block diagonal or is already a Gram matrix of a binary assignment; that is the conclusion being established.

Useful contributions include proofs of the five Appendix B milestones, a finite-dimensional factorization theorem with the prescribed number of columns, and the rotation theorem that handles repeated or zero rows. These pieces should share the stated definitions so that the eventual proof of Proposition 1 uses precisely formulations (3) and (4).

Selected references

  • P. R. Srivastava, P. Sarkar, and G. A. Hanasusanto, A Robust Spectral Clustering Algorithm for Sub-Gaussian Mixture Models with Outliers, Operations Research 71(1), 2023; arXiv:1912.07546v3, §3, Proposition 1 and Appendix B.
7 thms2 active usersReviewed
🏆Completed
Statistics·Captain: Lucas

Local Distance Network (H0DN 2026): generalized least squares behind the H0 consensusResearch Paper

Motivation

The Hubble constant H0H_0H0​ is the present expansion rate of the Universe. Its value measured locally with distance-ladder methods disagrees with the value inferred from the early Universe under the standard Λ\LambdaΛCDM model (the Hubble tension). The H0DN Collaboration (A&A 708, A166, 2026) combined geometric distances, Cepheids, the tip of the red giant branch, Miras, carbon stars, Type Ia and Type II supernovae, surface brightness fluctuations, the fundamental plane, Tully–Fisher relations and megamasers into a single Local Distance Network, reporting the baseline value H0=73.50±0.81 km s−1 Mpc−1H_0=73.50\pm0.81\ \mathrm{km\,s^{-1}\,Mpc^{-1}}H0​=73.50±0.81 kms−1Mpc−1.

That number comes from one statistical step. All equations of the network are linear (or linearized) in the parameters, the measurement errors are correlated, and the parameters are obtained by generalized least squares with a non-diagonal covariance matrix (Appendix B of the paper). The paper relies on three mathematical facts: the covariance-weighted solution is the Best Linear Unbiased Estimator (Aitken 1935); weighting by the inverse covariance gives the lowest variance among weighted least-squares solutions; and replacing the inverse of a singular covariance matrix by its Moore–Penrose inverse (Penrose 1956) is "completely equivalent to analytically making sure that only linearly independent equations are used". This mission formalizes exactly those facts.

Timeline of the mathematics used:

  • Gauss (1820s): least squares gives minimum-variance linear unbiased estimates for uncorrelated errors of equal variance.
  • Aitken (1935): extension to correlated errors with a known covariance matrix, i.e. generalized least squares.
  • Penrose (1955–1956): the generalized inverse characterized by the four Penrose equations, and its use for best approximate solutions of linear equations.

Setting

The data vector Y∈RmY\in\mathbb R^{m}Y∈Rm has one entry per equation of the network (host-distance, host-group, calibrator and Hubble-flow equations; m=255m=255m=255 in the baseline). The parameter vector X∈RnX\in\mathbb R^{n}X∈Rn collects host distance moduli, group distance moduli, reference absolute magnitudes and log⁡10H0\log_{10}H_0log10​H0​. The coefficient matrix A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n gives the theory prediction AXAXAX, and the data have covariance matrix C∈Rm×mC\in\mathbb R^{m\times m}C∈Rm×m.

For a symmetric positive-definite weight matrix WWW the quadratic form of Eq. (B.2) is

Q(X)=(Y−AX)TW(Y−AX),Q(X)=(Y-AX)^{\mathsf T}W(Y-AX),Q(X)=(Y−AX)TW(Y−AX),

and W=C−1W=C^{-1}W=C−1 gives the χ2\chi^2χ2 of Eq. (B.1). When AAA has full column rank, the GLS estimator matrix is LW=(ATWA)−1ATWL_W=(A^{\mathsf T}WA)^{-1}A^{\mathsf T}WLW​=(ATWA)−1ATW and the GLS estimate is X^W=LWY\hat X_W=L_WYX^W​=LW​Y. A linear estimator LYLYLY has covariance LCLTLCL^{\mathsf T}LCLT. A matrix PPP is a Moore–Penrose inverse of MMM if MPM=MMPM=MMPM=M, PMP=PPMP=PPMP=P, and MPMPMP and PMPMPM are symmetric.

In the network the mmm equations are built from only kkk distinct measurements (k=183k=183k=183 in the baseline): Y=BZY=BZY=BZ with Z∈RkZ\in\mathbb R^{k}Z∈Rk the vector of distinct measurements, of positive-definite covariance SSS, and BBB of full column rank. Then C=BSBTC=BSB^{\mathsf T}C=BSBT is singular whenever m>km>km>k.

Formalization targets

Goal: the χ2\chi^2χ2 solution is BLUE

For Y=AX0+εY=AX_0+\varepsilonY=AX0​+ε with Eε=0\mathbb E\varepsilon=0Eε=0, Cov⁡(ε)=C≻0\operatorname{Cov}(\varepsilon)=C\succ0Cov(ε)=C≻0 and AAA of full column rank, the estimate X^=LC−1Y\hat X=L_{C^{-1}}YX^=LC−1​Y is unbiased, and for every LLL such that LYLYLY is unbiased for every true parameter, and every v∈Rnv\in\mathbb R^nv∈Rn,

Var⁡(vTX^)≤Var⁡(vTLY).\operatorname{Var}(v^{\mathsf T}\hat X)\le\operatorname{Var}(v^{\mathsf T}LY).Var(vTX^)≤Var(vTLY).

Milestones

  1. Eq. (B.2): X^W\hat X_WX^W​ minimizes QQQ.
  2. Unbiasedness: LWA=IL_WA=ILW​A=I.
  3. Parameter covariance: LC−1CLC−1T=(ATC−1A)−1L_{C^{-1}}CL_{C^{-1}}^{\mathsf T}=(A^{\mathsf T}C^{-1}A)^{-1}LC−1​CLC−1T​=(ATC−1A)−1.
  4. Variance propagation: Var⁡(vTLY)=vTLCLTv\operatorname{Var}(v^{\mathsf T}LY)=v^{\mathsf T}LCL^{\mathsf T}vVar(vTLY)=vTLCLTv.
  5. Aitken, matrix form: LA=I⇒LCLT−(ATC−1A)−1⪰0LA=I\Rightarrow LCL^{\mathsf T}-(A^{\mathsf T}C^{-1}A)^{-1}\succeq0LA=I⇒LCLT−(ATC−1A)−1⪰0.
  6. Optimal weight: LWCLWT−LC−1CLC−1T⪰0L_WCL_W^{\mathsf T}-L_{C^{-1}}CL_{C^{-1}}^{\mathsf T}\succeq0LW​CLWT​−LC−1​CLC−1T​⪰0 for every W≻0W\succ0W≻0.
  7. Penrose: the Moore–Penrose inverse exists and is unique.
  8. Appendix B.2: if Y=BZY=BZY=BZ, C=BSBTC=BSB^{\mathsf T}C=BSBT, A=BA0A=BA_0A=BA0​ and PPP is a Moore–Penrose inverse of CCC, then (Y−AX)TP(Y−AX)=(Z−A0X)TS−1(Z−A0X)(Y-AX)^{\mathsf T}P(Y-AX)=(Z-A_0X)^{\mathsf T}S^{-1}(Z-A_0X)(Y−AX)TP(Y−AX)=(Z−A0​X)TS−1(Z−A0​X) for all XXX, and the two GLS estimates coincide.

Numerical claims of the paper

With the tension T(x,σx;y,σy)=∣x−y∣/σx2+σy2T(x,\sigma_x;y,\sigma_y)=|x-y|/\sqrt{\sigma_x^2+\sigma_y^2}T(x,σx​;y,σy​)=∣x−y∣/σx2​+σy2​​ between independent measurements:

  1. Abstract (2): relative uncertainties 0.809/73.4990.809/73.4990.809/73.499 and 0.697/73.9940.697/73.9940.697/73.994 (Table 4, V00 and V99) round to 1.1%1.1\%1.1% and 0.9%0.9\%0.9%.
  2. Abstract (6): T(73.50,0.81; 67.24,0.35)T(73.50,0.81;\,67.24,0.35)T(73.50,0.81;67.24,0.35) rounds to 7.17.17.1.
  3. Abstract (6): T(73.50,0.81; 68.51,0.58)T(73.50,0.81;\,68.51,0.58)T(73.50,0.81;68.51,0.58) rounds to 5.05.05.0.
  4. Sect. 5.2.4: T(73.994,0.697; 67.24,0.35)T(73.994,0.697;\,67.24,0.35)T(73.994,0.697;67.24,0.35) and T(73.656,0.713; 67.24,0.35)T(73.656,0.713;\,67.24,0.35)T(73.656,0.713;67.24,0.35) (Table 4, V99 and V99A) round to 8.78.78.7 and 8.18.18.1.

Significance

The result itself. These statements are what makes the reported H0H_0H0​ and its error bar meaningful as statistical quantities: the estimate is unbiased, its reported uncertainty is the covariance (ATC−1A)−1(A^{\mathsf T}C^{-1}A)^{-1}(ATC−1A)−1, no other linear unbiased combination of the same data is more precise, and the pseudoinverse shortcut used in the public code neither adds nor removes information compared with an explicit reduction to independent equations. The same facts underlie every covariance-weighted combination of correlated measurements.

Formalizing it. All of these results are classical and proved in the statistics literature. This mission adds machine-checked versions stated in the form used by the paper, including the pseudoinverse equivalence of Appendix B.2, which the paper states without proof. The astrophysical inputs (data selection, linearization, the numerical value of H0H_0H0​) are outside the scope of formal proof.

Difficulty

Each statement is classical, but the formal versions are not one-liners. The goal connects measure-theoretic expectation, variance and covariance with matrix algebra: variances of linear combinations of square-integrable random variables must be expanded through bilinearity of covariance before a Loewner-order inequality applies. The pseudoinverse equivalence fails without the full-column-rank hypothesis on BBB, and has to handle a singular CCC for which C−1C^{-1}C−1 does not exist. Existence of the Moore–Penrose inverse needs a spectral or rank-factorization argument; it is not available as a ready-made matrix operation.

Formalization scope

Everything is over R\mathbb RR with arbitrary finite index types. "Full column rank" is stated as injectivity of X↦AXX\mapsto AXX↦AX. Positive (semi)definiteness uses Mathlib's Matrix.PosDef / Matrix.PosSemidef, which include symmetry. Mathlib's matrix inverse returns 000 on singular matrices; every statement that uses (ATWA)−1(A^{\mathsf T}WA)^{-1}(ATWA)−1 carries hypotheses under which that matrix is invertible. The Moore–Penrose inverse is a predicate (the four Penrose equations), and the uniqueness milestone makes it a well-defined object. The probabilistic goal assumes only mean zero, finite second moments and a given covariance matrix (no Gaussianity). Unbiasedness of the competing estimator is required for every value of the true parameter, which rules out estimators that are unbiased only at one parameter value.

The numerical items check only the arithmetic from the published central values and uncertainties to the quoted significances and percentages; "rounds to aaa" is stated as a−0.05≤⋅<a+0.05a-0.05\le\cdot<a+0.05a−0.05≤⋅<a+0.05 (or the corresponding percentage interval). They say nothing about whether the inputs are correct.

The shared definitions (quadratic form, GLS estimator, estimator covariance, Moore–Penrose predicate) can be reused for any weighted least-squares development. Contributions are welcome on all milestones, as well as on a reusable construction of the matrix pseudoinverse.

Selected references

  • H0DN Collaboration (S. Casertano et al.), The Local Distance Network: A community consensus report on the measurement of the Hubble constant at ∼1% precision, A&A 708, A166, 2026. https://doi.org/10.1051/0004-6361/202557993
  • A. C. Aitken, On least squares and linear combination of observations, Proc. Royal Soc. Edinburgh 55, 42, 1935 (as cited in Appendix B of the paper above).
  • R. Penrose, On best approximate solutions of linear matrix equations, Math. Proc. Camb. Philos. Soc. 52, 17, 1956 (as cited in Appendix B.2 of the paper above).
15 thms2 active usersReviewed
🏆Completed
Condensed Matter PhysicsMathematical PhysicsQuantum Information+2·Captain: Alien60

Seiberg–Seifnashri–Shao 2024: Non-invertible Kramers–Wannier symmetry on the Ising chainResearch Paper

Motivation

Kramers–Wannier duality was found in 1941 as a map between the high- and low-temperature phases of the two-dimensional Ising model (Kramers–Wannier 1941). In its quantum form it exchanges the transverse field XjX_jXj​ and the nearest-neighbour coupling Zj−1ZjZ_{j-1}Z_jZj−1​Zj​ of the transverse-field Ising chain, and it fixes the critical point. In conformal field theory it is implemented by a topological defect line (Fröhlich–Fuchs–Runkel–Schweigert 2004), the prototypical non-invertible symmetry: its fusion with itself is a sum of operators, not a single invertible one (Shao, TASI lectures 2023).

On a finite periodic chain the duality cannot be a unitary operator, because it maps the Z2\mathbb Z_2Z2​-even sector to itself and annihilates the odd sector. Seiberg–Shao 2023 and Seiberg–Seifnashri–Shao 2024 wrote the exact lattice operator D\mathsf DD on the tensor-product Hilbert space (C2)⊗L(\mathbb C^2)^{\otimes L}(C2)⊗L. They showed that its algebra closes only after the lattice translation is included: D2=(1+η)T−1\mathsf D^2=(1+\eta)T^{-1}D2=(1+η)T−1. This is a lattice relation that a fusion category does not describe, since the continuum fusion rule N2=1+η\mathcal N^2=1+\etaN2=1+η appears only at low energy. The same identity drives the LSM-type constraint proved in that paper.

Timeline. 1941: Kramers and Wannier find the duality of the 2D Ising model. 2004: Fröhlich, Fuchs, Runkel and Schweigert realise it as a conformal defect. 2016: Aasen–Mong–Fendley construct the lattice defects. 2023–2024: Seiberg, Seifnashri and Shao find the exact operator algebra on the tensor-product Hilbert space, including the translation factor.

Setting

Fix L≥1L\ge1L≥1 qubits on a ring, with site indices in Z/L\mathbb Z/LZ/L (Fin L with modular arithmetic). A computational-basis state is labelled by a configuration s=(s0,…,sL−1)∈(Z/2)Ls=(s_0,\dots,s_{L-1})\in(\mathbb Z/2)^Ls=(s0​,…,sL−1​)∈(Z/2)L (Config L). Operators are complex 2L×2L2^L\times2^L2L×2L matrices indexed by configurations (Op L). Write sgn⁡(a)=(−1)a\operatorname{sgn}(a)=(-1)^asgn(a)=(−1)a.

  • Pauli operators. Xj∣s⟩=∣s+ej⟩X_j|s\rangle=|s+e_j\rangleXj​∣s⟩=∣s+ej​⟩ flips spin jjj (pauliX), and Zj∣s⟩=(−1)sj∣s⟩Z_j|s\rangle=(-1)^{s_j}|s\rangleZj​∣s⟩=(−1)sj​∣s⟩ (pauliZ).
  • Z2\mathbb Z_2Z2​ symmetry. η=∏jXj\eta=\prod_j X_jη=∏j​Xj​ flips every spin (eta).
  • Translation. T∣s⟩=∣s′⟩T|s\rangle=|s'\rangleT∣s⟩=∣s′⟩ with sk′=sk−1s'_k=s_{k-1}sk′​=sk−1​ (transl), so that TXjT−1=Xj+1TX_jT^{-1}=X_{j+1}TXj​T−1=Xj+1​.
  • Kramers–Wannier operator (kwD):
⟨t∣ D ∣s⟩  =  2−L/2 (−1)∑ktk (sk+sk+1).\langle t|\,\mathsf D\,|s\rangle \;=\; 2^{-L/2}\,(-1)^{\sum_{k} t_k\,(s_k+s_{k+1})}.⟨t∣D∣s⟩=2−L/2(−1)∑k​tk​(sk​+sk+1​).

This explicit formula is the definition used throughout. Relations (1.5) together with Dη=D\mathsf D\eta=\mathsf DDη=D determine D\mathsf DD up to a scalar, and (1.4) fixes the scalar up to a sign. Every statement below is invariant under D↦−D\mathsf D\mapsto-\mathsf DD↦−D, so this is the operator of Seiberg–Seifnashri–Shao in that paper's normalisation (footnote 1). Its equality with their matrix-product presentation (2.64) is not formalised here.

Formalization targets

Goal: the non-invertible fusion rule (eqs. (1.4), (2.65), (F.18))

D2=(1+η) T−1for every L≥1.\mathsf D^2=(1+\eta)\,T^{-1}\qquad\text{for every }L\ge1 .D2=(1+η)T−1for every L≥1.

Milestones

  1. Invertible algebra (eqs. (1.1)–(1.3), (2.10), (2.65)): η2=1\eta^2=1η2=1, Tη=ηTT\eta=\eta TTη=ηT, TL=1T^L=1TL=1, TXjT−1=Xj+1TX_jT^{-1}=X_{j+1}TXj​T−1=Xj+1​, TZjT−1=Zj+1TZ_jT^{-1}=Z_{j+1}TZj​T−1=Zj+1​, ηXj=Xjη\eta X_j=X_j\etaηXj​=Xj​η, ηZj=−Zjη\eta Z_j=-Z_j\etaηZj​=−Zj​η.
  2. Duality on XXX (eq. (1.5)): DXj=Zj−1Zj D\mathsf D X_j=Z_{j-1}Z_j\,\mathsf DDXj​=Zj−1​Zj​D.
  3. Duality on ZZZZZZ (eq. (1.5)): DZj−1Zj=Xj−1 D\mathsf D Z_{j-1}Z_j=X_{j-1}\,\mathsf DDZj−1​Zj​=Xj−1​D.
  4. Absorbing η\etaη (eqs. (1.4), (2.65)): Dη=ηD=D\mathsf D\eta=\eta\mathsf D=\mathsf DDη=ηD=D.
  5. Translation and adjoint (eq. (2.65), Table 1): TD=DTT\mathsf D=\mathsf DTTD=DT and D†=DT\mathsf D^\dagger=\mathsf DTD†=DT.
  6. Non-invertibility (§1.1): D\mathsf DD is not a unit, and ker⁡D≠0\ker\mathsf D\neq0kerD=0.

Significance

The result. The goal identity is the defining relation of the lattice Kramers–Wannier symmetry. Together with milestones 4–5 it shows that D/2\mathsf D/\sqrt2D/2​ restricted to the η\etaη-even sector squares to a translation, so D\mathsf DD is a square root of T−1T^{-1}T−1 there. The paper uses this to derive its LSM-type constraint, and also to show that the lattice symmetry is not a fusion category, because the continuum rule N2=1+η\mathcal N^2=1+\etaN2=1+η only emerges at low energy. Milestones 2–3 are the lattice Kramers–Wannier map on Z2\mathbb Z_2Z2​-invariant operators, so D\mathsf DD commutes with the critical Ising Hamiltonian H=−∑j(Zj−1Zj+Xj)H=-\sum_j(Z_{j-1}Z_j+X_j)H=−∑j​(Zj−1​Zj​+Xj​).

Formalizing it. The identities are proved in the physics literature by tensor-network manipulations ((F.14)–(F.18)) and checked numerically, but none of this is machine-checked. This mission produces a reusable Lean setup for qubit chains: Pauli strings on (Z/2)L(\mathbb Z/2)^L(Z/2)L, Z2\mathbb Z_2Z2​ and translation symmetries, and an exact non-invertible operator with its full operator algebra for every chain length. No mission on the platform or file in Mathlib currently formalizes a non-invertible lattice symmetry.

Difficulty

Each identity is easy to check for a fixed small LLL by brute force. The content is that it holds for all LLL at once, on a 2L2^L2L-dimensional space. The difficulty is bookkeeping with periodic indices: sums over (Z/2)L(\mathbb Z/2)^L(Z/2)L of characters (−1)⟨t, ⋅⟩(-1)^{\langle t,\,\cdot\rangle}(−1)⟨t,⋅⟩, reindexing k↦k±1k\mapsto k\pm1k↦k±1 in Fin L (including L=1L=1L=1, where k+1=kk+1=kk+1=k, and L=2L=2L=2, where k+1=k−1k+1=k-1k+1=k−1), and the exact normalisation 2−L/22^{-L/2}2−L/2, so that the right-hand side carries no stray factor 2L2^L2L. The goal also involves the matrix inverse T−1T^{-1}T−1, so a proof must establish that TTT is invertible rather than rely on Lean's junk value.

Formalization scope

  • Representation. Operators are Matrix (Fin L → ZMod 2) (Fin L → ZMod 2) ℂ; products are matrix products; T−1T^{-1}T−1 is Mathlib's matrix inverse (transl L)⁻¹; †\dagger† is conjTranspose. Every theorem assumes [NeZero L], i.e. L≥1L\ge1L≥1.
  • Conventions committed to. Zj=(−1)sjZ_j=(-1)^{s_j}Zj​=(−1)sj​ on basis states, translation to the right (sk′=sk−1s'_k=s_{k-1}sk′​=sk−1​), and D\mathsf DD normalised by 2−L/22^{-L/2}2−L/2 as in eqs. (1.4)/(2.65). Other conventions (left translation, unnormalised D\mathsf DD) change the statements to TTT instead of T−1T^{-1}T−1 or add a factor 2L2^L2L; the conventions here reproduce the paper's equations verbatim.
  • No trivialisation. kwD is an explicit formula, not a hypothesis. The goal fixes both sides completely, and milestone 1 pins the translation convention against eq. (2.10).
  • Out of scope. The defect Hamiltonians, the MPO presentation (2.64) itself, the Z2\mathbb Z_2Z2​- and duality-twisted operators of §§2.3.3–2.3.4, and the LSM constraint of §4.
  • Reusable. Pauli operators, translation and η\etaη on qubit chains; character-sum lemmas over (Z/2)L(\mathbb Z/2)^L(Z/2)L. Contributions of general Mathlib lemmas on Walsh–Hadamard-type sums are welcome.

Selected references

  • H. A. Kramers, G. H. Wannier, Statistics of the Two-Dimensional Ferromagnet. Part I, Phys. Rev. 60, 252–262 (1941). doi:10.1103/PhysRev.60.252
  • J. Fröhlich, J. Fuchs, I. Runkel, C. Schweigert, Kramers–Wannier duality from conformal defects, Phys. Rev. Lett. 93, 070601 (2004). arXiv:cond-mat/0404051
  • D. Aasen, R. S. K. Mong, P. Fendley, Topological Defects on the Lattice I: The Ising model, J. Phys. A 49, 354001 (2016). arXiv:1601.07185
  • N. Seiberg, S.-H. Shao, Majorana chain and Ising model – (non-invertible) translations, anomalies, and emanant symmetries, SciPost Phys. 16, 064 (2024). arXiv:2307.02534
  • S.-H. Shao, What's Done Cannot Be Undone: TASI Lectures on Non-Invertible Symmetries (2023). arXiv:2308.00747
  • Source: N. Seiberg, S. Seifnashri, S.-H. Shao, Non-invertible symmetries and LSM-type constraints on a tensor product Hilbert space, SciPost Phys. 16, 154 (2024). arXiv:2401.12281
8 thms2 active usersReviewed
🏆Completed
Dynamical Systems·Captain: Lucas

Dynamic Stochastic General Equilibrium I: The Taylor Principle and DeterminacyTextbook

Motivation

Dynamic stochastic general equilibrium (DSGE) models are the standard framework used by central banks and fiscal authorities for policy analysis and forecasting (Wikipedia overview). The models used for monetary-policy analysis are built from three interrelated blocks — demand, supply and a monetary-policy rule — that jointly determine output, inflation and the nominal interest rate. The canonical small-scale instance is the three-equation New Keynesian model (Woodford 2003; Galí 2008; Clarida, Galí and Gertler 1999).

A basic question about such a model is whether it pins down a unique equilibrium path at all. If many bounded paths solve the model, the model makes no definite prediction and expectations can become self-fulfilling. The answer for the three-equation model is the Taylor principle: the interest-rate rule must respond to inflation strongly enough.

Timeline. Blanchard and Kahn (1980) gave the eigenvalue-counting criterion for existence and uniqueness of bounded solutions of linear rational-expectations models. Kydland and Prescott (1982) started the real-business-cycle/DSGE programme. Rotemberg and Woodford (1997) introduced the New Keynesian DSGE framework. Bullard and Mitra (2002) derived the explicit determinacy condition κ(ϕπ−1)+(1−β)ϕy>0\kappa(\phi_\pi - 1) + (1-\beta)\phi_y > 0κ(ϕπ​−1)+(1−β)ϕy​>0 for the model with a contemporaneous Taylor rule, presented in textbook form by Galí (2008, Ch. 3).

Setting

Time is discrete, t=0,1,2,…t = 0, 1, 2, \dotst=0,1,2,…. All variables are deviations from the zero-inflation steady state: yty_tyt​ is the output gap, πt\pi_tπt​ inflation, and iti_tit​ the nominal interest rate. The parameters are σ>0\sigma > 0σ>0 (inverse elasticity of intertemporal substitution), β∈(0,1)\beta \in (0,1)β∈(0,1) (discount factor), κ>0\kappa > 0κ>0 (slope of the Phillips curve), and the policy coefficients ϕπ,ϕy≥0\phi_\pi, \phi_y \ge 0ϕπ​,ϕy​≥0.

A triple of real sequences (y,π,i)(y, \pi, i)(y,π,i) is an equilibrium if for every ttt

yt=yt+1−1σ(it−πt+1)(demand: dynamic IS curve)πt=βπt+1+κyt(supply: New Keynesian Phillips curve)it=ϕππt+ϕyyt(monetary policy: Taylor rule).\begin{aligned} y_t &= y_{t+1} - \tfrac{1}{\sigma}(i_t - \pi_{t+1}) && \text{(demand: dynamic IS curve)}\\ \pi_t &= \beta \pi_{t+1} + \kappa y_t && \text{(supply: New Keynesian Phillips curve)}\\ i_t &= \phi_\pi \pi_t + \phi_y y_t && \text{(monetary policy: Taylor rule).} \end{aligned}yt​πt​it​​=yt+1​−σ1​(it​−πt+1​)=βπt+1​+κyt​=ϕπ​πt​+ϕy​yt​​​(demand: dynamic IS curve)(supply: New Keynesian Phillips curve)(monetary policy: Taylor rule).​

The demand equation is the log-linearised consumption Euler equation, which equates marginal utility of consumption today with discounted marginal utility tomorrow. The model is determinate if the zero path is its only equilibrium in which yyy, π\piπ and iii all stay bounded.

Formalization targets

Goal: the Taylor principle

For σ>0\sigma > 0σ>0, 0<β<10 < \beta < 10<β<1, κ>0\kappa > 0κ>0, ϕπ,ϕy≥0\phi_\pi, \phi_y \ge 0ϕπ​,ϕy​≥0:

the model is determinate  ⟺  κ(ϕπ−1)+(1−β)ϕy>0.\text{the model is determinate} \iff \kappa(\phi_\pi - 1) + (1 - \beta)\phi_y > 0 .the model is determinate⟺κ(ϕπ​−1)+(1−β)ϕy​>0.

Milestones

  1. Consumption Euler equation. At an interior optimum of the two-period consumption–saving problem, u′(c0)=β(1+r)u′(c1)u'(c_0) = \beta(1+r)u'(c_1)u′(c0​)=β(1+r)u′(c1​).
  2. State-space form. For σ,β≠0\sigma, \beta \ne 0σ,β=0, the model is equivalent to (yt+1,πt+1)⊤=M(yt,πt)⊤(y_{t+1}, \pi_{t+1})^\top = M(y_t, \pi_t)^\top(yt+1​,πt+1​)⊤=M(yt​,πt​)⊤ together with the Taylor rule, for an explicit 2×22\times22×2 matrix MMM.
  3. Equilibria are parametrised by initial conditions. Each (y0,π0)(y_0, \pi_0)(y0​,π0​) determines exactly one equilibrium.
  4. Schur–Cohn test. For real TTT and D>0D > 0D>0, both roots of z2−Tz+Dz^2 - Tz + Dz2−Tz+D have modulus >1> 1>1 iff D>1D > 1D>1 and ∣T∣<1+D|T| < 1 + D∣T∣<1+D.
  5. Blanchard–Kahn lemma. For a real square matrix MMM, the only bounded solution of xt+1=Mxtx_{t+1} = Mx_txt+1​=Mxt​ is zero iff every complex eigenvalue of MMM has modulus >1> 1>1.

Significance

The result itself. The Taylor principle is the standard criterion for whether an interest-rate rule yields a well-defined equilibrium in New Keynesian models, and it is the first property checked when a policy rule is proposed. The determinacy region it describes is the starting point for the analysis of optimal policy and of learnability (Bullard and Mitra 2002).

Formalizing it. The result is classical and proved on paper. This mission formalizes the known argument. The mission produces a reusable Lean definition of the basic New Keynesian model, a general lemma on bounded orbits of linear recursions (which applies to any linear rational-expectations model with only forward-looking variables), and a formal Schur–Cohn criterion for real quadratics.

Difficulty

The economic content is elementary, but the obvious argument skips the hardest step. Textbook treatments state "determinacy holds iff both eigenvalues lie outside the unit circle" without proof, and the equivalence between "no nonzero bounded solution" and an eigenvalue condition has to be established for real sequences while the eigenvalues may be complex. In particular the converse direction needs a real bounded solution built from a complex eigenvector, and the boundary case of eigenvalues on the unit circle must come out on the non-determinate side. The parameter translation also has to handle complex-conjugate eigenvalues, not only real ones.

Formalization scope

  • Sequences are functions N→R\mathbb N \to \mathbb RN→R; the model is the deterministic (shock-free) version, so there are no expectation operators. Stochastic shocks do not change the determinacy condition, but that extension is outside the scope of this mission.
  • "Bounded" means a single real bound for all ttt; determinacy requires yyy, π\piπ and iii to be bounded. Boundedness of iii follows from that of yyy and π\piπ, so this adds no restriction.
  • Division is Lean's total division; every statement that divides by σ\sigmaσ or β\betaβ assumes they are nonzero (or positive).
  • Eigenvalues are complex roots of the characteristic polynomial of the complexified matrix.
  • The goal is not trivial: the zero path is always an equilibrium, determinacy is a genuine uniqueness claim, and the parameter hypotheses are satisfiable (e.g. σ=1\sigma = 1σ=1, β=0.99\beta = 0.99β=0.99, κ=0.1\kappa = 0.1κ=0.1, ϕπ=1.5\phi_\pi = 1.5ϕπ​=1.5, ϕy=0.5\phi_y = 0.5ϕy​=0.5).
  • All declarations live in the namespace DSGE. Contributions of general linear-recursion and polynomial-root lemmas are welcome.

Selected references

  • Wikipedia, Dynamic stochastic general equilibrium. https://en.wikipedia.org/wiki/Dynamic_stochastic_general_equilibrium
  • O. J. Blanchard and C. M. Kahn, The Solution of Linear Difference Models under Rational Expectations, Econometrica 48(5), 1980. https://doi.org/10.2307/1912186
  • F. E. Kydland and E. C. Prescott, Time to Build and Aggregate Fluctuations, Econometrica 50(6), 1982. https://doi.org/10.2307/1913386
  • R. Clarida, J. Galí and M. Gertler, The Science of Monetary Policy: A New Keynesian Perspective, Journal of Economic Literature 37(4), 1999. https://doi.org/10.1257/jel.37.4.1661
  • J. Bullard and K. Mitra, Learning about Monetary Policy Rules, Journal of Monetary Economics 49(6), 2002. https://doi.org/10.1016/S0304-3932(02)00144-7
  • M. Woodford, Interest and Prices: Foundations of a Theory of Monetary Policy, Princeton University Press, 2003.
  • J. Galí, Monetary Policy, Inflation, and the Business Cycle, Princeton University Press, 2008 (Chapter 3).
7 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

Three Conjectures in Extremal Spectral Graph Theory 2: For Large n, K₂ + Pₙ₋₂ Is the Unique Planar Graph on n Vertices of Maximum Spectral Radius (Boots–Royle / Cao–Vince Conjecture)Research Paper

Motivation

The spectral radius of a graph, the largest eigenvalue of its adjacency matrix, measures how densely and how unevenly the edges of the graph are distributed. Asking which graph in a class maximizes it is a spectral analogue of the extremal question "which graph in the class has the most edges". For planar graphs the question has a long history in spectral graph theory, going back at least to Schwenk and Wilson. It also arose in geography, where the spectral radius serves as a measure of the connectivity of planar networks. To compare real networks with a theoretical upper bound, geographers wanted the planar graph of maximum spectral radius (arXiv:1606.01916v2, p. 3).

Timeline, as recorded by Tait and Tobin (pp. 1–3):

  • 1978, Schwenk and Wilson: early study of the eigenvalues of planar graphs.
  • 1991, Boots and Royle, and independently 1993, Cao and Vince: conjecture that the planar graph on n≥9n \ge 9n≥9 vertices of maximum spectral radius is P2+Pn−2P_2 + P_{n-2}P2​+Pn−2​ (Conjecture 1 of the paper). The conjecture is false for n∈{7,8}n \in \{7, 8\}n∈{7,8}, so some lower bound on nnn is necessary (p. 2).
  • 1988–2000: successive improvements of the upper bound on the spectral radius of planar graphs, by Hong (1988, 1995, 1998), Cao and Vince (1993), Guiduli (1996) and Ellingham and Zha (2000). These bounds do not identify the extremal graph.
  • 2010, Dvořák and Mohar: an upper bound on the spectral radius of planar graphs of given maximum degree.
  • Guiduli and Hayes were reported by Ellingham and Zha to have proved the conjecture for large nnn. The preprint never appeared (p. 3).
  • 2017, Tait and Tobin: proof of the conjecture for all sufficiently large nnn (Theorem 15).

Setting

All graphs are finite and simple. A graph on nnn vertices has vertex set {0,1,…,n−1}\{0, 1, \dots, n-1\}{0,1,…,n−1}. Its adjacency matrix A(G)A(G)A(G) is the n×nn \times nn×n real matrix with entry 111 in position (u,w)(u, w)(u,w) when u∼wu \sim wu∼w and 000 otherwise. Its eigenvalues are real, and the largest is the spectral radius λ1(G)\lambda_1(G)λ1​(G).

A graph is planar if it can be drawn in the plane with vertices as distinct points and edges as simple arcs joining their ends, such that an arc meets no vertex other than its ends and two arcs meet only at common ends.

For graphs GGG and HHH on disjoint vertex sets, the join G+HG + HG+H is the graph on the union of the two vertex sets that keeps every edge of GGG and of HHH and adds every edge between a vertex of GGG and a vertex of HHH. Write K2K_2K2​ for a single edge, PmP_mPm​ for the path on mmm vertices, and K2+Pn−2K_2 + P_{n-2}K2​+Pn−2​ for their join: two adjacent vertices, both joined to every vertex of a path on the remaining n−2n - 2n−2 vertices. The paper also writes it P2+Pn−2P_2 + P_{n-2}P2​+Pn−2​.

A planar graph GGG on nnn vertices is a planar spectral maximizer if λ1(G′)≤λ1(G)\lambda_1(G') \le \lambda_1(G)λ1​(G′)≤λ1​(G) for every planar graph G′G'G′ on the same nnn vertices.

The milestones refer to a leading eigenvector v\mathbf vv of a maximizer, scaled so that every entry is positive and the largest entry is 111, and to a vertex xxx with vx=1\mathbf v_x = 1vx​=1. For a parameter ε>0\varepsilon > 0ε>0 they use the sets L={z:vz>ε}L = \{z : \mathbf v_z > \varepsilon\}L={z:vz​>ε} and S=V(G)∖LS = V(G) \setminus LS=V(G)∖L, the edge counts e(X)e(X)e(X) (edges inside XXX) and e(X,Y)e(X, Y)e(X,Y) (edges between XXX and YYY), and a second vertex www with vw>1−24ε\mathbf v_w > 1 - 24\varepsilonvw​>1−24ε that is adjacent to all but 94εn94\varepsilon n94εn vertices of SSS.

Formalization targets

Goal: Theorem 15

∃N0 ∀n≥N0 ∀G on n vertices:G is a planar spectral maximizer  ⟺  G≅K2+Pn−2.\exists N_0\ \forall n \ge N_0\ \forall G \text{ on } n \text{ vertices}: \quad G \text{ is a planar spectral maximizer} \iff G \cong K_2 + P_{n-2}.∃N0​ ∀n≥N0​ ∀G on n vertices:G is a planar spectral maximizer⟺G≅K2​+Pn−2​.

The threshold N0N_0N0​ is not fixed. The paper proves the statement only for nnn beyond an unspecified bound, and the conjecture's bound n≥9n \ge 9n≥9 remains open. The equivalence encodes "the unique maximizer is K2+Pn−2K_2 + P_{n-2}K2​+Pn−2​": every maximizer is isomorphic to it, and it is itself a maximizer.

Milestones, in the order of the proof

  1. If HHH is a proper spanning subgraph of a connected graph GGG, then λ1(H)<λ1(G)\lambda_1(H) < \lambda_1(G)λ1​(H)<λ1​(G) (§1.2, already proved on the platform).
  2. A planar graph on n≥3n \ge 3n≥3 vertices has no K3,3K_{3,3}K3,3​ subgraph and at most 3n−63n - 63n−6 edges, and each of its bipartite subgraphs has at most 2n−42n - 42n−4 edges (p. 8).
  3. Lemma 8: 2n−4<λ1<6n\sqrt{2n-4} < \lambda_1 < \sqrt{6n}2n−4​<λ1​<6n​.
  4. The counts ∣L∣≤32n−4/ε|L| \le 3\sqrt{2n-4}/\varepsilon∣L∣≤32n−4​/ε, e(S,L)≤2n−4e(S, L) \le 2n - 4e(S,L)≤2n−4, e(S)≤3n−6e(S) \le 3n - 6e(S)≤3n−6, e(L)≤92n−4/εe(L) \le 9\sqrt{2n-4}/\varepsilone(L)≤92n−4​/ε (p. 8).
  5. Lemma 9: ∑z∈Lvz≤ε2n−4+18/ε\sum_{z \in L} \mathbf v_z \le \varepsilon\sqrt{2n-4} + 18/\varepsilon∑z∈L​vz​≤ε2n−4​+18/ε and ∑z∈Svz≤(1+3ε)2n−4\sum_{z \in S} \mathbf v_z \le (1 + 3\varepsilon)\sqrt{2n-4}∑z∈S​vz​≤(1+3ε)2n−4​.
  6. Eq. (7): ∑y∼u, y∈Svy≥(vu−ε)2n−4−18/ε\sum_{y \sim u,\, y \in S} \mathbf v_y \ge (\mathbf v_u - \varepsilon)\sqrt{2n-4} - 18/\varepsilon∑y∼u,y∈S​vy​≥(vu​−ε)2n−4​−18/ε for u∈Lu \in Lu∈L.
  7. Lemma 10: vz>1/6n\mathbf v_z > 1/\sqrt{6n}vz​>1/6n​ for every vertex zzz.
  8. ∣{y∈S:y≁x}∣≤14εn|\{y \in S : y \not\sim x\}| \le 14\varepsilon n∣{y∈S:y∼x}∣≤14εn (p. 10).
  9. Lemma 11: a vertex w∈Lw \in Lw∈L, w≠xw \ne xw=x, with vw>1−24ε\mathbf v_w > 1 - 24\varepsilonvw​>1−24ε and ∣{y∈S:y≁w}∣≤94εn|\{y \in S : y \not\sim w\}| \le 94\varepsilon n∣{y∈S:y∼w}∣≤94εn.
  10. Lemma 12: vu<1/10\mathbf v_u < 1/10vu​<1/10 for every u∉{x,w}u \notin \{x, w\}u∈/{x,w}.
  11. Lemma 13: x∼wx \sim wx∼w.
  12. Lemma 14: every vertex other than xxx and www is adjacent to both.
  13. A planar graph with two distinct vertices adjacent to all other vertices is a spanning subgraph of K2+Pn−2K_2 + P_{n-2}K2​+Pn−2​ (proof of Theorem 15, p. 13).

Significance

The result. Theorem 15 settles the Boots–Royle / Cao–Vince conjecture for all large nnn. It identifies the planar graph of maximum spectral radius exactly, so the theoretical upper bound that the geographic application asks for is λ1(K2+Pn−2)\lambda_1(K_2 + P_{n-2})λ1​(K2​+Pn−2​). Along the way, Lemmas 8–14 describe the eigenvector of the extremal graph: two vertices carry almost all of the eigenvector weight, and every other entry is below 1/101/101/10. The same method proves the outerplanar analogue (Theorem 7, the companion mission of this series).

Formalizing it. The theorem is proved on paper and has no machine-checked proof. Formalizing it needs several pieces that are absent from Mathlib or the platform and are reusable: the edge bound 3n−63n - 63n−6 and the bipartite bound 2n−42n - 42n−4 for topologically planar graphs, the non-planarity of K3,3K_{3,3}K3,3​ and K5K_5K5​ and of their subdivisions, Rayleigh-quotient comparison of spectral radii, and the face structure of maximal planar graphs. Each milestone is a self-contained target.

Difficulty

Counting edges does not separate the candidates. A maximizer can be taken to be a maximal planar graph, so it has exactly 3n−63n - 63n−6 edges. Every maximal planar graph on nnn vertices has the same number of edges, and the standard lower bound λ1≥2∣E∣/n\lambda_1 \ge 2|E|/nλ1​≥2∣E∣/n is the same for all of them. The extremal graph is pinned down only through its eigenvector. One has to show that the weight concentrates on two vertices, which are then forced to be adjacent to each other (Lemma 13) and to every other vertex (Lemma 14). Lemma 13 is the step specific to planarity. It uses the triangular faces of a maximal planar graph to find an edge switch that keeps the graph planar. In the formal setting, planarity is topological, so every planarity fact of the argument (the edge counts, the K3,3K_{3,3}K3,3​ and K5K_5K5​ obstructions, the faces of a triangulation) has to be derived from the drawing.

Formalization scope

  • Graphs are SimpleGraph (Fin n). "GGG is K2+Pn−2K_2 + P_{n-2}K2​+Pn−2​" is a graph isomorphism G ≃g bookPath n, where bookPath n lives on Fin 2 ⊕ Fin (n - 2). It is not an equality on a fixed labelling.
  • λ1\lambda_1λ1​ is the published WangKangXue.SpectralTuran.specRad, the largest eigenvalue of the real adjacency matrix.
  • Planarity is the published topological RobertsonSeymour1986.GM5.IsPlanar: a drawing by simple arcs. It is not replaced by K5K_5K5​/K3,3K_{3,3}K3,3​-minor-freeness or by an edge count, either of which would change the class the maximum ranges over.
  • Extremality is IsSpecMax IsPlanar G: GGG is planar and λ1(G′)≤λ1(G)\lambda_1(G') \le \lambda_1(G)λ1​(G′)≤λ1​(G) for every planar G′G'G′ on Fin n. Every milestone from Lemma 8 to Lemma 14 assumes it. These lemmas are false for an arbitrary planar graph, so a statement that drops the hypothesis, or replaces it by a property implying the conclusion, is not acceptable.
  • The eigenvector is universally quantified: every v\mathbf vv with Av=λ1vA\mathbf v = \lambda_1 \mathbf vAv=λ1​v, all entries positive, all entries at most 111, and every xxx with vx=1\mathbf v_x = 1vx​=1. Such a vector exists because the maximizer is connected (Perron–Frobenius). A statement that only asserts the existence of some eigenvector is weaker and is ruled out.
  • Quantifiers. "For nnn sufficiently large" is ∃N ∀n≥N\exists N\ \forall n \ge N∃N ∀n≥N, and NNN may depend on ε\varepsilonε. Milestones 4–8 hold for every ε>0\varepsilon > 0ε>0. Lemmas 11–14 hold for 0<ε<ε00 < \varepsilon < \varepsilon_00<ε<ε0​ with an unspecified ε0\varepsilon_0ε0​, because the paper chooses ε\varepsilonε small. The quantifier on ε\varepsilonε is always outermost, so ε\varepsilonε never depends on nnn or GGG. Lemmas 12–14 hold for every vertex www satisfying the conclusion of Lemma 11 (the predicate IsSecondHub), with the constants 242424 and 949494.
  • Added hypotheses. n≥3n \ge 3n≥3 in the planar facts and in Lemma 8, where the paper's standing "nnn large enough" is needed only to that extent. The page names the vertex of Lemma 12 vvv, the same letter as the eigenvector; it is renamed uuu. Lemma 14's set AAA is stated in unfolded form.
  • Infrastructure that a complete development needs: Euler's formula for topologically planar graphs, the non-planarity of K3,3K_{3,3}K3,3​ and K5K_5K5​, Perron–Frobenius for connected graphs, and the Rayleigh quotient. Proofs of the planar facts (milestone 2) are reusable well beyond this mission. Contributions toward any of them are welcome.

Selected references

  • M. Tait and J. Tobin, Three conjectures in extremal spectral graph theory, J. Combin. Theory Ser. B (2017). Preprint arXiv:1606.01916v2. https://arxiv.org/abs/1606.01916, DOI https://doi.org/10.1016/j.jctb.2017.04.006
  • B. N. Boots and G. F. Royle, A conjecture on the maximum value of the principal eigenvalue of a planar graph, Geographical Analysis 23(3) (1991), 276–282.
  • D. Cao and A. Vince, The spectral radius of a planar graph, Linear Algebra Appl. 187 (1993), 251–257.
  • A. J. Schwenk and R. J. Wilson, On the eigenvalues of a graph, in: Selected Topics in Graph Theory, Academic Press, 1978, 307–336.
  • Hong Yuan, A bound on the spectral radius of graphs, Linear Algebra Appl. 108 (1988), 135–139.
  • M. N. Ellingham and X. Zha, The spectral radius of graphs on surfaces, J. Combin. Theory Ser. B 78(1) (2000), 45–56.
  • Z. Dvořák and B. Mohar, Spectral radius of finite and infinite planar graphs and of graphs of bounded genus, J. Combin. Theory Ser. B 100(6) (2010), 729–739.

Bibliographic data as given in the bibliography of Tait and Tobin (pp. 21–23).

21 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

Three Conjectures in Extremal Spectral Graph Theory 1: For Large n, K₁ + Pₙ₋₁ Is the Unique Outerplanar Graph on n Vertices of Maximum Spectral Radius (Cvetković–Rowlinson Conjecture)Research Paper

Motivation

The spectral radius λ1(G)\lambda_1(G)λ1​(G) of a graph GGG, the largest eigenvalue of its adjacency matrix, is a standard measure of how densely and how centrally a graph is connected. A classical theme of spectral graph theory asks, for a natural family of graphs, which member of the family on nnn vertices maximizes λ1\lambda_1λ1​. For planar graphs this question was raised by geographers comparing road and transport networks, and for outerplanar graphs it was posed by Cvetković and Rowlinson in their 1990 survey of the largest eigenvalue of a graph, where they relate it to the study of subfamilies of Hamiltonian graphs.

Conjecture (Cvetković–Rowlinson, 1990). The outerplanar graph on nnn vertices of maximum spectral radius is K1+Pn−1K_1 + P_{n-1}K1​+Pn−1​.

Timeline:

  • 1990. Cvetković and Rowlinson state the conjecture (Linear and Multilinear Algebra 28).
  • 1990. Rowlinson makes partial progress, on the index of certain outerplanar graphs (Ars Combinatoria 29).
  • 1993. Cao and Vince work on the spectral radius of planar graphs and the related conjecture (Linear Algebra Appl. 187).
  • 2001. Zhou, Lin and Hu study the spectral radius of Hamiltonian planar and outerplanar graphs (Tsinghua Science and Technology 6).
  • 2017. Tait and Tobin prove the conjecture for all sufficiently large nnn (arXiv:1606.01916, J. Combin. Theory Ser. B, doi:10.1016/j.jctb.2017.04.006), Theorem 7.

This mission formalizes Section 2 of Tait and Tobin.

Setting

All graphs are finite and simple. An nnn-vertex graph GGG has vertex set V(G)={0,…,n−1}V(G) = \{0, \dots, n-1\}V(G)={0,…,n−1}, adjacency matrix A(G)A(G)A(G), and spectral radius λ1(G)\lambda_1(G)λ1​(G), the largest eigenvalue of the real symmetric matrix A(G)A(G)A(G). Write dud_udu​ for the degree of a vertex uuu and N(u)N(u)N(u) for its neighbourhood.

A plane drawing of GGG places the vertices at distinct points of R2\mathbb R^2R2 and each edge as a simple arc between its ends; an arc passes through no other vertex, and two arcs meet only at a common end. The union of the vertex points and arcs is a compact set, so its complement has exactly one unbounded connected component, the outer face. A graph is outerplanar if it has a plane drawing in which every vertex lies on the boundary of the outer face.

The join G+HG + HG+H of two graphs is their disjoint union together with all edges between them. The fan K1+Pn−1K_1 + P_{n-1}K1​+Pn−1​ is a single vertex joined to every vertex of a path on n−1n-1n−1 vertices; it is outerplanar and has 2n−32n-32n−3 edges.

An outerplanar graph GGG on nnn vertices is a spectral maximizer if λ1(G′)≤λ1(G)\lambda_1(G') \le \lambda_1(G)λ1​(G′)≤λ1​(G) for every outerplanar graph G′G'G′ on the same nnn vertices.

Several milestones refer to a Perron vector: an eigenvector v\mathbf vv of A(G)A(G)A(G) for λ1\lambda_1λ1​ with all entries positive, normalized so that its maximum entry is 111, together with a vertex xxx with vx=1\mathbf v_x = 1vx​=1. For a connected graph such a vector exists by the Perron–Frobenius theorem.

Formalization targets

Goal: Theorem 7

There is NNN such that for every n≥Nn \ge Nn≥N and every graph GGG on nnn vertices,

G is an outerplanar spectral maximizer  ⟺  G≅K1+Pn−1.G \text{ is an outerplanar spectral maximizer} \iff G \cong K_1 + P_{n-1}.G is an outerplanar spectral maximizer⟺G≅K1​+Pn−1​.

The forward direction is the paper's Theorem 7; the converse says that the fan is the maximizer, as the conjecture reads. The threshold NNN is left unspecified, as in the paper.

Milestones

The milestones follow the proof in Section 2, in order:

  1. a strict subgraph of a connected graph has strictly smaller λ1\lambda_1λ1​ (already proved on the platform);
  2. an outerplanar graph on n≥2n \ge 2n≥2 vertices has at most 2n−32n-32n−3 edges and no K2,3K_{2,3}K2,3​ subgraph;
  3. Lemma 3: for n≥3n \ge 3n≥3 a spectral maximizer has λ1>n−1\lambda_1 > \sqrt{n-1}λ1​>n−1​;
  4. Lemma 4: du>vun−11nd_u > \mathbf v_u n - 11\sqrt ndu​>vu​n−11n​ for every vertex uuu;
  5. Lemma 5: for nnn large, dx>n−11nd_x > n - 11\sqrt ndx​>n−11n​ and vu<C1/n\mathbf v_u < C_1/\sqrt nvu​<C1​/n​ for every u≠xu \ne xu=x, with an absolute constant C1C_1C1​;
  6. Lemma 6: for nnn large, ∑z∈Bvz<C2/n\sum_{z\in B}\mathbf v_z < C_2/\sqrt n∑z∈B​vz​<C2​/n​, where B=V(G)∖(N(x)∪{x})B = V(G)\setminus(N(x)\cup\{x\})B=V(G)∖(N(x)∪{x});
  7. for nnn large, B=∅B = \emptysetB=∅: xxx is adjacent to every other vertex;
  8. an outerplanar graph with a vertex adjacent to all others is a spanning subgraph of K1+Pn−1K_1 + P_{n-1}K1​+Pn−1​.

Significance

The theorem settles, for all large nnn, a conjecture that had been open since 1990 and had resisted several partial attacks. The same paper settles, in the same framework, the planar analogue (the Boots–Royle and Cao–Vince conjecture, K2+Pn−2K_2 + P_{n-2}K2​+Pn−2​) and a conjecture on spectral irregularity. The outerplanar case is the shortest of the three.

On the formal side, the result is proved on paper but has no machine-checked proof. Completing the mission produces a formal theory of outerplanar plane drawings (edge bound, K2,3K_{2,3}K2,3​-freeness, outerplanarity of the fan), eigenvector estimates for extremal graphs, and the full extremal theorem. The edge bound and the K2,3K_{2,3}K2,3​ exclusion are reusable for any later work on outerplanar or series–parallel graphs. Determining the exact threshold NNN, or proving the statement for every n≥2n \ge 2n≥2, would be a strengthening beyond the paper.

Difficulty

There are two separate difficulties. The first is topological: the facts about outerplanar graphs that the spectral argument uses (at most 2n−32n-32n−3 edges, no K2,3K_{2,3}K2,3​ subgraph, no cycle in G−xG - xG−x when xxx dominates, outerplanarity of the fan) are folklore on paper but require a Jordan-curve-type argument about plane drawings, of which Mathlib currently contains very little. The second is spectral: the edge-switching step that proves B=∅B = \emptysetB=∅ compares λ1\lambda_1λ1​ of two graphs through the Rayleigh quotient, and needs a positive Perron vector and the variational characterization of the largest eigenvalue for symmetric matrices. A purely combinatorial edge-maximization argument does not work: the fan is not the only outerplanar graph with 2n−32n-32n−3 edges, so maximizing the number of edges does not identify the spectral maximizer.

Formalization scope

  • Graphs are SimpleGraph (Fin n); λ1\lambda_1λ1​ is the published WangKangXue.SpectralTuran.specRad, the largest eigenvalue of G.adjMatrix ℝ.
  • Outerplanarity is topological: a published RobertsonSeymour1986.GM5.PlaneDrawing with every vertex point in the closure of the unbounded component of the complement of the drawing. It is not replaced by a forbidden-minor characterization; such characterizations are theorems about outerplanarity, and would change which graphs compete in the maximization.
  • Extremality is IsSpecMax IsOuterplanar G: GGG is outerplanar and no outerplanar graph on the same vertex set has larger λ1\lambda_1λ1​. It is never weakened to a comparison with the fan.
  • "GGG is K1+Pn−1K_1 + P_{n-1}K1​+Pn−1​" is a graph isomorphism G ≃g fan n, with the fan on Fin 1 ⊕ Fin (n - 1).
  • Perron-vector statements quantify over every positive eigenvector for λ1\lambda_1λ1​ with maximum entry 111 and every vertex xxx with vx=1\mathbf v_x = 1vx​=1; existential quantification over v\mathbf vv would be weaker.
  • "For some absolute constant" is an existential quantifier placed before the threshold, the graph and the vector; "for nnn sufficiently large" is ∃ N, ∀ n ≥ N.
  • Added hypotheses, each forced by a degenerate case: n≥2n \ge 2n≥2 for the edge bound (the bound 2n−32n-32n−3 is negative below), n≥3n \ge 3n≥3 for Lemma 3 (it fails for n=2n = 2n=2, where the maximizer K2K_2K2​ has λ1=1=n−1\lambda_1 = 1 = \sqrt{n-1}λ1​=1=n−1​).

A complete development needs the Perron–Frobenius theorem for symmetric nonnegative matrices and the Rayleigh quotient characterization of λ1\lambda_1λ1​, both of general use; the theory of outerplanar drawings; and the counting arguments of the lemmas. Contributions to any of these layers are welcome, as are independent proofs of the outerplanar facts from the drawing definition.

Selected references

  • M. Tait and J. Tobin, Three conjectures in extremal spectral graph theory, J. Combin. Theory Ser. B (2017), https://doi.org/10.1016/j.jctb.2017.04.006; preprint arXiv:1606.01916v2, https://arxiv.org/abs/1606.01916
  • D. Cvetković and P. Rowlinson, The largest eigenvalue of a graph: a survey, Linear and Multilinear Algebra 28 (1990), 3–33.
  • P. Rowlinson, On the index of certain outerplanar graphs, Ars Combinatoria 29 (1990), 221–225.
  • D. Cao and A. Vince, The spectral radius of a planar graph, Linear Algebra Appl. 187 (1993), 251–257.
  • J. Zhou, C. Lin and G. Hu, Spectral radius of Hamiltonian planar graphs and outerplanar graphs, Tsinghua Science and Technology 6 (2001), 350–354.
12 thms2 active usersReviewed
🏆Completed
Algebraic TopologyCombinatorics·Captain: mikedeng1

Isoperimetric Inequalities in Simplicial Complexes 1: For a Finite d-Complex with a Complete Skeleton, the Spectral Gap Is at Most the Cheeger Constant, λ(X) ≤ h(X)Research Paper

Motivation

For a finite graph, the Cheeger constant measures how hard it is to cut the vertex set into two pieces, and the spectral gap of the graph Laplacian measures how fast random walks mix. The two Cheeger inequalities (Dodziuk 1984; Alon and Milman 1985; Alon 1986) bound each quantity by a function of the other, and they underlie the theory of expander graphs, with uses in derandomization, error-correcting codes and the analysis of Markov chains.

High-dimensional expanders extend this theory from graphs to simplicial complexes. Linial and Meshulam (2006) and Gromov (2010) introduced combinatorial and topological notions of expansion for complexes; the spectral side is Eckmann's discrete Hodge theory (1944), in which each dimension carries its own Laplacian. Parzanchevski, Rosenthal and Tessler (arXiv:1207.0638, Combinatorica 2015) defined a ddd-dimensional Cheeger constant h(X)h(X)h(X) through partitions of the vertices into d+1d+1d+1 blocks and proved the analogue of the upper Cheeger inequality, λ(X)≤h(X)\lambda(X)\le h(X)λ(X)≤h(X), for complexes with a complete skeleton. This mission formalizes that theorem.

Setting

Let V={0,1,…,n−1}V=\{0,1,\dots,n-1\}V={0,1,…,n−1} and d≥1d\ge1d≥1. A finite ddd-complex with a complete skeleton XXX on VVV consists of all subsets of VVV with at most ddd elements together with a set XdX^dXd of (d+1)(d+1)(d+1)-element subsets, the ddd-cells. A set of j+1j+1j+1 vertices is a jjj-cell; Xd−1X^{d-1}Xd−1 is therefore the set of all ddd-element subsets.

Each cell is oriented by the increasing order of its vertices, σ=[σ0,…,σj]\sigma=[\sigma_0,\dots,\sigma_j]σ=[σ0​,…,σj​] with σ0<⋯<σj\sigma_0<\dots<\sigma_jσ0​<⋯<σj​. The space Ωj\Omega^{j}Ωj of jjj-forms consists of the real functions on jjj-cells, with inner product

⟨f,g⟩=∑σ∈Xjf(σ)g(σ).\langle f,g\rangle=\sum_{\sigma\in X^{j}}f(\sigma)g(\sigma).⟨f,g⟩=σ∈Xj∑​f(σ)g(σ).

The co-boundary ∂d∗:Ωd−1→Ωd\partial_d^*:\Omega^{d-1}\to\Omega^d∂d∗​:Ωd−1→Ωd and the boundaries ∂d:Ωd→Ωd−1\partial_d:\Omega^d\to\Omega^{d-1}∂d​:Ωd→Ωd−1, ∂d−1:Ωd−1→Ωd−2\partial_{d-1}:\Omega^{d-1}\to\Omega^{d-2}∂d−1​:Ωd−1→Ωd−2 are

(∂d∗f)(τ)=∑i=0d(−1)if(τ∖τi),(∂jg)(σ)=∑v∼σg([v,σ0,…,σj−1]),(\partial_d^*f)(\tau)=\sum_{i=0}^d(-1)^i f(\tau\setminus\tau_i),\qquad (\partial_j g)(\sigma)=\sum_{v\sim\sigma}g([v,\sigma_0,\dots,\sigma_{j-1}]),(∂d∗​f)(τ)=i=0∑d​(−1)if(τ∖τi​),(∂j​g)(σ)=v∼σ∑​g([v,σ0​,…,σj−1​]),

where v∼σv\sim\sigmav∼σ means that v∉σv\notin\sigmav∈/σ and {v}∪σ\{v\}\cup\sigma{v}∪σ is a cell, and [v,σ0,… ][v,\sigma_0,\dots][v,σ0​,…] equals (−1)k(-1)^k(−1)k times the increasingly oriented cell when vvv has kkk smaller vertices in σ\sigmaσ. The upper Laplacian is Δ+=∂d∂d∗\Delta^+=\partial_d\partial_d^*Δ+=∂d​∂d∗​ on Ωd−1\Omega^{d-1}Ωd−1, and Zd−1=ker⁡∂d−1Z_{d-1}=\ker\partial_{d-1}Zd−1​=ker∂d−1​ is the space of (d−1)(d-1)(d−1)-cycles.

The spectral gap is the least eigenvalue of Δ+\Delta^+Δ+ on the cycles (Definition 2.1):

λ(X)=min⁡Spec⁡(Δ+∣Zd−1).\lambda(X)=\min\operatorname{Spec}\big(\Delta^+|_{Z_{d-1}}\big).λ(X)=minSpec(Δ+∣Zd−1​​).

For sets A0,…,Ad⊆VA_0,\dots,A_d\subseteq VA0​,…,Ad​⊆V, let F(A0,…,Ad)F(A_0,\dots,A_d)F(A0​,…,Ad​) be the set of ddd-cells with exactly one vertex in each AiA_iAi​. The Cheeger constant is (Definition 1.1)

h(X)=min⁡V=∐i=0dAin⋅∣F(A0,…,Ad)∣∣A0∣⋅∣A1∣⋯∣Ad∣,h(X)=\min_{V=\coprod_{i=0}^dA_i}\frac{n\cdot|F(A_0,\dots,A_d)|}{|A_0|\cdot|A_1|\cdots|A_d|},h(X)=V=∐i=0d​Ai​min​∣A0​∣⋅∣A1​∣⋯∣Ad​∣n⋅∣F(A0​,…,Ad​)∣​,

the minimum over partitions of VVV into nonempty sets A0,…,AdA_0,\dots,A_dA0​,…,Ad​. For d=1d=1d=1, Z0Z_0Z0​ is the space of functions summing to zero, Δ+\Delta^+Δ+ is the graph Laplacian, and hhh is the usual Cheeger constant min⁡A n∣E(A,Aˉ)∣/(∣A∣∣Aˉ∣)\min_{A}\,n|E(A,\bar A)|/(|A||\bar A|)minA​n∣E(A,Aˉ)∣/(∣A∣∣Aˉ∣).

Formalization targets

Goal: Theorem 1.2 (Cheeger Inequality)

λ(X)≤h(X)\lambda(X)\le h(X)λ(X)≤h(X)

for every finite ddd-complex XXX with a complete skeleton on n≥d+1n\ge d+1n≥d+1 vertices.

Milestones

  1. The chain-complex identity ∂d−1∂d=0\partial_{d-1}\partial_d=0∂d−1​∂d​=0 (p. 6).
  2. The form fff of (4.1), built from a partition, is a (d−1)(d-1)(d−1)-cycle (p. 12).
  3. ∂d∗\partial_d^*∂d∗​ is the adjoint of ∂d\partial_d∂d​: ⟨∂dg,f⟩=⟨g,∂d∗f⟩\langle\partial_dg,f\rangle=\langle g,\partial_d^*f\rangle⟨∂d​g,f⟩=⟨g,∂d∗​f⟩ (p. 6).
  4. Rayleigh's principle (4.2): λ(X)⟨f,f⟩≤⟨Δ+f,f⟩=⟨∂d∗f,∂d∗f⟩\lambda(X)\langle f,f\rangle\le\langle\Delta^+f,f\rangle=\langle\partial_d^*f,\partial_d^*f\rangleλ(X)⟨f,f⟩≤⟨Δ+f,f⟩=⟨∂d∗​f,∂d∗​f⟩ for f∈Zd−1f\in Z_{d-1}f∈Zd−1​ (p. 12).
  5. ⟨f,f⟩=n∏i=0d∣Ai∣\langle f,f\rangle=n\prod_{i=0}^d|A_i|⟨f,f⟩=n∏i=0d​∣Ai​∣ for the form (4.1) (p. 13).
  6. (4.3): ∣(∂d∗f)(σ)∣|(\partial_d^*f)(\sigma)|∣(∂d∗​f)(σ)∣ equals nnn for σ∈F(A0,…,Ad)\sigma\in F(A_0,\dots,A_d)σ∈F(A0​,…,Ad​) and 000 for the other ddd-cells (p. 13).
  7. ⟨∂d∗f,∂d∗f⟩=n2∣F(A0,…,Ad)∣\langle\partial_d^*f,\partial_d^*f\rangle=n^2|F(A_0,\dots,A_d)|⟨∂d∗​f,∂d∗​f⟩=n2∣F(A0​,…,Ad​)∣ (p. 14).

Milestones 2 and 5–7 hold for every partition, not only a minimizing one.

Significance

The result. Theorem 1.2 shows that a large spectral gap forces every partition of the vertices into d+1d+1d+1 blocks to be crossed by many ddd-cells, so spectral information certifies combinatorial expansion of a complex. The paper uses it with the spectral analysis of Gundert and Wagner to show that Linial–Meshulam random complexes X(d,n,Clog⁡n/n)X(d,n,C\log n/n)X(d,n,Clogn/n) have Cheeger constant of order log⁡n\log nlogn for large CCC (Corollary 1.3). The paper also shows that the converse direction fails: a triangulation of the Möbius strip has h(X)=114h(X)=1\tfrac14h(X)=141​ but λ(X)=0\lambda(X)=0λ(X)=0, so no lower bound of the form C⋅h(X)m≤λ(X)C\cdot h(X)^m\le\lambda(X)C⋅h(X)m≤λ(X) holds.

Formalizing it. The theorem is proved in the paper; to our knowledge no machine-checked proof exists. A formal proof requires a signed simplicial chain complex with explicit orientations, the adjoint relation between boundary and co-boundary, and a Rayleigh-quotient bound for a symmetric operator on an invariant subspace. These are the basic tools for any further formal work on spectral high-dimensional expansion, including the Mixing Lemma of the same paper (the companion mission of this series).

Difficulty

The graph proof plugs a two-valued test function into the Rayleigh quotient. In dimension ddd the test vector must be a (d−1)(d-1)(d−1)-cycle, and an indicator of a block is not one. The paper's form (4.1) assigns to a (d−1)(d-1)(d−1)-cell whose vertices meet ddd distinct blocks the size of the missing block, with the sign of a permutation of the blocks. Showing that this form is a cycle and that its co-boundary has absolute value exactly nnn on F(A0,…,Ad)F(A_0,\dots,A_d)F(A0​,…,Ad​) and 000 elsewhere is a case analysis over how the vertices of a cell fall into blocks, and every case depends on the orientation signs. A convention error in any of the operators or in the form makes one of these identities fail. A second, smaller difficulty is that λ(X)\lambda(X)λ(X) is a minimum over the spectrum on a subspace, so the Rayleigh bound must be proved for Δ+\Delta^+Δ+ restricted to Zd−1Z_{d-1}Zd−1​, which it preserves.

Formalization scope

  • Vertices are Fin n; a complex is a structure holding its ddd-cells as Finset (Finset (Fin n)), each of size d+1d+1d+1; the complete skeleton is built into the type. Complexes without ddd-cells are allowed.
  • Forms are EuclideanSpace ℝ over the subtype of kkk-element vertex sets, so no form is supported on sets of the wrong size. Ωd\Omega^dΩd is modelled on all (d+1)(d+1)(d+1)-element sets; ∂d∗\partial_d^*∂d∗​ vanishes off XdX^dXd and ∂d\partial_d∂d​ ignores values there.
  • Orientation is by the order of Fin n; the sign of vertex vvv in cell τ\tauτ is (−1)#{w∈τ:w<v}(-1)^{\#\{w\in\tau:w<v\}}(−1)#{w∈τ:w<v}. Boundary and co-boundary are both defined by their formulas; their adjointness is milestone 3.
  • The spectral gap is not defined by sInf. The goal states that some eigenvalue μ\muμ of Δ+\Delta^+Δ+ on Zd−1Z_{d-1}Zd−1​ (a nonzero cycle fff with Δ+f=μf\Delta^+f=\mu fΔ+f=μf) is at most the Cheeger ratio of every partition, which is equivalent to λ(X)≤h(X)\lambda(X)\le h(X)λ(X)≤h(X). A partition is a family A : Fin (d+1) → Finset (Fin n) of nonempty, pairwise disjoint sets covering the vertices.
  • Added hypotheses: d≥1d\ge1d≥1 (the Laplacians act on Ωd−1\Omega^{d-1}Ωd−1) and n≥d+1n\ge d+1n≥d+1 (presupposed by the paper, since hhh minimizes over partitions into d+1d+1d+1 nonempty sets; for n≤dn\le dn≤d the cycle space is 000).
  • Ruled out: forms supported off the ddd-element sets (they would be spurious cycles with eigenvalue 000), an eigenvalue set read through sInf (empty sets give 000), unsigned boundaries (for which ∂∂≠0\partial\partial\ne0∂∂=0), cocycles ker⁡∂d∗\ker\partial_d^*ker∂d∗​ in place of cycles ker⁡∂d−1\ker\partial_{d-1}ker∂d−1​ (on which Δ+\Delta^+Δ+ is zero), and arbitrary disjoint families in place of partitions (empty blocks give ratio 000).
  • Needed infrastructure: sign bookkeeping for faces of sorted finsets, the spectral theorem for symmetric operators on a finite-dimensional inner product space restricted to an invariant subspace (Mathlib's LinearMap.IsSymmetric), and counting cells by blocks of a partition. The chain-complex and adjointness lemmas are reusable in any formal development of simplicial Hodge theory; contributions there are welcome.

Selected references

  • O. Parzanchevski, R. Rosenthal, R. J. Tessler, Isoperimetric inequalities in simplicial complexes, Combinatorica 35 (2015). arXiv:1207.0638v3, doi:10.1007/s00493-014-3002-x
  • B. Eckmann, Harmonische Funktionen und Randwertaufgaben in einem Komplex, Comment. Math. Helv. 17 (1944), no. 1, 240–255.
  • N. Alon, V. D. Milman, λ₁, isoperimetric inequalities for graphs, and superconcentrators, J. Combin. Theory Ser. B 38 (1985), 73–88. doi:10.1016/0095-8956(85)90092-9
  • N. Linial, R. Meshulam, Homological connectivity of random 2-complexes, Combinatorica 26 (2006), 475–487. doi:10.1007/s00493-006-0027-9
  • A. Gundert, U. Wagner, On Laplacians of random complexes, Proceedings of the 2012 Symposium on Computational Geometry, ACM, 2012, 151–160.
  • M. Gromov, Singularities, expanders and topology of maps. Part 2: From combinatorics to topology via algebraic isoperimetry, Geom. Funct. Anal. 20 (2010), no. 2, 416–526.
10 thms2 active usersReviewed
🏆Completed
Numerical AnalysisOptimization·Captain: mikedeng1

Optimization-Based Algorithms for Tensor Decompositions: Canonical Polyadic Decomposition, Decomposition in Rank-(Lr, Lr, 1) Terms, and a New Generalization 1: Block Structure of the Gramian JᴴJResearch Paper

Motivation

Tensor decompositions express a multiway array as a sum of simple terms. The canonical polyadic decomposition (CPD) writes an NNN-th order tensor T∈CI1×⋯×IN\mathcal T\in\mathbb C^{I_1\times\cdots\times I_N}T∈CI1​×⋯×IN​ as a sum of RRR outer products of vectors; block term decompositions replace each rank-one term by a term of higher multilinear rank. These models are used in signal processing, blind source separation and telecommunications, and are computed numerically by minimizing a least-squares misfit.

Sorber, Van Barel and De Lathauwer (SIAM J. Optim. 23(2), 2013) introduce the (rank-Lr∘L_r\circLr​∘ rank-1) block term decomposition (BTD), which contains both the CPD and the rank-(Lr,Lr,1)(L_r,L_r,1)(Lr​,Lr​,1) BTD as special cases, and develop optimization algorithms for it: nonlinear conjugate gradient and quasi-Newton methods built on the complex gradient, and Gauss–Newton and Levenberg–Marquardt methods built on the Jacobian. For the second family the central object is the Gramian JHJJ^{\mathrm H}JJHJ of the Jacobian JJJ of the residual. Theorem 4.5 of the paper gives its exact block structure, and that structure is what lets the methods run without ever forming JJJ.

Setting

Fix N=P+QN = P + QN=P+Q modes with dimensions I1,…,INI_1,\dots,I_NI1​,…,IN​, a number of terms RRR, and block sizes L1,…,LRL_1,\dots,L_RL1​,…,LR​; put R′=∑rLrR' = \sum_r L_rR′=∑r​Lr​. The BTD approximates T\mathcal TT by

∑r=1R(∑r′ar′(1)∘⋯∘ar′(P))∘(cr(1)∘⋯∘cr(Q)),\sum_{r=1}^R\Big(\sum_{r'} a^{(1)}_{r'}\circ\cdots\circ a^{(P)}_{r'}\Big)\circ\big(c^{(1)}_r\circ\cdots\circ c^{(Q)}_r\big),r=1∑R​(r′∑​ar′(1)​∘⋯∘ar′(P)​)∘(cr(1)​∘⋯∘cr(Q)​),

where the inner sum runs over the LrL_rLr​ columns of block rrr. Here A(p)=[a1(p)⋯aR′(p)]∈CIp×R′A^{(p)} = [a^{(p)}_1\cdots a^{(p)}_{R'}]\in\mathbb C^{I_p\times R'}A(p)=[a1(p)​⋯aR′(p)​]∈CIp​×R′ and C(q)=[c1(q)⋯cR(q)]∈CIP+q×RC^{(q)} = [c^{(q)}_1\cdots c^{(q)}_R]\in\mathbb C^{I_{P+q}\times R}C(q)=[c1(q)​⋯cR(q)​]∈CIP+q​×R.

The paper reads this as a structured CPD in R′R'R′ rank-one terms. The first PPP factor matrices are the A(p)A^{(p)}A(p), and the last QQQ are

A(P+q)=C(q)⋅E,A^{(P+q)} = C^{(q)}\cdot E,A(P+q)=C(q)⋅E,

where E=diag(11×L1,…,11×LR)∈RR×R′E = \mathrm{diag}(1_{1\times L_1},\dots,1_{1\times L_R})\in\mathbb R^{R\times R'}E=diag(11×L1​​,…,11×LR​​)∈RR×R′ copies column rrr of C(q)C^{(q)}C(q) into the LrL_rLr​ columns of block rrr. The residual tensor is

FBTD=∑c=1R′ac(1)∘⋯∘ac(N)−T,\mathcal F_{\mathrm{BTD}} = \sum_{c=1}^{R'} a^{(1)}_c\circ\cdots\circ a^{(N)}_c - \mathcal T,FBTD​=c=1∑R′​ac(1)​∘⋯∘ac(N)​−T,

and the unknowns are z=(vecA(1),…,vecA(P),vecC(1),…,vecC(Q))z = (\mathrm{vec}A^{(1)},\dots,\mathrm{vec}A^{(P)},\mathrm{vec}C^{(1)},\dots,\mathrm{vec}C^{(Q)})z=(vecA(1),…,vecA(P),vecC(1),…,vecC(Q)). The Jacobian J=∂ vec(FBTD)/∂zTJ = \partial\,\mathrm{vec}(\mathcal F_{\mathrm{BTD}})/\partial z^{\mathrm T}J=∂vec(FBTD​)/∂zT is the complex (holomorphic) derivative: FBTD\mathcal F_{\mathrm{BTD}}FBTD​ is a polynomial in zzz, not in zˉ\bar zzˉ.

Three auxiliary matrices enter the answer. The first is Wσ=∗m∉σA(m)HA(m)W^\sigma = \ast_{m\notin\sigma}A^{(m)\mathrm H}A^{(m)}Wσ=∗m∈/σ​A(m)HA(m), the Hadamard product of the Gramians of the factor matrices outside a mode set σ\sigmaσ, with entries wr1r2σw^\sigma_{r_1r_2}wr1​r2​σ​. The second is F(q)=E⊗IIP+qF^{(q)} = E\otimes\mathbb I_{I_{P+q}}F(q)=E⊗IIP+q​​, which satisfies vec(C(q)E)T=vec(C(q))TF(q)\mathrm{vec}(C^{(q)}E)^{\mathrm T} = \mathrm{vec}(C^{(q)})^{\mathrm T}F^{(q)}vec(C(q)E)T=vec(C(q))TF(q) (Proposition 4.1). The third is the block diagonal Σ=diag(II1R′,…,IIPR′,F(1),…,F(Q))\Sigma = \mathrm{diag}(\mathbb I_{I_1R'},\dots,\mathbb I_{I_PR'},F^{(1)},\dots,F^{(Q)})Σ=diag(II1​R′​,…,IIP​R′​,F(1),…,F(Q)).

Formalization targets

Goal: Theorem 4.5

For every tensor T\mathcal TT and every zzz,

JHJ=Σ⋅[Π(n1,n2)]n1,n2=1N⋅ΣT,J^{\mathrm H}J = \Sigma\cdot\big[\Pi^{(n_1,n_2)}\big]_{n_1,n_2=1}^N\cdot\Sigma^{\mathrm T},JHJ=Σ⋅[Π(n1​,n2​)]n1​,n2​=1N​⋅ΣT, Π(n1,n2)≜(∂ vecF∂ vec(A(n1))T)H(∂ vecF∂ vec(A(n2))T)={W{n}⊗IInn=n1=n2,[wr1r2{n1,n2} ar2(n1)ar1(n2)H]r1,r2otherwise.\Pi^{(n_1,n_2)} \triangleq \Big(\tfrac{\partial\,\mathrm{vec}\mathcal F}{\partial\,\mathrm{vec}(A^{(n_1)})^{\mathrm T}}\Big)^{\mathrm H}\Big(\tfrac{\partial\,\mathrm{vec}\mathcal F}{\partial\,\mathrm{vec}(A^{(n_2)})^{\mathrm T}}\Big) = \begin{cases}W^{\{n\}}\otimes\mathbb I_{I_n} & n=n_1=n_2,\\ \big[w^{\{n_1,n_2\}}_{r_1r_2}\,a^{(n_1)}_{r_2}a^{(n_2)\mathrm H}_{r_1}\big]_{r_1,r_2} & \text{otherwise.}\end{cases}Π(n1​,n2​)≜(∂vec(A(n1​))T∂vecF​)H(∂vec(A(n2​))T∂vecF​)={W{n}⊗IIn​​[wr1​r2​{n1​,n2​}​ar2​(n1​)​ar1​(n2​)H​]r1​,r2​​​n=n1​=n2​,otherwise.​

The goal has two parts, and both are required. The first is that the Gramian of the CPD Jacobian equals the explicit block matrix. The second is the factorization through Σ\SigmaΣ.

Milestones

  1. The columns of the CPD Jacobian are rank-one tensors: ∂F/∂air(n)=ar(1)∘⋯∘ei(n)∘⋯∘ar(N)\partial\mathcal F/\partial a^{(n)}_{ir} = a^{(1)}_r\circ\cdots\circ e^{(n)}_i\circ\cdots\circ a^{(N)}_r∂F/∂air(n)​=ar(1)​∘⋯∘ei(n)​∘⋯∘ar(N)​.
  2. Diagonal blocks: inner products wr1r2{n}δijw^{\{n\}}_{r_1r_2}\delta_{ij}wr1​r2​{n}​δij​, hence the block wr1r2{n}IInw^{\{n\}}_{r_1r_2}\mathbb I_{I_n}wr1​r2​{n}​IIn​​.
  3. Off-diagonal blocks: inner products wr1r2{n1,n2}air2(n1)ajr1(n2)‾w^{\{n_1,n_2\}}_{r_1r_2}a^{(n_1)}_{ir_2}\overline{a^{(n_2)}_{jr_1}}wr1​r2​{n1​,n2​}​air2​(n1​)​ajr1​(n2​)​​, hence the rank-one block wr1r2{n1,n2}ar2(n1)ar1(n2)Hw^{\{n_1,n_2\}}_{r_1r_2}a^{(n_1)}_{r_2}a^{(n_2)\mathrm H}_{r_1}wr1​r2​{n1​,n2​}​ar2​(n1​)​ar1​(n2​)H​.
  4. Proposition 4.1: the vec identity for C(q)EC^{(q)}EC(q)E and the chain rule (4.3b) for the Jacobian columns of C(q)C^{(q)}C(q).
  5. The blocks of JHJJ^{\mathrm H}JJHJ that involve some C(q)C^{(q)}C(q) are ΠF(q)T\Pi F^{(q)\mathrm T}ΠF(q)T, F(q)ΠF^{(q)}\PiF(q)Π and F(q1)ΠF(q2)TF^{(q_1)}\Pi F^{(q_2)\mathrm T}F(q1​)ΠF(q2​)T, i.e. JHJ=Σ (JCPDHJCPD) ΣTJ^{\mathrm H}J = \Sigma\,(J_{\mathrm{CPD}}^{\mathrm H}J_{\mathrm{CPD}})\,\Sigma^{\mathrm T}JHJ=Σ(JCPDH​JCPD​)ΣT.

Significance

With Theorem 4.5, JHJJ^{\mathrm H}JJHJ is determined by the factor matrices and the small Gramians A(n)HA(n)A^{(n)\mathrm H}A^{(n)}A(n)HA(n). For a hypercubical CPD this takes O(NR2)O(NR^2)O(NR2) extra memory instead of the O(N2R2I2)O(N^2R^2I^2)O(N2R2I2) of a dense Gramian. Theorem 4.6 of the paper then turns the same structure into a matrix–vector product in O(NR2I)O(NR^2I)O(NR2I) operations, which is what inexact Gauss–Newton and Levenberg–Marquardt steps solved by preconditioned conjugate gradients require. The block-diagonal part Π(n,n)=W{n}⊗I\Pi^{(n,n)} = W^{\{n\}}\otimes\mathbb IΠ(n,n)=W{n}⊗I also gives the block Jacobi preconditioner of the paper's §4.2. For the CPD, expressions for the Gramian were already studied in chemometrics (the paper cites G. Tomasi's 2006 thesis for this); Theorem 4.5 states the block structure in closed form and extends it to the structured BTD through Σ\SigmaΣ.

The result is proved in the paper. As far as a search of Prove2Me and Mathlib shows, nothing about CPD or BTD Jacobians has been formalized. This mission produces a machine-checked proof of the block structure, starting from an explicit model of the decomposition and an honest complex derivative. That model (outer products, the structured CPD, EEE, Σ\SigmaΣ, the Hadamard-Gramian products) can be reused for the paper's cogradient theorem and for other tensor algorithms.

Difficulty

The identity is finite-dimensional, but no single step reduces it to a known lemma. First, JJJ is a genuine derivative of a multilinear polynomial map in ∑nInR′\sum_n I_nR'∑n​In​R′ complex variables, so each entry has to be computed from the derivative of a sum of products. Second, JHJJ^{\mathrm H}JJHJ is a sum over all ∏nIn\prod_n I_n∏n​In​ multi-indices. Turning it into the product of Gramians in WσW^\sigmaWσ means exchanging a sum of products with a product of sums while one or two modes are held fixed, with the conjugates landing on crossed column indices (ar2(n1)a^{(n_1)}_{r_2}ar2​(n1​)​, aˉr1(n2)\bar a^{(n_2)}_{r_1}aˉr1​(n2​)​). Third, the structured factor matrices A(P+q)=C(q)EA^{(P+q)} = C^{(q)}EA(P+q)=C(q)E are not unknowns. The derivative with respect to C(q)C^{(q)}C(q) has to go through the chain rule and the vec–Kronecker identity, and Σ\SigmaΣ's rows and columns are indexed by different sets.

Formalization scope

All objects are defined in TensorBTD.Gramian.Setting, with the following conventions.

  • Modes and columns. The NNN modes are Fin P ⊕ Fin Q (mode ppp is Sum.inl (p-1) and mode P+qP+qP+q is Sum.inr (q-1)), so all indices are 0-based. The R′R'R′ columns are Σ r : Fin R, Fin (L r) in lexicographic order, which is the order of (3.5).
  • Tensors and residuals. A tensor is a function of the multi-index. The residual is defined entrywise as a sum of outer products. The paper's (3.8) is its mode-nnn unfolding.
  • Vectorization and Kronecker products. Vectorized indices are (column, row) pairs, Mathlib's column-major Matrix.vec. This is the paper's Definition 2.5 with its misprint (i+(j−1)J)(i+(j-1)J)(i+(j−1)J) corrected to (i+(j−1)I)(i+(j-1)I)(i+(j−1)I). Kronecker products are Mathlib's ⊗ₖ.
  • Jacobian. The Jacobian is defined column by column as the complex derivative deriv of t↦G(x+teβ)t\mapsto G(x+te_\beta)t↦G(x+teβ​) at 000. It is not defined by its closed form, and it is not a real derivative.
  • The unstructured CPD. Π(n1,n2)\Pi^{(n_1,n_2)}Π(n1​,n2​) differentiates with respect to A(n)A^{(n)}A(n) for every nnn, including n>Pn>Pn>P, where A(n)A^{(n)}A(n) is not an unknown. It is therefore taken as the Jacobian of the unstructured CPD residual in R′R'R′ terms, with all NNN factor matrices free, evaluated at the factor matrices of zzz. This is how the paper's proof uses it.

There are no hypotheses. The paper's assumptions that P,Q≥1P, Q\ge 1P,Q≥1 and its qualifiers "nonzero" and "rank-LrL_rLr​" are not used in Section 4, so they are dropped. This is a generalization: Q=0Q = 0Q=0 gives the plain CPD in R′R'R′ terms.

A goal that took the closed form of Π\PiΠ as the definition, or that defined JJJ entrywise by the outer-product formula of milestone 1, would only state a sum identity. Both are ruled out: JJJ is a derivative, and the goal asserts that the Gramian of the CPD Jacobian equals the closed form. A misprint in the proof's closing paragraph, F(q)Π(p,P+q)F^{(q)}\Pi^{(p,P+q)}F(q)Π(p,P+q) for the (P+q,p)(P+q,p)(P+q,p) block, is corrected in Lean to F(q)Π(P+q,p)F^{(q)}\Pi^{(P+q,p)}F(q)Π(P+q,p).

Useful Mathlib infrastructure includes Matrix.vec, Matrix.kroneckerMap, Matrix.blockDiagonal', Finset.prod_univ_sum and the derivative rules for finite products (HasDerivAt.finset_prod). General lemmas welcome as contributions: derivatives of multilinear maps along coordinate directions, the sum–product exchange over Fintype.piFinset, and the chain rule for a Jacobian composed with a linear map.

Selected references

  • L. Sorber, M. Van Barel, L. De Lathauwer, Optimization-Based Algorithms for Tensor Decompositions: Canonical Polyadic Decomposition, Decomposition in Rank-(Lr,Lr,1)(L_r,L_r,1)(Lr​,Lr​,1) Terms, and a New Generalization, SIAM J. Optim. 23(2), 695–720, 2013. https://doi.org/10.1137/120868323
  • T. G. Kolda, B. W. Bader, Tensor Decompositions and Applications, SIAM Review 51(3), 455–500, 2009. https://doi.org/10.1137/07070111X
  • L. De Lathauwer, Decompositions of a Higher-Order Tensor in Block Terms — Part II: Definitions and Uniqueness, SIAM J. Matrix Anal. Appl. 30(3), 1033–1066, 2008. https://doi.org/10.1137/070690729
  • L. Sorber, M. Van Barel, L. De Lathauwer, Unconstrained Optimization of Real Functions in Complex Variables, SIAM J. Optim. 22(3), 879–898, 2012. https://doi.org/10.1137/110832124
7 thms2 active usersReviewed
🏆Completed
Numerical AnalysisOptimizationTheoretical Computer Science·Captain: mikedeng1

Low Rank Approximation and Regression in Input Sparsity Time 2: Sketched Multiple-Response Regression Is (1 + 4ε)-Optimal in Squared Error If the Sketch Embeds the Subspace and Approximates ProductsResearch Paper

Motivation

Least-squares regression, min⁡X∥AX−B∥F\min_X\|AX-B\|_FminX​∥AX−B∥F​ for a tall matrix A∈Rn×dA\in\mathbb R^{n\times d}A∈Rn×d with n≫dn\gg dn≫d, is among the most frequently solved problems in numerical computation. Direct methods (QR or SVD) cost O(nd2)O(nd^2)O(nd2) time, which is prohibitive when nnn is in the millions. Sketching replaces the problem by a much smaller one: choose a matrix S∈Rt×nS\in\mathbb R^{t\times n}S∈Rt×n with t≪nt\ll nt≪n, form SASASA and SBSBSB, and solve min⁡X∥S(AX−B)∥F\min_X\|S(AX-B)\|_FminX​∥S(AX−B)∥F​ instead. The question is when the solution of the small problem is nearly optimal for the original one.

Clarkson and Woodruff, Low Rank Approximation and Regression in Input Sparsity Time (STOC 2013; JACM 2017), showed that a very sparse random sketch (one non-zero per column, the CountSketch matrix) can be applied in time proportional to the number of non-zero entries of AAA and still yields (1+ε)(1+\varepsilon)(1+ε)-approximate regression and low-rank approximation. §7 of that paper isolates the deterministic part of the argument: two conditions on a fixed sketch SSS that guarantee a near-optimal solution, whatever distribution produced SSS.

Timeline. Sarlós (FOCS 2006) introduced sketch-and-solve regression with fast Johnson–Lindenstrauss transforms. Drineas, Mahoney, Muthukrishnan and Sarlós (Numer. Math. 2011) stated the structural conditions for single-response regression (their Lemma 1); Theorem 36 of Clarkson–Woodruff generalizes it to multiple responses. Clarkson and Woodruff then supplied the sparse sketches meeting the conditions in input-sparsity time.

Setting

All matrices are real. For a vector vvv let ∥v∥22=∑ivi2\|v\|_2^2=\sum_iv_i^2∥v∥22​=∑i​vi2​; for a matrix MMM let ∥M∥F2=∑i,jMij2\|M\|_F^2=\sum_{i,j}M_{ij}^2∥M∥F2​=∑i,j​Mij2​. Fix A∈Rn×dA\in\mathbb R^{n\times d}A∈Rn×d of rank at most rrr, a right-hand side B∈Rn×d′B\in\mathbb R^{n\times d'}B∈Rn×d′ and a sketch S∈Rt×nS\in\mathbb R^{t\times n}S∈Rt×n. Let C(A)={Ax}C(A)=\{Ax\}C(A)={Ax} be the column space and U∈Rn×kU\in\mathbb R^{n\times k}U∈Rn×k a matrix with orthonormal columns (U⊤U=IU^\top U=IU⊤U=I) spanning C(A)C(A)C(A).

  • Y∗Y^*Y∗ is a least-squares minimizer: it minimizes ∥AY−B∥F2\|AY-B\|_F^2∥AY−B∥F2​ (problem (8)).
  • Y~\tilde YY~ is a sketched minimizer: it minimizes ∥S(AY−B)∥F2\|S(AY-B)\|_F^2∥S(AY−B)∥F2​ (problem (7)).
  • SSS is a subspace embedding for AAA with parameter η\etaη if ∣∥SAx∥22−∥Ax∥22∣≤η∥Ax∥22\bigl|\|SAx\|_2^2-\|Ax\|_2^2\bigr|\le\eta\|Ax\|_2^2​∥SAx∥22​−∥Ax∥22​​≤η∥Ax∥22​ for every xxx.
  • SSS satisfies the approximate matrix multiplication event (Lemma 32) for a pair (U,W)(U,W)(U,W) with error parameter eee if ∥U⊤S⊤SW−U⊤W∥F2≤e2∥U∥F2∥W∥F2\|U^\top S^\top SW-U^\top W\|_F^2\le e^2\|U\|_F^2\|W\|_F^2∥U⊤S⊤SW−U⊤W∥F2​≤e2∥U∥F2​∥W∥F2​.

Formalization targets

Goal: Theorem 36 (p. 24)

If SSS is a subspace embedding for AAA with 0≤η≤1/20\le\eta\le1/20≤η≤1/2 and satisfies the event of Lemma 32 for (U,B−AY∗)(U,B-AY^*)(U,B−AY∗) with error parameter ε/r\sqrt{\varepsilon/r}ε/r​, then every sketched minimizer satisfies

∥AY~−B∥F2≤(1+4ε)∥AY∗−B∥F2.\|A\tilde Y-B\|_F^2\le(1+4\varepsilon)\|AY^*-B\|_F^2 .∥AY~−B∥F2​≤(1+4ε)∥AY∗−B∥F2​.

This is the explicit form the paper's proof establishes; the printed (1+ϵ)(1+\epsilon)(1+ϵ) bound on norms follows after rescaling ε\varepsilonε.

Milestones

  • Fact 34 (Pythagorean theorem): C⊤D=0⇒∥C+D∥F2=∥C∥F2+∥D∥F2C^\top D=0\Rightarrow\|C+D\|_F^2=\|C\|_F^2+\|D\|_F^2C⊤D=0⇒∥C+D∥F2​=∥C∥F2​+∥D∥F2​.
  • Fact 35 (normal equations): C−DC^-DC−D is a minimizer; every minimizer X∗X^*X∗ satisfies C⊤(CX∗−D)=0C^\top(CX^*-D)=0C⊤(CX∗−D)=0 and ∥CX−D∥F2=∥C(X−X∗)∥F2+∥CX∗−D∥F2\|CX-D\|_F^2=\|C(X-X^*)\|_F^2+\|CX^*-D\|_F^2∥CX−D∥F2​=∥C(X−X∗)∥F2​+∥CX∗−D∥F2​.
  • Lemma 37: for AAA with orthonormal columns, ∥A(Y~−Y∗)∥F≤2ε∥B−AY∗∥F\|A(\tilde Y-Y^*)\|_F\le2\sqrt\varepsilon\|B-AY^*\|_F∥A(Y~−Y∗)∥F​≤2ε​∥B−AY∗∥F​.
  • Theorem 39 (affine embeddings, an independent companion result of §7.5): under an embedding with parameter ε≤1/2\varepsilon\le1/2ε≤1/2 and the event of Lemma 32 with parameter ε/r\varepsilon/\sqrt rε/r​, ∥S(AX−B)∥F2−∥SB~∥F2\|S(AX-B)\|_F^2-\|S\tilde B\|_F^2∥S(AX−B)∥F2​−∥SB~∥F2​ equals ∥AX−B∥F2−∥B~∥F2\|AX-B\|_F^2-\|\tilde B\|_F^2∥AX−B∥F2​−∥B~∥F2​ up to ±2ε∥AX−B∥F2\pm2\varepsilon\|AX-B\|_F^2±2ε∥AX−B∥F2​ for all XXX, and ∥S(AX−B)∥F2=(1±3ε)∥AX−B∥F2\|S(AX-B)\|_F^2=(1\pm3\varepsilon)\|AX-B\|_F^2∥S(AX−B)∥F2​=(1±3ε)∥AX−B∥F2​ if SSS also preserves ∥B~∥F2\|\tilde B\|_F^2∥B~∥F2​ to 1±ε1\pm\varepsilon1±ε.

Significance

Theorem 36 separates the algorithm design for sketched regression from its correctness proof: any random construction (CountSketch, subsampled randomized Hadamard transforms, leverage-score sampling, Gaussian matrices) yields a (1+O(ε))(1+O(\varepsilon))(1+O(ε))-approximate regression solver once it is shown to satisfy the two conditions with constant probability. Clarkson and Woodruff use it for their input-sparsity-time regression algorithm (Theorem 38) and, through Theorem 39 and affine embeddings, for low-rank approximation. The same conditions recur throughout the randomized numerical linear algebra literature (see Woodruff's survey Sketching as a Tool for Numerical Linear Algebra, 2014).

The results are proved in the paper (§7.3, §7.5 and Appendix A, p. 37). To our knowledge none has a machine-checked proof. Formalizing them produces a reusable, distribution-free layer of sketching theory: the probabilistic statements about specific sketches can then be proved separately and composed with it.

Difficulty

The obvious argument applies the subspace embedding to the residual AY~−BA\tilde Y-BAY~−B, but that vector does not lie in C(A)C(A)C(A), so an embedding of C(A)C(A)C(A) alone says nothing about it; embedding C(A)C(A)C(A) augmented with the columns of BBB instead costs a sketch dimension that grows with d′d'd′. The hypotheses of Theorem 36 control the optimal residual B−AY∗B-AY^*B−AY∗ only through the approximate-product condition, which is far weaker than norm preservation, and the difficulty is to transfer that control to the sketched solution (Lemma 37) with the constants 2ε2\sqrt\varepsilon2ε​ and 1+4ε1+4\varepsilon1+4ε. A second obstacle is the passage from a general AAA of rank at most rrr to an orthonormal basis UUU of C(A)C(A)C(A): it changes ∥A∥F\|A\|_F∥A∥F​, which is why the approximate-product condition is stated for UUU.

Formalization scope

Matrices are Matrix (Fin m) (Fin n) ℝ; squared norms are explicit sums sqNorm and frobSq; the column space is the range of Matrix.mulVecLin; rank is Matrix.rank. Everything is deterministic: SSS is an arbitrary fixed matrix and no probability space appears. The committed conventions are:

  1. The subspace embedding is in squared form. In Theorem 36 and Lemma 37 its parameter η\etaη plays the paper's ϵ02\epsilon_0^2ϵ02​ (so ϵ0≤1/2\epsilon_0\le1/\sqrt2ϵ0​≤1/2​ becomes η≤1/2\eta\le1/2η≤1/2), which is how the proof of Lemma 37 (p. 37) uses it; in Theorem 39 the parameter is ε\varepsilonε itself, as that proof uses it.
  2. "SSS satisfies Lemma 32" is the event inside the probability, for the pair (U,B−AY∗)(U,B-AY^*)(U,B−AY∗) (resp. (U,B~)(U,\tilde B)(U,B~)) that the proofs use, with ≤\le≤ in place of the printed <<< (a weaker hypothesis).
  3. Y~\tilde YY~, Y∗Y^*Y∗, X∗X^*X∗ are arbitrary minimizers; "the solution" need not be unique. The Moore–Penrose inverse is specified by the four Penrose equations.
  4. r≥1r\ge1r≥1 guards ε/r\varepsilon/rε/r and ε/r\varepsilon/\sqrt rε/r​; "n>dn>dn>d" (§7) concerns running times and is not assumed.

A trivializing formalization is ruled out: Y~\tilde YY~ is never defined as Y∗Y^*Y∗, the approximate-product hypothesis is an inequality and not the exact identity U⊤S⊤S(B−AY∗)=0U^\top S^\top S(B-AY^*)=0U⊤S⊤S(B−AY∗)=0, η\etaη is non-negative, and the goal is stated for general AAA of rank at most rrr, not only for orthonormal AAA. The hypotheses are jointly satisfiable (for instance S=IS=IS=I).

A complete development needs the Frobenius inner product and its Pythagorean identity, the normal equations for matrix least squares, the existence of the Moore–Penrose inverse, and the spectral-norm bound for a symmetric matrix from its quadratic form; all are reusable beyond this mission. Proofs of any milestone, and alternative arguments for Theorem 36, are welcome.

Selected references

  • K. L. Clarkson and D. P. Woodruff, Low Rank Approximation and Regression in Input Sparsity Time, arXiv:1207.6365v4, 2013; J. ACM 64(6), 2017. https://arxiv.org/abs/1207.6365
  • P. Drineas, M. W. Mahoney, S. Muthukrishnan and T. Sarlós, Faster Least Squares Approximation, Numerische Mathematik 117(2), 2011. https://arxiv.org/abs/0710.1435
  • T. Sarlós, Improved Approximation Algorithms for Large Matrices via Random Projections, FOCS 2006. https://doi.org/10.1109/FOCS.2006.37
  • D. P. Woodruff, Sketching as a Tool for Numerical Linear Algebra, Foundations and Trends in Theoretical Computer Science 10(1–2), 2014. https://arxiv.org/abs/1411.4357
7 thms2 active usersReviewed
🏆Completed
Control TheoryDynamical Systems·Captain: mikedeng1

Lyapunov Equations, Energy Functionals, and Model Order Reduction of Bilinear and Stochastic Systems 2: An Explicit Bilinear System Whose Field x ↦ P̃(x)⁻¹x Is Not a Gradient, So (3.8) FailsResearch Paper

Motivation

Balanced truncation reduces a large control system to a small one by discarding the states that are both hard to reach and hard to observe. For linear systems "hard to reach" is measured exactly by the controllability Gramian PPP: the minimal input energy needed to steer the system from 000 to x0x_0x0​ is x0TP−1x0x_0^T P^{-1} x_0x0T​P−1x0​. For bilinear systems, in which the input also multiplies the state, no such exact formula is known, and several papers have tried to describe the nonlinear controllability energy functional EcE_cEc​ through state-dependent Gramians.

Gray and Mesko ([25] in the paper, 1998) and Condon and Ivanov ([11], 2005) stated that, for x≠0x \neq 0x=0 with ∥x∥\|x\|∥x∥ sufficiently small, the gradient of EcE_cEc​ is given by a state-dependent Gramian P~(x)\tilde P(x)P~(x) of the linearization, ∇Ec(x)=P~(x)−1x\nabla E_c(x) = \tilde P(x)^{-1}x∇Ec​(x)=P~(x)−1x, and derived from this comparison inequalities between EcE_cEc​ and the algebraic Gramian. Benner and Damm (SIAM J. Control Optim. 49(2), 2011, doi:10.1137/09075041X) observed that this formula needs an integrability condition that is not automatic, and gave an explicit two-dimensional system for which it fails (Example 3.3, pp. 697–698). This mission formalizes that counterexample.

Setting

A bilinear control system with state x(t)∈Rnx(t) \in \mathbb R^nx(t)∈Rn and input u(t)∈Rmu(t) \in \mathbb R^mu(t)∈Rm is

x˙=Ax+∑j=1mNjx uj+Bu,\dot x = Ax + \sum_{j=1}^m N_j x\, u_j + Bu,x˙=Ax+j=1∑m​Nj​xuj​+Bu,

with real matrices A,N1,…,Nm∈Rn×nA, N_1, \dots, N_m \in \mathbb R^{n\times n}A,N1​,…,Nm​∈Rn×n and B∈Rn×mB \in \mathbb R^{n \times m}B∈Rn×m; write bjb_jbj​ for the jjj-th column of BBB. The system is locally controllable if the pair (A,B)(A, B)(A,B) is controllable, that is, the Kalman matrix [B,AB,…,An−1B][B, AB, \dots, A^{n-1}B][B,AB,…,An−1B] has rank nnn.

Linearizing the system at a state xxx and the input u=0u = 0u=0 gives a linear system whose input matrix has columns Njx+bjN_j x + b_jNj​x+bj​. Its controllability Gramian P~(x)\tilde P(x)P~(x) is the solution of the Lyapunov equation

AP~(x)+P~(x)AT=−∑j=1m(Njx+bj)(Njx+bj)T.(3.9)A \tilde P(x) + \tilde P(x) A^T = -\sum_{j=1}^m (N_j x + b_j)(N_j x + b_j)^T. \tag{3.9}AP~(x)+P~(x)AT=−j=1∑m​(Nj​x+bj​)(Nj​x+bj​)T.(3.9)

When AAA is stable, (3.9) has exactly one solution for every xxx, and it is symmetric. The claim under test is

∇Ec(x)=P~(x)−1xfor x≠0, ∥x∥ sufficiently small.(3.8)\nabla E_c(x) = \tilde P(x)^{-1} x \qquad \text{for } x \neq 0,\ \|x\| \text{ sufficiently small.} \tag{3.8}∇Ec​(x)=P~(x)−1xfor x=0, ∥x∥ sufficiently small.(3.8)

A vector field FFF on an open set is integrable (a gradient field) if F=∇EF = \nabla EF=∇E for some real function EEE.

Example 3.3 is the single-input system (n=2n = 2n=2, m=1m = 1m=1) with

A=[−100−2],N=ν[0110],b=[11],A = \begin{bmatrix} -1 & 0 \\ 0 & -2 \end{bmatrix}, \qquad N = \nu \begin{bmatrix} 0 & 1 \\ 1 & 0 \end{bmatrix}, \qquad b = \begin{bmatrix} 1 \\ 1 \end{bmatrix},A=[−10​0−2​],N=ν[01​10​],b=[11​],

and a real parameter ν\nuν. In Lean these are exA, exN ν and exb (with exB the 2×12\times 12×1 matrix [b][b][b]), equation (3.9) is IsLinGramian, and controllability is IsControllable.

Formalization targets

Goal: Example 3.3

For every ν≠0\nu \neq 0ν=0, with P~(x)\tilde P(x)P~(x) solving (3.9) for every x∈R2x \in \mathbb R^2x∈R2: the pair (A,b)(A, b)(A,b) is controllable, and for every ε>0\varepsilon > 0ε>0 there is no E:R2→RE : \mathbb R^2 \to \mathbb RE:R2→R with

∇E(x)=P~(x)−1xfor all 0<∥x∥<ε.\nabla E(x) = \tilde P(x)^{-1}x \qquad \text{for all } 0 < \|x\| < \varepsilon .∇E(x)=P~(x)−1xfor all 0<∥x∥<ε.

The goal refutes every potential EEE, not only EcE_cEc​, so it does not depend on how EcE_cEc​ is defined; it is exactly the statement that the field is not integrable on any punctured neighbourhood of the origin, which is how (3.8) is claimed.

Milestones, in the order the example uses them

  1. Local controllability: (A,b)(A, b)(A,b) is controllable.
  2. The derivative of F(x)=P~(x)−1xF(x) = \tilde P(x)^{-1}xF(x)=P~(x)−1x (general nnn, mmm): where P~(x)\tilde P(x)P~(x) is invertible,
F′(x)h=P~(x)−1h−P~(x)−1P~x′(h)P~(x)−1x,AP~x′(h)+P~x′(h)AT=−∑j(Njh(Njx+bj)T+(Njx+bj)hTNjT).F'(x)h = \tilde P(x)^{-1}h - \tilde P(x)^{-1}\tilde P'_x(h)\tilde P(x)^{-1}x, \qquad A\tilde P'_x(h) + \tilde P'_x(h)A^T = -\sum_{j}\big(N_j h (N_j x + b_j)^T + (N_j x + b_j)h^TN_j^T\big).F′(x)h=P~(x)−1h−P~(x)−1P~x′​(h)P~(x)−1x,AP~x′​(h)+P~x′​(h)AT=−j∑​(Nj​h(Nj​x+bj​)T+(Nj​x+bj​)hTNjT​).
  1. The explicit Gramian at x=ξ(1,1)Tx = \xi(1,1)^Tx=ξ(1,1)T, 1+νξ≠01 + \nu\xi \neq 01+νξ=0:
P~(x)=(1+νξ)2[1/21/31/31/4],P~(x)−1=6(1+νξ)2[3−4−46].\tilde P(x) = (1+\nu\xi)^2\begin{bmatrix} 1/2 & 1/3 \\ 1/3 & 1/4\end{bmatrix}, \qquad \tilde P(x)^{-1} = \frac{6}{(1+\nu\xi)^2}\begin{bmatrix} 3 & -4 \\ -4 & 6\end{bmatrix}.P~(x)=(1+νξ)2[1/21/3​1/31/4​],P~(x)−1=(1+νξ)26​[3−4​−46​].
  1. The non-symmetric Jacobian at x=ξ(1,1)Tx = \xi(1,1)^Tx=ξ(1,1)T, νξ≠0\nu\xi \neq 0νξ=0, 1+νξ≠01+\nu\xi \neq 01+νξ=0:
F′(x)=P~(x)−1+12νξ(1+νξ)3[2−1−42],not symmetric.F'(x) = \tilde P(x)^{-1} + \frac{12\nu\xi}{(1+\nu\xi)^3}\begin{bmatrix} 2 & -1 \\ -4 & 2\end{bmatrix}, \quad \text{not symmetric.}F′(x)=P~(x)−1+(1+νξ)312νξ​[2−4​−12​],not symmetric.

Significance

The result. The example shows that the state-dependent Gramian P~(x)\tilde P(x)P~(x) of the linearization does not, in general, describe the controllability energy of a bilinear system through (3.8), even for a locally controllable system and arbitrarily close to the origin. As a consequence, the inequalities Ec(x0)>x0TP−1x0E_c(x_0) > x_0^TP^{-1}x_0Ec​(x0​)>x0T​P−1x0​ and Eo(x0)<x0TQx0E_o(x_0) < x_0^TQx_0Eo​(x0​)<x0T​Qx0​ derived in [25, 11] from (3.8) lose their justification, and the comparison of EcE_cEc​ with the algebraic Gramian requires the different argument the paper develops in its later sections. The example is a minimal one: two states, one input, one coupling parameter.

Formalizing it. The counterexample is proved in the paper by a hand computation through Kronecker products, and that computation contains a sign slip (see below); a machine-checked version settles the claim independently of it. The result is proved in the paper and, to our knowledge, has not been formalized anywhere. The general derivative formula (milestone 2) is reusable for any parametric Lyapunov equation.

Difficulty

The obvious route is to compute the Jacobian of FFF at one point and observe that it is not symmetric. Two steps of this route need care. First, P~(x)\tilde P(x)P~(x) is defined only implicitly, through (3.9) at every point, so its differentiability in xxx, and that of its inverse, must be derived from the invertibility of the Lyapunov operator X↦AX+XATX \mapsto AX + XA^TX↦AX+XAT and of P~(x)\tilde P(x)P~(x) near the point. Second, passing from "the Jacobian of FFF is not symmetric" to "FFF is not a gradient" requires the symmetry of second derivatives of a function that is only assumed differentiable with gradient FFF on a punctured ball; the regularity of EEE is inherited from that of FFF, not assumed. The goal is also not a statement about a single point: it must hold for every radius ε\varepsilonε, so the asymmetry must be exhibited at points arbitrarily close to the origin, where it is of order νξ\nu\xiνξ.

Formalization scope

  • Scalars are real; states are Fin n → ℝ, matrices Matrix (Fin n) (Fin n) ℝ, the paper's indices j=1,…,mj = 1, \dots, mj=1,…,m are Fin m. In the goal the plane is EuclideanSpace ℝ (Fin 2) and the potential is required to satisfy HasGradientAt at each point of the punctured ball 0<∥x∥<ε0 < \|x\| < \varepsilon0<∥x∥<ε, with no further regularity.
  • P~\tilde PP~ enters as an arbitrary function satisfying (3.9) at every point. For the example data (3.9) has exactly one solution at every xxx, so this is the paper's "defined by (3.9)", and the hypothesis is satisfiable.
  • Added hypothesis ν≠0\nu \neq 0ν=0. The paper says ν\nuν is "irrelevant for the computation", but its asymmetry term is proportional to νξ\nu\xiνξ; at ν=0\nu = 0ν=0 the Gramian is constant and the field is a gradient.
  • Repaired sign. The equation for P~x′(h)\tilde P'_x(h)P~x′​(h) on p. 697 is printed without parentheses after the minus sign, and the Kronecker formula for vec⁡P~x′(h)\operatorname{vec}\tilde P'_x(h)vecP~x′​(h) drops the minus sign of (3.9). Milestone 2 places the minus sign on both terms. The matrix 12νξ(1+νξ)3[2−1−42]\frac{12\nu\xi}{(1+\nu\xi)^3}\left[\begin{smallmatrix} 2 & -1 \\ -4 & 2\end{smallmatrix}\right](1+νξ)312νξ​[2−4​−12​] of the paper is, with the sign restored, the matrix of h↦−P~−1P~x′(h)P~−1xh \mapsto -\tilde P^{-1}\tilde P'_x(h)\tilde P^{-1}xh↦−P~−1P~x′​(h)P~−1x; milestone 4 therefore states F′(x)=P~(x)−1F'(x) = \tilde P(x)^{-1}F′(x)=P~(x)−1 plus this matrix. The non-symmetry conclusion is unchanged.
  • Matrix inverses are Mathlib's Matrix.inv, which returns 000 at singular matrices; P~(x)\tilde P(x)P~(x) is invertible near the origin, and milestones 2–4 assume invertibility (or 1+νξ≠01 + \nu\xi \neq 01+νξ=0) where they use it.
  • The observability half of (3.8), ∇Eo(x)=Q~(x)x\nabla E_o(x) = \tilde Q(x)x∇Eo​(x)=Q~​(x)x, which the paper says "can be argued similarly" without a proof, is not part of the mission.
  • A trivializing formalization is ruled out: P~\tilde PP~ is pinned by (3.9) at every point (a free P~\tilde PP~ would make the claim meaningless), and non-integrability is stated as the non-existence of a potential, not as the non-symmetry of some matrix.

Contributions welcome: proofs of the four milestones, in particular the smooth dependence of the solution of a Lyapunov equation on its right-hand side (milestone 2), which is general and reusable.

Selected references

  • P. Benner, T. Damm, Lyapunov Equations, Energy Functionals, and Model Order Reduction of Bilinear and Stochastic Systems, SIAM J. Control Optim. 49(2), 686–711, 2011. https://doi.org/10.1137/09075041X
  • W. S. Gray, J. Mesko, Energy functions and algebraic Gramians for bilinear systems, Proc. 4th IFAC Nonlinear Control Systems Design Symposium, Enschede, 1998, pp. 103–108.
  • M. Condon, R. Ivanov, Nonlinear systems — algebraic Gramians and model reduction, COMPEL 24, 202–219, 2005.
  • E. I. Verriest, Time variant balancing and nonlinear balanced realizations, in Model Order Reduction: Theory, Research Aspects and Applications, Mathematics in Industry 13, Springer, 2008, pp. 203–222.
7 thms2 active usersReviewed
🏆Completed
Mathematical Physics·Captain: Lucas

Baumgarten 2018: How to (Un-) Quantum Mechanics — Phase-Space AlgebraResearch Paper

Motivation

C. Baumgarten's essay How to (Un-) Quantum Mechanics (arXiv:1810.06981, v2 2025) argues that much of the mathematical formalism usually presented as specifically "quantum" — Heisenberg's equation of motion, commutators, eigenvalue problems, the real Pauli and Dirac algebras — already follows from classical linear Hamiltonian mechanics on an abstract phase space. The physical and philosophical claims of the paper are outside the scope of a formalization, but its argument rests on a compact chain of linear-algebra facts stated in Sections IV–VI (pp. 13–20). This mission formalizes exactly that chain, so that the mathematical part of the argument can be checked independently of its interpretation.

Setting

Fix a number n≥0n \ge 0n≥0 of degrees of freedom. A phase-space vector is ψ=(q1,p1,…,qn,pn)T∈R2n\psi = (q_1,p_1,\dots,q_n,p_n)^T \in \mathbb R^{2n}ψ=(q1​,p1​,…,qn​,pn​)T∈R2n. The symplectic unit matrix is the Kronecker product

γ0=1n⊗η0,η0=(01−10).\gamma_0 = \mathbf 1_n \otimes \eta_0, \qquad \eta_0 = \begin{pmatrix}0 & 1\\ -1 & 0\end{pmatrix}.γ0​=1n​⊗η0​,η0​=(0−1​10​).

A real 2n×2n2n\times 2n2n×2n matrix is Hamiltonian if it equals γ0A\gamma_0 Aγ0​A with AAA symmetric, skew-Hamiltonian if it equals γ0B\gamma_0 Bγ0​B with BBB skew-symmetric, and symplectic if Mγ0MT=γ0M\gamma_0M^T = \gamma_0Mγ0​MT=γ0​.

Linear Hamiltonian motion is ψ˙=Hψ\dot\psi = H\psiψ˙​=Hψ with HHH Hamiltonian (the paper's Eq. 35, coming from the quadratic Hamiltonian 12ψTAψ\tfrac12\psi^TA\psi21​ψTAψ). A matrix of second moments Σ(τ)\Sigma(\tau)Σ(τ) (in the paper an average ⟨ψψT⟩\langle\psi\psi^T\rangle⟨ψψT⟩) then evolves by

Σ˙=HΣ+ΣHT(Eq. 40),\dot\Sigma = H\Sigma + \Sigma H^T \qquad\text{(Eq. 40)},Σ˙=HΣ+ΣHT(Eq. 40),

and the autocorrelation matrix is S=Σγ0TS = \Sigma\gamma_0^TS=Σγ0T​.

Target

The goal theorem combines the conclusions drawn on pp. 16–17: for HHH Hamiltonian and Σ\SigmaΣ a symmetric solution of Eq. (40), the autocorrelation matrix satisfies, for every time τ\tauτ,

χS(τ)=χS(0)andTr⁡(S(τ)2k+1)=0  (k∈N),\chi_{S(\tau)} = \chi_{S(0)} \qquad\text{and}\qquad \operatorname{Tr}\big(S(\tau)^{2k+1}\big) = 0 \ \ (k \in \mathbb N),χS(τ)​=χS(0)​andTr(S(τ)2k+1)=0  (k∈N),

where χ\chiχ is the characteristic polynomial: "the eigenvalues are constants of motion" (after Eq. 51) together with Eq. (48).

The milestones follow the paper's own steps, in order:

  1. pairing ±λ\pm\lambda±λ of eigenvalues of skew-symmetric matrices, and a vanishing eigenvalue in odd size (p. 13);
  2. conservation of HHH under ψ˙=J∇H\dot\psi = J\nabla Hψ˙​=J∇H with JJJ skew (Eqs. 26–28);
  3. identities of γ0\gamma_0γ0​ and the transpose rules for (skew-)Hamiltonian matrices (Eqs. 33, 36, 54);
  4. exp⁡(Hτ)ψ0\exp(H\tau)\psi_0exp(Hτ)ψ0​ solves ψ˙=Hψ\dot\psi = H\psiψ˙​=Hψ (Eq. 49);
  5. Heisenberg's equation S˙=[H,S]\dot S = [H,S]S˙=[H,S] for second moments (Eq. 42);
  6. the Lax invariants Tr⁡(Sk)\operatorname{Tr}(S^k)Tr(Sk) (Eq. 47) and tracelessness of odd powers (Eq. 48);
  7. symplecticity of exp⁡(Hτ)\exp(H\tau)exp(Hτ) and S(τ)=M(τ)S(0)M(−τ)S(\tau) = M(\tau)S(0)M(-\tau)S(τ)=M(τ)S(0)M(−τ) (Eqs. 50–51);
  8. the dimension counts n(2n+1)n(2n+1)n(2n+1) and n(2n−1)n(2n-1)n(2n−1) (Eqs. 55–56) and the (anti-)commutator table (Eq. 57);
  9. the matrix Euler formulas for the real Pauli matrices (Eq. 66).

Significance

The result itself. Each statement is classical linear algebra or linear ODE theory; the paper uses them to argue that Heisenberg's equation and the spectral description of observables arise from second moments of a classical Hamiltonian ensemble. A checked version separates what is a theorem from what is interpretation, and pins down the hypotheses (for example, that only symmetry of AAA is needed for Eq. 48, not positive definiteness).

Formalizing it. None of these statements is new mathematics; the work is to formalize them in the paper's notation (γ0=1n⊗η0\gamma_0 = \mathbf 1_n\otimes\eta_0γ0​=1n​⊗η0​, entrywise matrix derivatives, the matrix exponential) so that they can be reused for later parts of the paper, such as the real Dirac algebra of Sec. VII–VIII.

Difficulty

Most milestones are short calculations. The two steps needing real infrastructure are (i) the uniqueness of solutions of the linear matrix ODE S˙=[H,S]\dot S = [H,S]S˙=[H,S], needed to identify S(τ)S(\tau)S(τ) with exp⁡(Hτ)S(0)exp⁡(−Hτ)\exp(H\tau)S(0)\exp(-H\tau)exp(Hτ)S(0)exp(−Hτ), and (ii) the dimension counts, which require an explicit basis or an isomorphism with symmetric/skew-symmetric matrices. Going through the Lax invariants alone gives only the traces of powers of SSS, and recovering the characteristic polynomial from them needs Newton's identities; the similarity form of Eq. (51) gives the conservation of the characteristic polynomial directly.

Formalization scope

Everything is over R\mathbb RR. Matrices are indexed by pairs (i,b)(i,b)(i,b), i<ni<ni<n, b∈{0,1}b\in\{0,1\}b∈{0,1}, so that γ0\gamma_0γ0​ is literally a Kronecker product; n=0n = 0n=0 is allowed. Time derivatives of matrix-valued functions are entrywise HasDerivAt; exp⁡\expexp is Mathlib's power-series NormedSpace.exp. A Hamiltonian matrix is γ0A\gamma_0Aγ0​A with AAA symmetric (no definiteness); Σ\SigmaΣ is any symmetric solution of Eq. (40) — positivity is not assumed because it is not used. Eigenvalues of real skew-symmetric matrices are taken over C\mathbb CC. "Number of linearly independent elements" is the dimension of the real span. No statement is vacuous: all hypotheses are satisfied, for example, by H=γ0H = \gamma_0H=γ0​ and Σ≡1\Sigma \equiv \mathbf 1Σ≡1.

All statements share the definition file UnQM_phase_space and the namespace UnQuantumMechanics.

Selected references

  • C. Baumgarten, How to (Un-) Quantum Mechanics, arXiv:1810.06981v2 [physics.gen-ph], 2025. https://arxiv.org/abs/1810.06981
  • P. D. Lax, Integrals of nonlinear equations of evolution and solitary waves, Comm. Pure Appl. Math. 21 (1968), 467–490. https://doi.org/10.1002/cpa.3160210503
18 thms2 active usersReviewed
🏆Completed
Mathematical Physics·Captain: Lucas

Davidson–Nardi–Nir 2008 (Leptogenesis), Eq. (5.10): upper bound on the flavoured CP asymmetry in N1 decaysResearch Paper

Motivation

Leptogenesis is a class of scenarios in which the baryon asymmetry of the Universe is produced from a lepton asymmetry generated in the out-of-equilibrium decays of heavy singlet neutrinos NkN_kNk​, which also give the light neutrinos their small masses through the type I seesaw (Fukugita–Yanagida 1986). The review of Davidson, Nardi and Nir (Phys. Rep. 466 (2008) 105) collects the standard results of the field. One of its central quantitative facts is an upper bound on the CP asymmetry in the decays of the lightest singlet N1N_1N1​, in terms of M1M_1M1​ and the light-neutrino masses. This bound is the origin of the familiar lower bound M1≳109 M_1\gtrsim10^9\,M1​≳109GeV for thermal leptogenesis with hierarchical singlets (Eq. (5.12) of the review).

Timeline. Casas and Ibarra introduced the orthogonal-matrix parametrization of the seesaw in 2001 (hep-ph/0103065). Davidson and Ibarra derived the bound ∣ε∣≤3M1(m3−m1)/(16πv2)|\varepsilon|\le 3M_1(m_3-m_1)/(16\pi v^2)∣ε∣≤3M1​(m3​−m1​)/(16πv2) on the total asymmetry in 2002 (hep-ph/0202239); Hamaguchi, Murayama and Yanagida gave a related bound (hep-ph/0109030). Once flavour effects were recognised (around 2006), attention moved to the flavoured asymmetries εαα\varepsilon_{\alpha\alpha}εαα​, whose bound (Eq. (5.10) of the review) is the goal of this mission.

Setting

There are three lepton flavours α\alphaα and three singlets NkN_kNk​ with Majorana masses Mk>0M_k>0Mk​>0. We work in the mass basis of the charged leptons and of the NkN_kNk​. The Yukawa matrix λ\lambdaλ is an arbitrary complex 3×33\times33×3 matrix, and v=vu>0v=v_u>0v=vu​>0 is the Higgs vev. The light-neutrino mass matrix (Eq. (2.5)) is

[m]αβ=∑kλαkMk−1λβkv2,[m]_{\alpha\beta}=\sum_k\lambda_{\alpha k}M_k^{-1}\lambda_{\beta k}v^2 ,[m]αβ​=k∑​λαk​Mk−1​λβk​v2,

a complex symmetric matrix. It is diagonalized as m=U∗DmU†m=U^*D_mU^\daggerm=U∗Dm​U† with UUU unitary and Dm=diag⁡(m1,m2,m3)D_m=\operatorname{diag}(m_1,m_2,m_3)Dm​=diag(m1​,m2​,m3​), mi≥0m_i\ge0mi​≥0 (Eq. (2.6)). The largest and smallest light masses are mmax⁡m_{\max}mmax​ and mmin⁡m_{\min}mmin​. The Casas–Ibarra matrix is R=Dm−1/2UTλDM−1/2vR=D_m^{-1/2}U^T\lambda D_M^{-1/2}vR=Dm−1/2​UTλDM−1/2​v (Eq. (2.11)).

At tree level N1N_1N1​ decays into ϕℓα\phi\ell_\alphaϕℓα​ and ϕˉℓˉα\bar\phi\bar\ell_\alphaϕˉ​ℓˉα​ with partial rate Γαα=∣λα1∣2M1/(8π)\Gamma_{\alpha\alpha}=|\lambda_{\alpha1}|^2M_1/(8\pi)Γαα​=∣λα1​∣2M1​/(8π) and total rate ΓD=[λ†λ]11M1/(8π)\Gamma_D=[\lambda^\dagger\lambda]_{11}M_1/(8\pi)ΓD​=[λ†λ]11​M1​/(8π) (Eq. (4.5)). So the branching fractions satisfy Bϕℓα+Bϕˉℓˉα=Γαα/ΓDB_{\phi\ell_\alpha}+B_{\bar\phi\bar\ell_\alpha}=\Gamma_{\alpha\alpha}/\Gamma_DBϕℓα​​+Bϕˉ​ℓˉα​​=Γαα​/ΓD​. For hierarchical singlets the flavoured CP asymmetry is (Eq. (5.9))

εαα=3M116πv2[λ†λ]11Im⁡{[λ]α1[m∗λ]α1}.\varepsilon_{\alpha\alpha}=\frac{3M_1}{16\pi v^2[\lambda^\dagger\lambda]_{11}}\operatorname{Im}\{[\lambda]_{\alpha1}[m^*\lambda]_{\alpha1}\}.εαα​=16πv2[λ†λ]11​3M1​​Im{[λ]α1​[m∗λ]α1​}.

Formalization targets

Goal — Eq. (5.10)

∣εαα∣≤3M1mmax⁡16πv2Bϕℓα+Bϕˉℓˉαfor every flavour α.|\varepsilon_{\alpha\alpha}|\le\frac{3M_1m_{\max}}{16\pi v^2}\sqrt{B_{\phi\ell_\alpha}+B_{\bar\phi\bar\ell_\alpha}}\qquad\text{for every flavour }\alpha.∣εαα​∣≤16πv23M1​mmax​​Bϕℓα​​+Bϕˉ​ℓˉα​​​for every flavour α.

Milestones

  1. Eq. (2.6): the matrix mmm admits a diagonalization m=U∗DmU†m=U^*D_mU^\daggerm=U∗Dm​U† with UUU unitary and mi≥0m_i\ge0mi​≥0.
  2. Eq. (2.11): for mi>0m_i>0mi​>0, RRR is complex orthogonal, RTR=RRT=1R^TR=RR^T=1RTR=RRT=1.
  3. Sec. 5.2: ∣m⋅x∗∣≤mmax⁡∣x∣|m\cdot x^*|\le m_{\max}|x|∣m⋅x∗∣≤mmax​∣x∣ for all x∈C3x\in\mathbb C^3x∈C3.
  4. Sec. 5.2 / Eq. (5.17): the total asymmetry bound ∣∑αεαα∣≤3M1(mmax⁡−mmin⁡)/(16πv2)|\sum_\alpha\varepsilon_{\alpha\alpha}|\le 3M_1(m_{\max}-m_{\min})/(16\pi v^2)∣∑α​εαα​∣≤3M1​(mmax​−mmin​)/(16πv2).

Significance

Eq. (5.10) is the input to the lower bounds on M1M_1M1​ and on the reheat temperature for hierarchical thermal leptogenesis (Eq. (5.12), Sec. 9.4.3), and it shows that flavoured asymmetries are not suppressed for degenerate light neutrinos, unlike the total one (Eq. (5.17)). These are established results. The work here is to formalize them: to state the seesaw quantities precisely and machine-check the linear-algebra steps (Takagi factorization, complex orthogonality, operator-norm bounds) that the physics literature takes for granted. To the captain's knowledge none of these statements has a machine-checked proof.

Difficulty

The goal reduces to an operator-norm estimate for the complex symmetric matrix mmm. That estimate needs the diagonalization m=U∗DmU†m=U^*D_mU^\daggerm=U∗Dm​U†, which is a Takagi (Autonne–Takagi) factorization, not a unitary eigen-decomposition: mmm is symmetric, not Hermitian. The obvious move, applying the spectral theorem to mmm, fails because mmm is in general not normal. The milestone-1 existence statement therefore needs its own argument, for example through the Hermitian matrix m†mm^\dagger mm†m. The total-asymmetry bound (milestone 4) needs a finer argument than the triangle inequality to produce the difference mmax⁡−mmin⁡m_{\max}-m_{\min}mmax​−mmin​ rather than mmax⁡m_{\max}mmax​.

Formalization scope

  • Everything is 3×33\times33×3 over C\mathbb CC with index set {0,1,2}\{0,1,2\}{0,1,2} (Fin 3); the singlet "N1N_1N1​" is index 000.
  • mmax⁡m_{\max}mmax​ and mmin⁡m_{\min}mmin​ are ⨆ i, masses i and ⨅ i, masses i over the three diagonal entries. No ordering of the mim_imi​ is imposed.
  • The diagonalization is a hypothesis IsLightMassDiagonalization m U masses (unitary UUU, mi≥0m_i\ge0mi​≥0, m=U‾ diag(mi) U†m=\overline U\,\mathrm{diag}(m_i)\,U^\daggerm=Udiag(mi​)U†). It is always satisfiable by milestone 1, so it is not vacuous.
  • εαα\varepsilon_{\alpha\alpha}εαα​ is the explicit hierarchical-limit expression (5.9), with [λ†λ]11[\lambda^\dagger\lambda]_{11}[λ†λ]11​ written as ∑β∣λβ1∣2\sum_\beta|\lambda_{\beta1}|^2∑β​∣λβ1​∣2. The physical approximation M2,3≫M1M_{2,3}\gg M_1M2,3​≫M1​ is built into this formula and is not a hypothesis. The branching sum is the tree-level ratio Γαα/ΓD\Gamma_{\alpha\alpha}/\Gamma_DΓαα​/ΓD​.
  • Division by zero returns 000 in Lean. This only matters when the first column of λ\lambdaλ vanishes, where both sides of the goal are 000.
  • Needed infrastructure: Takagi factorization of complex symmetric matrices (reusable beyond this mission), and elementary Euclidean-norm estimates on C3\mathbb C^3C3.

Selected references

  • S. Davidson, E. Nardi, Y. Nir, Leptogenesis, Physics Reports 466 (2008) 105–177. https://doi.org/10.1016/j.physrep.2008.06.002 · https://arxiv.org/abs/0802.2962
  • J. A. Casas, A. Ibarra, Oscillating neutrinos and μ → e γ, Nucl. Phys. B 618 (2001) 171. https://arxiv.org/abs/hep-ph/0103065
  • S. Davidson, A. Ibarra, A lower bound on the right-handed neutrino mass from leptogenesis, Phys. Lett. B 535 (2002) 25. https://arxiv.org/abs/hep-ph/0202239
  • M. Fukugita, T. Yanagida, Baryogenesis without grand unification, Phys. Lett. B 174 (1986) 45. https://doi.org/10.1016/0370-2693(86)91126-3
6 thms2 active usersReviewed
🏆Completed
AlgebraCombinatoricsDiscrete Geometry·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 3: A Maximum h-Scattered Subspace of Dimension rn/(h + 1) Meets Every Hyperplane in Dimension Between rn/(h + 1) − n and rn/(h + 1) − n + hResearch Paper

Motivation

Scattered subspaces are a central object of finite geometry. An Fq\mathbb F_qFq​-subspace UUU of an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​ defines an Fq\mathbb F_qFq​-linear set of the projective space PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn), and when UUU is scattered this linear set has the largest possible number of points for its rank. Maximum scattered subspaces give rise to maximum rank distance (MRD) codes, to translation caps, and to two-intersection sets and the associated two-weight codes and strongly regular graphs (Polverino 2010; Sheekey–Van de Voorde 2020).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2, Combinatorica 41, 2021) generalised the notion to hhh-scattered subspaces, which meet every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace in dimension at most hhh, and proved that such a subspace has dimension at most rn/(h+1)rn/(h+1)rn/(h+1) unless it defines a subgeometry. This mission concerns the extremal case: subspaces attaining rn/(h+1)rn/(h+1)rn/(h+1), and the way they meet hyperplanes.

Timeline.

  • 2000: Blokhuis and Lavrauw (Geom. Dedicata 81, Theorem 4.2) prove the case h=1h=1h=1: a scattered subspace of dimension rn/2rn/2rn/2 meets each hyperplane in dimension rn/2−nrn/2-nrn/2−n or rn/2−n+1rn/2-n+1rn/2−n+1, and they count the hyperplanes of each kind.
  • 2020: Csajbók, Marino, Polverino and Zullo prove the general statement (Theorem 2.7) by a double count and qqq-series identities, and use it to build maximum hhh-scattered subspaces by Delsarte duality.
  • Later work by Zini and Zullo (Scattered subspaces and related codes, reference [29] of the paper) determines the number of hyperplanes of each intersection dimension for every hhh; the case h=2h=2h=2 is in Napolitano–Zullo.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, n=[Fqn:Fq]n = [\mathbb F_{q^n}:\mathbb F_q]n=[Fqn​:Fq​], and let V=V(r,qn)V = V(r,q^n)V=V(r,qn) be an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​, viewed also as an rnrnrn-dimensional vector space over Fq\mathbb F_qFq​. A hyperplane of VVV is an (r−1)(r-1)(r−1)-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace.

Fix an integer hhh with 0<h≤r−10<h\le r-10<h≤r−1. An Fq\mathbb F_qFq​-subspace UUU of VVV is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h. It is maximum hhh-scattered if no hhh-scattered subspace of VVV has larger Fq\mathbb F_qFq​-dimension.

Put s=h+1s=h+1s=h+1 and suppose s∣rns\mid rns∣rn. For an Fq\mathbb F_qFq​-subspace UUU of dimension rn/srn/srn/s, let hih_ihi​ be the number of hyperplanes WWW with dim⁡Fq(W∩U)=i\dim_{\mathbb F_q}(W\cap U)=idimFq​​(W∩U)=i. The proof works with the Gaussian binomial coefficients [nk]q\left[{n\atop k}\right]_q[kn​]q​, the qqq-Pochhammer symbols (a;q)k=(1−a)(1−aq)⋯(1−aqk−1)(a;q)_k=(1-a)(1-aq)\cdots(1-aq^{k-1})(a;q)k​=(1−a)(1−aq)⋯(1−aqk−1), the elementary symmetric values σk,l\sigma_{k,l}σk,l​ of 1,q,…,qk1,q,\dots,q^k1,q,…,qk, and the sums

αk=∑ihi(qn−1)qki,βk=∑ihi(qn−1)∏j=0k−1(qi−qj),\alpha_k=\sum_i h_i(q^n-1)q^{ki},\qquad \beta_k=\sum_i h_i(q^n-1)\prod_{j=0}^{k-1}(q^i-q^j),αk​=i∑​hi​(qn−1)qki,βk​=i∑​hi​(qn−1)j=0∏k−1​(qi−qj), A=∑ihi(qn−1)∏l=0s−1(qi−q n(r−s)/s+l).A=\sum_i h_i(q^n-1)\prod_{l=0}^{s-1}\bigl(q^i-q^{\,n(r-s)/s+l}\bigr).A=i∑​hi​(qn−1)l=0∏s−1​(qi−qn(r−s)/s+l).

Formalization targets

Goal: Theorem 2.7

If UUU is a maximum hhh-scattered Fq\mathbb F_qFq​-subspace of V(r,qn)V(r,q^n)V(r,qn) of dimension rn/(h+1)rn/(h+1)rn/(h+1), then for every hyperplane WWW of VVV

rnh+1−n  ≤  dim⁡Fq(U∩W)  ≤  rnh+1−n+h.\frac{rn}{h+1}-n\;\le\;\dim_{\mathbb F_q}(U\cap W)\;\le\;\frac{rn}{h+1}-n+h.h+1rn​−n≤dimFq​​(U∩W)≤h+1rn​−n+h.

Milestones, in the order of the proof (§5, pp. 20–24)

  1. hi=0h_i=0hi​=0 for i<rn/s−ni<rn/s-ni<rn/s−n (the lower bound), and (23): ∑ihi(qn−1)=qrn−1\sum_i h_i(q^n-1)=q^{rn}-1∑i​hi​(qn−1)=qrn−1.
  2. Lemma 5.7: for 0≤k≤s−10\le k\le s-10≤k≤s−1,
∑ihi(qn−1)∏j=0k(qi−qj)=∏j=0k(qrn/s−qj) (q(r−k−1)n−1).\sum_i h_i(q^n-1)\prod_{j=0}^{k}(q^i-q^j)=\prod_{j=0}^{k}(q^{rn/s}-q^j)\,(q^{(r-k-1)n}-1).i∑​hi​(qn−1)j=0∏k​(qi−qj)=j=0∏k​(qrn/s−qj)(q(r−k−1)n−1).
  1. The qqq-series tools: Lemma 5.5 (σk,l=ql(l−1)/2[k+1l]q\sigma_{k,l}=q^{l(l-1)/2}\left[{k+1\atop l}\right]_qσk,l​=ql(l−1)/2[lk+1​]q​), Carlitz's inversion (Theorem 5.6), the qqq-binomial theorem (Theorem 5.2) and its specialisation (Corollary 5.3).
  2. (24): αk=∑j≤k[kj]qβj\alpha_k=\sum_{j\le k}\left[{k\atop j}\right]_q\beta_jαk​=∑j≤k​[jk​]q​βj​. Identity (25), which expresses AAA through α0,…,αs\alpha_0,\dots,\alpha_sα0​,…,αs​, is included as a supporting item rather than a milestone.
  3. Propositions 5.8 and 5.9: two triple sums asa_sas​, bsb_sbs​ both equal qnr(−1)s(q−n;q)sq^{nr}(-1)^s(q^{-n};q)_sqnr(−1)s(q−n;q)s​.
  4. A=0A=0A=0, which forces hi=0h_i=0hi​=0 for i>n(r−s)/s+s−1i>n(r-s)/s+s-1i>n(r−s)/s+s−1.

Significance

The result. Theorem 2.7 says that a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) has only h+1h+1h+1 possible intersection dimensions with hyperplanes. Its linear set therefore meets hyperplanes in few sizes, which links these subspaces to sets of few intersection numbers and to codes with few weights. Inside the paper, the upper bound is the input to §3: it shows that the Delsarte dual of a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) is maximum (n−h−2)(n-h-2)(n−h−2)-scattered (Theorem 3.3). That theorem in turn gives maximum hhh-scattered subspaces when h+1h+1h+1 does not divide rrr.

Formalizing it. The theorem is proved in the paper, but no machine-checked version exists. Beyond the geometry, the mission produces a library of finite qqq-series facts: Gaussian binomials as rational functions of qqq, the qqq-binomial theorem in both forms, Carlitz's inversion formula, and the elementary symmetric evaluation σk,l\sigma_{k,l}σk,l​. Some of these are proved on the platform in a different Mathlib environment, but they are not available in this one. Counting statements about subspaces over finite fields (hyperplanes through a subspace, ordered independent tuples) are also needed and are reusable.

Difficulty

The lower bound is a dimension count. The upper bound is not: the obvious approach bounds dim⁡(U∩W)\dim(U\cap W)dim(U∩W) from the scattered property alone, but the hhh-scattered condition controls intersections with hhh-dimensional subspaces, and hyperplanes have dimension r−1r-1r−1, which is far larger. No pointwise argument is known; the paper determines the distribution (hi)(h_i)(hi​) only through its first s+1s+1s+1 moments, given by a double count, and then shows that a specific nonnegative combination of the hih_ihi​ vanishes. The moment identities hold only for k≤s−1k\le s-1k≤s−1 (Lemma 5.7 needs each k+1≤h+1k+1\le h+1k+1≤h+1 independent vectors of UUU to stay independent over Fqn\mathbb F_{q^n}Fqn​), and closing the argument requires exact evaluation of a triple qqq-series with signed Gaussian binomials and quadratic exponents.

Formalization scope

  • Fq\mathbb F_qFq​ is a finite field F, Fqn\mathbb F_{q^n}Fqn​ a finite field K with [Algebra F K], and VVV a finite-dimensional K-module with a compatible F-module structure (IsScalarTower F K V). We take r=r=r= finrank K V, n=n=n= finrank F K and q=q=q= Fintype.card F.
  • The range 0<h<r0<h<r0<h<r and the spanning condition are part of IsHScattered.
  • "Dimension rn/(h+1)rn/(h+1)rn/(h+1)" is the equation (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U = rn(h+1)dimFq​​U=rn. Both bounds of Theorem 2.7 are stated with nnn moved to the other side: dim⁡U≤dim⁡(U∩W)+n≤dim⁡U+h\dim U\le\dim(U\cap W)+n\le\dim U+hdimU≤dim(U∩W)+n≤dimU+h. A version written with natural-number subtraction would make the lower bound vacuous whenever rn/(h+1)<nrn/(h+1)<nrn/(h+1)<n, and dropping the dimension hypothesis would make the upper bound false. Both trivialisations are ruled out.
  • Gaussian binomials are defined by the product formula (15) for real qqq and vanish for k>nk>nk>n. The qqq-identities are stated for real q>1q>1q>1, which covers every prime power. Carlitz's formula is stated for complex sequences.
  • Every fraction in an exponent is an exact quotient: rn/srn/srn/s is passed as mmm with sm=nrsm=nrsm=nr, and halves l(l−1)/2l(l-1)/2l(l−1)/2 are binomial coefficients (l2)\binom l2(2l​). Possibly negative exponents use integer powers.
  • The milestones of §5 carry the full hhh-scattered hypothesis, spanning included. The printed setting of §5.2 omits spanning, but Lemma 5.7 uses Proposition 2.1, which needs it.
  • Cited inputs stated as milestones: Lemma 5.5 ([6]), Theorem 5.2 ([15]) and Theorem 5.6 ([7]). Identity (18) is used inside proofs and is not an item.

Proofs of any milestone, of standard counting facts for subspaces of finite vector spaces, and of the qqq-series lemmas are welcome.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, Combinatorica 41 (2021). arXiv:1906.10590v2. https://arxiv.org/abs/1906.10590v2
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2009.04.007
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://doi.org/10.1007/s10623-019-00703-z
  • G. Gasper, M. Rahman, Basic Hypergeometric Series, 2nd ed., Cambridge University Press, 2004. https://doi.org/10.1017/CBO9780511526251
  • L. Carlitz, Some inverse relations, Duke Math. J. 40 (1973), 893–901. https://doi.org/10.1215/S0012-7094-73-04083-0
  • V. Napolitano, F. Zullo, Codes with few weights arising from linear sets, arXiv:2002.07241. https://arxiv.org/abs/2002.07241
  • P. J. Cameron, Notes on Counting: An Introduction to Enumerative Combinatorics, Cambridge University Press, 2017. https://doi.org/10.1017/9781108277457
18 thms2 active usersReviewed
🏆Completed
AlgebraComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Most Tensor Problems Are NP-Hard 4: A Rational 2×2×2 Tensor Has Smaller Rank over the Reals Than over the RationalsResearch Paper

Motivation

The rank of a matrix does not depend on the field in which its entries are read: a rational matrix has the same rank over Q\mathbb QQ, R\mathbb RR and C\mathbb CC, because rank is computed by Gaussian elimination, which never leaves the field of the entries. For 3-tensors, arrays A=[ ⁣[aijk] ⁣]\mathcal A = [\![a_{ijk}]\!]A=[[aijk​]] with three indices, this fails. Tensor rank governs the complexity of bilinear maps (the exponent of matrix multiplication is a statement about the rank of one tensor), the uniqueness of the CANDECOMP/PARAFAC decompositions used in psychometrics and signal processing, and the identifiability of latent-variable models. In each application the field matters: algorithms are run over R\mathbb RR or C\mathbb CC, while complexity results are often proved over Q\mathbb QQ or finite fields.

Håstad (1990) proved that deciding rank⁡(A)≤r\operatorname{rank}(\mathcal A) \le rrank(A)≤r is NP-complete over finite fields and NP-hard over Q\mathbb QQ. De Silva and Lim (2008) gave real tensors whose rank over C\mathbb CC is strictly smaller than their rank over R\mathbb RR. Hillar and Lim (2013, Theorem 1.14) showed that the same phenomenon already occurs between Q\mathbb QQ and R\mathbb RR, for a 2×2×22\times2\times22×2×2 tensor with integer entries, so that Håstad's result over Q\mathbb QQ does not by itself say anything about rank over R\mathbb RR.

Setting

Let EEE be a field. The outer product of x∈El\mathbf x \in E^lx∈El, y∈Em\mathbf y \in E^my∈Em, z∈En\mathbf z \in E^nz∈En is the tensor x⊗y⊗z∈El×m×n\mathbf x\otimes\mathbf y\otimes\mathbf z \in E^{l\times m\times n}x⊗y⊗z∈El×m×n with entries xiyjzkx_iy_jz_kxi​yj​zk​. The rank of A\mathcal AA over EEE is

rank⁡E(A)=min⁡{r:A=∑s=1rλs xs⊗ys⊗zs,  λs∈E, xs∈El, ys∈Em, zs∈En}.\operatorname{rank}_E(\mathcal A) = \min\Big\{ r : \mathcal A = \sum_{s=1}^{r} \lambda_s\,\mathbf x_s\otimes\mathbf y_s\otimes\mathbf z_s,\ \ \lambda_s\in E,\ \mathbf x_s\in E^l,\ \mathbf y_s\in E^m,\ \mathbf z_s\in E^n\Big\}.rankE​(A)=min{r:A=s=1∑r​λs​xs​⊗ys​⊗zs​,  λs​∈E, xs​∈El, ys​∈Em, zs​∈En}.

If A\mathcal AA has entries in a subfield F⊆EF \subseteq EF⊆E, both rank⁡F(A)\operatorname{rank}_F(\mathcal A)rankF​(A) and rank⁡E(A)\operatorname{rank}_E(\mathcal A)rankE​(A) are defined, and rank⁡E(A)≤rank⁡F(A)\operatorname{rank}_E(\mathcal A) \le \operatorname{rank}_F(\mathcal A)rankE​(A)≤rankF​(A).

The paper's example uses x=[1,0]⊤\mathbf x = [1,0]^\topx=[1,0]⊤, y=[0,1]⊤\mathbf y = [0,1]^\topy=[0,1]⊤ and

A=2 x⊗x⊗x−4 y⊗y⊗x+4 y⊗x⊗y−4 x⊗y⊗y∈Q2×2×2.\mathcal A = 2\,\mathbf x\otimes\mathbf x\otimes\mathbf x - 4\,\mathbf y\otimes\mathbf y\otimes\mathbf x + 4\,\mathbf y\otimes\mathbf x\otimes\mathbf y - 4\,\mathbf x\otimes\mathbf y\otimes\mathbf y \in \mathbb Q^{2\times2\times2}.A=2x⊗x⊗x−4y⊗y⊗x+4y⊗x⊗y−4x⊗y⊗y∈Q2×2×2.

A decomposition A=u1⊗u2⊗u3+v1⊗v2⊗v3\mathcal A = \mathbf u_1\otimes\mathbf u_2\otimes\mathbf u_3 + \mathbf v_1\otimes\mathbf v_2\otimes\mathbf v_3A=u1​⊗u2​⊗u3​+v1​⊗v2​⊗v3​ with ui=[ai,bi]⊤\mathbf u_i = [a_i,b_i]^\topui​=[ai​,bi​]⊤, vi=[ci,di]⊤\mathbf v_i = [c_i,d_i]^\topvi​=[ci​,di​]⊤ is equivalent to the eight cubic equations (30) in the twelve unknowns a1,…,d3a_1,\dots,d_3a1​,…,d3​, one for each entry of A\mathcal AA.

In Lean, outer x y z and rankOver E A implement the two definitions, tensorA is A\mathcal AA, and System30 is (30).

Formalization targets

Goal: Theorem 1.14

∃ A∈Q2×2×2:rank⁡R(A)<rank⁡Q(A).\exists\, \mathcal A \in \mathbb Q^{2\times2\times2}:\quad \operatorname{rank}_{\mathbb R}(\mathcal A) < \operatorname{rank}_{\mathbb Q}(\mathcal A).∃A∈Q2×2×2:rankR​(A)<rankQ​(A).

Milestones (proof of Theorem 1.14, p. 0:26)

  1. With z=x+2 y\mathbf z = \mathbf x + \sqrt2\,\mathbf yz=x+2​y and zˉ=x−2 y\bar{\mathbf z} = \mathbf x - \sqrt2\,\mathbf yzˉ=x−2​y:
zˉ⊗z⊗zˉ+z⊗zˉ⊗z=A,so rank⁡R(A)≤2.\bar{\mathbf z}\otimes\mathbf z\otimes\bar{\mathbf z} + \mathbf z\otimes\bar{\mathbf z}\otimes\mathbf z = \mathcal A,\qquad\text{so } \operatorname{rank}_{\mathbb R}(\mathcal A)\le 2.zˉ⊗z⊗zˉ+z⊗zˉ⊗z=A,so rankR​(A)≤2.
  1. A tensor of rank at most 2 over a field is a sum of two outer products, and for A\mathcal AA the identity (29) A=u1⊗u2⊗u3+v1⊗v2⊗v3\mathcal A = \mathbf u_1\otimes\mathbf u_2\otimes\mathbf u_3 + \mathbf v_1\otimes\mathbf v_2\otimes\mathbf v_3A=u1​⊗u2​⊗u3​+v1​⊗v2​⊗v3​ holds exactly when the coordinates of ui,vi\mathbf u_i, \mathbf v_iui​,vi​ satisfy (30).
  2. Every solution of (30) in a field of characteristic zero satisfies 2c22−d22=02c_2^2 - d_2^2 = 02c22​−d22​=0 and c1d2d3+2=0c_1d_2d_3 + 2 = 0c1​d2​d3​+2=0.
  3. Lemma 8.1: (30) has no rational solution.
  4. rank⁡Q(A)>2\operatorname{rank}_{\mathbb Q}(\mathcal A) > 2rankQ​(A)>2.

Significance

The theorem shows that tensor rank, unlike matrix rank, is not invariant under field extension even between Q\mathbb QQ and R\mathbb RR, and even for the smallest nontrivial format 2×2×22\times2\times22×2×2. Its consequence for complexity is that a hardness result for rank over Q\mathbb QQ cannot be transferred to R\mathbb RR by reading the same instance in a larger field; the paper accordingly re-examines Håstad's construction to obtain hardness over R\mathbb RR and C\mathbb CC (Theorem 8.2), which is outside this mission.

The result is proved in the paper, with the decisive algebraic step delegated to a computer-algebra computation (Appendix). A machine-checked proof replaces that computation by a certificate verified in Lean, and it settles a printed error: one of the two consequences of (30) in the proof of Lemma 8.1 is printed with the wrong sign (see Formalization scope). No formalization of array tensor rank over a field, or of its field dependence, is known to exist in Mathlib or on this platform.

Difficulty

The upper bound is an identity among explicit 2×2×22\times2\times22×2×2 arrays. The lower bound is the substance: one must show that the cubic system (30), which has real solutions, has no rational one. Since (30) is solvable over R\mathbb RR, no argument by signs, inequalities or real geometry can work; the obstruction is arithmetic, coming from the irrationality of 2\sqrt22​. The step that fails in a naive attempt is the elimination: eliminating ten of the twelve unknowns from eight cubic equations by hand is impractical. A second, smaller difficulty is the reduction from "rank⁡Q(A)≤2\operatorname{rank}_{\mathbb Q}(\mathcal A) \le 2rankQ​(A)≤2" to two terms of the special form (29), which requires absorbing the scalars and padding a decomposition with fewer than two terms.

Formalization scope

  • Tensors are functions Fin l → Fin m → Fin n → E, with 0-based indices: the paper's aijka_{ijk}aijk​ is A (i-1) (j-1) (k-1). Vectors are Fin n → E.
  • rankOver E A is the sInf over N\mathbb NN of the lengths rrr of decompositions ∑sλs xs⊗ys⊗zs\sum_s \lambda_s\, \mathbf x_s\otimes\mathbf y_s\otimes\mathbf z_s∑s​λs​xs​⊗ys​⊗zs​. The set is nonempty (one term per entry), so this is the paper's minimum. Zero summands are allowed; this gives the same minimum as the paper's sum of nonzero rank-1 tensors.
  • rank⁡R\operatorname{rank}_{\mathbb R}rankR​ of a rational tensor is rankOver ℝ of its entrywise cast to R\mathbb RR; rank⁡Q\operatorname{rank}_{\mathbb Q}rankQ​ is rankOver ℚ, whose witnesses are rational. A formalization in which both ranks range over real witnesses would make the theorem false.
  • The goal is the printed existential. It is not a loophole: the milestones concern the paper's explicit tensor.
  • Readings of loose phrases: "Suppose not and that there exist ui,vi\mathbf u_i, \mathbf v_iui​,vi​ with (29). Identity (29) gives eight equations found in (30)" is split into a general statement (rank at most 2 over any field means a sum of two outer products) and the equivalence of (29) with (30) over every field of characteristic zero (milestone 2); both are stated in a generality in which their hypotheses can hold, because for A\mathcal AA over Q\mathbb QQ they cannot. "Polynomial consequences of (30)" is read as "holds at every solution of (30) in every field of characteristic zero" (milestone 3); over Q\mathbb QQ alone the statement would be vacuous, since (30) has no rational solution.
  • Corrected error. The paper prints the second consequence as c1d2d3−2=0c_1d_2d_3 - 2 = 0c1​d2​d3​−2=0. It is false: the real solution from milestone 1 has c1d2d3=−2c_1d_2d_3 = -2c1​d2​d3​=−2. The milestone states c1d2d3+2=0c_1d_2d_3 + 2 = 0c1​d2​d3​+2=0 (checked by a Gröbner basis computation over Q\mathbb QQ), which serves the paper's argument equally. The Appendix certificates GkG_kGk​, HkH_kHk​ (p. 0:34) are not used in any statement.
  • Out of scope: Theorem 1.15/8.2 (Håstad's construction over R\mathbb RR and C\mathbb CC) and the conjectures of §13.

Needed infrastructure: finite sums of arrays, Real.sqrt and irrational_sqrt_two, and an ideal-membership certificate for milestone 3. The array rank rankOver is reusable for any statement about tensor rank over a field. The platform's mme_tensor_rank (restriction-based rank of a TensorObj over a single field, from the matrix-multiplication exponent series) is a different object and is not reused. Proofs of any milestone, and alternative certificates for Lemma 8.1, are welcome.

Selected references

  • C. J. Hillar and L.-H. Lim, Most tensor problems are NP-hard, J. ACM 60(6), Art. 45, 2013. https://doi.org/10.1145/2512329 (arXiv: https://arxiv.org/abs/0911.1393)
  • J. Håstad, Tensor rank is NP-complete, J. Algorithms 11(4), 644–654, 1990. https://doi.org/10.1016/0196-6774(90)90014-6
  • V. de Silva and L.-H. Lim, Tensor rank and the ill-posedness of the best low-rank approximation problem, SIAM J. Matrix Anal. Appl. 30(3), 1084–1127, 2008. https://doi.org/10.1137/06066518X
  • F. L. Hitchcock, The expression of a tensor or a polyadic as a sum of products, J. Math. Phys. 6, 164–189, 1927. https://doi.org/10.1002/sapm192761164
8 thms2 active usersReviewed
🏆Completed
Convex OptimizationNumerical AnalysisOperations Research+1·Captain: mikedeng1

A Primal-Dual Interior-Point Algorithm for Nonsymmetric Exponential-Cone Optimization 2: Rank-One Recursions Factor Y₀(Y₀ᵀS₀)⁻¹Y₀ᵀ = VVᵀ and S₀(Y₀ᵀS₀)⁻¹S₀ᵀ = UUᵀResearch Paper

Motivation

Quasi-Newton methods replace the Hessian of an objective by a matrix H≻0H \succ 0H≻0 that is updated from observed pairs of steps and gradient changes. The secant equation HS=YHS = YHS=Y asks the new matrix to map the observed steps SSS to the observed changes YYY. The best-known update is BFGS, which for ppp simultaneous pairs S,Y∈Rn×pS, Y \in \mathbb{R}^{n\times p}S,Y∈Rn×p reads

HBFGS:=Y(YTS)−1YT+H−HS(STHS)−1STH.H_{\mathrm{BFGS}} := Y(Y^TS)^{-1}Y^T + H - HS(S^THS)^{-1}S^TH .HBFGS​:=Y(YTS)−1YT+H−HS(STHS)−1STH.

Schnabel (Quasi-Newton methods using multiple secant equations, technical report, University of Colorado at Boulder, 1983, reference [25] of the paper) studied such multiple-secant updates; one of his results is that a positive definite HHH with HS=YHS = YHS=Y exists exactly when YTS≻0Y^TS \succ 0YTS≻0.

Dahl and Andersen (Math. Program. 194:341–370, 2022) use multiple-secant BFGS updates to build primal-dual scaling matrices for an interior-point algorithm on the nonsymmetric exponential cone, following Tunçel (Found. Comput. Math. 1:229–254, 2001) and Myklebust and Tunçel (arXiv:1411.2129). In their setting p=2p = 2p=2, and they need the update in factored, low-rank form. Their Theorem 2 supplies it: the term Y(YTS)−1YTY(Y^TS)^{-1}Y^TY(YTS)−1YT, and its counterpart S(YTS)−1STS(Y^TS)^{-1}S^TS(YTS)−1ST for the inverse update, are computed by ppp rank-one steps. These steps resemble single-secant quasi-Newton updates, and no inverse is formed. This mission formalizes Theorem 2 and the steps of its proof.

Setting

Let n,p≥0n, p \ge 0n,p≥0 and Y0,S0∈Rn×pY_0, S_0 \in \mathbb{R}^{n\times p}Y0​,S0​∈Rn×p. Write eke_kek​ for the kkk-th unit vector of Rp\mathbb{R}^pRp and ⟨a,b⟩=aTb\langle a, b\rangle = a^Tb⟨a,b⟩=aTb for the inner product of Rn\mathbb{R}^nRn, so that ⟨Yek,Sek⟩=(YTS)kk\langle Ye_k, Se_k\rangle = (Y^TS)_{kk}⟨Yek​,Sek​⟩=(YTS)kk​. The hypothesis of the theorem is

Y0TS0≻0,Y_0^TS_0 \succ 0,Y0T​S0​≻0,

meaning that the p×pp\times pp×p matrix Y0TS0Y_0^TS_0Y0T​S0​ is symmetric and positive definite.

For k=1,…,pk = 1, \dots, pk=1,…,p the recursions (25)–(26) are

vk:=Yk−1ek⟨Yk−1ek,Sk−1ek⟩1/2,Yk:=Yk−1−vkvkTSk−1,v_k := \frac{Y_{k-1}e_k}{\langle Y_{k-1}e_k, S_{k-1}e_k\rangle^{1/2}}, \qquad Y_k := Y_{k-1} - v_kv_k^TS_{k-1},vk​:=⟨Yk−1​ek​,Sk−1​ek​⟩1/2Yk−1​ek​​,Yk​:=Yk−1​−vk​vkT​Sk−1​, uk:=Sk−1ek⟨Yk−1ek,Sk−1ek⟩1/2,Sk:=Sk−1−ukukTYk−1.u_k := \frac{S_{k-1}e_k}{\langle Y_{k-1}e_k, S_{k-1}e_k\rangle^{1/2}}, \qquad S_k := S_{k-1} - u_ku_k^TY_{k-1}.uk​:=⟨Yk−1​ek​,Sk−1​ek​⟩1/2Sk−1​ek​​,Sk​:=Sk−1​−uk​ukT​Yk−1​.

Both updates of step kkk use the previous pair (Yk−1,Sk−1)(Y_{k-1}, S_{k-1})(Yk−1​,Sk−1​). Collect the vectors into V:=(v1⋯vp)V := (v_1 \cdots v_p)V:=(v1​⋯vp​) and U:=(u1⋯up)∈Rn×pU := (u_1 \cdots u_p) \in \mathbb{R}^{n\times p}U:=(u1​⋯up​)∈Rn×p.

The proof uses two more objects. The first is the p×pp\times pp×p matrix

L:=(Y0TS0e1⟨Y0e1,S0e1⟩1/2,⋯ ,Yp−1TSp−1ep⟨Yp−1ep,Sp−1ep⟩1/2).L := \left(\frac{Y_0^TS_0e_1}{\langle Y_0e_1, S_0e_1\rangle^{1/2}}, \cdots, \frac{Y_{p-1}^TS_{p-1}e_p}{\langle Y_{p-1}e_p, S_{p-1}e_p\rangle^{1/2}}\right).L:=(⟨Y0​e1​,S0​e1​⟩1/2Y0T​S0​e1​​,⋯,⟨Yp−1​ep​,Sp−1​ep​⟩1/2Yp−1T​Sp−1​ep​​).

The second is Ψk\Psi_kΨk​, the principal submatrix formed by the last p−kp-kp−k rows and columns of YkTSkY_k^TS_kYkT​Sk​. In Lean these are ExpConeIPM.Secant.Ys, Ss, d, V, U, L and Ψ, all in one definition item.

Formalization targets

Goal: Theorem 2 (pp. 357–358)

Y0(Y0TS0)−1Y0T=VVT,S0(Y0TS0)−1S0T=UUT.Y_0(Y_0^TS_0)^{-1}Y_0^T = VV^T, \qquad S_0(Y_0^TS_0)^{-1}S_0^T = UU^T .Y0​(Y0T​S0​)−1Y0T​=VVT,S0​(Y0T​S0​)−1S0T​=UUT.

Milestones (the steps of the proof, pp. 358–359)

  1. (27). For k=1,…,pk = 1, \dots, pk=1,…,p,
YkTSk=Yk−1TSk−1−(Yk−1TSk−1ek)(Yk−1TSk−1ek)T⟨Yk−1ek,Sk−1ek⟩.Y_k^TS_k = Y_{k-1}^TS_{k-1} - \frac{(Y_{k-1}^TS_{k-1}e_k)(Y_{k-1}^TS_{k-1}e_k)^T}{\langle Y_{k-1}e_k, S_{k-1}e_k\rangle}.YkT​Sk​=Yk−1T​Sk−1​−⟨Yk−1​ek​,Sk−1​ek​⟩(Yk−1T​Sk−1​ek​)(Yk−1T​Sk−1​ek​)T​.
  1. Well-definedness. For k=0,…,p−1k = 0, \dots, p-1k=0,…,p−1, Ψk≻0\Psi_k \succ 0Ψk​≻0, and in particular ⟨Ykek+1,Skek+1⟩>0\langle Y_ke_{k+1}, S_ke_{k+1}\rangle > 0⟨Yk​ek+1​,Sk​ek+1​⟩>0.
  2. Sparsity. Yjek=Sjek=0Y_je_k = S_je_k = 0Yj​ek​=Sj​ek​=0 for 1≤k≤j≤p1 \le k \le j \le p1≤k≤j≤p.
  3. Cholesky factorization (28). LLT=Y0TS0LL^T = Y_0^TS_0LLT=Y0T​S0​.
  4. The VVV-identity. LVT=Y0TLV^T = Y_0^TLVT=Y0T​.

The first identity of the goal follows from milestones 4 and 5. The paper says the second "follows similarly". The analogous identity LUT=S0TLU^T = S_0^TLUT=S0T​ is not displayed in the paper, so it is not a milestone.

Significance

The result. Theorem 2 expresses the multiple-secant part of the BFGS update (23), and of its inverse, as a sum of ppp rank-one terms vkvkTv_kv_k^Tvk​vkT​ and ukukTu_ku_k^Tuk​ukT​. Each term comes from a recursion that touches one column at a time. On pp. 359–360 Dahl and Andersen apply it twice with p=2p = 2p=2. This gives the BFGS scaling of their exponential-cone algorithm as an explicit rank-3 update of μF′′(x)\mu F''(x)μF′′(x), which is how the algorithm implemented in MOSEK computes its scaling matrices (§6, p. 361 of the paper). The argument is a Cholesky factorization of Y0TS0Y_0^TS_0Y0T​S0​ carried out implicitly on the factors Y0Y_0Y0​ and S0S_0S0​.

Formalizing it. The theorem is proved in the paper, in under a page. Its proof leaves two steps implicit. The first is that the symmetry of every YkTSkY_k^TS_kYkT​Sk​, which (27) and the step to LVT=Y0TLV^T = Y_0^TLVT=Y0T​ use, propagates from Y0TS0Y_0^TS_0Y0T​S0​. The second is the second identity, which the paper does not prove. A machine-checked proof records both. To our knowledge no proof assistant has a formal treatment of multiple-secant updates. The recursion also gives a reusable statement: a column-by-column Schur-complement process on a product YTSY^TSYTS produces its Cholesky factor.

Difficulty

The obvious route expands VVTVV^TVVT directly and compares it with Y0(Y0TS0)−1Y0TY_0(Y_0^TS_0)^{-1}Y_0^TY0​(Y0T​S0​)−1Y0T​. This leads nowhere, because vkv_kvk​ depends on all earlier steps through Yk−1Y_{k-1}Yk−1​ and Sk−1S_{k-1}Sk−1​. The step that carries the proof is an invariant over the recursion. The trailing blocks Ψk\Psi_kΨk​ of YkTSkY_k^TS_kYkT​Sk​ must stay symmetric positive definite, and the leading columns of YkY_kYk​ and SkS_kSk​ must stay zero. Both must be maintained together through a pair of coupled updates, in which SkS_kSk​ is updated with the old Yk−1Y_{k-1}Yk−1​. A second difficulty is bookkeeping: the paper's 1-based columns, the step count kkk, and the trailing block of size p−kp-kp−k shift relative to each other.

The hypothesis needs care. If Y0TS0Y_0^TS_0Y0T​S0​ is only assumed to satisfy xTY0TS0x>0x^TY_0^TS_0x > 0xTY0T​S0​x>0 for x≠0x \ne 0x=0, without symmetry, the identities are false in general. A 5×35\times 35×3 instance whose symmetric part is positive definite, with a small antisymmetric part, violates the first identity by 0.440.440.44 in the largest entry.

Formalization scope

Everything is real matrix algebra over Matrix (Fin n) (Fin p) ℝ, with arbitrary n,pn, pn,p (including p=0p = 0p=0, where both sides are zero). The formalization commits to the following conventions.

  • Y0TS0≻0Y_0^TS_0 \succ 0Y0T​S0​≻0 is Matrix.PosDef, which includes symmetry. The inverse is Matrix.inv. It is a genuine inverse under this hypothesis.
  • Columns are 0-based. Column j : Fin p is the paper's ej+1e_{j+1}ej+1​. Ys Y₀ S₀ k and Ss Y₀ S₀ k are YkY_kYk​ and SkS_kSk​ after kkk steps, and they are left unchanged after step ppp. d Y₀ S₀ j is ⟨Yjej+1,Sjej+1⟩\langle Y_je_{j+1}, S_je_{j+1}\rangle⟨Yj​ej+1​,Sj​ej+1​⟩.
  • The square root is Real.sqrt. The division by it is multiplication by an inverse. Both return junk values on non-positive arguments, which never occur under the hypothesis; milestone 2 states this.
  • VVV, UUU and LLL are computed from the recursion (25)–(26). They are never chosen as some factorization satisfying the conclusion. The trivializing formalization, which defines VVV as any factor of Y0(Y0TS0)−1Y0TY_0(Y_0^TS_0)^{-1}Y_0^TY0​(Y0T​S0​)−1Y0T​, is ruled out by construction.
  • Each milestone carries the theorem's hypothesis Y0TS0≻0Y_0^TS_0 \succ 0Y0T​S0​≻0. No hypothesis on the intermediate YkTSkY_k^TS_kYkT​Sk​ is assumed, since its symmetry is part of what must be proved.

No repair of the printed statements was needed. On p. 359 two misprints are not copied: ⟨Yp−1Tep,Sp−1ep⟩\langle Y_{p-1}^Te_p, S_{p-1}e_p\rangle⟨Yp−1T​ep​,Sp−1​ep​⟩ for ⟨Yp−1ep,Sp−1ep⟩\langle Y_{p-1}e_p, S_{p-1}e_p\rangle⟨Yp−1​ep​,Sp−1​ep​⟩, and SiTYiS_i^TY_iSiT​Yi​ for YiTSiY_i^TS_iYiT​Si​. The definition of LLL uses YiTSiY_i^TS_iYiT​Si​.

A complete development needs rank-one updates of products, Schur complements of a positive definite matrix in its leading entry, and inverses of LLTLL^TLLT for an invertible LLL. Schnabel's existence theorem (Theorem 1 of the paper) and the applications on pp. 359–360 are outside the mission. A general lemma on Schur-complement recursions producing Cholesky factors would be reusable on its own. Contributions on the U-side identity LUT=S0TLU^T = S_0^TLUT=S0T​ are welcome.

Selected references

  • J. Dahl, E. D. Andersen, A primal-dual interior-point algorithm for nonsymmetric exponential-cone optimization, Math. Program. 194:341–370, 2022. https://doi.org/10.1007/s10107-021-01631-4
  • R. B. Schnabel, Quasi-Newton methods using multiple secant equations, Technical Report, University of Colorado at Boulder, 1983 (no stable online link known; cited as [25] in Dahl–Andersen).
  • L. Tunçel, Generalization of primal-dual interior-point methods to convex optimization problems in conic form, Found. Comput. Math. 1:229–254, 2001. https://doi.org/10.1007/s102080010008
  • T. Myklebust, L. Tunçel, Interior-point algorithms for convex optimization based on primal-dual metrics, arXiv:1411.2129, 2014. https://arxiv.org/abs/1411.2129
7 thms2 active usersReviewed
🏆Completed
Graph TheoryTheoretical Computer Science·Captain: mikedeng1

Graph Sparsification by Effective Resistances 2: Approximate Laplacian Solves Preserve Effective-Resistance Sketches up to (1±ε)²Research Paper

Motivation

The effective resistance between two vertices of a weighted graph is the voltage difference that appears between them when the graph is viewed as an electrical network, edge weights being conductances, and one unit of current is injected at one vertex and extracted at the other. Effective resistances drive the spectral sparsification algorithm of Spielman and Srivastava (arXiv:0803.0929): sampling each edge with probability proportional to its weight times its effective resistance yields a sparse graph whose Laplacian approximates the original one. They are also used as a distance on graphs in the analysis of social and small-world networks, where they reflect how many short paths connect two vertices.

Computing every effective resistance exactly requires the pseudoinverse of the Laplacian, which costs far more than the size of the graph. Section 4 of the paper shows that all of them can be approximated in nearly linear time: a random projection compresses the relevant vectors to O(log⁡n)O(\log n)O(logn) dimensions, and the projected vectors are obtained from O(log⁡n)O(\log n)O(logn) calls to a fast approximate Laplacian solver (Spielman–Teng). This mission formalizes the deterministic statement that makes this procedure correct, Lemma 9: approximate solves, at a stated accuracy, do not destroy the approximation that the random projection provides.

Setting

Let G=(V,E,w)G=(V,E,w)G=(V,E,w) be a connected, simple, weighted undirected graph with n=∣V∣n=|V|n=∣V∣ vertices, edge set EEE and edge weights we>0w_e>0we​>0. Orient every edge arbitrarily, so that it has a head and a tail. The signed incidence matrix B∈RE×VB\in\mathbb R^{E\times V}B∈RE×V has B(e,v)=1B(e,v)=1B(e,v)=1 if vvv is the head of eee, −1-1−1 if vvv is its tail, and 000 otherwise. With WWW the diagonal matrix of weights, the Laplacian is L=BTWBL=B^{\mathsf T}WBL=BTWB, a symmetric positive semidefinite matrix whose kernel is spanned by the all-ones vector when GGG is connected. Its Moore–Penrose pseudoinverse is L+=∑λi≠0λi−1uiuiTL^+=\sum_{\lambda_i\neq 0}\lambda_i^{-1}u_iu_i^{\mathsf T}L+=∑λi​=0​λi−1​ui​uiT​, where uiu_iui​ are orthonormal eigenvectors of LLL with nonzero eigenvalues λi\lambda_iλi​.

For a vertex uuu let χu\chi_uχu​ be its indicator vector. The effective resistance between uuu and vvv is

Ruv=(χu−χv)TL+(χu−χv),R_{uv}=(\chi_u-\chi_v)^{\mathsf T}L^+(\chi_u-\chi_v),Ruv​=(χu​−χv​)TL+(χu​−χv​),

and Re=RabR_e=R_{ab}Re​=Rab​ for an edge eee with endpoints a,ba,ba,b. The LLL-norm of y∈RVy\in\mathbb R^Vy∈RV is ∥y∥L=yTLy\|y\|_L=\sqrt{y^{\mathsf T}Ly}∥y∥L​=yTLy​. Let wmin⁡w_{\min}wmin​ and wmax⁡w_{\max}wmax​ be the smallest and largest edge weights.

A resistance sketch is a k×nk\times nk×n matrix ZZZ (columns indexed by VVV) with

(1−ε)Ruv≤∥Z(χu−χv)∥2≤(1+ε)Ruvfor all u,v,(1-\varepsilon)R_{uv}\le\|Z(\chi_u-\chi_v)\|^2\le(1+\varepsilon)R_{uv}\quad\text{for all }u,v,(1−ε)Ruv​≤∥Z(χu​−χv​)∥2≤(1+ε)Ruv​for all u,v,

where ∥⋅∥\|\cdot\|∥⋅∥ is the Euclidean norm. In the paper, Z=QW1/2BL+Z=QW^{1/2}BL^+Z=QW1/2BL+ for a random ±1/k\pm1/\sqrt k±1/k​ matrix QQQ with k=O(log⁡n/ε2)k=O(\log n/\varepsilon^2)k=O(logn/ε2), and the Johnson–Lindenstrauss lemma makes it a sketch with high probability. Write ziz_izi​ and z~i\tilde z_iz~i​ for the iii-th rows of ZZZ and of an approximation Z~\widetilde ZZ, as vectors in RV\mathbb R^VRV.

Formalization targets

Goal: Lemma 9 (p. 11)

Let 0<ε<10<\varepsilon<10<ε<1. If ZZZ is a resistance sketch, if every row satisfies

∥zi−z~i∥L≤δ∥zi∥L,(4)\|z_i-\tilde z_i\|_L\le\delta\|z_i\|_L,\tag{4}∥zi​−z~i​∥L​≤δ∥zi​∥L​,(4)

and if

δ≤ε32(1−ε)wmin⁡(1+ε)n3wmax⁡,(5)\delta\le\frac{\varepsilon}{3}\sqrt{\frac{2(1-\varepsilon)w_{\min}}{(1+\varepsilon)n^3w_{\max}}},\tag{5}δ≤3ε​(1+ε)n3wmax​2(1−ε)wmin​​​,(5)

then for every pair u,vu,vu,v

(1−ε)2Ruv≤∥Z~(χu−χv)∥2≤(1+ε)2Ruv.(1-\varepsilon)^2R_{uv}\le\|\widetilde Z(\chi_u-\chi_v)\|^2\le(1+\varepsilon)^2R_{uv}.(1−ε)2Ruv​≤∥Z(χu​−χv​)∥2≤(1+ε)2Ruv​.

The lemma is stated for arbitrary kkk, ZZZ and Z~\widetilde ZZ: nothing about the random projection or the solver enters beyond (4) and the sketch property.

Milestones

  • Trace identity (§3, p. 8): ∑eweRe=n−1\sum_{e}w_eR_e=n-1∑e​we​Re​=n−1 for a connected graph.
  • Proposition 10 (p. 12): Ruv≥2/(nwmax⁡)R_{uv}\ge 2/(nw_{\max})Ruv​≥2/(nwmax​) for distinct vertices u≠vu\neq vu=v of a connected simple graph.

Significance

Lemma 9 is the correctness half of the paper's Theorem 2: together with a Johnson–Lindenstrauss lemma and the Spielman–Teng solver it yields a data structure, built in O~(mlog⁡r/ε2)\widetilde O(m\log r/\varepsilon^2)O(mlogr/ε2) time, that returns any effective resistance to within a factor (1±ε)2(1\pm\varepsilon)^2(1±ε)2 in O(log⁡n/ε2)O(\log n/\varepsilon^2)O(logn/ε2) time. This in turn makes the effective-resistance sampling of the paper's Theorem 1 run in nearly linear time, and the same sketch-and-solve pattern has been reused in later work on Laplacian solvers, graph sparsification and electrical-flow algorithms.

The result is proved in the paper. Formalizing it produces machine-checked statements of three facts that recur throughout spectral graph theory: the trace identity ∑eweRe=n−1\sum_e w_eR_e=n-1∑e​we​Re​=n−1 (Foster's theorem in its weighted form), the lower bound on effective resistances by comparison with the complete graph, and the stability of a resistance sketch under relative LLL-norm errors. Neither Mathlib nor this platform states any of them for the linear-algebraic definition of effective resistance used here.

Difficulty

The hypothesis (4) controls the error row by row, in the LLL-norm on RV\mathbb R^VRV, while the conclusion concerns the columns of Z~\widetilde ZZ applied to χu−χv\chi_u-\chi_vχu​−χv​, in the Euclidean norm on Rk\mathbb R^kRk, and it is a relative bound for every pair at once. A relative bound cannot hold unless RuvR_{uv}Ruv​ is bounded below uniformly over all pairs of distinct vertices, which is where the factors n3n^3n3, wmin⁡w_{\min}wmin​ and wmax⁡w_{\max}wmax​ of (5) come from. Such a lower bound is false for multigraphs, whose parallel edges can make RuvR_{uv}Ruv​ arbitrarily small, and the relation between the LLL-norm of a row and the Euclidean norms of the columns involves every edge of the graph, not only a path between uuu and vvv.

Proposition 10 is classically derived from Rayleigh's monotonicity law. Its standard formal statement on this platform concerns the probabilistic definition of effective resistance through hitting probabilities of a random walk, which is a different definition from (χu−χv)TL+(χu−χv)(\chi_u-\chi_v)^{\mathsf T}L^+(\chi_u-\chi_v)(χu​−χv​)TL+(χu​−χv​); no theorem relating the two is available.

Formalization scope

The graph is a structure WGraph V E over finite types VVV (vertices, n=n=n= Fintype.card V) and EEE (edges), with head, tail : E → V, head e ≠ tail e, weights w : E → ℝ with 0 < w e. Connectivity is that of the underlying simple graph (Mathlib's SimpleGraph.Connected, which includes V≠∅V\neq\emptysetV=∅); simplicity means that no two edges join the same unordered pair. Matrices are Mathlib matrices indexed by EEE and VVV. L+L^+L+ is the published Moore–Penrose pseudoinverse HarmonicGames.Decomposition.pinv of x↦Lxx\mapsto Lxx↦Lx on the Euclidean space RV\mathbb R^VRV, converted back to a matrix; for symmetric LLL this is the spectral pseudoinverse of §2.2. ∥Zx∥2\|Z x\|^2∥Zx∥2 is the sum of squares of the coordinates, not Lean's sup norm. n3n^3n3 is the real number n3n^3n3.

Choices committed to, relative to the page:

  • wmin⁡w_{\min}wmin​, wmax⁡w_{\max}wmax​ are any reals with 0<wmin⁡≤we≤wmax⁡0<w_{\min}\le w_e\le w_{\max}0<wmin​≤we​≤wmax​ for all edges; the exact extremes are an instance, and looser bounds only make (5) and Proposition 10 weaker.
  • ε\varepsilonε is assumed to satisfy 0<ε<10<\varepsilon<10<ε<1; the paper gives no range, and for ε≥1\varepsilon\ge1ε≥1 the square root in (5) has a non-positive argument.
  • The graph is assumed simple in Lemma 9 and Proposition 10. Proposition 10 is false for multigraphs (two parallel unit edges give R=1/2<1=2/(nwmax⁡)R=1/2<1=2/(nw_{\max})R=1/2<1=2/(nwmax​)), and the proof of Lemma 9 uses it.
  • Proposition 10 is stated for u≠vu\neq vu=v. As printed it claims all u,vu,vu,v, which fails at u=vu=vu=v since Ruu=0R_{uu}=0Ruu​=0.
  • The trace identity requires connectivity only.

A trivializing formalization is ruled out: the goal does not assume the intermediate inequality ∣∥Zx∥−∥Z~x∥∣≤(ε/3)∥Zx∥|\|Zx\|-\|\widetilde Zx\||\le(\varepsilon/3)\|Zx\|∣∥Zx∥−∥Zx∥∣≤(ε/3)∥Zx∥ of the proof, nor a stronger condition on δ\deltaδ than (5); its hypotheses are satisfiable (for example Z~=Z\widetilde Z=ZZ=Z with Z=W1/2BL+Z=W^{1/2}BL^+Z=W1/2BL+ and δ=0\delta=0δ=0), and its conclusion is not vacuous for n≥2n\ge2n≥2.

Infrastructure that a complete development needs, and that is reusable beyond this mission: the identity L+LL+=L+L^+LL^+=L^+L+LL+=L+ and LL+LL^+LL+ as the projection onto 1⊥\mathbf 1^\perp1⊥ for a connected Laplacian; the trace identity; Loewner-order monotonicity of RuvR_{uv}Ruv​ in the edge weights; and the effective resistances of the complete graph. Contributions of any of these as separate lemmas are welcome. The random projection (Johnson–Lindenstrauss) and the solver's running time are outside this mission.

Selected references

  • D. A. Spielman, N. Srivastava, Graph Sparsification by Effective Resistances, arXiv:0803.0929v4, 2009; SIAM J. Comput. 40(6), 2011. https://arxiv.org/abs/0803.0929, https://doi.org/10.1137/080734029
  • D. A. Spielman, S.-H. Teng, Nearly-linear time algorithms for preconditioning and solving symmetric, diagonally dominant linear systems, arXiv:cs/0607105. https://arxiv.org/abs/cs/0607105
  • D. Achlioptas, Database-friendly random projections: Johnson–Lindenstrauss with binary coins, J. Comput. Syst. Sci. 66(4), 2003. https://doi.org/10.1016/S0022-0000(03)00025-4
  • P. G. Doyle, J. L. Snell, Random Walks and Electric Networks, MAA, 1984. https://arxiv.org/abs/math/0001057
5 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Flows and Decompositions of Games: Harmonic and Potential Games 5: Every ϵ-Equilibrium of the Closest Potential Game Is an (ϵ + max_m 2α/√h_m)-Equilibrium of the Game, and ConverselyResearch Paper

Motivation

Potential games (Monderer and Shapley, 1996) are the finite games whose unilateral payoff differences are all differences of a single function, the potential. They always have a pure Nash equilibrium, and many natural learning dynamics (best response, fictitious play, logit response) converge in them. Most games met in applications are not exactly potential games, so a recurring question is how much of this theory survives for a game that is close to a potential game.

Candogan, Menache, Ozdaglar and Parrilo (arXiv:1005.2405, journal version Math. Oper. Res. 36(3), 2011) decompose the space of finite games into potential, harmonic and nonstrategic components. Section 6 of the paper equips the space of games with a weighted inner product under which this decomposition is orthogonal, computes the closest potential game to any game in closed form, and shows that approximate equilibria of a game and of its closest potential game correspond, with an explicit loss controlled by the distance between them. This mission formalizes that last result together with the statements it rests on.

Setting

A finite game has a finite set of players M\mathcal MM; each player mmm has a nonempty finite strategy set EmE^mEm with hm=∣Em∣h_m = |E^m|hm​=∣Em∣ elements, and a utility um:E→Ru^m : E \to \mathbb Rum:E→R on the set of strategy profiles E=∏mEmE = \prod_m E^mE=∏m​Em. For a profile ppp, (qm,p−m)(q^m, p^{-m})(qm,p−m) denotes ppp with player mmm's strategy replaced by qmq^mqm.

A profile ppp is an ϵ\epsilonϵ-equilibrium if um(pm,p−m)≥um(qm,p−m)−ϵu^m(p^m, p^{-m}) \ge u^m(q^m, p^{-m}) - \epsilonum(pm,p−m)≥um(qm,p−m)−ϵ for every player mmm and strategy qmq^mqm (equation (2) of the paper). A game is a potential game if there is φ:E→R\varphi : E \to \mathbb Rφ:E→R with φ(pm,p−m)−φ(qm,p−m)=um(pm,p−m)−um(qm,p−m)\varphi(p^m, p^{-m}) - \varphi(q^m, p^{-m}) = u^m(p^m, p^{-m}) - u^m(q^m, p^{-m})φ(pm,p−m)−φ(qm,p−m)=um(pm,p−m)−um(qm,p−m) for all mmm, pmp^mpm, qmq^mqm, p−mp^{-m}p−m (Definition 2.1).

A game is identified with its tuple of utilities, an element of C0MC_0^MC0M​ where C0={f:E→R}C_0 = \{f : E \to \mathbb R\}C0​={f:E→R}. The game graph has the profiles as nodes, with an edge between two profiles that differ in exactly one player's strategy. The operator DmD_mDm​ sends umu^mum to its differences along the edges where player mmm deviates, D=∑mDmD = \sum_m D_mD=∑m​Dm​, δ0\delta_0δ0​ is the gradient of the game graph, Πm=Dm†Dm\Pi_m = D_m^\dagger D_mΠm​=Dm†​Dm​, and †\dagger† is the Moore–Penrose pseudoinverse. Definition 4.2 defines the potential, harmonic and nonstrategic subspaces

P={u=Πu, Du∈im⁡δ0},H={u=Πu, Du∈ker⁡δ0∗},N=ker⁡D,\mathcal P = \{u = \Pi u,\ Du \in \operatorname{im}\delta_0\},\qquad \mathcal H = \{u = \Pi u,\ Du \in \ker\delta_0^*\},\qquad \mathcal N = \ker D ,P={u=Πu, Du∈imδ0​},H={u=Πu, Du∈kerδ0∗​},N=kerD,

and a harmonic game is a game in H⊕N\mathcal H \oplus \mathcal NH⊕N.

Section 6 introduces the weighted inner product and norm

⟨G,G^⟩M,E=∑mhm∑p∈Eum(p) u^m(p),∥G∥M,E2=⟨G,G⟩M,E.\langle G, \hat G\rangle_{M,E} = \sum_{m} h_m \sum_{p \in E} u^m(p)\,\hat u^m(p), \qquad \|G\|_{M,E}^2 = \langle G, G\rangle_{M,E} .⟨G,G^⟩M,E​=m∑​hm​p∈E∑​um(p)u^m(p),∥G∥M,E2​=⟨G,G⟩M,E​.

A closest potential game to GGG is a potential game G^\hat GG^ with ∥G−G^∥M,E≤∥G−G′∥M,E\|G - \hat G\|_{M,E} \le \|G - G'\|_{M,E}∥G−G^∥M,E​≤∥G−G′∥M,E​ for every potential game G′G'G′; a closest harmonic game is defined in the same way.

Formalization targets

Goal: Theorem 6.3

Let G^\hat GG^ be the closest potential game to GGG and α=∥G−G^∥M,E\alpha = \|G - \hat G\|_{M,E}α=∥G−G^∥M,E​. Then for every ϵ1\epsilon_1ϵ1​, every ϵ1\epsilon_1ϵ1​-equilibrium of G^\hat GG^ is an ϵ\epsilonϵ-equilibrium of GGG, and every ϵ1\epsilon_1ϵ1​-equilibrium of GGG is an ϵ\epsilonϵ-equilibrium of G^\hat GG^, where

ϵ=max⁡m∈M2αhm+ϵ1.\epsilon = \max_{m \in \mathcal M} \frac{2\alpha}{\sqrt{h_m}} + \epsilon_1 .ϵ=m∈Mmax​hm​​2α​+ϵ1​.

Milestones

  1. Lemma 2.1. If ∣um(p)−u^m(p)∣≤ϵ0|u^m(p) - \hat u^m(p)| \le \epsilon_0∣um(p)−u^m(p)∣≤ϵ0​ for all mmm and ppp, every ϵ1\epsilon_1ϵ1​-equilibrium of one game is a (2ϵ0+ϵ1)(2\epsilon_0 + \epsilon_1)(2ϵ0​+ϵ1​)-equilibrium of the other.
  2. Theorem 5.1. The set of potential games is the subspace P⊕N\mathcal P \oplus \mathcal NP⊕N.
  3. Theorem 6.1. Under ⟨⋅,⋅⟩M,E\langle\cdot,\cdot\rangle_{M,E}⟨⋅,⋅⟩M,E​ the subspaces P\mathcal PP, H\mathcal HH, N\mathcal NN are pairwise orthogonal.
  4. Theorem 6.2. With φ=δ0†Du\varphi = \delta_0^\dagger D uφ=δ0†​Du, the closest potential game to GGG has utilities Πmφ+(I−Πm)um\Pi_m \varphi + (I - \Pi_m)u^mΠm​φ+(I−Πm​)um, and the closest harmonic game has utilities um−Πmφu^m - \Pi_m\varphium−Πm​φ.

Significance

The result. Theorem 6.3 reduces the study of approximate equilibria of an arbitrary finite game to a potential game, where pure equilibria exist and are maximizers of the potential. Section 7 of the paper reports that, in a companion paper, best-response and fictitious-play dynamics are shown to converge to a neighbourhood of equilibria in near-potential games, with the size of the neighbourhood governed by the distance of the game to its closest potential game. Theorems 6.1 and 6.2 make that distance computable: the closest potential game is an orthogonal projection, given by linear operators of the game graph.

Formalizing it. All four statements are proved in the paper; none of them is machine-checked anywhere known to this mission. A formal development produces a verified operator layer for games on the game graph (gradient, pseudoinverses, the projections Πm\Pi_mΠm​), a verified proof that the weighted inner product, and not the unweighted one, makes the decomposition orthogonal, and a reusable perturbation lemma for ϵ\epsilonϵ-equilibria.

Difficulty

Lemma 2.1 and the final step of Theorem 6.3 are elementary inequalities. The obvious way to approximate a game by a potential game, taking the identical-interest part of its zero-sum/identical-interest split, does not give the closest potential game: the paper's Table 7 (p. 35) shows a potential game whose identical-interest part is far from it. The closest potential game has to come from the projection of Section 6. The weight of the mission is in Theorems 5.1, 6.1 and 6.2. They need the decomposition theorem of Section 4 (every game splits uniquely into P\mathcal PP, H\mathcal HH, N\mathcal NN) and properties of pseudoinverses of the operators DmD_mDm​ and δ0\delta_0δ0​ that Mathlib does not provide: Mathlib has no operator pseudoinverse at all. The orthogonality P⊥H\mathcal P \perp \mathcal HP⊥H under the weighted product rests on the specific spectral structure of the Laplacian of the graph of a single player's deviations; it is not a general fact, and it fails for the unweighted product when the hmh_mhm​ differ, so the standard orthogonal-complement machinery cannot be applied to C0MC_0^MC0M​ with its default inner product.

Formalization scope

Players are a finite type ι with decidable equality; strategy sets are finite types E m. Utilities are plain functions u : ι → (∀ m, E m) → ℝ, the shape used by the published MondererShapley.ClosedPath.IsPotentialGame, which is referenced for Definition 2.1. The operator layer works in PiLp 2 (fun _ => EuclideanSpace ℝ (∀ k, E k)) with the unweighted inner product of Section 4; edge flows carry the inner product 12∑(p,q)∈AX(p,q)Y(p,q)\tfrac12\sum_{(p,q)\in A} X(p,q)Y(p,q)21​∑(p,q)∈A​X(p,q)Y(p,q) of (7). The weighted inner product (55) and norm (56) are plain functions, not a second instance on the same type. "Closest" is the minimizing property itself, not an infimum of distances.

Hypotheses made explicit: every strategy set is nonempty (the paper's Em={1,…,hm}E^m = \{1,\dots,h_m\}Em={1,…,hm​}), so hm≥1h_m \ge 1hm​≥1; in Theorem 6.3 the set of players is nonempty, which the maximum over players needs. The paper's "an ϵ\epsilonϵ-equilibrium for some ϵ≤B\epsilon \le Bϵ≤B" is stated as "a BBB-equilibrium", which is equivalent because (2) is monotone in ϵ\epsilonϵ. Both directions of Lemma 2.1 and Theorem 6.3 are included.

The goal is stated for the closest potential game, as printed. A version for an arbitrary potential game at distance α\alphaα would be a different theorem, and the hypothesis is not vacuous: Theorem 6.2 shows the closest potential game exists. Theorem 6.2 is stated as an "if and only if" characterization, so it gives existence and uniqueness as well as the formula.

Contributions welcome: the Penrose identities for the pseudoinverse, the identities D†D=ΠD^\dagger D = \PiD†D=Π and Δ0,m=hmΠm\Delta_{0,m} = h_m \Pi_mΔ0,m​=hm​Πm​, and the decomposition theorem of Section 4, all of which are reusable by the other missions of this series.

Selected references

  • O. Candogan, I. Menache, A. Ozdaglar, P. A. Parrilo, Flows and Decompositions of Games: Harmonic and Potential Games, arXiv:1005.2405v2, 2010; Math. Oper. Res. 36(3):474–503, 2011. https://arxiv.org/abs/1005.2405, https://doi.org/10.1287/moor.1110.0500
  • D. Monderer, L. S. Shapley, Potential Games, Games Econ. Behav. 14(1):124–143, 1996. https://doi.org/10.1006/game.1996.0044
14 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryDynamical Systems·Captain: mikedeng1

Uncoupled Dynamics Do Not Lead to Nash Equilibrium 2: Near Jordan's Three-Player Game Γ₀ of Section III, No Uncoupled Dynamic Is Nash-ConvergentResearch Paper

Motivation

A central question of the theory of learning in games is whether simple adaptive behavior leads players to a Nash equilibrium. Many natural dynamics — fictitious play, best-reply dynamics, replicator dynamics — fail to converge in some games, and the failures are usually exhibited one dynamic at a time. Hart and Mas-Colell (AER 2003) asked a structural question instead: is there any continuous-time dynamic, satisfying one informational restriction, that converges to Nash equilibrium for all games in a reasonable family? The restriction is uncoupledness: each player's adjustment may depend on the current strategy profile and on that player's own payoff function, but not on the payoff functions of the others. This is the situation of players who do not know the opponents' preferences.

Their answer is negative, and the paper proves it with two examples. This mission formalizes the second, built on a three-player game introduced by James Jordan (GEB 1993) in his study of learning mixed-strategy equilibria. A companion mission formalizes the first example, a two-player game on the unit disk.

Setting

Three players each choose between two pure strategies, 000 and 111. A game Γ\GammaΓ is identified with its payoff functions (u1,u2,u3)(u^1,u^2,u^3)(u1,u2,u3), ui:{0,1}3→Ru^i:\{0,1\}^3\to\mathbb Rui:{0,1}3→R. A state is a mixed profile x=(x1,x2,x3)∈X=[0,1]3x=(x^1,x^2,x^3)\in X=[0,1]^3x=(x1,x2,x3)∈X=[0,1]3, where xix^ixi is the probability that player iii plays 000 (top row, left column, left matrix). Payoffs extend to XXX by expectation over independent randomizations, and xˉ\bar xxˉ is a Nash equilibrium when no player can raise its expected payoff by changing its own coordinate.

Jordan's family U0\mathcal U_0U0​ consists of the games

ui(s)={aisi=0, si+1=1,1si=1, si+1=0,0otherwise,u^i(s)=\begin{cases}a^i & s^i=0,\ s^{i+1}=1,\\ 1 & s^i=1,\ s^{i+1}=0,\\ 0&\text{otherwise,}\end{cases}ui(s)=⎩⎨⎧​ai10​si=0, si+1=1,si=1, si+1=0,otherwise,​

indices modulo 3, with parameters aia^iai close to 111: each player wants to mismatch the next player. Jordan's game Γ0\Gamma_0Γ0​ is the member with all ai=1a^i=1ai=1; every game of U0\mathcal U_0U0​ has a unique Nash equilibrium xˉi(Γ)=ai−1/(ai−1+1)\bar x^i(\Gamma)=a^{i-1}/(a^{i-1}+1)xˉi(Γ)=ai−1/(ai−1+1), and xˉ(Γ0)=(1/2,1/2,1/2)\bar x(\Gamma_0)=(1/2,1/2,1/2)xˉ(Γ0​)=(1/2,1/2,1/2).

A dynamic for a family U\mathcal UU is a vector field x˙=F(x;Γ)\dot x=F(x;\Gamma)x˙=F(x;Γ) on XXX, one for each Γ∈U\Gamma\in\mathcal UΓ∈U. It is uncoupled if Fi(x;Γ)=Fi(x;Γ′)F^i(x;\Gamma)=F^i(x;\Gamma')Fi(x;Γ)=Fi(x;Γ′) whenever Γ,Γ′∈U\Gamma,\Gamma'\in\mathcal UΓ,Γ′∈U give player iii the same payoff function. When every game of U\mathcal UU has a single Nash equilibrium xˉ(Γ)\bar x(\Gamma)xˉ(Γ), FFF is Nash-convergent for U\mathcal UU if, for every Γ∈U\Gamma\in\mathcal UΓ∈U, xˉ(Γ)\bar x(\Gamma)xˉ(Γ) is a rest point, every solution converges to it, F(⋅;Γ)F(\cdot;\Gamma)F(⋅;Γ) is C1C^1C1, and the Jacobian JJJ of F(⋅;Γ)F(\cdot;\Gamma)F(⋅;Γ) at xˉ(Γ)\bar x(\Gamma)xˉ(Γ) is hyperbolic and stable: all its eigenvalues have negative real parts.

Formalization targets

Goal: Theorem 1 near Jordan's game

Let U\mathcal UU have the single-Nash-equilibrium property and contain every game of U0\mathcal U_0U0​ that is close to Γ0\Gamma_0Γ0​. Then

no uncoupled dynamic for U is Nash-convergent for U.\text{no uncoupled dynamic for }\mathcal U\text{ is Nash-convergent for }\mathcal U .no uncoupled dynamic for U is Nash-convergent for U.

Milestones

  1. Every game of U0\mathcal U_0U0​ (indeed every aaa with all ai>0a^i>0ai>0) has the unique equilibrium xˉi=ai−1/(ai−1+1)\bar x^i=a^{i-1}/(a^{i-1}+1)xˉi=ai−1/(ai−1+1); in particular xˉ0=(1/2,1/2,1/2)\bar x_0=(1/2,1/2,1/2)xˉ0​=(1/2,1/2,1/2).
  2. If FFF is uncoupled and Nash-convergent, then f=F(⋅;Γ0)f=F(\cdot;\Gamma_0)f=F(⋅;Γ0​) satisfies fi(xˉ0+(y−12)ei)=0f^i(\bar x_0+(y-\tfrac12)e_i)=0fi(xˉ0​+(y−21​)ei​)=0 for yyy near 1/21/21/2, hence the diagonal and the trace of J=Df(xˉ0)J=Df(\bar x_0)J=Df(xˉ0​) vanish:
tr⁡J=0.\operatorname{tr}J=0.trJ=0.
  1. A real 3×33\times33×3 matrix with zero trace and nonzero determinant has an eigenvalue with positive real part.

Two further items record the paper's observations: uncoupledness forces J=(0c000de00)J=\begin{pmatrix}0&c&0\\0&0&d\\e&0&0\end{pmatrix}J=​00e​c00​0d0​​, and such a matrix has an eigenvalue with positive real part when cde≠0cde\ne0cde=0 and spectrum {0}\{0\}{0} otherwise. A last item shows that the coupled dynamic x˙=xˉ(Γ)−x\dot x=\bar x(\Gamma)-xx˙=xˉ(Γ)−x is Nash-convergent.

Significance

The theorem says that convergence to Nash equilibrium is not a property that adaptive dynamics can deliver on informational grounds alone: as soon as a family contains the games near Γ0\Gamma_0Γ0​, any rule in which players respond only to their own payoffs fails for some game, even though every game in the family has a unique equilibrium and a coupled rule converges for all of them. The finite example matters because it shows that the obstruction is not an artifact of continuum strategy spaces: it occurs in a 2×2×22\times2\times22×2×2 game in mixed strategies. The paper contrasts it (§IV) with the existence of uncoupled dynamics that converge to correlated equilibria: Nash equilibrium cannot be reached in an uncoupled way, while correlated equilibrium, a notion based on coordination, can. Follow-up work extends the impossibility to stochastic uncoupled dynamics (Hart and Mas-Colell, GEB 2006) and surveys the area (Hart, Econometrica 2005).

The result has been proved since 2003; no machine-checked proof of it is known. A formal proof requires an equilibrium computation in a parametric family of finite games, a careful treatment of the derivative of a vector field defined only on a cube, and a spectral fact about real 3×33\times33×3 matrices. The definitions of uncoupled and Nash-convergent dynamics written here are reusable for other impossibility results of the same kind.

Difficulty

The obvious attempt is to analyze a particular dynamic and show that it cycles around xˉ0\bar x_0xˉ0​. That proves nothing about other dynamics: the statement quantifies over every uncoupled FFF, so the argument must extract a constraint on FFF from uncoupledness alone. Uncoupledness only relates the dynamic at different games through single coordinates of FFF, and Nash-convergence only constrains FFF at the equilibria of the games in U\mathcal UU; neither says anything directly about the Jacobian at Γ0\Gamma_0Γ0​. Formally, the delicate steps are the uniqueness of the equilibrium for all nearby parameters, which requires excluding pure and partially mixed equilibria, and the passage from vanishing along a segment to a vanishing partial derivative.

Formalization scope

Players are indexed 0,1,20,1,20,1,2 in Lean (the page's player iii is index i−1i-1i−1), strategies are Fin 2, and a game is Fin 3 → (Fin 3 → Fin 2) → ℝ. The state space is X=[0,1]3⊂R3X=[0,1]^3\subset\mathbb R^3X=[0,1]3⊂R3; a dynamic is any map F:R3×Game→R3F:\mathbb R^3\times\text{Game}\to\mathbb R^3F:R3×Game→R3, whose values outside XXX never matter. Committed conventions:

  • Solutions stay in XXX: a solution is a curve on [0,∞)[0,\infty)[0,∞) with values in XXX satisfying the ODE (one-sided derivative at 000). Allowing curves that leave XXX would let the junk values of FFF outside XXX falsify convergence for every FFF and trivialize the goal.
  • Uncoupledness is required only between games of U\mathcal UU and only at states of XXX.
  • Nash-convergence bundles four clauses for every game of U\mathcal UU and every Nash equilibrium of it: rest point, C1C^1C1 on XXX, all eigenvalues of the Jacobian with negative real part (the published FatkhullinPolyak.Discrete.IsHurwitz), and convergence of every solution. The Jacobian is the derivative within XXX.
  • The single-Nash-equilibrium property of U\mathcal UU is a hypothesis of the goal.
  • The neighborhood hypothesis. The page assumes that U\mathcal UU contains a neighborhood of Γ0\Gamma_0Γ0​. The goal assumes less: U\mathcal UU contains every game of U0\mathcal U_0U0​ in some footnote-7 neighborhood of Γ0\Gamma_0Γ0​. The page's hypothesis implies this one, so the formal goal is at least as strong. The literal hypothesis is not used because it is not known (and not claimed on the page) to be compatible with the single-equilibrium property, and a contradictory pair of hypotheses would make the goal vacuous.
  • Milestone 1 assumes only ai>0a^i>0ai>0 instead of ∣ai−1∣<ε|a^i-1|<\varepsilon∣ai−1∣<ε for small ε\varepsilonε; this covers every such family with ε≤1\varepsilon\le1ε≤1.

The family U\mathcal UU cannot be vacuous: Jordan's games with ∣ai−1∣<1/2|a^i-1|<1/2∣ai−1∣<1/2 satisfy both hypotheses, and the coupled-dynamic item certifies that Nash-convergence itself can be met, so the goal's force rests on uncoupledness. Contributions welcome include the equilibrium computation for U0\mathcal U_0U0​, the spectral lemmas (which are independent of game theory), and the calculus step from vanishing along a segment to a vanishing partial derivative within a cube.

Selected references

  • S. Hart and A. Mas-Colell, Uncoupled Dynamics Do Not Lead to Nash Equilibrium, American Economic Review 93(5):1830–1836, 2003. https://doi.org/10.1257/000282803322655581
  • J. S. Jordan, Three Problems in Learning Mixed-Strategy Nash Equilibria, Games and Economic Behavior 5(3):368–386, 1993. https://doi.org/10.1006/game.1993.1022
  • S. Hart and A. Mas-Colell, Stochastic Uncoupled Dynamics and Nash Equilibrium, Games and Economic Behavior 57(2):286–303, 2006. https://doi.org/10.1016/j.geb.2005.09.007
  • S. Hart, Adaptive Heuristics, Econometrica 73(5):1401–1430, 2005. https://doi.org/10.1111/j.1468-0262.2005.00625.x
6 thms2 active usersReviewed
🏆Completed
CombinatoricsDiscrete GeometryGraph Theory·Captain: mikedeng1

The Geometry of Graphs and Some of Its Algorithmic Applications 4: The m-Cube Has Isometric Dimension mResearch Paper

Why graph dimension matters

A finite graph has distances defined by the lengths of its shortest paths. Representing those distances inside a normed vector space lets geometric language describe a combinatorial object, but the number of coordinates required can depend sharply on the graph. The isometric dimension asks for the smallest dimension of any real normed space that preserves every graph distance exactly. Linial, London, and Rabinovich study this invariant alongside metric embeddings and algorithmic uses of graph geometry in their 1995 paper. The cube is a useful test case: its vertices already have an obvious coordinate description, while the theorem must show that no different norm compresses those exact distances into fewer coordinates.

The paper's Section 5.3 relates isometric dimension to the rank of a matrix recording vertex distances in a maximum norm. It then computes the dimension of an even cycle and uses an isometric cycle inside the cube. These are known results of the paper, not an open conjecture. The mission isolates the rank characterization, the cycle calculation, and the cube calculation as reusable formal targets.

Graphs, norms, and the cube

For a finite connected simple graph G=(V,E)G=(V,E)G=(V,E), let dG(x,y)d_G(x,y)dG​(x,y) be the minimum number of edges in a path from xxx to yyy. A norm NNN on Rd\mathbb R^dRd is nonnegative, vanishes only at zero, satisfies N(av)=∣a∣N(v)N(av)=|a|N(v)N(av)=∣a∣N(v), and obeys N(u+v)≤N(u)+N(v)N(u+v)\leq N(u)+N(v)N(u+v)≤N(u)+N(v). An isometric embedding is a map φ:V→Rd\varphi:V\to\mathbb R^dφ:V→Rd such that N(φ(x)−φ(y))=dG(x,y)N(\varphi(x)-\varphi(y))=d_G(x,y)N(φ(x)−φ(y))=dG​(x,y) for every pair of vertices. The number dim⁡(G)\dim(G)dim(G) is the least ddd for which some norm and some such map exist. The paper states the more general metric-space definition in Definition 2.1 and adopts connected graphs as the standing convention in Section 5.1 (pp. 218–219, 229).

The mmm-cube has binary strings x=(x1,…,xm)x=(x_1,\ldots,x_m)x=(x1​,…,xm​) as vertices. Two strings are adjacent when exactly one coordinate differs. Its graph distance is the Hamming distance, the number of differing coordinates. For m≥2m\geq2m≥2, the even cycle C2mC_{2m}C2m​ has 2m2m2m vertices in cyclic order, each adjacent to its two neighbors. A graph JJJ is an isometric subgraph of GGG when its distances between its own vertices agree with their distances in GGG.

An ∣V∣×r|V|\times r∣V∣×r real matrix MMM implements GGG when the maximum absolute coordinate difference between rows iii and jjj is dG(i,j)d_G(i,j)dG​(i,j), for every pair. The number of columns rrr is allowed to vary; the matrix rank is its ordinary linear-algebraic rank. This is the matrix object in Theorem 5.7, p. 232.

Formalization targets

The first main intermediate target is the rank characterization

dim⁡(G)=min⁡M implements Grank⁡(M).\dim(G)=\min_{M\text{ implements }G}\operatorname{rank}(M).dim(G)=M implements Gmin​rank(M).

The next is the even-cycle result, stated for m≥2m\geq2m≥2:

dim⁡(C2m)=m.\dim(C_{2m})=m.dim(C2m​)=m.

The goal is Corollary 5.12, p. 233, for every positive integer mmm:

dim⁡(m-Cube)=m.\boxed{\dim(m\text{-Cube})=m.}dim(m-Cube)=m.​

The milestone list also records the isometric-subgraph lower bound, the nonsingularity of the distance matrix of a path, an isometric embedding of the cube into ℓ1m\ell_1^mℓ1m​, and an isometric C2mC_{2m}C2m​ inside the cube. The paper's proof of the corollary names the last two facts in consecutive sentences (p. 233).

What the result establishes

The upper bound says the familiar mmm binary coordinates suffice: the cube embeds in ℓ1m\ell_1^mℓ1m​ with all distances preserved. The lower bound is stronger than a claim about that particular norm or embedding. It rules out every real normed space of dimension below mmm, regardless of its norm. The even cycle provides a separate exact dimension calculation, while Theorem 5.7 gives a matrix-rank way to study other finite graph metrics. These statements separate the graph invariant from whichever embedding happens to be easiest to draw (Section 5.3, pp. 232–233).

The paper proves these claims mathematically. The remaining formalization work is to build machine-checked proofs of their precise statements, including the finite-dimensional norm interface, graph-distance calculations, implementing matrices, and the rank lower bound. The definitions of normed realization and implementing matrix can be reused for other graphs; the path-distance determinant can be used independently of graph embedding questions. The mission's theorem files are open proof targets, not claims that these proofs have already been checked in Lean.

Where the difficulty lies

Placing binary cube vertices in ℓ1m\ell_1^mℓ1m​ gives an immediate candidate for an upper bound, but it cannot by itself exclude embeddings into lower-dimensional spaces with a different norm. The lower bound has to control all norms. Theorem 5.7 converts that unrestricted geometric question into a rank statement for every implementing matrix, and Proposition 5.10 supplies the exact cycle dimension needed by the cube argument (pp. 232–233).

The paper's printed proof of Proposition 5.10 first obtains only rank⁡(A)≥m−1\operatorname{rank}(A)\geq m-1rank(A)≥m−1, then says a more careful analysis yields mmm without spelling it out. That final rank step is a genuine proof obligation for solvers; the stated proposition and its use in Corollary 5.12 are retained exactly (p. 233). The path-distance matrix cited in that proof is nonsingular when its size is at least two; size one would be a zero matrix.

Formalization scope

Lean represents an arbitrary ddd-dimensional real normed space by a norm function on Fin d → ℝ. This includes every finite-dimensional real normed space up to a choice of coordinates. The isoDim definition takes the least natural-number dimension admitting an isometric embedding, with equality of distances for every vertex pair. The graph metric comes from SimpleGraph.dist; connectedness is explicit where the paper assumes it. The cube is the graph on Fin m → Bool with Hamming-distance-one adjacency, and C2mC_{2m}C2m​ is Mathlib's cycleGraph (2 * m). The goal assumes m≥1m\geq1m≥1; its m=1m=1m=1 case is direct, while the cycle milestones use m≥2m\geq2m≥2. A zero-dimensional cube consists of one vertex and is covered by the auxiliary upper-bound statement, though the goal follows the paper's positive-dimensional convention.

An implementing matrix has arbitrary finite column count. Instead of taking a maximum over an empty index set, the formal definition requires all column differences to be bounded by the graph distance and a column to attain that distance for distinct rows. This agrees with the paper's maximum formula whenever columns are present and handles a one-vertex graph with zero columns. Matrix rank is taken over R\mathbb RR; the path-distance matrix has entries ∣r−s∣|r-s|∣r−s∣ for indices 0,…,m−10,\ldots,m-10,…,m−1. The infimum over achievable dimensions or ranks is a minimum, since these are nonempty subsets of N\mathbb NN for finite connected graphs. No asymptotic O(⋅)O(\cdot)O(⋅) or Ω(⋅)\Omega(\cdot)Ω(⋅) bound occurs in these targets, so there is no hidden constant to instantiate.

The statements require genuine norm axioms and exact graph distances. Allowing a seminorm, assuming the desired dimension bound, or replacing the cube by a path would empty the main claim. Useful contributions include the cube-distance calculation, the path determinant, an exact even-cycle lower bound, and the general rank characterization. The paper makes no running-time claim for these particular results; no algorithmic complexity assertion is included.

Selected references

  • N. Linial, E. London, Y. Rabinovich, The geometry of graphs and some of its algorithmic applications, Combinatorica 15(2), 215–245, 1995. DOI: 10.1007/BF01200757.
  • J. H. van Lint, R. M. Wilson, A Course in Combinatorics, Cambridge University Press, 1992, pp. 64–65, cited as [44] by Linial et al. for the path distance-matrix fact. Book record.
11 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

Quick Approximation to Matrices and Applications III: The Atoms of a Cut Decomposition with Error εn² Form a 2ε-Pseudo-Regular Partition of a GraphResearch Paper

Motivation

Szemerédi's regularity lemma partitions the vertex set of any graph into a bounded number of parts between which edges are distributed almost randomly. It is a central tool of extremal graph theory, but the number of parts it needs is a tower of exponentials in 1/ϵ1/\epsilon1/ϵ, which makes it unusable in algorithms. In 1996 and 1999 Frieze and Kannan introduced a weaker notion, now called weak regularity: a partition is good if, for every pair of disjoint vertex sets S,TS,TS,T, the number of edges between them is predicted, up to an additive error ϵn2\epsilon n^2ϵn2, by the densities between the parts. This weaker requirement is enough to approximate dense instances of Max-Cut and other problems, and it can be met with only 2O(1/ϵ2)2^{O(1/\epsilon^2)}2O(1/ϵ2) parts.

The paper Frieze and Kannan, Quick approximation to matrices and applications, Combinatorica 19 (1999) derives such partitions from a matrix decomposition. Section 5.1 shows that if the adjacency matrix of a graph is approximated by a sum of a few cut matrices with small error in the cut norm, then the atoms of the sets defining those cut matrices form a pseudo-regular partition. The weak regularity of this paper later became the basis of the cut-distance theory of graph limits (Lovász, Large networks and graph limits, AMS, 2012).

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a simple graph with n=∣V∣n=|V|n=∣V∣ vertices and adjacency matrix A\mathbf AA. For a real V×VV\times VV×V matrix M\mathbf MM and S,T⊆VS,T\subseteq VS,T⊆V write M(S,T)=∑i∈S∑j∈TM(i,j)\mathbf M(S,T)=\sum_{i\in S}\sum_{j\in T}\mathbf M(i,j)M(S,T)=∑i∈S​∑j∈T​M(i,j). A cut matrix CUT(R,C,d)\mathrm{CUT}(R,C,d)CUT(R,C,d) has entry ddd on R×CR\times CR×C and 000 elsewhere. A cut decomposition of width sss is a sum D=D(1)+⋯+D(s)\mathbf D=\mathbf D^{(1)}+\dots+\mathbf D^{(s)}D=D(1)+⋯+D(s) of cut matrices D(t)=CUT(Rt,Ct,dt)\mathbf D^{(t)}=\mathrm{CUT}(R_t,C_t,d_t)D(t)=CUT(Rt​,Ct​,dt​); its error is W=A−D\mathbf W=\mathbf A-\mathbf DW=A−D.

Let P=V1,…,Vk\mathcal P=V_1,\dots,V_kP=V1​,…,Vk​ be a partition of VVV with index set KKK, write Xi=X∩ViX_i=X\cap V_iXi​=X∩Vi​, let e(S,T)e(S,T)e(S,T) be the number of edges between disjoint sets SSS and TTT, and let di,j=e(Vi,Vj)/(∣Vi∣∣Vj∣)d_{i,j}=e(V_i,V_j)/(|V_i||V_j|)di,j​=e(Vi​,Vj​)/(∣Vi​∣∣Vj​∣) be the density between parts. The deviation from regularity is

ΔP(S,T)=e(S,T)−∑i∈K∑j∈Kdi,j∣Si∣∣Tj∣,\Delta_{\mathcal P}(S,T)=e(S,T)-\sum_{i\in K}\sum_{j\in K}d_{i,j}|S_i||T_j|,ΔP​(S,T)=e(S,T)−i∈K∑​j∈K∑​di,j​∣Si​∣∣Tj​∣,

and P\mathcal PP is ϵ\epsilonϵ-pseudo-regular if ∣ΔP(S,T)∣≤ϵn2|\Delta_{\mathcal P}(S,T)|\le\epsilon n^2∣ΔP​(S,T)∣≤ϵn2 for all disjoint S,T⊆VS,T\subseteq VS,T⊆V.

For a partition Q=W1,…,Wq\mathcal Q=W_1,\dots,W_qQ=W1​,…,Wq​, the block average MQ\mathbf M_{\mathcal Q}MQ​ of M\mathbf MM takes the value M(Wi,Wj)/(∣Wi∣∣Wj∣)\mathbf M(W_i,W_j)/(|W_i||W_j|)M(Wi​,Wj​)/(∣Wi​∣∣Wj​∣) on Wi×WjW_i\times W_jWi​×Wj​, and M\mathbf MM is compatible with Q\mathcal QQ if it is constant on every block Wi×WjW_i\times W_jWi​×Wj​. The atom partition of R1,…,Rs,C1,…,CsR_1,\dots,R_s,C_1,\dots,C_sR1​,…,Rs​,C1​,…,Cs​ is the coarsest partition of VVV in which every RtR_tRt​ and CtC_tCt​ is a union of parts; it has at most 4s4^s4s parts.

Formalization targets

Goal: claim (50), p. 204

If the cut decomposition has error at most ϵn2\epsilon n^2ϵn2, that is

∣A(S,T)−D(S,T)∣≤ϵn2for all S,T⊆V,|\mathbf A(S,T)-\mathbf D(S,T)|\le\epsilon n^2\quad\text{for all }S,T\subseteq V,∣A(S,T)−D(S,T)∣≤ϵn2for all S,T⊆V,

then the atom partition V1,…,VkV_1,\dots,V_kV1​,…,Vk​ of the sets Rt,CtR_t,C_tRt​,Ct​ satisfies

∣ΔP(S,T)∣≤2ϵn2for all disjoint S,T⊆V,|\Delta_{\mathcal P}(S,T)|\le 2\epsilon n^2\quad\text{for all disjoint }S,T\subseteq V,∣ΔP​(S,T)∣≤2ϵn2for all disjoint S,T⊆V,

i.e. it is 2ϵ2\epsilon2ϵ-pseudo-regular. The width sss is unconstrained: the statement holds for decompositions of any width, and the width only enters through the bound k≤4sk\le 4^sk≤4s on the number of parts.

Milestones

  1. (47), p. 203. For disjoint S,TS,TS,T: A(S,T)=e(S,T)\mathbf A(S,T)=e(S,T)A(S,T)=e(S,T), AQ(S,T)=∑i,jdi,j∣Si∣∣Tj∣\mathbf A_{\mathcal Q}(S,T)=\sum_{i,j}d_{i,j}|S_i||T_j|AQ​(S,T)=∑i,j​di,j​∣Si​∣∣Tj​∣, hence
A(S,T)−AQ(S,T)=ΔQ(S,T).\mathbf A(S,T)-\mathbf A_{\mathcal Q}(S,T)=\Delta_{\mathcal Q}(S,T).A(S,T)−AQ​(S,T)=ΔQ​(S,T).
  1. D is compatible with P\mathcal PP, p. 204. The sum of the cut matrices is constant on every block of the atom partition.
  2. Lemma 7(a), p. 203. If Q\mathcal QQ refines P\mathcal PP and M\mathbf MM is compatible with P\mathcal PP, then
sup⁡S,T⊆V∣A(S,T)−AQ(S,T)∣≤2sup⁡S,T⊆V∣A(S,T)−M(S,T)∣.\sup_{S,T\subseteq V}|\mathbf A(S,T)-\mathbf A_{\mathcal Q}(S,T)|\le 2\sup_{S,T\subseteq V}|\mathbf A(S,T)-\mathbf M(S,T)|.S,T⊆Vsup​∣A(S,T)−AQ​(S,T)∣≤2S,T⊆Vsup​∣A(S,T)−M(S,T)∣.

Companions

  • Lemma 7(b), p. 204. If M\mathbf MM is compatible with P\mathcal PP, then ∥A−AP∥F≤∥A−M∥F\|\mathbf A-\mathbf A_{\mathcal P}\|_F\le\|\mathbf A-\mathbf M\|_F∥A−AP​∥F​≤∥A−M∥F​.
  • k≤4sk\le 4^sk≤4s, p. 204. The atom partition of 2s2s2s sets has at most 4s4^s4s parts.

Significance

Claim (50) is the bridge from matrix approximation to graph partitions. Combined with Theorem 7 of the same paper (every matrix has a cut decomposition of width at most 1/ϵ21/\epsilon^21/ϵ2 with cut-norm error ϵmn∥A∥F≤ϵn2\epsilon\sqrt{mn}\|\mathbf A\|_F\le\epsilon n^2ϵmn​∥A∥F​≤ϵn2 for a graph), it gives the weak regularity lemma: every graph has a 2ϵ2\epsilon2ϵ-pseudo-regular partition into at most 41/ϵ24^{1/\epsilon^2}41/ϵ2 parts. Pseudo-regularity in turn means that e(S,T)e(S,T)e(S,T) is determined up to 2ϵn22\epsilon n^22ϵn2 by the numbers ∣Si∣,∣Tj∣|S_i|,|T_j|∣Si​∣,∣Tj​∣, which reduces Max-Cut and related problems on dense graphs to a search over a bounded-dimensional space. Lemma 7(a) is of independent use: Section 5.1.1 of the paper applies it again to pass to an equitable refinement.

The results are proved in the paper. Mathlib contains Szemerédi's regularity lemma in its equipartition form, and the platform has a published statement of it; neither the Frieze–Kannan weak regularity statement, the deviation ΔP\Delta_{\mathcal P}ΔP​, nor Lemma 7 has a machine-checked proof known to this mission. The mission produces a formal statement and proof of the partition half of the weak regularity lemma, reusable with any cut decomposition, including the existence result of the companion mission on cut decompositions.

Difficulty

The identity (47) and the compatibility of D\mathbf DD are bookkeeping, but bookkeeping over Mathlib's Finpartition, atomise and the rational-valued edgeDensity, with sums over parts that must be regrouped into sums over vertices. The substance lies in Lemma 7(a). The obvious argument bounds ∣A−AQ∣|\mathbf A-\mathbf A_{\mathcal Q}|∣A−AQ​∣ by ∣A−M∣+∣M−AQ∣|\mathbf A-\mathbf M|+|\mathbf M-\mathbf A_{\mathcal Q}|∣A−M∣+∣M−AQ​∣, and the difficulty is the second term: M−AQ\mathbf M-\mathbf A_{\mathcal Q}M−AQ​ is constant on the blocks of Q\mathcal QQ, but its block sums on arbitrary S,TS,TS,T have to be controlled by block sums of A−M\mathbf A-\mathbf MA−M, on which A\mathbf AA and AQ\mathbf A_{\mathcal Q}AQ​ need not agree. The printed argument handles only disjoint S,TS,TS,T, while the lemma is stated, and needed, for all pairs; a complete proof must cover pairs that overlap.

Formalization scope

All objects are defined in one definitions item in the namespace FriezeKannan.PseudoReg. The vertex set is a Fintype VVV with decidable equality, the graph a SimpleGraph V with decidable adjacency, and its adjacency matrix Mathlib's adjMatrix over R\mathbb RR. A partition of VVV is a Finpartition of Finset.univ, whose parts are the index set KKK; refinement is Mathlib's order Q≤P\mathcal Q\le\mathcal PQ≤P. Densities are SimpleGraph.edgeDensity, cast to R\mathbb RR, for all pairs of parts. For distinct parts this is the paper's d(Vi,Vj)d(V_i,V_j)d(Vi​,Vj​). For a part with itself it is the block average A(Vi,Vi)/∣Vi∣2\mathbf A(V_i,V_i)/|V_i|^2A(Vi​,Vi​)/∣Vi​∣2, not the value e(A,A)/(∣A∣2)e(A,A)/\binom{|A|}{2}e(A,A)/(2∣A∣​) printed in the §5 preamble: with the printed value the identity (47) fails on diagonal blocks, and the proof of (50) uses (47). The atom partition is Mathlib's Finpartition.atomise of the family {Rt}∪{Ct}\{R_t\}\cup\{C_t\}{Rt​}∪{Ct​}. The Frobenius norm is the square root of the sum of squared entries.

The paper takes the cut matrices from its Theorem 2, a randomized algorithm. The goal replaces this by the one property its proof uses: the hypothesis ∣A(S,T)−D(S,T)∣≤ϵn2|\mathbf A(S,T)-\mathbf D(S,T)|\le\epsilon n^2∣A(S,T)−D(S,T)∣≤ϵn2 for all S,T⊆VS,T\subseteq VS,T⊆V (Theorem 2 bounds the cut norm, a maximum over all pairs, by ϵn∥A∥F≤ϵn2\epsilon n\|\mathbf A\|_F\le\epsilon n^2ϵn∥A∥F​≤ϵn2). The paper's symmetrised error Wˉ\bar{\mathbf W}Wˉ is not needed. Lemma 7 is stated for an arbitrary real matrix A\mathbf AA, and the suprema of Lemma 7(a) are written as "every bound ccc on the right-hand family gives the bound 2c2c2c on the left-hand family", over all pairs S,TS,TS,T. No hypothesis is added to any statement.

The partition in the goal is fixed as the atom partition. A formalization that let the partition vary would be trivial: the partition into singletons has Δ≡0\Delta\equiv0Δ≡0.

Needed infrastructure: regrouping sums over a Finpartition, and block sums of matrices constant on the blocks of a partition, on arbitrary and on block-compatible sets. These are reusable for any statement about cut norms of block-constant matrices. Proofs of the milestones, of the companions, and of the goal are all welcome.

Selected references

  • A. Frieze and R. Kannan, Quick approximation to matrices and applications, Combinatorica 19(2):175–220, 1999. https://doi.org/10.1007/s004930050052
  • A. Frieze and R. Kannan, The regularity lemma and approximation schemes for dense problems, Proc. 37th FOCS, 12–20, 1996. https://doi.org/10.1109/SFCS.1996.548459
  • E. Szemerédi, Regular partitions of graphs, Problèmes combinatoires et théorie des graphes, Colloq. Internat. CNRS 260, 399–401, 1978.
  • L. Lovász, Large networks and graph limits, AMS Colloquium Publications 60, 2012. https://doi.org/10.1090/coll/060
5 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations III: Reduced-Form Criterion — a Linear Generalized Equation over a Polyhedral Set Is Strongly Regular Iff Its Reduced Form Is Uniquely Solvable on LResearch Paper

Motivation

Many problems in optimization and equilibrium modelling, among them linear and nonlinear complementarity problems, variational inequalities over polyhedra, and the Karush–Kuhn–Tucker conditions of nonlinear programs, can be written as a single generalized equation

0∈f(x)+∂ψC(x),0\in f(x)+\partial\psi_C(x),0∈f(x)+∂ψC​(x),

where ∂ψC\partial\psi_C∂ψC​ is the normal-cone operator of a closed convex set CCC. S. M. Robinson introduced strong regularity of such an inclusion at a solution x0x_0x0​ in Strongly regular generalized equations (1980) and proved an implicit-function theorem for it: when the linearised inclusion has a locally unique, Lipschitz inverse, solutions of the perturbed problem exist, are locally unique and depend Lipschitz-continuously on the perturbation. Strong regularity has since become the standard stability notion behind sensitivity analysis and the local convergence of Newton-type methods for variational problems; see Dontchev and Rockafellar, Implicit Functions and Solution Mappings (Springer, 2nd ed. 2014, doi:10.1007/978-1-4939-1037-3).

Strong regularity depends only on the linearisation, so deciding it means deciding it for a linear generalized equation. For a general polyhedral set CCC the paper's appendix does this by a reduction: locally around x0x_0x0​ the problem is equivalent to a homogeneous problem on a cone, the reduced form, and strong regularity is equivalent to unique solvability of that reduced form. This mission formalizes that appendix and the criterion it yields.

Setting

Work in Rn\mathbb R^nRn with the standard inner product, which identifies Rn\mathbb R^nRn with its dual. For C⊆RnC\subseteq\mathbb R^nC⊆Rn the normal cone at xxx is

∂ψC(x)={y:⟨y,c−x⟩≤0 for all c∈C} if x∈C,∂ψC(x)=∅ if x∉C.\partial\psi_C(x)=\{y:\langle y,c-x\rangle\le 0\ \text{for all } c\in C\}\ \text{if } x\in C,\qquad \partial\psi_C(x)=\emptyset\ \text{if } x\notin C.∂ψC​(x)={y:⟨y,c−x⟩≤0 for all c∈C} if x∈C,∂ψC​(x)=∅ if x∈/C.

A set is polyhedral convex if it is the intersection of finitely many closed half-spaces. Fix a nonempty polyhedral convex CCC, an n×nn\times nn×n real matrix AAA and a∈Rna\in\mathbb R^na∈Rn, and consider

0∈Ax+a+∂ψC(x).(A.1)0\in Ax+a+\partial\psi_C(x).\qquad\text{(A.1)}0∈Ax+a+∂ψC​(x).(A.1)

It is strongly regular at a solution x0x_0x0​ with constant λ\lambdaλ if there are neighbourhoods UUU of 000 and VVV of x0x_0x0​ such that for each y∈Uy\in Uy∈U the perturbed inclusion

y∈Ax+a+∂ψC(x)(A.2)y\in Ax+a+\partial\psi_C(x)\qquad\text{(A.2)}y∈Ax+a+∂ψC​(x)(A.2)

has exactly one solution x=s(y)x=s(y)x=s(y) in VVV, and ∥s(y1)−s(y2)∥≤λ∥y1−y2∥\|s(y_1)-s(y_2)\|\le\lambda\|y_1-y_2\|∥s(y1​)−s(y2​)∥≤λ∥y1​−y2​∥ on UUU.

The reduction uses the following objects, all built from the data:

  • y0:=Ax0+ay_0:=Ax_0+ay0​:=Ax0​+a;
  • the face F:=∂ψC∗(−y0)F:=\partial\psi_C^*(-y_0)F:=∂ψC∗​(−y0​), the set of maximisers of ⟨−y0,⋅⟩\langle -y_0,\cdot\rangle⟨−y0​,⋅⟩ over CCC (it contains x0x_0x0​);
  • the tangent cone T:=TF(x0)=∂ψF(x0)∘T:=T_F(x_0)=\partial\psi_F(x_0)^\circT:=TF​(x0​)=∂ψF​(x0​)∘, the polar of the normal cone of FFF at x0x_0x0​;
  • the subspace LLL parallel to FFF (the direction of its affine hull) and the orthogonal projector PLP_LPL​;
  • the lineality space MMM of TTT, the subspace L∩M⊥L\cap M^\perpL∩M⊥, and the cone K:=T∩M⊥K:=T\cap M^\perpK:=T∩M⊥.

The reduced form of (A.1) at x0x_0x0​ is the inclusion z∈PLAw+∂ψT(w)z\in P_LAw+\partial\psi_T(w)z∈PL​Aw+∂ψT​(w) for z∈Lz\in Lz∈L; in an orthonormal basis adapted to MMM, L∩M⊥L\cap M^\perpL∩M⊥ and L⊥L^\perpL⊥ it is z∈Bw+∂ψRr×K(w)z\in Bw+\partial\psi_{\mathbb R^r\times K}(w)z∈Bw+∂ψRr×K​(w) with an (r+s)×(r+s)(r+s)\times(r+s)(r+s)×(r+s) matrix BBB. It is vacuous when L={0}L=\{0\}L={0}.

Formalization targets

Goal: Theorem A.4 (p. 60)

If x0x_0x0​ solves (A.1), then (A.1) is strongly regular at x0x_0x0​ if and only if

L={0}or∀z∈L ∃! w∈Rn: z∈PLAw+∂ψT(w).L=\{0\}\quad\text{or}\quad\forall z\in L\ \exists!\,w\in\mathbb R^n:\ z\in P_LAw+\partial\psi_T(w).L={0}or∀z∈L ∃!w∈Rn: z∈PL​Aw+∂ψT​(w).

No Lipschitz constant is fixed: the left side is "strongly regular for some λ\lambdaλ".

Milestones

  1. Proposition A.1 (p. 58): for x0∈Cx_0\in Cx0​∈C, (C−x0)∩U=TC(x0)∩U(C-x_0)\cap U=T_C(x_0)\cap U(C−x0​)∩U=TC​(x0​)∩U for some neighbourhood UUU of 000.
  2. Proposition A.2 (p. 58): on F=∂ψC∗(−y0)F=\partial\psi_C^*(-y_0)F=∂ψC∗​(−y0​), ∂ψF(x)=∂ψC(x)+y0R+\partial\psi_F(x)=\partial\psi_C(x)+y_0\mathbb R_+∂ψF​(x)=∂ψC​(x)+y0​R+​, and ∂ψC∗(−y)⊂F\partial\psi_C^*(-y)\subset F∂ψC∗​(−y)⊂F for yyy near y0y_0y0​.
  3. Proposition A.3 (p. 58): for x0∈Fx_0\in Fx0​∈F, near the origin, 0∈(y0+k)+∂ψC(x0+h)0\in(y_0+k)+\partial\psi_C(x_0+h)0∈(y0​+k)+∂ψC​(x0​+h) iff 0∈PLk+∂ψT(h)0\in P_Lk+\partial\psi_T(h)0∈PL​k+∂ψT​(h).
  4. The correspondence (A.4) (p. 60): for xxx near x0x_0x0​ and small yyy, (A.2) holds iff 0∈PL(Ah−y)+∂ψT(h)0\in P_L(Ah-y)+\partial\psi_T(h)0∈PL​(Ah−y)+∂ψT​(h) with h=x−x0h=x-x_0h=x−x0​.

Companions

  • Corollary 3.2 (p. 53), in two items. Sufficiency: the reduced form is vacuous, or B11B_{11}B11​ is nonsingular and the Schur complement B/B11B/B_{11}B/B11​ is positive definite. Characterisation when K=R+sK=\mathbb R^s_+K=R+s​: strongly regular iff vacuous, or B11B_{11}B11​ nonsingular and B/B11B/B_{11}B/B11​ a P-matrix.
  • The 3 × 3 linear complementarity example of §4 (p. 53): strongly regular at x0=(1,0,0)x_0=(1,0,0)x0​=(1,0,0), and not strongly regular once the entry 555 of AAA becomes 444.

Significance

Theorem A.4 turns a local stability property, defined through neighbourhoods and an inverse map, into a finite-dimensional algebraic question about one homogeneous problem on a polyhedral cone. Combined with the Schur-complement criterion of Theorem 3.1, it gives checkable conditions (Corollary 3.2): nonsingularity of a block and positive definiteness, or the P-matrix property, of its Schur complement. Through the KKT reformulation of §4 this is the route by which strong second-order sufficiency and linear independence of binding constraint gradients imply strong regularity in nonlinear programming. The example of p. 53 shows the criterion deciding cases where AAA itself is neither positive definite nor a P-matrix.

The results are classical and proved in the paper; to our knowledge none of them has a machine-checked proof. The formalization adds a coordinate-free statement of the reduced form, which the paper writes only in an adapted basis; a Lean account of exposed faces and tangent cones of polyhedra, with their local conic structure (Propositions A.1–A.2), which the paper lists "without proof" and cites to Rockafellar; and checked versions of the corollary and the example.

Difficulty

The definition of strong regularity is local, while condition (ii) is global on LLL. The obvious argument, "linearise and read off the inverse", does not apply, because ∂ψC\partial\psi_C∂ψC​ is a set-valued map whose graph changes shape from point to point. The step that carries the weight is Proposition A.3: a perturbation of y0y_0y0​ may move the solution off the face FFF, and only polyhedrality, through the finitely many values of ∂ψC\partial\psi_C∂ψC​ on FFF and the local conic structure of A.1–A.2, rules this out uniformly in a neighbourhood. The direction from strong regularity to (ii) needs positive homogeneity of the reduced form to pass from uniqueness near 000 to uniqueness on all of LLL. The direction from (ii) to strong regularity needs the Lipschitz property of a single-valued inverse of a polyhedral multifunction (Robinson 1979, cited as [12, Proposition 2]), which is not elementary.

Formalization scope

  • The space is EuclideanSpace ℝ (Fin n), with inclusions written as memberships: (A.2) is y−(Ax+a)∈∂ψC(x)y-(Ax+a)\in\partial\psi_C(x)y−(Ax+a)∈∂ψC​(x). A matrix acts through Matrix.toEuclideanLin. The normal cone carries the clause x∈Cx\in Cx∈C, so ∂ψC(x)=∅\partial\psi_C(x)=\emptyset∂ψC​(x)=∅ off CCC; without it every inclusion would be satisfiable at points outside CCC and the statements would change meaning.
  • TC(x0)T_C(x_0)TC​(x0​) is the polar of the normal cone, as on p. 58, not the closure of the cone of feasible directions. FFF is the set of maximisers of ⟨−y0,⋅⟩\langle -y_0,\cdot\rangle⟨−y0​,⋅⟩ (the sign matters: the opposite face would make the theorem false). LLL is the direction of the affine span of FFF, and PLP_LPL​ is Mathlib's Submodule.starProjection.
  • The reduced form is stated basis-free on LLL; ∂ψT\partial\psi_T∂ψT​ is the normal cone of TTT in all of Rn\mathbb R^nRn. In Corollary 3.2, B11B_{11}B11​ and B/B11B/B_{11}B/B11​ are expressed through projectors onto MMM and L∩M⊥L\cap M^\perpL∩M⊥. Only the case K=R+sK=\mathbb R^s_+K=R+s​ is stated in a basis, an orthonormal basis of L∩M⊥L\cap M^\perpL∩M⊥ in which KKK is the orthant.
  • "Positive definite" does not require symmetry. "Strongly regular" without a constant is existential in λ\lambdaλ, with λ\lambdaλ real.
  • Corollary 3.2's second sentence refers on the page to "(3.8)", an evident slip for (3.9); it is formalized for (3.9).
  • The standing assumption "C nonempty polyhedral convex" is a hypothesis of every item.
  • A trivializing formalization is ruled out: strong regularity requires existence, uniqueness in VVV and the Lipschitz bound together, and condition (ii) requires existence and uniqueness for every z∈Lz\in Lz∈L.
  • Needed infrastructure: faces and tangent cones of polyhedra and their local structure (Minkowski–Weyl, finitely many faces), orthogonal decompositions, and Lipschitz continuity of single-valued polyhedral inverses. All of this is reusable beyond this mission. Proofs of the propositions, of the correspondence, and of the companions are welcome independently.

Selected references

  • S. M. Robinson, Strongly regular generalized equations, Mathematics of Operations Research 5(1), 43–62, 1980. https://doi.org/10.1287/moor.5.1.43
  • S. M. Robinson, Generalized equations and their solutions, Part I: Basic theory, Mathematical Programming Study 10, 128–141, 1979. https://doi.org/10.1007/BFb0120850
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
  • A. L. Dontchev and R. T. Rockafellar, Implicit Functions and Solution Mappings, 2nd ed., Springer, 2014. https://doi.org/10.1007/978-1-4939-1037-3
  • R. W. Cottle, Manifestations of the Schur complement, Linear Algebra and its Applications 8, 189–211, 1974. https://doi.org/10.1016/0024-3795(74)90066-4
6 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations II: Schur-Complement Criterion — A₁₁ Nonsingular and (A/A₁₁) Positive Definite Make (A + ∂ψ_{ℝʳ×K})⁻¹ Lipschitz on ℝ^{r+s}; for K = ℝˢ₊, P-Matrix IffResearch Paper

Motivation

A constrained system can be written as a generalized equation: a smooth or linear expression must balance the normal cone of a feasible set. This form includes variational inequalities and the first-order conditions of many optimization problems. It is useful to know whether a small change in the right-hand side determines one nearby solution and how far that solution moves. In the linear finite-dimensional case, Robinson's Theorem 3.1 gives matrix conditions that guarantee something stronger: a unique solution for every right-hand side, with one Lipschitz bound valid over the entire space. The theorem also identifies an exact matrix criterion when the feasible set is a product with a nonnegative orthant.

The question is relevant whenever some coordinates of a system are free and others are constrained by inequalities. Eliminating the free coordinates produces a smaller matrix, the Schur complement. The resulting condition can be checked on the reduced block, and in the orthant case it becomes the familiar P-matrix criterion from linear complementarity. Robinson states both claims in a single theorem and relates them to the behavior of a generalized equation rather than to an isolated matrix property Robinson, pp. 51–52.

Setting

Let r,sr,sr,s be positive integers and give Rr+s\mathbb R^{r+s}Rr+s its Euclidean norm. Write w=(w1,w2)w=(w_1,w_2)w=(w1​,w2​), with w1∈Rrw_1\in\mathbb R^rw1​∈Rr and w2∈Rsw_2\in\mathbb R^sw2​∈Rs. Let K⊆RsK\subseteq\mathbb R^sK⊆Rs be nonempty, closed, and convex, and put D=Rr×KD=\mathbb R^r\times KD=Rr×K. For w∈Dw\in Dw∈D, the normal cone is

ND(w)={v∈Rr+s:⟨v,c−w⟩≤0 for every c∈D}.N_D(w)=\{v\in\mathbb R^{r+s}:\langle v,c-w\rangle\leq0\text{ for every }c\in D\}.ND​(w)={v∈Rr+s:⟨v,c−w⟩≤0 for every c∈D}.

For w∉Dw\notin Dw∈/D, ND(w)N_D(w)ND​(w) is empty. Thus the inclusion y∈Aw+ND(w)y\in Aw+N_D(w)y∈Aw+ND​(w) itself enforces feasibility. This is Robinson's indicator-subdifferential convention Robinson, pp. 43 and 51.

Partition the real square matrix AAA into blocks A11A_{11}A11​, A12A_{12}A12​, A21A_{21}A21​, and A22A_{22}A22​, where A11A_{11}A11​ is r×rr\times rr×r. When A11A_{11}A11​ is nonsingular, its Schur complement in AAA is

A/A11=A22−A21A11−1A12.A/A_{11}=A_{22}-A_{21}A_{11}^{-1}A_{12}.A/A11​=A22​−A21​A11−1​A12​.

A real matrix MMM is positive definite in the theorem's sense when v⊤Mv>0v^\top Mv>0v⊤Mv>0 for every nonzero vvv. Symmetry is not assumed. A P-matrix has strictly positive determinants for every nonempty principal submatrix. Write R+s\mathbb R^s_+R+s​ for the vectors with all components nonnegative. These conventions are stated or used in Theorem 3.1 and its proof.

Formalization targets

General closed convex set

For TK(w)=Aw+NRr×K(w)T_K(w)=Aw+N_{\mathbb R^r\times K}(w)TK​(w)=Aw+NRr×K​(w), the first target is the sufficient condition

det⁡A11≠0andv⊤(A/A11)v>0  (v≠0)⟹TK−1:Rr+s→Rr+s is Lipschitz.\det A_{11}\ne0\quad\text{and}\quad v^\top(A/A_{11})v>0\;(v\ne0) \quad\Longrightarrow\quad T_K^{-1}:\mathbb R^{r+s}\to\mathbb R^{r+s}\text{ is Lipschitz}.detA11​=0andv⊤(A/A11​)v>0(v=0)⟹TK−1​:Rr+s→Rr+s is Lipschitz.

Here “is Lipschitz” includes that exactly one inverse value exists at every yyy. The assertion holds for every nonempty closed convex KKK; it is not restricted to polyhedral sets.

Nonnegative orthant

When K=R+sK=\mathbb R^s_+K=R+s​, the second target is an equivalence:

TR+s−1 is everywhere defined, single-valued and Lipschitz⟺det⁡A11≠0 and A/A11 is a P-matrix.T_{\mathbb R^s_+}^{-1}\text{ is everywhere defined, single-valued and Lipschitz} \quad\Longleftrightarrow\quad \det A_{11}\ne0\text{ and }A/A_{11}\text{ is a P-matrix}.TR+s​−1​ is everywhere defined, single-valued and Lipschitz⟺detA11​=0 and A/A11​ is a P-matrix.

The goal theorem is the conjunction of these two statements, matching Theorem 3.1. Its milestones record the paper's local upper Lipschitz assertion for polyhedral multifunctions, the block reduction, the reduced inverse result, the complementarity characterization, and the necessity of nonsingularity.

Significance

The first part gives a global sensitivity guarantee for a generalized equation with an arbitrary nonempty closed convex lower-block constraint. For any two right-hand sides, their unique solutions differ by at most a fixed multiple of the distance between those right-hand sides. The second part tells when this guarantee holds for the orthant model: the P-matrix condition is necessary as well as sufficient. These are the precise conclusions of Robinson's theorem; the mission concerns their machine-checked formalization, not an unresolved mathematical conjecture.

A complete development would provide reusable definitions of the normal-cone generalized equation, an explicitly nonsymmetric notion of positive definiteness, P-matrices, and the global inverse property. It would also formalize the linear complementarity characterization quoted in the paper. The current draft has Lean-checked statements with proof placeholders. No proof of Theorem 3.1 or of its milestones is claimed here.

Difficulty

Nonsingularity of the full matrix AAA alone does not decide whether the constrained inverse exists uniquely: the normal cone can change as w2w_2w2​ reaches different faces of KKK. A pointwise uniqueness argument also does not by itself supply one Lipschitz constant on all of Rr+s\mathbb R^{r+s}Rr+s. For the orthant case, checking only the full determinant or leading principal minors would miss the criterion Robinson invokes; every nonempty principal minor matters. The difficulty is to connect a global statement about all right-hand sides with the reduced matrix condition while preserving the normal cone's behavior at boundary points Robinson, pp. 51–52.

Formalization scope

Lean represents Rr+s\mathbb R^{r+s}Rr+s as a Euclidean space indexed by the disjoint union of Fin(r)\mathrm{Fin}(r)Fin(r) and Fin(s)\mathrm{Fin}(s)Fin(s). This gives the paper's Euclidean norm rather than the sup norm of a product type. The normal cone is empty off its set, and the inverse property explicitly requires existence for every right-hand side, uniqueness, and one global real Lipschitz bound. The Schur complement appears only with a nonsingular A11A_{11}A11​ in the substantive claims; matrix inversion on a singular input would otherwise be totalized by Lean. Positive definiteness does not add a symmetry hypothesis. The goal retains r,s>0r,s>0r,s>0 as printed; the paper's later remark about zero-dimensional blocks is outside this theorem.

The polyhedral milestones use finite intersections of closed half-spaces. The reduced-operator milestone uses a nonempty closed convex KKK, matching the theorem's setting. The LCP milestone allows any finite dimension; at dimension zero, both its universal uniqueness statement and its empty-minor P-matrix condition hold. A weaker encoding in which the inverse is merely single-valued where it happens to exist would erase the global conclusion and is excluded here.

Solvers can contribute the block-normal-cone equivalence, the global inverse statement for the reduced operator, the polyhedral Lipschitz result, the P-matrix characterization, and the final theorem. The normal-cone and matrix definitions can also serve later generalized-equation missions that use the same conventions.

Selected references

  • S. M. Robinson, Strongly Regular Generalized Equations, Mathematics of Operations Research 5(1), 43–62, 1980. DOI 10.1287/moor.5.1.43.
8 thms2 active usersReviewed
🏆Completed
Convex OptimizationStatistics·Captain: mikedeng1

Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers IV: The Covariance-Selection X-Update Is Q·diag((λᵢ + √(λᵢ² + 4ρ))/(2ρ))·QᵀTextbook

Why closed-form ADMM updates for ℓ1 problems

Many estimation problems in statistics, machine learning and signal processing minimize a smooth loss plus a nonsmooth ℓ1-type regularizer: the lasso, basis pursuit, least absolute deviations, Huber fitting, the group lasso, and ℓ1-penalized maximum likelihood for Gaussian graphical models. Chapter 6 of Boyd, Parikh, Chu, Peleato and Eckstein, Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers (Found. Trends Mach. Learn. 3(1), 2011), shows that the alternating direction method of multipliers (ADMM) splits each of these problems into a step that touches only the loss and a step that touches only the regularizer, and that each step has a closed form. The practical value of ADMM on these problems rests entirely on those closed forms: an iteration is one cached linear solve, one projection, or one thresholding.

The capstone is sparse inverse covariance selection (§6.5), the ℓ1-penalized Gaussian maximum-likelihood problem of Banerjee, El Ghaoui and d'Aspremont (2008), also solved by the graphical lasso of Friedman, Hastie and Tibshirani (2008). Its ADMM X-update minimizes a log-determinant objective over positive definite matrices, and the book shows that it is solved exactly by one symmetric eigenvalue decomposition.

Setting

All vectors are real and ∥⋅∥2\|\cdot\|_2∥⋅∥2​ is the Euclidean norm. For κ∈R\kappa\in\mathbb Rκ∈R the soft thresholding operator is Sκ(a)=a−κS_\kappa(a)=a-\kappaSκ​(a)=a−κ if a>κa>\kappaa>κ, 000 if ∣a∣≤κ|a|\le\kappa∣a∣≤κ, and a+κa+\kappaa+κ if a<−κa<-\kappaa<−κ, applied componentwise to vectors and entrywise to matrices. The vector soft thresholding operator on Rm\mathbb R^mRm is Sκ(a)=(1−κ/∥a∥2)+a\mathcal S_\kappa(a)=(1-\kappa/\|a\|_2)_+aSκ​(a)=(1−κ/∥a∥2​)+​a, with Sκ(0)=0\mathcal S_\kappa(0)=0Sκ​(0)=0. The Huber penalty is ghub(a)=a2/2g^{\mathrm{hub}}(a)=a^2/2ghub(a)=a2/2 for ∣a∣≤1|a|\le1∣a∣≤1 and ∣a∣−1/2|a|-1/2∣a∣−1/2 for ∣a∣>1|a|>1∣a∣>1, summed over components for vectors.

In scaled-form ADMM for minimizing f(x)+g(z)f(x)+g(z)f(x)+g(z) subject to Ax+Bz=cAx+Bz=cAx+Bz=c, with penalty ρ>0\rho>0ρ>0 and scaled dual variable uuu, the updates are

xk+1=argmin⁡x(f(x)+ρ2∥Ax+Bzk−c+uk∥22),zk+1=argmin⁡z(g(z)+ρ2∥Axk+1+Bz−c+uk∥22),x^{k+1}=\operatorname*{argmin}_x\bigl(f(x)+\tfrac\rho2\|Ax+Bz^k-c+u^k\|_2^2\bigr),\quad z^{k+1}=\operatorname*{argmin}_z\bigl(g(z)+\tfrac\rho2\|Ax^{k+1}+Bz-c+u^k\|_2^2\bigr),xk+1=xargmin​(f(x)+2ρ​∥Ax+Bzk−c+uk∥22​),zk+1=zargmin​(g(z)+2ρ​∥Axk+1+Bz−c+uk∥22​),

followed by uk+1=uk+Axk+1+Bzk+1−cu^{k+1}=u^k+Ax^{k+1}+Bz^{k+1}-cuk+1=uk+Axk+1+Bzk+1−c. "The update is given by formula FFF" means FFF is the unique minimizer of the corresponding subproblem.

For sparse inverse covariance selection, S∈Rn×nS\in\mathbb R^{n\times n}S∈Rn×n is symmetric (the empirical covariance), λ>0\lambda>0λ>0 is the regularization weight, ∥M∥F2=∑ijMij2\|M\|_F^2=\sum_{ij}M_{ij}^2∥M∥F2​=∑ij​Mij2​, ∥M∥1=∑ij∣Mij∣\|M\|_1=\sum_{ij}|M_{ij}|∥M∥1​=∑ij​∣Mij​∣, and S++n\mathbb S^n_{++}S++n​ is the set of symmetric positive definite matrices, the domain of log⁡det⁡\log\detlogdet. ADMM alternates

Xk+1=argmin⁡X∈S++n(Tr⁡(SX)−log⁡det⁡X+ρ2∥X−Zk+Uk∥F2),Zk+1=argmin⁡Z(λ∥Z∥1+ρ2∥Xk+1−Z+Uk∥F2),X^{k+1}=\operatorname*{argmin}_{X\in\mathbb S^n_{++}}\Bigl(\operatorname{Tr}(SX)-\log\det X+\tfrac\rho2\|X-Z^k+U^k\|_F^2\Bigr),\qquad Z^{k+1}=\operatorname*{argmin}_Z\Bigl(\lambda\|Z\|_1+\tfrac\rho2\|X^{k+1}-Z+U^k\|_F^2\Bigr),Xk+1=X∈S++n​argmin​(Tr(SX)−logdetX+2ρ​∥X−Zk+Uk∥F2​),Zk+1=Zargmin​(λ∥Z∥1​+2ρ​∥Xk+1−Z+Uk∥F2​),

and Uk+1=Uk+Xk+1−Zk+1U^{k+1}=U^k+X^{k+1}-Z^{k+1}Uk+1=Uk+Xk+1−Zk+1.

Formalization targets

Goal: the X-update in closed form (§6.5, p. 47)

Let SSS and Z−UZ-UZ−U be symmetric, ρ>0\rho>0ρ>0, and ρ(Z−U)−S=Q diag(μ1,…,μn) QT\rho(Z-U)-S=Q\,\mathrm{diag}(\mu_1,\dots,\mu_n)\,Q^Tρ(Z−U)−S=Qdiag(μ1​,…,μn​)QT with QTQ=QQT=IQ^TQ=QQ^T=IQTQ=QQT=I. Then

X=Q diag(μi+μi2+4ρ2ρ)QTX=Q\,\mathrm{diag}\Bigl(\frac{\mu_i+\sqrt{\mu_i^2+4\rho}}{2\rho}\Bigr)Q^TX=Qdiag(2ρμi​+μi2​+4ρ​​)QT

is positive definite and is the unique minimizer of Tr⁡(SX′)−log⁡det⁡X′+ρ2∥X′−Z+U∥F2\operatorname{Tr}(SX')-\log\det X'+\frac\rho2\|X'-Z+U\|_F^2Tr(SX′)−logdetX′+2ρ​∥X′−Z+U∥F2​ over X′∈S++nX'\in\mathbb S^n_{++}X′∈S++n​.

Milestones

  1. Scalar root (p. 47): for ρ>0\rho>0ρ>0, t=(μ+μ2+4ρ)/(2ρ)t=(\mu+\sqrt{\mu^2+4\rho})/(2\rho)t=(μ+μ2+4ρ​)/(2ρ) is positive and ρt−1/t=μ\rho t-1/t=\muρt−1/t=μ.
  2. Equation (6.5) (p. 47): the matrix XXX above is positive definite and ρX−X−1=ρ(Z−U)−S\rho X-X^{-1}=\rho(Z-U)-SρX−X−1=ρ(Z−U)−S.
  3. First-order condition (p. 47): a positive definite XXX minimizes the X-objective over S++n\mathbb S^n_{++}S++n​ if and only if S−X−1+ρ(X−Z+U)=0S-X^{-1}+\rho(X-Z+U)=0S−X−1+ρ(X−Z+U)=0.
  4. Z-update (p. 47): Zij=Sλ/ρ(Xij+Uij)Z_{ij}=S_{\lambda/\rho}(X_{ij}+U_{ij})Zij​=Sλ/ρ​(Xij​+Uij​) is the unique minimizer of λ∥Z∥1+ρ2∥X−Z+U∥F2\lambda\|Z\|_1+\frac\rho2\|X-Z+U\|_F^2λ∥Z∥1​+2ρ​∥X−Z+U∥F2​.
  5. Huber z-update (§6.1.1, p. 40): with v=Ax−b+uv=Ax-b+uv=Ax−b+u, z=ρ1+ρv+11+ρS1+1/ρ(v)z=\frac{\rho}{1+\rho}v+\frac1{1+\rho}S_{1+1/\rho}(v)z=1+ρρ​v+1+ρ1​S1+1/ρ​(v) minimizes ghub(z)+ρ2∥Ax−z−b+u∥22g^{\mathrm{hub}}(z)+\frac\rho2\|Ax-z-b+u\|_2^2ghub(z)+2ρ​∥Ax−z−b+u∥22​.
  6. Basis pursuit (§6.2, p. 41): if AATAA^TAAT is invertible, (I−AT(AAT)−1A)(z−u)+AT(AAT)−1b(I-A^T(AA^T)^{-1}A)(z-u)+A^T(AA^T)^{-1}b(I−AT(AAT)−1A)(z−u)+AT(AAT)−1b is the projection of z−uz-uz−u onto {x∣Ax=b}\{x\mid Ax=b\}{x∣Ax=b}.
  7. Lasso (§6.4, p. 43): (ATA+ρI)−1(ATb+ρ(z−u))(A^TA+\rho I)^{-1}(A^Tb+\rho(z-u))(ATA+ρI)−1(ATb+ρ(z−u)) minimizes 12∥Ax−b∥22+ρ2∥x−z+u∥22\frac12\|Ax-b\|_2^2+\frac\rho2\|x-z+u\|_2^221​∥Ax−b∥22​+2ρ​∥x−z+u∥22​, and Sλ/ρ(x+u)S_{\lambda/\rho}(x+u)Sλ/ρ​(x+u) minimizes λ∥z∥1+ρ2∥x−z+u∥22\lambda\|z\|_1+\frac\rho2\|x-z+u\|_2^2λ∥z∥1​+2ρ​∥x−z+u∥22​.
  8. Group lasso (§6.4.2, p. 45): blockwise Sλ/ρ(xi+ui)\mathcal S_{\lambda/\rho}(x_i+u_i)Sλ/ρ​(xi​+ui​) minimizes λ∑i∥zi∥2+ρ2∑i∥xi−zi+ui∥22\lambda\sum_i\|z_i\|_2+\frac\rho2\sum_i\|x_i-z_i+u_i\|_2^2λ∑i​∥zi​∥2​+2ρ​∑i​∥xi​−zi​+ui​∥22​.

Significance

The closed forms are what make ADMM competitive on these problems. For the lasso the x-update is a ridge regression whose factorization is computed once; for basis pursuit it is a cached projection; the ℓ1 step is a componentwise threshold. For covariance selection the X-update costs one eigenvalue decomposition, and the book (p. 46) cites Scheinberg, Ma and Goldfarb (2010) as showing that ADMM outperforms state-of-the-art methods on this problem. The goal also yields that Xk+1X^{k+1}Xk+1 is always positive definite, so the iterates remain in the domain of log⁡det⁡\log\detlogdet without a line search.

All statements here are classical and their proofs are elementary convex analysis and linear algebra. A search of the platform found no machine-checked version of any of them. Formalizing them produces verified proximity operators (soft thresholding, vector soft thresholding, Huber, projection onto an affine set) and a verified matrix-function argument for log⁡det⁡\log\detlogdet that later missions on ADMM, proximal methods and Gaussian graphical models can import.

Difficulty

The vector updates reduce to separable one-dimensional problems or to a normal equation, and the difficulty there is bookkeeping: uniqueness, the case a=0a=0a=0 of vector soft thresholding, and the three regimes of the Huber prox.

The goal is harder. The book's argument says that XXX satisfies the gradient equation "and thus minimizes the X-minimization objective". Checking the equation is algebra; the claim to be proved is minimality over the open cone S++n\mathbb S^n_{++}S++n​, which needs the convexity (indeed strict convexity, for uniqueness) of −log⁡det⁡-\log\det−logdet on positive definite matrices and the identification of its gradient with −X−1-X^{-1}−X−1 along symmetric directions. Mathlib has determinants and positive definiteness; a usable convexity statement for log⁡det⁡\log\detlogdet on S++n\mathbb S^n_{++}S++n​ is not among the platform's published results. Showing that XXX satisfies (6.5) alone does not establish the goal.

Formalization scope

  • Carriers. Vectors are EuclideanSpace ℝ (Fin n), matrices Matrix (Fin m) (Fin n) ℝ acting by Matrix.toEuclideanLin. The Frobenius norm and the entrywise ℓ1 norm are written as explicit sums, not through Mathlib's matrix norm instances. The vector ℓ1 norm is the platform definition HighDimStat.SparseLinear.l1Norm.
  • Updates as unique minimizers. Each update is stated as: the book's formula is the unique minimizer of the subproblem (IsUniqueMinimizerOn). Iterates are not defined; the subproblem's data (zkz^kzk, uku^kuk, xk+1x^{k+1}xk+1) are arbitrary.
  • Domain of log det. The X-objective is minimized over Matrix.PosDef only. Singular or indefinite matrices are never competitors, so Real.log of a nonpositive determinant plays no role.
  • Explicit hypotheses. SSS and Z−UZ-UZ−U are assumed symmetric in the goal and the first-order condition; SSS need not be positive semidefinite. ρ>0\rho>0ρ>0 everywhere. Basis pursuit assumes det⁡(AAT)≠0\det(AA^T)\ne0det(AAT)=0, which the book uses without stating. The book's λ>0\lambda>0λ>0 is relaxed to λ≥0\lambda\ge0λ≥0 in the thresholding statements, which contain the book's case.
  • Eigendecomposition. The goal holds for every orthogonal QQQ and real μ\muμ with ρ(Z−U)−S=Q diag(μ)QT\rho(Z-U)-S=Q\,\mathrm{diag}(\mu)Q^Tρ(Z−U)−S=Qdiag(μ)QT, not for one decomposition chosen by Mathlib.
  • Names. The book uses λ\lambdaλ for both the regularization weight and the eigenvalues; Lean calls them lam and μ.
  • Typo. The book prints uku^kuk in the group-lasso block update; the block uiku_i^kuik​ is stated.
  • Ruled out. A goal that only asserts that XXX satisfies (6.5), or that minimizes over a set extended by Real.log of nonpositive determinants, is not the book's claim; the goal states unique minimality over S++n\mathbb S^n_{++}S++n​.
  • Not stated. Least absolute deviations and the generalized lasso updates (same pattern as milestones 5 and 7), the overlapping group lasso, and the two-step termination claim for Huber fitting on p. 40 (whose formula xls=(ATA)−1bx^{\mathrm{ls}}=(A^TA)^{-1}bxls=(ATA)−1b is misprinted).

Contributions welcome: convexity and strict convexity of −log⁡det⁡-\log\det−logdet on S++n\mathbb S^n_{++}S++n​ and its derivative; a general "prox of a separable function is componentwise" lemma; and the projection onto an affine set.

Selected references

  • S. Boyd, N. Parikh, E. Chu, B. Peleato, J. Eckstein, Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers, Foundations and Trends in Machine Learning 3(1), 2011, pp. 1–122. https://doi.org/10.1561/2200000016
  • O. Banerjee, L. El Ghaoui, A. d'Aspremont, Model Selection Through Sparse Maximum Likelihood Estimation for Multivariate Gaussian or Binary Data, Journal of Machine Learning Research 9, 2008, pp. 485–516. https://jmlr.org/papers/v9/banerjee08a.html
  • J. Friedman, T. Hastie, R. Tibshirani, Sparse Inverse Covariance Estimation with the Graphical Lasso, Biostatistics 9(3), 2008, pp. 432–441. https://doi.org/10.1093/biostatistics/kxm045
  • K. Scheinberg, S. Ma, D. Goldfarb, Sparse Inverse Covariance Selection via Alternating Linearization Methods, Advances in Neural Information Processing Systems 23, 2010 (reference [148] of the book).
  • R. Tibshirani, Regression Shrinkage and Selection via the Lasso, Journal of the Royal Statistical Society B 58(1), 1996, pp. 267–288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
  • M. Yuan, Y. Lin, Model Selection and Estimation in Regression with Grouped Variables, Journal of the Royal Statistical Society B 68(1), 2006, pp. 49–67. https://doi.org/10.1111/j.1467-9868.2005.00532.x
13 thms2 active usersReviewed
PreviousPage 4 of 6Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me