Theorem 2, pp. 16–17, (15), no outliers — spectral rounding with (1+ε)-approximate k-means: Σ_k |S_k|/n_k ≤ 64(2+ε)‖X⁰ − X̂‖₁/n²_min
ProvedRobustSpecClust.Round.theorem_2This is the deterministic core of Theorem 2 (clustering error of the rounded solution) in the setting without outliers.
Let be the true labelling, with clusters of sizes , , true clustering matrix and . Let be any symmetric matrix with entries in (for instance the Robust-LP estimate). Spectral clustering on proceeds as follows:
- is any matrix of orthonormal top- eigenvectors of ;
- , with the membership matrix of an assignment and , is a -approximate solution () of k-means on the rows of ; the estimated membership matrix is .
Let be the optimal rotation, an orthogonal matrix minimising , and let , where and are the rows of and : the points of whose estimated centre is far from their true centre. Then
Combined with a bound on (Theorem 1 of the paper), this gives the misclassification rate of the full algorithm.
Formalization Note The printed Theorem 2 allows outliers and is stated with probability under a condition on and . As printed it is false for : the outlier rows of are zero, so is not k-means feasible and Lemma 5 does not apply; an explicit counterexample (two clusters of size , one isolated outlier, , , ) violates (15). This item is the case , which the proof in Appendix G establishes. Inequality (15) is deterministic in : the probability, the separation condition and the condition on only serve to feed Theorem 1 into the permutation claim (item theorem_2_permutation), so they are omitted. The printed is replaced by the weaker for all , which is all the statement needs. as on p. 47. The statement holds for every minimiser , not just for some orthogonal matrix.
import Mathlib import Definitions.Def_RobustSpecClust_Round_Setting
namespace RobustSpecClust.Round
open Matrix
theorem theorem_2 {n r : ℕ} [NeZero r] (φ : Fin n → Fin r) (hφ : ∀ k, 0 < clusterSize φ k)
(Xh : Matrix (Fin n) (Fin n) ℝ) (hsym : Xhᵀ = Xh) (hbox : ∀ i j, 0 ≤ Xh i j ∧ Xh i j ≤ 1)
(Uh : Matrix (Fin n) (Fin r) ℝ) (hU : IsTopEigvecs Xh Uh)
(ε : ℝ) (hε : 0 < ε) (a : Fin n → Fin r) (B : Matrix (Fin r) (Fin r) ℝ)
(hkm : IsApproxKMeans ε Uh a B)
(O : Matrix (Fin r) (Fin r) ℝ) (hO : O ∈ Matrix.orthogonalGroup (Fin r) ℝ)
(hOopt : ∀ O' ∈ Matrix.orthogonalGroup (Fin r) ℝ,
frobSq (Uh - U0 φ * O) ≤ frobSq (Uh - U0 φ * O')) :
∑ k, ((misSet (U0 φ * O) (memb a * B) φ (fun k => 1 / Real.sqrt (clusterSize φ k)) k).card
: ℝ) / clusterSize φ k
≤ 64 * (2 + ε) * l1 (trueClust φ - Xh) / nmin φ ^ 2 := by sorry
end RobustSpecClust.Round
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.