Motivation
A monotone disjunction over d Boolean variables is a rule of the form x[i1]∨⋯∨x[ik]. Learning such a rule online — predicting the label of each example before it is revealed and paying one unit per wrong prediction — is the basic test case for learning when only a few of many features matter. Littlestone's Winnow algorithm (Littlestone 1988) learns a k-literal disjunction with O(klogd) mistakes, while additive algorithms such as the Perceptron need a number of mistakes that grows linearly in d on the same problem. Kivinen and Warmuth (1997) placed this gap inside a general theory of multiplicative versus additive updates. Shalev-Shwartz's survey (2011) derives Winnow as a special case of Online Mirror Descent with an unnormalized entropy regularizer, and obtains its mistake bound from a general local-norm regret bound. This mission formalizes that derivation.
Setting
Throughout, labels are yt∈{−1,1} and instances are xt∈{0,1}d. For u∈{0,1}d with ∥u∥1=k, the hypothesis x↦sign(⟨u,x⟩−1/2) is the disjunction of the k variables with u[i]=1. A weight vector w errs on (x,y) when y(2⟨w,x⟩−1)≤0.
Winnow with parameter η>0 starts from w1=(1/d,…,1/d). On round t it receives xt, predicts sign(2⟨wt,xt⟩−1), and receives yt. If yt(2⟨wt,xt⟩−1)≤0 it sets wt+1[i]=wt[i]e2ηytxt[i] for every i; otherwise wt+1=wt. The set M collects the rounds on which it errs. On those rounds the surrogate loss is the hinge loss ft(w)=[1−yt(2⟨w,xt⟩−1)]+, and ft=0 on all other rounds.
Unnormalized Exponentiated Gradient with parameters η,λ>0, run on linear losses zt∈Rd, keeps wt[i]=λe−ηz1:t−1[i], where z1:t−1=∑s<tzs. Winnow is this algorithm with λ=1/d and zt=−2ytxt on t∈M, zt=0 otherwise.
Online Mirror Descent (OMD) with link function g predicts wt=g(−z1:t−1). Its analysis uses the Fenchel conjugate R⋆(θ)=supw∈S(⟨w,θ⟩−R(w)) of a regularizer R on a set S, and the Bregman divergence DF(a∥b)=F(a)−F(b)−⟨∇F(b),a−b⟩.
Formalization targets
Goal: Theorem 3.10
For 0<η<1/2, k≥1 and every u∈{0,1}d with ∥u∥1=k,
∣M∣≤t=1∑Tft(wt)≤1−2η1(t=1∑Tft(u)+ηklogd),
and if yt(2⟨u,xt⟩−1)≥1 for all t, the run with η=1/4 satisfies
∣M∣≤8klogd.
Milestones
- Lemma 2.20: for OMD with link g=∇R⋆ and every u∈S,
t=1∑T⟨wt−u,zt⟩≤R(u)−R(w1)+t=1∑TDR⋆(−z1:t∥−z1:t−1),
with equality at a minimizer of R(u)+∑t⟨u,zt⟩.
2. Theorem 2.23: if ηzt[i]≥−1 for all t,i, then for all u≥0
t=1∑T⟨wt−u,zt⟩≤ηdλ+∑iu[i]log(u[i]/(eλ))+ηt=1∑Ti∑wt[i]zt[i]2,
together with its specialization to λ=1/d.
3. (3.3): ∑t(ft(wt)−ft(u))≤∑t⟨wt−u,zt⟩≤klog(d)/η+η∑t∑iwt[i]zt[i]2 for Winnow.
4. (3.4): ∑iwt[i]zt[i]2≤2ft(wt) for every round.
Significance
The theorem gives a mistake bound for learning sparse disjunctions that is logarithmic in the number of irrelevant features, against the 4(d+1)k of the Perceptron run on the same surrogate (p. 173). The first inequality also covers non-separable data: the bound degrades by ∑tft(u), the total hinge violation of the best disjunction. The milestones are general and carry weight beyond Winnow. Lemma 2.20 is the standard duality form of the OMD regret bound. Theorem 2.23 is a local-norm bound that also allows negative losses down to −1/η.
All four results are proved on paper. To our knowledge none has a machine-checked proof, in Lean or elsewhere. This mission produces such proofs for the survey's own route: OMD duality, then unnormalized EG, then Winnow.
Difficulty
The obvious route bounds Winnow directly with a potential function, but the survey's statement sits at the end of a chain. The chain needs Fenchel–Young with an attained supremum, a telescoping identity for the conjugate, and the inequality e−a≤1−a+a2 for a≥−1. It also needs a reduction in which the surrogate losses ft depend on the algorithm's own error set M. Since ft is defined after the run, the subgradient inequality must be argued for exactly these losses. The bound 1+∑iu[i]log(du[i]/e)≤klogd uses that u is Boolean and that k≥1; for fractional u∈[0,1]d or for k=0 it fails. Solving (3.3) and (3.4) for ∑tft(wt) needs 1−2η>0.
Formalization scope
Vectors are Fin d → ℝ with explicit sums ∑i; Lemma 2.20 is stated in an arbitrary real Hilbert space. Rounds are numbered 0,…,T−1 in place of 1,…,T. Instances, labels and comparators carry the hypotheses xt[i]∈{0,1}, yt∈{−1,1}, u[i]∈{0,1}, ∑iu[i]=k. log is the natural logarithm, and 0log0=0 through Real.log 0 = 0.
Erratum corrected. The Winnow box on p. 173 prints the update wt+1[i]=wt[i]e−η2ytxt[i], and the proof on p. 174 uses zt=2ytxt. With that sign the algorithm demotes on a false negative, and Theorem 3.10 is false. Take d=2, k=1, u=(1,0), η=1/4, and xt=(1,0), yt=1 on every round. The margin condition holds, and w1=(1/2,1/2) errs on round 1. The printed update only shrinks w[1], so every round is an error, and T=6 exceeds 8log2≈5.55. On an error round the hinge surrogate has gradient −2ytxt at wt. The mission therefore formalizes the update wt+1[i]=wt[i]e2ηytxt[i] (Littlestone's Winnow) and zt=−2ytxt on M. With this update the run above errs once. The milestone texts are quoted verbatim, with the printed sign.
Implicit hypotheses made explicit.
- η>0 is Winnow's parameter.
- The goal requires η<1/2: at η=1/2 the factor 1/(1−2η) is undefined.
- k≥1 is required: the theorem fails for k=0 (take u=0, d=2, xt=(1,1), yt=−1).
- The particular case is a statement about the separate run with η=1/4, and its margin condition is required on the T rounds considered.
- The milestone (3.3) keeps the page's η≤1/2.
Conventions.
- M contains ties (yt(2⟨wt,xt⟩−1)=0), as in the proof on p. 174.
- In Lemma 2.20, "g=∇R⋆" is three hypotheses: g(θ)∈S, g(θ) attains the conjugate's supremum, and R⋆ has gradient g(θ) at θ. The comparator ranges over S.
- Theorem 2.23's ∥u∥1 is ∑iu[i], which equals it because u≥0.
The bounds carry no O(⋅) and no constant is instantiated. A trivializing formalization is ruled out: ft is the run's own surrogate, not a free function, and the η=1/4 conjunct quantifies over the η=1/4 weights.
Infrastructure needed: conjugates and the Fenchel–Young inequality on a subtype, telescoping sums, elementary exponential inequalities, and the case analysis on {0,1}-valued data. Lemma 2.20 and Theorem 2.23 are reusable for other OMD and EG analyses. Lemma 2.20 is also stated in the companion mission on normalized EG. Proofs of any milestone, and alternative routes to the goal, are welcome. Excluded: the Perceptron comparison 4(d+1)k (p. 173), and Theorem 3.9 (Perceptron), which is already proved on the platform.
Selected references