A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization 1: Deterministic Double Greedy Achieves 1/3 of the OptimumResearch Paper
Motivation
A set function on a finite ground set is submodular if it has diminishing returns, equivalently if for all . Cut functions of graphs and hypergraphs, coverage functions, entropy, and many facility-location and welfare objectives are submodular. Unconstrained Submodular Maximization (USM) asks, given a nonnegative submodular through a value oracle, for a set of maximum value. It contains Max-Cut, Max-DiCut and Max Facility Location as special cases, and it is a subroutine in algorithms for constrained submodular maximization.
Timeline:
- Feige, Mirrokni and Vondrák (FOCS 2007; SIAM J. Comput. 2011) gave a uniformly random set achieving of the optimum, a deterministic local search achieving , a randomized local search achieving , and proved that no algorithm making polynomially many value queries achieves .
- Oveis Gharan and Vondrák (SODA 2011) improved the ratio to about by simulated annealing; Feldman, Naor and Schwartz (ICALP 2011) to about .
- Buchbinder, Feldman, Naor and Schwartz (FOCS 2012; SIAM J. Comput. 2015) gave the double greedy algorithms: a deterministic linear-time -approximation (this mission) and a randomized linear-time -approximation, matching the query lower bound.
Setting
Let be a finite ground set and a nonnegative submodular function. Write , and let denote a set attaining it.
Algorithm 1 (DeterministicUSM) fixes an arbitrary order of and maintains two solutions, starting from and . In iteration it computes
If it sets , ; otherwise , . A tie adds . After iterations , which is the output.
The analysis uses the hybrid sets , which agree with and on and with on . In Lean, the run is state f l i, the state after the first entries of the order l, and is optI O (state f l i).
Formalization targets
Goal: Theorem I.1
For every nonnegative submodular and every order of ,
Milestones
- Lemma II.1. For every , .
- The hybrid sequence. agrees with on and with on the rest; and .
- Lemma II.2. For every ,
- The telescoped display. .
- Theorem II.3 (tightness). For every there is a nonnegative submodular with and an order on which .
Significance
The result. Algorithm 1 is the deterministic member of the double greedy family. It makes one pass over the ground set with four value queries per element, and it guarantees of the optimum for every order, without the polynomial-but-large running time and the loss of local search. Its analysis, which charges the decrease of to the increases of and , is the template the paper then refines into the randomized -approximation (Theorem I.2) and its continuous counterpart on the multilinear extension. Theorem II.3 shows that is the exact ratio of this algorithm, so the improvement to requires randomization (or a different deterministic rule) rather than a sharper analysis.
Formalizing it. The theorem is proved in the paper; to our knowledge it has no machine-checked proof. The mission produces a formal statement of the algorithm as printed, a checked proof of its guarantee for every order, and a checked tight instance. The definitions of the run and of are the same objects the randomized and fractional analyses reason about, so a complete development here is the first step toward the paper's main theorem.
Difficulty
The individual inequalities are short; the difficulty lies in the bookkeeping. Each step needs the invariants and , which follow from the order being an enumeration (no repetitions, every element present), and the identification of from in each branch of the algorithm. Summing Lemma II.2 needs a telescoping over the run defined as a fold. The naive idea of comparing with directly, without the hybrid sets, gives no bound: the greedy choices are made against and , not against . For Theorem II.3 the difficulty is producing an explicit instance, checking that it is submodular and nonnegative, and tracing the run, including the ties, which the algorithm resolves by adding.
Formalization scope
- The ground set is a finite type
Xwith decidable equality; subsets areFinset X; is real valued,Finset X → ℝ, and nonnegativity is the hypothesis∀ S, 0 ≤ f Swhere the page uses it (the goal, the telescoped display and the tight example). Lemma II.1, Lemma II.2 and the hybrid-sequence milestone do not assume it. - Submodularity is the lattice form of the paper's footnote 1, through the published definition
NonmonotoneSubmod.Shared.Submodular. The paper's main-text sentence ("for every and ") would force monotonicity when and is read as the footnote. is the publishedNonmonotoneSubmod.Shared.OPT f, the maximum of over all subsets. - The order is a list
lwithl.Nodupand∀ x, x ∈ l; isl[i - 1]. Every statement quantifies over all such lists. No nonemptiness of is assumed: for an empty ground set the goal reads . - The tie rule is line 5's : ties add .
- Where a milestone mentions an optimal solution, it takes a set
Owith∀ S, f S ≤ f O. - The goal is stated multiplied out, , because may be .
- Trivializing formalizations ruled out. The paper's Theorem I.1 reads "there exists a deterministic linear time -approximation algorithm"; without the running time that existential is satisfied by exhaustive search, so the goal is the guarantee of the printed Algorithm 1 for every order. Running time is not formalized: the algorithm evaluates on four sets per element, elements in all. Theorem II.3 requires , without which would satisfy it.
- Needed infrastructure: elementary lemmas on
List.foldloverList.take, on membership in the states of the run, and on telescoping sums over . A reusable lemma "the run keeps and decides exactly " would serve all three missions of this paper. Contributions of proofs of any milestone, of the goal from the milestones, and of the tight instance (e.g. the paper's five-vertex directed cut function) are welcome.
Selected references
- N. Buchbinder, M. Feldman, J. Naor, R. Schwartz, A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization, FOCS 2012. https://doi.org/10.1109/FOCS.2012.73 (journal version: SIAM J. Comput. 44(5), 2015, https://doi.org/10.1137/130929205)
- U. Feige, V. S. Mirrokni, J. Vondrák, Maximizing Non-monotone Submodular Functions, SIAM J. Comput. 40(4), 2011. https://doi.org/10.1137/090779346
- S. Oveis Gharan, J. Vondrák, Submodular Maximization by Simulated Annealing, SODA 2011. https://doi.org/10.1137/1.9781611973082.83
- M. Feldman, J. Naor, R. Schwartz, Nonmonotone Submodular Maximization via a Structural Continuous Greedy Algorithm, ICALP 2011. https://doi.org/10.1007/978-3-642-22006-7_29