Sample-Driven Optimal Stopping: From the Secretary Problem to the i.i.d. Prophet Inequality II: The Optimal Competitive Ratio Tends to the i.i.d. Prophet Constant as p Tends to 1Research Paper
Motivation
Optimal stopping with samples sits between two classical problems. In the secretary problem a decision maker sees items in random order, knows nothing about their values, and must stop on one; the best guarantee is . In the i.i.d. prophet inequality the values are independent draws from a known distribution, and the best guarantee against the expected maximum is the constant : Hill and Kertz (1982) and Kertz (1986) showed that no stopping rule does better, and Correa, Foncea, Hoeksma, Oosterwijk and Vredeveld (2017) showed that it is achieved. Real decision makers usually have neither nothing nor everything: they have a history of past observations.
Correa, Cristi, Epstein and Soto (arXiv:2011.06516v2) model this as -DOS (sample-driven optimal stopping): each of items is independently placed in a history set with probability , the decision maker sees the history first and then the remaining items online, and must stop on one online item. At this is the secretary problem; as the history reveals the distribution and the problem approaches the i.i.d. prophet setting. This mission formalizes the paper's Theorem 8, which makes the second statement precise: the optimal guarantee tends to .
Timeline. Hill and Kertz (1982) compared stop-rule and supremum expectations for i.i.d. variables; Kertz (1986) completed the comparison, giving the worst-case constant through the integral equation used below; Correa et al. (2017) gave a matching algorithm. Kaplan, Naori and Raz (2020) studied the sample-driven model with a weaker bound for small ; Correa, Dütting, Fischer and Schewior (2019) and Rubinstein, Wang and Weinberg (2020) studied i.i.d. values with samples from an unknown distribution. The present paper (2020–2021) gives the exact limit program and Theorem 8.
Setting
Fix . A stopping rule is a nonnegative function of a time and a rank . For let
The limit program SDCLP maximizes over pairs with
Its optimal value is . The paper obtains SDCLP as the limit of the linear programs that describe the best algorithm for -DOS with adversarial values (§4.1–4.2); Theorem 8 is a statement about the program's value.
Two constants are defined by equations. is the unique root in of
and is the solution of . A threshold rule (12) is given by times with : on it equals for ranks and for larger ranks.
Formalization targets
Goal: Theorem 8
Milestones, in the order the proof uses them
- B.4: .
- Lemma 4: a maximal satisfies when is non-increasing in .
- Lemma 5: for a threshold rule, the system "every term of that infimum equals " is equivalent to explicit equations (15)–(16).
- Lemma 6 (i), (ii): the times , , increase, and their limit is at most exactly under condition (18).
- B.6: and .
- Lemma 6 (iii): under (18) the threshold rule is feasible with value .
- Lemma 7: (19) has a unique root, continuous in .
- B.8: the ratio of the two sides of (19) tends to as .
Significance
The result. Theorem 8 shows that sample access interpolates continuously between the secretary and prophet worlds and that, with almost full information, no more than the known-distribution guarantee is lost or gained. The explicit rule behind is a concrete threshold algorithm, and the companion Theorem 9 of the paper (, a separate mission) turns it into sample-complexity bounds: samples suffice for .
Formalizing it. The result is proved on paper; no part of it is machine-checked. A formal proof contributes a verified treatment of an infinite-dimensional linear program over , of series defined through implicit equations, and of a Riemann-sum limit obtained by l'Hôpital's rule. One clause, , is not proved in the paper: it is imported from the i.i.d. prophet inequality literature via the interpretation of as a competitive ratio. A formal proof of that clause directly from SDCLP would be new.
Difficulty
The lower bound needs an explicit feasible point of an infinite program; checking feasibility of the threshold rule requires exact telescoping of series with products of the times , which are defined recursively through fractional powers. The limit is a limit of infinite series whose terms change scale as : every individual term tends to zero, so termwise passage to the limit gives no information, and the integral in the defining equation of appears only in an aggregate limit of the whole series. The upper bound cannot come from evaluating any single solution: it is a statement about every feasible , and the paper obtains it only through an external argument.
Formalization scope
- A stopping rule is
q : ℝ → ℕ → ℝ; ranks are 1-based (values at rank are never used), and constraints are imposed pointwise on as printed. The integral of the series in (10) is a lower Lebesgue integral of an -valued series, so it cannot collapse to a junk value; each is required integrable on . - is
sSupof the set of feasible ; it contains and is bounded by , so it is the true supremum (checked in a sorry-free verification file). The program ranges over all feasible , never only threshold rules. - (11) is quantified over only, so .
- Threshold rules use the half-open intervals of (7); (12) prints closed intervals, which overlap at the .
- The series in (18), (19), (26) and are written with the summation index shifted to start at ; with every logarithm's argument lies in , so they converge absolutely and
tsumis the true sum. - Lemma 6's recursion is for , the unique positive solution of (17).
- and are predicates (
IsAlphaTilde,IsAlphaStar), not chosen functions; the goal holds for every root selection. Existence and uniqueness of (with ) is already posed as the open itemCorreaThreshold.Adaptive.beta_star_existsUniqueand is not posed again. - "" is the one-sided filter
𝓝[<] 1. - Lemma 6 (iii) carries hypothesis (18), which the paper states in the sentence after the lemma; without it the claim is false.
Trivializing formalizations are ruled out: replacing by or by the value of a truncated program, fixing , restricting to threshold rules in the definition of , or replacing by each changes the theorem and is not done.
A complete development needs: binomial identities, interval integrals of and of piecewise-defined functions, real powers and logarithms of recursively defined sequences, summability of series in , continuity of the root of a monotone family of equations, and limits of Riemann-type sums on . The last two are reusable beyond this mission. Proofs of individual milestones are welcome independently of the goal.
Selected references
- J. Correa, A. Cristi, B. Epstein, J. A. Soto, Sample-Driven Optimal Stopping: From the Secretary Problem to the i.i.d. Prophet Inequality, arXiv:2011.06516v2, 2021. https://arxiv.org/abs/2011.06516v2
- T. P. Hill, R. P. Kertz, Comparisons of stop rule and supremum expectations of i.i.d. random variables, The Annals of Probability 10(2), 336–345, 1982 (reference [26] of the paper).
- R. P. Kertz, Stop rule and supremum expectations of i.i.d. random variables: a complete comparison by conjugate duality, Journal of Multivariate Analysis 19, 88–112, 1986 (reference [28]).
- J. Correa, P. Foncea, R. Hoeksma, T. Oosterwijk, T. Vredeveld, Posted price mechanisms for a random stream of customers, ACM EC 2017 (reference [17]).
- H. Kaplan, D. Naori, D. Raz, Competitive analysis with a sample and the secretary problem, SODA 2020 (reference [27]).
- J. Correa, P. Dütting, F. Fischer, K. Schewior, Prophet inequalities for i.i.d. random variables from an unknown distribution, ACM EC 2019 (reference [15]).
- A. Rubinstein, J. Z. Wang, S. M. Weinberg, Optimal single-choice prophet inequalities from samples, ITCS 2020 (reference [40]).