Sample-Driven Optimal Stopping: From the Secretary Problem to the i.i.d. Prophet Inequality III: The Explicit Lower Bound on the Competitive Ratio Is at Least α* Times pResearch Paper
Motivation
Optimal stopping with partial information sits between two classical problems. In the secretary problem a decision maker sees values in random order, knows nothing about how they are generated, and must stop on the best one; the optimal guarantee is . In the i.i.d. prophet inequality the values are independent draws from a known distribution, and the best guarantee, relative to the expected maximum, is the constant : Hill and Kertz (1982) and Kertz (1986) showed that no stopping rule does better on every distribution, and Correa, Foncea, Hoeksma, Oosterwijk and Vredeveld (2017, doi:10.1145/3033274.3085137) gave a rule that achieves it. Practical settings, such as pricing from historical data, lie in between: the distribution is unknown, but samples of it are available.
Correa, Cristi, Epstein and Soto (arXiv:2011.06516v2) interpolate between the two problems with the -sample-driven optimal stopping problem: each of adversarial values is independently revealed in advance (a sample) with probability , and the remaining values arrive online in random order. At this is the secretary problem; as it approaches the i.i.d. prophet inequality. They show that the optimal competitive ratio of the limit problem is the value of an infinite-dimensional linear program, and they construct an explicit threshold rule whose guarantee is the root of a scalar equation.
Prior work on learning a distribution from samples obtained guarantees with samples (Correa, Dütting, Fischer, Schewior, 2019) and with samples (Rubinstein, Wang, Weinberg, 2020). Theorem 9 of the paper, the goal of this mission, gives such a guarantee with samples.
Setting
Fix . The guarantee of the explicit threshold rule is the number solving
Lemma 7 of the paper shows that (19) has exactly one root in . The i.i.d. prophet constant is the solution of
The proof of Theorem 9 (Appendix B.9) works with three auxiliary functions of , each depending on as a parameter:
Appendix B.7 also names the two sides of (19): and . In Lean, IsAlphaTilde p a and IsAlphaStar s are shared predicates in SampleDrivenOS.Limit; aB9 s p, bB9 s p, cB9 s p, fB7 p α, and gB7 p α are in SampleDrivenOS.Linear.
Formalization targets
Goal: Theorem 9 (p. 17)
It is stated for every root of (19) and every solution of the integral equation; neither existence nor uniqueness is assumed.
Milestones (Appendix B.7 and B.9, in the order the proof uses them)
- B.7: is strictly increasing on and non-increasing on .
- B.9: if (19) holds with "" at in place of (after the substitution ), then .
- B.9: that inequality is equivalent to .
- B.9: is differentiable on with , also in term-by-term form.
- B.9: .
- B.9: .
- B.9: using the defining equation of ,
- B.9: for all and , .
- B.9: if , then .
- B.9: under the same hypothesis, on .
Significance
The explicit rule's guarantee is a lower bound on the optimal ratio , and Theorem 8 (a separate mission of this series) shows as . Theorem 9 makes that convergence quantitative and uniform: the guarantee is at least linear in , so with , an online set of size and samples the rule earns of the expected maximum. This improves the sample complexity of the earlier learning-based results by a polynomial factor, in a model more general than theirs.
The theorem is proved in the paper; it has no machine-checked proof. The proof is elementary real analysis on explicit series and integrals, and one of its steps is a numerical check that the paper does not carry out in print. A formalization turns that numerical claim into a certified inequality and checks a chain of estimates in which one inequality sign is misprinted (see Formalization scope).
Difficulty
The statement is about two implicitly defined numbers. has no closed form, and is defined by an integral equation. Evaluating both numerically at finitely many proves nothing for the remaining , and the inequality is tight at (), so no uniform slack is available near .
Concavity of would give the result immediately, and the paper reports it numerically, but the authors were unable to prove it; the argument must avoid it. The remaining work handles infinite series whose terms depend on through both and : differentiating such a series term by term requires uniform control of the derivative series, comparing it with an integral needs a monotonicity argument, and one step needs a bound valid on an entire two-parameter region rather than at a point.
Formalization scope
- Numbers, not processes. No probability, program or algorithm appears in Lean. Everything is a real-valued function on .
- Predicates, not choice. and enter as
IsAlphaTilde p a(with ) andIsAlphaStar s(with ). Statements quantify over every solution. Both exist, so the goal is not vacuous: existence of is Lemma 7 (posed in the second mission of this series), and existence and uniqueness of are posed asCorreaThreshold.Adaptive.beta_star_existsUnique(512ff915-7ec1-4d24-87b3-bc8adfee6bad). - Series. Every series is a Lean
tsumoveri : ℕwith the paper's index shifted toi + 1. For parameters in all series are summable, sotsumis the true sum; summability is part of what solvers prove, never a hypothesis. Differentiability of is likewise a conclusion (HasDerivAt), never assumed. - Total functions.
Real.log 0 = 0makes the integrands' values at equal their limits, so the interval integrals are the true integrals. Every division (, ) is at a positive argument under the stated ranges, and every logarithm's argument is positive. - . The paper uses this approximation through the interval of its numerical check. Milestones 9 and 10 carry that interval as a hypothesis; the goal does not. The lower bound is posed as
CorreaThreshold.Adaptive.inv_beta_star_gt(ce70487c-b155-4e47-9ce8-8348dc1b1645). The upper bound (numerically ) is posed nowhere and is welcome as a lemma. - A printed slip. The paper prints the conclusion of milestone 9 as "". The surrounding argument requires and announces "", and the formal statement uses .
- Ruled-out trivializations. Fixing , replacing by the numeral (a weaker statement, since ), stating 's monotonicity through
deriv(which is at non-differentiable points), or replacing by a chosen value all change the theorem. None is used. - Reusable infrastructure. Welcome contributions include term-by-term differentiation of
tsums under a dominating series, Riemann-sum comparisons for monotone integrands, a Chebyshev-type integral inequality for two decreasing functions, and certified interval arithmetic for a two-variable inequality such as milestone 8.
Selected references
- J. Correa, A. Cristi, B. Epstein, J. A. Soto, Sample-Driven Optimal Stopping: From the Secretary Problem to the i.i.d. Prophet Inequality, arXiv:2011.06516v2, 2021 (journal version: Mathematics of Operations Research, 2024). https://arxiv.org/abs/2011.06516v2
- J. Correa, P. Foncea, R. Hoeksma, T. Oosterwijk, T. Vredeveld, Posted Price Mechanisms for a Random Stream of Customers, ACM EC 2017; Mathematics of Operations Research 46(4), 2021. https://doi.org/10.1145/3033274.3085137
- T. P. Hill, R. P. Kertz, Comparisons of stop rule and supremum expectations of i.i.d. random variables, Annals of Probability 10(2), 1982 (reference [26] of the paper). https://doi.org/10.1214/aop/1176993767
- R. P. Kertz, Stop rule and supremum expectations of i.i.d. random variables: a complete comparison by conjugate duality, Journal of Multivariate Analysis 19, 1986 (reference [28] of the paper).
- J. Correa, P. Dütting, F. Fischer, K. Schewior, Prophet Inequalities for I.I.D. Random Variables from an Unknown Distribution, ACM EC 2019. https://doi.org/10.1145/3328526.3329627
- A. Rubinstein, J. Z. Wang, S. M. Weinberg, Optimal Single-Choice Prophet Inequalities from Samples, ITCS 2020. https://doi.org/10.4230/LIPIcs.ITCS.2020.60