Observation 3 — a plug-in policy has regret at most
ProvedNonstatNV.observation_3learning-augmented-algorithmsnewsvendornonstationary-demandonline-learningp2o-gran-per-chapterp2o-plan-paperp2o-strengthenedp2o-v1regret
Consider a model satisfying the standing assumptions and Assumption 2 with constant . Let be a policy for horizon and an instance, and let and . Suppose that for every period the policy first forms a measurable estimate of the mean and then orders . Then
Taking suprema over the instance class gives the printed form with : a policy that estimates the mean accurately has low regret.
Differences from the source:
- generalization: R[a, b] ≤ C · sup_{D∈D(v)} E Σ|μ̂_t − μ_t| for some universal constant C → for each instance, its regret over [a, b] ≤ 2ℓ · E Σ|μ̂_t − μ_t| on the same instance; reason: taking suprema over D(v) on both sides gives the printed bound with C = 2ℓ, the constant of the paper's proof
- generalization: μ̂_t is the policy's estimate (computed from past demands) → μ̂_t is any measurable function of the demand path with values in [μmin, μmax]; reason: the bound holds for any such estimate; the policy's estimates are a special case
- generalization: q*_t ∈ argmin (minimizers presupposed) → no existence of minimizers at the true means assumed; the clairvoyant cost is the infimum over Q; reason: when minimizers exist the infimum is the minimum
Preamble
import Definitions.Def_NonstatNV_Model_Standing import Definitions.Def_NonstatNV_Model_LipschitzCost import Definitions.Def_NonstatNV_Model_IsInstance import Definitions.Def_NonstatNV_Model_IsPolicy import Definitions.Def_NonstatNV_Model_intervalRegret open MeasureTheory
Formal statement
namespace NonstatNV
/-- **Observation 3** (An, Li, Moseley, Ravi, *The Nonstationary Newsvendor with (and without) Predictions*, arXiv:2305.07993v4, p.35). For any policy `π` that, from period `lo` to period `hi`,
first estimates the mean at time `t` to be `μ̂_t ∈ [μmin, μmax]` and then orders
`q_t ∈ argmin_{q∈Q} C_t(μ̂_t, q)`,
`R^π(T)[lo, hi] ≤ C · E[Σ_{t=lo}^{hi} |μ̂_t − μ_t|]` with `C = 2ℓ` (the constant of the proof).
**Formalization Note** The bound is stated per instance; taking suprema over the instance class gives
the printed form. The estimate `μhat t ω` (the `μ̂_t` of the page) is any measurable function of the demand path with values in
`[μmin, μmax]`. -/
theorem observation_3 (M : Model) (ℓ : ℝ) (hM : M.Standing) (hℓ : M.LipschitzCost ℓ)
(T : ℕ) (q : ℕ → (ℕ → ℝ) → ℝ) (hq : M.IsPolicy T q) (μhat : ℕ → (ℕ → ℝ) → ℝ)
(μ b h : ℕ → ℝ) (hinst : M.IsInstance T μ b h) (lo hi : ℕ) (hlo : 1 ≤ lo) (hhi : hi ≤ T)
(hμhat : ∀ t ∈ Finset.Icc lo hi, Measurable (μhat t) ∧ ∀ ω, μhat t ω ∈ Set.Icc M.μmin M.μmax ∧
∀ q' ∈ M.Q, M.cost (μhat t ω) (b t) (h t) (q t ω) ≤ M.cost (μhat t ω) (b t) (h t) q') :
M.intervalRegret μ b h q lo hi ≤
2 * ℓ * ∫ ω, (∑ t ∈ Finset.Icc lo hi, |μhat t ω - μ t|) ∂(M.demandLaw μ) := by sorry
end NonstatNV
Source
L. An, A. A. Li, B. Moseley, R. Ravi, The Nonstationary Newsvendor with (and without) Predictions, arXiv:2305.07993v4 (20 Feb 2025), https://arxiv.org/abs/2305.07993v4, Observation 3, p.35 (proof p.35)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.