Distributionally Robust Conditional Quantile Prediction with Fixed Design: Concentration of the surrogate residual distributionResearch Paper
Why fixed design matters for quantile prediction
A conditional quantile describes a level of a response that is exceeded with a specified probability after its explanatory variables are fixed. Such predictions enter inventory decisions when demand depends on prices, promotions, or product characteristics. These explanatory variables may be designed or selected deliberately. Treating their historical values as independent draws from a common distribution can therefore misrepresent the statistical problem. Qi, Cao and Shen (2021) study conditional quantile prediction with deterministic explanatory variables and random innovations.
Their procedure first fits a linear regression and then constructs a distributionally robust prediction from its residuals. A Wasserstein ambiguity set contains probability laws within a specified transportation distance of the empirical residual law. Its usefulness depends on whether the relevant future-response law lies near that center. The concentration result in this mission addresses this question for the full distribution, before any particular quantile or loss is selected.
The regression and probability setting
Fix a finite dimension , a deterministic sequence of feature vectors , and a true coefficient . The responses follow
The innovations are independent and identically distributed with a real Borel probability law of mean zero. They satisfy the light-tail assumption
Neither bounded support nor a density is required. The feature sequence is fixed before observing the innovations, and no separate intercept column is appended. The formal statements also allow a supplied constant feature column, a declared generalization of the source’s no-intercept model.
Let contain the first feature rows and let . The normalized Gram matrices converge to a finite nonsingular matrix. A sample size is admissible when it is positive and is nonsingular. At every such size, the ordinary least squares estimator is .
For any coefficient , let be the uniform empirical law of the residuals . At the true coefficient, this is the empirical innovation law. At the fitted coefficient, it is the surrogate residual distribution. Fix a deterministic prediction vector . Conditional on the realized training innovations , define as the pushforward of by . Thus it describes an independent future innovation shifted by the fitted prediction error. It is not averaged over training realizations.
Formalization targets
The goal is the complete Theorem 2 of Qi, Cao and Shen, supplied PDF/printed page 17. For every , there exists a deterministic nonnegative radius sequence such that, at every admissible sample size,
The radius can depend on the deterministic design, the law, the prediction vector and the confidence level, but never on the observed training vector. Both convergence and the closed upper-tail bound belong to the goal.
Seven milestones follow the dependency order of the source proof. Lemma 5 is represented by the existing, more general Fournier–Guillin empirical concentration theorem, specialized to dimension and transport power one. The new statements preserve Lemma 1's unrestricted dual representation, Lemma 4's variance bound
and both conclusions of Lemma 3:
where . Lemma 6 compares empirical innovations with fitted residuals at radius . Lemma 8 states for arbitrary translated real probability laws. Lemma 7 compares the innovation law with the training-conditioned shifted law at radius . Both radius-convergence clauses are retained, and may be any finite variance upper bound as allowed after Lemma 4.
What the concentration statement supplies
The result provides shrinking distributional uncertainty sets for regression residuals fitted on fixed-design data. In the source, this supports the finite-sample loss guarantee and the later consistency analysis. Those downstream claims, the independent tractable reformulation, and the random-design comparison are outside this mission; the selected goal concerns concentration alone. See Qi, Cao and Shen, Sections 4–6.
The formalization supplies concrete definitions of the responses, fitted residual law and training-conditioned target. It reuses published coupling-based Wasserstein and empirical-measure definitions. The existing Fournier–Guillin concentration statement is Open, rather than an already verified proof of the needed tail estimate. The seven new theorem declarations are likewise statement targets, not completed proofs.
Why the residual law needs separate analysis
Ordinary empirical concentration applies to independent samples from one law. Fitted residuals use a coefficient estimated from the same observations, so their coordinates are generally dependent and need not have identical distributions. Furthermore, the target law changes with the realized training sample through the prediction error at . Replacing either law with an unconditional mixture changes the theorem. The fixed-design setting and the distinction between these two random laws are central to the statement in Section 5.2.
Source defects also require explicit treatment. Lemma 7's printed closed-tail assertion fails at , because its radius is zero. Lemma 1's unrestricted supremum can include undefined signed integrals. The proof of Lemma 8 uses densities for laws that may be atomic. The proof of Lemma 7 also uses the variance of an absolute error in an uncentered tail bound; a two-sample Rademacher calculation disproves that intermediate inequality. These claims are preserved at their printed strength, with evidence recorded separately; no corrected theorem replaces a source milestone.
Formalization scope and conventions
Real coordinate vectors use finite function types, with indices shifted from one-based paper notation to zero-based finite indices. Dimensions are natural numbers; the source does not explicitly exclude zero, whose additional zero-radius issue in Lemma 6 is recorded separately. Training samples have exactly the finite product law . The finite-sample bounds quantify over all positive full-rank prefixes, so no condition requires a rank- matrix with fewer than rows.
Transport costs and nonnegative moments use extended nonnegative reals. Infinite integrals remain infinite. The light-tail parameter equals the actual finite exponential moment. Lemma 1 has explicit signed-integral definedness in its conclusion, exposing indeterminate expressions without restricting its probability laws. Translation is a measurable pushforward, including for atomic and infinite-first-moment laws.
Definitions do not assume concentration, an OLS error estimate, or the claimed leverage bounds. The goal does not substitute independent residuals, discrete noise, a fixed coefficient estimate, or sample-dependent radii. Further work can supply proofs or disproofs of the exact targets while retaining these conventions.
Selected references
- Meng Qi, Ying Cao and Zuo-Jun (Max) Shen, Distributionally Robust Conditional Quantile Prediction with Fixed Design, Management Science, 2021. DOI. Citations here use the supplied 36-page artifact, whose PDF and printed page numbers coincide; its SSRN footer differs from the catalog's published-basis label.
- Nicolas Fournier and Arnaud Guillin, On the rate of convergence in Wasserstein distance of the empirical measure, Probability Theory and Related Fields 162, 707–738, 2015. Author preprint.