A Dynamic Model for Managing Volunteer Engagement II: The Bellman Solution in Closed Form Between Consecutive Engagement ThresholdsResearch Paper
Motivation
Non-profit organizations such as food banks run on volunteer labour. Volunteers sign up for shifts, wait on a sign-up list, work, rest, and may or may not return; the organization can spend money on engagement activities (reminders, recognition events, recruitment drives) that raise the rate at which volunteers come back or arrive. Spending too little leaves shifts unstaffed; spending too much wastes a scarce budget. Ata, Tongarlak, Lee and Field (arXiv:2312.02920, Operations Research, 2024) model this as a multiclass queueing network, pass to a heavy-traffic limit, and obtain a one-dimensional drift-rate control problem: a reflected diffusion for the scaled workload whose drift is chosen, at a cost, from an interval of feasible drifts. The optimal policy they derive is a nested threshold policy: as the workload falls below successive thresholds , one more engagement activity is switched on.
To compute that policy one needs the thresholds, and the paper obtains them from a closed-form description of the solution of the Bellman equation between consecutive thresholds. That closed form, Proposition 3 of the paper, is the goal of this mission. A companion mission formalizes Theorem 1, the existence of a solution of the same Bellman equation.
Setting
There are engagement activities. The data are a lowest drift , drift increments , per-unit-drift costs , an idleness cost rate , a mean-reversion rate and a volatility . The breakpoints are
and the feasible drifts form the interval . The engagement cost is the convex, increasing, piecewise linear function with and slope on :
Its convex conjugate is
The Bellman equation of the drift-rate control problem asks for a constant and a continuously differentiable function on with
such that , is strictly increasing, and as . Here is the optimal long-run average cost and is the derivative of the transformed relative value function of the paper's §4 (p. 20).
Put for and . Since is strictly increasing from towards , each level is attained exactly once; the thresholds are
With the standard normal cumulative distribution function, the paper defines for
Formalization targets
Goal: Proposition 3 (p. 25)
For every solution of the Bellman equation and every ,
The statement fixes nothing beyond the model: it holds for any solution, with the thresholds defined from that solution.
Milestones
- (E9), Online Supplement p. 13: the conjugate is piecewise linear,
- Lemma 2(i), (D1), Online Supplement p. 9: for ,
- Lemma 2(ii), (D2), Online Supplement p. 9: the companion formula for .
Significance
The result. Proposition 3 turns the nested threshold policy into something computable. Evaluating at the right end of its interval and inverting gives from , so the thresholds follow by a one-dimensional recursion once is known. The paper's simulation study of a food bank (§5) uses these thresholds to set engagement policy. The result also shows that the value-function derivative, although defined through a nonlinear equation involving a supremum, is an explicit combination of Gaussian-type functions on each threshold interval.
Formalizing it. The result is proved in the paper (Online Supplement §D); no machine-checked version of it, of the conjugate formula (E9), or of the truncated Gaussian integrals (D1)–(D2) is known to exist. A formal proof checks the transcription of a long explicit formula with many constants, which is exactly where printed closed forms tend to go wrong, and produces reusable pieces: the conjugate of a convex piecewise linear function and two interval-integral identities for the normal cdf.
Difficulty
The Bellman equation is nonlinear in through . The obvious approach, solving it directly, fails because has no single formula. What makes it tractable is that on the argument stays in one linearity interval of ; this is a property of the solution, derived from its monotonicity and the definition of the thresholds, not a hypothesis. A complete proof must therefore combine the piecewise description of a supremum, a uniqueness argument for a linear first-order equation on a half-open interval (with the one-sided derivative at the left end and, for , an unbounded interval), and the evaluation of Gaussian integrals over finite intervals in terms of the normal cdf, matching every constant of the printed formula. The two expressions for the arguments, in and in (D1)–(D2), are equal, but the identification must be made.
Formalization scope
All objects live in the namespace VolunteerEngage.Thresholds, Lean 4 with Mathlib.
- The parameters form a structure
Model; and are -indexed sequences of which the indices are used. The standing assumptions (, , , , , , ) form the predicateStanding, a hypothesis of every model-level theorem. The paper states them in the model's derivation ((15), (24), (42), (43), (50), p. 18) rather than for the abstract control problem. - The cost (52) is written as one sum, equal to (52) on ; values off are never used. is the supremum (66) over , never its closed form, so (E9) is a genuine statement.
- A solution of the Bellman equation includes and a pair with continuous on and the one-sided derivative of within at every point. "Increasing" is strict.
- The thresholds enter the goal as a sequence with and, for , and ; strict monotonicity makes this the definition , so the proposition's clause "", which restates that definition, is not posed separately. is encoded by dropping the upper bound for .
- The goal is stated for every solution ; is part of the solution predicate, as on p. 21. It is not vacuous: the companion mission's goal (Theorem 1) asserts that a solution exists. A formalization that assumed the closed form of , that stays in one linearity interval, or that took as the definition of would make the goal trivial and is ruled out.
- is the published definition
Cohen2019.Robust.Phi, which is Mathlib'scdf (gaussianReal 0 1). Integrals in (D1)–(D2) are oriented interval integrals of continuous functions.
The source is the arXiv preprint v2 including its Online Supplement. The queueing network (§2) and the Brownian control problem (§3) motivate the Bellman equation but are not part of any formal statement; the optimality of the threshold policy (Theorem 2) is not formalized here. Proofs of any milestone, of the goal, and general lemmas on conjugates of piecewise linear functions or on Gaussian integrals over intervals are welcome.
Selected references
- B. Ata, M. H. Tongarlak, D. Lee, J. Field, A Dynamic Model for Managing Volunteer Engagement, arXiv:2312.02920v2, 2023; Operations Research, 2024. https://arxiv.org/abs/2312.02920