Processing Networks XIII: Back-Pressure Control for Packet NetworksTextbook
Motivation
Mission XII (12-packet-networks-model) built the discrete-time, slotted packet-network model
from scratch and proved the chapter's own version of the fluid-to-stochastic stability bridge
(Theorem 12.10). That result is only useful once paired with an actual control policy whose fluid
model can be shown stable. J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models
and Stability (Cambridge University Press, forthcoming; cited here from the authors'
pre-publication draft, 2020-4-2, http://spnbook.org) supplies exactly such a policy in Sections
12.4-12.5: back-pressure control (called max-weight when the network is single-hop), a rule
that has become the default choice in the switching and wireless-scheduling literature because it
requires no advance knowledge of arrival rates and achieves the largest possible stability region.
This mission formalizes back-pressure control for the discrete-time packet network model and
proves it maximally stable — the chapter's own counterpart to mission VIII's continuous-time
Theorem 9.12.
Setting
At the start of each timeslot, having observed the current buffer contents , the max-weight/ back-pressure (MW/BP) policy solves (Eq. 12.41), where restricts the schedule set (mission XII) to what is actually available given . Equivalently (Eq. 12.42-12.43), writing (with ) for the "weight" of activity , the policy maximizes — the schedule that clears the most "backlog pressure" per timeslot. The policy is deterministic (no randomization variable is needed, since (12.41) is a genuine optimization problem, not one that inherently requires randomized tie-breaking).
Formalization targets
Goal: Theorem 12.16 — aperiodicity, irreducibility, and conditional positive recurrence
Consider a packet network satisfying (12.1) and Assumption 12.1, operating under back-pressure control. The DTMC is aperiodic and irreducible unconditionally. If the stability condition (12.26) — the existence of with — is additionally satisfied, is positive recurrent. This is the mission's headline result, and it packages both a structural fact (irreducibility/aperiodicity, needed regardless of load) and a conditional stability fact (positive recurrence, needed only under (12.26)) in one theorem.
Supporting milestones
Lemma 12.17 shows the optimization problem (12.41) always has a nonzero solution whenever the network is nonempty — the fact that back-pressure never "idles unnecessarily," which Lemma 12.18 uses to show every state can reach the empty state (hence irreducibility) and that state has period (hence aperiodicity, via (12.1)'s own assumption that no external arrivals is possible with positive probability). Lemma 12.20 is the back-pressure fluid equation (12.44), the discrete-time analog of mission VIII's Theorem 9.8: at each regular point, the fluid-scaled buffer content dotted with the fluid departure rate equals the maximum of that same dot product over the convex hull of the schedule set. Lemma 12.21 shows this fluid model is stable whenever (12.26) holds, via an explicit quadratic Lyapunov function.
Significance
The result itself. Theorem 12.16 shows that back-pressure control — a rule requiring no knowledge of arrival rates, computed fresh from the current buffer contents every timeslot — is maximally stable: combined with Theorem 12.8 and Proposition 12.9 (mission XII), it stabilizes every packet network arrival-rate vector that any policy could possibly stabilize. This is the discrete-time, slotted analog of mission VIII's Theorem 9.12, and the two proofs share their essential Lyapunov argument (the book's own text calls Lemma 12.21's proof "almost identical to that of Theorem 9.12"), even though the two chapters' back-pressure equations are built from different underlying objects — mission VIII's continuous-time allocation polytope versus this chapter's convex hull of a discrete schedule set.
Formalizing it. A live prior-art check (GET /theorems?q=back-pressure, q=max-weight) finds
no relevant hits, matching mission VIII's own finding for the continuous-time version. This
mission formalizes the back-pressure optimization problem and policy, the back-pressure fluid
equation, and its stability from scratch, restating (per this series' convention for
concurrently-drafted chunks sharing a sub-namespace) the minimal apparatus needed from mission
XII: the packet network model, Assumption 12.1, the raw processes, fluid limit paths, the fluid
equations (12.31)-(12.36), and the ambient-chain machinery, plus a new Aperiodic predicate this
chunk needs that mission XII's own results do not.
Difficulty
The obvious approach to Lemma 12.20's back-pressure fluid equation — directly differentiate the discrete system equation — obscures the actual argument, which reduces a maximum over the (potentially non-polytope) discrete schedule set to a maximum over its convex hull (justified because a linear functional on a compact polytope is maximized at an extreme point) and then shows that every schedule with a strictly smaller objective value than the maximizer contributes zero derivative to the usage-counting process — the discrete-time analog of mission VIII's Lemmas 9.10-9.11. A second difficulty is connecting the maximum-over-a- finite-set at the fluid-scaled level to Definition 12.3's discrete, arrival-indexed back-pressure policy: this mission's own Lemma 12.20 item states the fluid-relevant consequence of the discrete policy as a documented hypothesis (mirroring mission XI's own scope decision for its structurally identical WWTA fluid equation) rather than re-deriving it from the raw stochastic recursion, which would require reconstructing infrastructure outside this chapter's own numbered results.
Formalization scope
The packet network model, Assumption 12.1, the raw processes, and the fluid-limit apparatus are
restated verbatim from mission XII (12-packet-networks-model), since concurrently-drafted chunks
sharing a sub-namespace do not import one another's Lean files. IsBPOptimal is phrased via
domination over the feasible-at- schedule set, not sSup/argmax, per this series'
junk-value-avoidance convention; the same convention is applied to the maximum over in the back-pressure fluid equation. The formalization does not admit a trivializing
reading: irreducibility and aperiodicity are the same non-vacuous renewal-theoretic notions used
throughout this series (Aperiodic requires a genuine positive self-transition probability, not a
vacuously-true condition), and the goal's positive-recurrence conjunct is genuinely conditional on
(12.26), stated with the correct strict inequality rather than weakened to . Contributions
completing the five by sorry proofs are welcome, particularly Lemma 12.17's hop-count induction
and Lemma 12.20's extreme-point/zero-derivative argument (mirroring mission VIII's own Lemmas
9.10-9.11, adapted to discrete time).
Selected references
- J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org