Motivation
Many queueing, inventory and storage models are Markov chains on a two-dimensional state space (n,i): a level n≥0 (a queue length, a stock level) and a phase i (the state of an arrival or service environment). When customers arrive in batches, the level can jump up by several units in one step but comes down one unit at a time; when services are grouped, it is the other way round. These two families, the M/G/1-type and GI/M/1-type chains, were developed by Neuts along separate lines (Neuts 1981; Neuts 1989, references 2 and 3), and they are the embedded chains of the classical M/G/1 queue at departures and the GI/M/1 queue at arrivals.
Chapter 13 of Latouche and Ramaswami, Introduction to Matrix Analytic Methods in Stochastic Modeling (SIAM 1999, doi:10.1137/1.9780898719734), shows that both families are embedded in quasi-birth-and-death processes (QBDs), and derives from the QBD theory of the earlier chapters the two central results: the first-passage matrix H of an M/G/1-type chain is the minimal nonnegative solution of H=∑nCnHn, and the stationary distribution of a GI/M/1-type chain is matrix-geometric, π~n=π~0Kn. This mission formalizes those statements.
Setting
Fix a countable set of phases ι and two sequences of real ι×ι matrices D0,D1,… and C0,C1,…. States are pairs (n,i), n≥0, i∈ι; the level ℓ(n) is the set of states with first coordinate n. Row vectors act on the left: π~n is the row vector (π~(n,i))i.
The M/G/1-type chain (skip-free to the left) has transition matrix (13.1): from (0,i) it moves to (k,j) with probability (Dk)ij; from (n,i), n≥1, it moves to (n−1+k,j) with probability (Ck)ij, k≥0. The GI/M/1-type chain (skip-free to the right) has transition matrix (13.2): from (n,i) it moves to (0,j) with probability (Dn)ij and to (n+1−k,j) with probability (Ck)ij, 0≤k≤n. Both matrices are assumed stochastic: nonnegative entries, rows summing to one.
The M/G/1-type chain is embedded in a QBD (13.3) on the states (n,d,j): the level is n and the phase is the pair (d,j), where d≥0 counts the levels still to be climbed. A jump from (n,i) to (n+k,j) becomes the sequence (n,0,i)→(n,k,j)→(n+1,k−1,j)→⋯→(n+k,0,j), with probabilities (Ck+1)ij,1,…,1 (Table 13.1, blocks (13.4)–(13.7)). In this QBD,
Hij=P[τ<∞ & (Xτ,Dτ,Jτ)=(n−1,0,j)∣(X0,D0,J0)=(n,0,i)],(13.9)
with τ the first passage time from ℓ(n) to ℓ(n−1), and G is the QBD's matrix of first-passage probabilities from ℓ(n) to ℓ(n−1).
A state is positive recurrent when its expected return time is finite, and a stationary probability vector π~ is nonnegative, sums to one and satisfies π~P~=π~.
Formalization targets
Goal: H is the minimal solution of (13.10) (Theorem 13.1.4)
For a stochastic M/G/1-type chain and every level n≥1, the matrix H of (13.9) has finite entries and is the minimal nonnegative solution of
H=n≥0∑CnHn,(13.10)
that is, it solves (13.10) and lies entrywise below every nonnegative real matrix Y with Y=∑nCnYn.
Milestones
- Theorem 13.1.3. The QBD's first-passage matrix has the block structure (13.8): G(k,i),(d,j)=(Hk+1)ij when d=0, and 0 otherwise.
- Corollary 13.1.2. If π~ is the stationary probability vector of an irreducible, positive recurrent M/G/1-type chain and π is a stationary probability vector of the QBD, then π~i=cπi,0 for a constant c.
- Theorem 13.1.5. With Cˉn=∑i≥0Cn+iHi and Dˉn=∑i≥0Dn+iHi, the matrix (I−Cˉ1)−1=∑νCˉ1ν is finite and, for n≥1,
π~n=(π~0Dˉn+1≤j≤n−1∑π~jCˉn−j+1)(I−Cˉ1)−1.(13.12)
- Theorem 13.2.3. For an irreducible, positive recurrent GI/M/1-type chain with stationary probability vector π~, there is a nonnegative K with
π~n=π~0Kn,(13.26)
K is the minimal nonnegative solution of K=C0+KC1+K2C2+⋯ (13.27), and, as printed, Kij is for every n≥1 the expected number of visits to (n+1,j) before the first return to ℓ(n−1), starting from (n,i).
Significance
Theorem 13.1.4 turns a probabilistic object, the matrix of first-passage probabilities one level down, into the minimal solution of a matrix equation of the size of one level. Every numerical method for M/G/1-type chains, including the quadratically convergent algorithms of Bini and Meini, computes this solution. Theorem 13.1.5 (Ramaswami's formula) then gives the stationary distribution recursively from H. Theorem 13.2.3 is the matrix-geometric property of GI/M/1-type chains, the origin of the matrix-analytic approach. Together these results cover the stationary analysis of batch-arrival and batch-service queues.
All four results are classical and proved in the book. None of them is formalized. Lean's Mathlib has no theory of first-passage matrices or of block-structured Markov chains. On Prove2Me the closest results are scalar ones: the geometric law of the G/M/1 arrival chain (QueueingFundamentals.GM1.arrival_point_geometric), the M/G/1 departure chain (QueueingFundamentals.MG1.*) and Foster-type classification of GI/M/1 chains (FosterQueues.GIM1.*). The matrix statements here contain those as the case of one phase.
Difficulty
The equation (13.10) follows formally from a first-step decomposition once H is known to be well defined independent of the level. The hard part is the passage between the chain and its QBD embedding. A first passage of the QBD from ℓ(n+k) down to ℓ(n−1) splits into k+1 successive one-level passages, a strong-Markov decomposition that must here be carried out as an identity of sums over trajectories. Minimality cannot be read off the equation: it needs the comparison of H with the iterates of the map Y↦∑nCnYn started from 0, with every series over a possibly infinite phase set. For Theorem 13.1.5 the inverse (I−Cˉ1)−1 has to be shown finite, which uses recurrence. Reading the interpretive clause of Theorem 13.2.3 literally is a trap (see below).
Formalization scope
Everything lives in the namespace MatrixAnalytic.SkipFree. Chains are real matrices ℕ × ι → ℕ × ι → ℝ on a countable phase type ι, and nothing requires finitely many phases. The QBD embedding has phase type ℕ × ι. Levels are counted from 0. Stochasticity, irreducibility, positive recurrence (finite expected return time) and stationary probability vectors restate the platform definition mm_countable. Probabilities and expected numbers of visits (H, G, and the visits in (13.26)) are sums over finite trajectories of products of one-step transition probabilities, valued in [0,∞]. Products, powers and series of nonnegative matrices are also computed in [0,∞]. The book's (I−M)−1 is ∑νMν, and finiteness is a conclusion wherever the book asserts it. "Minimal" is entrywise, over nonnegative real matrices.
H and K are never defined as solutions of (13.10) or (13.27), nor as "the minimal nonnegative solution". That definition would make Theorems 13.1.4 and 13.2.3 true by construction. H is the first-passage probability (13.9), and K is existentially quantified with its probabilistic meaning stated.
Beyond the paper. Finding F1/F2: the interpretive clause of Theorem 13.2.3 names the wrong taboo set. With one phase, C0=0.2, C1=0.3, C2=0.5, the minimal solution of (13.27) is K=0.4, but the expected number of visits to n+1 from n before reaching n−1 is 0.8. The faithful item states the page and is expected to be disproved. The corrected variant gm1_matrix_geometric_corrected counts visits before the return to ℓ(0)∪⋯∪ℓ(n), which is what the proof's K=R00(1) records.
Infrastructure needed: path-sum decompositions (first step, last exit, concatenation at a first-passage time) for countable chains, monotone iteration for matrix power series in [0,∞], and censoring of a chain on a subset of states. All of these are reusable for the other chapters of this series. Proofs that go directly through the skip-free chain, without the QBD embedding, are welcome.
Selected references
- G. Latouche and V. Ramaswami, Introduction to Matrix Analytic Methods in Stochastic Modeling, ASA-SIAM Series on Statistics and Applied Probability, SIAM, 1999. doi:10.1137/1.9780898719734
- M. F. Neuts, Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach, Johns Hopkins University Press, 1981; Dover reprint 1994.
- M. F. Neuts, Structured Stochastic Matrices of M/G/1 Type and Their Applications, Marcel Dekker, 1989.
- V. Ramaswami, "Stable recursion for the steady state vector for Markov chains of M/G/1 type", Communications in Statistics. Stochastic Models 4 (1988) 183–188 (reference [94] of the book; cited there in Remark 13.1.6).
- D. A. Bini and B. Meini, "On cyclic reduction applied to a class of Toeplitz-like matrices arising in queueing problems", in W. J. Stewart (ed.), Computations with Markov Chains, Kluwer, 1995, pp. 21–38 (reference [6] of the book).