---
title: 'Multiline Queues: Models & Applications'
url: https://www.emergentmind.com/topics/multiline-queues
type: topic
---

# Multiline Queues: Models & Applications

Multiline queues denote several related but technically distinct constructions across probability, queueing theory, concurrent data structures, and algebraic combinatorics. In queueing theory, the term is used for systems with multiple queues or multiple servers, including parallel queues with simultaneous arrivals, polling systems, and multi-server queues whose extreme congestion behavior is analyzed asymptotically. In interacting-particle and combinatorial settings, multiline queues are arrays of occupied and vacant sites, or more general ball systems, that encode steady states of multispecies exclusion processes and give combinatorial formulas for Macdonald-type polynomials. In parallel algorithms, the closely related term **MultiQueue** refers to a relaxed concurrent priority queue built from multiple internal sequential priority queues [1211.2193][1904.04054][1811.01024][2504.11652].

## 1. Terminological scope and principal meanings

Within the literature, “multiline queue” does not designate a single universal model. Instead, it labels several families of objects that share a multi-layer or multi-queue architecture.

| Usage | Core object | Representative source |
|---|---|---|
| Queueing systems | Multiple physical or logical queues, servers, or lines | [1306.3513], [1904.04054], [2204.08346], [1211.2193] |
| Concurrent data structures | Multiple internal sequential priority queues with relaxed semantics | [2107.01350], [2504.11652], [2109.00657] |
| Combinatorial probability | Layered arrays of occupied/vacant sites or balls encoding exclusion processes | [1206.0316], [1811.01024], [2410.21781] |

In the queueing-theoretic sense, the emphasis is on arrivals, service disciplines, workloads, waiting times, stability, and extremal congestion. In the combinatorial sense, multiline queues are discrete objects whose rows encode species, priorities, or queue sizes, and whose projections recover configurations of the multispecies TASEP, PASEP, or TAZRP on a ring [1206.0316][2304.13696][2410.21781]. In the concurrent-algorithmic sense, MultiQueues are engineered relaxed priority queues whose semantics are quantified through rank error and delay rather than exact delete-min correctness [2107.01350][2504.11652].

This multiplicity of meanings is not merely terminological. It reflects a structural recurrence: layered systems in which local operations on rows or queues induce a tractable global law. A plausible implication is that the persistence of the term across fields is tied to this shared layered architecture rather than to a single common formalism.

## 2. Queueing-theoretic multiline systems

A central queueing instance is the service system with two independent queues receiving Poisson arrivals at rates $\lambda_1$ and $\lambda_2$, a single server, and **size-independent service times**: when the server serves a queue, all waiting customers in that queue are served in one fixed time unit, regardless of queue length [1306.3513]. The state is $(x,y)$, where $x$ and $y$ are the numbers of waiting customers in queues 1 and 2, and the problem is formulated as an infinite-horizon Markov Decision Process with Bellman equation
\[
V(x,y) = \lambda + \min\left\{
\gamma \mathbb{E}\big[V(Z_1, Z_2 + y)\big] + y,\;
\gamma \mathbb{E}\big[V(Z_1 + x, Z_2)\big] + x
\right\},
\]
where $\lambda = (\lambda_1+\lambda_2)/2$, $Z_1,Z_2$ are Poisson arrivals, and $\gamma$ is the discount factor [1306.3513]. The objective is to minimize the total expected discounted waiting time. The paper proves that among state-independent policies the optimal policy is cyclic: serve the slow-arrival queue once and the fast-arrival queue $k$ times, repeating. If $r=\lambda_2/\lambda_1$, then the optimal $k^*$ satisfies
\[
\sum_{i=0}^{k^*} (k^* - i)\gamma^i \le r < \sum_{i=0}^{k^*+1} (k^* + 1 - i)\gamma^i,
\]
with asymptotic behavior $k^* \sim \sqrt{2r}-1$ as $\gamma\to 1$ and $k^*\sim r$ as $\gamma\to 0$ [1306.3513].

A distinct multiline setting is the parallel-queue model with simultaneous arrivals. Here $K$ parallel $M/G/1$ queues each receive one job from the same Poisson arrival epoch, with service vector $(B_n^{(1)},\ldots,B_n^{(K)})$ and ordered service times
\[
B^{(1)} \geq B^{(2)} \geq \ldots \geq B^{(K)}
\]
almost surely [1211.2193]. With workloads $V_t^{(i)}$, the recursion at arrival epochs is
\[
(V_{n+1}^{(1)},...,V_{n+1}^{(K)}) = \left( \max(V_n^{(1)} + B_n^{(1)} - A_n, 0), ..., \max(V_n^{(K)} + B_n^{(K)} - A_n, 0) \right).
\]
The stationary joint workload transform
\[
\psi(s_1,\ldots,s_K)=\mathbb{E}\!\left[e^{-\sum_{i=1}^K s_i V^{(i)}}\right]
\]
admits explicit formulas in the ordered case, together with a stochastic decomposition and a dual interpretation in multidimensional risk theory [1211.2193]. In the two-dimensional general non-ordered case, the transform satisfies the kernel equation
\[
K(s,t)\psi(s,t)=t\psi_1(s)+s\psi_2(t),
\]
leading to a Riemann boundary value problem [1211.2193].

Multi-server queues also appear in extreme-value form. For the M/M/$c$ queue, customers arrive according to a Poisson process at rate $\lambda$, each of $c$ servers provides exponential service at rate $\mu$, and $M_n$ denotes the maximum queue length of idle customers over $[0,n]$ [1904.04054]. In the stable regime $\lambda<c\mu$, the Poisson clumping heuristic yields
\[
\mathbb{P}\left\{ M_n \leq \log_{c\mu/\lambda}(n) + h \right\}
\sim
\exp\left[ - A_c(\lambda, \mu) \left(\frac{\lambda}{c\mu}\right)^{h+1} \right],
\]
with explicit specializations for $c=1,2,3$ and a discrete Gumbel interpretation [1904.04054]. The corresponding mean and variance approximations are
\[
\mathbb{E}(M_n) \approx \frac{\ln(n)}{\ln\left(\frac{c\mu}{\lambda}\right)} + \frac{\gamma + \ln A_c'(\lambda, \mu)}{\ln\left(\frac{c\mu}{\lambda}\right)} + \frac{1}{2},
\]
\[
\mathbb{V}(M_n) \approx \frac{\pi^2}{6}\frac{1}{\ln^2\left(\frac{c\mu}{\lambda}\right)}+\frac{1}{12}
\]
[1904.04054]. The discrete-time Geo/Geo/2 analogue yields parallel formulas for maximum line length and, via a limiting argument with $p=\lambda\Delta$ and $r=\mu\Delta$, recovers the M/M/2 case [1902.09272].

A recurring operational conclusion in these extreme-value analyses is the “one fast server is better than multiple slow servers” phenomenon for fixed total service capacity. In the emergency-room example with $\lambda=1/3$, one server with $\mu=1/2$ yields smaller expected maximum queue length than two servers each with $\mu=1/4$, and the average queue length comparison gives $2$ for M/M/1 against $2.4$ for M/M/2 [1902.09272]. The M/M/$c$ study reports the same qualitative pattern for maximum queue length constants when $c\mu$ is held fixed [1904.04054].

## 3. Polling, routing, and balancing policies for multiple queues

Multiline queueing models also include polling systems in which a single server attends several queues and routing interacts with service priorities. In the three-queue JSQ-SLQ polling system, arriving customers follow the Join the Shortest Queue discipline while the single server preemptively serves the longest queue [2204.08346]. To avoid the intractable infinite three-dimensional state space $(L_1,L_2,L_3)$, the process is represented as a two-dimensional Markov process with $L_1$ and $D=(I,D_2,D_3)$, where $I$ is the queue being served and $D_2=L_1-L_2$, $D_3=L_1-L_3$ [2204.08346].

Two complementary analytic frameworks are developed. The first is a Probability Generating Function system with 12 generating functions $G_d(z)$ satisfying
\[
A(z)\cdot \vec{G}(z)=\vec{P}(z),
\]
where $A(z)$ is a $12\times 12$ matrix. The second recasts the model as a Quasi-Birth-Death process with 12 phases and infinite levels, with steady-state vectors
\[
\vec{P}_n=\vec{P}_1R^{n-1},
\qquad
A_0+RA_1+R^2A_2=0,
\]
and stability condition
\[
\vec{\pi}A_0\vec{e}<\vec{\pi}A_2\vec{e}
\]
[2204.08346].

The queue-balancing effect of the combined policy is quantified by the Gini Index
\[
GI=\frac{\sum_{i=1}^3\sum_{j=1}^3 |\mathbb{E}[L_i]-\mathbb{E}[L_j]|}{2\cdot 3 \cdot \sum_{i=1}^3 \mathbb{E}[L_i]}.
\]
The reported numerical values are very small, for example $0.0003$, rising up to $0.15$ only in extreme asymmetric cases [2204.08346]. The paper attributes this to the complementary balancing effects of JSQ, which sends arrivals to shorter queues, and SLQ, which allocates service to longer queues.

This balancing perspective is consistent with the two-queue size-independent service model, where the optimal state-independent schedule is also a regular cyclic schedule rather than a reactive one [1306.3513]. Taken together, these results suggest that in some multi-queue environments, structured cyclic or balancing policies can approximate or realize optimal performance without requiring full state observability. Because this conclusion synthesizes results from different models, it is best read as an interpretation rather than as a theorem valid uniformly across queueing systems.

## 4. MultiQueues as relaxed concurrent priority queues

In parallel computing, **MultiQueues** are relaxed concurrent priority queues composed of multiple internal sequential priority queues. In the 2021 formulation, the data structure consists of an array $Q$ of $c\cdot p$ sequential priority queues, where $p$ is the number of parallel threads and $c>1$ is a tuning parameter [2107.01350]. Insert operations choose a random unlocked queue; delete-min chooses two random queues and removes the minimum from the queue with the smaller observed minimum. The quality of this relaxation is measured by **rank error** and **delay**.

For the classical MultiQueue, the probability that an element of global rank $i$ is deleted next is
\[
\mathsf{P}(\mathrm{rank}=i)=\left(1-\frac{2}{cp}\right)^{i-1}\frac{2}{cp},
\]
which implies
\[
\mathrm{E}[\text{rank error}] \le \frac{c}{2}p = O(p),
\]
and with high probability the rank error is $O(p\log p)$ [2107.01350]. The delay also has a geometric law with expected value $\frac{cp}{2}$ [2107.01350]. The architecture is augmented by insertion and deletion buffers, batch operations on the internal queues, and **stickiness**, where a thread preferentially reuses the same internal queue for several operations to improve cache locality [2107.01350].

The 2025 engineering study generalizes this design. The MultiQueue now uses an array of $c\cdot p$ independent internal sequential priority queues, each protected by a lightweight lock, random insertions, and deletions that sample $d\ge 2$ queues and lock the one with the smallest observed minimum [2504.11652]. The paper formalizes relaxed semantics with
\[
\mathbb{P}(R=i)=(1-s)^is,
\qquad
s=\frac{d}{cp},
\]
and
\[
\mathrm{E}[R]=\frac{1}{s}-1,
\]
so expected rank error scales as $\mathcal{O}(p)$ and high-probability maximum rank errors as $\mathcal{O}(p\log p)$; delay follows the same geometric distribution [2504.11652]. Buffering, batching, $k$-ary heaps, and stickiness are reported as central throughput mechanisms, while “wait-free locking” is presented as the key locking discipline: because the number of queues exceeds the number of threads, operations complete in an expected constant number of lock attempts [2504.11652].

A scheduler-level variant is the **Stealing Multi-Queue (SMQ)**, in which each thread has a local queue, steals with probability $p_{steal}$, and uses task batching [2109.00657]. Under a fair-enough scheduler and sufficiently large $p_{steal}$, the paper states expected maximum-rank and average-rank bounds of the form
\[
O\left( \frac{nB(1+\gamma)}{p_{steal} (\log n + \log \frac{1+\gamma}{p_{steal}) \right)
\]
and
\[
O\left( \frac{nB(1+\gamma)}{p_{steal} \log{\frac{1+\gamma}{p_{steal} \right)
\]
respectively, reducing to $O(n)$ average rank and $O(n\log n)$ maximum rank when $B=1$, $\gamma=0$, and $p_{steal}$ is constant [2109.00657]. The implementation is evaluated on graph-processing benchmarks, and the paper reports that it can surpass schedulers such as Galois and PMOD [2109.00657].

These MultiQueue results are not queueing models in the classical stochastic-service sense, but they retain the core multi-line motif: several internal queues are used to trade exact minimality for throughput, locality, and scalability. The terminology is therefore adjacent rather than identical to that of probabilistic multiline queues.

## 5. Combinatorial multiline queues and exclusion processes

In combinatorics and integrable probability, multiline queues are layered arrays that project to multispecies exclusion processes on a ring. In the inhomogeneous multispecies TASEP on a ring, a multiline queue is an $(n-1)\times N$ cylindrical array of occupied and vacant sites, where row $r$ contains $M_r=\sum_{i=1}^r m_i$ occupied sites [1206.0316]. Ferrari–Martin ringing path transitions define a continuous-time Markov chain on these arrays, and the **bully-path projection** maps each multiline queue to a TASEP configuration. In the homogeneous case the stationary distribution on multiline queues is uniform, so the stationary probability of a TASEP configuration is proportional to the number of multiline queues projecting to it [1206.0316]. For the inhomogeneous case, a conjectural monomial stationary weight is written in terms of coverage statistics $z_{r,i}(\mathcal{Q})$:
\[
w(\mathcal{Q}) = x_1^{V_1} x_2^{V_2} \cdots x_{n-2}^{V_{n-2}}
\prod_{1\leq i<r\leq n}
\left(\frac{x_r}{x_i}\right)^{z_{r,i}(\mathcal{Q})},
\]
with proved special cases for $n=3$ and for a single first-class particle [1206.0316].

The multispecies ASEP on a circle leads to a weighted refinement. In the 2018 work linking multiline queues to Macdonald polynomials, a multiline queue is an $L\times n$ ball system with weakly increasing numbers of balls from top to bottom, and $\MLQ(\mu)$ denotes the set of multiline queues of type $\mu$ [1811.01024]. Each nontrivial pairing receives a $q,t$-weight, and the total generating function is
\[
F_\mu(x_1,\ldots,x_n;q,t)=\sum_{Q\in \MLQ(\mu)} \wt(Q).
\]
The main results are
\[
E_\lambda(\mathbf{x};q,t)=F_\lambda(\mathbf{x};q,t),
\qquad
P_\lambda(\mathbf{x};q,t)=Z_\lambda(\mathbf{x};q,t)=\sum_{\mu\in S_n(\lambda)}F_\mu(\mathbf{x};q,t),
\]
with the ASEP stationary probability recovered from $F_\mu(1,\ldots,1;1,t)$ [1811.01024].

For the multispecies PASEP on a ring, the corresponding construction is the linked multiline queue with a **$q$-bully path algorithm** [2304.13696]. Rows contain prescribed numbers of occupied sites, and links between adjacent rows are weighted by $q^{i-1}/[t]_q$ when the $i$th available target is chosen, where
\[
[k]_q=1+q+\cdots+q^{k-1}.
\]
The paper computes adjacent-particle correlations on the first two sites by reducing to projected 3-species PASEP configurations and summing weights over linked multiline queues [2304.13696].

The 2024 study of **twisted multiline queues** extends these constructions to arbitrary compositions rather than only partition shapes [2410.21781]. A fermionic MLQ of type $(\alpha,n)$ is a tuple $Q=(Q_1,\ldots,Q_k)$ with $Q_j\subseteq [n]$ and $|Q_j|=\alpha_j$, whereas a bosonic MLQ replaces subsets by multisets [2410.21781]. The fermionic twisted algorithm generalizes the Ferrari–Martin algorithm and is shown to be equivalent to the Arita–Ayyer–Mallick–Prolhac algorithm; the bosonic twisted algorithm is novel and generalizes the Kuniba–Maruyama–Okado construction for the TAZRP [2410.21781]. A new Markov chain on bosonic twisted multiline queues is defined, projects to the $0$-TAZRP, and commutes with the symmetric-group action on rows [2410.21781].

Another probabilistic use of “multi-line process” occurs in the multiclass Hammersley–Aldous–Diaconis process. Here the invariant measures for the two-class process are constructed from a stationary M/M/1 queue with Poisson arrivals of rate $\lambda$ and service attempts of rate $\rho>\lambda$, placing first-class particles at departure times $D(A,S)$ and second-class particles at unused service times $U(A,S)$ [0707.4202]. The construction generalizes to $n$ classes through tandem queues and yields a multi-line process whose invariant measure is a product of Poisson processes [0707.4202]. This is not the same combinatorial MLQ as in TASEP, but it shares the queue-coupling and multilayer logic.

## 6. Spectral, crystal, and polynomial extensions

A major development is the embedding of multiline queues into the theory of symmetric functions and crystal combinatorics. In “Multiline queues with spectral parameters,” an MLQ of type $m=(m_1,\ldots,m_\ell,0,\ldots)$ is a sequence of queues $(q_1,\ldots,q_{\ell-1})$ where $q_i$ is a $p_i(m)$-queue and acts on words by the generalized Ferrari–Martin algorithm [1810.08157]. For a packed word $u$, the spectral weight is
\[
\mathbf{u}:=\sum_q \mathrm{wt}(q),
\]
summing over MLQs such that $q(1^n)=u$, and for any permutation $\sigma\in S_{\ell-1}$ the $\sigma$-twisted spectral weight satisfies
\[
\mathbf{u}=\mathbf{u}_\sigma
\]
[1810.08157]. This proves the commutativity conjecture of Arita, Ayyer, Mallick, and Prolhac. For a special family of words $u(v)$, the spectral weight has the determinant formula
\[
\mathbf{u(v)}=
\left(\prod_{b\in B}x_b\right)
\det\Big[h_{\gamma_j+i-j-1}(x_1,\ldots,x_{b_j})\Big]_{i,j=1}^r,
\]
where $h_k$ is the complete homogeneous symmetric function [1810.08157].

At $t=0$, multiline queues yield formulas for $q$-Whittaker polynomials through a **collapsing** insertion procedure [2407.05362]. For a multiline queue $M$, the major index $\maj(M)$ gives
\[
P_\lambda(X;q,0)=\sum_{M\in \MLQ(\lambda,n)} q^{\maj(M)}x^M.
\]
Collapsing is expressed through lowering operators
\[
\rho_N(B)\coloneqq e_{[1,L-1]}^\star e_{[1,L-2]}^\star \cdots e_{[1,2]}^\star e_{[1,1]}^\star(B),
\]
and is identified with crystal-operator dynamics [2407.05362]. The same framework recovers Lascoux–Schützenberger charge formulas for $q$-Whittaker polynomials, Littlewood–Richardson coefficients, and the dual Cauchy identity [2407.05362].

The interpolation extension is given by **signed multiline queues**. In the 2025 work on interpolation Macdonald polynomials, a signed multiline queue is an enhanced $2L\times n$ ball system with classic rows and signed rows $1,1',2,2',\ldots,L,L'$, where balls in signed rows may carry positive or negative labels [2510.02587]. The generating functions
\[
F_\mu^*(x;q,t)=\sum_{Q\in \SMLQ(\mu)} \wt(Q),
\qquad
Z_\lambda^*(x;q,t)=\sum_{\mu\in S_n(\lambda)}F_\mu^*(x;q,t)
\]
satisfy
\[
P_\lambda^*(x;q,t)=Z_\lambda^*(x;q,t),
\]
so interpolation Macdonald polynomials are obtained as generating functions of signed multiline queues [2510.02587]. The construction reduces to the earlier multiline queue formula when no negative balls are present [2510.02587].

Across these algebraic developments, multiline queues function as a common combinatorial skeleton for steady states of exclusion processes, Macdonald polynomials, interpolation analogues, and crystal-theoretic symmetries. This suggests that the queueing interpretation is not merely metaphorical: it furnishes an organizing principle capable of transporting methods between integrable probability and symmetric-function theory.

Source: https://www.emergentmind.com/topics/multiline-queues