--- title: Iterated Collect Model in Distributed Computing url: https://www.emergentmind.com/topics/iterated-collect-model type: topic --- # Iterated Collect Model in Distributed Computing Searching arXiv for the primary paper and closely related distributed-computing context. The iterated collect model is an asynchronous, wait-free iterated shared-memory model in which computation proceeds in rounds over a stack of memory layers, each layer being an array of $n$ single-writer/multi-reader registers, one per process. In each round, every correct process writes to its own register in the current layer and then collects the layer by asynchronously reading all $n$ registers, one by one, in any order, thereby obtaining a view of the values written by any subset of the processes that wrote before it accessed their registers. In the context of bounded-memory simulations of full-information protocols, the model is notable because bounded $b$-bit registers can implement $r$ rounds of unbounded full-information with round complexity $\Theta((n!)^{r-1}\cdot 2^{n-b})$, preserving solvability up to isomorphism in the sense of the asynchronous computability theorem [2509.13157]. ## 1. Definition and execution semantics Iterated collect is the simplest read-write access pattern in the family of iterated shared-memory models studied in "Space-Time Trade-off in Bounded Iterated Memory" [2509.13157]. Computation proceeds in rounds over a stack of memory layers; each layer is an array of $n$ single-writer/multi-reader registers, one per process. In each round $r$, every correct process writes to its own register in the current layer and then collects the layer by asynchronously reading all $n$ registers, one by one, in any order. The model is asynchronous and wait-free: each non-faulty process must complete in a finite number of its own steps regardless of other processes’ speeds. The failure model is crash failures: processes may stop taking steps at arbitrary times. A collect therefore returns a view shaped by the interleaving of writes and reads, rather than by a single atomic read event. More precisely, a process obtains a view of the values written by any subset of the processes that wrote before it accessed their registers. The paper formalizes bounded iterated algorithms through a generic structure called `ITER`. Shared memory is an array $M[R,|\Pi|]$ of $R$ layers, each an array of $|\Pi|$ SWMR entries initialized to $\bot$. A process starts from a local state $s \leftarrow \text{next\_state}(\text{input}(i),\bot,0)$, and for rounds $r=1,\dots,R$ performs a write of $\text{encode}(s,r)$ into $M[r,i]$, reads all entries in $M[r]$ by collect, and updates its state via $\text{next\_state}(s,v,r)$. The final decision is $\delta_i(s)$ [2509.13157]. ## 2. Position within iterated shared-memory models The iterated collect model differs from snapshot-based iterated models in the strength of the read primitive. The comparison in the paper is explicit. | Model | Read primitive | Structural note | |---|---|---| | IAS | Atomic snapshot | Returns a single, instantaneous view of all $n$ registers | | IIS | Immediate snapshot | Write and snapshot are executed together as a single immediate operation | | IC | Collect | A process reads registers one by one; views reflect the interleaving of writes and reads | For iterated atomic snapshot (IAS), reads are atomic snapshots that return a single, instantaneous view of all $n$ registers. For iterated immediate snapshot (IIS), write and snapshot are executed together as a single immediate operation; the protocol complex is exactly the standard chromatic subdivision. For iterated collect (IC), a process reads registers one by one; views reflect the interleaving of writes and reads and include strictly more configurations than snapshots [2509.13157]. The inclusion relation shown in the paper for $n=3$ is $$ I(\Delta^2)\subset \Xi^{IAS}(\Delta^2)\subset \Xi^{IC}(\Delta^2), \qquad I\cong Ch. $$ This places IC as strictly richer than the snapshot-based variants at the level of reachable configurations. A plausible implication is that IC exposes more scheduling structure in the protocol complex than IAS or IIS, even though the bounded full-information construction ultimately shows that stronger read atomics do not asymptotically improve the lower bound. ## 3. Full-information protocols and protocol-complex structure In the unbounded full-information protocol based on iterated collect, denoted FIIC, processes write their entire current local knowledge in every round, and update it to their read view; the state size grows round by round [2509.13157]. The reachable global configurations of a protocol from an input complex $\mathcal{I}$ are captured by a protocol map $$ \Xi:\mathcal{I}\to 2^\Omega, $$ where $\Omega$ is a simplicial complex of process-labeled vertices, called the protocol complex. A bounded protocol simulates the unbounded one “up to isomorphism” when $\Xi_A(\mathcal{I})$ has the same simplicial complex structure as $\Xi_{FIIC}(\mathcal{I})$: there is a bijection between vertices that preserves colors and maps simplices to simplices. The set of reachable states and their adjacency relationships therefore coincide, so the same decision map $\delta$ can be used, in the sense of ACT. Two structural properties of full-information protocol maps are used repeatedly. The first is mesh-shrinking: $$ \forall v,w\in V(\mathcal{I}),\ \{v,w\}\notin \Xi_{FI_P}(\mathcal{I}). $$ No original input edge survives into the next-round protocol complex. The second is intersection preservation: $$ \Xi_{FI_P}(A)\cap \Xi_{FI_P}(B)=\Xi_{FI_P}(A\cap B) $$ for subcomplexes $A,B\subseteq \mathcal{I}$. The paper states that these properties play the role of an intersection-preserving property of subdivisions and are crucial in the distinguishability arguments [2509.13157]. ## 4. Bounded encodings and distinguishability Bounded-memory simulation cannot write the entire local state in a register. Instead, a process writes an encoding $\omega(s)$ using at most $2^b-1$ distinct non-$\bot$ values per round. The central notion is distinguishability of vertices and faces in the input complex [2509.13157]. Given an encoding $\omega:V(\mathcal{I})\to E$, a colored vertex $v$ is distinguishable if no neighbor $u$ of $v$ has a neighbor $x$ of the same color as $v$ with $\omega(x)=\omega(v)$. A face $\sigma$ is distinguishable if all its vertices are distinguishable under $\omega$. A bounded algorithm $A$ is specified by a sequence of round-specific encoding functions $\omega_A(1),\dots,\omega_A(R)$ and next-state functions $\sigma_A(1),\dots,\sigma_A(R)$. The main necessary condition is Theorem 1 of the paper: $$ \Xi_A^{(r)}(\mathcal{I})\cong \Xi_{FI_P}(\mathcal{I}) \ \Longrightarrow\ \forall \sigma\in Faces(\mathcal{I})\ \exists k\le r:\ \sigma \text{ is distinguishable in }\mathcal{I}\text{ under }\omega_k. $$ Equivalently, if the distinguishable subcomplex induced by the encoding sequence is defined by $$ (\omega_A,\mathcal{I}) := \bigcup_{0\le k1. $$ Combining these facts with the observation that, in one bounded round, a process can differentiate at most $2^b-1$ states of the same color among a vertex’s neighbors yields the main lower bound. For an $(n-1)$-dimensional input complex with $n>2$, any bounded algorithm using the same write-read pattern and at most $b$ bits per process per round that satisfies $$ \Xi_A(\mathcal{I})\cong \Xi_{FI_P}^r(\mathcal{I}) $$ must perform $$ \Omega((n!)^{r-1}\cdot 2^{n-b}) $$ rounds. The paper interprets the factors combinatorially. The $(n!)^{r-1}$ term counts the number of process-order permutations across $r-1$ rounds that can produce distinct views around a fixed vertex. The $2^n$ term reflects the combinatorics of faces containing the vertex and the central vertices generated in subdivisions. The $b$-bit bound limits per-round distinguishability to at most $2^b-1$ neighbors per process color, producing the factor $2^{n-b}$ when solving for the number of rounds. The sensitivity to $b$ is explicit. When $b\ge n$, the factor $2^{n-b}\le 1$, so the bound becomes $\Theta((n!)^{r-1})$. When $b\ll n$, the number of rounds grows exponentially in $n-b$. The paper gives numerical examples, including $n=3,r=2,b=1$, which yields $\Omega(24)$ rounds; $n=4,r=2,b=2$, which yields $\Omega(96)$ rounds; and $n=5,r=3,b=3$, which yields $\Omega(57{,}600)$ rounds [2509.13157]. ## 6. Greedy Star construction and optimality in iterated collect The constructive upper bound for IC is the bounded full-information algorithm Greedy Star [2509.13157]. Its high-level strategy is to build a sequence of encoding functions that partitions the input complex into vertex-star subcomplexes and makes each partition distinguishable in one or more rounds. A vertex star $St(\mathcal{I},v)$ is the subcomplex of all faces containing $v$. In each phase, Greedy Star selects a set of pairwise disjoint stars and assigns codes within each star so that encodings are injective per process color inside the star. This guarantees distinguishability and ensures that processes can decode which local states are present in their views. Because $b$ bounds the number of distinct codes, each phase may require multiple bounded rounds to cover all facets in the selected stars. The algorithm initializes the covered subcomplex $A\leftarrow \varnothing$ and the remaining-vertex set $V\leftarrow V(\mathcal{I})$. It then repeats until $A=\mathcal{I}$: start a fresh phase, initialize $U\leftarrow \varnothing$ and $V_u\leftarrow \varnothing$, scan vertices $v\in V$, consider $S=St(\mathcal{I},v)$, and if $S$ does not intersect the already chosen $U$ in that phase, add $S$ to $U$, add its vertices to $V_u$, and define $\omega_r$ on $S$ so that for each process color $c$, vertices of color $c$ in $S$ receive pairwise distinct codes from $\{1,\dots,2^b-1\}$, with $\bot$ used elsewhere. After the phase, add $U$ to $A$, remove $V_u$ from $V$, append $\omega_r$ to the sequence, and continue. Correctness relies on the fact that, in rounds where $\omega_{GS}(r)(s)=\bot$, a process ignores the layer; otherwise it decodes the view to identify which face is present in the corresponding star and refines its knowledge. By construction, once a face is distinguished in some round, intersection-preservation and mesh-shrinking ensure its corresponding configurations persist across subsequent rounds until termination. The per-phase bound proved in the paper is $$ |\omega_S|\le 4\cdot \left\lceil \frac{\max_{v\in V(\mathcal{I})}\deg(\mathcal{I},v)}{n(2^b-1)} \right\rceil. $$ From this, together with asymptotic degree growth, the paper derives the tight bound for IC. For an $(n-1)$-dimensional input complex with $n>2$ and $r>0$, there exists a bounded collect-pattern algorithm $A\in ITER$ with at most $b$ bits per register per round such that $$ \Xi_A(\mathcal{I})\cong \Xi_{FIIC}^r(\mathcal{I}) \quad\text{and}\quad |\omega_A|\in \Theta((n!)^{r-1}\cdot 2^{n-b}). $$ Moreover, no bounded IC algorithm can use asymptotically fewer rounds. Theorem 5 further states that Greedy Star using the collect pattern actually simulates the unbounded FIIC protocol up to isomorphism: $$ \Xi_{GS}(\mathcal{I})\cong \Xi_{FIIC}(\mathcal{I}). $$ ## 7. Solvability, special cases, and terminological scope The connection to ACT is direct. ACT characterizes wait-free task solvability in read-write shared memory assuming unbounded full-information variables. The bounded iterated collect results show that bounded variables have the same computational power up to isomorphism with extra rounds: any task solvable by FIIC in $r$ iterations is solvable by the bounded algorithm with $\Theta((n!)^{r-1}\cdot 2^{n-b})$ rounds, and the ACT decision map $\delta$ is preserved [2509.13157]. The snapshot-based models obey the same lower bound $$ \Omega((n!)^{r-1}\cdot 2^{n-b}), $$ and there exists an algorithm performing at most $$ O((n!)^{r-1}\cdot 2^{n-b}\cdot n) $$ rounds. The paper attributes the extra factor $n$ to the fact that a single immediate snapshot round can be simulated in $n$ collect rounds. Thus the collect construction is asymptotically optimal, and the snapshot constructions are within a linear factor $n$ of optimal. Several caveats delimit the theory. The results assume wait-freedom and an adversarial asynchronous scheduler, unique identifiers, SWMR memory layers, writes preceding reads in each round, and deterministic local computation of the encoding sequence. The general lower bound is stated for $n>2$; for $n=2$, the paper states a different regime in which two processes need only $1$ round, achievable with $2$-bit registers. The paper also states that if one wants a single bounded round per full-information iteration, then the corresponding bit-complexity lower bound is $\Omega(r\cdot n\cdot \log n)$. Outside this distributed-computing meaning, the phrase “Iterated Collect Model” is used in several other papers only as a narrative mapping or as a point of clarification, not as the formal SWMR collect model. "When Models Don't Collapse: On the Consistency of Iterative MLE" frames iterative synthetic-data accumulation and retraining as an “Iterated Collect Model” cycle [2505.19046]. "Iterative Document-level Information Extraction via Imitation Learning" presents IterX as an iterative agent that “collects” templates one at a time [2210.06600]. "From Growing to Looping: A Unified View of Iterative Computation in LLMs" explicitly describes an “Iterated Collect-style approach” for repeatedly reusing a middle computation block [2602.16490]. By contrast, the graph-theoretic papers "The Iterated Local Model for Social Networks" and "The Iterated Local Model for tournaments" explicitly note that “Iterated Collect Model” is not their term; their formal objects are ILM and ILMT, respectively [1903.04523] [2601.23246]. In the precise distributed-computing sense, however, the iterated collect model denotes the layered collect-based read-write model analyzed in [2509.13157]. Its central significance is that it admits a complete space-time characterization for bounded simulation of full-information: bounded $b$-bit registers suffice to recover the unbounded protocol complex up to isomorphism, but only at the cost of $\Theta((n!)^{r-1}\cdot 2^{n-b})$ rounds. Source: https://www.emergentmind.com/topics/iterated-collect-model