Papers
Topics
Authors
Recent
Search
2000 character limit reached

Up-Down Walk on Forests

Updated 6 July 2026
  • Up-Down Walk on Forests is a family of local Markov chains that uses an edge-addition and deletion process on acyclic graph subsets to efficiently sample spanning trees.
  • The method leverages both component- and edge-constrained formulations using matroid exchange techniques to achieve provable mixing guarantees and near-linear sampling times.
  • The Balanced Up-Down (BUD) walk extends the framework by enforcing strict population balance in redistricting, though its quantitative convergence rates remain an open challenge.

The up-down walk on forests is a family of local Markov chains on acyclic edge sets of a graph, typically realized by adding an edge and then deleting an edge so that the state remains a forest. In redistricting applications, the underlying graph encodes geographic building blocks, and random spanning trees or forests are split into connected subgraphs that serve as districts. The central difficulty is balance: districts must have nearly equal population, whereas naive rejection based on random tree splittings becomes exponentially inefficient in the number of parts. Recent work formulates a balance-preserving variant, the Balanced Up-Down (BUD) walk, while earlier matroidal analyses establish sharp mixing guarantees and near-linear-time implementations for unconstrained down-up walks on forest state spaces (Akitaya et al., 12 Feb 2026, Anari et al., 2020).

1. Formal state spaces and transition rules

One standard formulation fixes the number of connected components. For a connected graph G=(V,E)G=(V,E) with V=n|V|=n, let FkF_k be the set of all spanning forests of GG with exactly kk connected components. Equivalently, these are bases of the rank-(nk)(n-k) truncation of the graphic matroid. From a forest FFkF\in F_k, the original Up-Down walk picks uniformly at random an edge eEE(F)e\in E\setminus E(F), adds it to FF, obtains a unique cycle CC in V=n|V|=n0, chooses uniformly at random an edge V=n|V|=n1, and deletes V=n|V|=n2. The resulting forest V=n|V|=n3 again lies in V=n|V|=n4. The one-step transition matrix satisfies

V=n|V|=n5

Because this is the usual basis-exchange walk on a matroid, it is irreducible and aperiodic on V=n|V|=n6, reversible, and has the uniform distribution on V=n|V|=n7 as its unique stationary distribution. In this formulation it mixes in V=n|V|=n8 steps, and each step can be implemented in amortized V=n|V|=n9 time, yielding an FkF_k0-time algorithm to sample a random forest in FkF_k1 (Akitaya et al., 12 Feb 2026).

A second formulation fixes the number of edges rather than the number of components. For a graph FkF_k2 with graphic matroid FkF_k3, let FkF_k4, the family of rank-FkF_k5 independent sets of FkF_k6. The target law may be uniform or weighted: FkF_k7 and can also be extended to all forests by

FkF_k8

The down-up chain on FkF_k9 removes a uniformly random edge GG0, forming GG1, then adds an edge GG2 with probability proportional to GG3 in the unweighted case and to GG4 in the weighted case. Detailed balance is immediate, and the main spectral result gives GG5, equivalently GG6, with mixing time GG7. Using dynamic forest data structures such as link-cut trees, each step can be implemented in GG8 time, for total runtime GG9; for spanning trees in a sparse graph this becomes kk0 (Anari et al., 2020).

These formulations are closely related but not identical. The component-constrained walk is the one used most directly in balanced partition generation, while the edge-constrained walk is the setting in which the strongest general mixing and implementation guarantees are presently available.

2. Balanced splittability and the BUD walk

The balance constraint is imposed on spanning trees rather than arbitrary forests. Fix an integer kk1 and tolerance kk2. A spanning tree kk3 of kk4 is kk5-balanced kk6-splittable if there exist kk7 edges whose removal produces kk8 connected components, each with total population in

kk9

where (nk)(n-k)0 are vertex weights and (nk)(n-k)1. The state space of the Balanced Up-Down walk is denoted (nk)(n-k)2, the set of (nk)(n-k)3-balanced (nk)(n-k)4-splittable spanning trees (Akitaya et al., 12 Feb 2026).

From (nk)(n-k)5, the BUD kernel draws a uniformly random edge (nk)(n-k)6, forms the unique cycle (nk)(n-k)7 in (nk)(n-k)8, and then restricts deletion to those (nk)(n-k)9 for which FFkF\in F_k0 remains in FFkF\in F_k1. Among those admissible edges, FFkF\in F_k2 is chosen uniformly, and FFkF\in F_k3 becomes the next state. By symmetry,

FFkF\in F_k4

so the uniform distribution on FFkF\in F_k5 is stationary; if the chain is irreducible, this stationary law is unique (Akitaya et al., 12 Feb 2026).

The motivation is algorithmic as well as statistical. In tree-based redistricting, one seeks a large ensemble of random graph partitions by drawing and splitting random spanning trees. Under exact or near-exact population balance, rejection sampling from unconstrained tree or forest walks becomes inefficient: the rejection rate needed to maintain balance grows exponentially with the number of parts. ReCom circumvents this barrier by merging and splitting pairs of districts at a time, which runs fast in practice, but it can have trouble exploring the state space. BUD addresses both issues by preserving splittability at every step and by sampling from a known invariant measure under exact balance (Akitaya et al., 12 Feb 2026).

A common misunderstanding is that balance can be appended as a minor accept-reject correction to any local forest walk without materially changing the chain. The available results point in the opposite direction: once balance is enforced, the admissible state space and the move set become the primary mathematical objects.

3. Stationarity, irreducibility, and mixing phenomena

For the unconstrained basis-exchange walk on FFkF\in F_k6, irreducibility and aperiodicity are automatic consequences of matroid exchange, and reversibility gives a uniform stationary distribution (Akitaya et al., 12 Feb 2026). The constrained BUD walk is more delicate. Under exact balance, FFkF\in F_k7, every tree FFkF\in F_k8 has a unique set of FFkF\in F_k9 split edges; writing this edge set as eEE(F)e\in E\setminus E(F)0, two trees eEE(F)e\in E\setminus E(F)1 with the same induced partition eEE(F)e\in E\setminus E(F)2 satisfy an internal rearrangement lemma: one can go from eEE(F)e\in E\setminus E(F)3 to eEE(F)e\in E\setminus E(F)4 in at most eEE(F)e\in E\setminus E(F)5 BUD steps while staying within eEE(F)e\in E\setminus E(F)6 at each step (Akitaya et al., 12 Feb 2026).

Irreducibility is proved in several special cases. For eEE(F)e\in E\setminus E(F)7 on simple grid graphs, if eEE(F)e\in E\setminus E(F)8 is a simply connected subgraph of the square lattice whose boundary is a simple cycle and eEE(F)e\in E\setminus E(F)9, then BUD is irreducible on the set of trees that split into components of sizes FF0 and FF1, and the diameter is FF2. The proof sketch represents each tree by its “column-components,” eliminates “sandwiched leaves” by local BUD moves, and rotates the boundary transition until any two partitions coincide. For triomino tilings, if FF3 is an FF4 rectangle with FF5 and FF6, then BUD is irreducible on FF7; the proof sketch reduces any FF8-omino tiling to the all-horizontal tiling in FF9 BUD moves by a finite case analysis on the first non-horizontal cell. At the same time, irreducibility fails in general: there exists an induced grid graph with holes and cut-vertices on which BUD is not irreducible, even for CC0 (Akitaya et al., 12 Feb 2026).

No rigorous mixing-time bound is yet known for BUD. Empirically, its autocorrelation behavior is similar to the unconstrained Up-Down walk. This leaves a characteristic asymmetry in the theory: the invariant law is explicit, and irreducibility is established in several regimes, but general quantitative convergence remains open (Akitaya et al., 12 Feb 2026).

The literature therefore distinguishes sharply between two questions that are often conflated: whether the chain is connected on the constrained state space, and how rapidly it mixes once connected. For BUD, the former is partially resolved, the latter is not.

4. Deciding approximate splittability and the hardness of conditional sampling

The key algorithmic subroutine for BUD is the decision problem of whether a given tree is CC1-balanced CC2-splittable. In the formulation called TAPP, the input is a tree CC3 with vertex weights summing to CC4, an integer CC5, and a tolerance CC6; the question is whether CC7. This decision problem is solvable in polynomial time (Akitaya et al., 12 Feb 2026).

The algorithmic basis is a dynamic program due to Ito–Uno–Zhou–Nishizeki (2008). Root CC8 at an arbitrary vertex. For each vertex CC9 and V=n|V|=n00, define V=n|V|=n01 to be the set of possible surplus weights of the partial district containing V=n|V|=n02 if one partitions the subtree V=n|V|=n03 into V=n|V|=n04 valid districts plus one leftover piece. To keep these sets polynomially bounded, replace V=n|V|=n05 by its V=n|V|=n06-closure V=n|V|=n07, which is a union of V=n|V|=n08 intervals. The recursion combines children by taking Minkowski sums of their V=n|V|=n09 sets, cropping to V=n|V|=n10, and then applying V=n|V|=n11-closure again. At the root, one checks whether V=n|V|=n12. The naive runtime is V=n|V|=n13 (Akitaya et al., 12 Feb 2026).

The improved analysis proves that for any V=n|V|=n14, V=n|V|=n15 has at most V=n|V|=n16 connected components. Amortizing interval merges yields an V=n|V|=n17 runtime in general, and V=n|V|=n18 when V=n|V|=n19. The underlying reason is that near leaves the number of connected components is proportional to subtree size, so expensive merges occur only near the root (Akitaya et al., 12 Feb 2026).

Counting and conditional sampling are harder. Fix V=n|V|=n20 and an edge V=n|V|=n21. Computing the probability that a uniformly random V=n|V|=n22-balanced V=n|V|=n23-partition of V=n|V|=n24 cuts V=n|V|=n25 is V=n|V|=n26-complete. The proof reduces from counting V=n|V|=n27 Knapsack solutions by constructing a caterpillar tree whose leaf branches have weights proportional to item sizes V=n|V|=n28, together with two large root branches; then the probability that V=n|V|=n29 is split equals

V=n|V|=n30

This hardness result explains why the natural edge-by-edge sampling strategy—deciding at each step whether to remove or contract an edge according to the correct conditional probability—does not yield an efficient exact sampler, even after splittability has been decided (Akitaya et al., 12 Feb 2026).

5. Empirical behavior on grids and redistricting instances

Empirical tests in the BUD study serve two distinct purposes: validating the invariant law on small instances and comparing autocorrelation behavior against alternative partition samplers on larger ones (Akitaya et al., 12 Feb 2026).

On the V=n|V|=n31 grid with V=n|V|=n32 under exact balance, BUD exactly recovers the uniform splittable-tree distribution. On the V=n|V|=n33 grid with V=n|V|=n34, where districts have size V=n|V|=n35 or V=n|V|=n36, the Cycle Walk fails to connect all partitions, but BUD mixes rapidly, with total-variation distance tending to V=n|V|=n37. On the V=n|V|=n38 grid with V=n|V|=n39, under their respective natural target measures, BUD makes approximately V=n|V|=n40 “internal” proposals, meaning proposals within a part, and V=n|V|=n41 “external” proposals, meaning proposals spanning cuts. When the Cycle Walk is tuned to the same V=n|V|=n42- versus V=n|V|=n43-tree frequencies, BUD’s autocorrelation on key observables decays roughly twice as fast per non-internal step, and its effective sample rate is approximately V=n|V|=n44 higher, although the per-iteration cost is approximately V=n|V|=n45 larger in unoptimized code (Akitaya et al., 12 Feb 2026).

A separate comparison considers the unconstrained Up-Down walk and BUD on an V=n|V|=n46 grid with V=n|V|=n47, using tree diameter as the observable. Their autocorrelations and effective sample rates are nearly identical for this metric, despite BUD’s much smaller state space. This suggests that the balance constraint need not degrade local mixing behavior on all observables, although no theorem currently formalizes that observation (Akitaya et al., 12 Feb 2026).

In North Carolina redistricting with V=n|V|=n48 districts and V=n|V|=n49 tolerance, BUD, which is uniform on splittable trees, is compared with Linked-Forest ReCom, which is uniform on forests. The ordered distribution of 2020 Presidential vote share in each district is tracked. Both chains converge to similar marginals, and BUD has comparable mixing. Under its stationary measure, BUD tends to produce more cut edges, hence less “compact” trees, than uniform-forest ReCom; this is reported as expected from the stationary laws (Akitaya et al., 12 Feb 2026).

These experiments do not constitute a general mixing theorem, but they delineate the tradeoff that currently defines the method: stronger structural control over balance, at the cost of a more expensive move.

6. Dense random graphs, rejection sampling, and the ReCom comparison

A complementary line of work studies the up-down walk on balanced forests in dense random graphs. Here the state space is

V=n|V|=n50

From V=n|V|=n51, the chain picks uniformly an edge V=n|V|=n52 joining two distinct components of V=n|V|=n53, adds it to obtain a forest with V=n|V|=n54 components, then removes a uniformly random edge V=n|V|=n55 from the resulting forest. There are no further Metropolis-Hastings rejections. The chain is irreducible and aperiodic on V=n|V|=n56, and its unique stationary distribution is uniform over V=n|V|=n57 (Gillman et al., 17 Jul 2025).

For fixed V=n|V|=n58, the quoted mixing bound is

V=n|V|=n59

with spectral gap V=n|V|=n60 for some absolute V=n|V|=n61. This leads to a rejection sampler for balanced forests: run the chain for V=n|V|=n62 steps to near stationarity, test whether each of the V=n|V|=n63 connected components has exactly V=n|V|=n64 vertices when V=n|V|=n65, and restart otherwise. If

V=n|V|=n66

then the expected number of restarts is V=n|V|=n67 (Gillman et al., 17 Jul 2025).

The key bridge to tree splittings is an equivalence between balanced V=n|V|=n68-forests and V=n|V|=n69-splittable spanning trees. Let

V=n|V|=n70

and let V=n|V|=n71 denote the probability that a uniform random V=n|V|=n72-forest under the up-down walk is balanced. For constant V=n|V|=n73,

V=n|V|=n74

with explicit bounds

V=n|V|=n75

In the dense random graph model V=n|V|=n76, with V=n|V|=n77, V=n|V|=n78, and V=n|V|=n79, the splitting probability satisfies

V=n|V|=n80

and consequently V=n|V|=n81. The same conclusion transfers to V=n|V|=n82 under the same density assumption and conditioning on connectedness. In that regime, the rejection sampler runs in overall polynomial time (Gillman et al., 17 Jul 2025).

The comparison with ReCom is explicit. ReCom-style chains choose two adjacent districts, recombine them into one region, sample a uniform spanning tree of that region, and split it by removing one edge. The dense-random-graph analysis emphasizes three limitations: the state space can be disconnected when perfect balance is enforced, no general polynomial-time mixing-time bound is known, and even allowing slack of one node per district can lead to exponentially small acceptance probabilities when splitting. By contrast, the up-down walk on V=n|V|=n83 is irreducible and aperiodic for every graph, and when balanced forests occur with inverse-polynomial probability—as they do in dense random graphs—it yields a provably polynomial-time approximate sampler for balanced forests under the spanning-tree weight (Gillman et al., 17 Jul 2025).

The resulting picture is nuanced rather than uniform. Unconstrained up-down walks on forest state spaces are among the best-understood local samplers in this area; balance-preserving variants such as BUD repair the rejection barrier and some irreducibility failures of pairwise recombination methods, but they shift the main open problems toward constrained connectivity and quantitative mixing.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Up-Down Walk on Forests.