SCIONLab Testbed: Global Path-Aware Research
- SCIONLab Testbed is a global research environment composed of SCION Autonomous Systems organized into Isolation Domains, interconnected via up-, core-, and down-segment links.
- Measurement studies on the testbed reveal key metrics such as path churn, forward/reverse asymmetry, and throughput-latency trade-offs, informing improvements in multipath protocols like MPQUIC.
- The platform supports both geographically distributed and co-located experimental setups to enable controlled studies of path diversity, lifetime, and the impact of multipath forwarding.
SCIONLab Testbed is a deployed research environment for path-aware networking in which SCION Autonomous Systems are organized into multiple Isolation Domains and interconnected by up-, core-, and down-segment links. Recent measurement studies use it both as a global overlay visible at the scale of some 30–40 ASes across five continents and as a controlled experimental substrate for longitudinal observation of path discovery, control-plane churn, path lifetime, forward/reverse asymmetry, and concurrent multipath behavior. In that role, the testbed has become a reference platform for evaluating protocol assumptions behind mechanisms such as Multipath QUIC (MPQUIC), particularly the assumptions of path stability, bidirectional symmetry, and monotonic gains from additional subflows (Herschbach et al., 4 Sep 2025, Rossi et al., 8 Sep 2025).
1. Topology, scope, and deployment variants
SCIONLab is described as a global research overlay comprising dozens of SCION Autonomous Systems organized into multiple Isolation Domains (ISDs) and interconnected by a full-mesh of up-, core-, and down-segment links. At the time of one measurement study, the testbed spanned ASes in at least three distinct ISDs—ISD 19 (central Europe), ISD 17 (Switzerland), and ISD 18 (United States)—with peering at multiple Internet exchange points. The same study notes that the SCIONLab “Figure 1” topology map shows some 30–40 ASes across five continents (Herschbach et al., 4 Sep 2025).
Two recent deployments exemplify different experimental uses of the testbed. One study originated active measurements from three co-located Google Cloud VMs, each hosting a user AS in one of the three target ISDs; the VMs were co-located in us-central1 to minimize artifacts from heterogeneous IP-transit links and to isolate SCION control- and data-plane behaviors (Herschbach et al., 4 Sep 2025). Another study deployed four SCIONLab hosts as Google Cloud e2-medium instances, each configured as a full SCION AS, with identifiers 1-ff00:0:110 (Europe), 1-ff00:0:120 (North America), 1-ff00:0:130 (Switzerland), and 1-ff00:0:140 (Taiwan). That configuration used one node per major region to maximize path diversity (Rossi et al., 8 Sep 2025).
The interconnection model in the four-node deployment relied on SCIONLab’s global backbone, with core ASes in Zurich, Munich, Boston, and Singapore. SCION data-plane traffic was carried over the public Internet through IP-in-UDP tunnels, and end-to-end paths traversed 2–5 AS hops depending on the endpoint pair (Rossi et al., 8 Sep 2025). Taken together, these deployments indicate that SCIONLab functions simultaneously as a geographically distributed operational substrate and as a controllable measurement target. This suggests that results obtained on the testbed can reflect both intrinsic SCION path dynamics and deployment-dependent artifacts introduced by vantage-point selection.
2. Architectural components and forwarding model
The control plane in the standard SCIONLab configuration includes beacon servers, path servers, and certificate servers. Beacon servers, one per local core AS, distribute up/down-segments. Path servers cache segments for remote ASes. Certificate servers publish AS certificates and TRCs (Rossi et al., 8 Sep 2025). These components define the discoverability and availability of path segments, and therefore directly condition any measurement of path churn or asymmetry.
The data plane is implemented through SCION border routers, which handle per-packet MAC checks and forward traffic along the selected path segment. In the four-node study, multipath forwarding was enabled via the mp-prober and mp-bandwidth scripts, but it ultimately used the same SCION data-plane (Rossi et al., 8 Sep 2025). This is operationally significant because any degradation observed under concurrent subflows cannot be separated from the underlying forwarding substrate merely by invoking a multipath tool; the forwarding path still traverses the same border-router logic and the same overlay links.
A common misconception is that path-aware forwarding by itself implies stable and symmetric route availability. The measurement evidence does not support that interpretation. The control plane advertises, filters, and caches path segments, while the data plane forwards only on the paths currently exposed to endpoints. As a result, the testbed exhibits path-set volatility and forward/reverse mismatch even when endpoints operate within the same deployed architecture (Herschbach et al., 4 Sep 2025).
3. Measurement workflows and data collection
One longitudinal campaign ran for four weeks over the period July 11–August 11, 2025, with analysis focused on the stable window July 16–August 11. Its suite executed every 30 minutes and consisted of pathdiscover, comparer, prober, mp-prober, bw-alldiscover, and bw-multipath. In that pipeline, pathdiscover invoked scion showpaths to enumerate all end-to-end SCION paths to each remote AS; comparer logged “add” and “remove” events by comparing successive path sets; prober used scion ping over a random sample of up to 15 distinct paths; mp-prober issued three concurrent scion ping streams over disjoint paths; and bw-alldiscover / bw-multipath used scion-bwtestclient on up to two simultaneous paths per destination (Herschbach et al., 4 Sep 2025).
A second campaign ran for 28 days with a 30-minute interval between measurement cycles via cron. Each cycle included seven enabled measurement types: path discovery with scion showpaths, path stability tracking with comparer, unipath bandwidth with scion-bwtestclient at 10 Mbps, 50 Mbps, and 100 Mbps targets, concurrent bandwidth with mp-bandwidth, unipath latency with scion ping, concurrent latency with mp-prober, and path analysis with scion traceroute to obtain per-hop RTT vectors. The per-cycle collection pipeline executed SCION CLI tools in sequence, emitted JSON records containing timestamp, source AS, destination AS, path fingerprint, measurement parameters, and raw results, rotated logs into archives/ and current/, and periodically ran scionpathml convert-json-to-csv to produce ML-ready tables (Rossi et al., 8 Sep 2025).
The scale of the four-node campaign is explicitly quantified. With 28 days and 48 cycles per day, it produced 1,344 measurement cycles per AS-pair. With 4 AS nodes, there were 12 distinct ordered AS–AS pairs, yielding approximately 16,128 total path-discovery events (Rossi et al., 8 Sep 2025). The three-VM study reports N=1,281 half-hour intervals for its two primary destinations (Herschbach et al., 4 Sep 2025). These designs show two complementary methodological choices: geographically distributed measurement to maximize path diversity, and co-located measurement to suppress underlay heterogeneity. A plausible implication is that SCIONLab supports both ecological observation and controlled isolation of specific control-plane effects.
4. Formal metrics used to characterize the testbed
The studies formalize SCIONLab dynamics through several related metrics. In one formulation, if is the set of available paths at time , then the path change over an interval is
where denotes symmetric difference, and the instantaneous churn rate is
Over the whole campaign, the average churn rate is
A second operationalization defines the control-plane churn rate as
with and the total numbers of path additions and removals over measurement duration 0 in hours; an AS-pair–specific form is written as
1
Both papers therefore treat churn as the time-normalized intensity of path-set change, even though one is defined from set differences and the other from logged add/remove events (Herschbach et al., 4 Sep 2025, Rossi et al., 8 Sep 2025).
Path lifetime is measured per fingerprint. For each distinct path fingerprint 2, let 3 be the time between first and last observation, with empirical CDF
4
where 5 is the total number of unique fingerprints observed. The related study using comparer logs defines path lifetime 6 for path 7 as the elapsed time between first appearance and subsequent disappearance, and models survival through
8
The exponential model is reported to capture the heavy tail of the lifetime distribution over medium time scales (Herschbach et al., 4 Sep 2025, Rossi et al., 8 Sep 2025).
Forward/reverse asymmetry is also formalized in two ways. One study defines path-set discrepancy through the Jaccard distance
9
where 0 denotes perfect symmetry and 1 denotes no shared fingerprints. The other defines
2
These are distinct but related measures of directional mismatch: 3 normalizes overlap by union size, while 4 counts non-overlapping elements directly (Herschbach et al., 4 Sep 2025, Rossi et al., 8 Sep 2025).
For performance, the single-path metrics are measured bandwidth 5 and RTT 6, while for two concurrent subflows on paths 7 the throughput and latency are expressed as
8
where 9 captures interference, and
0
where 1 denotes added jitter due to resource contention. The other study reports aggregate throughput as 2 and packet delivery ratio as
3
These definitions jointly frame SCIONLab as a testbed in which path availability and path quality are both stochastic objects subject to direct measurement (Herschbach et al., 4 Sep 2025, Rossi et al., 8 Sep 2025).
5. Empirical path diversity, lifetime, and asymmetry
Across the four-node deployment, the aggregated path statistics indicate moderate diversity and nontrivial instability. The reported average number of distinct paths per ordered AS-pair is 3.4. The median path lifetime is approximately 8 hours, the 90th percentile lifetime is approximately 24 hours, and the average churn rate is 0.12 changes per hour, interpreted as roughly one change every 8 hours. The median forward/reverse Jaccard distance is 0.28, corresponding to approximately 72% path-set overlap between forward and reverse directions (Rossi et al., 8 Sep 2025).
| Metric | Value | Context |
|---|---|---|
| Avg. distinct paths per pair | 3.4 | Moderate path diversity |
| Median path lifetime | 4 hours | Half of paths persist beyond 8 h |
| 90th percentile lifetime | 5 hours | Most stable paths last at least 1 day |
| Avg. churn rate | 0.12 changes/hour | Approximately 1 change every 8 h |
| Median Jaccard distance 6 | 0.28 | Approximately 72% forward/reverse overlap |
The path-discrepancy phenomenon is characterized more explicitly in the same study. The distribution of 7 across pairs is described as roughly Gaussian around 0.3 with 8, and higher discrepancy correlates with higher churn: pairs with 9 exhibit 0 changes per hour. The interpretation given is that endpoints must independently discover and monitor both directions to ensure correct multipath operation (Rossi et al., 8 Sep 2025).
The three-VM study reports substantially higher event-based churn for two primary destinations. For destination 17-ffaa:1:11e4, it observed A=557 additions and R=577 removals over T=640.5 h, giving 1 events per hour and empirical average path lifetime 2 h. For destination 18-ffaa:1:11e5, it observed A=1,254 and R=1,259, giving 3 events per hour and mean lifetime 4 h. Figure 2’s histogram is reported to show that nearly 80% of all paths lasted less than 100,000 s, approximately 27 h, and the exponential model is said to capture the heavy tail of the lifetime distribution (Herschbach et al., 4 Sep 2025).
Directional asymmetry is also directly observed in path counts. In one sample, AS-3 saw 20 distinct SCION paths to AS-2, while AS-2 saw only 18 towards AS-3, yielding 5. Across the measurement suite, asymmetric path counts appeared in roughly 15% of all 30-minute intervals, persisted for hours at a time, and were attributed to per-AS path filtering policies in SCION’s control plane rather than transient failures; no one-to-one correlation was observed with external topology events such as underlay link flaps (Herschbach et al., 4 Sep 2025). This result directly contradicts the common assumption that path-aware routing should expose the same path opportunities in both directions.
6. Multipath contention, throughput aggregation, and protocol consequences
The testbed measurements show a consistent throughput–latency trade-off under concurrent subflows. In the four-node study, mean single-path throughput was 54 Mbps with mean RTT 42 ms, loss 0.6%, and jitter 2.1 ms. Under two-path concurrent transmission, mean throughput increased to 98 Mbps, while mean RTT increased to 48 ms, loss to 0.8%, and jitter to 3.7 ms. The same study reports an aggregate throughput versus latency curve for 1 to 3 concurrent subflows, with diminishing returns after 2 subflows (Rossi et al., 8 Sep 2025).
A separate study examined mp-prober with n=3 subflows, each pinned to a different control-plane–discovered path. Under single-path conditions, a path typically yielded median RTT approximately 410 ms, jitter approximately 5 ms, and packet loss approximately 0.5%. Under multipath conditions, each constituent subflow experienced median 6 ms, 7 ms, and additional packet loss 8. At the same time, the combined throughput 9 consistently exceeded the fastest single-path rate by 20–30%. The latency penalty was summarized empirically as
0
which captures the roughly linear increase in latency with added subflows (Herschbach et al., 4 Sep 2025).
Both studies attribute the performance degradation to contention effects rather than to a failure of path discovery. One reports that 1, the cross-path interference term, is typically less than 10% of 2 when RTT differences are less than 10 ms, and recommends per-path congestion windows with occasional resequencing buffers if 3 ms (Rossi et al., 8 Sep 2025). The other suggests shared queuing points either at the VM’s NIC or within common SCIONLab overlay links as the likely source of the observed RTT, jitter, and loss inflation (Herschbach et al., 4 Sep 2025). The convergence of these observations indicates that multipath benefits on SCIONLab are real but not free: bandwidth aggregation is accompanied by measurable per-path quality degradation.
These measurements lead to concrete protocol recommendations for MPQUIC and related multipath transports. One study recommends tuning subflow lifetime to the median path lifetime with idle_timeout ≈ L_{50} / 2 ≈ 4 h, triggering proactive path rediscovery at approximately 4 h, probing chosen subflows every 30 minutes for latency and loss, limiting concurrent subflows to M=2, adapting congestion windows independently per path, and monitoring forward/reverse discrepancy with re-pairing if 5\tau_{\text{probe}} \le \bar{T}/36\tau_{\text{retire}} \approx 17k<n8R_{\text{total}}9\Delta RTT(n)$ below application thresholds (Herschbach et al., 4 Sep 2025).
A broader interpretation follows directly from these findings. SCIONLab does not simply provide multiple paths; it provides multiple paths whose availability, symmetry, and interaction are time-varying. This suggests that any multipath transport evaluated on the testbed must treat the path set as ephemeral, validate both directions explicitly, and optimize over a joint space of throughput, latency, jitter, and loss rather than assuming that additional subflows monotonically improve end-to-end service quality.