---
title: 'ReVQom: Efficient Codec for Collaborative Perception'
url: https://www.emergentmind.com/topics/revqom
type: topic
---

# ReVQom: Efficient Codec for Collaborative Perception

Searching arXiv for the cited ReVQom paper and closely related collaborative-perception baselines to ground the article.
ReVQom is a learned feature codec for multi-agent collaborative perception (CP) that preserves spatial identity while compressing intermediate features for transmission across connected agents such as autonomous vehicles, unmanned aerial vehicles, and robots. It is presented as an end-to-end method that compresses feature dimensions via a simple bottleneck network followed by multi-stage residual vector quantization (RVQ), so that only per-pixel code indices are transmitted rather than full intermediate features [2509.21464]. Within BEV-based CP, the method is designed to reduce the communication burden of sharing rich intermediate representations while retaining the spatial structure needed for downstream fusion and detection. On the DAIR-V2X real-world CP dataset, ReVQom reports compression from 8192 bits per pixel (bpp) of uncompressed 32-bit float features to 6–30 bpp per agent, corresponding to 273x compression at 30 bpp and 1365x compression at 6 bpp, with minimal accuracy loss [2509.21464].

## 1. Problem setting and design objective

Multi-agent collaborative perception seeks to improve scene understanding by sharing information across connected agents. In the stated application setting, collaboration improves detection especially in occluded or long-range scenarios by fusing information from different vantage points, including roadside units and vehicles [2509.21464]. The central systems problem is that communication bandwidth constrains scalability: transmitting high-dimensional Bird’s Eye View features from each agent can exceed practical V2X channel budgets.

ReVQom is proposed to address this bottleneck by compressing spatial feature representations aggressively enough to enable ultra-low-bandwidth communication without sacrificing collaborative perception quality [2509.21464]. The method specifically targets the case where raw feature transmission is prohibitively expensive: the paper identifies uncompressed features as 8192 bpp, arising from 32 bits times 256 channels, and contrasts this with compressed operating points between 6 and 30 bpp [2509.21464]. This framing places ReVQom within the broader line of BEV-based collaborative perception systems such as CoBEVT, F-Cooper, V2X-ViT, and Where2comm, which are discussed in the reported comparisons [2509.21464].

A notable aspect of the formulation is that ReVQom is not described as a generic scene codec. It is a feature codec tailored to intermediate representations used for multi-agent fusion. The emphasis on preserving spatial identity distinguishes the method from approaches that trade away the explicit spatial arrangement of features, which the paper argues is crucial for downstream fusion and detection in BEV [2509.21464].

## 2. Architectural formulation

At the architectural level, ReVQom consists of two principal components: a spatial bottleneck network and a multi-stage RVQ module [2509.21464]. The bottleneck first reduces channel dimensionality while preserving the spatial layout. Concretely, each agent applies a \(1\times1\) convolution to map the BEV feature tensor from \(C\) channels to \(C_r\), with \(C_r \ll C\), followed by Group Normalization [2509.21464]. Because the operation is pointwise in the spatial dimensions, the \(H \times W\) layout is preserved.

The reduced feature at each pixel location is then processed by multi-stage residual vector quantization. Each stage uses a learned codebook of size \(K\). The quantizer searches for the nearest codeword to the current residual, beginning with the bottleneck feature itself, and encodes its index. The selected codeword is subtracted from the residual, and the process repeats for the prescribed number of stages \(n_q\) [2509.21464]. This residual decomposition allows the transmitted representation to be a sequence of discrete indices per pixel rather than a dense floating-point vector.

The sender-receiver protocol is correspondingly simple. The sender takes an input BEV feature map \(F\) of size \(H \times W \times C\), applies \(1\times1\) Conv + GroupNorm to obtain \(F_r\) of size \(H \times W \times C_r\), then for each pixel and RVQ stage finds the nearest codebook entry and transmits the codebook index \(k\) [2509.21464]. The output is therefore a per-pixel sequence of indices \(\{k^{(0)}, \ldots, k^{(n_q-1)}\}\).

At the receiver, reconstruction is obtained by summing the corresponding stagewise codewords,
\[
z_q = \sum_{i=0}^{n_q-1} q^{(i)},
\]
then applying a post-affine transformation, described as another \(1\times1\) convolution followed by ReLU, and finally expanding channels back to the original size \(C\) to recover a reconstructed BEV feature for fusion [2509.21464]. Codebooks are updated during training using Exponential Moving Average (EMA), which the paper describes as providing stability and consistency across agents [2509.21464].

## 3. Rate, compression, and transmitted representation

The communication model is expressed directly in terms of codebook indices. Because each pixel transmits one index per RVQ stage, the compressed bit rate in bits per pixel is
\[
\text{bpp} = n_q \times \log_2 K,
\]
and the transmission cost per agent is
\[
R = H \times W \times n_q \times \log_2 K.
\]
The uncompressed reference cost is \(32 \times C \times H \times W\), reflecting 32-bit floating-point features with \(C\) channels [2509.21464].

The compression ratio is correspondingly defined as
\[
\text{Compression ratio} = \frac{\text{Uncompressed bpp}}{\text{Compressed bpp}},
\]
with uncompressed bpp given by \(32 \times C\) and compressed bpp given by \(n_q \times \log_2 K\) [2509.21464]. For the reported BEV setting, the uncompressed baseline is 8192 bpp, and the compressed operating points are as follows [2509.21464]:

| Setting | bpp | Compression |
|---|---:|---:|
| ReVQom-\(\mu\) (\(K=4\)) | 6 | 1365x |
| ReVQom-T (\(K=16\)) | 12 | 683x |
| ReVQom-S (\(K=64\)) | 18 | 455x |
| ReVQom-M (\(K=256\)) | 24 | 341x |
| ReVQom-L (\(K=1024\)) | 30 | 273x |

These figures encapsulate the core operating trade-off of the method: the communication payload is controlled by the number of RVQ stages and codebook size, while detection accuracy depends on whether the resulting reconstruction preserves the downstream semantics needed for collaborative fusion [2509.21464]. A plausible implication is that ReVQom treats communication as a structured discrete coding problem rather than as sparse raw-feature selection.

## 4. Experimental evaluation on DAIR-V2X

The empirical study is conducted on the DAIR-V2X dataset, described as a multi-view LiDAR benchmark with vehicle and roadside-unit observations and ground-truth 3D labels [2509.21464]. ReVQom is integrated into CoBEVT as a modular compressor [2509.21464]. The principal detection metrics reported are \(AP@0.3\) and \(AP@0.5\).

The paper compares ReVQom against prior CP methods with substantially higher bandwidth. The reported results are:

| Method | bpp | Compression | AP@0.3 | AP@0.5 |
|---|---:|---:|---:|---:|
| F-Cooper (raw) | 8192 | 1x | 0.704 | 0.648 |
| V2X-ViT | 6144 | 1.3x | 0.745 | 0.676 |
| Where2comm | 512 | 16x | 0.701 | 0.634 |
| ReVQom-\(\mu\) | 6 | 1365x | 0.690 | 0.558 |
| ReVQom-T | 12 | 683x | 0.699 | 0.609 |
| ReVQom-S | 18 | 455x | 0.747 | 0.651 |
| ReVQom-M | 24 | 341x | 0.753 | 0.666 |
| ReVQom-L | 30 | 273x | 0.725 | 0.636 |

Several points are explicit in these results. First, at 18 bpp, ReVQom-S achieves 455x compression with \(0.747\) \(AP@0.3\), which the paper states outstrips all prior methods, including methods using essentially uncompressed features [2509.21464]. Second, at 24 bpp, ReVQom-M attains the highest reported \(AP@0.3\) of \(0.753\) and \(AP@0.5\) of \(0.666\) among the listed methods [2509.21464]. Third, even the ultra-low-bandwidth settings of 6–12 bpp remain competitive, with \(AP@0.3\) between \(0.690\) and \(0.699\), which the paper characterizes as graceful degradation [2509.21464].

The article’s central comparative claim is therefore not merely that ReVQom compresses more strongly, but that at moderate compressed rates it matches or exceeds the collaborative detection accuracy of earlier systems while operating at one to two orders of magnitude lower transmission budgets [2509.21464].

## 5. Codebook behavior and ablation findings

The ablation study isolates several design choices: EMA decay rate, number of quantization stages, channel reduction ratio, and codebook size [2509.21464]. These analyses are presented as technical evidence for the selected operating configuration rather than as independent algorithmic variants.

For EMA, the paper reports that a lower decay rate of \(0.8\) outperforms the standard \(0.99\), which is interpreted as indicating that faster codebook adaptation helps in highly dynamic, multi-agent settings [2509.21464]. For quantization depth, three-stage RVQ, \(n_q=3\), gives top performance, while more stages, such as four, produce diminishing returns [2509.21464]. For channel reduction, the best result is obtained at reduction ratio \(C_{rr}=16\), while more aggressive compression degrades accuracy sharply [2509.21464]. For codebook size, \(K=64\) is identified as optimal in balancing bandwidth and accuracy, whereas \(K=1024\) is reported to lead to overfitting and reduced AP [2509.21464].

The paper also analyzes codebook assignment patterns. At low \(K\), most indices encode only background; for example, code 0 covers 96–98% of space, while the remaining codes are used for foreground semantics [2509.21464]. This observation is presented as evidence that the codec leverages both spatial and channel redundancy. In practical terms, large portions of the BEV map can be represented by a small set of background assignments, while semantically salient regions consume the higher-information code usage. This suggests that the gains are not solely attributable to numeric compression, but to the alignment between scene structure and discrete code allocation.

A common misconception would be to interpret the highest codebook size as necessarily best. The reported ablations contradict this: \(K=1024\) at 30 bpp underperforms the 24 bpp setting with \(K=256\), and the paper explicitly attributes this to diminished returns and possible overfitting [2509.21464].

## 6. Relation to collaborative perception practice and deployment constraints

ReVQom is described as a drop-in replacement for existing BEV-based collaborative networks such as CoBEVT [2509.21464]. Its practical appeal derives from the communication protocol: only index streams are transmitted, while codebooks are pre-shared and synchronized across agents [2509.21464]. This protocol is well matched to V2X systems where communication bandwidth is limited but maintaining shared model state is feasible.

The deployment discussion in the paper identifies several practical implications. First, the index-based communication scheme allows operation within realistic V2X channel budgets, even as the number of agents scales up [2509.21464]. Second, the reported accuracy retention under strong compression makes the method relevant for safety-critical, real-time collaborative applications [2509.21464]. Third, orders-of-magnitude bandwidth savings may permit inclusion of more agents and larger operational areas without exceeding communication constraints [2509.21464].

The same discussion also makes clear that these advantages depend on assumptions that can become constraints. Codebook synchronization is required across all agents, and the paper notes that codebook drift or misalignment in deployment requires handling [2509.21464]. Likewise, sudden changes in agent population or scene layout may pose difficulties, even though the improved EMA setting is reported to help with dynamic environments [2509.21464]. Extreme channel reduction is also explicitly identified as harmful, implying that spatial quantization and channel reduction must be balanced rather than optimized independently [2509.21464].

These points situate ReVQom as a systems-oriented compression method rather than a purely representational innovation. Its relevance depends on the end-to-end communication-fusion loop in collaborative perception, particularly in V2X deployment scenarios.

## 7. Limitations, interpretation, and research directions

The limitations reported for ReVQom are specific and operational. The first is the requirement for pre-shared and synchronized codebooks across all agents [2509.21464]. The second is that extreme reduction in channels severely degrades performance, showing that the bottleneck cannot be made arbitrarily narrow without impairing detection [2509.21464]. The third is that dynamic topologies and sudden scene changes could create difficulties despite the benefits of faster EMA adaptation [2509.21464].

The future directions named in the paper follow directly from these constraints. They include dynamic quantization or adaptive codebooks, on-the-fly codebook updates, adaptive bit allocation depending on scene content or agent topology, investigation of transmission errors, packet loss, and latency in the coded index stream, and extension to broader datasets or heterogeneous sensor settings [2509.21464]. These are not presented as solved problems.

From the reported evidence, a plausible implication is that ReVQom’s main contribution is to make discrete, index-based feature transmission viable at rates far below those typically used in collaborative perception, while retaining the explicit BEV spatial structure required by downstream fusion. Another plausible implication is that the method’s strongest empirical regime is not the most extreme compression point, but the mid-range operating points, especially 18–24 bpp, where the bandwidth reduction remains several hundredfold and the detection performance is strongest [2509.21464]. In that sense, ReVQom is best understood as a practical communication-accuracy trade-off mechanism for multi-agent perception rather than as a universally optimal low-rate codec.

Source: https://www.emergentmind.com/topics/revqom