Papers
Topics
Authors
Recent
Search
2000 character limit reached

LoViC: Disambiguation in Vision & Video Frameworks

Updated 4 July 2026
  • LoViC is an overloaded acronym used across distinct research domains, including long video generation, open-vocabulary object detection, and LiDAR semantic segmentation.
  • It employs varied methodologies such as context compression with FlexFormer for video, localized region-word matching for detection, and confidence-aware point painting for LiDAR fusion.
  • Accurate interpretation of LoViC necessitates disambiguation from similar terms like LocOv, LVIC, and LaViC, each designed for specialized tasks.

Searching arXiv for papers associated with “LoViC” and closely related spellings to disambiguate the term. LoViC is an overloaded label in recent arXiv literature rather than a single canonical method. It denotes, exactly, a framework for efficient long video generation with context compression (Jiang et al., 17 Jul 2025); it is also used in secondary summaries for "Localized Vision-Language Matching for Open-vocabulary Object Detection," whose paper names the method LocOv (Bravo et al., 2022), and it can function as a query-side alias for LVIC, "Lifting Visual Information as Cue," in LiDAR semantic segmentation (Dong et al., 2024). A related but distinct acronym, LaViC, names a framework for visually-aware conversational recommendation and is explicitly not called LoViC in the paper (Jeon et al., 30 Mar 2025). This suggests that any technical discussion of "LoViC" must begin with disambiguation.

1. Nomenclature and disambiguation

The term appears across several unrelated research programs, each in a different problem domain and with a different architectural core.

Usage Expansion or paper title Primary task
LoViC "LoViC: Efficient Long Video Generation with Context Compression" Long video generation
LoViC / LocOv "Localized Vision-Language Matching for Open-vocabulary Object Detection" Open-vocabulary object detection
LoViC / LVIC "LVIC: Multi-modality segmentation by Lifting Visual Info as Cue" LiDAR semantic segmentation
LaViC "Adapting Large Vision-LLMs to Visually-Aware Conversational Recommendation" Conversational recommendation

The ambiguity is partly orthographic. In open-vocabulary detection, the method is described as LoViC in the summary but "called LocOv in the paper" (Bravo et al., 2022). In LiDAR segmentation, the paper name is LVIC, but the query-side alias "LoViC" is explicitly acknowledged in the supplied description (Dong et al., 2024). In conversational recommendation, the clarification is stronger: "The term 'LoViC' does not appear in the paper," and it is best interpreted as a misspelling or informal alias for LaViC (Jeon et al., 30 Mar 2025). Only the long-video paper uses LoViC as the exact title string (Jiang et al., 17 Jul 2025).

2. LoViC as localized vision-language matching for open-vocabulary object detection

In "Localized Vision-Language Matching for Open-vocabulary Object Detection," LoViC refers to a two-stage, vision-language method for open-vocabulary object detection (OVOD) that learns to detect novel object classes from image-caption pairs while also using standard box annotations for a limited set of known classes (Bravo et al., 2022). The problem setup defines a label space L=CknownCnovelL = C_{\text{known}} \cup C_{\text{novel}}, with disjoint known and novel classes, and training data consisting of image-caption pairs plus bounding boxes and labels for known classes only. At test time, the detector must localize and classify both known and novel classes.

The detector architecture is Faster R-CNN (C4) with a ResNet-50 backbone. Stage 1, Localized Semantic Matching (LSM), learns a joint embedding between image regions and caption words using two types of visual regions: OLN-generated box regions, which are object-centric and localized, and grid-region features from the backbone, which capture background and broader context. For a region feature rir_i and token embedding wjw_j, the region-text similarity is defined as s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j. After a word-wise softmax, image-caption similarity is computed by

sim(I,C)=1RIi=1RIj=1WCdi,j(riwj).\mathrm{sim}(I, C) = \frac{1}{|R^I|} \sum_{i=1}^{|R^I|} \sum_{j=1}^{|W^C|} d_{i,j}\,(r_i^\top w_j).

LSM combines contrastive grounding, transformer-based image-caption matching, masked language modeling, and consistency regularization, with the stage objective

LLSM=LG+LICM+LMLM+LCons.\mathbf{L}_{\text{LSM}} = \mathcal{L}_G + \mathcal{L}_{ICM} + \mathcal{L}_{MLM} + \mathcal{L}_{\text{Cons}}.

The method’s distinctive claims center on localization and semantic disentanglement. Location guidance comes from OLN proposals with objectness >0.7> 0.7, pooled with RoI pooling, and is complemented by grid features. The text side uses a simple token embedding module, such as the embedding layer of BERT base-uncased or GloVe, with multi-token class names represented by the average of their token embeddings. The paper reports that this simple, disentangled text embedding empirically outperforms large contextualized LLMs for novel object detection. The stated rationale is that full contextualized encoders produce token representations that are overly context-dependent and therefore less compatible with region-centric single-object alignment.

Stage 2, Specialized Task Tuning (STT), initializes Faster R-CNN and the region-text projection layer from LSM, then fine-tunes using known-class annotations while freezing the first two residual blocks of ResNet-50 and the projection layer. Classification is similarity-based: for a box-region feature rir_i and class text embedding ckc_k, the score is based on dot-product similarity, with background represented by a zero vector and a softmax over known classes plus background during fine-tuning. At inference, the same mechanism can score both known and novel classes by supplying the corresponding text embeddings.

The reported results on COCO 2017, under the generalized validation setting, are Novel AP 16.6 (AP50 28.6), Known AP 31.9 (AP50 51.3), and All AP 28.1 (AP50 45.7). The STT-ZSD baseline, which uses no captions, yields Novel AP 0.03 (AP50 0.05), Known AP 33.0 (AP50 53.1), and All AP 24.4 (AP50 39.2). The paper also reports competitive generalized AP50 relative to large-data methods such as RegionCLIP, ViLD, and XP-Mask, while training on only approximately 0.6M image-caption pairs. On VAW, a long-tailed attribute/object benchmark, LoViC achieves Novel AP 0.67 (AP50 1.42), Known AP 1.21 (AP50 2.31), and All AP 0.91 (AP50 1.77). Ablations attribute gains to the combination of box and grid regions, the consistency regularizer, and the simple token embedding module. The stated failure modes are fine-grained confusion among visually similar categories such as cat versus dog, fork versus knife versus spoon, and couch versus chair or bed, along with difficulty on long-tail classes such as toaster.

3. LoViC as LVIC: lifting visual information as cue for LiDAR semantic segmentation

In the LiDAR segmentation literature, the relevant system is LVIC, "Lifting Visual Information as Cue," a simple, point-centric multi-modality fusion method for LiDAR semantic segmentation that revisits point painting with two targeted improvements (Dong et al., 2024). First, it prioritizes low-level, dense visual features rather than high-level semantic logits. Second, it introduces a depth-aware confidence cue to mitigate projection error between camera and LiDAR, which the authors describe as "the devil" in point painting.

LVIC is organized into a visual encoder, a painting module, and a fusion module. The visual encoder uses EfficientViT-b0 and outputs a low-level texture feature map of shape 16×H/4×W/416 \times H/4 \times W/4 and a dense depth map of shape rir_i0. For each LiDAR point rir_i1, the painting module projects the point into the camera image, samples the predicted depth at the projected pixel, and samples the low-level visual feature at quarter resolution. If projection is invalid, LVIC pads rir_i2 for all painted dimensions. The painted attributes attached to each point are the 2D pixel coordinate rir_i3, the estimated camera depth rir_i4, and a rir_i5-dimensional visual feature rir_i6 with rir_i7 before adaptation. After painting, a point cloud of shape rir_i8 becomes rir_i9.

Fusion is intentionally lightweight. A visual adapter maps wjw_j0 channels with GELU activation. A LiDAR point encoder maps geometry, such as wjw_j1 and optionally intensity, to wjw_j2 channels. A fully connected layer then fuses the adapted visual and geometry features using the painted depth cue to gate the visual contribution. The base LiDAR semantic segmentation backbone in experiments is UDeerPeP. The report presents depth-aware gating as a typical or derived formulation based on the discrepancy between LiDAR depth and image-predicted depth, rather than as an explicit printed equation in the paper.

The central methodological claim is that LiDAR already captures geometry well and benefits more from fine-grained appearance cues such as texture and edges than from high-level semantic logits, especially when projection is imperfect. Depth discrepancy provides a per-point confidence signal for whether a projected visual feature should be trusted. This reframes painting as confidence-aware augmentation rather than a hard visual assignment.

On the nuScenes LiDAR semantic segmentation test set, with test-time augmentation, the baseline PeP model achieves mIoU 81.8 and LVIC achieves mIoU 83.8. Class-wise changes listed in the report include Bicycle 55.5 to 68.7, Bus 90.5 to 95.8, Construction 72.7 to 81.5, Pedestrian 81.4 to 84.3, and Truck 74.0 to 77.1, while some categories decrease slightly, such as barrier 85.5 to 83.7, car 91.6 to 90.3, and trailer 87.3 to 85.7. The report claims that LVIC ranks 1st on the nuScenes LiDAR semantic segmentation leaderboard at the time of writing. Its stated limitations are dependence on calibration and monocular depth quality, errors at far range, occlusion-related ambiguity, sensor desynchronization, and the absence of richer multi-view aggregation or learned uncertainty modeling.

4. LoViC as efficient long video generation with context compression

"LoViC: Efficient Long Video Generation with Context Compression" addresses a different problem entirely: scaling diffusion transformers for minute-level text-to-video generation under the quadratic cost of self-attention (Jiang et al., 17 Jul 2025). The central difficulty is that a clip with wjw_j3 frames and wjw_j4 spatial tokens per frame yields wjw_j5 tokens, so attention scales as wjw_j6. LoViC proposes segment-wise generation with explicit context compression, allowing a model to condition on long histories without feeding the full raw history into the DiT at every step.

Its core module is FlexFormer, described as an expressive autoencoder that jointly compresses video and text into unified latent representations. Each video-text pair is encoded independently, then their compressed tokens are concatenated and passed to the DiT as context. FlexFormer uses a single learnable query token wjw_j7 that is replicated to length wjw_j8 according to the desired compression, with

wjw_j9

where s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j0 is the number of input context tokens and s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j1 is a compression factor that can vary across time. The design replaces Q-Former cross-attention with self-attention so that Rotary Position Embedding can be applied in multi-modal 3D positional spaces. The method further introduces Interpolated-RoPE (I-RoPE), which assigns spatiotemporal positions to replicated query tokens by interpolating from video-token positions. Different interpolation styles correspond to different compression strategies, including uniform, linear, and logarithmic schedules.

The DiT is trained in unified latent space using rectified flow rather than standard DDPM s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j2-prediction. The training loss is

s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j3

with forward interpolation s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j4. Context tokens are concatenated with the current segment’s latent tokens at each self-attention layer, and no extra cross-attention is added. Position-aware encoding is used to distinguish context from the current segment and to support four tasks within one framework: prediction, retrodiction, interpolation, and multi-shot generation.

Training uses million-scale open-domain videos built from Panda-70M, with re-captioning by Qwen2.5-VL-7B and filtering by ViCLIP. The model supports up to 257 frames per generation step and caps full examples at 771 frames. Training is staged: 20K steps for FlexFormer autoencoding with MSE reconstruction, 30K steps for DiT training with randomly sampled prediction, interpolation, and retrodiction, and 10K steps of multi-shot fine-tuning with a temporal gap of 20 latent frames in positional indices. The DiT is approximately 2.3B parameters and uses LTX-Video-V0.9.0 as the base backbone.

The reported single-shot results compare against CausVid, SkyReel-V2, FramePack (13B), and LTX-Video-V0.9.6. Representative LoViC numbers are Prediction: PSNR 15.76, LPIPS 0.316, Subject Consistency 0.981, Background Consistency 0.970, Motion Smoothness 0.996, Aesthetic Quality 0.485, Video-text Alignment 0.237; Interpolation: PSNR 16.82, LPIPS 0.272, Subject 0.947, Background 0.954, Motion 0.995, Aesthetic 0.479, VTA 0.228; Retrodiction: PSNR 15.60, LPIPS 0.325, Subject 0.985, Background 0.974, Motion 0.996, Aesthetic 0.477, VTA 0.220. In multi-shot generation, LoViC reports Subject Consistency 0.944 and Background Consistency 0.951, with Aesthetic 0.448 and Video-text Alignment 0.180. The stated limitations are degradation of extremely long-horizon consistency, sensitivity to compression strategy and positional gaps, artifacts under high-speed motion or abrupt scene changes, and possible semantic mismatch from inconsistent or weak captions.

5. LaViC and the frequent spelling confusion with LoViC

LaViC is not LoViC, but the ambiguity is sufficiently common that it belongs in any encyclopedic treatment of the term. "LaViC: Adapting Large Vision-LLMs to Visually-Aware Conversational Recommendation" proposes a two-stage framework for dialogue-based recommendation in visually oriented domains such as fashion, beauty, and home decor (Jeon et al., 30 Mar 2025). The task is to recommend a single item from a small retrieved candidate set, using both the dialogue context and product images.

The central technical issue is token budget. In LLaVA-v1.6, each image is split into 5 sub-images, each sub-image produces 577 tokens including the [CLS] token, and the total is therefore 2,885 tokens per image. LaViC compresses each product image to only 5 compact visual tokens, one [CLS]-positioned embedding per sub-image, producing a 577× reduction from 2,885 to 5. For 10 candidates, this reduces image tokens from 28,850 to 50. Stage 1, visual knowledge self-distillation, freezes the LLM and trains only the vision tower and projector via LoRA so that the model can regenerate an image description from the 5 compressed tokens instead of the full image-token sequence. Stage 2, recommendation prompt tuning, fixes the distilled visual tokens and fine-tunes the LLM via LoRA to output the correct candidate item ID from the dialogue context, item titles, and compressed visual tokens.

The candidate representation is explicitly multimodal: for candidate item s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j5,

s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j6

The self-distillation loss is negative log-likelihood over the description generated from compressed tokens, and the recommendation loss is negative log-likelihood over the correct item ID. The system uses a single NVIDIA A100 40GB GPU for all open-source generative methods, with LoRA hyperparameters s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j7, s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j8, and dropout s(ri,wj)=riwjs(r_i, w_j) = r_i^\top w_j9 in both stages.

The evaluation uses a Reddit-Amazon aligned dataset across beauty, fashion, and home, with approximately 19K conversations, 51K turns, and approximately 15K unique items. Under SBERT retrieval, LaViC with text and image achieves the highest HR@1 among open-source comparisons across all domains: Beauty 0.1187 with VR 0.9702, Fashion 0.1232 with VR 0.9298, and Home 0.3197 with VR 0.9892. Under OpenAI-emb_large retrieval, LaViC further improves to Beauty 0.1743, Fashion 0.1787, and Home 0.3537. Ablations show that using titles only, or using 5 [CLS] tokens without Stage 1 self-distillation, underperforms full LaViC. The paper notes limitations from relying on a single representative image per product, dependence on candidate retrieval quality, and the fact that combined cross-domain training does not yet improve over separate per-domain training.

6. Shared design patterns and major differences

Despite the name overlap, the four systems solve distinct problems and are not interchangeable. LocOv/LoViC addresses open-vocabulary object detection; LVIC/LoViC addresses LiDAR semantic segmentation; LoViC proper addresses long video generation; and LaViC addresses conversational recommendation (Bravo et al., 2022, Dong et al., 2024, Jiang et al., 17 Jul 2025, Jeon et al., 30 Mar 2025). The overlap lies less in task domain than in a recurring design preference: visual information is treated as a selective cue that must be localized, compressed, or confidence-weighted before fusion.

This pattern is clearest in how each system handles visual granularity. LocOv learns region-word correspondences from object proposals and grid features rather than relying only on image-level or grid-only matching. LVIC attaches low-level texture features and a depth cue to each LiDAR point instead of painting high-level semantic logits. Long-video LoViC compresses long video-text history into compact context tokens via FlexFormer, rather than exposing full raw history to every DiT layer. LaViC compresses each product image from 2,885 tokens to 5 distilled visual tokens so that candidate-level multimodal reasoning fits within the model context window. This suggests a common methodological theme: performance hinges not merely on adding more visual data, but on matching the representation scale to the downstream decision unit, whether region, point, segment, or candidate item.

The main differences are equally sharp. The supervision regimes range from weak supervision with captions plus known-class boxes in LocOv, to multi-modal sensor fusion in LVIC, to generative flow matching on million-scale videos in long-video LoViC, to LoRA-based self-distillation and prompt tuning in LaViC. The dominant failure modes also differ: fine-grained category confusion in OVOD, projection and depth errors in LiDAR-camera fusion, long-horizon drift in video generation, and candidate retrieval or single-image coverage limitations in conversational recommendation. For researchers, the practical implication is that "LoViC" names a family of unrelated acronymic artifacts rather than a coherent lineage; accurate interpretation depends entirely on the cited paper and problem setting.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to LoViC.