Create and explore imaginative 3D worlds with our new product Dreamfield (opens in a new tab)
Papers
Topics
Authors
Recent
Search
2000 character limit reached

Refiner-Bench Definition, Key Characteristics, Applications

Updated 1 October 2026
  • Refiner-Bench benchmarks are specialized video refiners that enhance low-resolution videos to higher-resolution, improving perceptual quality, reducing artifacts, and preserving subject identity, scene content, and motion.
  • Refiner-Bench uses a shared-input protocol to evaluate refining systems that receive identical low-resolution video generators, and it includes source generators WAN 2.1 1.3B, SANA-Video 2B, and LTX-2 Stage 1. The benchmark includes 150 diverse videos with varying motion and camera types and six content categories.
  • Key evaluation metrics in Refiner-Bench include VBench that assesses temporal components of video quality while the standard frames per second is 24, and UniPercept for assessing individual frame and aesthetic quality.

Refiner-Bench is a video-refinement benchmark introduced for evaluating systems that transform low-resolution video-generator outputs into higher-resolution videos while improving perceptual quality, mitigating synthesis artifacts, and preserving subject identity, scene content, and motion. It was introduced with SoL-Refiner, a one-step high-resolution video refiner, and uses a shared-input protocol in which competing refiners receive identical aligned low-resolution videos, thereby separating refiner quality from the quality of the upstream generator (Liu et al., 29 Sep 2026). The name is also used informally for several unrelated evaluation suites and benchmark proposals concerning language-model reasoning, retrieval restructuring, front-end code editing, data refinement, and industrial refinery planning; these uses are not components of the video benchmark.

1. Scope and conceptual definition

Refiner-Bench evaluates the transformation

xlow=Gϕ(c),x^high=Rθ(xlow),x_{\mathrm{low}}=G_{\phi}(c),\qquad \hat{x}_{\mathrm{high}}=R_{\theta}(x_{\mathrm{low}}),

where GϕG_{\phi} is a low-resolution video generator and RθR_{\theta} is a high-resolution refiner. The benchmark is concerned with the properties of RθR_{\theta} rather than with the independent quality of GϕG_{\phi}. Its intended evaluation dimensions are spatial-detail enhancement, synthesis-artifact repair, preservation of identity and scene content, preservation of motion, generalization across source generators, and computational efficiency.

The central methodological principle is input control. Refinement systems are not evaluated using the particular low-resolution outputs for which they were developed. Instead, every competing system receives the same aligned and resized low-resolution videos. This design reduces a major confound: a refiner may otherwise appear superior because it receives a better upstream input rather than because it performs a better transformation.

The benchmark is distinct from conventional video super-resolution evaluation. Spatial enlargement is part of the task, but the target also includes perceptual improvement, artifact mitigation, temporal preservation, and robustness to difficult content. The benchmark therefore combines video-quality metrics with explicit refinement-step and latency measurements.

The term “Refiner-Bench” is not uniformly used across the broader literature. “Refiner: Reasoning Feedback on Intermediate Representations” evaluates a reasoner–critic framework on three reasoning tasks but does not formally introduce a benchmark with that name (Paul et al., 2023). Similarly, “Refiner: Restructure Retrieval Content Efficiently to Advance Question-Answering Capabilities” uses five existing QA datasets as an evaluation suite rather than defining a distinct Refiner-Bench resource (Li et al., 2024). These suites should not be conflated with the video benchmark.

2. Dataset composition and controlled inputs

Refiner-Bench contains 150 videos, evenly divided among three source generators.

Source generator Videos Native resolution Main benchmark input
WAN 2.1 1.3B 50 832×480832\times480 1024×5761024\times576
SANA-Video 2B 50 1280×7361280\times736 1024×5761024\times576
LTX-2 Stage 1 50 768×512768\times512 GϕG_{\phi}0

Native videos are first cropped to valid aligned dimensions and then resized to the common GϕG_{\phi}1 input. WAN 2.1 and SANA-Video provide out-of-distribution source generators for SoL-Refiner, whereas LTX-2 Stage 1 is more in-distribution because SoL-Refiner is initialized from an LTX-2.3 checkpoint.

The content is organized into 12 groups covering human activity, animals, nature, sports and dance, cinematic portraits, urban scenes, vehicles, multi-subject interaction, camera-motion stress, fantasy or stylized content, food and cooking, and product or object close-ups. The selected material exposes refinement systems to faces, hands, fur, reflections, water, smoke, fine geometry, occlusion, fast articulation, repeated architectural structure, and micro-motion.

The benchmark includes three motion levels:

  • Low motion: 50 videos.
  • Medium motion: 64 videos.
  • High motion: 36 videos.

It also includes six camera-motion types:

  • Dolly: 34 videos.
  • Orbit: 30 videos.
  • Pan: 29 videos.
  • Handheld: 22 videos.
  • Tilt: 19 videos.
  • Static: 16 videos.

For the principal approximately 2K evaluation, all videos are supplied at GϕG_{\phi}2. LingBot produces GϕG_{\phi}3 outputs, while the other systems produce GϕG_{\phi}4 outputs. For the resolution study, the input is prepared at approximately half the target resolution; the 4K setting uses GϕG_{\phi}5 inputs and GϕG_{\phi}6 outputs.

The benchmark consequently combines generator diversity, content diversity, motion diversity, and camera-motion diversity while maintaining a common input protocol. A plausible implication is that its results are more diagnostic of the refinement mapping than evaluations in which each refiner receives a model-specific input distribution.

3. Evaluation protocol and metrics

The principal evaluation uses VBench and UniPercept, which measure complementary aspects of video quality.

VBench reports six submetrics:

  • Subject Consistency (SC): preservation of subject identity and appearance over time.
  • Background Consistency (BC): temporal stability of background and scene layout.
  • Motion Smoothness (MS): smoothness and plausibility of temporal motion.
  • Dynamic Degree (DD): amount or richness of motion.
  • Aesthetic Quality (AQ): visual appeal and composition.
  • Imaging Quality (IQ): perceptual clarity and visual fidelity.

The reported VBench average is

GϕG_{\phi}7

The benchmark also reports improvement over the common resized input:

GϕG_{\phi}8

This difference isolates the change attributed to refinement more directly than an absolute score alone.

UniPercept reports:

Its aggregate is

GϕG_{\phi}9

UniPercept samples eight uniformly spaced frames per video. VBench includes explicit temporal criteria, whereas UniPercept emphasizes frame-level aesthetics, general image quality, structure, and texture. Together they assess both perceptual enhancement and preservation of temporal behavior.

The benchmark also reports refinement steps, output resolution, and latency. This is essential because the number of target-resolution denoising evaluations is a primary cost determinant. If a refiner uses RθR_{\theta}0 denoising network evaluations, the target-resolution computational burden is associated with RθR_{\theta}1 full high-resolution latent passes.

The evaluation has recognized limitations. VBench and UniPercept do not fully measure long-range temporal consistency, because their evaluations rely on aggregate temporal criteria and sampled frames. In addition, the reinforcement-learning reward used by SoL-Refiner samples only three frames, one from each temporal third of the video. These metrics therefore provide substantial but incomplete coverage of temporal fidelity.

4. Compared refinement systems

The principal comparison includes external refiners, one-step restoration, and SoL-Refiner variants.

System Steps Output resolution
LingBot Stage-2 Refiner 8 RθR_{\theta}2
LTX-2.3 Refiner 3 RθR_{\theta}3
LTX-2.0 Refiner 3 RθR_{\theta}4
SEEDVR2 1 RθR_{\theta}5
SoL-Refiner, multi-step 23 RθR_{\theta}6
SoL-Refiner, one-step 1 RθR_{\theta}7

SoL-Refiner is trained in three stages: high-resolution continual training, reinforcement-learning post-training, and staged DMD-GAN distillation to three steps and then one step. Its multi-step version functions as the post-trained teacher, while the one-step version is the principal efficiency-oriented model.

At inference, SoL-Refiner can use a tiny autoencoder rather than the full VAE. It can also be executed with Sol-Engine, which uses kernel fusion, sparse attention, and related inference optimizations. These are system-level acceleration components rather than changes to the benchmark’s shared-input principle.

The comparison distinguishes model quality from systems efficiency. One-step distillation reduces the number of denoising evaluations, the tiny autoencoder reduces encoding and decoding cost, and Sol-Engine reduces denoising cost. The benchmark therefore permits separate analysis of refinement quality, denoising-step count, and end-to-end latency.

5. Quantitative findings

Under the approximately 2K shared-input protocol, the resized-input baseline achieves a VBench average of RθR_{\theta}8. The principal results are:

Method VBench average RθR_{\theta}9 UniPercept average
Resized input RθR_{\theta}0 RθR_{\theta}1 RθR_{\theta}2
LingBot Stage-2 RθR_{\theta}3 RθR_{\theta}4 RθR_{\theta}5
LTX-2.3 RθR_{\theta}6 RθR_{\theta}7 RθR_{\theta}8
LTX-2.0 RθR_{\theta}9 GϕG_{\phi}0 GϕG_{\phi}1
SEEDVR2 GϕG_{\phi}2 GϕG_{\phi}3 GϕG_{\phi}4
SoL-Refiner, multi-step GϕG_{\phi}5 GϕG_{\phi}6 GϕG_{\phi}7
SoL-Refiner, one-step GϕG_{\phi}8 GϕG_{\phi}9 832×480832\times4800

The one-step SoL-Refiner obtains the best one-step VBench average and exceeds the evaluated external refiners on the VBench average. It improves particularly on aesthetic quality and imaging quality. Its VBench average is lower than that of the 23-step SoL-Refiner, indicating a quality cost associated with aggressive distillation.

On UniPercept, the one-step model achieves the best reported external-refiner comparison on IAA, IQA, and ISTA, with an aggregate score of 832×480832\times4801. The multi-step model reaches 832×480832\times4802. These results indicate that one-step distillation retains much of the multi-step model’s perceptual quality.

At 832×480832\times4803, the one-step model improves over the three-step LTX-2.3 Refiner by:

  • 3.86% relative improvement in VBench average.
  • 22.79% relative improvement in UniPercept average.

The reported results therefore extend beyond the approximately 2K setting. They suggest that the refinement mapping remains effective at a substantially larger spatial token grid, although the supplied evidence does not establish performance across arbitrary resolutions or non-generator degradations.

6. Efficiency, generalization, and limitations

In the central 2K latency setting, videos contain 241 frames at 24 frames per second and outputs have resolution 832×480832\times4804. The three-step LTX-2.3 Refiner requires 57.461 seconds of refinement latency. The complete one-step SoL-Refiner system, using the tiny autoencoder and Sol-Engine, requires 6.447 seconds:

832×480832\times4805

The reported end-to-end speedup is therefore 8.91×. The successive acceleration contributions are:

  • One-step distillation: 832×480832\times4806.
  • Tiny autoencoder: 832×480832\times4807.
  • Sol-Engine: 832×480832\times4808.

For multi-step refinement at 4K, Sol-Engine reduces latency from 927.6 seconds to 284.8 seconds for 81-frame videos and from 5123 seconds to 1650 seconds for 161-frame videos. These correspond to approximately 832×480832\times4809 and 1024×5761024\times5760 acceleration.

SoL-Refiner is also evaluated with WAN-5B, WAN-1.3B, and Cosmos-Nano. The low-resolution-plus-refinement pipeline improves mean VBench and UniPercept over direct high-resolution generation for all three generators. Reported end-to-end latency reductions are 54.7% for WAN-5B, 71.1% for WAN-1.3B, and 64.4% for Cosmos-Nano. This supports cross-generator transfer beyond the LTX family.

The benchmark and method have several limitations:

  1. Frame-centric evaluation: three sampled frames are used for reinforcement-learning rewards, and eight uniformly sampled frames for UniPercept; long-range temporal consistency is not directly optimized or fully measured.
  2. Limited correction scope: the refiner primarily improves local detail, texture, and synthesis artifacts. It is not explicitly designed to repair major geometric, semantic, or motion failures already present in the base video.
  3. Restricted source diversity: the benchmark includes three AI video generators but does not cover camera-captured degradations, conventional video-restoration settings, or broad video-editing tasks.
  4. Unequal output resolutions: LingBot produces 1024×5761024\times5761, whereas other principal baselines produce 1024×5761024\times5762 outputs.
  5. Hardware-dependent latency: the 8.91× speedup includes the tiny autoencoder and Sol-Engine and was measured on one H100 under a specified resolution and frame-count configuration. It is therefore a system-level result rather than a universal model-only speed ratio.

More broadly, Refiner-Bench establishes a controlled setting for comparing video refiners, but it does not by itself resolve the relationship between perceptual quality and semantic faithfulness. A refiner may increase aesthetic or imaging scores while subtly changing identity, object structure, or motion. The inclusion of subject consistency, background consistency, motion smoothness, and improvement over the common input mitigates this issue, but additional long-horizon and content-preservation tests would be needed for a complete assessment.

In the broader family of “refiner” benchmarks and evaluation suites, the video Refiner-Bench is distinguished by its explicit shared-input design. Other works evaluate intermediate-representation correction in language reasoning (Paul et al., 2023), post-retrieval evidence restructuring (Li et al., 2024), MLLM-based front-end editing and repair (Xiao et al., 6 Jun 2025), deterministic compositional text-refinement execution (Huang et al., 30 Jun 2026), repository-scale refactoring (Amor et al., 4 Sep 2026), and execution-grounded skill refinement for refinery-planning software (Liu et al., 25 Sep 2026). These works provide related methodological precedents, but their datasets, tasks, metrics, and refinement targets are separate from the video benchmark.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Refiner-Bench.