Scaling CookVoice to larger models and datasets

Determine the scaling potential of CookVoice by evaluating larger Diffusion Transformer variants and substantially larger human-voice training datasets than the current 43.51-million-parameter model trained on 168 hours of data.

Background

CookVoice is currently implemented with the DiT-S diffusion-transformer variant and trained on a comparatively small 168-hour dataset. Although the framework achieves broad task coverage and efficient inference, the paper states that it has not yet been scaled because of resource constraints. Establishing how performance, controllability, and efficiency change with larger model capacity and training data remains unresolved.

References

First, due to resource constraints, CookVoice has not yet been scaled up. The current model only use the DiT-S version of diffusion transformer~($43.51$M parameters) and is trained on $168$ hours of data, which is still much smaller than large-scale voice generation systems. The scaling potential of CookVoice has not been fully explored.

CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation  (2608.11590 - Lou et al., 12 Aug 2026) in Section Limitation