OralGPT: A Two-Stage Vision-Language Model for Oral Mucosal Disease Diagnosis and Description (2510.13911v1)

Abstract: Oral mucosal diseases such as leukoplakia, oral lichen planus, and recurrent aphthous ulcers exhibit diverse and overlapping visual features, making diagnosis challenging for non-specialists. While vision-LLMs (VLMs) have shown promise in medical image interpretation, their application in oral healthcare remains underexplored due to the lack of large-scale, well-annotated datasets. In this work, we present \textbf{OralGPT}, the first domain-specific two-stage vision-language framework designed for oral mucosal disease diagnosis and captioning. In Stage 1, OralGPT learns visual representations and disease-related concepts from classification labels. In Stage 2, it enhances its language generation ability using long-form expert-authored captions. To overcome the annotation bottleneck, we propose a novel similarity-guided data augmentation strategy that propagates descriptive knowledge from expert-labeled images to weakly labeled ones. We also construct the first benchmark dataset for oral mucosal diseases, integrating multi-source image data with both structured and unstructured textual annotations. Experimental results on four common oral conditions demonstrate that OralGPT achieves competitive diagnostic performance while generating fluent, clinically meaningful image descriptions. This study provides a foundation for language-assisted diagnostic tools in oral healthcare.