Vision-Language Model as a ‘Zero-Shot’ Assistant for Evaluating Condylar Osseous Changes in Cone-beam Computed Tomography

Abstract

Introduction and aims Interpreting condylar osseous changes on CBCT is challenging for general practitioners. This study evaluated the ‘zero-shot’ diagnostic performance and utility of Vision-Language Models (VLMs) as AI assistants for detecting condylar abnormalities. Methods We analysed 72 CBCT images from the EHPN study for internal validation and constructed a balanced sample of 70 images from the MMDental dataset for external validation, with dual-radiologist consensus as the ground truth. Three frontier VLMs (Gemini-3, GPT-5.2, and Qwen3-VL) were used to evaluate representative sagittal slices without prior fine-tuning. Performance was measured by diagnostic accuracy, sensitivity, specificity, and balanced accuracy, while the Quality Assessment of Medical AI-generated Information (QAMAI) framework assessed the quality of AI-generated structured reports. This study was reported following STARD-AI and CLAIM guidelines as primary checklists, with TRIPOD-LLM as a supplementary framework. Results Gemini-3 achieved the highest diagnostic accuracy (90.3%; 95% CI: 81.0%-95.5%), outperforming GPT-5.2 (75.0%) and Qwen3-VL (55.6%). External validation on a constructed balanced sample from the MMDental dataset confirmed these findings, with Gemini-3 achieving 90.00% accuracy. Regarding report generation, Gemini-3 surpassed the other models across five QAMAI dimensions, providing more accurate, clear, and clinically useful justifications aligned with diagnostic standards. Conclusion VLMs, particularly Gemini-3, exhibit zero-shot capabilities in identifying condylar changes and generating high-quality diagnostic reports. While these models maintain a conservative diagnostic tendency, they demonstrate potential as preliminary, training-free screening aids in oral maxillofacial radiology. Further multicentre validation is warranted to establish clinical utility. Clinical Relevance Cloud-based VLMs could offer accessible screening assistance by allowing general practitioners to query condylar findings via simple web interfaces without specialized hardware. These tools may contribute to structured reporting workflows, though their diagnostic consistency in routine practice remains to be established, and they should complement rather than replace expert clinical judgment.