Kaixiong Gong

AVCap: Reinforcing Audio-Video Joint Caption with Detail-Aware Reward

Detailed audio-video joint captioning is essential for multimodal video understanding and generation. However, prior works are constrained by three main limitations: (1) the scarcity of high-quality public datasets with fine-grained audio-visual joint captions; (2) reinforcement-learning methods that rely on coarse rew...