SyncRA: Learning Temporal Correspondence in Omni-Modal Models
Recent omni-modal models demonstrate strong perception of audio and visual inputs, yet often struggle to connect what they hear with what they see at the same moment. This weakness in temporal correspondence can cause models to associate spoken cues with the wrong visual scenes, producing plausible answers grounded in...
Ze-Long Xu, Yan Li, Wenpen Hu et al.
· 0 citations