Reasoning for Social Audio-Visual Question Answering: Where Do We Stand?
It is revealed that substantial priors can be learned solely from the text modality and that using a textual caption instead of the video yields performance on par with Vanilla SFT, revealing the limitations of current MLLMs when it comes to social understanding.