SciReC: Diagnostic Evaluation of Multimodal, Multi-Turn Relational Reasoning with Adaptive Interaction
The proposed DMRA, a deficit-based diagnostic framework that quantifies the contribution of these components to identify the primary cause of unsuccessful cases, reveals that relational reasoning is the primary source of error across all models, followed by memory limitations.
N. Yilmaz, Naga Sai Abhiram Kusumba, Stella Wenxing Liu et al.
· 0 citations