Banks rely on extensive internal policy frameworks to ensure that corporate lending decisions comply with regulatory requirements and internal risk standards. Reviewing loan applications against these policies is a largely manual and knowledge-intensive process, which can lead to overlooked policy violations or excepti...
This study investigates how the design of textual interfaces affects prompt optimization for multimodal reasoning, on the audio-visual question answering task, and highlights textual interface design as an important factor in making prompt optimization effective for omni-modal reasoning systems.
Yi Wang, Tian-Zi Wang, Tong Lei et al.· 0 citations
Linters are widely used in code maintenance and real-time IDE editing to surface lint alerts related to performance, style, error-prone, and other patterns in source files. However, existing code benchmarks do not explicitly evaluate linter-guided file refactoring, where models must reduce lint alerts in source files w...
Tong-Wei Deng, Jin-Yu Zhu, Yue Cao et al.· 0 citations
We introduce SEA-HELM Audio, a Southeast Asian (SEA) multilingual evaluation framework that extends the text-based SEA-HELM benchmark to assess performance degradation in cascaded automatic speech recognition and large language model (ASR-LLM) pipelines. Using synthesized speech, we compare speech-input and text-input...
Yixian Tan, Aulia Adila, Jonathan Heng et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work generates concise rules that express relations between perception to action and uses Group Relative Policy Optimization (GRPO) to train Qwen2.5 and Llama3 models across four ToM benchmarks, suggesting that explicit rules help models bridge the reasoning gap in ToM and support knowledge transfer across models.
Soyoung Oh, Nursulu Sagimbayeva, N. Jennings et al.· 0 citations
Video large language models (Video LLMs) often generate responses unsupported by the input video. Contrastive decoding (CD) can mitigate these hallucinations, but its effectiveness depends on how the negative branch weakens visual evidence. Existing methods rely on predefined perturbations or masking guided by question...
Zhi-Xi Cai, Ruo-Qi Yuan, Xin-Cheng Yang et al.· 0 citations
Counts of which brands a large language model names are useful only if they hold long enough to act on are tested with a pre-registered replication with a pre-registered replication.
In long-horizon tool-calling tasks, LLM agents can fail not only because of tool-use errors, but also because of ineffective interaction with users. Yet existing benchmarks largely assume cooperative and behaviorally stable users, leaving the effect of emotional variation on agent reliability underexplored. We introduc...
Rishitosh Kumar Singh, Amir Saeidi, Shamanthak Hegde et al.· 0 citations
Post-training often improves the performance of large audio-language models on audio understanding and reasoning benchmarks. However, these improvements may reflect adaptation to specific question formats, such as multiple-choice questions, rather than genuine advances in audio understanding and reasoning capabilities....
Hua-Hsuan Chen, Xuanjun Chen, Wei-Chung Lu et al.· 0 citations
Multimodal in-context learning (ICL) is an important capability of multimodal large language models (MLLMs). Its performance is closely tied to the demonstrations it uses, making demonstration retrieval a core problem for ICL. Common methods use fixed scoring methods to retrieve all the demonstrations at once, which ma...
Yanshu Li, Rui-Xiang Tang, Junyi Jessy Li et al.· 0 citations
Multimodal models and agents have emerged to enable AI systems to learn from and interact with the real world more like humans by integrating information across multiple modalities. However, enabling multimodal agents to continually acquire useful information from complex, heterogeneous multimodal data remains a signif...
Ming-Hao Guo, Qing-Yue Jiao, Xiu-Jin Liu et al.· 0 citations
Embodied visual tracking requires a robot to identify a designated target from visual observations and control its own motion to follow that target through an environment. Following an isolated person is a comparatively simple demonstration of embodied visual tracking, but following the intended person among distractor...
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.