Multimodal in-context learning (ICL) is an important capability of multimodal large language models (MLLMs). Its performance is closely tied to the demonstrations it uses, making demonstration retrieval a core problem for ICL. Common methods use fixed scoring methods to retrieve all the demonstrations at once, which ma...
Yanshu Li, Rui-Xiang Tang, Junyi Jessy Li et al.· 0 citations
This work introduces TWISTER, the first automaton-twisted Sequential Monte Carlo decoder for MDLMs, and proves that for regular language constraints, the Feynman-Kac correction is exactly computable, with the twists obtained efficiently using quantities pre-computed for step-exact sampling.
Aditya Thimmaiah, Lara Marinov, Jayanth Srinivasa et al.· 0 citations
The results demonstrate that EXCODER provides an effective, though imperfect, solution to this problem in automated code generation, offering developers the first way to implement ERC following test-driven development.
Ling-Tao Zhong, Jiyang Zhang, Jayanth Srinivasa et al.· 0 citations
This work introduces CROCODIL (Cross-model Code Editing with LLMs), a post-training framework for reducing excessive edits while preserving functional correctness and CROCODIL's similarity reward penalizes large changes, while its execution reward scores build and test success.
Ling-Han Zhong, Aditya Thimmaiah, Jayanth Srinivasa et al.· 0 citations
Real-world communication often requires pragmatic reasoning: interpreting meanings implied through context and cultural convention rather than stated literally. Existing pragmatic evaluation remains largely limited to English and high-resource languages, leaving Indic languages unexplored despite their linguistic and c...
This work evaluates open-source coding LLMs under two semantic formalisms and two semantic shifts across Human-Written, LLM-Translated, and Fuzzer-Generated program splits, showing that LLMs lean on pre-training priors rather than systematically applying the given rules.
Lara Marinov, Aditya Thimmaiah, Jayanth Srinivasa et al.· Proceedings of the 2nd ACM S...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.