Self-Posed Reasoning Distillation (SPRD) adds tasks generated by a frozen teacher, filters them for answer consistency, and trains on label distributions obtained from repeated teacher reasoning, achieving a 182-fold speedup in latency over reasoning rollout on Gemma-4-31B.
Zi-Yi Chen, Yan Zhang, Jian-Hui Wei et al.· 1 citation
Skill internalization aims to convert externally specified procedural skills into persistent model capabilities, allowing language-model agents to execute them without retrieving or reinjecting skill descriptions at inference time. Yet when new skills are learned continually, whether previously internalized skills rema...
Haomiao Qiu, Yining Tang, Hongyi Wan et al.· 0 citations
Independently authored skills can impose incompatible requirements, competing preferences, and redundant instructions when jointly loaded by an LLM agent. We propose SkillFusion, an offline compiler that reconciles these interactions into a reusable merged skill. Its central idea is to make composition decisions explic...
Enhao Huang, Xinye Zhao, Yiming Li et al.· 0 citations
With the rapid proliferation of social media, harmful memes have become a growing threat to online ecosystems. Their harmfulness is often implicitly conveyed through complex interactions among visual, textual, and contextual cues, making accurate detection challenging. Recent studies have introduced Retrieval-Augmented...
Hexiang Gu, Saihui Hou, Changlan Liu et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
MDP planners often rely on nominal transition models that may differ from the true dynamics. Robust MDP planning accounts for this uncertainty through a set of admissible models, but doing so with limited online computation is challenging: the search tree grows exponentially with the horizon and each robust backup requ...
Despite significant advances in language understanding, Large Language Models (LLMs) can still miss meaning hidden in plain sight, failing to identify harmful intent in expressions readily understood by humans. Malicious users exploit this gap by strategically disguising harmful content to evade automated moderation, p...
Yisong Xiao, Benlei Cui, Shiji Zhao et al.· 0 citations
Mixture-of-experts (MoE) models activate only a few experts per token, but when their expert weights are offloaded to host memory, host-to-device (H2D) expert transfers enter the critical path of decoding. Speculative decoding verifies several draft tokens in one forward pass, yet in an MoE model each verified token ac...
Hongliang Cao, Xiuyu Li, Siqi Wang et al.· 0 citations
CoverSynth makes coverage and evidence quality explicit construction objectives, producing corpus-grounded evaluations that reveal retrieval headroom and differences between agent configurations that reveal unseen failure modes such as an inability of agents to handle underspecified or ambiguous requests.
Anahita Sharma, Apaar Shanker, Rishav Chakravarti et al.· 0 citations
An end-to-end success rate alone cannot distinguish failure to learn an action from failure to apply it as task state changes. We study this distinction in deterministic tool workflows that provide the current artifact state and candidate action recipes. Using 1.7B, 8B, and 27B Qwen models, we compare supervised learni...
Dong Nie, Rui-Yi Lan, Yi-Xin Nie et al.· 0 citations
Crowdsourced disaster imagery provides timely, ground-level observations when conventional disaster mapping is delayed or incomplete, yet its geographic value depends on where observations are produced, how they are interpreted, and whether they can be reliably located as actionable Geospatial Intelligence (GEOINT). Us...
Hao Li, Wenping Yin, Fabian Deuser et al.· 0 citations
Bridging the structural gap between biological brains and artificial neural networks presents a pathway to altered computational dynamics. This paper introduces a Reservoir Computing framework that replaces random networks with biologically realistic modularity by applying the Weighted Stochastic Block Model (WSBM) to...
Large language models are generally more capable than smaller ones, but their memory requirements can make local deployment difficult. We ask whether part of this capability gap can instead be recovered by running a smaller or more compressed model multiple times and selecting among its outputs using public or model-ge...
Tomer Galanti, Josh M. Susskind, Eran Malach· 0 citations