SpecAgent is introduced, a collaboration protocol that turns the strong model from the author of each step into a reviewer of steps drafted by a weak model, suggesting that a strong model need not author every step of an agent: reviewing grounded drafts retains most of its quality while cutting both latency and memory...
Zi-Lin Wang, Yinhong Liu, Chao Chen et al.· 0 citations
Unified multimodal models (UMMs) receive image-generation supervision that exposes them to visual information not fully documented in text. Can learning to generate images expand what pretrained models know? We introduce Knowledge Transfer Probing (KTP), a controlled protocol that supplies new knowledge through image-g...
Wen-Kai Li, Wen-Yi Hong, Zhuo-Yi Yang et al.· 0 citations
Human face-to-face conversation requires coordinating speech, gestures and expressions across both speaking and listening. We present ELLSA 2, an end-to-end full-duplex dialogue model that jointly optimizes speech interaction and streaming gesture-expression generation. An autoregressive, chunk-wise synthesizer combine...
Si-Yin Wang, Wen-Yi Yu, T. Chiba et al.· 0 citations
Aerial vision-language navigation (VLN) agents built on large vision-language models are expensive to query. Executing a complete predicted action chunk before replanning amortizes this cost, reducing model inference from 195 to 42 ms per executed waypoint for our policy. It also moves the states at which the policy is...
Rui-Bin Ju, Rui Cai, Min Xu et al.· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
In reinforcement learning, advantage-based value-learning methods, unlike standard Q-learning, share information across actions by decomposing the action-value function into a state-dependent value component and action-specific advantages. While this mechanism has proven effective in both tabular and deep reinforcement...
Kintan Saha, Hamed Masoudi, Xinyi Sheng et al.· 0 citations
Understanding video content requires reasoning at multiple levels of granularity, from identifying objects to interpreting their interactions and localizing when specific actions occur. This thesis studies three query-guided grounding tasks that answer where key objects are (object-level grounding), how they interact (...
To improve task performance while encouraging desirable response properties, LLM post-training often combines a primary reward (e.g., correctness) with auxiliary rewards (e.g., brevity or efficiency). However, how these rewards are aggregated can critically affect training outcomes. We show that symmetric aggregation,...
Yu-Shu Li, Jiin Woo, Xiao-Xiao Li et al.· 0 citations
It is proposed that fusion can improve prediction when classical and quantum representations capture complementary predictive relationships, and evaluated quantum representations for their complementary predictive contribution and matching the representation and fusion strategy to the target relationships.
Azadeh Alavi, Fatemeh Kouchmeshki, Hossein Akhoundi et al.· 0 citations
Matoi separates reusable consequence evidence from current execution authority and durable occurrence history. Its finite query-aware contract covers branches, ordered collections and negative lookups. A consumer reuses only its own checked evidence whose observations remain valid; signed requests, live grants, quota a...
Multi-agent large language model (LLM) systems are increasingly deployed at the edge to support complex tasks that require collaboration and information exchange among multiple agents. However, when task contexts are passed across agents, shared context that has already been processed by upstream agents often needs to...
Han Shen, Qifu Tyler Sun, Fanyang Meng et al.· 0 citations
Memory enables large language models (LLMs) to use information beyond their parameters, such as past user conversations, long documents, or an agent's earlier actions. For a frozen LLM, access to this accumulated knowledge is limited to what a memory system places in its context window. However, gathering and combining...
Adibvafa Fallahpour, Parsa Idehpour, Vignesh Kothapalli et al.· 0 citations
With the expansion of pre-trained language model usage in recent years, the importance of datasets for performing tasks in specialized domains has significantly increased. Therefore, we have built a Korean dataset called ESG-Kor to automatically extract Environmental, Social, and Governance (ESG) information, which has...