Low-rank adaptation (LoRA) has attracted significant attention in the parameter-efficient fine-tuning (PEFT) landscape. However, its design suffers from two fundamental limitations. First, its invariance manifold induces flat directions in the loss landscape, creating an optimization bottleneck for adaptive optimizers....
While conversational recommendation systems provide a more natural user interface, they face the challenge of progressively discovering a user's needs before they can recommend an item that satisfies them. To evaluate the ability of AI agents at this elicitation process, we introduce $\tau$-Rec-Books, a benchmark that...
Bharath Sivaram Narasimhan, Karthik R. Narasimhan· 0 citations
LLM agents increasingly act on information retrieved from public sources they treat as credible, which turns a manipulated recommendation into a transaction, a dependency, or a decision with physical consequences. The security literature models this threat as instruction injection, in which an adversary writes a comman...
Ilan Zendel, Matan Levy, Stav Cohen et al.· 0 citations
It is suggested that explicit global context designs may pose a backdoor risk in SGG architectures because of the role of the global context pathway in backdoor behavior.
Xiao-Guang Chang, Tuo Chen, Cheng-Ze Jiang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
In this work, we study end-to-end FP4 reinforcement learning (RL) post-training for Mixture-of-Experts (MoE) large language models. Recent work on FP4 RL has introduced effective recovery recipes that restore accuracy under aggressive low-precision quantization for dense models, but we find that the same approach yield...
Hei-Yi Mak, H. Le, Mehran Taghian Jazi et al.· 0 citations
The results uncover an underexplored efficiency-attack surface in FEM solvers and show that runnable FEM programs can serve as adversarial inputs, and CloakFEM, a domain-guided LLM-agent framework for automatically generating runnable adversarial FEM programs that amplify solver computation.
Can market notices read by a large language model (LLM) improve short-horizon electricity price spike forecasts? We study five regions of Australia's National Electricity Market. A local LLM extracted features once per notice, only notices visible at the forecast origin were used, and a gradient-boosting model produced...
Liang Lin, Jianguo Zhu, Gang Lei et al.· 0 citations
Parameter-efficient linearization turns a pretrained autoregressive Transformer into an efficient model by hybridizing sliding-window attention (SWA) with a constant-size recurrent memory. But does every layer's recurrent state contribute to long-context retrieval? Investigating an SWA and Test-Time Training (TTT) hybr...
Vimal William, Yuanzhe Li, Danella Zhao et al.· 0 citations
We introduce a training-free sparse attention method that builds a prompt-specific key index to accelerate both prefill and decoding. The method clusters the keys into large semantic blocks that group tokens from noncontiguous positions. Each query position selects blocks by scoring their centroids and attends to the o...
Aggregate scores for continual learning algorithms rest on a distribution over task orders that is rarely stated. We formulate algorithm comparison as an expectation over a declared order distribution, which separates training variation from order variation, and apply it to motion forecasting with four road-layout task...
Zirui Li, Yunlong Lin, Haohan Yang et al.· 0 citations
In-image machine translation (IIMT) replaces text in an image with its translation while preserving the surrounding visual context. Existing task-specific models achieve convincing performance but require massive paired training images before and after translation. As advanced text-to-image (T2I) models have reached a...
Zhixian Li, Xingsong Ye, Yongkun Du et al.· 0 citations
A shared memory that does this for a community, prototyped as a social app, SEAM, which works out how fragments relate, distills knowledge about the group, and replies in a situated and associative way.
Ke-Ru Wang, Michael Xu, Ken Perlin et al.· 0 citations