Parameter-efficient linearization turns a pretrained autoregressive Transformer into an efficient model by hybridizing sliding-window attention (SWA) with a constant-size recurrent memory. But does every layer's recurrent state contribute to long-context retrieval? Investigating an SWA and Test-Time Training (TTT) hybr...
Vimal William, Yuan-Zhe Li, Danella Zhao et al.· 0 citations
Accurate prediction of pedestrian crossing intentions plays a critical role in enhancing the safety of pedestrian-vehicle interactions in autonomous driving. However, effectively capturing subtle spatiotemporal patterns in pedestrian pose sequences and integrating complementary visual and ego-vehicle motion information...
The increasing reliance on mobile phones has made phone-induced pedestrian distraction increasingly prevalent. Activities such as texting, watching videos, and making phone calls have become significant contributors to traffic accidents. Reliable detection of pedestrian distraction is essential for autonomous vehicles,...
Yuan-Zhe Li, Hou-Nian Liu, Xiao-Tong Chang et al.· 0 citations
Emerging long-horizon agentic tasks require repeated model calls, worsening the inference cost of already-costly language models. While narrow agentic tasks suggest potential for aggressive model pruning without performance drop, empirical results show existing methods proposed for question answering tasks severely deg...
Yuan-Zhe Li, Peng-Xin Wang, Yuxin Ren et al.· 0 citations
Pedestrian head orientation recognition plays an important role in autonomous driving by providing valuable cues for understanding pedestrian attention and anticipating potential crossing behavior. However, reliable recognition in real-world traffic scenes remains challenging because pedestrian head regions are often c...
Yuan-Zhe Li, Yi-Di Huang, Xiao-Tong Chang et al.· 0 citations
Stable Perturbation-Robust Policy Optimization (SPrPO) is introduced, which applies adaptive and sensitivity-aware perturbations during RL training and shows improved perturbation robustness while maintaining stable policy optimization.
Peng-Xin Wang, Yuan-Zhe Li, Yuxin Ren et al.· 0 citations
A quantization-robust unlearning framework that makes forgetting robust to quantization while maintaining overall model utility is proposed, and a curvature-based criteria that pinpoints sensitive weights in the unlearned model that leads to both non-robust forgetting and reduced utility is revealed.
Jia-Lu Wang, Jia-Ning Deng, Shu-Qing Luo et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.