Matrix optimizers have emerged as a promising direction, with Muon standing out as a prominent design. Revisiting Muon through its full-Gram representation, we observe that it jointly processes marginal-scale and interaction information. This opens an alternative way to organize geometric information hierarchically, mo...
Zi-Xuan Gong, Ze-Yu Gan, Jia-Ye Teng et al.· 0 citations
As the capabilities of large language models (LLMs) continue to advance, increasing attention is turning to how to translate their abilities into useful behavior. Personal agents bring this question into everyday settings, where models are expected to serve individual users and continually adapt to their preferences. W...
A novel architecture that strictly decouples statistical preference learning from semantic intent parsing is explored, which achieves the lowest cumulative regret and highest test accuracy, significantly outperforming traditional memory-augmented agents.