With the evolution of artificial intelligence (AI) paradigms towards agentic AI, the widespread integration of large language models (LLMs) enhances system capabilities while also introducing situational risks and challenges of value misalignment, making value alignment in agentic AI systems a critical issue. This pape...
Weihao Zeng, Hengshu Zhu, Chuan Qin et al.· Proceedings of the Thirty-Fi...· 0 citations
Beyond strong convexity, for general convex SGD, a Gibbs limiting law is identified and a pre-limit Wasserstein approximation error under stability and Stein-equation hypothesis is proved, which are validated numerically.
Zedong Wang, Yu-Yang Wang, Ijay Narang et al.· 1 citation
Full-parameter fine-tuning of large language models has substantial memory costs because backpropagation stores activations and gradients. Zeroth-order optimization avoids this by estimating update directions from loss evaluations, but existing methods require tuning a sensitive learning rate for each model and task. W...