This work proposes Hybrid Momentum (HyM), which combines a linearly weighted average of past gradients with a geometrically discounted fast momentum, and proposes HyMUON, which applies Newton--Schulz orthogonalization to the hybrid direction.
Hai-Feng Xu, Yi-Jin Ren, Chenyu Zhou et al.· 0 citations
Across 3,034 problems and six generator sizes, ORSMT improves the model-code match rate in all 72 benchmark and generator combinations before selection and raises the aggregate rate from 43.2% to 88.2% and the share that are both correct and matched from 25.2% to 40.2%.
Rui Zhang, Chenyu Zhou, Jiang-Hao Lin et al.· 0 citations
Skill2Query is a framework that first parses a skill document into a Skill Knowledge Graph and then generates pseudo-queries through a three-stage process including style mimicking, query template generation, and parameter filling, which consistently improves sparse, dense, and skill-routing retrieval.
Lihui Ding, Zi-Han Guo, Bingwei Lu et al.· 2 citations
GraphBU is proposed, a graph-native generator whose basic unit is a local subproblem plus its interface whose basic unit is a local subproblem plus its interface that keeps graph statistics close to the source family, preserves feasibility on most datasets, and improves downstream Predict-and-Search training.
Xiaolei Guo, Chenyu Zhou, Jiang-Hao Lin et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.