Long-context large language models (LLMs) have demonstrated strong capabilities across a wide range of tasks, but the growing KV cache introduces substantial memory and inference overhead. Existing one-shot KV cache compression methods typically commit to irreversible eviction immediately after prefill, before any sign...
Zhe Wang, Jia-Kai Li, Yu-Jia Sun et al.· 0 citations
The proposed SGA first characterizes the topology of all potential forecast branches using a directed acyclic graph, such that the graph complexity bounds the uncertainty of multi-step TSFM forecasts, and then precisely measures the graph complexity by integrating both topological information and TSFM-inherent stochast...
Xin-Miao Hu, Shuang Liang, Cheng Feng et al.· 0 citations
VGCompiler organizes reasoning around two compilers: a representation compiler that recovers a structure-preserving intermediate graph representation from visual input, and an operation compiler that compiles query intent under the recovered graph state into an executable graph operation.
Rong-Zheng Wang, Zhe Wang, Ke Qin et al.· 0 citations
The Graph-based Reasoning UncErtainty in Trajectories (GRUET) method for the uncertainty quantification of ReAct is presented, comprising turn-level reasoning uncertainty quantification and trajectory-level uncertainty aggregation; the former precisely quantifies reasoning uncertainty via modeling the reasoning space s...
The key idea of GUT is to characterize the potential branches of each reasoning chain with a directed acyclic graph, thereby ensuring that all potential branches are comprehensively covered within the graph space.
Shuang Liang, Xin-Miao Hu, Xiang-Jun Ou et al.· 0 citations
LEEPS is introduced, a Latent-Guided Explore--Exploit Prompt Sampler that adaptively balances the reuse of previously observed informative prompts with continued exploration of uncertain ones, thereby making exploration more targeted without additional rollouts.
Shuang Liang, Hao Zhou, Yifan Gong et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.