HAServe is presented, which turns HorizonSchema, a workload abstraction that connects exact prefix paths, permitted serializations, and released consumers as shared inputs to both decisions, into a scheduling--memory co-design method of systematic optimization for online LLM serving.
Xing-Yu Qu, Tian-Hao Lin, Yiqi Li et al.· 1 citation
A Cross-graph Tuning-free Prompting Framework (CTP) is introduced, which supports both homogeneous and heterogeneous graphs, can be directly deployed to unseen graphs without further parameter tuning, and thus enables a plug-and-play GNN inference engine.
Yaqi Chen, Shi-Xun Huang, Lei Wang et al.· Neural Networks· 0 citations
GRBench constructs a linked graph-relational schema from the real-world SciSciNet-v2 dataset and derives scalable instances through consistency-preserving subset extraction and evaluates representative system architectures through a unified, multidimensional methodology.
Ze-Peng Liu, Xin-Xin Huang, Xuan-Ming Liu et al.· 0 citations
CacheBridge is introduced, which co-designs architecture-indexed mapper support, attention-aligned calibration, and bounded mapper construction while retaining a closed-form affine interface for online deployment.
Xing-Yu Qu, Si-Yuan Lu, Z. Chen et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.