LLM-Orch: large language model-driven serverless orchestration with reinforcement-augmented prompt optimization and continuous feedback for context-aware edge intelligence
LLM-Orch is an integrated, serverless system for coordination based on large-scale language models that interprets operator instructions using contextual reasoning and continuously refines coordination decisions based on feedback from execution and ensures the stability and adaptability of the system in the long term.
This survey presents a systematic taxonomy and technical review of dynamic orchestration strategies designed to address communication overhead, KV cache management challenges, and increased token consumption within large Language Model-based Multi-Agent Systems.
Heet Nagoriya, H. Raithatha· International Journal of Kno...· 0 citations
With the rapid proliferation of 5G and the Internet of Things, ensuring low latency in edge computing has become crucial for real‐time processing applications. However, existing task scheduling approaches often struggle to balance multiple optimization objectives effectively due to manual parameter tuning and slo...
Yu-Qi Zhao, Shen-Dong Gao, Ya-Tong Wang et al.· Software, Practice & Experie...· 0 citations
OptiCom is proposed, a unified framework that represents LLM-driven optimizers within a shared configuration space: C=(A,Q,O,E,M,S), corresponding to artifact, query, operator, evaluation, memory, and strategy, corresponding to artifact, query, operator, evaluation, memory, and strategy.
Chen-Xing Wei, Si-Chen Liu, Lizzie Liu et al.· 0 citations
Dynamic Retrieval-based Policy Generation (DRPG) is proposed, a framework that integrates memory-based retrieval with a dynamic policy generator, leveraging historical data and environment feedback to produce task-specific policies for continual LLM improvement.
It is shown that pipeline parallelism (PP), long overlooked because it offers little decode-latency advantage, can reduce JCT by providing a more favorable balance between prefill and decode efficiency, and PipeSwift is built, an optimized open-source pipeline-parallel runtime integrated with a tailored micro-batch par...
Shiju Wang, Fei Ren, Fang-Cheng Fu et al.· arXiv.org· 0 citations
OrchSLM is introduced, a routing framework that unifies existing non-interactive orchestration methods and exposes their underlying design choices as controllable parameters, and reveals how orchestration behavior emerges from diverse knobs, including the task structure, model-pool composition, and multi-agent consensu...
Cheng-Xi Zhang, Yu-Rong Yao· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.