Skip to content

LLM-Orch: large language model-driven serverless orchestration with reinforcement-augmented prompt optimization and continuous feedback for context-aware edge intelligence

Sep 2026 · Computing · Vol 108 · 0 citations · 12 references

TL;DR

LLM-Orch is an integrated, serverless system for coordination based on large-scale language models that interprets operator instructions using contextual reasoning and continuously refines coordination decisions based on feedback from execution and ensures the stability and adaptability of the system in the long term.

View source

Similar papers

Review 2026

The Systems Architecture of LLM Multi-Agent Systems: Routing, Memory, and Resource Optimisation

This survey presents a systematic taxonomy and technical review of dynamic orchestration strategies designed to address communication overhead, KV cache management challenges, and increased token consumption within large Language Model-based Multi-Agent Systems.

Heet Nagoriya, H. Raithatha · 0 citations
Sep 2026

LLM4ETS: Self‐Evolving Algorithm Design for Edge Task Scheduling via Large Language Models

With the rapid proliferation of 5G and the Internet of Things, ensuring low latency in edge computing has become crucial for real‐time processing applications. However, existing task scheduling approaches often struggle to balance multiple optimization objectives effectively due to manual parameter tuning and slo...

Yu-Qi Zhao, Shen-Dong Gao, Ya-Tong Wang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

OptiCom : A Unified Framework for State-Conditioned Composition in LLM-Driven Optimization

OptiCom is proposed, a unified framework that represents LLM-driven optimizers within a shared configuration space: C=(A,Q,O,E,M,S), corresponding to artifact, query, operator, evaluation, memory, and strategy, corresponding to artifact, query, operator, evaluation, memory, and strategy.

Chen-Xing Wei, Si-Chen Liu, Lizzie Liu et al. · 0 citations

Smarter by the Moment: Environment-Driven Dynamic Policies for Continual LLM Improvement

Dynamic Retrieval-based Policy Generation (DRPG) is proposed, a framework that integrates memory-based retrieval with a dynamic policy generator, leveraging historical data and environment feedback to produce task-specific policies for continual LLM improvement.

Ting-Wei Chang, Po-Chun Chen, Hen-Hsen Huang et al. · 0 citations
Sep 2026

PipeSwift: Revisiting Pipeline Parallelism for Large-Scale Completion-Oriented Agentic LLM Serving

It is shown that pipeline parallelism (PP), long overlooked because it offers little decode-latency advantage, can reduce JCT by providing a more favorable balance between prefill and decode efficiency, and PipeSwift is built, an optimized open-source pipeline-parallel runtime integrated with a tailored micro-batch par...

Shiju Wang, Fei Ren, Fang-Cheng Fu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

OrchSLM: Probing the Dynamics of Small Language Model Orchestration

OrchSLM is introduced, a routing framework that unifies existing non-interactive orchestration methods and exposes their underlying design choices as controllable parameters, and reveals how orchestration behavior emerges from diverse knobs, including the task structure, model-pool composition, and multi-agent consensu...

Cheng-Xi Zhang, Yu-Rong Yao · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.