HGT-Autoscaler is proposed, a dependency-aware proactive autoscaling framework based on Heterogeneous Graph Transformers that leverages relation-aware attention mechanisms to learn expressive system representations and forecast resource requirements in a proactive manner.
Abstract
Autoscaling of microservice applications in containerized cloud environments remains a challenging problem due to complex inter-service dependencies, hierarchical deployment structures, and highly dynamic workloads. Existing autoscaling approaches are predominantly reactive or rely on homogeneous representations of system interactions, which limits their ability to anticipate load propagation across heterogeneous components such as services, message queues, and infrastructure layers. In this paper, we propose HGT-Autoscaler, a dependency-aware proactive autoscaling framework based on Heterogeneous Graph Transformers. The system is modeled as a multi-relational hierarchical graph that explicitly captures both service-level interactions and deployment structure across containers, virtual machines, and physical nodes. The proposed model leverages relation-aware attention mechanisms to learn expressive system representations and forecast resource requirements in a proactive manner. The autoscaling problem is formulated as a constrained optimization task that minimizes average response time under a given cost budget. Experimental evaluation on realistic microservice workloads demonstrates that the proposed approach significantly reduces latency and improves scaling stability compared to reactive and learning-based baselines, while maintaining cost efficiency.
QMScaler is proposed, a QoS-driven microservice horizontal scaling framework based on Monte Carlo Tree Search (MCTS) that aims to minimize the number of container instances while meeting the QoS requirements of multiple application functions.
Tian-Yang Zheng, Peng-Fei Yang, Zhe Xu et al.· Proceedings of the Internati...· 0 citations
SLO-Scaler is proposed, an uncertainty-aware autoscaling framework that predicts short-horizon request rates, tail latency, and SLO violation probability using a Bayesian LSTM model, and is evaluated on the DeathStarBench Social Network benchmark deployed on Kubernetes under periodic, bursty, and long-tail traffic patt...
Shuo Wang, Xiao-Xuan Sun, Shao-yu Huang et al.· 1 citation
CARSO (Counterfactual Autoscaling and Resource-efficient Service Orchestration), a proactive and interpretable framework that integrates eXplainable Artificial Intelligence (XAI) into the autoscaling process that outperforms state-of-the-art proactive autoscaling frameworks in both QoS compliance and overall resource u...
Lazaros Liatsas, Godfrey M. Kibalya, Angelos Antonopoulos· IEEE Transactions on Network...· 0 citations
Deploying Large Language Models (LLMs) over the edge-cloud continuum faces severe stability challenges due to the conflict between stochastic network topology and complex workflow dependencies. Existing schedulers, relying either on computationally prohibitive Graph Neural Networks (GNNs) or topology-agnostic heuristic...
Yan Gao, Shaoyuan Huang, Yonghui Ye et al.· IEEE Transactions on Cogniti...· 0 citations
A double deep Q-Network-based proactive autoscaling approach (DDQN-Proactive) along with Resource Removal Strategy (RRS) that enhances decision-making by decoupling action selection from value evaluation, enabling more stable and adaptive scaling.