Skip to content
Open access

HGT-Autoscaler: Dependency-Aware Proactive Scaling of Microservices Using Heterogeneous Graph Transformers

2026 · IEEE Access · Vol 14, pp. 104394-104410 · 0 citations · 45 references
Computer Science

TL;DR

HGT-Autoscaler is proposed, a dependency-aware proactive autoscaling framework based on Heterogeneous Graph Transformers that leverages relation-aware attention mechanisms to learn expressive system representations and forecast resource requirements in a proactive manner.

Abstract

Autoscaling of microservice applications in containerized cloud environments remains a challenging problem due to complex inter-service dependencies, hierarchical deployment structures, and highly dynamic workloads. Existing autoscaling approaches are predominantly reactive or rely on homogeneous representations of system interactions, which limits their ability to anticipate load propagation across heterogeneous components such as services, message queues, and infrastructure layers. In this paper, we propose HGT-Autoscaler, a dependency-aware proactive autoscaling framework based on Heterogeneous Graph Transformers. The system is modeled as a multi-relational hierarchical graph that explicitly captures both service-level interactions and deployment structure across containers, virtual machines, and physical nodes. The proposed model leverages relation-aware attention mechanisms to learn expressive system representations and forecast resource requirements in a proactive manner. The autoscaling problem is formulated as a constrained optimization task that minimizes average response time under a given cost budget. Experimental evaluation on realistic microservice workloads demonstrates that the proposed approach significantly reduces latency and improves scaling stability compared to reactive and learning-based baselines, while maintaining cost efficiency.

Read PDF

Similar papers

Book Open access Sep 2026

QMScaler: A QoS-Constrained Resource-Efficient Microservice Autoscaling Framework for Edge Environments

QMScaler is proposed, a QoS-driven microservice horizontal scaling framework based on Monte Carlo Tree Search (MCTS) that aims to minimize the number of container instances while meeting the QoS requirements of multiple application functions.

Tian-Yang Zheng, Peng-Fei Yang, Zhe Xu et al. · 0 citations
Preprint Aug 2026

SLO-Scaler: Uncertainty-Aware SLO-Driven Autoscaling for Microservices

SLO-Scaler is proposed, an uncertainty-aware autoscaling framework that predicts short-horizon request rates, tail latency, and SLO violation probability using a Bayesian LSTM model, and is evaluated on the DeathStarBench Social Network benchmark deployed on Kubernetes under periodic, bursty, and long-tail traffic patt...

Shuo Wang, Xiao-Xuan Sun, Shao-yu Huang et al. · 1 citation
Open access 2026

Counterfactual Autoscaling for Resource-Efficient Service Orchestration in the Cloud–Edge Continuum

CARSO (Counterfactual Autoscaling and Resource-efficient Service Orchestration), a proactive and interpretable framework that integrates eXplainable Artificial Intelligence (XAI) into the autoscaling process that outperforms state-of-the-art proactive autoscaling frameworks in both QoS compliance and overall resource u...

Lazaros Liatsas, Godfrey M. Kibalya, Angelos Antonopoulos · 0 citations
2026

Workflow-Aware Expert Routing for Distributed LLM Serving Over the Edge-Cloud Continuum

Deploying Large Language Models (LLMs) over the edge-cloud continuum faces severe stability challenges due to the conflict between stochastic network topology and complex workflow dependencies. Existing schedulers, relying either on computationally prohibitive Graph Neural Networks (GNNs) or topology-agnostic heuristic...

Yan Gao, Shaoyuan Huang, Yonghui Ye et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.