Nov 2026· IEEE Transactions on Parallel and Distributed Systems· Vol 37, pp. 2458-2475· 0 citations· 58 references
Computer Science
Abstract
In this paper, we examine the Cloud-HPC continuum from the perspective of resource allocation and the execution of indistinguishable HPC and Cloud workloads. After briefly analyzing Kubernetes, an open-source platform for orchestrating containerized applications, we identified inefficiencies in resource usage resulting from the continuous activation of all compute nodes. Next, we review existing reactive autoscaling approaches, which can adjust the number of Kubernetes nodes in real time but cannot anticipate future resource needs. To address this limitation, the paper introduces a combination of proactive and reactive AI-driven autoscaling methodologies that predict the number of compute nodes required by analyzing node behavior during workflow execution. This approach optimizes resource utilization, reduces operational costs, and maintains application performance in cloud environments. It integrates seamlessly into the Kubernetes ecosystem with minimal modifications. Furthermore, this study challenges the traditional notion of the HPC–cloud continuum by exploring an extreme hypothesis: replacing the HPC scheduler with a cloud orchestrator. The proposed autoscaling module can serve as a new computing node scheduler, integrated with the default Kubernetes scheduler and potentially with HPC schedulers. Experimental evaluations across diverse benchmarks confirm their effectiveness in improving efficiency, reducing costs, and sustaining performance, benefiting Kubernetes cluster administrators and end users.
As the digital landscape evolves, the demand for high-performance, low-latency computing has surged, pushing traditional cloud computing to its limits. This has led to the conceptualization of the edge-cloud continuum, which integrates and leverages the strengths of the cloud, fog, and end-devices layers. However, real...
Vid Bregar, Matjaz B. Juric· Cluster Computing· 1 citation
Exploiting discounted spot instances for HPC requires an application to change its resource allocation at runtime, shrinking ahead of an interruption and expanding onto replacement capacity. Existing elasticity mechanisms implement rescaling as a full process teardown followed by a cold restart at the new processor cou...
Aditya Bhosale, Laxmikant V. Kalé· arXiv.org· 0 citations
Cloud simulation toolkits such as CloudSim and GridSim are widely used to evaluate resource provisioning and scheduling algorithms in virtualised computing environments. However, their standard models are constrained by architectural assumptions centred on finite workloads dispatched to virtual machines or grid resourc...
Milán Balázs, Bálint Babenyecz, György Eigner· Symposium on Intelligent Sys...· 0 citations
An extensive critical review of serverless functions in cloud–edge environments reveals that cloud–edge serverless systems need accountable placement, state-aware workflows, reproducible benchmarking, trustworthy orchestration, and carbon-aware lifecycle control, which can be achieved only by going beyond latency and e...
Abdullah Abbasi, D. Hakro, Asad Ullah et al.· Future Internet· 0 citations
Cloud computing and high-performance computing (HPC) typically follow different paradigms: cloud services are often orchestrated using Kubernetes, whereas HPC workloads are managed through batch schedulers such as Slurm. Growing demand for shared computational resources increases the need for interoperability between t...
Kirin is presented, an orchestrator for cloud-native WebAssembly services that supports core orchestration responsibilities, including resource scheduling, lifecycle management, scaling, and request routing, and demonstrates competitive performance, suggesting that WebAssembly is a viable candidate for broader adoption...
Joshua Bauer, Sebastian Werner, Maria C. Borges· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.