Algorithm–Architecture Co-Design for Vertically Integrated AI and HPC Systems: Challenges, Advantages, and Future Outlook
Abstract
Next-generation scientific instruments in high-energy physics, X-ray imaging, fusion diagnostics, and other data-intensive applications generate data rates that increasingly exceed practical communication bandwidth and power budgets, making the traditional approach of transferring raw data to remote computing systems unsustainable. This article presents the vertically integrated AI for sensing and high-performance computing (VIAS) project, which treats 3D heterogeneous integration not merely as an advanced packaging technology but as a computational design paradigm that jointly shapes algorithms, hardware architectures, and memory organization. Rather than focusing on a single accelerator, VIAS explores a diverse set of AI and high-performance computing (HPC) workloads, including compact neural networks, spiking neural networks (SNNs), hyperdimensional computing (HDC), vision transformers (ViTs), machine-learning-based compression, and modular chiplet accelerators, to demonstrate how vertically integrated architectures reduce data movement through algorithm–architecture–technology co-design. Across these case studies, we identify recurring design principles that exploit dense vertical interconnects, memory locality, and specialized heterogeneous compute engines to enable real-time processing directly at the detector edge. We further discuss the common system-level challenges, including thermal management, memory hierarchy, communication, and 3D-aware design automation, that must be addressed to realize future intelligent scientific instruments. Together, these efforts establish a reusable co-design methodology for next-generation edge-AI and HPC systems built around vertically integrated heterogeneous architectures.