Skip to content

Into the CUDA Multiverse of Runtime Compilation: Exploring Kernel Fusion Strategies for GPU Database Systems

Aug 2026 · Proceedings of the VLDB Endowment · Vol 19, pp. 4658-4661 · 0 citations · 13 references

TL;DR

The CUDA Code-General is presented, a query compilation framework for GPU database systems that allows selecting any of the 22 TPC-H benchmark queries or entering arbitrary SQL, to choose between runtime or static compilation and to inspect the generated CUDA code for three kernel fusion strategies side by side.

Abstract

This demonstration presents the CUDA Code-General, a query compilation framework for GPU database systems. The interface allows selecting any of the 22 TPC-H benchmark queries or entering arbitrary SQL, to choose between runtime or static compilation and to inspect the generated CUDA code for three kernel fusion strategies side by side: fused multiple sequential kernels, cooperative groups, and dynamic parallelism. Users can observe how the number of generated pipelines affects compilation cost, how cooperative groups fuse them into a single kernel with synchronisation barriers, and how dynamic parallelism delegates kernel launches to the device.

View source

Similar papers

Book Open access Sep 2026

In-Copy Fusion: Runtime Argument Fusion for Efficient OpenMP GPU Offloading

In-Copy Fusion (ICF), a runtime optimization of OpenMP’s accelerator model, implemented in LLVM, that gathers eligible map clauses into staging buffers, orchestrating an optimal transfer pipeline through fusion without modifying application or kernel code, preserves OpenMP semantics with negligible overhead is presente...

Dionisis-Odysseas Sotiropoulos, Sara Royuela Alcázar, Eduardo Quiñones et al. · 0 citations
Open access Aug 2026

SimDSL: A Domain-Specific Language for Large-Scale GPU-Resident Simulation

These findings demonstrate that high-level ECS simulation programs can be compiled into efficient GPU execution without requiring users to manually implement and coordinate low-level kernels.

Anisha Tasnim, Tian Zhao · 0 citations
Book Open access Sep 2026

Taming Dynamism on GPUs: Cross-SM Kernel Fusion via SM Cooperation and Just-in-Time Reduction

Modern LLM architectures and systems render GPU kernel input shapes increasingly dynamic, e.g., conditional expert routing in MoE and batches with variable-length sequences. This dynamism degrades performance in both expert-tuned kernels and compiler frameworks. We identify the root cause as dynamic cross-SM data depen...

Jing-Kai He, Guang-Da Sun, Tian-Jian Li et al. · 0 citations
#machine learning Preprint Aug 2026

DataKernelBench: Can LLMs Optimize Database Queries on GPUs?

DataKernelBench is introduced, which translates SQL into validated PyTorch TorchPlan programs and evaluates LLMs that optimize either the core tensor-bounded snippet or the full query in CUDA or Triton through execution-guided repair and finds that higher-performing implementations commonly use kernel fusion and execut...

Gokul Karthik Kumar, Yotam Perlitz, Corey Lammie et al. · 1 citation
Preprint Oct 2026

Characterizing CPU-GPU Memory Sharing over Unified Memory Architecture

Unified Memory Architecture (UMA) enables the CPU and GPU to share a single physical memory. However, its complexity and opacity often drive applications back to inefficient copying or to incorrect direct access that sacrifices performance or even correctness. This paper presents a comprehensive study of CPU-GPU memory...

Jin-Rong Yang, Zi-Meng Wang, Rong Chen et al. · 0 citations
Preprint Sep 2026

Interactive Debugger for Performance Portable Python HPC Kernels

We propose PKDB, the first interactive debugger for GPU and multithreaded low-level kernels written in Python. Python is widely used in high performance computing (HPC), with frameworks such as PyKokkos translating Python-embedded domain-specific languages to native code that runs across OpenMP-threaded CPUs and variou...

Ivan Grigorik, Gabriel Kosmacher, G. Biros et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.