Skip to content

Bonsai: Efficient and Optimal Automatic Tensor Rematerialization for Memory-Constrained DNN Training

Oct 2026 · Proceedings of the ACM on Programming Languages · Vol 10, pp. 1766 - 1793 · 0 citations · 51 references
Tensor decomposition and applications

Abstract

GPU memory is increasingly the primary bottleneck in scaling deep neural network (DNN) training, where the activation tensors footprint of a model may exceed the memory capacity. Tensor recomputation is a powerful technique that trades additional computation for reduced peak memory usage. However, existing approaches face a fundamental tension between performance optimality and computational scalability. On the one hand, solvers leverage Integer Linear Programming (ILP) to provide mathematically optimal solutions but suffer from the combinatorial explosion of the search space and thus become intractable for modern DNN models. On the other hand, heuristics-based approaches achieve scalability but sacrifice optimality altogether, resulting in suboptimal execution schedules. The root cause of these inefficiencies in the state of the art is the mismatch in abstraction. This paper introduces Bonsai, a framework that tackles this scalability-granularity tension. At the heart of Bonsai is a novel abstraction of operator segmentation that breaks the computation graph into flexible, variable-sized units to enable a lightweight yet effective segment-based ILP formulation. By having segments, Bonsai collapses the search space and prunes redundant solutions that stall existing solvers. This abstraction enables Bonsai to maintain a holistic view of the entire model, ensuring that no optimization opportunity is lost while reducing the number of decision variables by orders of magnitude. The evaluation across a diverse set of DNN architectures and models demonstrates that Bonsai scales to real-world models, is up to 10.13× lower solver cost than state-of-the-art ILP solvers, and delivers up to 11

Read PDF

Similar papers

#computer vision Review Open access Mar 2016

Determinants of overweight or obesity among ever-married adult women in Bangladesh

The findings of the study indicate that a large number of women in Bangladesh are suffering from being overweight or obese, and multiple factors are responsible for this including, older age,being from wealthy households, higher education, being from food-secured households, watching TV at least once a week, and being...

Haribondhu Sarma, N. Saquib, M. Hasan et al. · 75 citations · ⚡5
#artificial intelligence Open access Sep 2026

Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaders

The rapid growth of scientific literature makes it increasingly challenging for researchers to identify novel and impactful ideas, especially across disciplines. Modern artificial intelligence (AI) systems offer new opportunities for scientific ideation, but how compelling are AI-generated ideas, and how can their qual...

Xuemei Gu, Mario Krenn · 65 citations
#computer vision Conference Aug 2008

Scrum in a Multiproject Environment: An Ethnographically-Inspired Case Study on the Adoption Challenges

Agile methods continue to gain popularity. In particular, the Scrum method appears to be on the verge of becoming a de-facto standard in the industry, leading the so called Agile movement. While there are success stories and recommendations, there is little scientifically valid evidence of the challenges in the adoptio...

A. Marchenko, P. Abrahamsson · 59 citations · ⚡11
#data science Review Open access Apr 2022

Association between Mother’s Education and Infant and Young Child Feeding Practices in South Asia

Findings demonstrate a strong positive association between mother’s education and IYCF indicators and suggest strengthening national policies to educate women at least to the secondary level in SACs might be a cost-effective intervention for improving IY CF practices.

M. Tariqujjaman, M. Hasan, M. Mahfuz et al. · 45 citations · ⚡4
#computer vision Open access Sep 2012

Making the leap to a software platform strategy: Issues and challenges

A comprehensive taxonomy of the challenges faced when a medium-scale organization decided to adopt software platforms is provided, namely: business challenges, organizational challenges, technical challenges, and people challenges.

Yaser Ghanam, F. Maurer, P. Abrahamsson · 41 citations · ⚡3

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.