Oct 2026· Proceedings of the ACM on Programming Languages· Vol 10, pp. 1766 - 1793· 0 citations· 51 references
Tensor decomposition and applications
Abstract
GPU memory is increasingly the primary bottleneck in scaling deep neural network (DNN) training, where the activation tensors footprint of a model may exceed the memory capacity. Tensor recomputation is a powerful technique that trades additional computation for reduced peak memory usage. However, existing approaches face a fundamental tension between performance optimality and computational scalability. On the one hand, solvers leverage Integer Linear Programming (ILP) to provide mathematically optimal solutions but suffer from the combinatorial explosion of the search space and thus become intractable for modern DNN models. On the other hand, heuristics-based approaches achieve scalability but sacrifice optimality altogether, resulting in suboptimal execution schedules. The root cause of these inefficiencies in the state of the art is the mismatch in abstraction. This paper introduces Bonsai, a framework that tackles this scalability-granularity tension. At the heart of Bonsai is a novel abstraction of operator segmentation that breaks the computation graph into flexible, variable-sized units to enable a lightweight yet effective segment-based ILP formulation. By having segments, Bonsai collapses the search space and prunes redundant solutions that stall existing solvers. This abstraction enables Bonsai to maintain a holistic view of the entire model, ensuring that no optimization opportunity is lost while reducing the number of decision variables by orders of magnitude. The evaluation across a diverse set of DNN architectures and models demonstrates that Bonsai scales to real-world models, is up to 10.13× lower solver cost than state-of-the-art ILP solvers, and delivers up to 11
The findings of the study indicate that a large number of women in Bangladesh are suffering from being overweight or obese, and multiple factors are responsible for this including, older age,being from wealthy households, higher education, being from food-secured households, watching TV at least once a week, and being...
Haribondhu Sarma, N. Saquib, M. Hasan et al.· BMC Obesity· 75 citations· ⚡5
The rapid growth of scientific literature makes it increasingly challenging for researchers to identify novel and impactful ideas, especially across disciplines. Modern artificial intelligence (AI) systems offer new opportunities for scientific ideation, but how compelling are AI-generated ideas, and how can their qual...
Xuemei Gu, Mario Krenn· Proceedings of the National...· 65 citations
O Ongoing pro-poor health-financing strategies should be strengthened with introduction of innovative ways to monitor access, equity, and quality of care in maternal health.
Herfina Y. Nababan, M. Hasan, Tiara Marthias et al.· International Journal of Wom...· 64 citations· ⚡2
Agile methods continue to gain popularity. In particular, the Scrum method appears to be on the verge of becoming a de-facto standard in the industry, leading the so called Agile movement. While there are success stories and recommendations, there is little scientifically valid evidence of the challenges in the adoptio...
A. Marchenko, P. Abrahamsson· Agile Conference· 59 citations· ⚡11
Findings demonstrate a strong positive association between mother’s education and IYCF indicators and suggest strengthening national policies to educate women at least to the secondary level in SACs might be a cost-effective intervention for improving IY CF practices.
M. Tariqujjaman, M. Hasan, M. Mahfuz et al.· Nutrients· 45 citations· ⚡4
A comprehensive taxonomy of the challenges faced when a medium-scale organization decided to adopt software platforms is provided, namely: business challenges, organizational challenges, technical challenges, and people challenges.
Yaser Ghanam, F. Maurer, P. Abrahamsson· Information and Software Tec...· 41 citations· ⚡3
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
MIT News · Artificial Intelligence· news.mit.eduJul 15, 2026
Assistant Professor Pat Pataranutaporn describes a new interface that lets everyday users glimpse inside an AI's neural network before their chatbot ever says a word.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.