Skip to content
#edge computing Open access

A Systematic Review of Swin Transformer, Mamba, and Kolmogorov–Arnold Network Architectures and Their Hybrids in Visual Computing: Retrospective Registration

Oct 2026 · Open Science Framework
Advanced Neural Network Applications

Abstract

Retrospective registration. This protocol is registered after the review was completed: the literature search was last run on 31 March 2026, and screening, data extraction and synthesis had been finished before this registration was submitted. It records the review question, eligibility criteria, sources, search strategy, selection, data extraction and synthesis methods as they were applied, so that the conduct of the review can be checked against the published report. Purpose. Since 2021, three architecture families have each changed one building block of the Transformer: the Swin Transformer confines self-attention to shifted local windows, Mamba and other selective state-space models (SSMs) replace attention with an input-dependent recurrence, and Kolmogorov–Arnold Networks (KANs) move the nonlinearity of the multilayer perceptron to learnable functions on the edges. No previous review covers the three families jointly, and none quantifies how consistently primary studies report the computational efficiency they claim. This systematic review compares the three families and their hybrids in visual computing, including biomedical imaging, industrial and remote-sensing imagery, LiDAR and point-cloud data. Research questions. RQ1. What does each family contribute, in terms of what it represents, where it innovates and why it improves on the block it replaces? RQ2. How do the families differ in representational power and computational efficiency? RQ3. How consistently does the literature support the efficiency it claims? RQ4. How far has the combination of the families been taken? Methods (summary). Six sources (arXiv, Crossref, OpenAlex, PubMed, Semantic Scholar and DBLP) were searched through their public programmatic interfaces for English-language studies published from 2021 to 2026. Records were screened by title and abstract, prioritised with a score combining venue quality, citations and level of contribution, and the highest-ranked records were assessed in full text. Included studies were extracted with a common schema and compared along six axes: architectural variants, applications, computational efficiency, interpretability, data efficiency and hybridisation. Synthesis is narrative and tabular; no meta-analysis is performed. The review is reported in accordance with PRISMA 2020. Expected outcomes. A comparative map of the contribution of each family and their hybrids, the tasks and domains where each is used, and an assessment of how often studies report parameters, FLOPs, latency, memory and code, leading to recommendations for standardised efficiency reporting.

View source

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54

Related blog posts

Microsoft Research Blog Oct 21, 2026

Solving a 31-year-old grand challenge in mathematics – the KLS conjecture

For decades, a fundamental question about the difficulty of computing in high-dimensional spaces has resisted proof. New research resolves this question, removing a major theoretical obstacle to understanding the efficiency of randomized algorithms used across science and computing. The Kannan–Lovász–Simonovits (KLS) conjecture was proposed in 1995. It asks whether, for a broad class of high-dimensional […] The post Solving a 31-year-old grand challenge in mathematics – the KLS conjecture appear…

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.