Oct 2026· Zenodo (CERN European Organization for Nuclear Research)
Neural Networks and Reservoir Computing
Abstract
The relentless exponential scaling of foundation models and transformer architectures has pushed conventional silicon complementary metal-oxide-semiconductor (CMOS) digital accelerators (GPUs, TPUs) toward fundamental thermodynamic and interconnect boundaries. Joule heating, resistance-capacitance (RC) interconnect delay scaling, and the 'memory wall' severely constrain energy efficiency and compute density. Optical Computing and Integrated Silicon Photonics (SiPh) establish an analog non-Von Neumann hardware paradigm that executes fundamental linear algebra operations—specifically General Matrix-Matrix Multiplication (GEMM)—at the speed of light with near-zero runtime energy dissipation. By encoding vector-matrix activations into coherent optical wave fields and modulating light through cascaded Mach-Zehnder Interferometer (MZI) meshes, Micro-Ring Resonator (MRR) banks, and Wavelength-Division Multiplexing (WDM) waveguides, photonic tensor processing units (PTPUs) execute analog matrix multiplications in continuous time with sub-nanosecond propagation latencies. However, translating integrated photonic circuits into production deep learning accelerators introduces profound optoelectronic engineering bottlenecks: analog noise accumulation across deep optical meshes, severe thermal phase drift, limited electro-optic Digital-to-Analog / Analog-to-Digital (DAC/ADC) conversion resolution, non-linear activation implementation hurdles, and wafer-scale optical footprint scaling. This paper delivers an exhaustive, mathematically formal technical investigation and empirical benchmark of integrated photonic computing for deep neural network acceleration. We formalize the Clements and Reck unitary matrix decomposition algorithms over reconfigurable MZI topologies, derive the optical transmission transfer matrix under optical carrier phase error perturbations, and establish energy-per-MAC physical thermodynamic bounds across electro-optic conversion interfaces. Furthermore, we construct an empirical co-simulation and hardware testbed benchmarking silicon photonic meshes against state-of-the-art CMOS accelerators (NVIDIA H100, Google TPU v5p) across vision transformers, large language model attention heads, and resonant graph convolutions. Our empirical findings demonstrate that a 64x64 integrated MZI photonic mesh achieves a 58.4x improvement in energy-delay product (EDP) over 4nm digital CMOS cores, sustaining up to 128 Tera-Operations per Second per Watt (TOPS/W) at 4-bit to 8-bit equivalent precision, while active thermo-optic phase stabilization preserves 98.2% baseline classification accuracy. Finally, we establish open research directions in all-optical non-linear activation functions, co-packaged optical memory architectures, and wafer-scale photonic interconnect scaling.
Agile methods continue to gain popularity. In particular, the Scrum method appears to be on the verge of becoming a de-facto standard in the industry, leading the so called Agile movement. While there are success stories and recommendations, there is little scientifically valid evidence of the challenges in the adoptio...
A. Marchenko, P. Abrahamsson· Agile Conference· 59 citations· ⚡11
A comprehensive taxonomy of the challenges faced when a medium-scale organization decided to adopt software platforms is provided, namely: business challenges, organizational challenges, technical challenges, and people challenges.
Yaser Ghanam, F. Maurer, P. Abrahamsson· Information and Software Tec...· 41 citations· ⚡3
It is shown that high article processing charges are not sufficiently justified by the publishers, which often lack transparency and may prevent authors from adopting OA.
D. Graziotin, Xiaofeng Wang, P. Abrahamsson· Scientometrics· 21 citations· ⚡1
MCGLPPI, a novel geometric representation learning framework that combines graph neural networks (GNNs) with the MARTINI molecular coarse-grained (CG) model to predict overall PPI properties accurately and efficiently, offers an effective and efficient solution for PPI overall property predictions.
Yang Yue, Shu Li, Yihua Cheng et al.· bioRxiv· 15 citations
PepPCBench enables a robust evaluation of PFNN-based methods and supports their continued development for peptide-protein structure prediction, and highlights the influence of peptide length, conformational flexibility, and training set similarity on prediction accuracy.
Si-Long Zhai, Huifeng Zhao, Ji-Ke Wang et al.· Journal of Chemical Informat...· 13 citations· ⚡1
Abstract Predicting properties from coordinate–category data—sets of vectors paired with categorical information—is fundamental to computational science, manifesting in materials science as predicting formation energies or elastic moduli from crystal structures. While large language models (LLMs) have increasingly been...
Nawaf Alampara, Santiago Miret, Kevin Maik Jablonka· Nature Computational Science· 13 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
MIT News · Artificial Intelligence· news.mit.eduJul 15, 2026
Assistant Professor Pat Pataranutaporn describes a new interface that lets everyday users glimpse inside an AI's neural network before their chatbot ever says a word.
Microsoft Research Blog· microsoft.comJul 13, 2026
Cryptographic code supports vital protections in modern computing systems. Learn how a new method helps verify code as developers write it while preserving speed and adaptability as it gets implemented and evolves. The post Verifying Rust cryptography in SymCrypt, from standards to code appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduJul 6, 2026
PhD student Rachel Sava, winner of the Envisioning the Future of Computing Prize, explores transformative improvements and dystopian risks of neural technology.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.