Results indicate that the parameter efficiency reported for KANs does not transfer to deployment cost on scalar embedded cores, and that an MLP residual branch is the more dependable default for embedded HRPINN deployment unless specific quantization co-design is used.
Abstract
Hard-constrained recurrent physics-informed networks (HRPINNs) embed known dynamics inside a recurrent numerical integrator and restrict a neural branch to learning only the residual dynamics that the first-principles model does not capture. Kolmogorov--Arnold Networks (KANs) have been proposed as parameter-efficient replacements for multilayer perceptrons (MLPs) in such residual branches, but their learnable B-spline activations follow a markedly different execution profile. Building on prior work that characterized when a vanilla B-spline KAN matches or underperforms an MLP as an HRPINN residual branch in discovery accuracy, this paper asks whether that parameter efficiency survives deployment. Using identical trained weights, we measured execution latency, energy per integration step, and dependability under post-training quantization in the closed recurrent loop on a RISC-V RV64GC platform without vector extensions (StarFive VisionFive~2, SiFive U74). For the two accuracy-comparable pairs, the KAN residual branch executed $13.5\times$ and $8.0\times$ slower and consumed $11.3\times$ and $5.6\times$ more energy per integration step (3.7\,$\mu$J against 0.33\,$\mu$J for the smallest pair); across all four parameter-matched size tiers the ranges are $4.7\times$--$14.5\times$ and $4.7\times$--$18.7\times$. Under INT8 quantization, KAN trajectories diverged up to $43\times$ earlier than matched MLPs; the damage traces to weight quantization, not to input-side knot-interval misassignment. These results indicate that the parameter efficiency reported for KANs does not transfer to deployment cost on scalar embedded cores, and that an MLP residual branch is the more dependable default for embedded HRPINN deployment unless specific quantization co-design is used.
The ability to derive the governing equations of a dynamical system from data is essential for prediction and control across many scientific fields. Two challenges, however, are the expansion of candidate terms when reducing higher-order equations to first-order form and noise from estimating derivatives. We propose Hi...
Kolmogorov-Arnold Networks (KANs) represent a compelling alternative to traditional Multi-Layer Perceptron (MLP)-based neural networks. By employing activation functions as learnable elements, KANs offer superior interpretability, making them suited for scientific domains. In this work, we investigate the neural scalin...
T. Čadež, Sanghoon Lee, Kyoung-Min Kim· 0 citations
Kolmogorov-Arnold Networks (KANs) represent a paradigmatic shift in deep learning by replacing fixed node activations with learnable univariate functions on edges, offering enhanced interpretability and parameter efficiency. While recent polynomial-based KAN variants have addressed the computational overhead of origina...
The Physics-Informed Stochastic Configuration Machine is proposed, a novel backpropagation-free framework for both forward and inverse problems in differential equations that achieves high-fidelity predictive accuracy and robust parameter identification while accelerating the training process by orders of magnitude com...
Yueze Song, Zhong-Zhe Chen, Li-Hui Cen et al.· 0 citations
Physics-informed neural networks (PINNs) remain difficult to train for hyperbolic conservation laws. Artificial viscosity is a common remedy, and several methods reduce its coefficient during training. We examine adaptive moment estimation (Adam) followed by limited-memory Broyden–Fletcher–Goldfarb–Shanno (L-BFGS) opti...
S. Mukhambetzhanov, Y. Kenzhebek, S. D. Bekele et al.· Big Data and Cognitive Compu...· 0 citations
This chapter reconstructs the Hopfield network as a physical theory of memory rather than merely an early neural-network algorithm, treating the Hopfield network as an effective theory whose symmetry, locality, and point-neuron assumptions delimit its biological reach.
Nima Dehghani· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.