CON decomposition is introduced, which quantifies how much of a layer's variance each concept explains given all other concepts and the outcome, and how much none of them explains, yielding layer-comparable, calibrated scores that suppress false positives.
Roshan Prakash, Marco Simnacher, Manuel Pfeuffer et al.· 0 citations
This work empirically validate predictions through exact calculations and controlled stochastic optimization of the worst-case joint-distribution error permitted by excess risk at most $\varepsilon$-identifiability modulus using an $\varepsilon$-identifiability modulus.
Seq2Synth is introduced, a unified benchmark for assessing temporal and schema properties to determine applicable evaluations, covering timestamp, cross-sectional, longitudinal, and structural fidelity, alongside trajectory-aware utility and privacy.
Kiwan Kwon, Kangmin Kim, Ho-Jin Lee et al.· 0 citations
The Mamba-Assisted Closure (MAC) framework is proposed, which employs a Mamba-based sequence model to predict the closure from the resolved trajectory and couples the learned closure with the reduced-order governing equations through a numerical integrator to advance the resolved variables in time.
Zhifei Wei, S. Qadeer, Panos Stinis· arXiv.org· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work pairs the brain emulator with large language models that generate news headlines from linguistic parameters such as valence, arousal, and dominance and shows that these parameters can be recovered from predicted brain maps, demonstrating that the emulator's synthetic neural encodings preserve information abou...
Niels Bracher, Xavier Intes, Stefan T. Radev· arXiv.org· 0 citations
This study develops a theoretical framework framing transformers as kernel regressors, motivating a purely intrinsic strategy for ablating heads based on the stable rank of the per-head projection matrices, and uncovers the specific heads responsible for degenerate phenomena widely observed in TSFMs.
Anthony Bao, Venkata Hasith Vattikuti, Jeffrey Lai et al.· arXiv.org· 3 citations
This work introduces SHAKE-GNN, a novel scalable graph-level GNN framework based on a hierarchy of Kirchhoff Forests, a class of random spanning forests used to construct stochastic multi-resolution decompositions of graphs, enabling flexible trade-offs between efficiency and performance.
The empirical evaluations on standard benchmarks and in a comparison study with widely used explanation methods show that attention weights can be meaningfully incorporated into the studied XAI frameworks, highlighting their value in enriching transformer explainability.
Marte Eggen, Jacob Lysnæs-Larsen, Inga Strümke· arXiv.org· 1 citation
The teacher, an auxiliary behavior model, is trained to sample high-loss regions of the student and can generalize across unexplored modes, thereby enhancing mode coverage by providing an efficient training curriculum.
Minsu Kim, Sanghyeok Choi, Taeyoung Yun et al.· International Conference on...· 27 citations· ⚡6
It is established that gradient-based training can induce an implicit regularization towards low rank for several neural network architectures, and it is demonstrated empirically that this phenomenon may facilitate an explanation of generalization over natural data.
A new algorithm for amortized inference in sparse probabilistic graphical models (PGMs) is presented that enables off-policy training but avoids the need to instantiate all the random variables for each parameter update, thus speeding up training considerably.
J. Falet, Haebeom Lee, Esmeralda S. Whitammer et al.· International Conference on...· 9 citations
This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to model distributions over continuous spaces, and generative flow networks (GFlowNets), which have been used for distributions over discrete structures such as graphs. We demon...
Esmeralda S. Whitammer, S. Lahlou, T. Deleu et al.· International Conference on...· 120 citations· ⚡9
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.