CWAM (Causal WAM), which incorporates the sparsity constraint into a pretrained WAM by adding a sparse routing path to its action head, with the world modeling objective remaining unchanged, is proposed.
Jun-Tao Cheng, Jin-Zhou Tang, Fan Feng et al.· 0 citations
This paper proposes the Quantum Geometry® Grand Challenge, a five-year prize and benchmark program for quantum and hybrid quantum–classical methods in computational geometry, computer-aided design, computer-aided design, geographic information science, and meshing.
W. R. Franklin· Proceedings of the 2nd ACM S...· 0 citations
Data from emerging preclinical and clinical trials, which show significant improvements in WOMAC and VAS scores and a decrease in DAS28 with minimal adverse effects, suggest that UC-MSCs will improve pain and function and, in turn, overall quality of life.
D. Greene, Umm E. Habiba, R. Sathyanarayanan et al.· Regenerative Therapy· 0 citations
Recent advances in Time Series Foundation Models (TSFMs) increasingly rely on axial attention mechanisms, but despite their empirical success, the theoretical properties of axial attention remain largely unexplored. To bridge this gap, we extend the Single Location Regression framework introduced in Marion et al. [2025...
Many applications of multi-objective reinforcement learning (MORL) require policies that balance conflicting objectives while satisfying safety constraints. We study safe MORL with zero constraint violation throughout learning, covering both cumulative and stepwise constraints. A key challenge is to explore sufficientl...
Chenxi Li, Yao Shu, Siyang Gao et al.· 0 citations
It is proved that under exclusive specialization every update that raises pass@1 strictly lowers the success of some prompt; a strictly positive price on prompts (Stiemke duality) is the exact condition, and being merely the best strategy on a prompt is provably not enough.
This work proposes profiling-guided layer-wise RoPE allocation, assigning high/low coverage under a fixed budget using early coverage-benefit profiles, and normalized-depth mapping transfers profiles within model families, enabling small-model measurements to guide larger-model allocations before pretraining.
When exact probabilities cannot be computed, \emph{density ratio estimation (DRE)} is a key subroutine in the wide range of applications where density ratios appear, from experimental design to generative modelling and reinforcement learning. In this paper, we introduce the concept of an \emph{expected log density rati...
Avi Amalanshu, Chandler Squires, Yizhou Lu et al.· 0 citations
Feature extraction from unstructured data typically relies on opaque embeddings unsuited to interpretable decision-making. Interpretable features, on the other hand, typically require costly, and often infeasible, hand-engineering. Large language models (LLMs) offer a natural bridge, as they can read raw data and descr...
We show that the transformer architecture emerges as the score of last-token laws in a natural statistical model of language, where sentences are empirical measures of tokens, a language is a law on $P(S^d)$, and our prior belief is that sentences carry no structure at all. By the maximum-entropy principle, we select t...
Whether models trained on different modalities converge to the same representation of the world is central to AI. The Platonic Representation Hypothesis (PRH) conjectures that they do as they scale, but without a proof it offers neither a guarantee nor a recipe. We turn the hypothesis into a theorem. First, we prove a...
An application to the k-$\epsilon$ turbulence closure in a single-column ocean model, with atmospheric surface forcing as context, shows that localized posterior calibration reduces temperature and zonal-velocity errors relative to deterministic and global-posterior calibration.
Exaucé Luweh Adjim Ngarti, É. Arnaud, Leonardo Nicoletti et al.· 0 citations
Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.