It is proved that $d+1$ is the exact minimum total number of hidden neurons among standard feedforward networks with locally integrable activations and affine outputs.
Joint-embedding predictive architectures enable planning with latent world models, but accurate transition prediction alone does not ensure that the planning objective is easy to optimize. We introduce Control-Geometry Straightening (CGS), a single auxiliary loss that learns planner-friendly representations by directly...
Simplex Diffusion Models (SDMs) are proposed, a framework that lifts the diffusion process to the probability simplex to represent beliefs over categories and can carry uncertainty across denoising steps, which mitigates information collapse.
Justin Deschenaux, Alexandre Galashov, Andrew Campbell et al.· 2 citations
Any continuous measure-to-measure operator with outputs of finite $p-th moment can be uniformly approximated, in the $p-Wasserstein distance, by continuous measure-dependent pushforwards, using measure-theoretic transformers.
Takashi Furuya, N. Nelsen, Frank Cole· 1 citation
Reach audiences
Advertise in front of researchers, engineers, and readers.
We study post-hoc refinement of frozen node classifiers: given only the graph $G$ and class distributions $Q$ predicted by a frozen model, can we improve accuracy without access to node features, model parameters, or gradients? APPNP answers this by propagating logits with a restart towards the initial predictions, min...
Preben Johnsen Bentdal, Nello Blaser, Xue-Cheng Tai· 0 citations
This work studies whether one masked transformer can approximate causal token-to-token maps uniformly over sequences of arbitrary length sampling a fixed normalized horizon, and characterizes the causal families admitting uniform approximation on these compact input classes by a single transformer with length-independe...
Takashi Furuya, Maarten V. de Hoop, Gabriel Peyré· 0 citations
This work investigates conditions that ensure fast transfer in the growing-horizon regime of hyperparameter transfer in a shallow linear network with a single trainable hidden matrix, trained by full-batch gradient descent.
We study approximate sampling: given $N$ independent samples from a proposal distribution $\mu$, the goal is to select one whose distribution is close to a target $\pi$ specified only up to a normalizing constant. Block and Polyanskiy (2023) provide finite budget error bounds for approximate rejection sampling (RS) as...
A weighted Bellman residual minimization framework that incorporates density ratio weighting by effectively integrating expert demonstrations with behavioral data is introduced, providing specific guidance for the rational utilization of expert demonstrations.
Li-Can Kang, Jerry Zhijian Yang, Cheng Yuan et al.· 0 citations
Non-stationary online learning has attracted much attention in recent years, as static regret is insufficient to guide algorithm design in changing environments. To address this limitation, interval regret and dynamic regret have been introduced as two representative performance metrics that strengthen static regret in...
Sampling latency compounds in diffusion workflows, where users generate and discard many candidates before keeping one. Surprisingly, the poor outputs of standard few-step samplers do not reflect a lack of reconstruction capacity: by optimizing only the initial noise, frozen 3-4-step samplers can closely reproduce thei...
We present a three-tier progression of Hidden Markov Models: maximum-likelihood (Baum-Welch), variational Bayesian (VBEM), and a neural variational extension (Neural VBEM), that model each customer's transaction history as a trajectory through a small number of latent behavioural regimes, one of which is empirically id...
Joseph Uririoghene Obukofe, A. O'Hare, Chioma Sandra Dike· 0 citations
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.