This work proposes ABC-Align, leveraging abundant pseudo label signal to minimize variance and applying a lightweight, adaptive correction grounded in the human-labeled subset, and empirically demonstrates that ABC-Align achieves superior performance over prior semi-supervised baselines in a series of experiments on an...
Eric Frankel, Bang-Hua Zhu, Sewoong Oh et al.· 0 citations
The proposed AlphaPareto replaces the scalar reward with a multi-objective vector-valued reward that simultaneously captures predictive power, temporal stability, perturbation robustness, and diversity, and optimizes these objectives through a Pareto-regularized learning procedure.
HARMONIA achieves stronger explanation recovery than existing interpretable graph baselines while maintaining competitive predictive performance and scaling to graphs with millions of nodes, and shows that interpretable graph learning can remain both faithful and scalable without sacrificing predictive effectiveness.
Weak-to-strong generalization (W2SG) occurs when a student trained on a teacher's predictions outperforms that teacher. We study when this happens under fully converged, ridgeless two-stage learning, with no early stopping, no explicit regularization, and no assumption that the student is more expressive than the teach...
Mohammad Zeinalpour, Amir Najafi· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Detailed statistical theory for RSI evaluation in this setting is developed, including simultaneous error control, valid lower bounds on cumulative improvement, and a characterization of the fundamental limits of adaptive evaluation reuse.
Xiao-Jing Sun, Yu-Hang Zeng, Zi-Hua She et al.· 1 citation· ⚡1
Prior information for real-world physical quantities is most elegantly expressed via partial differential equations (PDEs). In this paper, we propose a novel way to solve PDEs using probabilistic inference on a factor graph. In general, factor graphs provide a natural way to encode prior knowledge into a model as expli...
Анна Петровна Казачкова, Leonhard Hennicke, Rainer Schlösser et al.· 0 citations
Deep ReLU networks are piecewise-affine mappings that partition the input space into cells, each characterized by a distinct activation pattern. This structure motivates fitting a local linear model within each cell to preserve predictive accuracy while improving interpretability. The challenge is to identify regimes t...
The neural scaling law relating longer training to better performance through a power law is central to today's large language models (LLMs), yet its origin remains debated. One recent proposal is that power laws can emerge from the strong non-linearity of a single softmax head learning peaked distributions. What happe...
Yizhou Liu, Sara Kangaslahti, Jeff Gore· 0 citations
A large scale evaluation of one JEPA instantiation across nine backbones and eleven benchmarks spanning temporal and spatio-temporal forecasting finds that the benefit of this instantiation varies sharply across backbones, indicating the variability is a general property of this instantiation rather than a dataset spec...
Yu-Tong Feng, Bo-Wen Liao, See-Kiong Ng et al.· 0 citations
This work focuses on the unified model for joint estimation of eQTL mapping and gene network, and proposes a regularized multi-task graphical lasso, named L_{1-2}$ GLasso, which can obtain sparser and more accurate solutions than other commonly-used methods.
Compensated Feedback based SFL (CoeF-SFL), a communication-efficient framework that retains the end-to-end objective without any auxiliary network, is proposed and significantly outperforms auxiliary-network-based methods under the same communication frequency.
Auditing publicly released descendants of distilled models spanning diverse post-training objectives, SCOUT consistently identifies the distillation source and tracing teacher-associated *syntactic signatures* along training trajectories reveals that they emerge during distillation and persist through subsequent prefer...
Minwoo Jang, Jaechang Kim, Minhyeon Oh et al.· 0 citations
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.