A familiar line of reasoning runs as follows: language models are flexible approximators trained under a strictly proper loss, so scale brings them closer to Solomonoff induction, and their predictive success is evidence of that approach. We apply known results from algorithmic information theory, universal prediction...
Luan Ozelim, Abicumaran Uthamacumaran, H. Zenil· 0 citations
A certified, differentiable estimator is used to bring the calculus into learning dynamics: grokking, where a complexity order parameter is known but has not been made to act, and the algorithmic estimator's distinct contribution is timing (when to fire and when to release), not attribution.
Luan Ozelim, Abicumaran Uthamacumaran, H. Zenil· 0 citations
We connect two questions in Algorithmic Information Theory (AIT), Machine Learning (ML) and Artificial General Intelligence (AGI): whether LLMs estimate Solomonoff induction, and whether they can self-improve towards an AI Singularity. We provide theoretical, methodological and empirical answers in the negative but sho...
H. Zenil, Abicumaran Uthamacumaran, Luan Ozelim· 1 citation
A decision-support pipeline combining disease-specific biomarker correlation graphs, ordinary differential equations (ODEs), deep sequence classification, and retrieval-augmented generation (RAG) is developed, with a decoupling between grounding and diagnostic correctness.
Henri Feto, Abicumaran Uthamacumaran, H. Zenil· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.