Skip to content
#small language model Open access

Externalized Intelligence and Model Substitution

Oct 2026 · Zenodo (CERN European Organization for Nuclear Research) · 1 references
Artificial Intelligence Applications

Abstract

The continuity of an artificial intelligence system’s memory and governance should not depend on retaining a particular large language model. This study investigates externalized intelligence as an architecture in which task-relevant memory, information selection, policy, and permissions are maintained outside model weights. The inference model receives structured, authorized context and performs task-specific reasoning within externally established constraints. This architecture extends Artificial Deterministic Intelligence (ADI), which separates probabilistic reasoning from deterministic authority. Cortex is proposed as a governed memory-continuity substrate for maintaining authorized task information and governing conditions independently of the inference model. Model substitution is examined as the replacement of the inference model while preserving externally maintained task information, governing constraints, and evaluation criteria. Controlled synthetic-record experiments assessed factual correctness, provenance, scope compliance, and required abstention. Under scoped-context conditions, the tested 8B and 35B configurations each satisfied the complete acceptance requirements in 90 of 90 trials. The larger tested model was therefore unnecessary for this workload under the evaluated conditions. This result demonstrates workload-specific substitution with a smaller model without loss of observed acceptance and supports investigating how external memory and governance influence the model capacity required for a task. These findings establish smaller-model sufficiency within the tested configurations, rather than general model equivalence or a quantitative measure of intelligence. They support a system-level account of intelligent performance in which externally maintained information and deterministic controls contribute alongside model inference. The human-centered objective is to preserve accumulated memory, permissions, and governing policies across model replacement, allowing people to retain continuity and control as the technology providing inference changes.

View source

Similar papers

#small language model Dataset Open access Oct 2026

Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)

Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...

O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al. · 465 citations
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Open access Feb 2018

Lean Internal Startups for Software Product Innovation in Large Companies: Enablers and Inhibitors

This study investigates how Lean internal startup facilitates software product innovation in large companies and identifies its enablers and inhibitors, and shows the potential of the method-in-action framework to investigate the Lean startup approach in non-startup context.

Henry Edison, Nina M. Smørsgård, Xiaofeng Wang et al. · 78 citations · ⚡6

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.