Skip to content
#small language model Open access

Harness-Driven Progressive Detail: Making Stateless and Small Language Models Do Bounded Agentic Work — An Implementation Report under PSOS and LMCP

Oct 2026 · Figshare

Abstract

Agentic coding and operations work is usually delegated to a model running an open tool loop: the model decides each next step, re-reads its growing transcript every turn, and stops when it believes it has finished. That arrangement is affordable on a provider with prompt caching, where each turn pays only for new tokens. On a stateless provider — most non-frontier APIs, and every small model running on local hardware — the same loop re-reads the full transcript every turn, so cost grows roughly with the square of the number of turns, and the model is never forced to produce an answer. In our production deployment one such run on a stateless model aborted at turn 43 after consuming about 156,000 input tokens to produce 4,300 output tokens, and every stateless agent had to be fenced out of agentic work.This paper reports the design and measured behaviour of Progressive Detail, an implementation — not a new standard — of the Progressive Skill Ontology Standard (PSOS) [2] and of the continuity requirements of the Local Multi-Agent Coordination Protocol (LMCP) [1]. Progressive Detail has four parts: (1) a four-tier description of every retrievable item (trigger, description, summary, detail) with the rule that a model never receives detail unless a cheaper tier selected it; (2) deterministic, LLM-free progressive recall over those tiers; (3) emulated between-turn caching that gives a stateless model the input shape a cached model would see; and (4) a spliced pipeline in which the harness, not the model, drives the work: orient, plan, a bounded number of short single-purpose steps that must each return structured output, review, and synthesis. The harness owns truth: it re-checks every file-and-line citation against the repository, greps for anything the model did not examine, accepts done only when a grounded finding supports it, and refuses role deliverables (a test run, a video, a triaged ticket) that were not actually produced.Measured in the reference deployment, the spliced pipeline turned a simulated looping model from 80 turns and about 253,000 tokens with no verdict into 17 calls and about 27,000 tokens with findings from every step; turned a storyboard task that had consumed 1.33 million input tokens over six failed runs into a single delivered run of 29 calls and about 15,500 input tokens; and let a 3-billion-parameter on-device model answer an exact call-site question with nine atomic calls of at most about 443 tokens each. We report the failures as carefully as the successes: in the first week of production use, fewer than half of stateless runs completed, in about half the cases because of provider credentials, rate limits and gate refusals rather than model behaviour.Version 2 adds §6.1: why the harness, not the model provider, must make sure nothing is cut or left out of a model’s input without saying so (PSOS v2 R52), what is built, and the gaps that remain.Version 3 (2026-10-05) adds record-level recall over one content tree: 96 of 100 held-out queries are answered at rank 1, at about 1,200 tokens instead of 9,500–19,000. It explains why the emulated cache failed between pipeline steps for a production GLM tester, and the fix. It adds progress-aware run ceilings, deliverable-call facts with a plan guard, dry-run replay and a storyboard-test recipe. That tester had completed 0 of 39 runs: replaying its failed tasks took about 1.26 million input tokens with 0 completions before, and about 86,000 tokens with 4 of 4 storyboard tests passed after. A with/without summary is set against the unadjusted production completion figure, which is still low.

View source

Similar papers

#small language model Dataset Open access Oct 2026

Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)

Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...

O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al. · 465 citations
#computer vision Open access Jun 2016

Software Development in Startup Companies: The Greenfield Startup Model

The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.

Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al. · 178 citations · ⚡14
#computer vision Open access Oct 2016

Software Startups - A Research Agenda

Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.

M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al. · 157 citations · ⚡17
#machine learning Review Open access Oct 2016

“Failures” to be celebrated: an analysis of major pivots of software startups

This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.

Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al. · 127 citations · ⚡15
#computer vision Review Open access May 2015

A survey study on major technical barriers affecting the decision to adopt cloud services

The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.

Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al. · 111 citations · ⚡8
#computer vision Open access Feb 2018

Lean Internal Startups for Software Product Innovation in Large Companies: Enablers and Inhibitors

This study investigates how Lean internal startup facilitates software product innovation in large companies and identifies its enablers and inhibitors, and shows the potential of the method-in-action framework to investigate the Lean startup approach in non-startup context.

Henry Edison, Nina M. Smørsgård, Xiaofeng Wang et al. · 78 citations · ⚡6

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.