Skip to content

RosettaBitcoin: An Artifact-Backed Experience Report on Verification Infrastructure for Agent-Assisted Consensus Validators

Sep 2026 · 0 citations · 11 references
Computer Science

TL;DR

The case suggests that explicit failure records, fixtures, port-owned proofs, and validating imports can make agent-assisted systems more auditable and controlled ablations and external replications are needed to test whether such infrastructure causally improves development outcomes.

Abstract

Agent-assisted software projects are often reported through demonstrations or aggregate benchmarks that conceal how correctness claims were admitted. This experience report studies RosettaBitcoin, a single-developer project that built twelve separately implemented Bitcoin testnet4 consensus validators, through its immutable 17 June 2026 software snapshot (DOI 10.5281/zenodo.20738249). We analyze the snapshot's tracked SQLite evidence database, curated artifact index, conformance fixtures, validation scripts, blocker records, and version history. At the snapshot, all twelve ports had port-owned 45/45 script-corpus proofs and strict 5,000-block baselines. Nine had canonical clean 50,000-block, 100,000-block, and post-100,000 validation lanes. Java had one 19.86-second near-tip maintenance artifact. No port had an empty-state-to-tip proof, and no port satisfied the project's binary full-node gate; Docker and live-node capability gaps remained. The artifact history also records a 3 h 17 min 57 s Zig scaffold-to-50,000 span, but the observed intervals describe non-equivalent tasks and cannot estimate effort, productivity, or causality. A separate diagnostic supplement preserves evidence that a pure-Mojo cryptographic backend validated fresh state to height 100,000 and resumed to 140,234, agreed on a 45-case shadow comparison, rejected six crafted invalid classes, and was killed by three targeted mutations. That evidence is noncanonical, noncomparable, and class-bounded. The case suggests that explicit failure records, fixtures, port-owned proofs, and validating imports can make agent-assisted systems more auditable. Controlled ablations and external replications are needed to test whether such infrastructure causally improves development outcomes.

View source

Similar papers

Preprint Aug 2026

CAPRI: Contract-Aware Proof Repair for Isabelle

CAPRI is presented, a contract-aware repair workflow in which Isabelle checks the proof and an independent checker enforces a machine-readable edit contract, in which Isabelle checks the proof and an independent checker enforces a machine-readable edit contract.

Jim Woodcock, Gabriel Leite, Augusto Sampaio et al. · 1 citation
Preprint Aug 2026

Contract-Aware Rescue of a Drifted Isabelle Development: The Double-Tank Case Study

CAPRI, a contract-aware proof-repair tool, is used to govern a reconstruction by combining Isabelle acceptance with an independent check of repository changes against machine-readable edit contracts, and the reconstruction discharged all ten scoped obligations within the original nine-theory structure.

Jim Woodcock, Gabriel Leite, Augusto Sampaio et al. · 0 citations

Markdown Mayhem : Taming the Agentic Documentation Explosion

It is argued that without principled governance, agent-oriented documentation risks undermining both human comprehension and agent reliability, and a proposed foundational directions for restoring coherence are proposed.

Harsha Kokel · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.