Skip to content

mimeo: Compiling Public Expert Corpora into Agent Skills and Testing What Transfers

Aug 2026 · 1 citation · 73 references
Computer Science

TL;DR

The evidence supports mimeo as a compact, inspectable reference on a person, not as a demonstrated transfer of their judgment; the evidence supports mimeo as a compact, inspectable reference on a person.

Abstract

Giving an agent a file about a named expert can supply hard-to-find material, produce a recognizable persona, or change what the agent decides. These are different claims. We test each one. mimeo is an open-source tool that finds a person's public work, checks each extracted quotation against the cached source text, and writes a file an agent can load. Eight logged builds averaged 38 model calls; the check rejects 13.2% of extracted quotations. We tested four expert files with one coding-agent harness. Knowledge access was clearest: mimeo answered all 20 obscure, quotation-heavy questions; no closed-book condition answered more than 10. Keyword search (BM25) over the same pages answered 15-17, a gap this sample cannot resolve. Grounding showed one clear benefit: personas written from model memory misstated a documented position on 1-4 of 20 answers under every grader; the plain agent and mimeo never did. Every persona was easy to spot on short open prompts, and adding task material lowered identification by 18-23 points. mimeo was no more identifiable than a from-memory profile. Judgment transfer remained unresolved because both tests hit their ceiling: every condition found 94-97% of the problems planted in engineering tasks and scored 94-100% on 16 new application scenarios. An AI-judged"sounds like the expert"score changed with the judge: two of four preferred answers based on a model's stereotype, while two found no difference on the same text. That is a caution against relying on a single AI judge. The evidence supports mimeo as a compact, inspectable reference on a person, not as a demonstrated transfer of their judgment. Toolkit and expert profiles: https://github.com/K-Dense-AI/mimeo

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Skill Issue: Lessons from Optimizing Repository SKILLs for Coding Agents

This work mine harder tasks --- merged pull requests of the repository, reverted at a single frozen base commit; and score a candidate document by whether the same agent does better with it than without it, to find a maintainer of one repository found in them knowledge one only gets by working in the project.

M. Kozyrev, A. Kozyrev, A. Podkopaev · 0 citations
#artificial intelligence Review Sep 2026

CART: Closed-Loop Adaptive Red Teaming for Large Language Models

Automated red teaming often replays a fixed set of prompts, which measures known risks but cannot learn from failures found during testing. We present CART (Closed-Loop Adaptive Red Teaming), a framework that uses each result to guide what it tests next. CART begins with broad risk coverage, follows weaknesses that eme...

Dong-Dong Zhang, Teng-Chao Lv, Yi-Ling Jia et al. · 0 citations
Preprint Aug 2026

GitSkills: A Dataset of Agent Skills on GitHub

GitSkills is presented, a dataset of 3,797,117 $\mathrm{SKILL.md}$ files collected from 282,200 public repositories in July 2026, which retains every file occurrence with its repository, path, and content hash.

Giuseppe Destefanis, Daniel Graziotin, Matteo Vaccargiu et al. · 1 citation
Preprint Jul 2026

SIGIL: Compiling Agent Skills into Typed Harnesses

Skill Compilation is introduced, realized in SIGIL, which compiles a prose skill into an executable harness, and is model-independent: the harness holds at 86% across two model generations while prose swings from 56% to 68%.

Jayanaka L. Dantanarayana, Savini Kashmira, Lingjia Tang et al. · 0 citations

Related blog posts

Hugging Face Blog Oct 20, 2026

MPS in PyTorch 2.15

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.