Skip to content

Beyond Prompt or Skill? Attribution-Guided Optimization of Modular LLM Programs

Sep 2026 · arXiv.org · Vol abs/2609.32492 · 0 citations · 32 references
Computer Science

TL;DR

SPARO (Skill, Prompt, And Routing Optimization), a framework that jointly optimizes task instructions, reusable skill blocks, and routing rules, is proposed, suggesting that effective language-program optimization depends not only on discovering useful task knowledge, but also on deciding where that knowledge should be stored and when it should be activated.

Abstract

Large language models can solve increasingly diverse reasoning tasks, yet their performance remains highly sensitive to task prompts, intermediate instructions, and the way reusable problem-solving knowledge is incorporated. Existing optimization methods usually focus on only one part of this design space: they either optimize a monolithic prompt, or separately induce and refine skills from model traces. As a result, they lack a principled mechanism for deciding which component should be updated when failures occur, and they rarely optimize prompts, skills, and skill-use policies in a unified framework. We propose SPARO (Skill, Prompt, And Routing Optimization), a framework that jointly optimizes task instructions, reusable skill blocks, and routing rules. It performs controlled counterfactual evaluations, converts examples'effects into a probabilistic responsibility distribution over prompt, skill, and routing components, samples one component from that distribution, and applies the corresponding targeted mutation. This design moves language-program optimization beyond global prompt rewriting toward structured, reusable, and selectively activated task knowledge. Across five benchmarks and five worker models, SPARO consistently outperforms both prompt-centered and skill-centered optimization baselines. These results suggest that effective language-program optimization depends not only on discovering useful task knowledge, but also on deciding where that knowledge should be stored and when it should be activated.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

OptiSkill: A Hierarchical and Evolving SkillBank for LLM-Based Optimization Modeling

Automated operations research (OR) modeling requires LLMs to translate natural-language decision problems into correct mathematical programs. Existing methods can improve individual formulations, but they often solve problems in isolation, retaining little reusable experience and repeating similar formulation errors. P...

Rui Zhao, Rui Liu, Yuan Zuo et al. · 0 citations

StraTune: Adaptive Selection of Revision Operators for Self-Evolving LLM Skills

StraTune (strategy-guided skill tuning), which lets a frozen optimizer LLM choose the revision operator at every round from the optimization state, which is defined as the current execution feedback together with the recorded outcomes of earlier strategies and forms.

Ze-Ping Liu, Yan Li, Ni Lao et al. · 0 citations

Prompt2Skill: Unsupervised Skill Optimization From Natural Language Instructions

Skills are external artifacts that Large Language Models (LLMs) consume at inference time to improve their performance on specialized domains by incorporating relevant procedural and domain knowledge. Expert-authored skills are expensive to produce, and the resulting artifacts are not optimized for the specific model t...

B. Ni, Li Li, Ryan A. Rossi et al. · 0 citations
Review Aug 2026

DynaContext: Self-Improving Dynamic Contextualization of Optimized Prompts for Heterogeneous Parameter Extraction

DynaContext is introduced, a framework that combines an offline-optimized extraction core, learned with GEPA or SkillOpt, with inference-time contextual adaptation and validation-gated self-improvement, with inference-time contextual adaptation and validation-gated self-improvement.

Joe Yu, Shibin Thomas Stanley Paul, Sven Mayer · 0 citations
#artificial intelligence Preprint Oct 2026

SkillSandbox: Skill Verification via Dynamic Scenario Synthesis

SkillSandbox is proposed, a framework that dynamically synthesizes a task and its environment for each skill that are skill-relevant yet novel that yields the strongest downstream performance and improved execution efficiency across ALFWorld and WebShop with three models.

Serin Kim, Kwangwook Seo, Dok-Yung Song et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.