Skip to content

Performance-Driven Demonstration Selection for In-Context Learning

· 0 citations · 27 references

TL;DR

Performance-Driven Demonstration Selection (PDDS), which directly aligns demonstration selection with ICL performance, is proposed, which formulates selection as predicting the target LLM’s downstream task performance for a given query–in-context pair, replacing proxy heuristics with a performance-aware objec-tive.

View source

Similar papers

Preprint Aug 2026

From Specialization to Generalization: Instruction-tuned LLMs for Robust Harmful Content Mitigation

By thoroughly unifying 36 English hate speech datasets spanning multiple labeling schemes, this work fine-tune a generalist LLM, based on Qwen3 (Qwen Team, 2025), specifically for hate speech mitigation, demonstrating not only state-of-the-art performance on in-domain benchmarks but also substantial improvements in cross-domain and cross-lingual generalization--areas where encoder-based specialist classifiers often struggle.

Lukas Edman, Daryna Dementieva, Alexander Fraser · 0 citations
#small language model Preprint Aug 2026

StrategyBench: Evaluating Explicit Strategy Induction in Large Language Models

This work proposes StrategyBench, which selects strategy-inducible tasks from BIG-Bench, constructs reference strategies, and defines evaluation metrics along two dimensions: strategy quality and downstream utility, and experiments show that explicit strategy utility differs substantially across task categories and depends on both strategy generation and execution conditions.

Jinghan Tan, Yuanzhe Wang, Lu Chen et al. · 0 citations
Preprint Jul 2026

TAPR: Enhancing LLM Performance with a Task-Aware Prompt Rewriter

This work introduces a Task-Aware Prompt Rewriter (TAPR), a model that reformulates user prompts into task-optimized prompts with the explicit goal of improving downstream LLM performance.

Oliver Savolainen, E. Bastianelli, H. Azarbonyad · 1 citation
Book Open access Jul 2026

Rank-ICL: Ranking-based In-context Learning for Search Result Explanation

Evaluation on WikiSA and ExaRank shows that ranking-based few-shot prompting generally improves over zero-shot prompting and achieves competitive performance against random-shot prompting, indicating that retrieval-based demonstration selection is beneficial but not uniformly superior in all settings.

A. Laksito, Aali Alqarni, Mark Stevenson · 0 citations
Preprint Jul 2026

Aligning Language Models with Selective Prediction

A novel alignment framework, Reinforcement Learning for Selection Reward (RLSR), is proposed, which targets the area under the risk-coverage curve (AURC) -- a popular SP performance metric -- as its alignment objective and achieves substantially better risk-coverage trade-off compared to multiple alignment baselines on both in-domain and out-of-domain tasks.

Gaoxiang Luo, Yi-Fan Wu, Sinian Zhang et al. · 0 citations
Preprint Jul 2026

SAMPLe: SAM-based Optimizer for Prompt Learning in VLMs

SAMPLe (Sharpness-Aware Minimization Prompt Learning), a plug-in sharpness-aware optimizer that enhances prompt generalizability by accounting for loss landscape sharpness, is introduced, establishing itself as a robust, model-agnostic solution for prompt learning.

Hossein Rajoli, Fatemeh Lotfi, Niloufar Alipour Talemi et al. · 0 citations