CALICO is presented, a human-centered, codebook-aligned annotation workflow that treats prompts as editable, versioned, and optimizable artifacts and integrates codebook parsing, prompt generation, result inspection, prompt versioning, natural language human feedback, and label-supervised prompt optimization through ex...
Harbor Adapters are developed that port more than 80 benchmarks to evaluate arbitrary agents, and validated through rigorous code review and parity experiments, and Harbor-Index is introduced, a curated set of 82 difficult, diverse, and high-quality tasks spanning 29 benchmarks to support more reliable and comprehensiv...
Lin Shi, Hao-Wei Lin, Zi-Xuan Zhu et al.· 1 citation
Together, these results support multi-view repository-context serving with explicit, operation-specific validity boundaries with quality-cost frontiers across the repository-context lifecycle.