When Does Few-Shot Prompting Help? A Systematic Empirical Study of Shot-Count Effects Across Model Scale, Architecture, and Output Parsing Robustness
A controlled study of five LLMs across six shot-count configurations on the AG News four-class benchmark demonstrates that the relationship between shot count and classification performance is not monotonic, not universal, and not predictable from model scale alone.