INCONVENIENT: A Benchmark to Assess LLM Generalization Capabilities from Convenience Samples
INCONVENIENT is introduced, a benchmark designed to study robustness to convenience-sample bias and provides explicit control over both the direction and severity of relationship shifts, enabling a systematic assessment of robustness to convenience sampling.