XTC: Head-Aware Sampling by Excluding Top Choices
This work introduces XTC (Exclude Top Choices), a lightweight head-aware decoding operator that targets this regime of open-ended generation in which several continuations are plausible but too much probability mass remains concentrated on the most generic choice.