Fair Fact-Checking: Closing the Cross-Lingual Gap in LLM Factual Judgement with RoSh
RoSh is proposed, a per-language shift and rotation of the residual stream, computed in closed form at three layers, with no training and no weight modified, that improves every model and closes 75% of the gap on average, helping most where the model was worst.