Skip to content
Preprint

From Interpretability to Control: Insights from Six Years of the TrustNLP Workshop

Aug 2026 · 0 citations · 67 references
Computer Science

TL;DR

Analysis from the classification study reveals that truthfulness is the fastest-growing dimension, fairness remains the most consistent theme, and explainability exhibits a U-shaped trajectory; declining as post-hoc methods lost relevance but resurging in 2026 through mechanistic interpretability.

Abstract

The Workshop on Trustworthy Natural Language Processing (TrustNLP), co-located with major ACL conferences since 2021, has grown from 8 proceedings papers to 41 over six editions, documenting a field-wide transition from post-hoc interpretability of static models to mechanistic understanding and proactive control of generative systems. We synthesize insights from all 144 proceedings papers, classifying them along six trust dimensions grounded in established frameworks (TrustLLM, DecodingTrust). We observe co-occurrences with capability emergence. The release of the first high-impact chat models activated all trust dimensions simultaneously, while subsequent model generations shifted focus toward truthfulness and safety alignment. Analysis from the classification study reveals that truthfulness is the fastest-growing dimension (absent in 2021-2022, comprising 37% of papers by 2025-2026), fairness remains the most consistent theme, and explainability exhibits a U-shaped trajectory; declining as post-hoc methods lost relevance but resurging in 2026 through mechanistic interpretability. A cross-venue comparison with ACL, NAACL, EACL, and EMNLP (~2K papers) in the same period shows that TrustNLP's topical distribution closely follows the field average. We identify four structural insights and conclude with actionable directions for the research community.

View source

Similar papers

#machine learning Preprint Sep 2026

LLM4Trust: Exploring the Capabilities of Large Language Models for Trust Evaluation

LLM4Trust is proposed, the first benchmark framework that systematically explores the capabilities of Large Language Models for trust evaluation and proposes a defense mechanism and batch inference to improve the robustness and efficiency of LLM-based trust evaluation.

Jie Wang, Yan-Bo Sun, Zheng Yan et al. · 0 citations
#natural language process... Preprint Oct 2026

Identifying Introspection From the Inside

This paper identifies mechanistic signatures of faithful self-report in a controlled setting and proposes that it is possible to distinguish between the two patterns of computation by examining the structure of the networks themselves.

David Atkinson, Dillon Plunkett, David Bau · 0 citations
#artificial intelligence Preprint Sep 2026

Multi-Channel Mitigation of Source-Trust Shortcuts in Fact-Checking RL Agents

Retrieval-augmented fact-checkers often receive a reliability label, such as HIGH or LOW trust, for each evidence source. These labels should adjust the model's confidence and its decision to search for more evidence, while the verdict should follow the evidence content. We introduce TrustSwap, a counterfactual test th...

Jian-Chang Su, Yi-Wei Yang, Wei Zhang · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.