Counterfactual fairness audits of clinical language-model agents report a flip rate: how often an action changes when only the patient's demographic descriptor changes. Part of that rate is not demographic. A stochastic agent also changes its own action when nothing changes, and a flip rate cannot be interpreted withou...
Indic text is syntactically compact, semantically ambiguous, and highly context-dependent, making English translation particularly challenging. Traditional neural machine translation (NMT) methods, even when enhanced with pre-trained language models (PLMs) and linguistic features such as part-of-speech (POS) tags, synt...
S. Chauhan, Shefali Saxena, Shweta V. Jain et al.· IEEE Access· 0 citations
Counterfactual audits are the standard tool for checking whether a clinical agent treats demographically distinct but clinically identical patients differently. They report a flip rate: how often an action changes when only the patient descriptor changes. We show that this quantity is uninterpretable on its own. Re-run...