Challenges of Auditing: Variability in Outputs of Large Language Models for Health
People increasingly use frontier AI models for health advice, but via different access modes (e.g., ChatGPT, ChatGPT Health, APIs) with varying settings. Here, we find systematic differences across access modes. Because evaluations typically rely on APIs while consumers interact through chatbot interfaces, these discre...
Yuan Pu, Yew-On Chang, Fu-Rong Jia et al.
· 0 citations