Aug 2026· Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care· Vol 15, pp. 57 - 61· 0 citations· 53 references
TL;DR
A list of eight best practices was created to assist developers with designing AI systems in a way that would reduce the overall risk of harm for users attempting to use their AI for mental health cases.
Abstract
Artificial intelligence (AI) systems, particularly large language models (LLMS) or chatbots, have been gaining increased popularity in recent years. Users will sometimes use these models for personal mental health assistance. This review aimed to expand the topic and to further understanding of AI’s effectiveness in these use cases. A total of 51 different research articles were examined, leading to themes of interaction quality, explainability, trust, ethical concerns, and anthropomorphism being discussed. In addition to the themes, a list of eight best practices was created to assist developers with designing AI systems in a way that would reduce the overall risk of harm for users attempting to use their AI for mental health cases. While AI is no substitute for a clinician, there are areas in which these systems can perform well and help foster the clinical relationship, but proper user experience design principles should be maintained throughout the process to ensure efficacy and user safety.
The findings indicate that AI is potentially able to stimulate accessibility, engagement, and temporary relief of symptoms, but future research should focus on long-term outcomes and safeguards to ensure safe, transparent integration into mental health care.
To maximise the health benefits for the public, AI should be used to construct an auxiliary triage system that supports human clinicians and enables appropriate referrals when needed, and presents a dual-edged nature of AI.
Qin Gu· Frontiers in Humanities and...· 0 citations
Evidence suggests that while AI tools can temporarily reduce symptoms and improve accessibility to professional help for mild to moderate conditions, they are less effective in cases of severe or complex disorders.
Nan-Xi Zhang· Theoretical and Natural Scie...· 0 citations
This article shows how the Technology Acceptance Model and Technology Trust are combined in the Unified Theory of Acceptance and Use of Technology (UTAUT) and how the Perceived Empathy Model (PEM) and Perceived Clarity of Accountability Model (PCA) are extensions of these models.
Evidence suggests that purpose-built chatbot coaching systems may have some benefits as they are generally well received and can support short-term motivation and selected behavior change, but effects for sustained, meaningful outcomes are inconsistent.
Jason T. Potel, M. Kumashiro· Behavioral Science· 0 citations
There is an urgent need for clear national and hospital-level policies to support safe, regulated integration of AI into clinical practice to support safe, regulated integration of AI into clinical practice.
W. Sivakumar, R. Ajeet Singh, D. Hennessey· British Journal of Surgery· 0 citations