A Framework for Evidence-Based Psychotherapy with AI (EBP-AI)

Abstract

Artificial intelligence (AI) systems and large language models (LLMs) offer substantial potential to augment or even fundamentally change elements of psychological assessment and treatment. However, current AI technologies have yet to demonstrate the capacity to effect meaningful and sustained clinical change. This gap reflects both the limited integration of clinical science knowledge into language models and applications built using them, as well as the mismatch between the brief, minutes-long nature of most AI interactions and the months-long course of most evidence-based treatments. Here we introduce the Evidence-Based Psychotherapy with AI (EBP-AI) framework, which articulates a set of principles for developing effective clinical AI applications: a) psychodiagnostic assessment, b) longitudinal case conceptualization, c) appropriately dosed intervention planning, d) meaningful progress evaluation, e) rigorous validation with clinical populations, f) attention to real world implementation and use, g) clinically appropriate style, and h) understanding clinical psychology as a living science. We introduce a set of key technical questions for the development and evaluation of clinical LLMs and AIs aligned with these principles. Despite their potential, current clinical AIs fall short, in part due to issues with memory, sycophancy, and prioritizing short-term helpfulness over long-term clinical impact. Responsible and ethical design of effective, clinical-science-based AI systems will require understanding their limitations and strategically extending their capabilities.