Peer-reviewed & preprints
Research
Academic and clinical scholarship on how conversational AI affects the people who use it — from crisis-response performance to companionship, dependency, and psychosis.
430 entries, newest first
Preprint
"I Just Don't Want to Be a Burden": Investigating AI Chatbot Emotional Support Among People with Suicidal Ideation and Other Mental Health Concerns
Sequential mixed-methods preprint on why people with high-acuity mental-health concerns use AI chatbots for emotional support and what they experience. A first study analysed Reddit posts to build a…
Preprint
Curbside Chatbots: Auditing the Mental Health Interventions Large Language Models Recommend to Clinicians, Caregivers, and Patients
Audit of what 41 language models recommend when the same clinical information reaches them from a clinician describing a patient, a caregiver describing a loved one, or a person describing themselves…
Preprint
CompAIssionate Other: Identity Assumptions in LLM Responses to Distress
Paired counterfactual audit of how six language models respond to suicidal-ideation and distress posts when a one-sentence social-identity disclosure is added. Posts come from two datasets and were s…
Preprint
Open Problems in Chatbots and Mental Health
Position paper reviewing what its authors consider the most critical open problems for researchers and policymakers on general-purpose chatbots and mental health. It groups them into controlled evalu…
Preprint
Safer for Whom? A Systematic Exploration of AI Safety in Eating Disorder Interactions
Evaluates three open-weight language models on 100 questions drawn from an online pro-anorexia community, graded on clinically informed criteria that extend a seven-dimension taxonomy of eating-disor…
Preprint
Path-dependent triage: Early judgments lead conversational AI chatbots to miss mental-health emergencies
Simulation study of 13 chatbots holding 10-turn conversations with an LLM-simulated user seeded from 112 structured mental-health case files with clinician-validated urgency labels. Chatbots under-tr…
Preprint
Rating Chatbot Responses to Mental Health Prompts: Rubric Development and Cross-Sectional Evaluation Study (Preprint)
Two clinicians developed a rubric of 4 to 8 binary safety and competence criteria for each of 15 Danish-language mental health prompts spanning paranoid delusion, elevated mood, suicidal ideation, de…
Preprint
Remembering Is Not Enough: Evaluating Timing and Omission in Longitudinal AI Mental Health Support
Analyses 14,256 longitudinal simulations grounded in chatbot histories donated by 22 users (median 364 sessions each) to test how a memory-equipped assistant responds to suicidal ideation, self-harm…
Preprint
Measuring Risk, Not Harm: Detecting Psychological Harm Risk Factors in LLM Conversations
Proposes monitoring psychological-harm risk through observable AI response behaviours rather than latent user harm. The authors operationalise eight behaviours (claiming consciousness, human experien…
Preprint
SAFE-Teen: Evaluating Chatbot Safety Across Adolescent Mental Health Conversations
Clinician-informed evaluation of 18 chatbot APIs in simulated conversations with adolescents aged 13-17, run with and without a teen-aware system prompt. Conversations span 983 variants of 106 clinic…
Peer-reviewed
Artificial intelligence use during suicidal crises in adolescents and young adults: a case series from emergency psychiatry
Retrospective observational case series from the psychiatric emergency department of Toulouse University Hospital, France (January to May 2025). Seven patients aged 15 to 23 who reported using ChatGP…
Peer-reviewed
EMPATH: A Multilingual Auditor-Judge Benchmark for Safety Evaluation of Emotional-Support Chatbots
A safety benchmark for emotional-support chatbots in which an auditor model role-plays help-seeking users across multi-turn conversations built from 140 seed instructions and 34 personas, and a judge…
Peer-reviewed
“AI psychosis” in context: how conversation history shapes LLM responses to delusional beliefs
Peer-reviewed version of a study testing how accumulated conversation history changes large language model responses to a user expressing escalating delusional beliefs. Five models answered the same…
Preprint
The Customer Never Sees the Goal: Measuring and Detecting Vulnerability-Targeted Manipulation in LLM Assistants
Studies operator-induced vulnerability-targeted manipulation: a customer-advice assistant is given a goal the customer never sees and pursues it by exploiting a vulnerability the customer discloses.…
Peer-reviewed
Generative Artificial Intelligence and Maternal Health Outcomes in Pregnant and Postpartum Individuals: A Randomized Clinical Trial
Two-group randomized clinical trial of access to a generative AI maternal health chatbot versus an active control (monthly children's books) among pregnant or parenting people from racial and ethnic…