Conversational AI and Emerging Psychosis: A Simulation Study of Potentially Iatrogenic Response Patterns
Three consumer chatbot systems (ChatGPT Free, ChatGPT Plus and Gemini Free) each completed three versions of a 21-turn conversation derived from a clinical case of emerging paranoid delusions, under baseline, emotional and reinforcement-pattern prompt conditions, producing nine conversations and 189 responses. Two psychosis experts blind to the study hypotheses coded every response against a scheme built to identify potentially iatrogenic behaviour. The authors report problematic patterns across all three systems and recommend none of them for this clinical scenario.
Publisher
PsyArXiv (Universidad Francisco de Vitoria; Durham University)
Published
6 Aug 2026
Added
3 days ago
Key Findings
- 39 of 189 responses (20.6%) met predefined criteria for critical errors
- Severity ratings increased as the simulated psychotic symptoms escalated across the 21 turns
- Coded problem categories were omission of assessment and support, premature recommendations, simulation of affective bonding, reinforcement of paranoid interpretations, and promotion of safety-seeking behaviours
- Gemini generated significantly more dysfunctional patterns than ChatGPT Plus
- Prompt condition (baseline, emotional, reinforcement-pattern) had no significant effect on chatbot behaviour
Methodology Notes
Simulation study built from a single clinical case, so the unit counts are nine conversations and 189 responses rather than a sample of users; generalisation beyond this scenario family is untested. Two raters blind to hypotheses. Products were tested as deployed on free and paid consumer tiers rather than via API, and no model version identifiers are given, so the results will date quickly. Not peer reviewed. Independently surfaced by two beats this sweep. Verified against the OSF API preprint record (title, all four contributors, date_published 2026-08-06, preprint DOI) with the full abstract read from that record; the OSF landing page is a JavaScript shell to fetchers, and api.osf.io plus osf.io/download is the working route.
Sources
PsyArXiv preprint (OSF) (primary)
Archived snapshot (Wayback Machine) — preserved against link rot
Authors
Inés Abalo-Rodríguez, Rebeca Pardo Cebrián, Roman D. Moreno-Fernandez, Ben Alderson-Day
Tags
Cite This
APA
Inés Abalo-Rodríguez et al. (2026). Conversational AI and Emerging Psychosis: A Simulation Study of Potentially Iatrogenic Response Patterns. PsyArXiv (Universidad Francisco de Vitoria; Durham University). https://osf.io/preprints/psyarxiv/25c4h
Related Insights
How LLMs Respond to Escalating Delusions: Four Longitudinal Trajectories of Model Behavior
arXiv preprint · 13 Aug 2026
Characterizing Delusional Spirals through Human-LLM Chat Logs
ACM (Proceedings of FAccT 2026) · 25 Jun 2026
Artificial intelligence (AI) psychosis: mechanisms, clinical risks and safety considerations in generative AI chatbots
BJPsych Open (Cambridge University Press / Royal College of Psychiatrists) · 11 Jun 2026
Technological folie à deux: feedback loops between AI chatbots and mental health
Nature Mental Health · 10 Mar 2026
Using LLM-as-a-Judge/Jury to Advance Scalable, Clinically-Validated Safety Evaluations of Model Responses to Users Demonstrating Psychosis
Proceedings of the IASEAI Conference (published by AAAI) · 15 Jul 2026