Benchmark / dataset Credible

The Psychogenic Machine: Simulating AI Psychosis, Delusion Reinforcement and Harm Enablement in Large Language Models

Introduces psychosis-bench, a benchmark of 16 structured multi-turn scenarios (12 turns each) simulating the progression of erotic, grandiose, and referential delusions to measure delusion confirmation, harm enablement, and safety intervention in LLMs. Eight models were evaluated across 1,536 conversation turns.

Read at arxiv.org Archived copy

Publisher

arXiv (King's College London-led)

Published

13 Sept 2025

Added

yesterday

DOI

10.48550/arXiv.2509.10970

Key Findings

Mean Delusion Confirmation Score of 0.91 across eight models — a strong tendency to perpetuate rather than challenge delusions
Models frequently enabled harmful requests and rarely offered safety interventions
Performance degraded markedly on implicit versus explicit delusional scenarios

Methodology Notes

Preprint (arXiv, v1 2025-09-13, v2 2025-09-17). Scripted multi-turn simulation with quantitative scoring rubrics (delusion confirmation, harm enablement, safety intervention); simulated rather than real-user conversations.

Sources

arXiv abstract (primary)

Archived snapshot (Wayback Machine) — preserved against link rot

Topics

Chatbot psychosis Crisis detection Guardrails & moderation Benchmarks Eval methodology

Authors

Joshua Au Yeung, Jacopo Dalmasso, Luca Foschini, Richard J. B. Dobson, Zeljko Kraljevic

Cite This

APA

Joshua Au Yeung et al. (2025). The Psychogenic Machine: Simulating AI Psychosis, Delusion Reinforcement and Harm Enablement in Large Language Models. arXiv (King's College London-led). https://arxiv.org/abs/2509.10970