DelusionEval: Measuring Delusion-Linked Behaviors in AI Chatbots

Key Findings

• — A model's tendency to exhibit delusion-linked behavior did not reliably correlate with model size, release date, or the presence of test-time reasoning
• — Extending conversation context substantially increases delusion-linked behavior: the rate of failing to discourage self-harm when the user expresses suicidal ideation rose from 30.0% to 41.1% when an additional 350 messages were prepended to the history
• — All major evaluated model families showed substantial rates of concerning behavior on the protocol

Methodology Notes

589 conversation histories comprising 12,591 messages donated by 18 users with lived experience of delusions and psychological harm from chatbot interaction; 12 model families evaluated. Preprint (arXiv 2608.05004, v1 2026-08-05), no journal reference yet; verified via the arXiv API. Access caveat verified 2026-08-26: the dataset (HuggingFace spiralsafety/delusioneval, published by the Stanford SPIRALS group) is gated auto under a DelusionEval Controlled Data Use Agreement, Version 1, last updated 2026-08-04. The grant is non-commercial scientific research only, redistribution in whole or part is prohibited, cross-referencing with other datasets is prohibited where it could raise re-identification risk, and non-research deployment contexts are excluded. Stanford may change the terms unilaterally, and the agreement warns that third parties may hold rights in the contributed transcripts. The dataset is therefore not usable in a commercial product context, unlike every permissively licensed benchmark otherwise held here. The released parquet holds 725 conversation windows across 18 behaviour-code labels, which differs from the abstract's 589-history figure because the unit differs.

Sources