Mapping the Content and Consistency of Suicidal Thoughts with Large Language Models: A Two-Study Longitudinal Investigation Among Adolescents and Young Adults
Two longitudinal samples of people with past-year suicidal thoughts and behaviours answered open-ended questions about their suicidal urges at baseline and follow-up, and a two-stage LLM topic-modelling pipeline maps what content sits behind a given numeric urge rating. The question is how people translate an internal state into a number on a self-report scale, and how stable that translation is within and between people. Agreement is highest at the ends of the scale and worst in the middle.
Publisher
PsyArXiv (Harvard University; Yale University; McLean Hospital; University of Denver)
Published
31 Aug 2026
Added
today
Key Findings
- Study 1: N = 158 adolescents; Study 2: N = 202 young adults, all with past-year suicidal thoughts and behaviours, completing open-ended items at baseline and follow-ups.
- The pipeline recovered 13 topics of suicidal-thought content in Study 1 and 14 in Study 2, including Family and Friends Reactions and Depressed and Exhausted.
- Within-person and between-person consistency were both U-shaped: agreement is highest at the endpoints of the rating scale.
- The same numeric urge rating therefore carries materially different content across people and across occasions, concentrated in the middle of the scale.
- The authors position LLM topic modelling as a way to advance measurement of suicide risk rather than as a detector.
Methodology Notes
Two longitudinal samples with open-text self-report at multiple timepoints; topics are LLM-derived and therefore inherit the model's clustering choices; the samples are people already reporting past-year suicidal thoughts and behaviours, so this is about measurement within a high-risk group rather than screening. Preprint, not peer-reviewed; v3 posted 2026-08-31 on PsyArXiv (osf.io/preprints/psyarxiv/8jx4u); OSF API record, abstract and contributor list verified.
Sources
Authors
Leily Marieh Behbehani, Ruben van Genugten, Frances Grace Hart, Sharina Hamm, Kathryn Fox, Shirley B. Wang
Tags
Cite This
APA
Leily Marieh Behbehani et al. (2026). Mapping the Content and Consistency of Suicidal Thoughts with Large Language Models: A Two-Study Longitudinal Investigation Among Adolescents and Young Adults. PsyArXiv (Harvard University; Yale University; McLean Hospital; University of Denver). https://osf.io/preprints/psyarxiv/8jx4u
Related Insights
Ground Truths in Suicide Research: The Current State of AI-Based Suicide Detection in Social Media
Association for Computational Linguistics (Proceedings of the 11th Workshop on Computational Linguistics and Clinical Psychology, CLPsych 2026) · 1 Jul 2026
"Mirror" Large Language Model Evaluations of Depression are Criterion Contaminated
arXiv (Washington University in St. Louis; Southern Methodist University) · 7 Aug 2025