Evaluating Reasoning LLMs for Suicide Screening with the Columbia-Suicide Severity Rating Scale
Tests six LLMs on classifying posts across the Columbia-Suicide Severity Rating Scale (C-SSRS) 7-point severity ladder, comparing model outputs with human annotations. Assesses automated suicide-risk screening and characterises misclassification patterns.
Publisher
arXiv
Published
11 May 2025
Added
today
DOI
—
Key Findings
- Claude and GPT models aligned closely with human C-SSRS annotations; ordinal error varied across models
- Models can approximate C-SSRS severity classification but make consequential misclassifications
- Authors stress human oversight remains necessary for any deployment
Methodology Notes
Preprint (arXiv 2505.13480, v1 11 May 2025). Six LLMs evaluated on C-SSRS 7-point severity classification against human annotations.
Sources
arXiv abstract (primary)
Archived snapshot (Wayback Machine) — preserved against link rot
Authors
Avinash Patil, Siru Tao, Amardeep Gedhu
Tags
Cite This
APA
Avinash Patil, Siru Tao, Amardeep Gedhu (2025). Evaluating Reasoning LLMs for Suicide Screening with the Columbia-Suicide Severity Rating Scale. arXiv. https://arxiv.org/abs/2505.13480
Related Insights
Evaluation of Alignment Between Large Language Models and Expert Clinicians in Suicide Risk Assessment
Psychiatric Services (American Psychiatric Association); RAND-led author team · 26 Aug 2025
Large language models for psychosocial risk assessment: A multi-method evaluation across suicide, intimate partner violence, and substance misuse
PLOS Digital Health · 27 Apr 2026
A machine learning approach to identifying suicide risk among text-based crisis counseling encounters
Frontiers in Psychiatry · 23 Mar 2023