Assessing Suicide Risk in Arabic Crisis Helpline Calls: A Comparison of Arabic and English Large Language Models

Key Findings

• — 383 calls were included: 373 for the at-risk task (52.3% positive) and 297 for the high-risk task (30.0% positive)
• — The best Arabic model reached a macro-F1 of 81.19 and a ROC-AUC of 90.61 on the high-risk task; the best English model reached 85.00 and 92.59, identifying 88.9% of high-risk calls
• — High-risk calls separated more cleanly than at-risk calls in both languages, and translation to English did not reduce the best observed performance
• — The authors conclude suicide risk can be classified from de-identified Arabic transcripts without sending audio outside the helpline

Methodology Notes

arXiv 2609.00191, v1 submitted 2026-08-31 (announced 2026-09-02); no venue or DOI stated. Affiliations read from the PDF title block: Yale Department of Emergency Medicine, American University of Beirut Department of Epidemiology and Population Health, and Embrace Mental Health Center in Beirut (the helpline operator). Single helpline, single country, limited period; only 545 of 987 de-identified transcripts matched a service record and calls over ten minutes fell outside the eligibility window; no word-error-rate measurement of the speech recognition against hand transcripts; labels are the operator's recorded C-SSRS assessment rather than independent clinical review. The authors state the models do not predict suicidal behaviour, which was never observed. Code repositories on GitHub (Arabic_transcribe_deidentify and Arabic_Suicide_project) verified live.

Sources