Curbside Chatbots: Auditing the Mental Health Interventions Large Language Models Recommend to Clinicians, Caregivers, and Patients
Audit of what 41 language models recommend when the same clinical information reaches them from a clinician describing a patient, a caregiver describing a loved one, or a person describing themselves. Across 19 case vignettes and five questions the authors collected 35,055 free-text responses, extracted every named intervention with a validated judge, and had 29 models rate the option lists on a seven-point scale. The authors state they will release the instrument, code and corpus on publication.
Publisher
Beth Israel Deaconess Medical Center, Division of Digital Psychiatry (arXiv preprint)
Published
9 Nov 2026
Added
3 days ago
DOI
—
Key Findings
- Models recommended consulting a professional in 95% of responses to caregiver and patient footings, against 66% for the same vignettes written from the clinician footing (56% and 58% of clinician-footing responses for therapy and medication asks).
- A 'not a doctor' disclaimer appeared in 14% of caregiver and patient responses and 6% of clinician responses; 21 models included it in under 2% of responses while Qwen 3.5 Plus included it in 91%.
- The responses named 494,328 interventions, of which 91.2% were recommended and 8.8% advised against; when asked about a specific intervention type, models more often named options they themselves rated below zero as initial choices, usually with conditions attached.
Methodology Notes
Preprint (arXiv 2611.12814, submitted 9 November 2026), not peer reviewed. 19 vignettes, five questions, 41 models, 35,055 open-ended responses; a second arm had 29 models give 19,836 seven-point ratings. Interventions were extracted by an LLM judge validated against human coders. Figures verified by the curator in the arXiv HTML full text on 2026-11-12. The corpus and code are announced for release on publication and were not available at time of logging.
Sources
arXiv:2611.12814(opens in a new tab) (primary)
arXiv HTML full text(opens in a new tab)
Archived snapshot (Wayback Machine)(opens in a new tab) — preserved against link rot
Topics
Authors
Matthew Flathers, Jill Noorily, Phuong Anh Nguyen, Mark Kalinich, Mina Fallah, Victoria Lisowski, Christine Shi, Rebekah M. Bodner, Anna Simms, Mihika Hete, Meiting Chen, Samuel K. Powell, Tatum Williamson, Laura Ospina-Pinillos, Haruka Notsu, Julian Herpertz, John Torous
Tags
Cite This
APA
Matthew Flathers et al. (2026). Curbside Chatbots: Auditing the Mental Health Interventions Large Language Models Recommend to Clinicians, Caregivers, and Patients. Beth Israel Deaconess Medical Center, Division of Digital Psychiatry (arXiv preprint). https://arxiv.org/abs/2611.12814