Preprint Preliminary

TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Health

Introduces a benchmark measuring LLM trustworthiness in mental-health contexts across eight pillars: Reliability, Crisis Identification and Escalation, Safety, Fairness, Privacy, Robustness, Anti-sycophancy, and Ethics. Finds even strong models struggle to perform consistently across all safety-critical dimensions.

Read at arxiv.org Archived copy

Publisher

arXiv

Published

3 Mar 2026

Added

today

DOI

—

Key Findings

Defines eight trustworthiness pillars including Crisis Identification and Escalation and Anti-sycophancy
Even leading models fail to hold up consistently across all safety-critical dimensions
Provides a multi-dimensional evaluation framework rather than a single aggregate score

Methodology Notes

Preprint (arXiv 2603.03047, v1 3 March 2026). Multi-pillar benchmark spanning general-purpose and specialised mental-health models.

Sources

arXiv abstract (primary)

Archived snapshot (Wayback Machine) — preserved against link rot

Topics

Benchmarks Eval methodology Crisis detection Sycophancy

Authors

Zixin Xiong, Ziteng Wang, Haotian Fan, Xinjie Zhang, Wenxuan Wang

Cite This

APA

Zixin Xiong et al. (2026). TrustMH-Bench: A Comprehensive Benchmark for Evaluating the Trustworthiness of Large Language Models in Mental Health. arXiv. https://arxiv.org/abs/2603.03047

Related Insights

Peer-reviewed

When Can We Trust LLMs in Mental Health? Large-Scale Benchmarks for Reliable LLM Evaluation

Association for Computational Linguistics (EACL 2026) · 24 Mar 2026

Benchmark / dataset

VERA-MH: Reliability and Validity of an Open-Source AI Safety Evaluation in Mental Health

arXiv (Spring Health / Slingshot AI-affiliated author team) · 4 Feb 2026