Skip to main content

How safety gets measured

Benchmarks & Datasets

Evaluation suites, test sets, and datasets for measuring conversational-AI safety — the instruments behind the claims.

78 entries, newest first

13 Nov 2026 University of California, Berkeley and Swarthmore College authors (arXiv preprint) Benchmark / dataset

Benchmark / dataset

Auditing Chatbots for Incursion into Professional Legal Practice

Introduces UPLBench, a benchmark built from 65 court decisions in 33 state and federal forums that found unauthorized practice of law in high-stakes domains (immigration, bankruptcy, personal injury,…

28 Oct 2026 Vals AI and the Talent Mobility Fund (a program of Renaissance Philanthropy) Benchmark / dataset

Benchmark / dataset

Can AI Get Immigration Right?

Benchmark report from Vals AI and the Talent Mobility Fund evaluating how 25 AI models answer U.S. immigration-law questions posed by people who rely on AI for their own immigration situation. Immigr…

20 Oct 2026 arXiv (Pareto Inc; NYU Langone) Benchmark / dataset

Benchmark / dataset

When Health Assistants Agree Too Readily: A Benchmark of Time-Critical Self-Diagnosis

SelfDx is a paired benchmark testing whether models agree with a user's own benign explanation of symptoms when a time-critical alternative remains possible. Each of 100 pairs contrasts a caution cas…

19 Oct 2026 arXiv (GovTech Singapore; MOH Office for Healthcare Transformation; Singapore University of Technology and Design; National University of Singapore; Nanyang Technological University; University of British Columbia) Benchmark / dataset

Benchmark / dataset

VEILED-SH: Vulnerability Expression through Indirect Language Evaluation Dataset (Self-Harm)

Benchmark and construction method for evaluating single-turn AI responses to indirect, culturally situated expressions of suicide, self-harm and distress. Its 10,003 prompts draw on Singapore-grounde…

18 Oct 2026 arXiv (Ben-Gurion University of the Negev; Tel Aviv University; Clalit Health Services) Benchmark / dataset

Benchmark / dataset

When Empathy Misses the Goal: A Benchmark for Goal Displacement in LLM Advice

Benchmark measuring goal displacement, defined as an LLM substituting warmth and reassurance for content that advances the user stated goal in advice conversations. GDB has 230 author-written single-…

14 Oct 2026 arXiv (MIT Media Lab; USC Marshall Neely Center; UC Berkeley Haas School of Business; Psychology of Technology Institute; Carnegie Mellon University; University of Amsterdam; UNC Chapel Hill; Harvard University) Benchmark / dataset

Benchmark / dataset

Open Benchmark of AI Impact on Humans (ImpactBench): an expert-guided, open platform for the holistic evaluation of AI impact on humans

Preprint introducing ImpactBench, an open, expert-guided benchmark platform that translates constructs from domain experts and 26 existing benchmarks into 809 behavioural metrics of whether model beh…

9 Oct 2026 Scale AI (Scale Labs) Benchmark / dataset

Benchmark / dataset

DistressBench: Evaluating Multi-Dimensional Crisis Support in Large Language Models

Benchmark of 718 English suicide and self-harm crisis conversations whose user turns were written by licensed clinicians and crisis counsellors, spanning 23 subcategories, each paired with a task-spe…

8 Oct 2026 Vals AI, in collaboration with Stanford University's SALT Lab Benchmark / dataset

Benchmark / dataset

SAFE-Teen: Teen Mental Health & Safety

Benchmark page from Vals AI evaluating how AI chatbots respond when a teenager aged 13-17 seeks support for mental-health and safety concerns. Clinicians wrote 106 fictional teen scenarios across thr…

7 Oct 2026 arXiv (University of California, Santa Cruz; Stanford University) Benchmark / dataset

Benchmark / dataset

RELATE: An Evaluation Framework for measuring Relational Orientation of Large Language Models

Defines relational orientation for emotional-support language models along two non-exclusive dimensions: inward-facing language that positions the AI as the user's ongoing source of support, and outw…

4 Oct 2026 CLEF 2026 Working Notes (CEUR Workshop Proceedings Vol-4283); Universidade da Coruña IRLab, University of Sheffield, Università della Svizzera italiana Benchmark / dataset

Benchmark / dataset

Overview of eRisk 2026 Early Risk Prediction on the Internet: Symptom Ranking and Conversational Approaches for Depression and ADHD (Extended Overview)

Organisers' overview of the tenth eRisk lab at CLEF 2026. It covers three shared tasks on early risk detection for mental health. In Task 1, systems hold conversations with 20 fine-tuned LLM personas…

1 Oct 2026 Association for Computational Linguistics (EMNLP 2026); University of Oxford, University of Edinburgh, University of St Andrews, Nanyang Technological University Benchmark / dataset

Benchmark / dataset

HarmReduction: Benchmarking LLMs in Harm Reduction Information Provision to Support People Who Use Drugs

Peer-reviewed benchmark for the accuracy and safety of large language model answers to harm reduction questions from people who use drugs. The HR-Basic dataset has 2,160 question-answer-evidence pair…

1 Oct 2026 Slingshot AI Benchmark / dataset

Benchmark / dataset

Mental Health Evaluation Harness (mheval) and Mental Health Evaluation Leaderboard

Open-source evaluation harness and public leaderboard that run nine published mental-health benchmarks for language models from their original repositories, with pinned commits, checksum-verified dat…

30 Sept 2026 arXiv (ELLIS Institute Tübingen; Max Planck Institute for Intelligent Systems; Tübingen AI Center) Benchmark / dataset

Benchmark / dataset

FIGS: Evaluating Multi-Turn Sycophancy Without Penalizing Empathy

Benchmark that scores sycophancy and calibrated validation (acknowledging a user's feelings without yielding) as separate axes over ten-turn conversations driven by an adaptive user simulator. It rel…

29 Sept 2026 arXiv (Massachusetts Institute of Technology); accepted to Findings of EMNLP 2026 Benchmark / dataset

Benchmark / dataset

Sense and Sensitivity: Benchmarking LLM Clinical Triage Recommendations with Physician Experts

Benchmark comparing language-model and physician triage recommendations (self-manage at home, in-person visit, tests or referral) on clinical cases, including patient-written Reddit r/AskDocs posts,…

28 Sept 2026 arXiv (Southern University of Science and Technology; City University of Hong Kong; Lingnan University) Benchmark / dataset

Benchmark / dataset

Raising the Bar for Chinese Adolescent LLM Safety: A Culturally-Grounded, Fine-Grained Benchmark

Chinese-language benchmark (QH-Bench) for adolescent conversational safety with a single-turn track of 715 items across 10 risk domains and a multi-turn track of 100 four-turn trajectories that cross…