How safety gets measured
Benchmarks & Datasets
Evaluation suites, test sets, and datasets for measuring conversational-AI safety — the instruments behind the claims.
78 entries, newest first
Benchmark / dataset
Auditing Chatbots for Incursion into Professional Legal Practice
Introduces UPLBench, a benchmark built from 65 court decisions in 33 state and federal forums that found unauthorized practice of law in high-stakes domains (immigration, bankruptcy, personal injury,…
Benchmark / dataset
Can AI Get Immigration Right?
Benchmark report from Vals AI and the Talent Mobility Fund evaluating how 25 AI models answer U.S. immigration-law questions posed by people who rely on AI for their own immigration situation. Immigr…
Benchmark / dataset
When Health Assistants Agree Too Readily: A Benchmark of Time-Critical Self-Diagnosis
SelfDx is a paired benchmark testing whether models agree with a user's own benign explanation of symptoms when a time-critical alternative remains possible. Each of 100 pairs contrasts a caution cas…
Benchmark / dataset
VEILED-SH: Vulnerability Expression through Indirect Language Evaluation Dataset (Self-Harm)
Benchmark and construction method for evaluating single-turn AI responses to indirect, culturally situated expressions of suicide, self-harm and distress. Its 10,003 prompts draw on Singapore-grounde…
Benchmark / dataset
When Empathy Misses the Goal: A Benchmark for Goal Displacement in LLM Advice
Benchmark measuring goal displacement, defined as an LLM substituting warmth and reassurance for content that advances the user stated goal in advice conversations. GDB has 230 author-written single-…
Benchmark / dataset
Open Benchmark of AI Impact on Humans (ImpactBench): an expert-guided, open platform for the holistic evaluation of AI impact on humans
Preprint introducing ImpactBench, an open, expert-guided benchmark platform that translates constructs from domain experts and 26 existing benchmarks into 809 behavioural metrics of whether model beh…
Benchmark / dataset
DistressBench: Evaluating Multi-Dimensional Crisis Support in Large Language Models
Benchmark of 718 English suicide and self-harm crisis conversations whose user turns were written by licensed clinicians and crisis counsellors, spanning 23 subcategories, each paired with a task-spe…
Benchmark / dataset
SAFE-Teen: Teen Mental Health & Safety
Benchmark page from Vals AI evaluating how AI chatbots respond when a teenager aged 13-17 seeks support for mental-health and safety concerns. Clinicians wrote 106 fictional teen scenarios across thr…
Benchmark / dataset
RELATE: An Evaluation Framework for measuring Relational Orientation of Large Language Models
Defines relational orientation for emotional-support language models along two non-exclusive dimensions: inward-facing language that positions the AI as the user's ongoing source of support, and outw…
Benchmark / dataset
Overview of eRisk 2026 Early Risk Prediction on the Internet: Symptom Ranking and Conversational Approaches for Depression and ADHD (Extended Overview)
Organisers' overview of the tenth eRisk lab at CLEF 2026. It covers three shared tasks on early risk detection for mental health. In Task 1, systems hold conversations with 20 fine-tuned LLM personas…
Benchmark / dataset
HarmReduction: Benchmarking LLMs in Harm Reduction Information Provision to Support People Who Use Drugs
Peer-reviewed benchmark for the accuracy and safety of large language model answers to harm reduction questions from people who use drugs. The HR-Basic dataset has 2,160 question-answer-evidence pair…
Benchmark / dataset
Mental Health Evaluation Harness (mheval) and Mental Health Evaluation Leaderboard
Open-source evaluation harness and public leaderboard that run nine published mental-health benchmarks for language models from their original repositories, with pinned commits, checksum-verified dat…
Benchmark / dataset
FIGS: Evaluating Multi-Turn Sycophancy Without Penalizing Empathy
Benchmark that scores sycophancy and calibrated validation (acknowledging a user's feelings without yielding) as separate axes over ten-turn conversations driven by an adaptive user simulator. It rel…
Benchmark / dataset
Sense and Sensitivity: Benchmarking LLM Clinical Triage Recommendations with Physician Experts
Benchmark comparing language-model and physician triage recommendations (self-manage at home, in-person visit, tests or referral) on clinical cases, including patient-written Reddit r/AskDocs posts,…
Benchmark / dataset
Raising the Bar for Chinese Adolescent LLM Safety: A Culturally-Grounded, Fine-Grained Benchmark
Chinese-language benchmark (QH-Bench) for adolescent conversational safety with a single-turn track of 715 items across 10 risk domains and a multi-turn track of 100 four-turn trajectories that cross…