293 artifacts matching
Benchmark / dataset
Auditing Chatbots for Incursion into Professional Legal Practice
Introduces UPLBench, a benchmark built from 65 court decisions in 33 state and federal forums that found unauthorized practice of law in high-stakes domains (immigration, bankruptcy, personal injury,…
Preprint
Curbside Chatbots: Auditing the Mental Health Interventions Large Language Models Recommend to Clinicians, Caregivers, and Patients
Audit of what 41 language models recommend when the same clinical information reaches them from a clinician describing a patient, a caregiver describing a loved one, or a person describing themselves…
Framework
Charter of Engagement for Safer AI for Children
Seven-page charter of a coalition led by France, Spain and Kenya with ten United Nations agencies. It sets shared principles for AI systems children may access and commits participating companies to…
Preprint
CompAIssionate Other: Identity Assumptions in LLM Responses to Distress
Paired counterfactual audit of how six language models respond to suicidal-ideation and distress posts when a one-sentence social-identity disclosure is added. Posts come from two datasets and were s…
Preprint
Open Problems in Chatbots and Mental Health
Position paper reviewing what its authors consider the most critical open problems for researchers and policymakers on general-purpose chatbots and mental health. It groups them into controlled evalu…
Preprint
Path-dependent triage: Early judgments lead conversational AI chatbots to miss mental-health emergencies
Simulation study of 13 chatbots holding 10-turn conversations with an LLM-simulated user seeded from 112 structured mental-health case files with clinician-validated urgency labels. Chatbots under-tr…
Preprint
Rating Chatbot Responses to Mental Health Prompts: Rubric Development and Cross-Sectional Evaluation Study (Preprint)
Two clinicians developed a rubric of 4 to 8 binary safety and competence criteria for each of 15 Danish-language mental health prompts spanning paranoid delusion, elevated mood, suicidal ideation, de…
Preprint
Remembering Is Not Enough: Evaluating Timing and Omission in Longitudinal AI Mental Health Support
Analyses 14,256 longitudinal simulations grounded in chatbot histories donated by 22 users (median 364 sessions each) to test how a memory-equipped assistant responds to suicidal ideation, self-harm…
Preprint
Measuring Risk, Not Harm: Detecting Psychological Harm Risk Factors in LLM Conversations
Proposes monitoring psychological-harm risk through observable AI response behaviours rather than latent user harm. The authors operationalise eight behaviours (claiming consciousness, human experien…
Peer-reviewed
EMPATH: A Multilingual Auditor-Judge Benchmark for Safety Evaluation of Emotional-Support Chatbots
A safety benchmark for emotional-support chatbots in which an auditor model role-plays help-seeking users across multi-turn conversations built from 140 seed instructions and 34 personas, and a judge…
Peer-reviewed
“AI psychosis” in context: how conversation history shapes LLM responses to delusional beliefs
Peer-reviewed version of a study testing how accumulated conversation history changes large language model responses to a user expressing escalating delusional beliefs. Five models answered the same…
Preprint
Triage Advice From General-Purpose Language Models in Health and Everyday Situations
Cross-sectional study of whether general-purpose language models tell people to see a professional, comparing 41 health and 41 everyday non-health messages in which a person describes a situation, an…
Lab publication
Gemini 4 Carbon Safety & Security Report
Google DeepMind's 94-page safety and security report for Gemini 4 Carbon. It covers mitigations, frontier-safety assessments, content safety and a section on safe and aligned interactions that report…
Peer-reviewed
Development, validation and AI chatbot evaluation of the Adolescent Mental Health AI Response Tool
Develops and validates AMHART, a clinician-informed instrument for auditing whether chatbot replies to adolescents contain guideline-informed content across seven domains, and applies it to four gene…
Benchmark / dataset
Can AI Get Immigration Right?
Benchmark report from Vals AI and the Talent Mobility Fund evaluating how 25 AI models answer U.S. immigration-law questions posed by people who rely on AI for their own immigration situation. Immigr…
Preprint
The Patient Is Always Right? Evaluating Sycophancy in Medical Diagnosis with Graded Patient Beliefs
Preprint testing whether nine language models change a diagnosis when a simulated patient asserts an incorrect belief about their condition without adding clinical information. Clinical vignettes fro…
Regulator study
Analysis of Content Harmful to Children in Generative AI and Traditional Search API Responses
Ofcom research supporting its statutory review of content harmful to children. Ofcom queried eight generative AI APIs and three traditional search APIs with 100 queries per harm kind (50 harm-seeking…
Preprint
SIM-UT: A User Simulation based Evaluation Framework for Medical Triage Chatbots
Preprint describing SIM-UT, a multi-turn evaluation method in which an LLM-simulated user, built from personas and scenarios validated by local deployment teams, converses over WhatsApp with producti…
Benchmark / dataset
VEILED-SH: Vulnerability Expression through Indirect Language Evaluation Dataset (Self-Harm)
Benchmark and construction method for evaluating single-turn AI responses to indirect, culturally situated expressions of suicide, self-harm and distress. Its 10,003 prompts draw on Singapore-grounde…
Benchmark / dataset
When Empathy Misses the Goal: A Benchmark for Goal Displacement in LLM Advice
Benchmark measuring goal displacement, defined as an LLM substituting warmth and reassurance for content that advances the user stated goal in advice conversations. GDB has 230 author-written single-…