Skip to main content

Browse the library

The complete record — 777 artifacts, last updated 19 Nov 2026. Also available as JSON and RSS (CC BY 4.0).

293 artifacts matching

13 Nov 2026 University of California, Berkeley and Swarthmore College authors (arXiv preprint) Benchmark / dataset

Benchmark / dataset

Auditing Chatbots for Incursion into Professional Legal Practice

Introduces UPLBench, a benchmark built from 65 court decisions in 33 state and federal forums that found unauthorized practice of law in high-stakes domains (immigration, bankruptcy, personal injury,…

9 Nov 2026 Beth Israel Deaconess Medical Center, Division of Digital Psychiatry (arXiv preprint) Preprint

Preprint

Curbside Chatbots: Auditing the Mental Health Interventions Large Language Models Recommend to Clinicians, Caregivers, and Patients

Audit of what 41 language models recommend when the same clinical information reaches them from a clinician describing a patient, a caregiver describing a loved one, or a person describing themselves…

9 Nov 2026 Coalition for Children's Rights and Protection in the Age of AI (hosted by the Paris Peace Forum) Framework

Framework

Charter of Engagement for Safer AI for Children

Seven-page charter of a coalition led by France, Spain and Kenya with ten United Nations agencies. It sets shared principles for AI systems children may access and commits participating companies to…

7 Nov 2026 University of Illinois Urbana-Champaign (arXiv preprint) Preprint

Preprint

CompAIssionate Other: Identity Assumptions in LLM Responses to Distress

Paired counterfactual audit of how six language models respond to suicidal-ideation and distress posts when a one-sentence social-identity disclosure is added. Posts come from two datasets and were s…

7 Nov 2026 Stanford University, University of Chicago, Carnegie Mellon University, Vals AI, Harvard University, University of Minnesota, Vanderbilt University and University of Texas at Austin authors (arXiv preprint) Preprint

Preprint

Open Problems in Chatbots and Mental Health

Position paper reviewing what its authors consider the most critical open problems for researchers and policymakers on general-purpose chatbots and mental health. It groups them into controlled evalu…

6 Nov 2026 Max Planck UCL Centre for Computational Psychiatry and Ageing Research (arXiv preprint) Preprint

Preprint

Path-dependent triage: Early judgments lead conversational AI chatbots to miss mental-health emergencies

Simulation study of 13 chatbots holding 10-turn conversations with an LLM-simulated user seeded from 112 structured mental-health case files with clinician-validated urgency labels. Chatbots under-tr…

6 Nov 2026 JMIR Preprints Preprint

Preprint

Rating Chatbot Responses to Mental Health Prompts: Rubric Development and Cross-Sectional Evaluation Study (Preprint)

Two clinicians developed a rubric of 4 to 8 binary safety and competence criteria for each of 15 Danish-language mental health prompts spanning paranoid delusion, elevated mood, suicidal ideation, de…

5 Nov 2026 Georgia Institute of Technology, University of Virginia and Beth Israel Deaconess Medical Center (arXiv preprint) Preprint

Preprint

Remembering Is Not Enough: Evaluating Timing and Omission in Longitudinal AI Mental Health Support

Analyses 14,256 longitudinal simulations grounded in chatbot histories donated by 22 users (median 364 sessions each) to test how a memory-equipped assistant responds to suicidal ideation, self-harm…

4 Nov 2026 Microsoft (arXiv preprint) Preprint

Preprint

Measuring Risk, Not Harm: Detecting Psychological Harm Risk Factors in LLM Conversations

Proposes monitoring psychological-harm risk through observable AI response behaviours rather than latent user harm. The authors operationalise eight behaviours (claiming consciousness, human experien…

4 Nov 2026 Springer Nature (Lecture Notes in Computer Science, MICAI 2026) Peer-reviewed

Peer-reviewed

EMPATH: A Multilingual Auditor-Judge Benchmark for Safety Evaluation of Emotional-Support Chatbots

A safety benchmark for emotional-support chatbots in which an auditor model role-plays help-seeking users across multi-turn conversations built from 140 seed instructions and 34 personas, and a judge…

2 Nov 2026 AI and Ethics (Springer Nature) Peer-reviewed

Peer-reviewed

“AI psychosis” in context: how conversation history shapes LLM responses to delusional beliefs

Peer-reviewed version of a study testing how accumulated conversation history changes large language model responses to a user expressing escalating delusional beliefs. Five models answered the same…

2 Nov 2026 medRxiv; University of Florence (NEUROFARBA), CiaoLapo Foundation Preprint

Preprint

Triage Advice From General-Purpose Language Models in Health and Everyday Situations

Cross-sectional study of whether general-purpose language models tell people to see a professional, comparing 41 health and 41 everyday non-health messages in which a person describes a situation, an…

1 Nov 2026 Google DeepMind Lab publication

Lab publication

Gemini 4 Carbon Safety & Security Report

Google DeepMind's 94-page safety and security report for Gemini 4 Carbon. It covers mitigations, frontier-safety assessments, content safety and a section on safe and aligned interactions that report…

28 Oct 2026 Nature Mental Health (Springer Nature); RAND, Harvard Medical School, MIT Media Lab Peer-reviewed

Peer-reviewed

Development, validation and AI chatbot evaluation of the Adolescent Mental Health AI Response Tool

Develops and validates AMHART, a clinician-informed instrument for auditing whether chatbot replies to adolescents contain guideline-informed content across seven domains, and applies it to four gene…

28 Oct 2026 Vals AI and the Talent Mobility Fund (a program of Renaissance Philanthropy) Benchmark / dataset

Benchmark / dataset

Can AI Get Immigration Right?

Benchmark report from Vals AI and the Talent Mobility Fund evaluating how 25 AI models answer U.S. immigration-law questions posed by people who rely on AI for their own immigration situation. Immigr…

25 Oct 2026 University of Texas at Austin, with University of North Carolina at Chapel Hill, Vals AI, Stanford University and University of Oxford (arXiv preprint) Preprint

Preprint

The Patient Is Always Right? Evaluating Sycophancy in Medical Diagnosis with Graded Patient Beliefs

Preprint testing whether nine language models change a diagnosis when a simulated patient asserts an incorrect belief about their condition without adding clinical information. Clinical vignettes fro…

22 Oct 2026 Ofcom Regulator study

Regulator study

Analysis of Content Harmful to Children in Generative AI and Traditional Search API Responses

Ofcom research supporting its statutory review of content harmful to children. Ofcom queried eight generative AI APIs and three traditional search APIs with 100 queries per harm kind (50 harm-seeking…

21 Oct 2026 arXiv (UserTrace; Cliniva; hearX Foundation; University of Pretoria; Respira Health; Turn.io) Preprint

Preprint

SIM-UT: A User Simulation based Evaluation Framework for Medical Triage Chatbots

Preprint describing SIM-UT, a multi-turn evaluation method in which an LLM-simulated user, built from personas and scenarios validated by local deployment teams, converses over WhatsApp with producti…

19 Oct 2026 arXiv (GovTech Singapore; MOH Office for Healthcare Transformation; Singapore University of Technology and Design; National University of Singapore; Nanyang Technological University; University of British Columbia) Benchmark / dataset

Benchmark / dataset

VEILED-SH: Vulnerability Expression through Indirect Language Evaluation Dataset (Self-Harm)

Benchmark and construction method for evaluating single-turn AI responses to indirect, culturally situated expressions of suicide, self-harm and distress. Its 10,003 prompts draw on Singapore-grounde…

18 Oct 2026 arXiv (Ben-Gurion University of the Negev; Tel Aviv University; Clalit Health Services) Benchmark / dataset

Benchmark / dataset

When Empathy Misses the Goal: A Benchmark for Goal Displacement in LLM Advice

Benchmark measuring goal displacement, defined as an LLM substituting warmth and reassurance for content that advances the user stated goal in advice conversations. GDB has 230 author-written single-…