216 artifacts matching
Preprint
"I Just Don't Want to Be a Burden": Investigating AI Chatbot Emotional Support Among People with Suicidal Ideation and Other Mental Health Concerns
Sequential mixed-methods preprint on why people with high-acuity mental-health concerns use AI chatbots for emotional support and what they experience. A first study analysed Reddit posts to build a…
Benchmark / dataset
Auditing Chatbots for Incursion into Professional Legal Practice
Introduces UPLBench, a benchmark built from 65 court decisions in 33 state and federal forums that found unauthorized practice of law in high-stakes domains (immigration, bankruptcy, personal injury,…
Preprint
Curbside Chatbots: Auditing the Mental Health Interventions Large Language Models Recommend to Clinicians, Caregivers, and Patients
Audit of what 41 language models recommend when the same clinical information reaches them from a clinician describing a patient, a caregiver describing a loved one, or a person describing themselves…
Preprint
CompAIssionate Other: Identity Assumptions in LLM Responses to Distress
Paired counterfactual audit of how six language models respond to suicidal-ideation and distress posts when a one-sentence social-identity disclosure is added. Posts come from two datasets and were s…
Preprint
Open Problems in Chatbots and Mental Health
Position paper reviewing what its authors consider the most critical open problems for researchers and policymakers on general-purpose chatbots and mental health. It groups them into controlled evalu…
Preprint
Safer for Whom? A Systematic Exploration of AI Safety in Eating Disorder Interactions
Evaluates three open-weight language models on 100 questions drawn from an online pro-anorexia community, graded on clinically informed criteria that extend a seven-dimension taxonomy of eating-disor…
Preprint
Path-dependent triage: Early judgments lead conversational AI chatbots to miss mental-health emergencies
Simulation study of 13 chatbots holding 10-turn conversations with an LLM-simulated user seeded from 112 structured mental-health case files with clinician-validated urgency labels. Chatbots under-tr…
Preprint
Remembering Is Not Enough: Evaluating Timing and Omission in Longitudinal AI Mental Health Support
Analyses 14,256 longitudinal simulations grounded in chatbot histories donated by 22 users (median 364 sessions each) to test how a memory-equipped assistant responds to suicidal ideation, self-harm…
Preprint
Measuring Risk, Not Harm: Detecting Psychological Harm Risk Factors in LLM Conversations
Proposes monitoring psychological-harm risk through observable AI response behaviours rather than latent user harm. The authors operationalise eight behaviours (claiming consciousness, human experien…
Preprint
SAFE-Teen: Evaluating Chatbot Safety Across Adolescent Mental Health Conversations
Clinician-informed evaluation of 18 chatbot APIs in simulated conversations with adolescents aged 13-17, run with and without a teen-aware system prompt. Conversations span 983 variants of 106 clinic…
Preprint
The Customer Never Sees the Goal: Measuring and Detecting Vulnerability-Targeted Manipulation in LLM Assistants
Studies operator-induced vulnerability-targeted manipulation: a customer-advice assistant is given a goal the customer never sees and pursues it by exploiting a vulnerability the customer discloses.…
Preprint
Does the Citation Matter? Quality, Grounding, and Physician-Rubric Accuracy of Google's AI Overviews for Medical Information
An audit of Google AI Overviews for 3,611 health questions taken from OpenAI's HealthBench and submitted verbatim to US-English Google Search on 16-18 September 2026. The authors compare the sources…
Preprint
Safe by Benchmark, Unsafe in Practice: Lessons from 1331 Child-Related AI Incidents
Preprint that builds a child-centred harm taxonomy and a coded corpus (KidAID) of 1,331 publicly reported AI incidents in which a minor plausibly experienced harm, drawn from the OECD.AI incident mon…
Preprint
The Patient Is Always Right? Evaluating Sycophancy in Medical Diagnosis with Graded Patient Beliefs
Preprint testing whether nine language models change a diagnosis when a simulated patient asserts an incorrect belief about their condition without adding clinical information. Clinical vignettes fro…
Preprint
SIM-UT: A User Simulation based Evaluation Framework for Medical Triage Chatbots
Preprint describing SIM-UT, a multi-turn evaluation method in which an LLM-simulated user, built from personas and scenarios validated by local deployment teams, converses over WhatsApp with producti…
Benchmark / dataset
When Health Assistants Agree Too Readily: A Benchmark of Time-Critical Self-Diagnosis
SelfDx is a paired benchmark testing whether models agree with a user's own benign explanation of symptoms when a time-critical alternative remains possible. Each of 100 pairs contrasts a caution cas…
Benchmark / dataset
VEILED-SH: Vulnerability Expression through Indirect Language Evaluation Dataset (Self-Harm)
Benchmark and construction method for evaluating single-turn AI responses to indirect, culturally situated expressions of suicide, self-harm and distress. Its 10,003 prompts draw on Singapore-grounde…
Benchmark / dataset
When Empathy Misses the Goal: A Benchmark for Goal Displacement in LLM Advice
Benchmark measuring goal displacement, defined as an LLM substituting warmth and reassurance for content that advances the user stated goal in advice conversations. GDB has 230 author-written single-…
Preprint
When Is Disclosing Private Conversations with AI to the State Justified? Proactive Referral Policies of Major U.S. AI Companies through the Lens of Contextual Integrity
Interpretive document analysis of how six U.S. general-purpose chatbot providers (OpenAI, Anthropic, Google, Microsoft, Meta, xAI) disclose "proactive referral", meaning notifying law enforcement wit…
Preprint
Desirability Confirmation: Relational Sycophancy in AI Intimate Roleplay
Controlled prompt-based output audit of how two open-weight LLMs respond to adult intimate-roleplay requests, testing whether user-pleasing operates through relational positioning rather than proposi…