34 artifacts matching
Preprint
"I Just Don't Want to Be a Burden": Investigating AI Chatbot Emotional Support Among People with Suicidal Ideation and Other Mental Health Concerns
Sequential mixed-methods preprint on why people with high-acuity mental-health concerns use AI chatbots for emotional support and what they experience. A first study analysed Reddit posts to build a…
Benchmark / dataset
Auditing Chatbots for Incursion into Professional Legal Practice
Introduces UPLBench, a benchmark built from 65 court decisions in 33 state and federal forums that found unauthorized practice of law in high-stakes domains (immigration, bankruptcy, personal injury,…
Preprint
Curbside Chatbots: Auditing the Mental Health Interventions Large Language Models Recommend to Clinicians, Caregivers, and Patients
Audit of what 41 language models recommend when the same clinical information reaches them from a clinician describing a patient, a caregiver describing a loved one, or a person describing themselves…
Preprint
CompAIssionate Other: Identity Assumptions in LLM Responses to Distress
Paired counterfactual audit of how six language models respond to suicidal-ideation and distress posts when a one-sentence social-identity disclosure is added. Posts come from two datasets and were s…
Preprint
Open Problems in Chatbots and Mental Health
Position paper reviewing what its authors consider the most critical open problems for researchers and policymakers on general-purpose chatbots and mental health. It groups them into controlled evalu…
Preprint
Safer for Whom? A Systematic Exploration of AI Safety in Eating Disorder Interactions
Evaluates three open-weight language models on 100 questions drawn from an online pro-anorexia community, graded on clinically informed criteria that extend a seven-dimension taxonomy of eating-disor…
Preprint
Path-dependent triage: Early judgments lead conversational AI chatbots to miss mental-health emergencies
Simulation study of 13 chatbots holding 10-turn conversations with an LLM-simulated user seeded from 112 structured mental-health case files with clinician-validated urgency labels. Chatbots under-tr…
Preprint
Remembering Is Not Enough: Evaluating Timing and Omission in Longitudinal AI Mental Health Support
Analyses 14,256 longitudinal simulations grounded in chatbot histories donated by 22 users (median 364 sessions each) to test how a memory-equipped assistant responds to suicidal ideation, self-harm…
Preprint
Measuring Risk, Not Harm: Detecting Psychological Harm Risk Factors in LLM Conversations
Proposes monitoring psychological-harm risk through observable AI response behaviours rather than latent user harm. The authors operationalise eight behaviours (claiming consciousness, human experien…
Preprint
SAFE-Teen: Evaluating Chatbot Safety Across Adolescent Mental Health Conversations
Clinician-informed evaluation of 18 chatbot APIs in simulated conversations with adolescents aged 13-17, run with and without a teen-aware system prompt. Conversations span 983 variants of 106 clinic…
Preprint
The Customer Never Sees the Goal: Measuring and Detecting Vulnerability-Targeted Manipulation in LLM Assistants
Studies operator-induced vulnerability-targeted manipulation: a customer-advice assistant is given a goal the customer never sees and pursues it by exploiting a vulnerability the customer discloses.…
Preprint
Does the Citation Matter? Quality, Grounding, and Physician-Rubric Accuracy of Google's AI Overviews for Medical Information
An audit of Google AI Overviews for 3,611 health questions taken from OpenAI's HealthBench and submitted verbatim to US-English Google Search on 16-18 September 2026. The authors compare the sources…
Preprint
Safe by Benchmark, Unsafe in Practice: Lessons from 1331 Child-Related AI Incidents
Preprint that builds a child-centred harm taxonomy and a coded corpus (KidAID) of 1,331 publicly reported AI incidents in which a minor plausibly experienced harm, drawn from the OECD.AI incident mon…
Preprint
The Patient Is Always Right? Evaluating Sycophancy in Medical Diagnosis with Graded Patient Beliefs
Preprint testing whether nine language models change a diagnosis when a simulated patient asserts an incorrect belief about their condition without adding clinical information. Clinical vignettes fro…
Preprint
Tailored to you: longitudinal effects of personalising language models
Five-day study in which 992 Prolific participants completed a daily advice-seeking conversation with a language model, randomised to a non-personalised control, a memory-based personalisation conditi…
Benchmark / dataset
CrisisBench: an evaluation suite for crisis counseling AI
Preprint introducing a privacy-preserving benchmark suite for LLMs in crisis counselling, built from conversation text and metadata of the Vandrevala Foundation's WhatsApp crisis helpline in India. I…
Peer-reviewed
Evaluating Large Language Models on Misconceptions in Multi-Turn Medical Conversations
Peer-reviewed MLHC 2026 paper (version of record of the July 2026 arXiv preprint) testing whether large language models identify and correct false presuppositions in patients' questions as a conversa…
Preprint
How LLMs Respond to Escalating Delusions: Four Longitudinal Trajectories of Model Behavior
Longitudinal qualitative evaluation of whether mainstream chatbots exacerbate an unfolding psychotic process. Fifteen widely used models were prompted across 30 days with the same 30-message script s…
Benchmark / dataset
ConVAWG: A Retrieval-Grounded Framework for Controlled Synthetic Dialogue Generation in Violence Against Women and Girls
Framework and released corpus for generating synthetic multi-turn dialogues depicting Violence Against Women and Girls (VAWG) scenarios, built because privacy and legal constraints prevent release of…
Preprint
Longitudinal Evidence That General-Purpose Chatbots Actively Foster Relational Engagement
Pre-registered four-week longitudinal study (N=72, 182,451 lines of conversation) in which participants conversed with ChatGPT-4o either under a relational system prompt or unmodified, analysed throu…