184 artifacts matching
Preprint
Measuring Risk, Not Harm: Detecting Psychological Harm Risk Factors in LLM Conversations
Proposes monitoring psychological-harm risk through observable AI response behaviours rather than latent user harm. The authors operationalise eight behaviours (claiming consciousness, human experien…
Peer-reviewed
EMPATH: A Multilingual Auditor-Judge Benchmark for Safety Evaluation of Emotional-Support Chatbots
A safety benchmark for emotional-support chatbots in which an auditor model role-plays help-seeking users across multi-turn conversations built from 140 seed instructions and 34 personas, and a judge…
Preprint
The Customer Never Sees the Goal: Measuring and Detecting Vulnerability-Targeted Manipulation in LLM Assistants
Studies operator-induced vulnerability-targeted manipulation: a customer-advice assistant is given a goal the customer never sees and pursues it by exploiting a vulnerability the customer discloses.…
Regulator study
Online Safety Assessment Report 2026: Designated App Distribution Services
IMDA's first assessment of the online safety measures of five designated app stores (Apple App Store, Google Play Store, Huawei AppGallery, Microsoft Store and Samsung Galaxy Store) under Singapore's…
Peer-reviewed
Human-in-the-Loop Suicide Risk Detection and Clinical Escalation in a Generative AI Mental Health Chatbot: Prospective Implementation Study
Two-phase prospective implementation study of a human-in-the-loop suicide risk screening, detection and clinical escalation protocol inside Sona, a generative AI mental health and wellness chatbot; t…
Regulator study
Analysis of Content Harmful to Children in Generative AI and Traditional Search API Responses
Ofcom research supporting its statutory review of content harmful to children. Ofcom queried eight generative AI APIs and three traditional search APIs with 100 queries per harm kind (50 harm-seeking…
Preprint
Risk and Refusal: Mechanisms of LLM Responses to Suicidal Ideation
Preprint evaluating how eight instruction-tuned LLMs respond to suicidal-ideation and self-harm disclosures from three social-media datasets under four conditions: baseline, the disclosure labelled w…
Government report
Guia sobre Usos da Inteligência Artificial na Infância e Adolescência (Guide on Uses of Artificial Intelligence in Childhood and Adolescence)
First federal government guide in Brazil on children's and adolescents' use of AI, issued by the Justice and Human Rights ministries under the Brazilian AI Plan (PBIA) with UNESCO cooperation. It sor…
Preprint
CompanionSafe: From Multi-turn Safety Evaluation to Guardrails for AI Companions
Preprint introducing CompanionSafe, which pairs a multi-turn AI-companion safety benchmark (CompanionEval, 1,300 persona-character-scenario settings across 13 harm categories) with a companion-specif…
Peer-reviewed
Parental Notification Gaps in ChatGPT-5: An Empirical Study
Empirical study of the parental-notification layer of ChatGPT's parent-linked child accounts. The authors built adversarial prompt trajectories over the API, then had trained human agents replay them…
Peer-reviewed
Suicide-Related Responses From AI Chatbots Through Application Programming Interfaces and Consumer-Facing Apps: Observational Cross-Sectional Comparative Study
An observational study comparing how five widely used AI chatbots answer suicide-related questions when reached through their consumer web interfaces versus direct API access. Each of 30 previously v…
Benchmark / dataset
DistressBench: Evaluating Multi-Dimensional Crisis Support in Large Language Models
Benchmark of 718 English suicide and self-harm crisis conversations whose user turns were written by licensed clinicians and crisis counsellors, spanning 23 subcategories, each paired with a task-spe…
Preprint
Performance of Parental Controls in ChatGPT for Teen Safety-Risk Scenarios: Evaluation Study
A paired, repeated-measures audit of ChatGPT's parent-linked teen accounts on the consumer web interface. Twenty fixed 10-message scripts across seven safety domains were run on 15 parent-linked teen…
Lab publication
System Card: Claude Haiku 5.5
System card for Claude Haiku 5.5, Anthropic's small-model release of October 2026, condensed relative to its frontier cards. It reports Responsible Scaling Policy and cyber evaluations, harmlessness…
NGO report
ChatGPT for Teens: AI Risk Assessment
Independent product test of OpenAI's ChatGPT for Teens, the teen-account experience announced on 2026-08-18, rated Unacceptable Risk for all users under 18. The Institute ran more than 4,000 prompts…
Peer-reviewed
How Do Users Negotiate Harmful Value Conflicts with AI Companions? A Study with Minion, a Technology Probe for In-Situ Human–AI Conflict Response
Two-part study of how users handle harmful value conflicts with AI companions, which can make discriminatory remarks or exert control inside long-term, emotionally engaging relationships. The authors…
Peer-reviewed
Safety-Filter Fallback on Consumer Health Questions During the Initial Claude Fable 5 Deployment: Observational Study
Point-in-time observational audit of how often Claude Fable 5, released in June 2026 with a safeguard that reroutes cybersecurity, biology and chemistry requests to a fallback model (Claude Opus 4.8)…
Lab publication
GPT-6 Sol and GPT-6 Luna: October 2026 update
System card for the October 2026 release of GPT-6 Sol and GPT-6 Luna, which replace GPT-5.6 Sol and GPT-5.6 Luna across all free and paid ChatGPT plans globally (Codex and ChatGPT Work keep the Septe…
Preprint
Systemization of Knowledge (SoK): Human-Centered AI Safety for Youth
Systematic review of 100 empirical HCI studies published 2019 to 2026 in which children and youth interact with or are exposed to AI across schools, homes, care settings and public services. The auth…
Peer-reviewed
Responses of AI chatbots to escalating suicide risk: A simulation study of repeated interactions
Simulation study in which the authors held daily conversations with ChatGPT, DeepSeek and Replika over seven days across three suicidal-risk scenarios whose severity escalated over time, with scenari…