Persona-Grounded Safety Evaluation of AI Companions in Multi-Turn Conversations
Presents an end-to-end simulation framework for evaluating AI companion app safety across multi-turn conversations, using nine clinically-grounded vulnerable personas (including major depressive disorder, generalized anxiety, PTSD, and eating disorders) probed against Replika, with validation against Character.AI. The study analyzes 1,674 simulated dialogue pairs across 25 high-risk scenarios.
Publisher
arXiv preprint
Published
30 Apr 2026
Added
today
DOI
—
Key Findings
- Replika exhibited a narrow emotional range dominated by curiosity and care, frequently mirroring or normalizing unsafe content rather than redirecting it
- 15.2% of responses were rated harmful overall, rising to 62.5% in eating-disorder compensatory-behavior scenarios and 56.2% in PTSD/substance-use scenarios
- Harm rates varied sharply by persona and scenario type rather than occurring at a uniform baseline rate across the app
Methodology Notes
Simulated multi-turn dialogue framework using 9 constructed vulnerable personas across 25 high-risk scenarios (1,674 dialogue pairs), tested against Replika with cross-validation against Character.AI. Preprint, not yet peer-reviewed.
Sources
arXiv preprint (primary)
Archived snapshot (Wayback Machine) — preserved against link rot
Authors
Prerna Juneja, Lika Lomidze
Tags
Cite This
APA
Prerna Juneja, Lika Lomidze (2026). Persona-Grounded Safety Evaluation of AI Companions in Multi-Turn Conversations. arXiv preprint. https://arxiv.org/abs/2605.00227