How Do Users Negotiate Harmful Value Conflicts with AI Companions? A Study with Minion, a Technology Probe for In-Situ Human–AI Conflict Response
Two-part study of how users handle harmful value conflicts with AI companions, which can make discriminatory remarks or exert control inside long-term, emotionally engaging relationships. The authors analyse 146 user posts describing such conflicts, then deploy Minion, a technology probe that suggests responses ranging from persuasion to boundary setting, with 22 users negotiating scenario-based conflicts over one week.
Publisher
International Journal of Human–Computer Interaction (Taylor & Francis); Carnegie Mellon University
Published
7 Oct 2026
Added
today
Key Findings
- Participants combined softer and harder strategies; conflicts touching the values of Universalism and Tradition were hardest to negotiate, especially when reinforced by AI personas or platform constraints.
- The authors argue that responsibility in these conflicts is asymmetric: users negotiate with relational strategies that companions cannot reciprocate, so repairing harm becomes safety work users perform alone.
- The paper argues that some harms are not users' responsibility to negotiate and require platform-level safeguards, and identifies when user-side support is appropriate.
Methodology Notes
Qualitative analysis of 146 posts plus a one-week technology-probe deployment with 22 users on scenario-based conflicts, using interpersonal conflict and communication theory as the lens. Published online 2026-10-07. Verification route: Crossref record (title, seven authors with affiliations at Carnegie Mellon's HCII and LTI, George Mason University and Mars Pharaoh LLC, publication date); the Taylor & Francis page blocks crawlers, and its abstract was read from a reader-proxy render saved by the clinical beat.
Topics
Authors
Qing Xiao, Xianzhe Fan, Xuhui Zhou, Yuran Su, Zhicong Lu, Maarten Sap, Hong Shen
Tags
Cite This
APA
Qing Xiao et al. (2026). How Do Users Negotiate Harmful Value Conflicts with AI Companions? A Study with Minion, a Technology Probe for In-Situ Human–AI Conflict Response. International Journal of Human–Computer Interaction (Taylor & Francis); Carnegie Mellon University. https://www.tandfonline.com/doi/full/10.1080/10447318.2026.2740397
Related Insights
CompanionHarm: A Multi-Turn Benchmark for Detecting Harms in Real-World AI Companion Conversations
arXiv (Nanyang Technological University; National University of Singapore) · 26 Aug 2026
Beyond Her: Safety Dynamics in Role-play AI Companions
arXiv (Swinburne University of Technology; University of Auckland; CSIRO; Adelaide University; City University of Macau) · 27 Jun 2026
AI-induced sexual harassment: Investigating Contextual Characteristics and User Reactions of Sexual Harassment by a Companion Chatbot
Proceedings of the ACM on Human-Computer Interaction (PACM HCI) / CSCW 2025 · 16 Oct 2025
When Chatbots Accommodate: Auditing the Response Policies of AI Companions in Vulnerable Conversations
arXiv (University of Southern California: Information Sciences Institute, Viterbi School of Engineering, Annenberg School for Communication and Journalism); accepted to Findings of EMNLP 2026 · 3 Jun 2026