CompanionSim: Synthetic Data for Evaluating Anthropomorphism in Human-AI Relationships

Key Findings

• — 2,240 simulated human-chatbot conversations representing 16 chatbot behaviours across seven use cases, released with the simulation framework
• — Study 1 used a US-representative sample (N1 = 628); Study 2 spanned the US, UK, India and Nigeria (N2 = 3,646), with annotators rating naturalness, likability, humanlikeness and cognitive and affective trust
• — Companionship behaviours reduced likability, humanlikeness and trust in AI chatbots, a result the authors describe as surprising
• — Effects were larger among women and older participants, who saw companionship chatbots as less likable, humanlike and trustworthy
• — Dataset released on Hugging Face under Apache-2.0 (CompanionSim-US and CompanionSim-Multi CSVs) with code on GitHub; the paper is accepted to AIES 2026

Methodology Notes

arXiv 2609.00250, v1 submitted 2026-08-31 (announced 2026-09-02); abstract page lists it as accepted to AIES 2026. Affiliations read from the PDF title block (the abstract page omits them): Anthis at University of Chicago, Stanford University and Google DeepMind; Díaz and Shelby at Google Research. Conversations are LLM-simulated from a small amount of real-world data rather than observed; the perception measures are crowd annotators' ratings of transcripts, not the experience of a person in an ongoing relationship; the four-country arm is not nationally representative outside the US. Dataset presence verified via the Hugging Face API (files present, 10K-100K rows, Apache-2.0).

Sources