How AI and Human Behaviors Shape Psychosocial Effects of Extended Chatbot Use: A Longitudinal Randomized Controlled Study
A four-week randomized controlled experiment in which 981 participants used ChatGPT (GPT-4o) for at least five minutes a day under one of nine conditions crossing interaction mode (text, neutral voice, engaging voice) with conversation type (open-ended, non-personal, personal), producing more than 300,000 messages. Weekly surveys tracked loneliness, socialization with real people, emotional dependence on the chatbot, and problematic use. Assigned conditions produced no significant group-level effects, but voluntary daily usage duration predicted worse outcomes on all four measures, and trust and social attraction toward the chatbot were associated with higher dependence and problematic use.
Publisher
MIT Media Lab; OpenAI (arXiv preprint)
Published
21 Mar 2025
Added
today
Key Findings
- No significant effects of interaction mode or conversation type were detected on any of the four psychosocial outcomes at the group level, despite measurable differences in AI and human conversational behaviour across conditions.
- Participants spent an average of 5.32 minutes a day with the chatbot (range 1.01 to 27.65), more with voice than text, most with the engaging voice, and more in open-ended than in personal or non-personal conversation.
- Within-condition daily duration predicted higher loneliness (beta 0.02, p = 0.027), less socialization with people (beta -0.05, p = 0.0019), more emotional dependence (beta 0.06, p < 0.001) and more problematic use (beta 0.02, p = 0.017); mediation analysis found duration carried modality and task effects onto socialization and dependence.
- Baseline loneliness and socialization showed negligible correlation with later usage duration (Spearman rho 0.1 and -0.09), so lonelier participants did not simply use the chatbot more.
- Higher trust in and social attraction toward the chatbot were associated with higher emotional dependence and problematic use; the authors name daily duration as a signal to monitor and soft caps or break nudges as levers to test in future trials.
- The authors state that duration was not manipulated, so the direction of the duration-outcome relationship cannot be settled by this design.
Methodology Notes
Preregistered four-week randomized controlled trial, n = 981 adults recruited for daily use, nine conditions (3 modes x 3 conversation types), weekly self-report scales (loneliness, socialization, emotional dependence via an ADS-9 craving subscale, problematic use), plus automated classifier analysis of conversation content. Version 1 posted to arXiv 2025-03-21; version 2 posted 2025-10-02 (70 pages with supplement). A Research Square preprint of the same study (10.21203/rs.3.rs-8148142/v1, posted 2026-04-27) is marked 'Under Review' and not peer-reviewed as of 2026-09-15. Companion study to the platform-scale affective-use analysis published by the same OpenAI and MIT team in April 2025.
Topics
Authors
Cathy Mengying Fang, Auren R. Liu, Valdemar Danry, Eunhae Lee, Samantha W. T. Chan, Pat Pataranutaporn, Pattie Maes, Jason Phang, Michael Lampe, Lama Ahmad, Sandhini Agarwal
Tags
Cite This
APA
Cathy Mengying Fang et al. (2025). How AI and Human Behaviors Shape Psychosocial Effects of Extended Chatbot Use: A Longitudinal Randomized Controlled Study. MIT Media Lab; OpenAI (arXiv preprint). https://arxiv.org/abs/2503.17473
Related Insights
Investigating Affective Use and Emotional Well-being on ChatGPT
OpenAI; MIT Media Lab · 4 Apr 2025
"I Felt Very Seen, But Still Very Alone": Longitudinal Trajectories of General-Purpose LLM Use for Socioemotional Support
arXiv (Carnegie Mellon University; Data & Society Research Institute) · 11 Sept 2026
Chatbot appearance and loneliness trajectories in women with high autistic traits
Computers in Human Behavior: Artificial Humans (Elsevier); Toyo University · 1 Aug 2026