The Personalization Trap: How User Memory Alters Emotional Reasoning in LLMs
Tests how long-term user memory changes emotional reasoning in large language models by evaluating 15 models on human-validated emotional-intelligence tests with identical scenarios paired with different user profiles. The same scenario produced systematically different emotional interpretations depending on who the user was remembered to be, with advantaged profiles receiving more accurate readings in several high-performing models, and significant demographic disparities in both emotion understanding and supportive recommendations.
Publisher
Association for Computational Linguistics (Proceedings of ACL 2026, Short Papers); Amazon
Published
1 Jul 2026
Added
1 month ago
Key Findings
- Identical emotional scenarios paired with different remembered user profiles produced systematically divergent emotional interpretations across 15 LLMs.
- In several high-performing models, advantaged profiles received more accurate emotional interpretations; the benchmarks beat's read of the PDF records gaps such as 80.1% against 77.4% for Claude 3.7 Sonnet and 81.6% against 76.6% for DeepSeek-R1.
- Significant disparities across demographic factors appeared in both emotion-understanding and supportive-recommendation tasks.
- The authors conclude that personalization mechanisms can embed social hierarchies into models' emotional reasoning, so memory-enhanced assistants may reinforce inequality.
Methodology Notes
Evaluation of 15 models (Claude 3.5 to 4.5, DeepSeek-R1 and V3, Llama 3.x and 4, Mistral Large, Phi-4-mini, Qwen3, Gemma-2 per the beat's PDF read) on validated emotional-intelligence items (STEU and STEM) under varied synthetic user profiles, several thousand questions per experiment; no human participants. Published in the ACL 2026 Short Papers volume (July 2026), pages 511 to 529, DOI 10.18653/v1/2026.acl-short.43; all authors at Amazon. Verified at the ACL Anthology on 2026-09-15.
Sources
ACL Anthology(opens in a new tab) (primary)
Archived snapshot (Wayback Machine)(opens in a new tab) — preserved against link rot
Authors
Xi Fang, Weijie Xu, Yuchong Zhang, Stephanie Eckman, Scott Nickleach, Chandan K. Reddy
Tags
Cite This
APA
Xi Fang et al. (2026). The Personalization Trap: How User Memory Alters Emotional Reasoning in LLMs. Association for Computational Linguistics (Proceedings of ACL 2026, Short Papers); Amazon. https://aclanthology.org/2026.acl-short.43/
Related Insights
Interaction Context Often Increases Sycophancy in LLMs
ACM CHI Conference on Human Factors in Computing Systems (Massachusetts Institute of Technology; Penn State University) · 13 Apr 2026
Annie, Are You Okay? How Style- and Context-Based Personalization Shape AI-Assisted Decision-Making
arXiv (Northeastern University; University College Dublin) · 21 Sept 2026
Et Tu, Brute? Economic Misalignment in Personal AI Agents
arXiv (Foundation AI, Cisco; Carnegie Mellon University) · 21 Sept 2026
Tailored to you: longitudinal effects of personalising language models
Google DeepMind (arXiv preprint) · 17 Sept 2026