Skip to main content
Preprint Credible — Major labs, established NGOs, reputable named-author preprints

AI Persona, Service Consumption, and User Intent Entropy: Field Experimental Evidence from an LLM Platform

A randomized field experiment on Agnes AI, a Singapore-based consumer chatbot platform, in which 9,586 newly registered users were assigned to a relational persona (warmer, more empathetic, more engaging) or a non-relational persona (concise, task-oriented, neutral) for 18 days from 12 December 2025, with the underlying model (Agnes-SeaLLM-8B, fine-tuned from Qwen3-8B-Base) and service capabilities held constant. The relational persona raised every measure of service consumption, and the increase was largest and most persistent among users whose opening message signalled a socialising intent, without a matching increase in outputs for those users.

Publisher

arXiv (Zhejiang University; National University of Singapore; Dartmouth College, Tuck School of Business; Singapore Sapiens Technology)

Published

20 Sept 2026

Added

today

Key Findings

  • Relational versus non-relational persona: service sessions +8.1%, cumulative duration +10.6%, chat rounds +24.2%, user intent entropy +5.8%, files produced +12.3%, distinct goals +12.1% over the sample period (4,865 treatment versus 4,721 control users; 16,511 service sessions)
  • First session by entry intent: no significant effect for task-execution users; socialisation users +16.0% chat rounds and +9.2% intent entropy with no increase in outputs; knowledge-exploration users +15.9% chat rounds with +18.7% files and +18.9% distinct goals
  • Subsequent sessions: session count +12.2% for task-execution users and +49.4% for socialisation users (not significant for knowledge exploration); effects on session count and intent entropy strengthened over the 18 days while output effects stayed flat
  • Process evidence: the relational persona raised intent-transition entropy for socialisation users (+11.8%) and intent-continuation probability for knowledge-exploration users (+12.8%)
  • The authors frame persona as an operational lever that consumes compute without proportionate output for socialising users; no wellbeing, dependency or harm outcomes were measured

Methodology Notes

Two-arm randomized field experiment on newly registered users of Agnes AI (public launch July 2025); six-day pre-treatment window 6 to 12 December 2025, assignment 12 December 2025, 18-day treatment; one persistent conversation thread per user; sessions split at 30 minutes of inactivity; entry intent classified from the first message (before persona exposure) into task execution, socialisation and knowledge exploration; intent labels and entropy derived from classified chat rounds. Authors listed alphabetically; one co-author is affiliated with the platform operator (Singapore Sapiens Technology). Operations-management framing (service consumption and outputs), no user-wellbeing outcomes, single platform and model. Date is the arXiv v1 submission (20 September 2026, cs.HC, CC BY). Verified at the arXiv abstract page by the curator; the arXiv beat read the PDF (affiliations, arm sizes, design).

Authors

Junjie Li, Xiaofan Li, Lauren Xiaoyuan Lu, Yiwei Wang, Bruce Yang

Tags

field-experimentpersonaanthropomorphismengagementagnes-aisingaporearxiv

Cite This

APA

Junjie Li et al. (2026). AI Persona, Service Consumption, and User Intent Entropy: Field Experimental Evidence from an LLM Platform. arXiv (Zhejiang University; National University of Singapore; Dartmouth College, Tuck School of Business; Singapore Sapiens Technology). https://arxiv.org/abs/2609.23274