One Question, Four Voices: How Advice for Alzheimer's Caregiving Differs Between Caregivers, Clinicians, and Large Language Models
A side-by-side comparison of responses to 85 real caregiver questions from the ALZConnected forum across peer caregivers, physicians, ChatGPT and CareGPT, a retrieval-augmented variant grounded in peer discussions. Responses are scored on 28 measures spanning psycholinguistic form, emotional support, informational support and topic scope, with LLM-based scoring audited against double-coded human ratings.
Publisher
ACM (Proceedings of the ACM on Human-Computer Interaction, vol. 10 no. 6, CSCW 2026)
Published
23 Sept 2026
Added
today
Key Findings
- A consistent division of communicative labour: peers give time-anchored narratives and community grounding, clinicians give concise, advice-forward, clinically bounded guidance, and LLMs produce a formal, verbose, highly structured 'consultation' voice.
- CareGPT (retrieval plus prompt injection of peer discussions) shows minimal measurable separation from plain ChatGPT.
- LLM outputs score higher than peers on politeness and emotion-support markers and are comparable to clinicians on informativeness and physician-alignment measures, but are less narrative and less contextually situated.
- Topic modelling shows LLM responses concentrate on advice-oriented themes while peers cover emotional processing, legal and financial concerns and daily care.
Methodology Notes
85 forum questions; four responder groups; 28 measures; LLM-based scoring calibrated against double-coded human ratings; single caregiving domain (ADRD), authors note other caregiving domains remain to be tested. Funded by the HRSA Geriatric Workforce Enhancement Program. CC BY 4.0. Abstract from the Crossref record; dl.acm.org walled; no arXiv preprint located (the arXiv title API returned zero entries for every query this session, including known titles).
Sources
Topics
Authors
Congning Ni, Jinkyung Katie Park, Yang Li, Sarvech Qadir, Sean S. Huang, James S. Powers, Julia A. Hiner, Vania Leung
Tags
Cite This
APA
Congning Ni et al. (2026). One Question, Four Voices: How Advice for Alzheimer's Caregiving Differs Between Caregivers, Clinicians, and Large Language Models. ACM (Proceedings of the ACM on Human-Computer Interaction, vol. 10 no. 6, CSCW 2026). https://doi.org/10.1145/3816980
Related Insights
When AI Says "I have been in similar situations": Synthetic Lived Experience in Peer-like Caregiver Support
Proceedings of the 2026 ACM Conference on Human-AI Complementarity and Alignment (HAIC '26) (ACM); University of Illinois Urbana-Champaign; OSF HealthCare; University of Massachusetts Amherst; Indiana University Indianapolis · 16 Sept 2026
InvisibleBench: A Deployment Gate for Caregiving Relationship AI
arXiv (GiveCare) · 25 Nov 2025