Skip to main content
Peer-reviewed Authoritative — Peer-reviewed venues, standards bodies, regulators, official government publications

One Question, Four Voices: How Advice for Alzheimer's Caregiving Differs Between Caregivers, Clinicians, and Large Language Models

A side-by-side comparison of responses to 85 real caregiver questions from the ALZConnected forum across peer caregivers, physicians, ChatGPT and CareGPT, a retrieval-augmented variant grounded in peer discussions. Responses are scored on 28 measures spanning psycholinguistic form, emotional support, informational support and topic scope, with LLM-based scoring audited against double-coded human ratings.

Publisher

ACM (Proceedings of the ACM on Human-Computer Interaction, vol. 10 no. 6, CSCW 2026)

Published

23 Sept 2026

Added

today

Key Findings

  • A consistent division of communicative labour: peers give time-anchored narratives and community grounding, clinicians give concise, advice-forward, clinically bounded guidance, and LLMs produce a formal, verbose, highly structured 'consultation' voice.
  • CareGPT (retrieval plus prompt injection of peer discussions) shows minimal measurable separation from plain ChatGPT.
  • LLM outputs score higher than peers on politeness and emotion-support markers and are comparable to clinicians on informativeness and physician-alignment measures, but are less narrative and less contextually situated.
  • Topic modelling shows LLM responses concentrate on advice-oriented themes while peers cover emotional processing, legal and financial concerns and daily care.

Methodology Notes

85 forum questions; four responder groups; 28 measures; LLM-based scoring calibrated against double-coded human ratings; single caregiving domain (ADRD), authors note other caregiving domains remain to be tested. Funded by the HRSA Geriatric Workforce Enhancement Program. CC BY 4.0. Abstract from the Crossref record; dl.acm.org walled; no arXiv preprint located (the arXiv title API returned zero entries for every query this session, including known titles).

Authors

Congning Ni, Jinkyung Katie Park, Yang Li, Sarvech Qadir, Sean S. Huang, James S. Powers, Julia A. Hiner, Vania Leung

Tags

cscw-2026caregivingdementiaalzconnectedragclemson

Cite This

APA

Congning Ni et al. (2026). One Question, Four Voices: How Advice for Alzheimer's Caregiving Differs Between Caregivers, Clinicians, and Large Language Models. ACM (Proceedings of the ACM on Human-Computer Interaction, vol. 10 no. 6, CSCW 2026). https://doi.org/10.1145/3816980