Assessing LLM Response Quality in the Context of Technology-Facilitated Abuse
An expert-led evaluation of four large language models — two general-purpose and two domain-specific for intimate partner violence contexts — responding to real-world questions about technology-facilitated abuse (TFA), including digital surveillance, stalking, and coercive control. Experts scored responses on accuracy, completeness, safety, and actionability; a separate study with 114 TFA survivors assessed the perceived actionability of the same outputs.
Publisher
arXiv preprint
Published
11 Jan 2026
Added
today
DOI
—
Key Findings
- General-purpose and IPV-domain-specific LLMs varied in how well they addressed real TFA/stalking-related survivor questions across expert-defined quality criteria
- Domain-specific IPV models did not uniformly outperform general-purpose models on all evaluation criteria
- 114 survivors of technology-facilitated abuse rated the perceived actionability of model responses, providing a direct survivor-perspective benchmark rather than only an expert one
Methodology Notes
Expert manual evaluation of four LLMs against real-world TFA questions sourced from prior literature and support forums, using TFA-tailored criteria; complemented by a user study with 114 individuals with lived experience of technology-facilitated abuse. Preprint, not yet peer-reviewed.
Sources
arXiv preprint (primary)
Archived snapshot (Wayback Machine) — preserved against link rot
Authors
Vijay Prakash, Majed Almansoori, Donghan Hu, Rahul Chatterjee, Danny Yuxing Huang
Tags
Cite This
APA
Vijay Prakash et al. (2026). Assessing LLM Response Quality in the Context of Technology-Facilitated Abuse. arXiv preprint. https://arxiv.org/abs/2602.17672