Move by Move: Measuring and Steering How LLMs Conduct Psychotherapy

Key Findings

• — A ten-move, function-based therapeutic ontology grounded in the MULTI-60 inventory and validated by five licensed psychologists
• — Models over-use inquiry at up to three times the human clinician rate
• — Models neglect psychoeducation relative to human clinicians
• — Models are strongly context-anchored: they carry forward strategies a human clinician initiated but rarely initiate those strategies themselves
• — Exposing the ontology as a set of tools roughly halves mean deviation from the human move distribution and improves turn-level alignment with human therapists by 7-9 percentage points, with no fine-tuning

Methodology Notes

Annotation campaign with five licensed psychologists; an LLM judge validated against expert agreement and used to scale annotation; applied to real counselling transcripts and to model-led sessions across a panel of frontier models. The abstract does not state the panel composition, the transcript corpus size, or the source and consent basis of the real counselling transcripts. Preprint, not peer-reviewed, no venue listed; v1 submitted 2026-08-21.

Sources