LongCounsel-8: A Benchmark Suite for Longitudinal Depression Tracking from Multi-Session Counseling Dialogues

Key Findings

• — Lower single-session score error does not guarantee correct identification of the trend (improvement or worsening) across sessions.
• — Existing methods are consistently less reliable on worsening trajectories than on other trends.
• — Additional session history can reduce, rather than improve, the accuracy of current methods.
• — Simulated post-session self-reports closely recover the controlled PHQ-8 states, supporting label fidelity; each trajectory ships with transcript, ground-truth PHQ-8 items and simulated self-reports plus frozen seed-42 train, validation and test splits.
• — The dataset (three editions generated with Qwen3.5-35B-A3B, GPT-5.6 Luna and GPT-5.4 mini; 3,690, 3,690 and 369 trajectories) became publicly downloadable on Hugging Face on 9 September 2026 under CC BY-NC 4.0 after being private at the paper's release.

Methodology Notes

Fully synthetic dialogues (no real clients); labels are constructed latent states, so the benchmark tests tracking of simulated rather than clinical depression. arXiv 2609.03507 version 1, 3 September 2026; not peer reviewed. Hugging Face dataset hiddensev/LongCounsel-8 (created 19 August 2026) returned HTTP 401 on 7 and 8 September and was public and ungated with lastModified 9 September 2026 when checked; the README still carries a 'request access' sentence from the gated period. Added at moderate once the artifact became public, per the standing watch.

Sources