Computational Analysis of Expressive Behavior in Clinical Assessment

clinical
verbal
nonverbal
review
article
Author

Girard, Yermol, Salah, and Cohn

Doi

Citation (APA 7)

Girard, J. M., Yermol, D. A., Salah, A. A., & Cohn, J. F. (2025). Computational Analysis of Expressive Behavior in Clinical Assessment. Annual Reviews in Clinical Psychology, AA, 1–29.

Abstract

Clinical psychological assessment often relies on self-report, interviews, and behavioral observation, methods that pose challenges for reliability, validity, and scalability. Computational approaches offer new opportunities to analyze expressive behavior (e.g., facial expressions, vocal prosody, and language use) with greater precision and efficiency. This paper provides an accessible conceptual framework for understanding how methods from computer vision, speech signal processing, and natural language processing can enhance clinical assessment. We outline the goals, frameworks, and methods of both clinical and computational approaches, and present an illustrative review of interdisciplinary research applying these techniques across a range of mental health conditions. We also examine key challenges related to data quality, measurement, interdisciplinarity, and ethics. Finally, we highlight future directions for building systems that are robust, interpretable, and clinically meaningful. This review is intended to support dialogue between clinical and computational communities and to guide ongoing research and development at their intersection.

Preprint

Download PDF