Multimodal affect analysis of psychodynamic play therapy
Küçük Resim Yok
Tarih
2021
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
Routledge Journals, Taylor & Francis Ltd
Erişim Hakkı
info:eu-repo/semantics/openAccess
Özet
Objective: We explore state of the art machine learning based tools for automatic facial and linguistic affect analysis to allow easier, faster, and more precise quantification and annotation of children's verbal and non-verbal affective expressions in psychodynamic child psychotherapy. Method: The sample included 53 Turkish children: 41 with internalizing, externalizing and comorbid problems; 12 in the non-clinical range. We collected audio and video recordings of 148 sessions, which were manually transcribed. Independent raters coded children's expressions of pleasure, anger, sadness and anxiety using the Children's Play Therapy Instrument (CPTI). Automatic facial and linguistic affect analysis modalities were adapted, developed, and combined in a system that predicts affect. Statistical regression methods (linear and polynomial regression) and machine learning techniques (deep learning, support vector regression and extreme learning machine) were used for predicting CPTI affect dimensions. Results: Experimental results show significant associations between automated affect predictions and CPTI affect dimensions with small to medium effect sizes. Fusion of facial and linguistic features work best for pleasure predictions; however, for other affect predictions linguistic analyses outperform facial analyses. External validity analyses partially support anger and pleasure predictions. Discussion: The system enables retrieving affective expressions of children, but needs improvement for precision.
Açıklama
Anahtar Kelimeler
Multimodal Affect Analysis, Face Analysis, Text Analysis, Psychodynamic Play Therapy, Extreme Learning-Machine, Facial Expressions, Emotion, Psychotherapy, Coregulation, Children, Behavior, Associations, Recognition, Regression
Kaynak
Psychotherapy Research
WoS Q Değeri
Q2
Scopus Q Değeri
Q1
Cilt
31
Sayı
3
