| Popis: |
Behavioral observation is an important tool for research and practice in clinical, developmental, and social psychology. Traditional,expert-based methods for behavioral observation from videos are limited by the amount of time and resources it requires. Artificialintelligence tools are available that can automatically and reliably code specific emotions and behaviors. However, the generatedoutput is not specifically aligned to applications in psychology. We present methods for automating behavioral coding using opensource software and provide an overview of available sources and instructions on how they can be applied to generate codes fromwidely used behavioral coding manuals. Using two examples, we describe methods for applying open source computer visionand hearing tools to code behavior in two settings: a parent-child interaction and a psychotherapeutic exposure session. We use amodular approach, defining specific behaviors with features extracted with computer vision and hearing tools that can be combinedinto higher order constructs. Modules can be combined in different ways to allow a flexible application to a variety of codingmanuals or observational tasks. In addition, we propose ways of testing the validity of the automated codes. Some modalities arebetter suited than others for specific tasks. For example, the performance of computer vision tools is excellent for detecting emotion,whereas speech signal processing is less sensitive to detecting specific emotions. However, speech is better suited for detectingvocalization than computer vision. Issues of privacy and bias are discussed as well as methods for mitigating these risks. Weidentified behaviors that can be computationally coded. Our proposed automated methods will enable researchers to code more oftheir video and audio data than is possible with human coding for meaningful behavioral information and investigate mechanisms atplay in social interactions. Some of these methods can be directly applied by psychologists whereas others necessitate collaborationwith computer scientists. |
