Title
The Protocol for Integration of Automated and Dynamic Facial Expression Emotion Recognition with EEG for Emotional Traits Analysis in Pilot Candidates
Authors
[ 1 ] Instytut Napędów i Lotnictwa, Wydział Inżynierii Lądowej i Transportu, Politechnika Poznańska | [ 2 ] Instytut Informatyki, Wydział Informatyki i Telekomunikacji, Politechnika Poznańska | [ P ] employee | [ SzD ] doctoral school student | [ S ] student
Scientific discipline (Law 2.0)
[2.3] Information and communication technology[2.7] Civil engineering, geodesy and transport
Year of publication
2025
Chapter type
chapter in monograph / paper
Publication language
english
Keywords
EN
- Emotion recognition
- EEG analysis
- Neurological evaluation
Abstract
EN Pilots face unique psychological challenges and possess distinctive psychological traits. Research in aviation psychology has shown that pilots exhibit increased levels of assertiveness, activity, and a propensity for excitement-seeking. Initially, reactions were analyzed manually using the Facial Action Coding System (FACS), which includes 46 action units (AUs). Today, automated systems based on artificial intelligence, like FaceReader (by Noldus), have been developed. Other physiological parameters, such as blood pressure, heart rate, heart rate variability (HRV), and skin conductance, provide additional methods for recognizing emotions. The electroencephalogram (EEG) allows for a deeper understanding of emotions by examining bioelectrical responses and cognitive appraisal processes. This paper presents a protocol for the integration of automated and dynamic facial expression emotion recognition with EEG for the analysis of emotional traits in pilot candidates. The system is tested at the Poznan University of Technology Aviation Training Center. Additionally, the collected data will be used to build an AI model, which is intended to be used to support personalized neurorehabilitations.
Pages (from - to)
197 - 200
Ministry points / chapter
5
System created by Poznań University of Technology
and Poznan Supercomputing and Networking Center
Log in through eKonto to add to SIS