Operator Monitoring in Control Center

Dynamically changing task requirements can lead to high cognitive load, distraction, fatigue or drowsiness, and thus affect safety. Operator monitoring measures relevant states using multimodal, non-invasive sensors, such as cameras and wearables. Our approach combines various data sources, such as eye, head and body tracking, as well as heart and respiratory activity, to derive metrics such as stress, attention, workload, focus and fatigue, and to adapt the operator state monitoring system to different control rooms and application scenarios.