Automatic real-time FACS-coder to anonymise drivers in eye tracker videos
Paper in proceedings, 2011

Driver’s face is a rich source of information for understanding driver behaviour. From the driver’s face, one could get an idea of the driver’s emotional state and where s/he looks at. In recent years, naturalistic driving studies and field operational tests have been conducted to collect driver behavioural data, which often includes video of the driver, from many drivers driving for an extended period of time. Due to the Data Privacy Act, it is desirable to make the driver video anonymous, while preserving the original facial expressions. This paper describes our attempt to make a system that could do so. The system is a combination of an automatic Facial Action Coding System (FACS) coder based on Active Appearance Models (AAMs), a classifier that analyses local deformations in the AAM shape mesh and a 3D visualisation. The image acquisition hardware is based on a SmartEye eye tracker installed in a vehicle. The eye tracker we used provides a constant image quality independent of external illumination, which is a precondition for deploying the system in a vehicle environment. While the system uses Action Unit (AU) activations internally, the evaluation was done using the six basic emotions.


Selpi Selpi

Chalmers, Applied Mechanics, Vehicle Safety

Torsten Wilhelm

Smart Eye AB

Marcus N E Jansson

Chalmers, Applied Mechanics, Vehicle Safety

Li Hagström

Chalmers, Applied Mechanics, Vehicle Safety

Niklas Brandin

Räven AB

Magnus Andersson

Räven AB

John-Fredrik Grönvall

Volvo Cars

Proceedings of the IEEE International Conference on Computer Vision. 2011 IEEE International Conference on Computer Vision Workshops, ICCV Workshops 2011, Barcelona, 6-13 November 2011


Subject Categories

Computer Engineering

Computer Science

Computer Vision and Robotics (Autonomous Systems)

Areas of Advance

Information and Communication Technology


Driving Forces

Sustainable development


Basic sciences





More information

Latest update