Assessment of Speech Dialog Systems using Multi-modal Cognitive Load Analysis and Driving Performance Metrics
Paper in proceeding, 2009
In this paper, cognitive load analysis via acoustic-and CAN-Bus-based driver performance metrics is employed to assess two different commercial speech dialog systems (SDS) during in-vehicle use. Several metrics are proposed to measure increases in stress, distraction and cognitive load and we compare these measures with statistical analysis of the speech recognition component of each SDS. It is found that care must be taken when designing an SDS as it may increase cognitive load which can be observed through increased speech response delay (SRD), changes in speech production due to negative emotion towards the SDS, and decreased driving performance on lateral control tasks. From this study, guidelines are presented for designing systems which are to be used in vehicular environments.
Delay
Acoustical engineering
Instruments
Systems engineering and theory
Guidelines
Stress measurement
Performance analysis
Cellular phones
Acoustic measurements
Speech analysis
Author
Tristan Kleinschmidt
Queensland University of Technology (QUT)
Pinar Boyraz Baykas
University of Texas at Dallas
Hynek Boril
University of Texas at Dallas
S. Sridharan
Queensland University of Technology (QUT)
John H.L. Hansen
University of Texas at Dallas
2009 IEEE International Conference on Vehicular Electronics and Safety (ICVES)
162-167 5400232
978-1-4244-5441-9 (ISBN)
2009 IEEE International Conference on Vehicular Electronics and Safety (ICVES)
Pune, India,
Pune, India,
Areas of Advance
Information and Communication Technology
Transport
Subject Categories
Psychology (excluding Applied Psychology)
Applied Psychology
Vehicle Engineering
DOI
10.1109/ICVES.2009.5400232