Assessment of Speech Dialog Systems using Multi-modal Cognitive Load Analysis and Driving Performance Metrics
Paper in proceeding, 2009
In this paper, cognitive load analysis via acoustic-and CAN-Bus-based driver performance metrics is employed to assess two different commercial speech dialog systems (SDS) during in-vehicle use. Several metrics are proposed to measure increases in stress, distraction and cognitive load and we compare these measures with statistical analysis of the speech recognition component of each SDS. It is found that care must be taken when designing an SDS as it may increase cognitive load which can be observed through increased speech response delay (SRD), changes in speech production due to negative emotion towards the SDS, and decreased driving performance on lateral control tasks. From this study, guidelines are presented for designing systems which are to be used in vehicular environments.
Speech analysis
Stress measurement
Performance analysis
Delay
Guidelines
Acoustical engineering
Systems engineering and theory
Cellular phones
Instruments
Acoustic measurements
Author
Tristan Kleinschmidt
Queensland University of Technology (QUT)
Pinar Boyraz Baykas
University of Texas
Hynek Boril
University of Texas
S. Sridharan
Queensland University of Technology (QUT)
John H.L. Hansen
University of Texas
2009 IEEE International Conference on Vehicular Electronics and Safety (ICVES)
162-167 5400232
978-1-4244-5441-9 (ISBN)
2009 IEEE International Conference on Vehicular Electronics and Safety (ICVES)
Pune, India,
Pune, India,
Areas of Advance
Information and Communication Technology
Transport
Subject Categories (SSIF 2011)
Psychology (excluding Applied Psychology)
Applied Psychology
Vehicle Engineering
DOI
10.1109/ICVES.2009.5400232