Augmented Reality Eye Tracking for Tram Driver Simulator Training: Concept, Implementation, and Early Feedback

Paper in proceeding, 2025

This paper presents a novel approach to visual attention training for novice tram drivers by combining a tram driving simulator with eye-tracking-enabled Augmented Reality (AR) glasses. Based on previous eye-tracking studies and interviews with tram driving instructors, we identified issues related to the attention distribution of novice drivers. That is, we found that driver field-of-view areas critical to tram-driving safety, are often neglected by novices. For instance, such areas enable drivers to check the right-side mirror before turning right. The training system proposed here aims to direct novice visual attention to critical areas by highlighting overlooked regions, displaying directional arrows, or providing auditory cues from the left or right side. Integration of real-time eye tracking into AR glasses supports continuous monitoring of trainee gaze patterns, offering instructors valuable information on trainee visual behavior. Such real-time data allows for dynamic adaptation of training cues, ensuring that visual attention guidance is both relevant and personalized. The proposed system has the potential to enhance situational awareness among tram drivers.