Gaze Based Human Intention Analysis
Doctoral thesis, 2023
Virtual reality (VR)
deep machine learning
human intention prediction
time series analysis
Chalmers, Electrical Engineering, Systems and control
Human Movement Direction Classification using Virtual Reality and Eye Tracking
Procedia Manufacturing,; Vol. 51(2020)p. 95-102
Paper in proceeding
Intended Human Arm Movement Direction Prediction using Eye Tracking
International Journal of Computer Integrated Manufacturing,; Vol. In Press(2023)
Comparison of LSTM, Transformers, and MLP-mixer neural networks for gaze based human intention prediction
Frontiers in Neurorobotics,; Vol. 17(2023)
Cognitive Ability Evaluation using Virtual Reality and Eye Tracking
2018 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS (CIVEMSA),; (2018)
Paper in proceeding
Exploring the usability of Virtual Reality and Eye Tracking for Psychological Testing using Raven’s Progressive Matrices
This thesis presents a system that uses artificial intelligence (AI) to predict in what direction a human is about to reach her/his arm, solely based on where they have been looking, their eye gaze. Measuring eye gaze is interesting from a behavioral perspective, because it is a noninvasive method that can give an insight into the individual’s problem solving, reasoning, and search strategies. The tests performed in this work, using virtual reality (VR), shows promising results using the combination of eye gaze and AI as a method to predict human movement intention. VR is shown as an important tool to be able to analyze eye gaze and at the same time ensure the safety of the human operator as these means of communicating with a robot are not yet possible in a real world setting.
Finally, the thesis focuses on how the AI can estimate its own uncertainty and how we can use that to determine whether to trust its predictions or not. However, as this research is in its early phase, there are several other points of uncertainty that still need to be addressed in the future before it is possible to use this work in the real world. There are also other areas that may benefit from analysis of human intention. One such area is also addressed in the current thesis, where the same set-up is utilized in the context of psychological testing. As AI technology continues to develop, it can be used to enhance the process of psychological testing by increasing the amount and variety of information that can be obtained during testing, increasing the accuracy of the test scores.
Electrical Engineering, Electronic Engineering, Information Engineering
Doktorsavhandlingar vid Chalmers tekniska högskola. Ny serie: 5326
EB-salen, Hörsalsvägen 11.
Opponent: Professor Mikael Ekström, Mälardalens universitet, Västerås, Sverige