Datadriven Human Intention Analysis : Supported by Virtual Reality and Eye Tracking
Licentiatavhandling, 2021

The ability to determine an upcoming action or what decision a human is about to take, can be useful in multiple areas, for example in manufacturing where humans working with collaborative robots, where knowing the intent of the operator could provide the robot with important information to help it navigate more safely. Another field that could benefit from a system that provides information regarding human intentions is the field of psychological testing where such a system could be used as a platform for new research or be one way to provide information in the diagnostic process. The work presented in this thesis investigates the potential use of virtual reality as a safe, customizable environment to collect gaze and movement data, eye tracking as the non-invasive system input that gives insight into the human mind, and deep machine learning as the tool that analyzes the data. The thesis defines an experimental procedure that can be used to construct a virtual reality based testing system that gathers gaze and movement data, carries out a test study to gather data from human participants, and implements an artificial neural network in order to analyze human behaviour. This is followed by four studies that gives evidence to the decisions that were made in the experimental procedure and shows the potential uses of such a system.

psychological testing.

time series analysis

eye tracking

uncertainty estimation

human intention prediction

Virtual reality (VR)

collaborative robots

deep machine learning

Opponent: Professor Mikael Ekström, Mälardalen Högskola

Författare

Julius Pettersson

Chalmers, Elektroteknik, System- och reglerteknik, Automation

Human Movement Direction Classification using Virtual Reality and Eye Tracking

Procedia Manufacturing,; Vol. 51(2020)p. 95-102

Paper i proceeding

Cognitive Ability Evaluation using Virtual Reality and Eye Tracking

2018 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS (CIVEMSA),; (2018)

Paper i proceeding

Julius Pettersson, Petter Falkman, Human Arm Movement Intention Prediction using Eye Tracking

Julius Pettersson, Petter Falkman, Human Movement Direction Prediction using Virtual Reality and Eye Tracking

Styrkeområden

Informations- och kommunikationsteknik

Produktion

Hälsa och teknik

Drivkrafter

Hållbar utveckling

Ämneskategorier

Data- och informationsvetenskap

Robotteknik och automation

Signalbehandling

Utgivare

Chalmers tekniska högskola

Online

Opponent: Professor Mikael Ekström, Mälardalen Högskola

Mer information

Senast uppdaterat

2021-05-28