A Bermuda Triangle?: A Review of Method Application and Triangulation in User Experience Evaluation
Paper in proceeding, 2018

User experience (UX) evaluation is a growing field with diverse approaches. To understand the development since previous meta-review efforts, we conducted a state-of-the-art review of UX evaluation techniques with special attention to the triangulation between methods. We systematically selected and analyzed 100 papers from recent years and while we found an increase of relevant UX studies, we also saw a remaining overlap with pure usability evaluations. Positive trends include an increasing percentage of field rather than lab studies and a tendency to combine several methods in UX studies. Triangulation was applied in more than two thirds of the studies, and the most common method combination was questionnaires and interviews. Based on our analysis, we derive common patterns for triangulation in UX evaluation efforts. A critical discussion about existing approaches should help to obtain stronger results, especially when evaluating new technologies.




mixed methods


User experience



Ingrid M Pettersson

Chalmers, Industrial and Materials Science

Volvo Cars

Florian Lachner

Ludwig Maximilian University of Munich (LMU)

Anna-Katharina Frison

Technical University Ingolstadt

Andreas Riener

Technical University Ingolstadt

Andreas Butz

Technical University of Munich

Conference on Human Factors in Computing Systems - Proceedings

Vol. 2018-April
978-1-4503-5620-6 (ISBN)

The 2018 CHI Conference on Human Factors in Computing Systems
Montreal, Canada,

AUX - Automotive User Experience

VINNOVA (2012-03664), 2013-01-01 -- 2016-12-31.

Subject Categories

Media and Communication Technology

Human Computer Interaction

Information Systemes, Social aspects

Areas of Advance

Information and Communication Technology



More information

Latest update

4/7/2022 1