Learn with Haptics: Improving Vocabulary Recall with Free-form Digital Annotation on Touchscreen Mobiles
Paper in proceeding, 2020

Mobile vocabulary learning interfaces typically present material only in auditory and visual channels, underutilizing the haptic modality. We explored haptic-integrated learning by adding free-form digital annotation to mobile vocabulary learning interfaces. Through a series of pilot studies, we identified three design factors: Annotation mode, presentation sequence, and vibrotactile feedback, that influence recall in haptic-integrated vocabulary interfaces. These factors were then evaluated in a within-subject comparative study using a digital flashcard interface as baseline. Results using a 84-item vocabulary showed that the 'whole word' annotation mode is highly effective, yielding a 24.21% increase in immediate recall scores and a 30.36% increase in the 7-day delayed scores. Effects of presentation sequence and vibrotactile feedback were more transient; they affected the results of immediate tests, but not the delayed tests. We discuss the implications of these factors for designing future mobile learning applications.

intersensory reinforced learning

haptics for learning

mobile vocabulary learning

motoric engagement

multimodal learning


Smitha Sheshadri

National University of Singapore (NUS)

S. D. Zhao

National University of Singapore (NUS)

Yang Chen

Zhejiang University

Morten Fjeld

Chalmers, Computer Science and Engineering (Chalmers), Interaction design

Conference on Human Factors in Computing Systems - Proceedings

9781450367080 (ISBN)

2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020
Honolulu, USA,

Subject Categories

Media and Communication Technology

Interaction Technologies

Human Computer Interaction



More information

Latest update