Real-Time 3D Hand Interaction: Optimization and Complexity Reduction
Paper in proceeding, 2008

This paper suggests a low-cost way to enable 3D hand interaction based on the frame capturing functionality of a single consumer-grade webcam. Our recent developments have focused on examining and realizing a less complex method. The suggested method reduces tracking effort to only one reference marker: a color-coded bracelet that helps locate the part of the captured frame containing the user's hand. The located area contains all the information needed to extract hand rotation and finger angle data. To facilitate hand feature extraction we outfit the user's hand with a specially coded glove equipped with two square palm markers, one for each side of the hand, and five distinct finger colors. We believe that our approach of tracking only one marker will be more efficient than related methods that track each finger separately. The method is further simplified by using spatial properties drawn from physiological characteristics of the human hand to limit the areas considered by the algorithm. Some challenges in realizing this method are related to webcam limitations such as image noise and limited image- and color-resolution. Other challenges are overlapping hands and fingers, hand positioning outside the field of view, and interference by local light sources.

hand tracking

gesture

algorithms

3D interaction

artificial

experimentation

3D navigation

tracking

mixed reality

performance

scene analysis

design

3D hand interaction

augmented and virtual realities

object recognition

Author

Sven Berg Ryen

Chalmers, Computer Science and Engineering (Chalmers)

Morten Fjeld

Interaction design

Jonas Fredriksson

Chalmers, Computer Science and Engineering (Chalmers)

Proc. ACM NordiCHI 2008

Vol. 1 1 133-141
9781595937049 (ISBN)

Subject Categories

Computer Engineering

DOI

10.1145/1463160.1463175

ISBN

9781595937049

More information

Created

10/7/2017