Abstract

This paper presents a method for learning, tracking, and recognizing human gestures using a view-based approach to model both object and behavior. Object views are represented using sets of view models, rather than single templates. Stereotypical space-time patterns, i.e. gestures, are then matched to stored gesture patterns using dynamic time warping. Real-time performance is achieved by using special-purpose correlation hardware and view prediction to prune as much of the search space as possible. Both view models and view predictions are learned from examples. We present results showing tracking and recognition of human hand gestures at over 10Hz. 1 Introduction The location and orientation of head, hand, and eyes is a critical element of all human dialog. The ability to follow objects moving through space and recognize particular motions as meaningful gestures is therefore essential if computer systems are to interact naturally with human users [2, 6]. Currently, however, this inf...

Citations