Real-Time both hands gesture recognition system:prototype for VR and computer music conducting

Abstract

Human-computer interaction is an important issue in the development of modern computer technology and virtual environment.In this paper, we present a real-time and dynamic both hands gesture recognition system. The prototype has been built on low-cost personal computerwith user-friendly interface and adopts for various users. Nerual network learning technique, dynamic time warping method and spatial sensoring schemes are incorporated. The goal is to design an intelligent system which can distinguish between various spatio-temporal signal representing hand gestures. The resulting system possesses severazl superior characteristics:real-time and online learning, user-friendly and functionality,and high recognition rate. we demonstrate the merits of the proposed gesture recognition system with two applications:(1)virtual reality application in which the object is manipulated by the gestures and (2)virtual band conducting with gestures.