Free-hand gesture control with “touchable” virtual interface for human-3DTV interaction

Hand gesture based input method has quickly emerged as an alternative way for human-3DTV interaction. However, it limits the user experience and gets severe when gesture recognition in uncontrolled TV room is not accurate or robust enough and a large type and number of gestures are required. In this paper, we present a simple and fast human-3DTV interaction method that combines the advantages of touchless gesture input process and traditional direct-touch interaction with a hand-held device. Our system displays a virtual 3D interface in the user's view for the user to manipulate, and then recognizes the user's gestures to interact with the 3DTV. In this way the user could see immediate visual response on the 3D interface. Moreover, with several simple gestures, the user can manipulate 3DTV fasters and more accurate. The paper reports a user study on accuracy and speed to validate advantages by our proposed human-3DTV interaction approach.