Multi-modal Interface in Multi-Display Environment for Multi-users

Multi-display environments (MDEs) are becoming more and more common. By introducing multi-modal interaction techniques such as gaze, body/hand and gestures, we established a sophisticated and intuitive interface for MDEs where the displays are stitched seamlessly and dynamically according to the users' viewpoints. Each user can interact with the multiple displays as if she is in front of an ordinary desktop GUI environment.