Kinecting With Music : A Human Interface for a Digital Orchestra

We have developed Virtual Orchestra, a Microsoft Kinect game written in C# that creates an interactive virtual experience analogous to that of conducting an orchestra[6]. It allows an untrained user to virtually manipulate components of the playback of a MIDI song file including tempo, volume, pausing, and starting using motion detection with gesture recognition. A graphical user interface (GUI) reflects the changes a player has created in the MIDI song by displaying instruments currently playing, volume, and the next two measures of notes. This project required the communication between three main disparate components: gesture recognition, a MIDI controller, and an interactive GUI, all of which communicate via a central dispatch.