A remix instrument based on fragment feature-analysis

We present an innovative remix-instrument that allows to create music from a collection of audio-visual media fragments. A three-dimensional scatter plot derived from feature-analysis becomes a Theremin-inspired instrument that enables exploration, intuitive navigation and embodied performance of the media fragments on a granular level. As example, we are using the audiovisual recording of an instrumental performance as source for interactive remix. Our system provides an alternative interface to the musical instrument's audiovisual corpus: as the instrument's sound and behavior can be accessed in ways which are not possible on the original instrument, the resulting non-linear playback of the grains generates an instant remix in a cut-up aesthetic. The presented system is a novel strategy to access and re-use media fragments in the domain of musical interfaces.