Voice Attack Recognition For Lyric Singing Learning Gesture: An Adaptive Video Game Interface

We will present an educational video games which propose the user to learn about his own voice attack production in order to teach him how to sing by imitation. The learning of singing, whether thought as the construction of the physical vocal pattern, or as the interpretative preparation of a piece of music, proceeds initially through observation, then by imitation of a given physical model. One of the principal difficulties in this mimetic process frequently lies in the different perceptions [1] of the singer and the listener. Without attempting to compensate directly this problem, we propose an interactive system that reacts to external data, thus facilitating the creation of a model of the singer and at the same time real-time simulation of his actions.We hence offer, within the given framework, to create a basic virtual animation, in order to recognize the voice attack. It is important at this stage to define the nature of the work envisaged, which will not consist of an exhaustive project. We specifically intend to describe the means for encoding the vocal attack expression and its relation to the facial and sound expression, in order to translate a feeling.We will then proceed to the development of a virtual, computer-generated lyric singer, using the process of interactive phonation as represented by a virtual actor with simplified expressions. Initially this phonation will be limited to the attack expression of a small number of phonemes. We will also predict the sound development based on this first attack. This part of the process could become the basis of further concrete developments and constitute the foundation for various potential extensions.