Abstract

Sounds are generally associated with motion events in the real world. Therefore, there is an intimate linkage between the two. In most cases, however, motions and sounds in computer animations and virtual environments (VE) are treated separately. In this paper, we present a methodology to map sounds to motions. In particular, we present a system designed for soundtrack production which seeks to bring musical accompaniments within the reach of animators as well as for live performance using VE peripherals. The creative compositional process involves filtering the data being generated by the motion control system and mapping these values to musical constructs. A simple UI as well as animator-programmable filters allow flexible control over the nature of the music produced. The system's rendering can be in the form of common musical scores (e.g. CSOUND, MIDI), or as real-time performance of musical pieces. Using this methodology, we have produced aesthetically pleasing, appropriate music ...

Citations