Citation Context

...or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. NIME’14, June 30 – July 03, 2014, Goldsmiths, University of London, UK. Copyright remains with the author(s). With the increased availability of motion tracking technologies, there has also been an increased effort towards the use of machine learning algorithms to recognise control actions of users. Such algorithms have been applied to control musical instruments (e.g. [7, 1, 8]), gesture based sound selection from a database [3], and study of instrumentalists’ sound-producing actions [4]. Our paper presents a new active music device, using a sensor sole and a novel movement classification algorithm to continuously recognise the movement pattern of the user. Movement patterns could be different gaits, such as running or walking straight or sideways, or other activities such as foot-tapping or jumping. Being an active music device, where the user can influence the music to some extent, the mapping between control actions and sound output is an essential part of the de...

Citation Context

...ons using monochromatic infrared cameras. Its FOV extends 25mm to 600mm with a 150o spread from the device and it has high framerate (>200fps) and precision (1/100mm per finger) [8]. 2.2 Gestural Control of Instruments Gestural instruments have been developed over many years (see Miranda and Wanderley [11] for a comprehensive treatment of the subject), and new developments (e.g. using cameras [13,14], motioncapture [15], or gloves [12]) are regularly reported. More recently the advent of consumer-level gesture-capture devices like the KinectTM has led to further developments in the area, e.g. [4, 22, 23]. The recent release of Leap MotionTM has likewise produced many examples of new instruments, largely documented in video alone (e.g. see [7]). One notable exception is the work of Silva et al. who undertook an evaluation of the sensor in the context of digital music instruments (in similar vein to this paper) [17]. In their case, they used visual and tactile feedback to aid the performer in locating their hand position and were able to measure latency using the difference between the timing of sounds recorded on the tactile surface and note triggering by the sensor. Our work evaluates the pla...

Citation Context

...” or “music” at KinectHacks 1 provides several pages of musical interfaces designed by the programming community; even in the academic world, four papers presented at NIME 2012 used the Kinect sensor =-=[11, 10, 15, 6]-=-. The Kinect has been used in compelling performances such as in the V Motion system 2 that showcase the potential of gestural instruments. However, designing gestural interfaces that use the Kinect p...