C. Scaletti and A.B. Craig. Using sound to extract meaning from complex data. In Proceedings SPIE, 1459, pages 207--219, 1991.  Home/Search   Document Details and Download   Summary   Related Articles   Check

....research was, and still is conducted on these subjects, where particularly the use of audio in the output direction was introduced in a wide variety of applications. Some examples of the use of sound (in the output direction) are in scientific visualization (to extract meaning from complex data [SC91]) in a human computer interface for the blind [Edw89] or as an addition to existing interfaces, such as the Sonic Finder , an interface that uses auditory icons [Gav89] However, most of this research was confined to monophonic sounds emitted by one simple speaker inside the computer. Although ....

C. Scaletti and A.B. Craig. Using sound to extract meaning from complex data. In Proceedings SPIE, 1459, pages 207--219, 1991.

....processors) more complex audio came within reach. In addition, researchers realized the advantages and potentials of the use of both speech and non speech audio in human computer interfaces and applications. Some examples are in scientific visualization (to extract meaning from complex data [SC91]) in a human computer interface for the blind [Edw89] or as an addition to existing interfaces, such as the Sonic Finder , an interface that uses auditory icons [Gav89] However, most of these applications were confined to monophonic sounds emitted by one simple speaker inside the computer. ....

C. Scaletti and A.B. Craig. Using sound to extract meaning from complex data. In Proceedings SPIE, 1459, pages 207--219, 1991.

.... acoustic signal for the purposes of facilitating communication and interpretation [1] In the auditory display community (ICAD) there has been a strong focus on the auditory side of this transformation, emphasizing psychoacoustics, parameterization of sound, spatial sound and sound design (e.g. [2, 3, 4, 5, 6]) These are very important issues that demand continued attention. We feel, however, that sonification is considered more as a technique than as a display, and that a thorough discussion of how to interact with such a display is lacking. This becomes even more important when exploring spatially ....

Scaletti, C. & Craig, A.B. Using sound to extract meaning from complex data. In Proceedings of the SPIE vol. 1459, San Jose, 1991: 207-219

....powerful glyphs for small data sets [Chernoff 73] glyphs for larger data sets are suggested by [Picket Grinstein 88] and [Beddow 90] Looking beyond visualization, one can also use senses other than our visual sense to express data values. Smith et al. [Smith et al. 90] and Scaletti and Craig [Scaletti Craig 91] use sound as an additional visual cue. 7.3 Line graphs Line graphs are used to display continuous information and are therefore an effective visual representation of scalar data sets of form D S 1 and of form D mS 1 . For D mS 1 , m lines differing by color, style or thickness can ....

SCALETTI, C. AND A.B. CRAIG. [1991]. Using Sound to Extract Meaning from Complex Data. NCSA. University of Illinois, Champaign IL.

....all of these techniques still have major shortcomings: It is still a flat piece of glass or paper. Even binocular displays do not force the human eye to change focus when moving from the front of the scene to the back. It only uses one sense, the sense of sight. As experiments show (e.g. [SCALETTI91]) there is much to be gained by reinforcing one sense s intake of information by simultaneously presenting it to another. Many of these tricks are difficult to take somewhere else and show other people. Flat hardcopy cannot capture all of the 3D cues. Once we leave the workstation environment, ....

Carla Scaletti and Alan Craig, Using Sound to Extract Meaning from Complex Data, NCSA videotape, February 19, 1991.

....and effortlessly, features such as colour, shape, orientation, spatial frequency, movement and curvature. Attentive vision serially processes and integrates these features. It has been shown that both execute in parallel [14] In addition, Sound has demonstrated its potential as a data conveyor [21, 10, 20, 3, 9]. In this context we feel that discussion should be in terms of data presentation [31] rather than visualisation, because the visual system is just one of the channels used to present data. 1 The paper introduces PowerTools, a framework where tools cooperate to build up supertools. Three tools ....

....risk) attached to them. This meaning attachment eases their interpretation and avoids long training periods. In addition, their real world nature engages the user in the model. 10 Musical sounds have been discarded because they have no meaning attachment, require expensive dedicated hardware [21, 20, 9] (e.g. MIDI keyboards, synthesizers) and, to be effective musical, expertise from the user [21, 9] Sounds are pre recorded by the SRT developers in directories and files supplied with SRT. These files can be considered as basic sound units that the SRT modifies according to the value of the ....

[Article contains additional citation context not shown here]

Carla Scaletti and Alan B Craig. Using sound to extract meaning from complex data. SPIE, 1459:207--219, 1991.

....of audio and visual information (the face of the talker and the word spoken) was equivalent to improving the signal to noise ratio by up to 24dB. PREVIOUS SONIFICATION APPROACHES A number of researchers have examined the application of sound parameters for the analysis of data. Scaletti Craig [4] experimented with sonification to enhance a series of pre existing visualization sequences of physical phenomena. Portigal [3] demonstrated that subjects who replayed sounds representative of document structure as a retention tactic performed better at retrieval tests than those who did not. ....

.... form AURALIZATION APPROACH The majority of the previously developed approaches to sonification are unsuitable for generic auralization solutions because of their reliance on particular hardware devices (typically dedicated MIDI or spatial sound processing units) For example, Scaletti Craig [4] utilised expensive hardware in the form of the Capybara multiple DSP system; Travera [7] employed the Convolvotron spatial audio hardware; Jackson Francioni [2] and Sonnewald et al. 5] employed MIDI equipment, which provides a generally affordable solution but can result in inconsistent ....

Scaletti, C., & Craig, A.B. (1991) Using sound to extract meaning from complex data. Proceedings of the SPIE Conference 1459, San Jose, California, pp. 207-219

....the audio and MIDI libraries to control the sound hardware. The use of these libraries makes it easy to extend the functionality of the program by increasing the understandability of the interface to the sound hardware. 13 3. Why Use Sound The auditory system excels at certain tasks. Carla Scaletti, 1991 3.1 Alarms and Monitors In considering how sound can provide meaningful information about data, we should consider how sound provides meaningful information in everyday listening. William Buxton points out that humans have highly developed listening skills [Buxton, 1990] We depend upon our ....

....difficulty with the system is that the hardware is somewhat exotic. A significant investment of time and money and some specialized knowledge is required to put together a similar system. This kind of investment is usually enough to deter someone who only wants to discover if sound might be useful [Scaletti and Craig, 1991] [Scaletti, 1993] Scaletti, 1994] 28 4.3.3 Astheimer: The apE Visualization System In 1992, P. Astheimer of the Fraunhofer Institute for Computer Graphics in Darmstadt, Germany, integrated a sonification tool into apE, an existing visualization system. The apE system, created at Ohio State ....

Carla Scaletti and A.B. Craig. Using sound to extract meaning from complex data. SPIE, 1459:206--219, 1991.

....before developing it s own language and representations, sonification has drawn on the experience of the computer music community. However, like visualization and graphics, sonification and music differ in important ways; sonification idioms are only beginning to emerge. As examples, Scaletti [7], Rabenhorst et al. [5] and Francioni [3] have begun exploring the use of new idioms and abstractions for mapping data to sound. Scaletti and Craig treat the data set as a stream of audio samples, transforming the new sound created this way, or using it to control other sounds. Rabenhorst and ....

Scaletti, C., and Craig, A. B. Using Sound to Extract Meaning from Complex Data. In Proceedings of the SPIE, Conference 1459, Extracting Meaning from Complex Data: Processing, Display, Interaction II (San Jose, CA, 1991).

....before developing it s own language and representations, sonification has drawn on the experience of the computer music community. However, like visualization and graphics, sonification and music differ in important ways; sonification idioms are only beginning to emerge. As examples, Scaletti [35], Rabenhorst et al. [31] and Francioni [11] have begun exploring the use of new idioms and abstractions for mapping data to sound. Francioni s work [11] is most relevant to our research goals, as it concerns the mapping of parallel computer system performance data to synthesized sound. Much of ....

Scaletti, C., and Craig, A. B. Using Sound to Extract Meaning from Complex Data. In Proceedings of the SPIE, Conference 1459, Extracting Meaning from Complex Data: Processing, Display, Interaction II (San Jose, CA, 1991).

....balance, which are explored by mouse cursor movement over the iconographic display. Rabenhorst et al. take a similar approach, mapping three dimensional vector gradients in an exploratory environment to de tuning and stereo balance of each of three notes in a musical chord. Scaletti and Craig [20] developed a preliminary set of standard, high level sonification tools that they used to add time varying, data driven sound to scientific visualizations. The fundamental tool, a Shifter, interprets a stream of data as samples of a waveform. The other tools use each value in the data stream to ....

....to reduce the processing time to manageable levels. The synthesis time can be reduced with special purpose digital signal processing hardware. The Capybara digital signal processor (based on nine Motorola 56001 digital signal processors running in parallel) was used by Scaletti and Craig [20] to support software synthesis in real time. The Capybara system is controlled by a functional, data stream language called Kyma, allowing the user to graphically combine sound synthesis building blocks and map data to sound. Although this is a flexible platform for building sonifications, the ....

[Article contains additional citation context not shown here]

Scaletti, C., and Craig, A. B. Using Sound to Extract Meaning from Complex Data. In Proceedings of the SPIE, Conference 1459, Extracting Meaning from Complex Data: Processing, Display, Interaction II (San Jose, CA, 1991).

No context found.

Scaletti, C. & Craig, A. (1991). Using Sound to Extract Meaning from Complex Data. In Proceedings of the SPIE, Conference 1459, Extracting Meaning from Complex Data: Processing, Display, Interaction II. San Jose: SPIE.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC