Feature-Based Synthesis for Sonification and
2006
Abstract
We present a general framework for synthesizing audio manifesting arbitrary sets of perceptually motivated, quantifiable acoustic features. Much work has been done recently on finding acoustic features that describe perceptually relevant aspects of sound. The ability to synthesize sounds defined by arbitrary feature values would allow perception researchers to more directly generate stimuli "to order," as well as providing an opportunity to directly test the perceptual relevance and characteristics of such features. The methods we describe also provide a straightforward way of approaching the problem of mapping from data to synthesis control parameters for sonification.
References (22)
- REFERENCES
- A. Horner, J. Beauchamp, and L. Haken, "Machine Tongues XVI: Genetic algorithms and their application to FM matching synthesis," Computer Music Journal 17(3), pp. 17-29, 1993.
- A. Horner, N. Cheung, and J. Beauchamp, "Genetic algorithm optimization of additive synthesis envelope breakpoints and group synthesis parameters," in Proceedings of the International Computer Music Conference 1995, pp. 215-222.
- A. Horner, J. Beauchamp, and R. So, 2004, "A search for best error metrics to predict discrimination of original and spectrally altered musical instrument sounds," in Proceedings of the International Computer Music Conference 2004, pp. 9-16.
- S. Wun, A. Horner, and L. Ayers, "A comparison between local search and genetic algorithm methods for wavetable matching," in Proceedings of the International Computer Music Conference, 2004, pp. 386-389.
- A.J. Joseph and S.K. Lodha, "MUSART: Musical Audio Transfer Function Real-Time Toolkit," in Proceedings of the International Conference on Auditory Display, Kyoto, Japan, 2002.
- H. Terasawa, M. Slaney, and Berger, J. "Perceptual Distance in Timbre Space," in Proceedings of the International Conference on Auditory Display, Limerick, Ireland, 2005.
- M. Lee, and D. Wessel, "Connectionist models for real- time control of synthesis and compositional algorithms," in Proceedings of the International Computer Music Conference 1992 pp. 277-280.
- I. Bowler, A. Purvis, P. Manning, and N. Bailey, "On mapping N articulation onto M synthesizer-control parameters," in Proceedings of the International Computer Music Conference 1990, pp. 181-184.
- T. Lidy, G. Pölzlbauer, and A. Rauber, "Sound re- synthesis from rhythm pattern features -audible insight into a music feature extraction process," in Proceedings of the International Computer Music Conference 2005, pp. 93-96.
- S. Lakatos, P. Cook, and G. Scavone, "Selective attention to the parameters of a physically informed sonic model," Acoustics Research Letters Online, Acoustical Society of America, March 2000.
- Scharf, B. "Auditory attention: The psychoacoustical approach," in Attention, edited by H. Pashler et al. Psychology Press, Hove, U.K., 1998.
- A. Kameoka, and M. Kuriyagawa, "Consonance theory, Part II: Consonance of complex tones and its calculation method," Journal of the Acoustical Society of America, 45, 1460-1469, 1969.
- B. N. Walker and J. T. Cothran, "Sonification Sandbox: A graphical toolkit for auditory graphs," in Proceedings of the International Conference on Auditory Display, Boston, MA, 2003.
- O. Ben-Tal, J. Berger, B. Cook, M. Daniels, G. Scavone, and P. Cook, "SONART: the sonification application research toolbox," in Proceedings of the Int. Conf. On Auditory Display, 2002.
- S. Pauletto and Andy Hunt, "A toolkit for interactive sonification," in Proceedings of the Int. Conf. on Auditory Display, 2004.
- P. Cook and S. Lakatos, "Using DSP-based parametric synthesis models to study human perception," in Proceedings of the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, Mohonk, NY, 2003.
- D. Rocchesso, "Acoustic cues for 3-D shape information," in Proceedings of the 2001 International Conference on Auditory Display, Espoo, Finland, 2001.
- L. Ottaviani and D. Rocchesso, "Auditory perception of 3D size: experiments with synthetic resonators," ACM Transactions on Applied Perceptions, Vol. 1, No. 2, Pages 118-129, October 2004.
- Scavone, G., Lakatos, S., Cook, P., and Harbke, C., "Perceptual spaces for sound effects obtained with an interactive similarity rating program," in Proceedings of the International Symposium on Musical Acoustics, 2001
- M. Slaney, "Auditory toolbox," Technical Report # 1998-010. Interval Research Corporation, Palo Alto, CA, 1998.
- G. Tzanetakis, A. Ermolinskyi, P. Cook, "Pitch histograms in audio and symbolic music information retrieval," in Proceedings of ISMIR, 2002.