This paper presents a new approach to using music for debugging computer code, layered program au... more This paper presents a new approach to using music for debugging computer code, layered program auralization. We use layers of musical structure to represent the state and behavior of a computer program while it is running, taking advantage of metaphorical relationships between musical structure and programming constructs.
14th IEEE International Conference on Program Comprehension (ICPC'06), 2006
Layered program auralization uses music for debugging computer code. Layers of musical structure ... more Layered program auralization uses music for debugging computer code. Layers of musical structure represent the state and behavior of a computer program while it is running, taking advantage of metaphorical relationships between musical structure and programming constructs.
Time-frequency representations such as the spectrogram are commonly used to analyze signals havin... more Time-frequency representations such as the spectrogram are commonly used to analyze signals having a time-varying distribution of spectral energy, but the spectrogram is constrained by an unfortunate tradeoff between resolution in time and frequency. A method of achieving high-resolution spectral representations has been independently introduced by several parties. The technique has been variously named reassignment and remapping, but while the
Sound Morphing using Loris and the Reassigned Bandwdith-Enhanced Additive Sound Model: Practice and Applications
The reassigned bandwidth-enhanced additive sound model is a high-fidelity representation that all... more The reassigned bandwidth-enhanced additive sound model is a high-fidelity representation that allows ma- nipulations and transformations to be applied to a great variety of sounds, including noisy and non- harmonic sounds. Combining sinusoidal and noise en- ergy in a homogeneous representation, the reassigned bandwidth-enhanced model is ideally suited to sound morphing, and is implemented in the open source soft- ware
The Journal of the Acoustical Society of America, 2007
Two computational methods for pruning a reassigned spectrogram to show only quasisinusoidal compo... more Two computational methods for pruning a reassigned spectrogram to show only quasisinusoidal components, or only impulses, or both, are presented mathematically and provided with step-by-step algorithms. Both methods compute the second-order mixed partial derivative of the short-time Fourier transform phase, and rely on the conditions that components and impulses are each well-represented by reassigned spectrographic points possessing particular values of this derivative. This use of the mixed second-order derivative was introduced by Nelson ͓J. Acoust. Soc. Am. 110, 2575-2592 ͑2001͔͒ but here our goals are to completely describe the computation of this derivative in a way that highlights the relations to the two most influential methods of computing a reassigned spectrogram, and also to demonstrate the utility of this technique for plotting spectrograms showing line components or impulses while excluding most other points. When applied to speech signals, vocal tract resonances ͑formants͒ or glottal pulsations can be effectively isolated in expanded views of the phonation process.
This paper presents a new approach to using music for debugging computer code, layered program au... more This paper presents a new approach to using music for debugging computer code, layered program auralization. We use layers of musical structure to represent the state and behavior of a computer program while it is running, taking advantage of metaphorical relationships between musical structure and programming constructs.
ABSTRACT Modern digital hearing aid technology that is heavily optimized for speech intelligibili... more ABSTRACT Modern digital hearing aid technology that is heavily optimized for speech intelligibility often makes music unlistenable, so that hearing aid wearers often prefer to remove their hearing aids when listening to music. The effects of hearing aid processing on musical signals and on the perception of music have received very little attention. There is no standard test of music perception, and to make the problem more difficult, different musical styles thrive in strikingly different acoustical environments. There have been some studies on the effect of reduced bandwidth on the perceived quality of music, but no systematic evaluation of the effects of dynamic range compression, the most ubiquitous form of gain compensation in digital hearing aids. In this report we present a novel approach to hearing aid fitting applied to both individual differences in hearing impairment and differences among musical styles. The method uses a subjective space approach to reduce the dimensionality of the fitting problem and a non-linear regression technology to interpolate among hearing aid parameter settings. This listener-driven method provides not only a technique for optimal aid fitting, but also information on individual differences and the effects of gain compensation on different musical styles.
Sound Morphing using Loris and the Reassigned Bandwidth-Enhanced Additive Sound Model: Practice and Applications
International Computer Music Conference Proceedings, 2002
The reassigned bandwidth-enhanced additive sound model is a high-fidelity representation that all... more The reassigned bandwidth-enhanced additive sound model is a high-fidelity representation that allows ma- nipulations and transformations to be applied to a great variety of sounds, including noisy and non- harmonic sounds. Combining sinusoidal and noise en- ergy in a homogeneous representation, the reassigned bandwidth-enhanced model is ideally suited to sound morphing, and is implemented in the open source soft- ware
Uploads
Papers by Kelly Fitz