Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Amplitude Envelope and Alarm Design
References

Multimodal Technologies and Interaction

Profile image of Sharmila SreetharanSharmila Sreetharan

2019

https://doi.org/10.3390/MTI3010004
visibility

…

description

10 pages

link

1 file

Abstract

Quality care for patients requires effective communication amongst medical teams. Increasingly, communication is required not only between team members themselves, but between members and the medical devices monitoring and managing patient well-being. Most human–computer interfaces use either auditory or visual displays, and despite significant experimentation, they still elicit well-documented concerns. Curiously, few interfaces explore the benefits of multimodal communication, despite extensive documentation of the brain’s sensitivity to multimodal signals. New approaches built on insights from basic audiovisual integration research hold the potential to improve future human–computer interfaces. In particular, recent discoveries regarding the acoustic property of amplitude envelope illustrate that it can enhance audiovisual integration while also lowering annoyance. Here, we share key insights from recent research with the potential to inform applications related to human–computer...

Related papers

Overview of auditory representations in human-machine interfaces
Csapo Adam, György Wersényi

ACM Computing Surveys, 2013

In recent years, a large number of research projects have focused on the use of auditory representations in a broadened scope of application scenarios. Results in such projects have shown that auditory elements can effectively complement other modalities not only in the traditional desktop computer environment but also in virtual and augmented reality, mobile platforms, and other kinds of novel computing environments. The successful use of auditory representations in this growing number of application scenarios has in turn prompted researchers to rediscover the more basic auditory representations and extend them in various directions. The goal of this article is to survey both classical auditory representations (e.g., auditory icons and earcons) and those auditory representations that have been created as extensions to earlier approaches, including speech-based sounds (e.g., spearcons and spindex representations), emotionally grounded sounds (e.g., auditory emoticons and spemoticons), and various other sound types used to provide sonifications in practical scenarios. The article concludes by outlining the latest trends in auditory interface design and providing examples of these trends.

View PDFchevron_right
Improving detectability of auditory interfaces for medical alarms through temporal variation in amplitude envelope
Michael Schutz

British Journal of Anaesthesia, 2023

Background: Auditory interfaces play a vital role in many applications, informing users about both urgent and routine information critical to safety. Unfortunately, problems related to high alarm rates, low reliability, and sound annoyance create barriers to optimising the quality of patient care in perioperative medicine and critical care. Here, we explore how to reduce annoyance and improve detection by manipulating a sound's temporal envelope or the way its energy changes over time. Methods: In the first experiment, participants were asked to detect a series of percussive and flat tones presented at six signal-to-noise ratios while performing a concurrent speech comprehension task. In the second experiment, different participants were asked to evaluate the relative annoyance of these same sounds. Results: Relative to industry-standard flat tones, percussive tones were significantly less annoying and more detectable. Although more detectable, percussive tones did not impair concurrent speech comprehension. Conclusions: Temporal variation in amplitude envelope represents a promising path towards improving auditory interfaces for patient monitoring. By using temporally variable sounds, auditory interfaces can be more effective in alerting users. This is important for safety-critical areas, such as medical alarms, where annoyance often limits efficacy. As this manipulation can preserve the pitch and rhythm of tone sequences, it is compatible with users' pre-existing knowledge of current alarms.

View PDFchevron_right
More detectable, less annoying: Temporal variation in amplitude envelope and spectral content improves auditory interface efficacy
Michael Schutz

The Journal of the Acoustical Society of America, 2022

Auditory interfaces, such as auditory alarms, are useful tools for human computer interaction. Unfortunately, poor detectability and annoyance inhibit the efficacy of many interface sounds. Here, it is shown in two ways how moving beyond the traditional simplistic temporal structures of normative interface sounds can significantly improve auditory interface efficacy. First, participants rated tones with percussive amplitude envelopes as significantly less annoying than tones with flat amplitude envelopes. Crucially, this annoyance reduction did not come with a detection cost as percussive tones were detected more often than flat tones-particularly, at relatively low listening levels. Second, it was found that reductions in the duration of a tone's harmonics significantly lowered its annoyance without a commensurate reduction in detection. Together, these findings help inform our theoretical understanding of detection and annoyance of sound. In addition, they offer promising original design considerations for auditory interfaces. V

View PDFchevron_right
Designing the Model Human Cochlea: An Ambient Crossmodal Audio-Tactile Display
Deborah Fels

IEEE Transactions on Haptics, 2009

View PDFchevron_right
Multimodal Signals: Cognitive and Algorithmic Issues
Bernd J Kröger, Dianle Zhou, Anna Esposito

Lecture Notes in Computer Science, 2009

... 1 Gerard Chollet, Anna Esposito, Annie Gentes, Patrick Horain, Walid Karam, Zhenbo Li, Catherine Pelachaud, Patrick Perrot, Dijana Petrovska-Delacretaz, Dianle Zhou, and Leila Zouari Speech through the Ear, the Eye, the Mouth and the Hand..... ...

View PDFchevron_right
Sonification of Brain and Body Signals in Collaborative Tasks Using a Tabletop Musical Interface
Sergi Jorda

Physiological Computing has been applied in different disciplines, and is becoming popular and widespread in Human-Computer Interaction, due to device miniaturization and improvements in realtime processing. However, most of the studies on physiologybased interfaces focus on single-user systems, while their use in Computer-Supported Collaborative Work (CSCW) is still emerging. The present work explores how sonification of human brain and body signals can enhance user experience in collaborative music composition. For this task, a novel multimodal interactive system is built using a musical tabletop interface (Reactable) and a hybrid Brain-Computer Interface (BCI). The described system allows performers to generate and control sounds using their own or their fellow team member's physiology. Recently, we assessed this physiology-based collaboration system in a pilot experiment. Discussion on the results and future work on new sonifications will be accompanied by practical demonstration during the conference.

View PDFchevron_right
Virtual auditory reality reduced to the bare essentials
William Hartmann

The Journal of the Acoustical Society of America, 1995

View PDFchevron_right
Auditory Displays in Human–Machine Interfaces
Gunnar Johannsen

Proceedings of the IEEE, 2004

Auditory displays are described for several application domains: transportation, industrial processes, health care, operation theaters, and service sectors. Several types of auditory displays are compared, such as warning, state, and intent displays. Also, the importance for blind people in a visualized world is considered with suitable approaches. The service robot domain has been chosen as an example for the future use of auditory displays within multimedia process supervision and control applications in industrial, transportation, and medical systems. The design of directional sounds and of additional sounds for robot states, as well as the design of more complicated robot sound tracks, are explained. Basic musical elements and robot movement sounds have been combined. Two exploratory experimental studies, one on the understandability of the directional sounds and the robot state sounds as well as another on the auditory perception of intended robot trajectories in a simulated supermarket scenario, are described. Subjective evaluations of sound characteristics such as urgency, expressiveness, and annoyance have been carried out by nonmusicians and musicians. These experimental results are briefly compared with time-frequency analyses.

View PDFchevron_right
Designing a model human cochlea: issues and challenges in crossmodal audio-haptic displays
Deborah Fels

Proceedings of the First International Conference on Ambient Media and Systems, 2008

In this paper, we describe a Model Human Cochlea (MHC), a sensory substitution technique aimed at translating some of the emotional content expressed in music onto a haptic ambient display. We present some of the issues and challenges encountered in designing the model. This research is situated within the domain of crossmodal displays, with specific focus on enhancing the entertainment experience associated with film audio for users who are deaf or hard of hearing. The interface, in its final form factor, will be integrated into an EmotiChair, a multi-sensory entertainment interface that supports crossmodal audio-haptic display interactions. To assist with the design of the MHC, we have developed a flexible prototype to support research in crossmodal audio-haptic displays. Details of the multidisciplinary design process that has informed the development of the the MHC prototype, and the evaluation methodology adopted to explore the different configurations of the MHC are presented.

View PDFchevron_right
Intensity dependent interaction in audiovisual integration
Valéria Csépe

2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom), 2012

Ventriloquism is one of the most exciting phenomena in multimodal perception. It refers to a percept when an auditory and a visual stimulus coincide but has different spatial origin, and the latter attracts the location of the sound on the perceptual level. A huge number of studies revealed how and when certain properties of the constituting modalities interact during the processing of multimodal information. However none of them dealt with one of the most prominent aspect of real world signals, namely their intensity. We used high and low intensity audio and visual signals in a task where participants were asked to decide whether the sound came from left or right. Results showed that only high intensity visual stimuli attracted sound locations. We found also that response times for high intensity sounds increased in conditions where they were presented with high intensity visual stimuli on the opposite side. These results suggest that spatial ventriloquism depends on stimulus intensity. I.

View PDFchevron_right

References (80)

  1. Mullet, K.; Sano, D. Designing Visual Interfaces: Communication Oriented Techniques; Prentice Hall PTR: Upper Saddle River, NJ, USA, 1994.
  2. Marcus, A. Human-computer Interaction; Baecker, R.M., Grudin, J., Buxton, W.A.S., Greenberg, S., Eds.; Morgan Kaufmann Publishers Inc.: San Francisco, CA, USA, 1995; pp. 425-441, ISBN 1-55860-246-1.
  3. Rocchesso, D.; Bresin, R.; Fernstrom, M. Sounding Objects. IEEE MultiMed. 2003, 10, 42-52. [CrossRef]
  4. Jeon, M. Auditory User Interface Design: Practical Evaluation Methods and Design Process Case Studies. Int. J. Des. Soc. 2015, 8, 1-16. [CrossRef]
  5. Calvert, G.A.; Spence, C.; Stein, B.E. The Handbook of Multisensory Processes; MIT Press: Cambridge, MA, USA, 2004; ISBN 0262033216.
  6. Meredith, M.A.; Stein, B.E. Interactions among Converging Sensory Inputs in the Superior Colliculus. Science 1983, 221, 389-391. [CrossRef] [PubMed]
  7. Stein, B.E.; Stanford, T.R.; Ramachandran, R.; Perrault, T.; Rowland, B. Challenges in quantifying multisensory integration: Alternative criteria, models, and inverse effectiveness. Exp. Brain Res. 2009, 198, 113-126. [CrossRef] [PubMed]
  8. Stein, B.E.; Meredith, M.A. The Merging of the Senses; The MIT Press: Cambridge, MA, USA, 1993; ISBN 0-262-19331-0.
  9. Stein, B.E.; Stanford, T.R. Multisensory integration: Current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 2008, 9, 255-266. [CrossRef]
  10. Meredith, M.A.; Stein, B.E. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J. Neurophysiol. 1986, 56, 640-662. [CrossRef] [PubMed]
  11. May, P.J. The mammalian superior colliculus: Laminar structure and connections. In Neuroanatomy of the Oculomotor System; Büttner-Ennever, J., Ed.; Elsevier: New York, NY, USA, 2006; Volume 151, pp. 321-378, ISBN 0079-6123.
  12. King, A.J. The superior colliculus. Curr. Biol. 2004, 14, R335-R338. [CrossRef] [PubMed]
  13. Wallace, M.T.; Meredith, M.A.; Stein, B.E. Multisensory Integration in the Superior Colliculus of the Alert Cat. J. Neurophysiol. 1998, 80, 1006-1010. [CrossRef] [PubMed]
  14. Hirokawa, J.; Sadakane, O.; Sakata, S.; Bosch, M.; Sakurai, Y. Multisensory Information Facilitates Reaction Speed by Enlarging Activity Difference between Superior Colliculus Hemispheres in Rats. PLoS ONE 2011, 6, e25283. [CrossRef] [PubMed]
  15. Hammond-Kenny, A.; Bajo, V.M.; King, A.J.; Nodal, F.R. Behavioural benefits of multisensory processing in ferrets. Eur. J. Neurosci. 2017, 45, 278-289. [CrossRef] [PubMed]
  16. Sparks, D.L. Translation of sensory signals into commands for control of saccadic eye movements: Role of primate superior colliculus. Physiol. Rev. 1986, 66, 118-171. [CrossRef] [PubMed]
  17. Leo, F.; Bertini, C.; di Pellegrino, G.; Làdavas, E. Multisensory integration for orienting responses in humans requires the activation of the superior colliculus. Exp. Brain Res. 2008, 186, 67-77. [CrossRef] [PubMed]
  18. Pitti, A.; Kuniyoshi, Y.; Quoy, M.; Gaussier, P. Development of the Multimodal Integration in the Superior Colliculus and Its Link to Neonates Facial Preference BT. In Advances in Cognitive Neurodynamics (IV);
  19. Liljenström, H., Ed.; Springer: Dordrecht, The Netherlands, 2015; pp. 543-546.
  20. Ross, L.A.; Saint-Amour, D.; Leavitt, V.M.; Javitt, D.C.; Foxe, J.J. Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 2007, 17, 1147-1153. [CrossRef] [PubMed]
  21. McGurk, H.; MacDonald, J. Hearing lips and seeing voices. Nature 1976, 264, 746-748. [CrossRef] [PubMed]
  22. Ghazanfar, A.A. The multisensory roles for auditory cortex in primate vocal communication. Hear. Res. 2009, 258, 113-120. [CrossRef] [PubMed]
  23. Venezia, J.H.; Vaden, K.I.; Rong, F.; Maddox, D.; Saberi, K.; Hickok, G. Auditory, Visual and Audiovisual Speech Processing Streams in Superior Temporal Sulcus. Front. Hum. Neurosci. 2017, 11, 174.
  24. Beauchamp, M.S.; Lee, K.E.; Argall, B.D.; Martin, A. Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus. Neuron 2004, 41, 809-823. [CrossRef]
  25. Hein, G.; Knight, R.T. Superior Temporal Sulcus-It's My Area: Or Is It? J. Cogn. Neurosci. 2008, 20, 2125-2136.
  26. Noesselt, T.; Rieger, J.W.; Schoenfeld, M.A.; Kanowski, M.; Hinrichs, H.; Heinze, H.; Driver, J. Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices. J. Neurosci. 2007, 27, 11431-11441. [CrossRef]
  27. Beauchamp, M.S.; Nath, A.R.; Pasalar, S. fMRI-Guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect. J. Neurosci. 2010, 30, 2414-2417. [CrossRef]
  28. Marques, L.M.; Lapenta, O.M.; Merabet, L.B.; Bolognini, N.; Boggio, P.S. Tuning and disrupting the brain-modulating the McGurk illusion with electrical stimulation. Front. Hum. Neurosci. 2014, 8, 533.
  29. Shams, L.; Kamitani, Y.; Shimojo, S. Visual illusion induced by sound. Cogn. Brain Res. 2002, 14, 147-152.
  30. Bolognini, N.; Rossetti, A.; Casati, C.; Mancini, F.; Vallar, G. Neuromodulation of multisensory perception: A tDCS study of the sound-induced flash illusion. Neuropsychologia 2011, 49, 231-237. [CrossRef] [PubMed]
  31. Walker, J.T.; Scott, K.J. Auditory-visual conflicts in the perceived duration of lights, tones and gaps. J. Exp. Psychol. Hum. Percept. Perform. 1981, 7, 1327-1339. [CrossRef] [PubMed]
  32. Iordanescu, L.; Grabowecky, M.; Franconeri, S.; Theeuwes, J.; Suzuki, S. Characteristic sounds make you look at target objects more quickly. Atten. Percept. Psychophys. 2010, 72, 1736-1741. [CrossRef] [PubMed]
  33. Vroomen, J.; de Gelder, B. Sound enhances visual perception: Cross-modal effects of auditory organization on vision. J. Exp. Psychol. Hum. Percept. Perform. 2000, 26, 1583-1590. [CrossRef] [PubMed]
  34. Van der Burg, E.; Olivers, C.N.L.; Bronkhorst, A.W.; Theeuwes, J. Pip and pop: Nonspatial auditory signals improve spatial visual search. J. Exp. Psychol. Hum. Percept. Perform. 2008, 34, 1053-1065. [CrossRef]
  35. Perrott, D.R.; Sadralodabai, T.; Saberi, K.; Strybel, T.Z. Aurally Aided Visual Search in the Central Visual Field: Effects of Visual Load and Visual Enhancement of the Target. Hum. Factors 1991, 33, 389-400. [CrossRef] [PubMed]
  36. Ushioda, H.; Wada, Y. Multisensory integration between visual and tactile motion information: Evidence from redundant-signals effects on reaction time. Proc. Fechner Day 2007, 23, 1.
  37. Brewster, S.; Raty, V.-P.; Kortekangas, A. Enhancing Scanning Input With Non-Speech Sounds. In Proceedings of the Second Annual ACM Conference on Assistive Technologies, Vancouver, BC, Canada, 11-12 April 1996; pp. 10-14.
  38. Vitense, H.S.; Jacko, J.A.; Emery, V.K. Multimodal feedback: An assessment of performance and mental workload. Ergonomics 2003, 46, 68-87. [CrossRef] [PubMed]
  39. Brewster, S. Sonically-Enhanced Drag and Drop. In Proceedings of the International Conference on Auditory Display (ICAD 98), Glasgow, UK, 1-4 November 1998; pp. 1-7.
  40. Lutfi, R.A. Auditory detection of hollowness. J. Acoust. Soc. Am. 2001, 110, 1010-1019. [CrossRef]
  41. Wee, A.N.; Sanderson, P. Are melodic medical equipment alarms easily learned? Anesth. Analg. 2008, 106, 501-508. [CrossRef] [PubMed]
  42. Sanderson, P.; Wee, A.N.; Lacherez, P. Learnability and discriminability of melodic medical equipment alarms. Anaesthesia 2006, 61, 142-147. [CrossRef] [PubMed]
  43. Risset, J.-C.; Wessel, D.L. Exploration of Timbre by Analysis and Synthesis. In The Psychology of Music; Deutsch, D., Ed.; Gulf Professional Publishing: San Diego, CA, USA, 1999; pp. 113-169, ISBN 0122135652.
  44. Gaver, W. What in the world do we hear?: An ecological approach to auditory event perception. Ecol. Psychol. 1993, 5, 1-29. [CrossRef]
  45. Neuhoff, J.G. Ecological Psychoacoustics; Neuhoff, J.G., Ed.; Elsevier Academic Press: Amsterdam, The Netherlands, 2004; ISBN 9780125158510.
  46. Gordon, J.W. The perceptual attack time of musical tones. J. Acoust. Soc. Am. 1987, 82, 88-105. [CrossRef] [PubMed]
  47. Strong, W.; Clark, M. Perturbations of synthetic orchestral wind-instrument tones. J. Acoust. Soc. Am. 1967, 41, 277-285. [CrossRef]
  48. Skarratt, P.A.; Cole, G.G.; Gellatly, A.R.H. Prioritization of looming and receding objects: Equal slopes, different intercepts. Attent. Percep. Psychophys. 2009, 71, 964-970. [CrossRef] [PubMed]
  49. Saldanha, E.L.; Corso, J.F. Timbre cues and the identification of musical instruments. J. Acoust. Soc. Am. 1964, 36, 2021-2026. [CrossRef]
  50. Goswami, U. A temporal sampling framework for developmental dyslexia. Trends Cogn. Sci. 2011, 15, 3-10. [CrossRef] [PubMed]
  51. Schutz, M. Acoustic structure and musical function: Musical notes informing auditory research. In The Oxford Handbook on Music and the Brain; Thaut, M.H., Hodges, D.A., Eds.; Oxford University Press: Oxford, UK, 2011.
  52. Schlauch, R.S.; Ries, D.T.; DiGiovanni, J.J. Duration discrimination and subjective duration for ramped and damped sounds. J. Acoust. Soc. Am. 2001, 109, 2880-2887. [CrossRef] [PubMed]
  53. Grassi, M.; Pavan, A. The subjective duration of audiovisual looming and receding stimuli. Atten. Percept. Psychophys. 2012, 74, 1321-1333. [CrossRef] [PubMed]
  54. Grassi, M.; Darwin, C.J. The subjective duration of ramped and damped sounds. Percept. Psychophys. 2006, 68, 1382-1392. [CrossRef] [PubMed]
  55. DiGiovanni, J.J.; Schlauch, R.S. Mechanisms responsible for differences in perceived duration for rising-intensity and falling-intensity sounds. Ecol. Psychol. 2007, 19, 239-264. [CrossRef]
  56. Grassi, M. Sex difference in subjective duration of looming and receding sounds. Perception 2010, 39, 1424-1426. [CrossRef] [PubMed]
  57. Ries, D.T.; Schlauch, R.S.; DiGiovanni, J.J. The role of temporal-masking patterns in the determination of subjective duration and loudness for ramped and damped sounds. J. Acoust. Soc. Am. 2008, 124, 3772-3783. [CrossRef] [PubMed]
  58. Stecker, G.C.; Hafter, E.R. An effect of temporal asymmetry on loudness. J. Acoust. Soc. Am. 2000, 107, 3358-3368. [CrossRef] [PubMed]
  59. Teghtsoonian, R.; Teghtsoonian, M.; Canévet, G. Sweep-induced acceleration in loudness change and the "bias for rising intensities". Percept. Psychophys. 2005, 67, 699-712. [CrossRef]
  60. Neuhoff, J.G. An Adaptive Bias in the Perception of Looming Auditory Motion. Ecol. Psychol. 2001, 13, 87-110. [CrossRef]
  61. Neuhoff, J.G. Perceptual bias for rising tones. Nature 1998, 395, 123-124. [CrossRef]
  62. Welch, R.; Warren, D. Immediate perceptual response to intersensory discrepancy. Psychol. Bull. 1980, 88, 638-667. [CrossRef] [PubMed]
  63. Fendrich, R.; Corballis, P.M. The temporal cross-capture of audition and vision. Percept. Psychophys. 2001, 63, 719-725. [CrossRef] [PubMed]
  64. Schutz, M.; Lipscomb, S.D. Hearing gestures, seeing music: Vision influences perceived tone duration. Perception 2007, 36, 888-897. [CrossRef] [PubMed]
  65. Schutz, M. The mind of the listener: Acoustics, perception, and the musical experience. Percuss. Notes 2009, 22-28.
  66. Schutz, M.; Kubovy, M. Causality and cross-modal integration. J. Exp. Psychol. Hum. Percept. Perform. 2009, 35, 1791-1810. [CrossRef] [PubMed]
  67. Chuen, L.; Schutz, M. The unity assumption facilitates cross-modal binding of musical, non-speech stimuli: The role of spectral and amplitude cues. Attent. Percept. Psychophys. 2016, 78, 1512-1528. [CrossRef] [PubMed]
  68. Armontrout, J.A.; Schutz, M.; Kubovy, M. Visual determinants of a cross-modal illusion. Atten. Percept. Psychophys. 2009, 71, 1618-1627. [CrossRef]
  69. Schutz, M. Crossmodal Integration: The Search for Unity; University of Virginia: Charlottesville, VA, USA, 2009.
  70. Schutz, M.; Stefanucci, J.; Baum, S.H.; Roth, A. Name that percussive tune: Associative memory and amplitude envelope. Q. J. Exp. Psychol. 2017, 70, 1323-1343. [CrossRef]
  71. Schutz, M.; Vaisberg, J.M. Surveying the temporal structure of sounds used in Music Perception. Music Percept. Interdiscip. J. 2014, 31, 288-296. [CrossRef]
  72. Vallet, G.; Shore, D.I.; Schutz, M. Exploring the role of amplitude envelope in duration estimation. Perception 2014, 43, 616-630. [CrossRef]
  73. Schutz, M.; Stefanucci, J. Hearing value: Exploring the effects of amplitude envelope on consumer preference. Ergon. Des. Q. Hum. Factors Appl. in press.
  74. Sreetharan, S.; Schlesinger, J.; Schutz, M. Designing Effective Auditory Interfaces: Exploring the Role of Amplitude Envelope. In Proceedings of the ICMPC15/ESCOM10, Graz, Austria, 23-28 July 2018; Parncutt, R., Sattmann, S., Eds.; pp. 426-431.
  75. Rayo, M.F.; Moffatt-Bruce, S.D. Alarm system management: Evidence-based guidance encouraging direct measurement of informativeness to improve alarm response: Table 1. BMJ Qual. Saf. 2015, 24, 282-286. [CrossRef] [PubMed]
  76. AAMI. Clinical Alarms Clinical Alarms Summit Conveners; AAMI: Arlington, VA, USA, 2011.
  77. Edworthy, J. Does sound help us to work better with machines? a commentary on Rauterberg's paper "About the importance of auditory alarms during the operation of a plant simulator". Interact. Comput. 1998, 10, 401-409.
  78. Block, F.E. "For if the trumpet give an uncertain sound, who shall prepare himself to the battle?" (I Corinthians 14:8, KJV). Anesth. Analg. 2008, 106, 357-359. [CrossRef] [PubMed]
  79. Grassi, M.; Casco, C. Audiovisual bounce-Inducing effect: When sound congruence affects grouping in vision. Attent. Percep. Psychophys. 2010, 72, 378-386. [CrossRef] [PubMed]
  80. Edworthy, J.; Hellier, E. Alarms and human behaviour: Implications for medical alarms. Br. J. Anaesth. 2006, 97, 12-17. [CrossRef] [PubMed]

Related papers

Improving Human-Computer Interface Design through Application of Basic Research on Audiovisual Integration and Amplitude Envelope
Michael Schutz

Multimodal Technologies and Interaction, 2019

Quality care for patients requires effective communication amongst medical teams. Increasingly, communication is required not only between team members themselves, but between members and the medical devices monitoring and managing patient well-being. Most human-computer interfaces use either auditory or visual displays, and despite significant experimentation, they still elicit well-documented concerns. Curiously, few interfaces explore the benefits of multimodal communication, despite extensive documentation of the brain's sensitivity to multimodal signals. New approaches built on insights from basic audiovisual integration research hold the potential to improve future human-computer interfaces. In particular, recent discoveries regarding the acoustic property of amplitude envelope illustrate that it can enhance audiovisual integration while also lowering annoyance. Here, we share key insights from recent research with the potential to inform applications related to human-computer interface design. Ultimately, this could lead to a cost-effective way to improve communication in medical contexts-with signification implications for both human health and the burgeoning medical device industry.

View PDFchevron_right
Acoustic rendering as support for sustained attention during biomedical procedures
Emil Jovanov

1998

Biomedical procedures of long duration cause mental fatigue and attention deficit. We investigated using sound as a means to support sustained attention during prolonged procedures and analysis. In this paper we present tactical audio as support for precise manual positioning of a surgical instrument, and introduce acoustic rendering as an additional information channel and/or warning signal in EEG analysis.

View PDFchevron_right
Psychoacoustic Sonification as User Interface for Human-Machine Interaction
Tim Ziemer, Nuttawut Nuchprayoon

Psychoacoustic Sonification as User Interface for Human-Machine Interaction, 2020

When operating a machine, the operator needs to know some spatial relations, like the relative location of the target or the nearest obstacle. Often, sensors are used to derive this spatial information, and visual displays are deployed as interfaces to communicate this information to the operator. In this paper, we present psychoacoustic sonification as an alternative interface for human-machine interaction. Instead of visualizations, an interactive sound guides the operator to the desired target location, or helps her avoid obstacles in space. By considering psychoacoustics-i.e., the relationship between the physical and the perceptual attributes of sound-in the audio signal processing, we can communicate precisely and unambiguously interpretable direction and distance cues along three orthogonal axes to a user. We present exemplary use cases from various application areas where users can benefit from psychoacoustic sonification.

View PDFchevron_right
Auditory and Visual Facilitation: Cross-Modal Fusion of Information in Multi-Modal Displays
Mark Chignell

The modern battlefield is increasingly populated with vast amounts of electronic information. The plethora of data that can be delivered needs to be filtered, interpreted, and formatted in ways that are meaningful and useful for particular tasks and situations. Cross-modal fusion of information should be helpful in optimizing battlespace interfaces to provide the maximum amount of data to the commander and in enhancing their operational picture while avoiding increasing working memory load. Boyne, S.; Pavlovic, N.; Kilgore, R.; Chignell, M.H. (2005) Auditory and Visual Facilitation: Cross-Modal Fusion of Information in Multi-Modal

View PDFchevron_right
Decaying amplitude envelopes reduce alarm annoyance: Exploring new approaches to improving auditory interfaces
Michael Schutz

Applied Ergonomics, 2021

Auditory alarms offer great potential for facilitating human-computer interactions in complex, rapidly changing environments. They are particularly useful in medical settings, where in theory they should afford communication in emergency rooms, operating theatres, and hospitals around the world. Unfortunately, the sounds typically used in these devices are problematic, and researchers have documented numerous shortcomings. Their ubiquity means that even incremental improvements can have significant benefits for patient care. However, solutions have proven challenging for multiple reasons-including issues of backward compatibility inherent in changing any standard. Here we present a series of three experiments showing that manipulations to one specific, understudied property can significantly lower alarm annoyance without harming learning or memory-while preserving an alarm's melodic and rhythmic structure. These results suggest promising new directions for improving the hospital's soundscape, where evidence of problems related to sound are increasingly recognized as affecting medical outcomes as well as physician well-being.

View PDFchevron_right

Cited by

On the generalization of tones: A detailed exploration of non-speech auditory perception stimuli
Jessica Gillard

Scientific Reports, 2020

The dynamic changes in natural sounds’ temporal structures convey important event-relevant information. However, prominent researchers have previously expressed concern that non-speech auditory perception research disproportionately uses simplistic stimuli lacking the temporal variation found in natural sounds. A growing body of work now demonstrates that some conclusions and models derived from experiments using simplistic tones fail to generalize, raising important questions about the types of stimuli used to assess the auditory system. To explore the issue empirically, we conducted a novel, large-scale survey of non-speech auditory perception research from four prominent journals. A detailed analysis of 1017 experiments from 443 articles reveals that 89% of stimuli employ amplitude envelopes lacking the dynamic variations characteristic of non-speech sounds heard outside the laboratory. Given differences in task outcomes and even the underlying perceptual strategies evoked by dyn...

View PDFchevron_right
580 California St., Suite 400
San Francisco, CA, 94104
© 2025 Academia. All rights reserved