Academia.eduAcademia.edu

Outline

Monophonic Sonification for Spatial Navigation

2019, Proceedings of International Workshop on Informatics

Abstract

Sonification is the communication of variable data by means of sound. It can be used as an alternative or augmentation of visualization. In this paper we describe and evaluate a sonification approach that communicates the location of a target in three dimensional space. This is achieved by thorough consideration of auditory perception in our sonification. An experiment with passive listeners reveals that the sonification is readily interpretable. Listeners are able to identify the direction and distance along the single dimensions. This renders the sonification suitable for interactive navigation tasks in three dimensional space.

References (29)

  1. Thomas Hermann, Andy Hunter, and John G. Neuhoff, editors. The Sonification Handbook. COST and Logos, Berlin, 2011. URL http://sonification.de/ handbook/.
  2. Gaëtan Parseihian, Charles Gondre, Mitsuko Ara- maki, Solvi Ystad, and Richard Kronland-Martinet. Comparison and evaluation of sonification strate- gies for guidance tasks. IEEE Trans. Multime- dia, 18(4):674-686, April 2016. ISSN 1520-9210. doi:10.1109/TMM.2016.2531978.
  3. Tim Ziemer, Holger Schultheis, David Black, and Ron Kikinis. Psychoacoustical interactive sonification for short range navigation. Acta Acustica united with Acustica, 104(6):1075-1093, 2018. ISSN 1610-1928. doi:10.3813/AAA.919273.
  4. Tim Ziemer and Holger Schultheis. Psychoacoustic au- ditory display for navigation: an auditory assistance sys- tem for spatial orientation tasks. J. Multimodal User In- terfaces, Special Issue: Interactive Sonification, 2018. doi:10.1007/s12193-018-0282-2.
  5. Tim Ziemer and Holger Schultheis. Psychoacousti- cal signal processing for three-dimensional sonification. In 25th International Conference on Auditory Displays (ICAD2019), Newcastle, June 2019.
  6. Tapio Lokki and Matti Gröhn. Navigation with au- ditory cues in a virtual environment. IEEE Multi- Media, 12(2):80-86, April 2005. ISSN 1070-986X. doi:10.1109/MMUL.2005.33.
  7. Bruce N. Walker and Jeffrey Lindsay. Navigation per- formance with a virtual auditory display:effects of bea- con sound, capture radius, and practice. Human Factors, 48(2):265-278, 2006.
  8. Tim Ziemer and Holger Schultheis. A psychoacous- tic auditory display for navigation. In 24th Interna- tional Conference on Auditory Displays (ICAD2018), Houghton, MI, June 2018. doi:10.21785/icad2018.007.
  9. David Black, Christian Hansen, Arya Nabavi, Ron Kiki- nis, and Horst Hahn. A survey of auditory display in image-guided interventions. International Journal of Computer Assisted Radiology and Surgery, 12(9):1665- 1676, 2017. doi:10.1007/s11548-017-1547-z.
  10. Tim Ziemer and David Black. Psychoacoustically motivated sonification for surgeons. In Interna- tional Journal of Computer Assisted Radiology and Surgery, volume 12, pages 265-266, Barcelona, Jun 2017. URL https://link.springer.com/ article/10.1007/s11548-017-1588-3.
  11. Holger Schultheis, Tim Ziemer, and Tina Vajsbaher. Cognitive surgical assistance in minimally-invasive in- terventions. In 8. Interdisziplinären Workshops zu Kog- nitiven Systemen, pages 12-13, Duisburg-Essen, March 2019. doi:10.17185/duepublico/4840.
  12. Douglas S. Brungart, Brian D. Simpson, Ronald C. Dall- man, Griffin Romigh, Richard Yasky, and John Raquet. A comparison of head-tracked and vehicle-tracked vir- tual audio cues in an aircraft navigation taask. In Pro- ceedings of the 13th International Conference on Audi- tory Display, pages 32-37, Montréal, Jun 2007. URL http://hdl.handle.net/1853/49972.
  13. André Lundkvist, Roger Johnsson, Arne Nykänen, and Jakob Stridfelt. 3d auditory displays for parking assis- tance systems. SAE Int. J. Passeng. Cars -Electron.
  14. Electr. Syst., 10:17-23, 04 2017. doi:10.4271/2017-01- 9627.
  15. He Huang, Steven L Wolf, and Jiping He. Recent devel- opments in biofeedback for neuromotor rehabilitation. Journal of NeuroEngineering and Rehabilitation, 3(11), 2006. doi:10.1186/1743-0003-3-11.
  16. Daniel S. Scholz, Sönke Rohde, Nikou Nikmaram, Hans-Peter Brückner, Michael Großbach, Jens D. Roll- nik, and Eckart O. Altenmüller. Sonification of arm movements in stroke rehabilitation -a novel approach in neurologic music therapy. Frontiers in Neurol- ogy, 7:Article ID: 106, 2016. ISSN 1664-2295. doi:10.3389/fneur.2016.00106.
  17. Eberhard Zwicker and Hugo Fastl. Psychoacoustics. Facts and Models. Springer, Berlin, Heidelberg, second updated edition, 1999. doi:10.1007/978-3-662-09562-1.
  18. D. Arfib, J.M. Couturier, Kessous, L., and V. Ver- faille. Strategies of mapping between gesture data and synthesis model parameters using perceptual spaces. Journal of Organised Sound, 7(2):127-144, 2002. doi:10.1017/S1355771802002054.
  19. Jens Blauert. Spatial Hearing. The Pychophysics of Hu- man Sound Source Localization. MIT Press, Cambridge, MA, revised edition, 1997.
  20. Albrecht Schneider. Pitch and Pitch Percep- tion, pages 605-685. Springer Berlin Heidelberg, Berlin, Heidelberg, 2018. ISBN 978-3-662-55004-5. doi:10.1007/978-3-662-55004-5 31.
  21. Roger N. Shepard. Circularity in judgments of relative pitch. The Journal of the Acoustical Society of America, 36(12):2346-2353, 1964. doi:10.1121/1.1919362.
  22. Tim Ziemer. Psychoacoustic Music Sound Field Synthe- sis (in Print), volume 6 of Current Research in System- atic Musicology. Springer, Cham, 2019.
  23. Albrecht Schneider. Perception of timbre and sound color. In Rolf Bader, editor, Springer Handbook of Systematic Musiwology, chapter 32, pages 687-726.
  24. Springer, Berlin, Heidelberg, 2018. doi:10.1007/978- 3-662-55004-5 32.
  25. Tim Ziemer, Yi Yu, and Suhua Tang. Using psychoa- coustic models for sound analysis in music. In Proceed- ings of the 8th Annual Meeting of the Forum on Infor- mation Retrieval Evaluation, FIRE '16, pages 1-7, New York, NY, USA, 2016. ACM. ISBN 978-1-4503-4838- 6. doi:10.1145/3015157.3015158.
  26. Tim Ziemer, David Black, and Holger Schultheis. Psy- choacoustic sonification design for navigation in surgi- cal interventions. Proceedings of Meetings on Acoustics, 30, 2017. doi:10.1121/2.0000557.
  27. Tim Ziemer. Two-dimensional psychoacoustic sonifica- tion. In Franziska Olbertz, editor, 33. Jahrestagung der deutschen Gesellschaft für Musikpsychologie (DGM), pages 60-61, Hamburg, Sep 2017. URL https: //www.researchgate.net/publication/ 319778727_Two-dimensional_ psychoacoustic_sonification.
  28. W. Aures. Berechnungsverfahren für den sensorischen wohlklang beliebiger schallsignale (a model for calcu- lating the sensory euphony of various sounds). Acustica, 59(2):130-141, 1985.
  29. Tim Ziemer and Holger Schultheis. Perceptual auditory display for two-dimensional short-range navigation. In Fortschritte der Akustik -DAGA 2018, pages 1094- 1096, Munich, March 2018. Deutsche Gesellschaft für Akustik. URL https://www.dega-akustik. de/publikationen/online-proceedings/.