Academia.eduAcademia.edu

Interactive Audio

description35 papers
group1,402 followers
lightbulbAbout this topic
Interactive audio refers to sound design and production techniques that allow users to engage with audio content in a dynamic manner, often in real-time. This field encompasses the creation of audio experiences that respond to user inputs, enhancing immersion and interactivity in various media, including video games, virtual reality, and interactive installations.
lightbulbAbout this topic
Interactive audio refers to sound design and production techniques that allow users to engage with audio content in a dynamic manner, often in real-time. This field encompasses the creation of audio experiences that respond to user inputs, enhancing immersion and interactivity in various media, including video games, virtual reality, and interactive installations.

Key research themes

1. How can audio be utilized and designed to enhance interactivity and accessibility in immersive and multimodal environments?

This area focuses on leveraging audio technology to augment user interaction in both virtual and physical spaces, including mobile HCI, virtual reality, and multimedia platforms. It addresses how audio cues, visualizations, and multimodal feedback can be designed to facilitate more inclusive experiences, particularly for users with sensory impairments, and to enrich immersion and expressivity in interactive systems.

Key finding: This paper presents SoundVizVR, a Unity plugin that visualizes sound characteristics and types in VR to improve sound accessibility for deaf or hard-of-hearing users, validated through user studies showing that combined Full... Read more
Key finding: The study foregrounds the use of autoethnographic methods and multi-perspective design approaches to explore audio-based mobile HCI, showing how localized sound and its emotional, spatial, and cultural meanings contribute to... Read more
Key finding: This research highlights the development of robust multimedia systems with advanced sound synchronization and interactive control capabilities, overcoming limitations of conventional multimedia frameworks by incorporating... Read more
Key finding: The paper develops Tampokme, a multiplayer audio game designed with accessible controls suited for visually and motor-impaired players, demonstrating through iterative design and sound-focused interface simplification that... Read more
Key finding: Playsound.space offers a web-based platform enabling live collaborative musical improvisation through semantic search and real-time playback of Creative Commons sounds from large online databases, validated by user studies... Read more

2. What computational and psychoacoustic models advance the expressive communication and perceptual quality of audio in interactive media?

This theme investigates computational frameworks and psychoacoustic techniques aimed at capturing, modeling, and enhancing expressive audio characteristics for richer musical interaction, audio reproduction, and user experience. It includes parametric audio coding, expressive performance modeling, and perceptual quality evaluation under different listening contexts, focused on creating computational tools to emulate or simulate audio expressivity and listener preferences.

Key finding: The paper reviews expressive analysis and modeling paradigms for music performance, emphasizing the need to capture systematic acoustic deviations by performers as communicative expressive cues beyond musical scores, thereby... Read more
Key finding: Introduces advanced parametric multi-channel audio coding strategies—such as phase compensated downmixing, blind upmixing, and acoustic diversity creation—to achieve low-overhead immersive sound reproduction, improving... Read more
Key finding: This study develops an interactive earphone simulator that interpolates acoustic measurements of 14 earphones along spectral shape and stereo image axes and demonstrates through a controlled experiment that preferred virtual... Read more
Key finding: Corroborates the development of a psychoacoustically founded two-dimensional interactive earphone simulator that captures 66.2% of variability in acoustic features and reveals that listeners’ preferred sound signatures depend... Read more
Key finding: Demonstrates through physiological (skin conductance and heart rate) and subjective measures that sound significantly elevates arousal and influences player preference and cognitive biases in slot machine play, underscoring... Read more

3. How do interactive audio technologies and techniques enable novel forms of creative musical and narrative expression?

This theme examines the role of interactive audio in artistic and cultural contexts, focusing on the use of audio for creative improvisation, narrative enhancement, and experiential design in domains such as performing arts, video games, visual music, and digital storytelling. Research addresses how audio interactivity facilitates emergent user participation, adaptive sonic experiences, and the fusion of sound with other media for innovative artistic expression.

Key finding: Playsound.space supports free improvisation and experimental music by enabling real-time, semantic sound searches from large online sound databases with visual spectrogram feedback, allowing for spontaneous musical creation... Read more
Key finding: Explores the innovative use of scrolling as a novel interaction model combined with granular synthesis on the web to create immersive and non-linear audio experiences, demonstrating that natural user inputs can enable... Read more
Key finding: Analyzes the challenges of synchronizing linear music scores with highly interactive gameplay, highlighting how the tension between player agency and musical narrative forces the music design to accommodate unpredictability,... Read more
Key finding: Presents rhythmic visualizations as a multisensory artistic practice that merges music with dynamic color and form regulated by brainwave entrainment principles, offering new methods for enhancing musical experiences via... Read more
Key finding: Surveys the emerging role of video games as platforms for musical engagement and education, emphasizing their characteristics of interactivity, immersion, and social engagement which foster creative and critical thinking,... Read more

All papers in Interactive Audio

Notre travail porte sur l'utilisation de l'interaction 3D immersive pour la performance musicale. De nombreuses recherches ont été menées sur l'utilisation d'interfaces graphiques pour le contrôle musical. Elles ont notamment décrit... more
The article outlines a psychoacoustically founded method to describe the acoustic performance of earphones in two dimensions, Spectral Shape and Stereo Image Coherence. In a test set of 14 typical earphones, these dimensions explained... more
Notre travail porte sur l'utilisation de l'interaction 3D immersive pour la performance musicale. De nombreuses recherches ontété menées sur l'utilisation d'interfaces graphiques pour le contrôle musical. Elles ont notamment décrit... more
Guest lecture delivered at the University of Milan, 10/04/2024. Pictures used for didactic purposes only. All rights belong to the owners. Embedded YouTube videos replaced by clickable areas.
Rhythmic Visualizations, also known as visual music, epitomize the convergence of art, technology, and sensory exploration, leading to a paradigm shift in our understanding and interaction with music. Leveraging advanced software... more
Notre travail porte sur l'utilisation de l'interaction 3D immersive pour la performance musicale. De nombreuses recherches ontété menées sur l'utilisation d'interfaces graphiques pour le contrôle musical. Elles ont notamment décrit... more
Actes du Colloque Le corps dans les jeux vidéo ubiquitaires 20 novembre 2014 co-organisé par le laboratoire RIRRA21 de l'UM3 et LIRMM de l'UM
Slot machine wins and losses have distinctive, measurable, physiological effects on players. The contributing factors to these effects remain under-explored. We believe that sound is one of these key contributing factors. Sound plays an... more
Travail achevé dans sa première version le 15 mai 2010, révisé le 20 janvier 2011 Résumé Nous observons depuis plusieurs années l'apparition de singuliers systèmes homme-machine se positionnant dans le champ de la créativité musicale sans... more
Évoquer la mort Hervé ZÉNOUDA, Les images et les sons dans les hypermédias artistiques contemporains. De la correspondance à la fusion
Ubiquitous music (UbiMus) proposes to study how social interaction with mobile and distributed technologies can converge to form novel creativity support tools and music artistic practices. A recent field overlapping with UbiMus is the... more
This article offers an overview of the Greco-Latin and early modern Jesuit sources of Stefan Iavorskii’s (1658–1722) three bilingual panegyrics addressed to his patron Varlaam Iasinskii, rector of the Kiev-Mohyla college (1669–1689), the... more
This paper aims to investigate the creative uses of scrolling as an interaction method for navigating through sound and music. Mainly focused on the use of granular synthesis, the paper explores the interaction model and technical... more
Hors des placements habituels de l'informatique dans le domaine de la musique et de Ja musicologie, on constate depuis peu l'apparition de systèmes hommes-machines qui manifestent leur existence en rupture avec une tradition... more
An ever more sedentary lifestyle is a serious problem in our society. Enhancing people's exercise adherence through technology remains an important research challenge. We propose a novel approach for a system supporting walking that draws... more
Évoquer la mort Hervé ZÉNOUDA, Les images et les sons dans les hypermédias artistiques contemporains. De la correspondance à la fusion
ENIGMES (Expérimentation de Nouvelles Interfaces Gestuelles Musicales et Sonores) est un projet de recherche et d’expérimentation pédagogique interdisciplinaire développé à l’ENSCI (Ecole Nationale Supérieure de Création Industrielle) en... more
Alors que de nombreuses avancées ont éte ́ faites ces der-nier temps pour améliorer les capacités graphiques des or-dinateurs, il a éte ́ fait peu de cas de ces progrès dans les applications pour la création musicale, en... more
Out of the scope of the usual positions of computing in the field of music and musicology, one notices the emergence of human-computer systems that do exist by breaking off. Though these singular systems take effect in the usual fields of... more
This paper presents our ongoing efforts to design an immersive sonification model to represent protein surfaces through 3D sound, in order to extend pre-existing protein visualisation methods without overloading visual perception. The... more
Afin d'étendre les modes de visualisation de protéines déjà disponibles, nous présentons ici une nouvelle approche de sonification permettant de représenter la surface d'une protéine par du son. A chaque point de la surface discrétisée... more
Cet article se tourne vers les moyens utilises par les photographes specialises en photographie gastronomique, moyens qui sont responsables par les effets de suggestion synesthesique produits a un recepteur dans la mesure ou cette... more
Educational practices are constantly adjusting to technological advances, in order to improve their effectiveness in delivering knowledge and preparing students for the challenges of modern digital society. Electronic games and augmented... more
Résumé Arturo Corrales Figures musicales Un outil de compréhension et d’analyse pour la musique de dernières décennies du XXe siècle. thèse soutenue le 15 septembre 2017 Mention « très honorable » obtenue à l’unanimité Membres du jury de... more
Les dispositifs images-sons numeriques ont souvent ete etudies sous le biais de l’ouverture de l’oeuvre, des rapports transformes entre auteurs et spectateurs ou bien encore, sous l’angle des correspondances images/sons1. Nous avons... more
La deuxième partie du vingtième siècle voit apparaître une volonté généralisée de libéralisation des formes artistiques. En littérature, le groupe OULIPO introduit l'utilisation intensive des mathématiques et des jeux sur les... more
This article aims to shed light on a new and emerging creative field: "Audio Games," a crossroad between video games and computer music. Today, a plethora of tiny applications, which propose entertaining audiovisual experiences with a... more
Le logiciel eua'oolin-nahuatl : eua, prendre son envol ; oolin, mouvement-a pour but la conversion en notation musicale du libre tracé de trajectoires dans un espace tridimensionnel. (Estrada 1994b, 94-99) eua'oolin propose une forme... more
Chroma est l'environnement d'aide à la composition et de contrôle de la synthèse développé par Marco Stroppa depuis 1980 pour la réalisation de ses pièces. Nous décrivons dans cet article l'intégration et les nouvelles extensions du... more
The article outlines a psychoacoustically founded method to describe the acoustic performance of earphones in two dimensions, Spectral Shape and Stereo Image Coherence. In a test set of 14 typical earphones, these dimensions explained... more
Hors des placements habituels de l'informatique dans le domaine de la musique et de Ja musicologie, on constate depuis peu l'apparition de systèmes hommes-machines qui manifestent leur existence en rupture avec une tradition... more
Out of the scope of the usual positions of computing in the field of music and musicology, one notices the emergence of human-computer systems that do exist by breaking off. Though these singular systems take effect in the usual fields of... more
Cet article montre l’apport du livre de Célestin Deliège à la musicologie a) d’un point de vue strictement historique, puisque pour la première fois (hormis par R. Toop) est abordée de façon substantielle l’école de la New Complexity; ce... more
Google “What is Clubhouse?” and you’ll find a flurry of articles written in the past few weeks about this fast-growing social network. It’s not yet a year old, and much of the buzz stems from the fact that Clubhouse is invite-only,... more
Que peut-on dire de l'activité rhétorique dans le contexte du média interactif ou expérienciel ? Comment peut-on sonder l'héritage millénaire de cette discipline pour jeter éclairage original sur l'abondance d'expériences interactives... more
Cet essai se donne comme objectif présenter l’œuvre « Concert Wine » d’Ignacio Moreno (une étudie originale qui propose un lien structurel entre chaque type de vin et la musique) en la plaçant dans la perspective plus vaste de la... more
Playsound.space is a web-based tool to search for and play Creative Commons licensed-sounds, which can be applied to free improvisation, experimental music production and soundscape composition. It provides fast access to about 400k... more
Introduction Le faire artistique commence par un point 1 , fût-il tracé par la plume de l'écrivain, le pinceau du peintre ou les pointes de la danseuse classique. Pourtant ce point omniprésent ne laisse aucune prise à une sémiotique du... more
Ψηφιακά διαδραστικά περιβάλλοντα χρησιµοποιούνται στις µέρες µας όλο και περισσότερο όχι µόνο για την ψυχαγωγία, αλλά και για την εκπαίδευση και ευαισθητοποίηση του χρήστη. Ως διαδραστικά ηχητικά περιβάλλοντα ορίζονται αυτά που... more
Download research papers for free!