Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Music Analysis
Database
Results
Discussions
Conclusions
References
All Topics
Art
Audio Arts and Acoustics

AUDIOCYCLE: BROWSING MUSICAL LOOPS LIBRARIES

Profile image of Christian FrissonChristian Frisson

2008

Abstract

This paper presents AudioCycle, a prototype application for browsing through music loop libraries. AudioCycle provides the user with a graphical view where the audio extracts are visualized and organized according to their similarity in terms of musical properties, such as timbre, harmony, and rhythm. The user is able to navigate in this visual representation, and listen to individual audio extracts, searching for those of interest. AudioCycle draws from a range of technologies, including audio analysis from music information retrieval research, 3D visualization, spatial auditory rendering, audio time-scaling and pitch modification. The proposed approach extends on previously described music and audio browsers. Concepts developped here will be of interest to DJs, remixers, musicians, soundtrack composers, but also sound designers and foley artists. Possible extension to multimedia libraries are also suggested.

Related papers

Visualization in Audio-Based Music Information Retrieval
George Tzanetakis

Computer Music Journal, 2006

View PDFchevron_right
comp-i: A System for Visual Exploration and Editing of MIDI Datasets
Rumi Hiraga

Conventional sequence software systems, which are com- monly used to edit MIDI-encoded music, possess two kinds of problems due to interactions with MIDI data through multiple independent windows. We address the problems by develop- ing a system, called comp-i (Comprehensible MIDI Player - Interactive), which provides music composers and arrangers with a novel type of 3D interactive virtual space, where the users are allowed to explore global music structures and to edit local features, both are embedded in a time-series of mul- tichannel asynchronous events of MIDI datasets while keep- ing their cognitive maps.

View PDFchevron_right
Adaptive Mapping of Sound Collections for Data-driven Musical Interfaces
Pierre Alexandre Tremblay

2019

Descriptor spaces have become an ubiquitous interaction paradigm for music based on collections of audio samples. However, most systems rely on a small predefined set of descriptors, which the user is often required to understand and choose from. There is no guarantee that the chosen descriptors are relevant for a given collection. In addition, this method does not scale to longer samples that require higher-dimensional descriptions, which biases systems towards the use of short samples. In this paper we propose novel framework for automatic creation of interactive sound spaces from sound collections using feature learning and dimensionality reduction. The framework is implemented as a software library using the SuperCollider language. We compare several algorithms and describe some example interfaces for interacting with the resulting spaces. Our experiments signal the potential of unsupervised algorithms for creating data-driven musical interfaces.

View PDFchevron_right
MuVis: an application for interactive exploration of large music collections
Manuel J. Fonseca

2010

In this paper we present MuVis, an interactive visualization and exploration tool for large music collections, based on music content and metadata. We combined a user-centered design with three main components: information visualization techniques (based on semantic ordered treemaps), music information retrieval mechanisms (for semantic and contentbased information extraction) and dynamic queries, to offer users a more efficient, flexible and yet, easy to use solution for browsing music collections and to create playlists. Preliminary results reveal that our solution is faster and easier to use than the Windows Media Player, allowing users to perform a more effective and fast navigation, while getting a deeper knowledge of their library. Satisfaction survey revealed that users liked our approach for browsing, filtering and creating playlists, while at the same time they were able to "re-discover" forgotten music, due to the similarity mechanisms incorporated in our solution.

View PDFchevron_right
A General Framework for Visualization of Sound Collections in Musical Interfaces
Pierre Alexandre Tremblay

2021

This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY

View PDFchevron_right
An integrated visual approach for music indexing and dynamic playlist composition
Sylvie Ranwez

Proceedings of SPIE, 2006

This paper presents an innovative integrated visual approach for indexing music and for automatically composing personalized playlists for radios or chain stores. To efficiently index hundreds of music titles by hand with artistic descriptors, the user only needs to drag and drop them onto a dynamic music landscape. To help the user we propose different dynamic visualization tools, such as the semantic spectrum and semantic field lenses. An algorithm then propagates artistic values that are hidden in the landscape into the titles being indexed. Different propagation algorithms are tested and compared. The dynamic composition methodology is then described with its class n-gram algorithm and its means for personalization based on the same music map as the visual indexing method. The technological leap that is proposed here is to turn musical experience into an integrated visual experience that may generate new kind of music knowledge and emotion. Topics: Measurement and Modeling (performance measurement of multimedia systems)-Multimedia Computing (development tools)-Case Studies and Applications (multimedia authoring)

View PDFchevron_right
Creating, Visualizing, and Analyzing Dynamic Music Objects in the Browser with the Dymo Designer
Geraint Wiggins

2016

Dynamic music is gaining increasing popularity outside of its initial environment, the videogame industry, and is gradually becoming an autonomous medium. Responsible for this is doubtlessly the prevalence of integrated multisensory platforms such as smartphones as well as the omnipresence of the internet as a provider of content on demand. The music format Dynamic Music Objects builds on these assumptions and on recent advances in music information retrieval and semantic web technologies. It is capable of describing a multitude of adaptive, interactive, and immersive musical experiences. This paper introduces the Dymo Designer, a prototypical web app that allows people to create and analyze Dynamic Music Objects in a visual, interactive, and computer-assisted way. CCS Concepts •Information systems → Music retrieval; •Humancentered computing → Interaction design process and methods; Mobile devices; •Applied computing → Sound and music computing; •Hardware → Sensor devices and platforms;

View PDFchevron_right
Iklax : A New Musical Audio Format for Interactive Music
Sylvain Marchand

In this paper, we are presenting a new model for interactive music. Unlike most interactive systems, our model is based on file organization, but does not require digital audio treatments. This model includes a definition of a constraints system and its solver. The products of this project are intended for the general public, inexperienced users, as well as professional musicians, and will be distributed commercially. We are here presenting three products of this project.

View PDFchevron_right
Browsing sound and music libraries by similarity
xavier siebert

128th AES Convention, London, …, 2010

This paper presents a prototype tool for browsing through multimedia libraries using content-based multimedia information retrieval techniques. It is composed of several groups of components for multimedia analysis, data mining, interactive visualization, as well as connection with external hardware controllers. The musical application of this tool uses descriptors of timbre, harmony, as well as rhythm and two different approaches for exploring/browsing content. First, a dynamic data mining allows the user to group sounds into clusters according to those different criteria, whose importance can be weighted interactively. In a second mode, sounds that are similar to a query are returned to the user, and can be used to further proceed with the search. This approach also borrows from multi-criteria optimization concept to return a relevant list of similar sounds.

View PDFchevron_right
Audioscapes: exploring surface interfaces for music exploration
Steven Ness

There is a growing interest in touch-based and gestural inter-faces as alternatives to the dominant mouse, keyboard and monitor interaction. Content and context-aware visualiza-tions of audio collections have been proposed as a more ef-fective way to interact with the increasing amounts of au-dio data available digitally. Audioscapes is a framework for prototyping and exploring how touch-based and gestu-ral controllers can be used with state-of-the-art content and context-aware visualizations. By providing well-defined in-terfaces and conventions a variety of different audio col-lections, controllers and visualization methods can be com-bined to create innovative ways of interacting with large au-dio collections. We describe the overall system architecture, the currently available components and specific case studies.

View PDFchevron_right

References (55)

  1. REFERENCES
  2. 1. Scientific references
  3. Timothy Beamish, Karon Maclean, and Sidney Fels. "Ma- nipulating Music: Multimodal Interaction for DJs". In: Pro- ceedings of CHI'04. 2004. P.: 124.
  4. Henry Bernard. "Tangible Media Browsing: Exploring And Browsing Large Multimedia Collections With A Tabletop". MA thesis. Music Technology Group, UPF-IUA, Barcelona and INPG-ICA, Grenoble, 2007. P.: 124.
  5. S. K. Card, J. D. Mackinlay, and G. G. Robertson. "The design space of input devices." In: Proceedings of the SIGCHI conference on Human factors in computing sys- tems (CHI'90). 1990. Pp. 117-124. P.: 124.
  6. Lonny L. Chu. "Haptic Interactions For Audio Navigation". PhD thesis. Stanford University, 2003. P.: 124.
  7. E. Costanza, S. B. Shelley, and J. Robinson. "Introducing Audio D-Touch: A Tangible User Interface For Music Com- position And Performance". In: Proc. of the 6th Int. Confer- ence on Digital Audio Effects (DAFX-03). 2003. P.: 124.
  8. Joëlle Coutaz et al. "Four Easy Pieces for Assessing the Us- ability of Multimodal Interaction: The CARE properties". In: Proceedings of the INTERACT'95 conference. 1995. Pp. 115-120. URL: http://iihm.imag.fr/publs/ 1995/Interact95_CARE.pdf. P.: 124.
  9. Jean-Michel Couturier and Magnolya Roy. "Grapholine, Instrument Audiovisuel De "Dessin Musical"". In: Articles des Journées d'Informatique Musicale. 2008. P.: 124.
  10. Laurent Couvreur et al. "Audio Thumbnailing". In: QPSR of the numediart research program. Ed. by Thierry Du- toit and Benoît Macq. Vol. 1. 2. http://www.numediart.org. 2008. Pp. 67-85. P.: 120.
  11. M. Davies and M. Plumbley. "A Spectral Difference Ap- proach to Downbeat Extraction in Musical Audio". In: Pro- ceedings of EUSIPCO 2006. 2006. P.: 121.
  12. M. Davies and M. Plumbley. "Beat Tracking with a Two State Model". In: Proceedings of ICASSP 2005. 2005. P.: 121.
  13. R.O. Duda and P.E. Hart. Pattern Classification and Scene Analysis. John Wiley and Sons, 1973. P.: 123.
  14. D. Ellis. "Beat Tracking with Dynamic Programming". In: Proceedings of MIREX 2006. 2006. Pp.: 120, 121.
  15. M. Fernström and E. Brazil. "Sonic browsing: An auditory tool for multimedia asset management". In: International Conference on Auditory Display (ICAD2001). Helsinki, Finland 2001. P.: 123.
  16. K. Fukunaga. Introduction to Statistical Pattern Recogni- tion. Ed. by Werner Rheinboldt. Academic Press -Second Edition, 1990. P.: 122.
  17. M. Goto. "An Audio-based Real-Time Beat Tracking Sys- tem for Music With or Without Drums-sounds". In: Journal of New Music Research 30.2 (2001). Pp. 159-171. P.: 121.
  18. Kjetil F. Hansen, Marcos Alonso, and Smilen Dimitrov. "Combining Dj Scratching, Tangible Interfaces And A Physics-Based Model of Friction Sounds". In: Proceedings of ICMC07. 2007. P.: 124.
  19. Kjetil Falkenberg Hansen and Marcos Alonso. "More DJ techniques on the reactable". In: Proceedings of the Inter- national Conference on New Interfaces for Musical Expres- sion (NIME). 2008. P.: 124.
  20. Kjetil Falkenberg Hansen and Roberto Bresin. "Mapping strategies in DJ scratching". In: Proceedings of the 2006 In- ternational Conference on New Interfaces for Musical Ex- pression (NIME06). 2006. P.: 125.
  21. Kouki Hayafuchi and Kenji Suzuki. "MusicGlove: A Wear- able Musical Controller for Massive Media Library". In: Proceedings of the International Conference on New Inter- faces for Musical Expression (NIME). 2008. P.: 124.
  22. Sebastian Heise, Michael Hlatky, and Jörn Loviscach. "SoundTorch: Quick Browsing in Large Audio Collec- tions". In: 125th Audio Engineering Society Convention. 7544. 2008. Pp.: 119, 123, 124.
  23. H. Hermansky, N. Morgan, and P. D. Korn. "Auditory Model for Parametrization of Speech". Pat. 5,450,522. 1995. P.: 120.
  24. T. Jehan. "Downbeat prediction by listening and learning". In: Proceedings of WASPAA 2005. 2005. P.: 121.
  25. Tristan Jehan. "Creating Music by Listening". PhD thesis. Massuchussets Institute of Technology, 2005. Pp.: 119, 120.
  26. K. Jensen. "Mutliple Scale Music Segmentation Using Rhythm, Timbre and Harmony". In: EURASIP Journal on Advances in Signal Processing 2007 7 (2007). Pp.: 119, 120.
  27. Ajay Kapur, Manj Benning, and George Tzanetakis. "Query-By-Beat-Boxing: Music Retrieval For The Dj". In: Proceedings of ISMIR'04. 2004. P.: 124.
  28. Takuro Mizuta Lippit. "Turntable Music in the Digital Era: Designing Alternative Tools for New Turntable Expres- sion". In: Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME06). 2006. P.: 124.
  29. Roderick Murray-Smith et al. "Stane: Synthesized Surfaces for Tactile Input". In: CHI 2008. 2008. P.: 124.
  30. G. Peeters. "Time Variable Tempo Detection and Beat Marking". In: Proceedings of ICMC 2005. 2005. P.: 121.
  31. G. Peeters. "Toward Automatic Music Audio Summary Generation from Signal Analysis". In: Proceedings of the International Symposium on Music Information Retrieval (ISMIR). Paris, France 2002. P.: 120.
  32. G. Poliner et al. "Melody Transcription from Music Au- dio: Approaches and Evaluation". In: IEEE Transactions on Audio, Speech and Language Processing 15(4) (2007). Pp. 1247-1256. P.: 119.
  33. Martin Russ. Sound Synthesis and Sampling. 3rd ed. Mu- sic Technology. Focal Press, 2008. ISBN: 9780240521053. Pp.: 119, 125.
  34. To Yip Sang and Kam Wong. "Multi-User Hand Gesture Based Musical Element Mapping With Traditional Musical Elements". In: Proceedings of ICMC'08. 2008. P.: 124.
  35. Diemo Schwartz. "Musical Applications of Real-Time Corpus-Based Concatenative Synthesis". In: ICMC 2007. Copenhagen 2007. P.: 119.
  36. Stephen Sinclair and Marcelo M. Wanderley. "Defining a control standard for easily integrating haptic virtual envi- ronments with existing audio/visual systems". In: Proceed- ings of NIME'07. 2007. P.: 125.
  37. Hans-Christoph Steiner, David Merrill, and Olaf Matthes. "A Unified Toolkit for Accessing Human Interface De- vices in Pure Data and Max/MSP". In: Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME07). 2007. P.: 125.
  38. John Steventon. DJing for Dummies. John Wiley & Sons, 2007. ISBN: 978-0470032756. P.: 124.
  39. Rebecca Stewart, Mark Levy, and Mark Sandler. "3D in- teractive environment for music collection navigation". In: Proceedings of the Conference on Digital Audio Effects (DAFx). 2008. P.: 124.
  40. Anne Veroust-Blondet. VITALAS -State of the Art on Ad- Visualisation Methods. Tech. rep. 2007. P.: 122.
  41. H. Vinet, P. Herrera, and F. Pachet. "The Cuidado Project: New Applications Based on Audio and Music Content De- scription". In: Proc. of ICMC. Göteborg, Sweden 2002. Pp. 450-454. P.: 119.
  42. Marcelo Wanderley and Marc Battier, eds. Trends In Ges- tural Control Of Music. Ircam -Centre Pompidou, 2000. ISBN: 2-8442-6039-X. P.: 124.
  43. Colin Ware. Information Visualization: Perception for De- sign. 2nd ed. Interactive Technologies. Morgan Kaufmann, 2004. ISBN: 1-55860-819-2. Pp.: 123, 125.
  44. Stephen Webber. DJ Skills: The essential guide to Mix- ing and Scratching. Focal Press, 2007. ISBN: 978- 0240520698. Pp.: 119, 124, 125.
  45. Matthew Wright. "Implementation and Performance Issues with OpenSound Control". In: Proceedings of ICMC 1998. 1998. URL: http://www.cnmat.berkeley.edu/ ICMC98/papers-pdf/OSC.pdf. P.: 125.
  46. F. Zheng, G. Zhang, and Z. Song. "Comparison of Differ- ent Implementations of MFCC". In: Journal of Computer Science and Technology 16 (2001). Pp. 582-589. P.: 120.
  47. A. Zils and F. Pachet. "Musical Mosaicing". In: COST G-6 Conference on Digital Audio Effects (DAFX-01). Limerick, Ireland 2001. P.: 119.
  48. 9.2. Software and technologies
  49. Merriam-Webster Dictionary Online. http://www.merriam- webster.com/. Consulted on January 14, 2009. P.: 120.
  50. Music Information Retrieval Evaluation eXchange. URL: http : / / www . music -ir . org / mirex / 2006 / index.php/Main_Page. P.: 121.
  51. OpenAL. URL: http://www.openal.org/. P.: 124.
  52. OpenSceneGraph (OSG). URL: http : / / www . openscenegraph.org/. P.: 123.
  53. PureData. URL: http://www.puredata.info. P.: 125. [40] Sony Creative Software. ACID. http://www.sonycreativesoftware.com/products/acidfamily.asp. URL: http : / / www . sonycreativesoftware . com/products/acidfamily.asp. P.: 119.
  54. The OpenInterface Platform. URL: http : / / www . openinterface.org. P.: 125.
  55. Zero-G. Pro Sample Library. URL: http : / / www . zero-g.co.uk/. P.: 122.

Related papers

AudioCycle: Browsing Musical Loop Libraries
Christian Frisson

2009

This paper presents AudioCycle, a prototype application for browsing through music loop libraries. AudioCycle provides the user with a graphical view where the audio extracts are visualized and organized according to their similarity in terms of musical properties, such as timbre, harmony, and rhythm. The user is able to navigate in this visual representation, and listen to individual audio extracts, searching for those of interest. AudioCycle draws from a range of technologies, including audio analysis from music information retrieval research, 3D visualization, spatial auditory rendering, audio time-scaling and pitch modification. The proposed approach extends on previously described music and audio browsers. Concepts developed here will be of interest to DJs, remixers, musicians, soundtrack composers, but also sound designers and foley artists. Possible extension to multimedia libraries are also suggested.

View PDFchevron_right
AudioCycle: A similarity-based visualization of musical libraries
Christian Frisson

2009

This paper presents AudioCycle, a prototype application for browsing through music loop libraries. AudioCycle provides the user with a graphical view where the audio extracts are visualized and organized according to their similarity in terms of musical properties, such as timbre, harmony, and rhythm. The user is able to navigate in this visual representation and listen to individual audio extracts, as well as query the database by providing audio examples. AudioCycle draws from a range of technologies, including audio analysis from music information retrieval research, 3D visualization, spatial auditory rendering, audio time-scaling and pitch modification. The proposed approach extends on previously described music and audio browsers. Possible extension to multimedia libraries is also suggested.

View PDFchevron_right
Groove Explorer: An Intelligent Visual Interface for Drum Loop Library Navigation
Mark Sandler

2019

Music producers nowadays rely on increasingly large libraries of loops, samples and virtual instrument sounds as part of the composition process. Intelligent interfaces are therefore useful in enabling navigation of these databases in a way that supports the production workflow. Within virtual drumming software, producers typically rely on large libraries of symbolic drum loops. Due to their large size, navigating and exploring these libraries can be a difficult process. To address this, preliminary work is presented into the Groove Explorer. Using Self-Organizing Maps, a large library of symbolic drum loops is automatically mapped on a 2D space according to rhythmic similarity. This space can then be explored via a Max/MSP prototype interface. Early results suggest that while the algorithm works well for smaller datasets, further development is required, particularly in the similarity metric used, to make the tool scalable to large libraries.

View PDFchevron_right
FEATUR.UX: An approach to leveraging multitrack information for artistic music visualization
ireti olowe

2016

FEATUR.UX (Feature ous) is an audio visualisation tool, currently in the process of development, which proposes to introduce a new approach to sound visualisation using pre-mixed, independent multitracks and audio feature extraction. Sound visualisation is usually performed using a mixed mono or stereo track of audio. Audio feature extraction is commonly used in the field of music information retrieval to create search and recommendation systems for large music databases rather than generating live visualisations. Visualizing multitrack audio circumvents problems related to the source separation of mixed audio signals and presents an opportunity to examine interdependent relationships within and between separate streams of music. This novel approach to sound visualisation aims to provide an enhanced listening experience in a use case that employs non-tonal, non-notated forms of electronic music. Findings from prior research studies focused on live performance and preliminary quantit...

View PDFchevron_right
EarGram : an Application for Interactive Exploration of Large Databases of Audio Snippets for Creative Purposes
Carlos Guedes

2012

This paper outlines the creative and technical considerations behind earGram, an application built as a Pure Data patch for real-time concatenative sound synthesis. The system encompasses four generative strategies that automatically re-arrange and explore a database of descriptor-analyzed sound snippets (corpus) by rules other than its original temporal order into musically coherent outputs. Of notice are the system’s machine-learning capabilities that reveal musical patterns and temporal organizations, as well as several visualization tools that assist the user in making decisions during performance.

View PDFchevron_right

Related topics

  • Sound Design
  • Audio Analysis
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved