Skip to main content

michel buffa

Followers

31

Following

3

Public Views

Interests

Uploads

Papers by michel buffa

This paper presents WikiNEXT, a semantic application wiki. WikiNEXT lies on the border between ap... more This paper presents WikiNEXT, a semantic application wiki. WikiNEXT lies on the border between application wikis and modern web based IDEs (Integrated Development Environments) like jsbin.com, jsfiddle.net, cloud9ide.com, etc. It has been initially created for writing documents that integrate data from external data sources of the web of data, such as DBPedia.org or FreeBase.com, or for writing interactive tutorials (e.g. an HTML5 tutorial, a semantic web programming tutorial) that mix text and interactive examples in the same page. The system combines some powerful aspects from (i) wikis, such as ease of use, collaboration and openness, (ii) semantic web/wikis such as making information processable by machines and (iii) web-based IDEs such as instant development and code testing in a web browser. WikiNEXT is for writing documents/pages as well as for writing web applications that manipulate semantic data, either locally or coming from the web of data. These applications can be created, edited or cloned in the browser and can be used for integrating data visualizations in wiki pages, for annotating content with metadata, or for any kind of processing. WikiNEXT is particularly suited for teaching web technologies or for writing documents that integrate data from the web of data.

Web Audio Modules 2.0: Audio Plugins for the Web Platform!

HAL (Le Centre pour la Communication Scientifique Directe), Nov 14, 2022

Used in artistic productions, education and research, open source projects and commercial applica... more Used in artistic productions, education and research, open source projects and commercial applications. Faust offers end-users a high-level alternative to C/C++ to develop audio applications for a large variety of platforms. The role of the Faust compiler is to synthesize the most efficient implementations for the target language (C, C++, LLVM, WebAssembly, etc.). Online doc / tutorial so that you can experiment yourself, create, build GUI, export WAM2 plugins directly from the FAUST online IDE. The WAM standard is stable now and comes with many examples. OUR MAIN CONCERN NOW: get inputs from developers regarding barriers to entry / adoption! Things that will come soon: ○ The wam-community repo is growing :-) ○ The WAM SDK has been extended to support 3D WebGL/GLSL/Video extensions ○ A WAM based DAW is under development and will be open source ○ More examples using WASM, in particular C++/WASM ○ Remote plugin server with API Join us on slack WebAudio channel / #webaudiomodules!

Design and Run Real-time Spectral Processing on the Web with Faust

Web-based spectral processing with the Web Audio API is a challenging task that requires efficien... more Web-based spectral processing with the Web Audio API is a challenging task that requires efficient and flexible tools. It involves Fourier transform utilities and frequency-domain data manipulations. In this paper, we present a novel framework for designing and running real-time spectral processors on the web, using Faust as the programming language and its web-based toolchain. Our framework is inspired by Max's pfft~paradigm, which allows users to create custom spectral processors from streamed spectral data. Using Faust language and suitable FFT tools, the designed algorithm can be compiled to WebAssembly modules that are executed in an Audio Worklet. We demonstrate the potential of our framework by showing some examples of spectral effects and synthesizers that can be easily designed and executed on the web.

Evolution of the Web Audio Modules Ecosystem

The Web Audio Modules (WAM) is a mature proposal for Web Audio Plugins. Started in 2015 [3, 6, 7,... more The Web Audio Modules (WAM) is a mature proposal for Web Audio Plugins. Started in 2015 [3, 6, 7, 8], this open source proposal evolved and reached version 2.0 in 2021 [17]. This resource paper provides an overview of the evolution of the ecosystem surrounding the WAM standard. Since V2.0 publication WAM has been the subject of numerous publications, demonstrations, and presentations at various conferences such as the Audio Developer Conference, Sound and Music Computing, Internet of Sounds, and The Web Conference, to name a few. As a direct consequence, there is now a large set of WAM-format plugins and hosts, along with new online tutorials and tools that facilitate plugin development (online IDEs, etc.), the vast majority being open source. An initiative called Wam Community has also emerged to simplify the sharing of effects and instruments in the WAM format, accompanied by an API and online tools. New WAM hosts have been introduced, including two Digital Audio Workstations (DAWs), collaborative WAM hosts applications for music creation, and compatible visual programming languages. Furthermore, the WAM format supports extensions and this article presents some of the available ones for handling video, 3D, WebGL shaders, and parameter modulation between WAMs, among other functionalities.

Semantic Social Network Analysis

Web Science, Mar 18, 2009

Social Network Analysis (SNA) tries to understand and exploit the key features of social networks... more Social Network Analysis (SNA) tries to understand and exploit the key features of social networks in order to manage their life cycle and predict their evolution. Increasingly popular web 2.0 sites are forming huge social network. Classical methods from social network analysis (SNA) have been applied to such online networks. In this paper, we propose leveraging semantic web technologies to merge and exploit the best features of each domain. We present how to facilitate and enhance the analysis of online social networks, exploiting the power of semantic social network analysis.

From blues to rock to jazz : three different web audio tube guitar amplifier simulator plugins

Zenodo (CERN European Organization for Nuclear Research), Jun 28, 2022

We propose to present a set of web audio plugins specialized in three kinds of sounds. The first ... more We propose to present a set of web audio plugins specialized in three kinds of sounds. The first one targets blues / classic rock sounds and proposes a drop down menu with presets that go from clean warm blues like the tones used by BB King, to more classic rock/blues distorted sounds as used by Jimmy Hendrix or AC/DC. The second one is aimed to Hi-Gain/Metal sounds similar to Mesa Boogie type of sounds, and the third one is an acoustic guitar simulator (enabling the use of an electric guitar to get an acoustic folk guitar sound). These plugins are partially available in open source, but the versions we propose to demo are commercialized by our laboratory (French CNRS/SATT Sud-Est) and included in some commercial DAWs.

Build WebAudio and JavaScript Web Applications using JSPatcher: A Web-based Visual Programming Editor

HAL (Le Centre pour la Communication Scientifique Directe), Jun 5, 2021

Many visual programming languages (VPLs) such as Max [1] or PureData [2] provide a graphic canvas... more Many visual programming languages (VPLs) such as Max [1] or PureData [2] provide a graphic canvas to allow developers to connect functions or data between them. This canvas, also known as a patcher [3], is basically a graph meant to be interpreted as dataflow computation by the system. Some VPLs are used for multimedia performance or content generation as the UI system is often an important part of the language. This paper presents a webbased VPL, JSPatcher, which allows not only to build audio graphs using the WebAudio API, but also to design graphically AudioWorklet DSPs with FAUST toolchain, [4] [5] or to create interactive programs with other language built-ins, Web APIs or any JavaScript modules.

Audio on the Web (a brief history)

HAL (Le Centre pour la Communication Scientifique Directe), Jun 5, 2022

Making Computer Music on the Web with JSPatcher

HAL (Le Centre pour la Communication Scientifique Directe), Jun 7, 2022

Web technology through the internet and a web browser, is attractive to modern computer music art... more Web technology through the internet and a web browser, is attractive to modern computer music artists as it provides high accessibility and interactivity and opens to possibilities. Since the development of JSPatcher [1], an online visual programming language (VPL) for audio processing and interactive web-based programs, we have recently added various music-related features to the application, including important features that common music computing practices need, such as file management, audio buffer handling, audio plugin support, and computer-assisted composition functions. It aims to make it easier for musicians, composers or designers of multimedia projects who might be familiar with VPLs on native platforms like Max [2], PureData [3] or OpenMusic [4], to bring or create their work on the web with less effort. This paper presents the concept, implementation details and examples of these newly added features.

Modernized Toolchains to Create JSPatcher Objects and WebAudioModules from Faust Code

Zenodo (CERN European Organization for Nuclear Research), Jun 28, 2022

Faust, as an audio domain specific language (DSL) for DSP, has different compilation targets incl... more Faust, as an audio domain specific language (DSL) for DSP, has different compilation targets including WebAudio nodes [7, 4]. An AudioWorklet [2] processor wrapping a WebAssembly DSP can be generated statically from native platform compilers as a JavaScript module with wasm files, or dynamically in a browser using a WebAssembly version of the compiler [5]. The WebAssembly compiler has been used in various WebAudio projects through a JavaScript module faust2webaudio, such as the Faust IDE [6] and JSPatcher [8]. In the paper, we present recent work on a new version of the Faust WebAssembly compiler for the WebAssembly target and its JavaScript wrapper module: faustwasm. Using modern JavaScript tools, the module is designed to be crossplatform and runnable under both Node.js and browser environment to generate, compile, and instantiate WebAssembly binary code from Faust code and wrap the binary as an AudioWorkletProcessor. Based on this module, we created faust2wam, a WebAudio plugin generator for the WebAu-dioModule standard with an automatically generated user interface. We also created a tool as an external package for JSPatcher to generate JSPatcher DSP objects in bulk.

Programming virtual musical instruments and audio effects in the Web browser

HAL (Le Centre pour la Communication Scientifique Directe), Apr 9, 2018

WebAudio is a recent W3C API that brings the world of computer music applications into the browse... more WebAudio is a recent W3C API that brings the world of computer music applications into the browser. While JavaScript and Web standards are increasingly flexible and powerful, C/C++ has been the language of choice for real-time audio applications and domain specific languages such as FAUST facilitate rapid development with high performance. We present here a host Web application-the Pedal Board project-as well as plugins (instruments, effects), written in JavaScript, ported from C/C++, or written using Domain Specific Languages such as FAUST, and compiled to the new WebAssembly binary standard that can be executed by recent Web browsers. These plugins follow an open standard we are developing (details on [4]).

Software and Platforms - Semantic Wiki

Semantic Social Network Analysis

arXiv (Cornell University), Apr 23, 2009

Social Network Analysis (SNA) tries to understand and exploit the key features of social networks... more Social Network Analysis (SNA) tries to understand and exploit the key features of social networks in order to manage their life cycle and predict their evolution. Increasingly popular web 2.0 sites are forming huge social network. Classical methods from social network analysis (SNA) have been applied to such online networks. In this paper, we propose leveraging semantic web technologies to merge and exploit the best features of each domain. We present how to facilitate and enhance the analysis of online social networks, exploiting the power of semantic social network analysis.

RoboDOMO, un robot d’assistance aux personnes âgées et dépendantes dans un environnement d’objets communicants

HAL (Le Centre pour la Communication Scientifique Directe), 2011

Cet article decrit principalement un bouquet de services mobiquitaires base sur un robot mobile e... more Cet article decrit principalement un bouquet de services mobiquitaires base sur un robot mobile et un environnement d’objets communicants, qui permet de faciliter la vie de personnes en situation de dependance. RoboDOMO est un prototype de robot d’assistance ; il est capable d’integrer et fournir des informations en provenance de multiples sources sans fil, de faciliter la communication avec une tierce personne grâce a la visioconference, ou encore d’etre pilote a distance par le telephone mobile de la famille ou du corps medical. La mise en œuvre de RoboDOMO et de son environnement d’objets communicants (capteurs, tags NFC, etc.) au sein d’une architecture standardisee ouverte est presentee dans son contexte pluridisciplinaire.

Incremental and multimodal visualization of discographies: exploring the WASABI music knowledge base

Zenodo (CERN European Organization for Nuclear Research), Jun 28, 2022

The WASABI song corpus and knowledge graph for music lyrics analysis

Language Resources and Evaluation

We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted fro... more We present the WASABI 1 Song Corpus, a large corpus of songs enriched with metadata extracted from music databases on the Web, and resulting from the processing of song lyrics and from audio analysis. More specifically, given that lyrics encode an important part of the semantics of a song, we focus here on the description of the methods we proposed to extract relevant information from the lyrics, such as their structure segmentation, their topics, the explicitness of the lyrics content, the salient passages of a song and the emotions conveyed. The corpus contains 1.73M songs with lyrics (1.41M unique lyrics) annotated at different levels with the output of the above mentioned methods. The corpus labels and the provided methods can be exploited by music search engines and music professionals (e.g. journalists, radio presenters) to better handle large collections of lyrics, allowing an intelligent browsing, categorization and recommendation of songs. We demonstrate the utility and versatility of the WASABI Song Corpus in three concrete application scenarios. Together with the work on the corpus, we present the work achieved to transition the dataset into a knowledge graph, the WASABI RDF Knowledge Graph, and we show how this will enable an even richer set of applications.

Exchanges Documents Extraction Languages Web Ergonomics Interaction Semantics Servers

Develop WebAudio Plugins in a Web Browser

We propose to demo an online IDE based around the FAUST DSP audio language that includes a source... more

FAUST online IDE: dynamically compile and publish FAUST code as WebAudio Plugins

The development and porting of virtual instruments or audio effects on the Web platform is a hot ... more The development and porting of virtual instruments or audio effects on the Web platform is a hot topic. Several initiatives are emerging, from business enterprise based ones (Propellerhead Rack Extension running on the Web ), to more community based 1 open-source projects [10]. Most of them aim to facilitate adapting existing code base (usually developed in native languages like C/C++) as well as facilitating the use of existing audio DSP languages and platforms. Our group previously presented an open format for WebAudio Plugins named WAP [11]. It aims to facilitate the interoperability of audio/MIDI plugins developed either using pure Web APIs, porting existing native code bases, or using Domain Specific Languages (DSL). In the DSL category, we already did developments to use the FAUST audio DSP language. In this paper, we present a solution based around FAUST, its redesigned Web based editor, and the integration of a plugin GUI editor allowing to directly test, generate and deploy...

New Results - Emotional and Social Web