Academia.eduAcademia.edu

Outline

Title
Abstract
Introduction
Background and Related Work
Conclusions
References
All Topics
Computer Science

A Dynamic Timed-Language for Computer-Human Musical Interaction

Profile image of Jean-Louis GiavittoJean-Louis Giavitto

2013, HAL (Le Centre pour la Communication Scientifique Directe)

Abstract

In this paper, we present the programing of time and interaction in Antescofo, a real-time system for performance coordination between musicians and computer processes during live music performance. To this end, Antescofo relies on artificial machine listening and a domain specific real-time programing language. It extends each paradigm through strong coupling of the two and strong emphasis on temporal semantics and behavior of the system. The challenge in bringing human actions in the loop of computing is strongly related to temporal semantics of the language, and timeliness of live execution despite heterogeneous nature of time in the two mediums. Interaction scenarii are expressed at a symbolic level through the management of musical time (i.e. events like notes or beats in relative tempi) and of the 'physical' time (with relationships like succession, delay, duration, speed). Antescofo unique features are presented through a series of paradigmatic program samples which illustrate how to manage execution of different audio processes through time and their interactions with an external environment. The Antescofo approach has been validated through numerous uses of the system in live electronic performances in contemporary music repertoire by various international music ensembles.

Related papers

Real times: implementing a temporal phenomenology in an interactive music system
Jonathan Impett

ccrma.stanford.edu

This paper examines the issue of temporal decision-making in the context of an interactive music system. Conventional views of the time-frames of musical activity, composers' rationalisations, models of jazz improvisation, and the temporal dimensions of other interactive systems are discussed. Central to the study is the question of the distribution in time of the various factors which contribute to a particular musical phenomenon. It is proposed to model this "space of mediation" as a dynamical system, in a development of the arguments of Prigogine and Boon (1998). The architecture of an interactive system currently being developed is based on an adaptive complex of such systems, its activity in time a function of their aggregation and modulation.

View PDFchevron_right
A synchronous embedding of Antescofo, a domain-specific language for interactive mixed music
Florent Jacquemard

2013 Proceedings of the International Conference on Embedded Software (EMSOFT), 2013

Antescofo is recently developed software for musical score following and mixed music: it automatically, and in realtime, synchronizes electronic instruments with a musician playing on a classical instrument. Therefore, it faces some of the same major challenges as embedded systems. The system provides a programming language used by composers to specify musical pieces that mix interacting electronic and classical instruments. This language is developed with and for musicians and it continues to evolve according to their needs. Yet its semantics has only recently been formally defined. This paper presents a synchronous semantics for the core language of Antescofo and an alternative implementation based on an embedding inside an existing synchronous language, namely ReactiveML. The semantics reduces to a few rules, is mathematically precise and leads to an interpretor of only a few hundred lines. The efficiency of this interpretor compares well with that of the actual implementation: on all musical pieces we have tested, response times have been less than the reaction time of the human ear. Moreover, this embedding permitted the prototyping of several new programming constructs, some of which are described in this paper.

View PDFchevron_right
Real times: implementing a temporal phenomenology in an interactive music system 1999
Jonathan Impett

This paper examines the issue of temporal decision-making in the context of an interactive music system. Conventional views of the time-frames of musical activity, composers' rationalisations, models of jazz improvisation, and the temporal dimensions of other interactive systems are discussed. Central to the study is the question of the distribution in time of the various factors which contribute to a particular musical phenomenon. It is proposed to model this "space of mediation" as a dynamical system, in a development of the arguments of . The architecture of an interactive system currently being developed is based on an adaptive complex of such systems, its activity in time a function of their aggregation and modulation.

View PDFchevron_right
Real-Time Control of Music Performance
Anders Friberg

2008

In this chapter we will look at the real-time control of music performance on a higher level dealing with semantic/gestural descriptions rather than the control of each note as in a musical instrument. It is similar to the role of the conductor in a traditional orchestra. The conductor controls the overall interpretation of the piece but leaves the execution of the notes to the musicians. A computer-based music performance system typically consists of a human controller using gestures that are tracked and analysed by a computer generating the performance. An alternative could be to use audio input. In this case the system would follow a musician or even computer-generated music.

View PDFchevron_right
Representation Of Musical Computer Processes
yann orlarey

Proceedings of the SMC Conferences, 2014

The paper presents a study about the representation of musical computer processes within a music score. The idea is to provide performers with information that could be useful especially in the context of interactive music. The paper starts with a characterization of a musical computer process in order to define the values to be represented. Next it proposes an approach to time representation suitable to asynchronous processes representation.

View PDFchevron_right
CURRENT TRENDS AND FUTURE RESEARCH DIRECTIONS FOR INTERACTIVE MUSIC
Mauricio Toro

In this review, it is explained and compared different software and formalisms used in music interaction: sequencers, computer-assisted improvisation, meta-instruments, score-following, asynchronous dataflow languages, synchronous dataflow languages, process calculi, temporal constraints and interactive scores. Formal approaches have the advantage of providing rigorous semantics of the behavior of the model and proving correctness during execution. The main disadvantage of formal approaches is lack of commercial tools.

View PDFchevron_right
Towards an Encoding of Musical Interaction
Myriam Desainte-Catherine

Designs and Architectures

While representing musical processes or musical scores through Markup Languages is now well established, the authors assume that there is still the need for a format to encode musical material with which a musician can interact. The lack of such a format is especially crucial for contemporary music that involves computing processes. They propose such a formal representation for composing musical scores in which some temporal properties can be interactively modified during their execution. This allows the creation of scores that can be interpreted by a performer in the same way a musician can interpret a score of instrumental music. The formal representation comes with an XML format for encoding the scores and also interfacing the representation with other types of Markup Language musical description.

View PDFchevron_right
Real-time issues in computer music
Roger Dannenberg

1993 Proceedings Real-Time Systems Symposium, 1993

View PDFchevron_right
The ChucK Audio Programming Language: A Strongly-timed and On-the-fly Environ/mentality
Ge Wang

2008

The computer has long been considered an extremely attractive tool for creating, manipulating, and analyzing sound. Its precision, possibilities for new timbres, and potential for fantastical automation make it a compelling platform for expression and experimentation -but only to the extent that we are able to express to the computer what to do, and how to do it. To this end, the programming language has perhaps served as the most general, and yet most precise and intimate interface between humans and computers. Furthermore, "domain-specific" languages can bring additional expressiveness, conciseness, and perhaps even different ways of thinking to their users. This thesis argues for the philosophy, design, and development of ChucK, a general-purpose programming language tailored for computer music. The goal is to create a language that is expressive and easy to write and read with respect to time and parallelism, and to provide a platform for precise audio synthesis/analysis and rapid experimentation in computer music. In particular, ChucK provides a syntax for representing information flow, a new time-based concurrent programming model that allows programmers to flexibly and precisely control the flow of time in code (we call this "strongly-timed"), and facilities to develop programs on-the-fly -as they run. A ChucKian approach to live coding as a new musical performance paradigm is also described. In turn, this motivates the Audicle, a specialized graphical environment designed to facilitate on-the-fly programming, to visualize and monitor ChucK programs in real-time, and to provide a platform for building highly customizable user interfaces.

View PDFchevron_right
LC: a strongly-Timed Prototype-Based Programming Language for Computer Music
Naotoshi Osaka

2013

This paper describes LC, a new computer music programming language currently under development. LC is a strongly-timed prototype-based programming language for live computer music with lightweight concurrency and lexical closure, the design of which takes the emergence of live-coding performance on laptop computers into consideration as a significant design opportunity for a new computer music language.

View PDFchevron_right

References (36)

  1. C. Alexander. A pattern language: towns, buildings, construction, volume 2. Oxford Uni- versity Press, USA, 1977.
  2. J. Allen. Maintaining knowledge about temporal intervals. Communications of the ACM, 26(11):832-843, 1983.
  3. D. P. Anderson and R. Kuivila. A system for computer music performance. ACM Trans. Comput. Syst., 8(1):56-82, Feb. 1990.
  4. G. Berry and G. Gonthier. The esterel synchronous programming language: Design, seman- tics, implementation. Sci. Comput. Program., 19(2):87-152, 1992.
  5. R. Boulanger, editor. The Csound book: perspectives in software synthesis, sound design, signal processing, and programming. MIT Press, Cambridge, MA, USA, 2000.
  6. A. Cont. Antescofo: Anticipatory synchronization and control of interactive parameters in computer music. In Proceedings of International Computer Music Conference (ICMC). Belfast, August 2008.
  7. A. Cont. A coupled duration-focused architecture for realtime music to score alignment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(6):974-987, 2010.
  8. A. Cont. A coupled duration-focused architecture for realtime music to score alignment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(6):974-987, June 2010.
  9. A. Cont. On the creative use of score following and its impact on research. In Sound and Music Computing, Padova, Italy, July 2011.
  10. A. Cont, J. Echeveste, J.-L. Giavitto, and F. Jacquemard. Correct Automatic Accompani- ment Despite Machine Listening or Human Errors in Antescofo. In ICMC 2012 -Interna- tional Computer Music Conference, Ljubljana, Slovenia, Sept. 2012. IRZU -the Institute for Sonic Arts Research.
  11. R. B. Dannenberg. Arctic: A functional language for real-time control. In In 1984 ACM Symposium on LISP and Functional Programming, pages 96-103, 1984.
  12. R. B. Dannenberg. An on-line algorithm for real-time accompaniment. In Proceedings of the International Computer Music Conference (ICMC), pages 193-198, 1984.
  13. R. B. Dannenberg. The implementation of nyquist, a sound synthesis language. Computer Music J, 1997.
  14. M. Desainte-Catherine and A. Allombert. Interactive scores: A model for specifying tem- poral relations between interactive and static events. Journal of New Music Research, 34(4):361-374, 2005.
  15. J. Echeveste, F. Jacquemard, A. Cont, and J.-L. Giavitto. Operational semantics of a domain specific language for real time musician-computer interaction. Discrete Event Dynamic Systems, 2013. to appear.
  16. A. Ghosal, T. A. Henzinger, C. M. Kirsch, and M. A. A. Sanvido. Event-driven programming with logical execution times. In Proc. of HSCC 2004, Lecture Notes in Computer Science, pages 357-371, 2004.
  17. N. Halbwachs. Synchronous Programming of Reactive Systems., volume 1427 of Lecture Notes in Computer Science. Springer, 1998.
  18. N. Halbwachs, P. Caspi, P. Raymond, and D. Pilaud. The synchronous data flow program- ming language lustre. Proceedings of the IEEE, 79(9):1305-1320, 1991.
  19. T. Henzinger, B. Horowitz, and C. Kirsch. Giotto: a time-triggered language for embedded programming. Proceedings of the IEEE, 91(1):84 -99, jan 2003.
  20. H. Kopetz. Event-triggered versus time-triggered real-time systems. In Proceedings of the International Workshop on Operating Systems of the 90s and Beyond, volume 563, pages 87-101, Dagstuhl Castle, Germany, July 8-12 1991. Springer.
  21. H. Kopetz and G. Bauer. The time-triggered architecture. Proceedings of the IEEE, 91(1):112 -126, jan 2003.
  22. E. Large and M. Jones. The dynamics of attending: How people track time-varying events. Psychological review, 106(1):119, 1999.
  23. E. A. Lee. Computing needs time. Communications of the ACM, 52(5):70-79, 2009.
  24. P. LeGuernic, T. Gautier, M. Le Borgne, and C. Le Maire. Programming real-time appli- cations with signal. Proceedings of the IEEE, 79(9):1321-1336, 1991.
  25. Z. Liu, Y. Feng, and B. Li. Musicscore: mobile music composition for practice and fun. In Proceedings of the 20th ACM international conference on Multimedia, MM '12, pages 109-118, New York, NY, USA, 2012. ACM.
  26. Inria
  27. L. Mandel and F. Plateau. Interactive programming of reactive systems. In Proceedings of Model-driven High-level Programming of Embedded Systems (SLA++P'08), Electronic Notes in Computer Science, pages 44-59, Budapest, Hungary, Apr. 2008. Elsevier Science Publishers.
  28. G. Mazzola and O. Zahorka. Tempo curves revisited: Hierarchies of performance fields. Computer Music Journal, 18(1):40-52, 1994.
  29. J. McCartney. A new real-time synthesis language. In International Computer Music Con- ference, 1996.
  30. M. Pouzet. Lucid synchrone, version 3. Tutorial and reference manual. Université Paris-Sud, LRI, 2006.
  31. M. Puckette. Combining event and signal processing in the max graphical programming environment. Computer Music Journal, 15:68-77, 1991.
  32. C. Raphael. The informatics philharmonic. Commun. ACM, 54:87-93, March 2011.
  33. A. Sorensen. Impromptu: An interactive programming environment for composition and performance. In Proceedings of the Australasian Computer Music Conference 2009, 2005.
  34. A. Sorensen and H. Gardner. Programming with time: cyber-physical programming with impromptu. In ACM Sigplan Notices, volume 45, pages 822-834. ACM, 2010.
  35. B. Vercoe. The synthetic performer in the context of live performance. In Proceedings of the ICMC, pages 199-200, 1984.
  36. G. Wang. The ChucK audio programming language." A strongly-timed and on-the-fly envi- ron/mentality". PhD thesis, Princeton University, 2009.

Related papers

Operational semantics of a domain specific language for real time musician-computer interaction
Jean-Louis Giavitto

Discrete Event Dynamic Systems: Theory and Applications, 2013

With the advent and availability of powerful personal computing, the computer music research and industry have been focusing on real-time musical interactions between musicians and computers; delegating human-like actions to computers who interact with a musical environment. One common use-case of this kind is Automatic Accompaniment where the system is comprised of a real-time machine listening system that in reaction to recognition of events in a score from a human performer, launches necessary actions for the accompaniment section. While the real-time detection of score events out of live musicians' performance has been widely addressed in the literature, score accompaniment (or the reactive part of the process) has been rarely discussed.

View PDFchevron_right
ChucK: A Strongly Timed Computer Music Language
Perry Cook

Computer Music Journal, 2015

ChucK is a programming language designed for computer music. It aims to be expressive and straightforward to read and write with respect to time and concurrency, and to provide a platform for precise audio synthesis and analysis and for rapid experimentation in computer music. In particular, ChucK defines the notion of a strongly timed audio programming language, comprising a versatile time-based programming model that allows programmers to flexibly and precisely control the flow of time in code and use the keyword now as a time-aware control construct, and gives programmers the ability to use the timing mechanism to realize sample-accurate concurrent programming. Several case studies are presented that illustrate the workings, properties, and personality of the language. We also discuss applications of ChucK in laptop orchestras, computer music pedagogy, and mobile music instruments. Properties and affordances of the language and its future directions are outlined.

View PDFchevron_right
From Authored to Produced Time in Computer-Musician Interactions
Florent Jacquemard

2013

Human musicians have since long developed methods and formalisms for ensemble authoring and real-time coordination and synchronization of their actions. Bringing such capabilities to computers and providing them with the ability to take part in musical interactions with human musicians, poses interesting challenges for authoring of time and interaction and real-time coordination that we address in this paper in the context of Mixed Music and the Antescofo project.

View PDFchevron_right
Real-Time Temporal Control of Musical Processes
Myriam Desainte-Catherine

The temporal control of the execution of multimedia processes is a crucial point for a number of application fields. We propose a formalism for authoring multimedia scripts that involves dynamic triggerings. In addition, we propose an abstract machine able to execute these scripts, by adapting the temporal organization of the processes according to the dynamic triggerings. This machine must implement some temporal features such as fast forward or GOTO functionalities. We present some algorithms performing these functionalities. A last, we mention some evaluation by users and possible future works.

View PDFchevron_right
Real-Time Interaction Among Composers, Performers, and Computer Systems
Cort Lippe

As the computer becomes more and more ubiquitous in society, the term " interactive " has become a widely used, but misunderstood term. In this paper, I discuss definitions of interactive music and interactive music systems, performance issues in interactive music, and performer/machine relationships that engender interaction in an attempt to explain how and why I pursue this discipline. Furthermore, I describe the function of computers in my compositions, and the manner in which I explore performer/machine interaction. Personal Background Prior to 1980, I was equally active as both an instrumental and electronic music composer. I was originally drawn to the computer because of a strong interest in designing new sounds, something at which computers are quite good, and exploring algorithmic compositional structures, simulation being another particular strength of computers. While new sounds and compositional algorithms can be readily explored in a non-real-time environment, and the tape and instrument paradigm has existed since the beginnings of electronic music, my first experiences with electronic music were with analog synthesizers, and my earliest experiences with computers in the 1970s were predominately with real-time systems. In addition, during the second half of the 1970s, I worked with an improvisational music/dance ensemble exploring live-electronics combined with acoustic instruments. For the past 20 years, I have pursued creative and research interests in interactive computer music involving live instrumentalists and computers in performance situations. The opportunity to combine instruments and computers became increasing practical as real-time digital signal processors became more available in the 1980s. As the level of refinement of real-time control became proportionally greater, it became evident that composed music for instruments and interactive computer systems was a viable medium of expression. And while it is true that interactive computer music is a relatively new area in the electronic music field, developments in the power of desktop computers and the sophistication of real-time software have been responsible for enormous growth of the genre in the last ten years. The challenge of interactive computer music has been to articulate sonic design and compositional structures in some sort of interactive relationship with live performers. While some composers use computers to model or imitate musical instruments, and others are interested in modeling human performance, I am not interested in replacing either instruments or performers. Musicians, with their years of experience playing on instruments which have often developed over centuries, offer rich musical and cultural potential, and are perhaps the ultimate driving force for me as a composer working with computer technology. Interactive Music Robert Rowe, in the seminal book Interactive Music Systems [Rowe, 1993], states: " Interactive music systems are those whose behavior changes in response to musical input ". A dictionary definition of the word interactive states: " capable of acting on or influencing each other ". This would imply that a feedback loop of some sort exists between performer and machine. Indeed, the Australian composer Barry Moon suggests: " levels of interaction can be gauged by the potential for change in the behaviors of computer and performer in their response to each other ". [Moon,

View PDFchevron_right

Related topics

  • Computer Science
  • Human Computer Interaction
    • 580 California St., Suite 400
    San Francisco, CA, 94104
    © 2025 Academia. All rights reserved