Multimodal Annotation

The MUMIN multimodal coding scheme was originally created to experiment with annotation of multimodal communication in short clips from movies and in video clips of interviews taken from Swedish, Finnish and Danish television broadcasting. However, the coding scheme also intends to be a general instrument for the study of gestures and facial displays in interpersonal communication, in particular the role played by multimodal expressions for feedback, turn management and sequencing. The first coding experiment was carried out at a workshop at KTH, Stockholm, on 21-22 June 2004. The version V3.4 of the coding scheme, presented in this paper, is the result of comments and discussions during and after the workshop.

In this short report, I share my experience of getting to know the choreographic practice of choreographer Jonathan Burrows and composer Matteo Fargion using the Motion Bank digital annotation tool Piecemaker. My report narrates the process of coming from a place of not knowing their practice at all to a deeper understanding through listening to interviews and deciphering their scorebooks. I present some of the thought processes and steps I took using Piecemaker, and how this led me to explore different references (e.g. other composers, historical performance forms, etc.) they draw upon to create their choreographies. I then share the results of my study using the Motion Bank publishing tool MoSys.

Online Score: http://scores.motionbank.org/jbmf-revisited/

ABSTRACT In this short report, I share my experience of getting to know the choreographic practice of choreographer Jonathan Burrows and composer Matteo Fargion using the Motion Bank digital annotation tool Piecemaker. My report narrates the process of coming from a place of not knowing their practice at all to a deeper understanding through listening to interviews and deciphering their scorebooks. I present some of the thought processes and steps I took using Piecemaker, and how this led me to explore different references (e.g. other composers, historical performance forms, etc.) they draw upon to create their choreographies. I then share the results of my study using the Motion Bank publishing tool MoSys.