Abstract The Music Table is an augmented reality system for composing music by manipulating objec... more Abstract The Music Table is an augmented reality system for composing music by manipulating objects on a tabletop as a physicalized representation of the music being heard. Educational theory, and the apparent success of related ap-plications in various learning contexts, ...
Over eight years of working with computers, a recurring problem has been what to do when existing... more Over eight years of working with computers, a recurring problem has been what to do when existing tools fail to grow along with artistic ideas. Having failed to become skilled at programming, I have repeatedly sought ways to deal with this problem. I describe my experience of working with programmers and my adoption of various visual programming tools. I also describe some of the territories I have crossed in pondering the concepts of programming and computation, especially in regard to augmented reality. I also describe my group's recent work in augmented reality and music, as well as a promising approach to augmented reality authoring.
Tangible interfaces are finding their way into various areas of creative activity, particularly i... more Tangible interfaces are finding their way into various areas of creative activity, particularly in the creation of music. Tangible representations of musical information, together with their graphical counterparts, play an important role in increasingly complex representational systems. This paper explores the relationships between these representations in the context of various modes of compositional (and by extension, creative) engagement adopted by composers in their working process.
Real-time 3D computer graphics offer interesting metaphors for representation and control of comp... more Real-time 3D computer graphics offer interesting metaphors for representation and control of computergenerated sound. Such metaphors can reach beyond the interface-building tools included in popular computer music synthesis programs. By exploring some simple projects using the Touch Designer modeling and animation environment, the author intends to expose some of the sound control possibilities afforded by this program and encourage further experimentation by others.
We present an environment that enables non-programmers to quickly author interactive augmented re... more We present an environment that enables non-programmers to quickly author interactive augmented reality projects without writing code or waiting to compile. Major changes to models, animation, behaviors and interactivity can be made while the application is running, and the results immediately seen on a HMD or screen. We do this by combining marker-tracking software with Touch Designer, a real-time 3D
On the Music Table, patterns of cards arranged on a tabletop become musical phrases. The system s... more On the Music Table, patterns of cards arranged on a tabletop become musical phrases. The system stores completed phrases on other cards and combines them as larger patterns. Animated characters provide fun visual feedback as users edit and arrange phrases, making abstract musical structures visible and tangible.
This report summarises the discussion and experimental work pro- duced by the authors at the 2009... more This report summarises the discussion and experimental work pro- duced by the authors at the 2009 symposium Computational Creativity: An Interdisciplinary Approach, Dagstuhl Leibniz-Zentrum fur Informatik. It outlines the motivation for using computational techniques to stimulate human creativity, briey summarising its historical context and predeces- sors, and describes two software studies produced by the group as base-line exemplars of these
No new technology appears in a society without causing changes to that society. Artists instincti... more No new technology appears in a society without causing changes to that society. Artists instinctively respond to these changes and the potential meanings of the technologies that bring them about. In this way, artists' interest in technology goes beyond the simple desire to possess new tools for artistic expression. Artists serve to prepare society for the invisible changes going on within it by producing artworks in response to the mechanisms of change. This paper discusses the authors' approaches to using concepts from artificial life in their musical works, which are basically of two kinds -artificial worlds producing music as an output, and interactive compositional tools using evolutionary algorithms to generate music and sound. It also provides a brief cultural context for these works.
In this workshop, I introduce some of the reasons for my fascination with alife and my desire to ... more In this workshop, I introduce some of the reasons for my fascination with alife and my desire to use it for music making. I also talk about some of the joys and sorrows of the collaboration process. Four alife worlds, Feeping Creatures, Spinners, Gakkimon Planet and Listening Sky are described in the order they were made. I talk about what I like and dislike about each one and how I would like to extend them.
proceedings of the 9th International Conference on Human-Computer Interaction (HCI International 2001), 2001
Starting from the days of the Musical Telegraph, the first electronic instrument, the majority of... more Starting from the days of the Musical Telegraph, the first electronic instrument, the majority of synthesizers today are still equipped with keyboards, often using the traditional layout of acoustic pianos. The question that many researchers attempt to answer is that of improvement. In this paper we present an Augmented Groove, a novel musical instrument that attempts to depart from traditional approaches to musical performance, ie use keyboards, dials or simulated traditional musical controllers. It allows novices to play ...
In Search of Vital Presence - Evolving Virtual Musics
Lecture Notes in Computer Science, 2000
Abstract. A long-standing interest in the boundaries and relationships between art and science, a... more Abstract. A long-standing interest in the boundaries and relationships between art and science, animate and inanimate, technology and biology all serve to drive my work as an artist and composer. Technological changes that exploit biological paradigms will change our ...
Immersive realities: articulating the shift from VR to mobile AR through artistic practice
The Engineering Reality of Virtual Reality 2012, 2012
ABSTRACT Our contemporary imaginings of technological engagement with digital environments has tr... more ABSTRACT Our contemporary imaginings of technological engagement with digital environments has transitioned from flying through Virtual Reality to mobile interactions with the physical world through personal media devices. Experiences technologically mediated through social interactivity within physical environments are now being preferenced over isolated environments such as CAVEs or HMDs. Examples of this trend can be seen in early tele-collaborative artworks which strove to use advanced networking to join multiple participants in shared virtual environments. Recent developments in mobile AR allow untethered access to such shared realities in places far removed from labs and home entertainment environments, and without the bulky and expensive technologies attached to our bodies that accompany most VR. This paper addresses the emerging trend favoring socially immersive artworks via mobile Augmented Reality rather than sensorially immersive Virtual Reality installations. With particular focus on AR as a mobile, locative technology, we will discuss how concepts of immersion and interactivity are evolving with this new medium. Immersion in context of mobile AR can be redefined to describe socially interactive experiences. Having distinctly different sensory, spatial and situational properties, mobile AR offers a new form for remixing elements from traditional virtual reality with physically based social experiences. This type of immersion offers a wide array of potential for mobile AR art forms. We are beginning to see examples of how artists can use mobile AR to create social immersive and interactive experiences.
The Second Ieee and Acm International Symposium on Mixed and Augmented Reality 2003 Proceedings, Oct 7, 2003
Using The Music Table, a player can compose musical patterns by arranging cards on a tabletop. An... more Using The Music Table, a player can compose musical patterns by arranging cards on a tabletop. An overhead camera allows the computer to track the movements and positions of the cards and to provide immediate feedback in the form of music and on-screen computer ...
Starting from the days of the Musical Telegraph, the first electronic instrument, the majority of... more Starting from the days of the Musical Telegraph, the first electronic instrument, the majority of synthesizers today are still equipped with keyboards, often using the traditional layout of acoustic pianos. The question that many re-searchers attempt to answer is that of improvement. In this paper we present an Augmented Groove, a novel musical instrument that attempts to depart from traditional approaches to musical performance, i.e. use keyboards, dials or simulated traditional musical controllers. It allows novices to play electronic musical compositions, interactively remixing and modulating their elements, by manipulating simple physical objects.
Uploads
Papers by Rodney A Berry