Academia.eduAcademia.edu

Visual Music

description352 papers
group10,222 followers
lightbulbAbout this topic
Visual Music is an interdisciplinary field that explores the relationship between visual art and music, focusing on the synesthetic experience where visual elements are used to represent or evoke musical concepts, emotions, and structures, often through the integration of multimedia technologies.
lightbulbAbout this topic
Visual Music is an interdisciplinary field that explores the relationship between visual art and music, focusing on the synesthetic experience where visual elements are used to represent or evoke musical concepts, emotions, and structures, often through the integration of multimedia technologies.

Key research themes

1. How can audiovisual sampling and synchronous synthesis techniques shape multichannel visual music composition?

This theme investigates advanced compositional methodologies that integrate audiovisual sampling, synchronous granular synthesis, and algorithmic controls to create complex multichannel audiovisual works. It matters because these techniques offer precise control over temporal and spatial form, enabling composers to extend musical form beyond conventional concert experiences into immersive audiovisual installations.

Key finding: The paper proposes and implements the MAVASP method combining audiovisual sampling and synchronous granular synthesis governed by pseudorandom number generators to create multichannel audiovisual compositions. It demonstrates... Read more
Key finding: This study adapts musical form concepts from concert music to time-based audiovisual installations, emphasizing the visitor's agency in co-producing temporal experience. It identifies compositional strategies for extending... Read more
Key finding: The author revives and hybridizes obsolete analogue devices such as oscilloscopes and lasers to create synchronous audiovisual works where image and sound derive from the same signal. This direct signal translation reveals... Read more

2. What roles do visual elements, such as gaze and image, play in shaping musical communication and audience perception?

This theme explores the multimodal interactions between visual and auditory stimuli in music, focusing on how vision influences musical experience, the perception of emotion, and performative aspects such as gaze in live performance and audiovisual identity in media. Understanding these intersections is crucial for both enhancing music communication and decoding multimodal sensory integration.

Key finding: The paper reviews psychological and empirical research showing that visual information significantly influences music perception at multiple levels, from audience evaluation to low-level features like loudness and timbre. It... Read more
Key finding: Through multimodal musical analysis and fieldwork on Yorùbá oríkì praise-singing, this study identifies the performer's gaze as a critical modality for establishing social engagement and focal attention in music... Read more
Key finding: Focusing on hearing-impaired participants, this experimental study finds that although visual information plays a supplementary role in emotion recognition during musical performance, its effectiveness is less for... Read more

3. How can integrated audiovisual approaches redefine the boundaries between sound design, music, and visual music in contemporary media and performance?

This theme examines the dissolution of traditional boundaries between sound design, music composition, and visual music through integrated audiovisual practices in contemporary media, including film soundtracks, live audiovisual installations, and virtual environments. Innovations in technology and interdisciplinary approaches create new paradigms for audiovisual creativity and offer expanded compositional and performative vocabularies.

Key finding: The book develops the concept of 'integrated soundtrack' where score, speech, and sound effects form an interdependent soundscape blending musique concrète and minimalism. It challenges hierarchical models of film sound,... Read more
Key finding: This call foregrounds interdisciplinary research on the audio-visual synchronicity between photography and sound, highlighting concepts such as visualisation of sound, sonority of image, and synaesthesia. It situates... Read more
Key finding: Through human-centered design and empirical user studies, this paper finds that customizable virtual environments in VR support individual creativity in musical beat composition and maintain high levels of flow and user... Read more

All papers in Visual Music

Late in his career, John Cage often recalled his brief interaction with German abstract animator Oskar Fischinger in 1937 as the primary impetus for his early percussion works. Further examination of this connection reveals an important... more
Once upon a time there was a computer music system called GROOVE (Generating Realtime Operations On Voltage-controlled Equipment, Bell Telephone Laboratories, Murray Hill, New Jersey), which outputted in the realm of sound, and was a... more
This article places computer music directly into Stan Godlovitch's Model of Musical Performance; an idealized conception of musical performance based on four fundamental constituents: sounds, agents, works and listeners. Godlovitch's... more
Music is associated to colors since ancient years. Different mappings between attributes of sound and images allow the efficient conversion between the two types of media. The proposed method for converting images to music using the... more
Becoming commercially available in the mid 1960s, video quickly became integral to the intense experimentalism of New York City's music and art scenes. The medium was able to record image and sound at the same time, which allowed... more
Discusses shift in the politics of the avant-garde after World War II. I argue that the utopian aspirations of the avant-garde are refocused on providing singular, non-binding examples of alternative ways of seeing, thinking, and... more
This essay establishes a parallelism between the ‘Clavilux’, a silent colour-organ from Thomas Wilfred in the —beginning of the 20th century, and ‘Ufabulum’, an audiovisual live performance from the artist Squarepusher in the year 2012.... more
The Augmented Tonoscope is an artistic study into the aesthetics of sound and vibration through its analogue in visual form – the modal wave patterns of Cymatics. Key to the research is the design, fabrication and crafting of a sonically... more
The Author discusses his views on musical composition in the late twentieth century, focusing on the influence that communication and computer technology have had over his pursuit. He goes on to describe his use of computer-based... more
Gridjam, a performance instrument, visualized real-time in the Virtual Color Organ, was developed and transformed through collaboration and new technology during a fifteen year process. This international performance of specially composed... more
Our research is inspired by the sound and component design of the classic analogue synthesizer the EMS VCS3. In this project, a convergence is made between analogue and digital technologies. By introducing virtual and augmented realities... more
This article deals with the philosophical idea of worldmaking pursued through techné, meaning the fusion of the technical means of artistic creation, theorizing, and analysis, but specifically occurring in a feedback loop involving... more
Discusses the efforts of New Zealand artist Len Lye to use cinema as a source of somatic rejuvenation in the 1930s.
My research was framing traditional animation as a design tool for documenting embodied knowledge but also as an embodied practice in itself. Through the process of frame by frame sequential interpretation, as an animator I was able to... more
The better quality pdf is downloadible from here: "http://www.leoalmanac.org/wp-content/uploads/2013/07/LEAVol19No3-Mailman.pdf Through recent artistic practices and technology of interactive systems for music, composition and... more
Trevor Wishart is an electroacoustic composer who obtained his PhD at the University of York in 1973 . books On Sonic Art (1984 and 1996) and Audible Design (1994), which present his ideas about sound treatment, perception and... more
"This investigation provides an answer to the following ontological question: what is an acousmatic musical performance? Chapter 1 discusses acousmatic sound – a fundamental constituent of the acousmatic musical performance – and... more
A critical commentary that presents and contextualizes a film and video making practice spanning three decades. It locates a contemporary visual music practice within current and emerging critical and theoretical contexts and tracks back... more
The evolutional course of music through centuries has shown an incremental use of chromatic variations by composers and performers for melodies’ and music sounds’ enrichment. This paper presents an integrated model, which contributes to... more
Ruggero Vasari was a vital figure in the history of Futurism and played a key role in the movement’s relations with Central and Eastern Europe. The specific interplay between his artistic identity as an Italian Futurist on one hand and... more
Here we describe a programme that will enable the performance of advanced real-time computer graphics by non-programmers through flexible modules that are easily exchanged and managed.
This article describes the intersection of Media Archaeology and Visual Music in my artistic practice that repurposes obsolete devices to investigate new connections between light and sound. I revive and hack tools from our analogue past:... more
This essay traces the theorization of interwar animation through period analogies with painting and dance, paying special attention to the valorization of concepts such as dematerialization and embodiment, which metaphors of visual music... more
Over the last century, researchers and artists have developed and employed a range of techniques to create audiovisual compositions. From the hand-painted abstract visual music animations by Futurist artists Arnaldo Ginna and Bruno Corra... more
Taking cues from architecture, painting, and experimental cinema, Noam Elcott maps three distinct paradigms for the format of the vertically oriented screen (i.e. portrait format). Portraiture-the erect human figure or face-may be... more
A pesquisa trata das diversas ferramentas tecnológicas utilizadas por artistas para criar e executar trabalhos de Visual Music desde os primeiros experimentos com Color Organs no século XVIII até a produção contemporânea, mostrando de que... more
El cine absoluto, desarrollado durante las vanguardias históricas, continuó con una larga tradición artística que vinculaba experiencia musical con visual. Sus autores, gracias al cine, pudieron trabajar con la imagen en movi-miento para... more
This paper presents an approach for usability and expressivity trade-off for real-time multimedia systems. Through a new graphic user interface paradigm and using visual programming languages architecture, ViMus is an expressive tool, but... more
O desejo de estabelecer correspondências entre som e imagem vem intrigando e suscitando inúmeros questionamentos e analogias há séculos. Esta pesquisa visa levantar questões relativas ao sonoro e ao visual, discutir a prática dos mashups... more
This thesis explores the phenomenon of teaching and learning of western music theory within university level education. The teaching and learning of western music theory concerns an intangible medium, which can pose difficulties in its... more
Films can be related to discrete or multiple positions along a continuum from clarity to obscurity, from the recognizable, pictorial and concrete, to the undefined, ambiguous, symbolic and abstract. This thesis discusses examples of films... more
Addresses the relationship between images and music in the pre-World War Two films of Len Lye.  Places these films within the context of the 'visual music' tradition in prewar abstract painting and film-making.
Visual music is an art form that implies intermodal connections between the senses but which has historically often failed to identify aesthetically satisfying correspondences. Artistic success does not automatically emerge in one medium... more
Skalldans is an audiovisual improvisation piece for a solo laptop performer. Sound and video syntheses are piloted with a MIDI interface, a camera, and a Wiimote; also, audiovisual streams influence each other. The present text discusses... more
https://pdpseven.wixsite.com/sound-color CHROMOSCALE presents a novel framework that integrates numerical systems with color representation through a unique chromatic approach based on cyclic orders. The concept revolves around the... more
""State-of-the-art ways for visualizing high-level music concepts are currently a trend in music computing, aiming at bridging the semantic gap between music information retrieval and human knowledge. This work presents the analysis... more
Download research papers for free!