Academia.eduAcademia.edu

Visual Music

description352 papers
group10,221 followers
lightbulbAbout this topic
Visual Music is an interdisciplinary field that explores the relationship between visual art and music, focusing on the synesthetic experience where visual elements are used to represent or evoke musical concepts, emotions, and structures, often through the integration of multimedia technologies.
lightbulbAbout this topic
Visual Music is an interdisciplinary field that explores the relationship between visual art and music, focusing on the synesthetic experience where visual elements are used to represent or evoke musical concepts, emotions, and structures, often through the integration of multimedia technologies.

Key research themes

1. How can audiovisual sampling and synchronous synthesis techniques shape multichannel visual music composition?

This theme investigates advanced compositional methodologies that integrate audiovisual sampling, synchronous granular synthesis, and algorithmic controls to create complex multichannel audiovisual works. It matters because these techniques offer precise control over temporal and spatial form, enabling composers to extend musical form beyond conventional concert experiences into immersive audiovisual installations.

Key finding: The paper proposes and implements the MAVASP method combining audiovisual sampling and synchronous granular synthesis governed by pseudorandom number generators to create multichannel audiovisual compositions. It demonstrates... Read more
Key finding: This study adapts musical form concepts from concert music to time-based audiovisual installations, emphasizing the visitor's agency in co-producing temporal experience. It identifies compositional strategies for extending... Read more
Key finding: The author revives and hybridizes obsolete analogue devices such as oscilloscopes and lasers to create synchronous audiovisual works where image and sound derive from the same signal. This direct signal translation reveals... Read more

2. What roles do visual elements, such as gaze and image, play in shaping musical communication and audience perception?

This theme explores the multimodal interactions between visual and auditory stimuli in music, focusing on how vision influences musical experience, the perception of emotion, and performative aspects such as gaze in live performance and audiovisual identity in media. Understanding these intersections is crucial for both enhancing music communication and decoding multimodal sensory integration.

Key finding: The paper reviews psychological and empirical research showing that visual information significantly influences music perception at multiple levels, from audience evaluation to low-level features like loudness and timbre. It... Read more
Key finding: Through multimodal musical analysis and fieldwork on Yorùbá oríkì praise-singing, this study identifies the performer's gaze as a critical modality for establishing social engagement and focal attention in music... Read more
Key finding: Focusing on hearing-impaired participants, this experimental study finds that although visual information plays a supplementary role in emotion recognition during musical performance, its effectiveness is less for... Read more

3. How can integrated audiovisual approaches redefine the boundaries between sound design, music, and visual music in contemporary media and performance?

This theme examines the dissolution of traditional boundaries between sound design, music composition, and visual music through integrated audiovisual practices in contemporary media, including film soundtracks, live audiovisual installations, and virtual environments. Innovations in technology and interdisciplinary approaches create new paradigms for audiovisual creativity and offer expanded compositional and performative vocabularies.

Key finding: The book develops the concept of 'integrated soundtrack' where score, speech, and sound effects form an interdependent soundscape blending musique concrète and minimalism. It challenges hierarchical models of film sound,... Read more
Key finding: This call foregrounds interdisciplinary research on the audio-visual synchronicity between photography and sound, highlighting concepts such as visualisation of sound, sonority of image, and synaesthesia. It situates... Read more
Key finding: Through human-centered design and empirical user studies, this paper finds that customizable virtual environments in VR support individual creativity in musical beat composition and maintain high levels of flow and user... Read more

All papers in Visual Music

This chapter, for the forthcoming edited collection, _In the Shadow of the Phonograph_, explores some of the ways in which musical cultures of mourning respond to what Steven Shaviro (2010) has termed new ‘media regimes’ that emerged... more
La genèse et le développement de l'éducation musicale à l'école : entre l'enseignement de l'art et l'éducation par l'art en Suisse romande François Joliat
Dockum’s experimental MobilColor was a custom-built, interactive motor-driven projector that created live, abstract color compositions. Developed between 1935 and 1952, it is examined here as a precursor to a cybernetic conception of... more
Cet article propose une généalogie à la fois technique, culturelle et plastique de l’émergence des écrans et de l’imagerie électronique au XXe siècle. Là où les études de médias se sont principalement concentrées sur les avancées... more
This article examines the little-known colour film experiments of the Synchromists, an avant-garde group founded in the 1910s by US painters Stanton Macdonald-Wright and Morgan Russell. It focuses on the Synchrome Corporation, a company... more
This article examines the little-known colour film experiments of the Synchromists, an avant-garde group founded in the 1910s by US painters Stanton Macdonald-Wright and Morgan Russell. It focuses on the Synchrome Corporation, a company... more
Sound-shape associations, a subset of cross-modal associations between the auditory and visual domain, have been studied mainly in the context of matching a set of purposefully crafted shapes to sounds. Recent studies have explored how... more
Critical Point is written for solo cello and interactive computer music system with two to four channel sound system and computer animation. The cellist plays from a score, and the computer records and transforms the cello sounds in... more
Cinema, drawing love. The embodiment of complex and conscious thoughts. Its definitions are numerous and related to thoughts in line with mystical and intuitive experiences. The seventh art is accustomed to the minds of audiences who are... more
"Vertiges de l'Image" is a project on audiovisual computer experimentation, gathering music improvised by Phonogénistes with the images generated live by António de Sousa Dias. The project started in 2010 and its last performance took... more
Analise historica da criacao do som gravado, do cinema com som sincronizado, do desenvolvimento da linguagem cinematografica sonora, dos elementos formadores do som cinematografico, e de suas especificidades no mundo da animacao, seguida... more
In the perception of an audiovisual scenario and context our ears are informed by our eyes, just as our eyes can be redirected by our ears. Perception becomes the grounds on which film artists manipulate sonic/visual relationships to... more
When we use the word " synesthesia " , we mean people with the clinical condition of homonymous name, a percentage of the human population for which the binding of different senses to a single stimulus of a specialized nature is a... more
We introduce the use of weighted medial graph structures to represent sounds and musical events. Such structures permit the building of hierarchical neighborhood relationships (symmetries) while mapping time to a weight (of a note, or... more
The aim of this article is to compare Stiegler's analyses of television with the internet. The problem, in my view, arises from the fact that the internet desynchronizes consciousnesses that television, according to Stiegler, had... more
This article arises from a case study of the bachelor's degree in Audiovisual and Multimedia at the Polytechnic Institute of Beja (IPBeja) carried out in 2024. The study revealed that colour theory is one of the most influential theories... more
Tacita Dean’s art relies on the perception of liminalities, of moving in-between, of one medium unfolding into another through dispersed, “molecular” sensations, either subverting or augmenting impressions of art forms perceived on the... more
This thesis consists of a unified portfolio of eight compositions focused on and exploring alternative versions of the 3rd channel, which is a personal approach to composition and a way to describe my compositional technique. The... more
This thesis consists of a unified portfolio of eight compositions focused on and exploring alternative versions of the 3rd channel, which is a personal approach to composition and a way to describe my compositional technique. The... more
The Electric Slide Organistrum (Figure 1) is an acoustic stringed instrument played through a video capture system. The vibration of the instrument string is generated electro-magnetically and the pitch variation is achieved by movements... more
The art of calligraphy, like other achievements of human thought, has gone through different eras and has reached its current stage after passing long centuries. In the beginning, the origin of the script was pictorial and sketchy, and... more
This paper explores the hypothesis that the subconscious mind functions as a quantum computer, integrating insights from quantum mechanics, neuroscience, and psychology. By examining the role of the pineal gland as a facilitator of... more
Transcribed text of the original print of ARC Press: Byron, M. (1976). Pieces: A Second Anthology / ed. by Michael Byron. Vancouver; A.R.C. Publications. Article: Grayson, J. (1971). Avenues to Higher Levels of Psychic... more
This practice-based thesis explores the application of electroacoustic music composition techniques and tools in the context of entertainment science fiction film. After an initial exploration of existing theories in the fields of... more
Revive is an live audio-visual performance project that brings together a musical artificial intelligence architecture, human electronic musicians, and audio-reactive visual agents in a complex multimedia environment of a dome view with... more
The theoretical framework of this research delves into the complex and multifaceted relationship between music and painting, particularly in the context of synesthetic experiences. The confluence of music and painting has given rise to... more
This thesis was born from the confluence of many factors. In 2003 I was accepted as a postgraduate student at the University of Helsinki, Finland, where I began my doctoral studies. My sudden move to the North was motivated by two facts:... more
This thesis was born from the confluence of many factors. In 2003 I was accepted as a postgraduate student at the University of Helsinki, Finland, where I began my doctoral studies. My sudden move to the North was motivated by two facts:... more
O que se constrói nesse saber viver juntos? Este foi o tema que norteou o encontro de pesquisadores ibero-americano durante o XI POÉTICAS, ES 2022. O seminário reuniu artistas, professores e pesquisadores em torno do debate sobre o que... more
'Perhaps this scheme will enable us to hear more often from each other' is the major of four audiovisual compositions of an interdisciplinary practice-based PhD research portfolio. The research – Visual Music Strategies and the Sense of... more
Studying the correlation between auditory perception and, emerging during this perception, colour associations opens the possibility of finding audio – visual relationships and connections, which can be used for audio visualisation in... more
Esta pesquisa propõe investigar o trabalho de curadores e programadores de filmes brasileiros. O surgimento de especialistas em curadoria e programação de cinema no Brasil coincide com o nascimento e desenvolvimento de festivais de... more
Kandinsky e la strada verso l'arte totale
Os documentos audiovisuais trazem para a Ciência da Informação brasileira inúmeros desafi os referentes a identifi cação de seu assunto principal, e torna mais complexo o momento de elaboração de resumo e identifi cação de palavras-chave... more
A quick glance at various art exhibition halls in Nigeria reveal lots of sculptural pieces, paintings, textiles and drawings dominating the scene, with a very few prints, cartoons, videos and photographs, hanging here and there in... more
During the past four hundred years the Newtonian and Goethean schools collected many experimental observations on the formation of colors. The situation became more complicated after the experiments of Land who documented that the... more
SANTOS, Robert Simão dos. Study of the influence of affordances for learning of resonance in material media by means of Chladni standards. 2018. Total number of sheets. Dissertation (Masters in Teaching Human, Social and Nature... more
El presente artículo tiene como objetivo realizar una reflexión sobre la importancia de la experiencia de usuario en las obras de arte basadas en fotografía socio-documental, referido en concreto al proyecto artístico GENOCIDE PROJECT. Se... more
This article draws a perceptual approach to audiovisual mapping. Clearly perceivable cause and effect relationships can be problematic if one desires the audience to experience the music. Indeed perception would bias those sonic qualities... more
The purpose of this research is to explore the idea of relating storytelling with acousmatic music in the creation of a hybrid vehicle for transmitting stories, to develop a compositional methodology derived from the exploration of the... more
Download research papers for free!