Yuan Yi Fan: Structural Analogy

Artist(s):

• Yuan Yi Fan

Title:

Structural Analogy

Exhibition:

• DAC Online Exhibition 2018: Origins + Journeys

Category:

• Sound Art

Artist Statement:

Sound Figures by Ernst Chladni (1787) is the origin of systematic attempt to visualize sounds as image. Inspired by Chladni’s acoustics research, thesis of Structural Analogy is that aesthetics of audiovisual transformation could be enriched by systematically integrating music information retrieval (MIR) and pattern formation techniques into creative processes. Sound visualization using short-term acoustic features is one of the effective strategies in engaging audience in live audiovisual performance. However, short-term acoustic features alone are not sufficient in engaging audience in art forms that require time to unfold narratives, such as in audiovisual composition and interactive installation. To examine this thesis, a custom computer graphics application that integrates the open-source Essentia MIR toolbox is developed and capable of visually modeling causality based on a source sound signal. This music video is created using the above software application, which enables examination of emergent connections between sound and visual at various spatial and temporal scales through computation and algorithms. Structural Analogy is an ongoing experiment that investigates techniques necessary to visualize narratives in source sound signals. Since 2016, Structural Analogy has been exhibited at international venues, including FOCA, SBCAST, DDP, WOCMAT-IRCAM Forum, and CURRENTS.