Making Multimodal Melodies: Design and Implementation of a Comprehensive, Interactive Music Visualization System

Abstract

This thesis presents the design and implementation of an interactive music visualization system that bridges auditory and visual modalities through user-driven input in real time. Unlike traditional visualizers that passively interpret pre-recorded audio, this system enables dynamic, tactile interaction using a MIDI controller, an Arduino microcontroller, and an LED display panel. Through a combination of hardware and software components, the system translates musical attributes such as pitch, dynamics, tempo, and pedaling into vivid and customizable light displays. The design emphasizes accessibility and modularity, supporting various MIDI devices and allowing users to engage at both beginner and advanced levels of musical experience. The system offers a novel platform for exploring the relationship between sound and sight, with potential applications in performance, education, and accessible music interaction.