Pulse and Drift: Partial Audio–Visual Coupling for Culturally Situated Music Visualization

Abstract

Audio-reactive visualization is often built around tight synchronization between sound features and visual motion. For meditative experiences involving rhythmically complex or culturally unfamiliar music, however, full synchronization may become reductive or overstimulating. We present an exploratory audio-reactive visualization system for African-inspired meditative music, combining traditional instruments (kora, kalimba, djembe), ambient field recordings from Zanzibar’s Shangani Street, and real-time visuals implemented in Cocos Creator. The system uses a partial coupling strategy: two visual elements respond to low-frequency audio energy, while two others evolve through procedural noise. Through a preliminary qualitative study with 10 participants from diverse cultural backgrounds, we examine how partial coupling shaped perceived engagement and calm, how unfamiliar listeners used visuals as perceptual scaffolds, and how place-based ambient recordings supported spatial imagination. Findings suggest that partial coupling may offer a useful design tactic for meditative music visualization, while surfacing design tensions around cultural specificity, accessibility, and authorship. We discuss provisional design considerations and identify directions for more rigorous comparative and collaborative future work.