An Architecture for Constructing Mulsemedia Applications using Real-Time Fluid Simulation

Abstract

The integration of sensory effects—such as wind, heat, and scent—into multimedia applications holds great promise for enhancing user immersion and Quality of Experience (QoE). However, simulating the propagation of such effects in dynamic environments presents considerable challenges, particularly in achieving real-time interactivity, physical plausibility, and perceptual coherence. This paper introduces an interactive simulation system based on Smoothed-Particle Hydrodynamics (SPH), designed to model gaseous-like sensory effects for real-time applications. The proposed architecture allows authors to configure virtual environments, define sensor and actuator properties, and simulate the behavior of sensory effects under different conditions. A wind-with-temperature simulation scenario is presented as a proof of concept, demonstrating the feasibility of the approach. Experimental results indicate that the proposed model captures key physical trends observed in real-world measurements. Thus, the proposed system provides a foundation for the design and evaluation of future mulsemedia experiences.