Integration of CCTV and IoT Sensors for Context-aware Intelligent Surveillance Systems

Abstract

The growing demand for smarter and more dependable surveillance systems has driven the integration of advanced technologies capable of providing real-time situational awareness and accurate anomaly detection. Conventional Closed-Circuit Television (CCTV) systems are typically constrained by their reliance on manual monitoring and lack of contextual insight, leading to slow response times and high false-alarm rates. This paper presents the design and simulation-based implementation of a context-aware intelligent surveillance system that fuses CCTV video streams with Internet of Things (IoT) sensor data to enhance detection accuracy and system responsiveness, specifically for indoor fire detection. The system employs a Variational Autoencoder (VAE) trained on multimodal data to learn normal behavioural patterns and identify anomalies through reconstruction-error analysis. Training and testing were conducted using simulated sensor data and the MmodalFire dataset, which provides synchronised video and environmental sensing data across diverse indoor environments. The system was implemented within a MATLAB–Python co-simulation framework, enabling effective modelling of both hardware behaviour and software intelligence without physical deployment. Experimental results demonstrate strong performance, with an accuracy of 96.8%, precision of 95.4%, recall of 97.1%, and a low false-alarm rate of 3.2%, representing a significant improvement over a traditional CCTV-only system. The system also exhibits low detection latency, high robustness, and sensitivity under varying environmental conditions, including smoke interference and low visibility. These findings indicate the potential of multimodal data fusion and unsupervised learning to improve surveillance intelligence.