Query-Driven Intelligent Surveillance using Deep Learning for Activity Recognition and Video Summarization
Surveillance systems have experienced rapid growth which results in production of large video data streams. The monitoring process for this data becomes challenging because its volume exceeds human capacity and this situation creates potential for errors. Our research presents a hybrid intelligent surveillance system which conducts automatic video analysis through its two core operational components. The system employs two primary components to achieve its objectives. The SlowFast-based model enables users to track activities through their development across various time intervals. The system employs YOLO-based models to identify critical objects which include fire and weapons and road accidents through real-time monitoring. The system achieves improved stability through the implementation of a temporal debouncing method. The system uses multiple frame detection checks to improve detection accuracy which helps prevent false alarms. The system includes a module dedicated to video summarization which creates a summary from detected activities and visual changes. The system discards unneeded video content while retaining essential information through this process. The model uses a dataset that contains 4758 video clips which display various classification types. The system reaches 85% validation accuracy which demonstrates its ability to handle new data successfully. The system operates on devices with limited resources while providing an immediate alert system to inform users about essential incidents. The system delivers an easy-to-use and effective solution for intelligent video surveillance operations.