Optical flow based violence detection from video footage using hybrid MobileNet and Bi-LSTM
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2023.
| Main Authors: | , , , |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English |
| Published: |
Brac University
2024
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/10361/22667 |
| id |
10361-22667 |
|---|---|
| record_format |
dspace |
| institution |
Brac University |
| collection |
Institutional Repository |
| language |
English |
| topic |
Surveillance camera Violence detection Deep learning Motion detection Beating Use of weapons Burning Optical flow Bidirectional Long Short-Term Memory (Bi-LSTM) MobileNet V2 Crime detection Real-time monitoring Proactive security management Machine learning Cognitive learning theory |
| spellingShingle |
Surveillance camera Violence detection Deep learning Motion detection Beating Use of weapons Burning Optical flow Bidirectional Long Short-Term Memory (Bi-LSTM) MobileNet V2 Crime detection Real-time monitoring Proactive security management Machine learning Cognitive learning theory Haque, Tashfia Ahmed, Farhan Fuad Ahmed, S. M. Irfan Siam, Mohammad Optical flow based violence detection from video footage using hybrid MobileNet and Bi-LSTM |
| description |
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2023. |
| author2 |
Alam, Md. Golam Rabiul |
| author_facet |
Alam, Md. Golam Rabiul Haque, Tashfia Ahmed, Farhan Fuad Ahmed, S. M. Irfan Siam, Mohammad |
| format |
Thesis |
| author |
Haque, Tashfia Ahmed, Farhan Fuad Ahmed, S. M. Irfan Siam, Mohammad |
| author_sort |
Haque, Tashfia |
| title |
Optical flow based violence detection from video footage using hybrid MobileNet and Bi-LSTM |
| title_short |
Optical flow based violence detection from video footage using hybrid MobileNet and Bi-LSTM |
| title_full |
Optical flow based violence detection from video footage using hybrid MobileNet and Bi-LSTM |
| title_fullStr |
Optical flow based violence detection from video footage using hybrid MobileNet and Bi-LSTM |
| title_full_unstemmed |
Optical flow based violence detection from video footage using hybrid MobileNet and Bi-LSTM |
| title_sort |
optical flow based violence detection from video footage using hybrid mobilenet and bi-lstm |
| publisher |
Brac University |
| publishDate |
2024 |
| url |
http://hdl.handle.net/10361/22667 |
| work_keys_str_mv |
AT haquetashfia opticalflowbasedviolencedetectionfromvideofootageusinghybridmobilenetandbilstm AT ahmedfarhanfuad opticalflowbasedviolencedetectionfromvideofootageusinghybridmobilenetandbilstm AT ahmedsmirfan opticalflowbasedviolencedetectionfromvideofootageusinghybridmobilenetandbilstm AT siammohammad opticalflowbasedviolencedetectionfromvideofootageusinghybridmobilenetandbilstm |
| _version_ |
1814308341742043136 |
| spelling |
10361-226672024-04-24T21:03:01Z Optical flow based violence detection from video footage using hybrid MobileNet and Bi-LSTM Haque, Tashfia Ahmed, Farhan Fuad Ahmed, S. M. Irfan Siam, Mohammad Alam, Md. Golam Rabiul Ahmed, Md. Faisal Department of Computer Science and Engineering, Brac University Surveillance camera Violence detection Deep learning Motion detection Beating Use of weapons Burning Optical flow Bidirectional Long Short-Term Memory (Bi-LSTM) MobileNet V2 Crime detection Real-time monitoring Proactive security management Machine learning Cognitive learning theory This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2023. Cataloged from PDF version of thesis. Includes bibliographical references (pages 46-48). This thesis presents a novel approach for the automatic detection, categorization, and sub-categorization of violent and nonviolent behaviors in video footage. This research addresses the growing necessity for enhanced security protocols in both public and private sectors. Surveillance cameras are commonly accessible and easily affordable; however, their utilization is frequently inefficient due to boundaries related to human real-time monitoring. This occurrence may lead to delayed responses to unanticipated events, hence highlighting the need for enhanced and efficient monitoring measures. Our thesis presents a novel approach for the automation of violence detection by utilizing machine learning and deep learning techniques. The techniques applied in this study integrate object and motion detection through the utilization of optical flow analysis and a MobileNet-Bi-LSTM fusion architecture. This methodology exceeds conventional methods by incorporating both temporal dynamics and spatial features. We have invested notable efforts in enhancing our dataset acknowledging the significance of training an efficient violence detection system. In addition to the existing dataset, we have systematically compiled an adequate number of video footage. The compiled videos contain a diverse array of circumstances, effectively representing a variety of environments, lighting conditions, and situations. The inclusion of this range is crucial in facilitating our model’s ability to generalize and adapt to real-world scenarios seamlessly. A thorough annotation procedure of meticulous labeling of ‘violent’ ‘non-violent’ actions, along with specific subcategories of violence like ‘Beating,’ ‘Use of Weapons,’ and ‘Burning’ was done to uphold the standards of quality and precision in the enhanced dataset. For an in-depth review, a comparison study was undertaken to examine two unique methodologies. The first approach centers on the categorization of actions into two distinct categories: ‘Non-Violence’ and ‘Violence,’ based on a binary classification system. The second approach entails the categorization of behaviors of the videos of our unique dataset named ‘Beating-Burning-Weapon (BBW) Violence’ Dataset into two main groups, namely ‘Non-Violence’ and ‘Violence,’ which further subdivided into three sub-categories of violence, which are ‘Beating,’ ‘Burning,’ and ‘Use of Weapons.’ In our comprehensive evaluation of violence detection methods, we tested two violence detection methods on the two previously mentioned datasets. The ‘Frame Selection at Equal Intervals’ method achieved higher accuracy, 90.16% in the ‘Real Life Violence Situations (RLVS)’ Dataset and 85.32% in the BBW Violence Dataset, making it a precise choice. On the other hand, the ‘Merged Frame Stacking’ method, offering computational efficiency, achieved respectable accuracies of 85% and 74% in the RLVS and BBW Violence Datasets respectively. This provides a foundational baseline for violence detection, thus highlighting method-specific advantages and trade-offs. Our research holds significant potential for proactive security management by promptly detecting and responding to possible threats. Tashfia Haque Farhan Fuad Ahmed S. M. Irfan Ahmed Mohammad Siam B.Sc. in Computer Science 2024-04-24T06:45:25Z 2024-04-24T06:45:25Z 2023 2023-09 Thesis ID 18201140 ID 19101549 ID 19101390 ID 23141065 http://hdl.handle.net/10361/22667 en Brac University theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. 48 pages application/pdf Brac University |