Multimodal approach to human detection in unconstrained environments using YOLOV7 for conventional, infrared & thermal cameras
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science, 2023.
| المؤلفون الرئيسيون: | , , , , |
|---|---|
| مؤلفون آخرون: | |
| التنسيق: | أطروحة |
| اللغة: | English |
| منشور في: |
Brac University
2023
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | http://hdl.handle.net/10361/21922 |
| id |
10361-21922 |
|---|---|
| record_format |
dspace |
| spelling |
10361-219222023-12-07T09:58:46Z Multimodal approach to human detection in unconstrained environments using YOLOV7 for conventional, infrared & thermal cameras Rukaiya, Maymuna Khan Soumik, Md. Muhtadee Faiaz Sakib, Sazzad Hossan Islam, Md. Ashikul Ishrak, Mohammad Farhan Rhaman, Dr. Md. Khalilur Reza, Mr. Md. Tanzim Department of Computer Science and Engineering, Brac University Human detection Machine learning YOLO v7 Faster R-CNN Bangla speech recognition Thermal image Primary dataset Machine learning. Artificial intelligence. This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science, 2023. Cataloged from PDF version of thesis. Includes bibliographical references (pages 56-58). Search and rescue operations in disaster-stricken areas are often hindered by chal lenging environmental conditions, such as poor visibility, limited lighting, and high levels of noise and clutter. These conditions can make it difficult to locate and res cue survivors in a timely manner, which can have significant implications for their survival and recovery. Traditional methods of human detection, such as visual obser vation, can be ineffective in these environments, and new and innovative approaches are needed to address these challenges. This research presents a novel multimodal approach to human detection in unconstrained environments using YOLOv7 for con ventional, infrared and thermal cameras. The proposed approach aims to improve human detection performance in challenging environments, such as post-disaster situations, where traditional methods may fail. A unique dataset of 7,087 images was created for this research, including both conventional and thermal images, which were collected to capture the realistic scenario of disaster environments. The dataset was used to train various CNN models for human life detection, and the results were evaluated using standard metrics. Additionally, to further enhance the search and rescue operations in post-disaster situations, a Bangla speech recognition model was integrated into the system. The results of this research demonstrate the effectiveness of the proposed approach in detecting humans in challenging environments, such as low-light and obscured conditions. The use of thermal imaging in particular, has the potential to significantly improve human detection in disaster scenarios where visibility is limited. This research provides a valuable contribution to the field of human detection in unconstrained environments and has the potential to improve search and rescue operations in the future. Maymuna Rukaiya Md. Muhtadee Faiaz Khan Soumik Sazzad Hossan Sakib Md. Ashikul Islam Mohammad Farhan Ishrak B.Sc. in Computer Science 2023-12-05T09:16:57Z 2023-12-05T09:16:57Z 2023 2023-01 Thesis 19101142 19101491 22241131 22241137 22241187 http://hdl.handle.net/10361/21922 en Brac University theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. 58 pages application/pdf Brac University |
| institution |
Brac University |
| collection |
Institutional Repository |
| language |
English |
| topic |
Human detection Machine learning YOLO v7 Faster R-CNN Bangla speech recognition Thermal image Primary dataset Machine learning. Artificial intelligence. |
| spellingShingle |
Human detection Machine learning YOLO v7 Faster R-CNN Bangla speech recognition Thermal image Primary dataset Machine learning. Artificial intelligence. Rukaiya, Maymuna Khan Soumik, Md. Muhtadee Faiaz Sakib, Sazzad Hossan Islam, Md. Ashikul Ishrak, Mohammad Farhan Multimodal approach to human detection in unconstrained environments using YOLOV7 for conventional, infrared & thermal cameras |
| description |
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science, 2023. |
| author2 |
Rhaman, Dr. Md. Khalilur |
| author_facet |
Rhaman, Dr. Md. Khalilur Rukaiya, Maymuna Khan Soumik, Md. Muhtadee Faiaz Sakib, Sazzad Hossan Islam, Md. Ashikul Ishrak, Mohammad Farhan |
| format |
Thesis |
| author |
Rukaiya, Maymuna Khan Soumik, Md. Muhtadee Faiaz Sakib, Sazzad Hossan Islam, Md. Ashikul Ishrak, Mohammad Farhan |
| author_sort |
Rukaiya, Maymuna |
| title |
Multimodal approach to human detection in unconstrained environments using YOLOV7 for conventional, infrared & thermal cameras |
| title_short |
Multimodal approach to human detection in unconstrained environments using YOLOV7 for conventional, infrared & thermal cameras |
| title_full |
Multimodal approach to human detection in unconstrained environments using YOLOV7 for conventional, infrared & thermal cameras |
| title_fullStr |
Multimodal approach to human detection in unconstrained environments using YOLOV7 for conventional, infrared & thermal cameras |
| title_full_unstemmed |
Multimodal approach to human detection in unconstrained environments using YOLOV7 for conventional, infrared & thermal cameras |
| title_sort |
multimodal approach to human detection in unconstrained environments using yolov7 for conventional, infrared & thermal cameras |
| publisher |
Brac University |
| publishDate |
2023 |
| url |
http://hdl.handle.net/10361/21922 |
| work_keys_str_mv |
AT rukaiyamaymuna multimodalapproachtohumandetectioninunconstrainedenvironmentsusingyolov7forconventionalinfraredthermalcameras AT khansoumikmdmuhtadeefaiaz multimodalapproachtohumandetectioninunconstrainedenvironmentsusingyolov7forconventionalinfraredthermalcameras AT sakibsazzadhossan multimodalapproachtohumandetectioninunconstrainedenvironmentsusingyolov7forconventionalinfraredthermalcameras AT islammdashikul multimodalapproachtohumandetectioninunconstrainedenvironmentsusingyolov7forconventionalinfraredthermalcameras AT ishrakmohammadfarhan multimodalapproachtohumandetectioninunconstrainedenvironmentsusingyolov7forconventionalinfraredthermalcameras |
| _version_ |
1814308841742925824 |