Motion based gesture detection using frame composition LSTM
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science, 2022.
| Những tác giả chính: | , , , , |
|---|---|
| Tác giả khác: | |
| Định dạng: | Luận văn |
| Ngôn ngữ: | English |
| Được phát hành: |
Brac University
2023
|
| Những chủ đề: | |
| Truy cập trực tuyến: | http://hdl.handle.net/10361/21831 |
| id |
10361-21831 |
|---|---|
| record_format |
dspace |
| spelling |
10361-218312024-03-13T21:00:22Z Motion based gesture detection using frame composition LSTM Islam, Ishraqul Islam, Md. Saqif Provat, Mahin Islam Khandakar, Shaneen Shadman Karim, Fardin Junayed Rhaman, Md. Khalilur Department of Computer Science and Engineering, Brac University Frame composition LSTM ASL MediaPipe holistic Hand gesture recognition Human-computer interaction Computer communication systems This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science, 2022. Cataloged from PDF version of thesis. Includes bibliographical references (pages 36-38). Years of technological progress have made machines capable of identifying humans in images and videos. Moreover, machines like computers can also detect our hand gestures. Gesture recognition is the tool needed to comprehend sign languages. Sign language recognition is an important part of computer vision that uses the visual-manual modality of expression. This method solves the communication barrier between the deaf and mute and the common people. Currently, in the world, there are around 432 Million deaf mutes which is around 5% of the total global population. To solve this problem of communication gap we are focusing on creating an application for detecting sign language which will detect hand gestures and show us the output in the form of text. There are different sign languages present, but in our paper, we are mainly dealing with American Sign Language ( ASL ). Thus for this research, there are certain datasets present on the internet but we will be collecting our own set of words via our Real-time data collection system and make the sentences by using our model. To develop this model we are using both Long Short Term Memory. LSTM networks are a class of RNN that may learn order dependency in sequence prediction challenges. This is a necessary characteristic in complicated problem fields such as machine translation, and speech recognition, therefore we will be using it to recognize the gesture from images and video captured via the camera or webcam. Furthermore, to detect the pose and model it, we are using the MediaPipe Holistic library with the help of OpenCV. This helps us draw the landmarks on skeleton poses. Thus, giving us a generalized overview of an individual’s appearance and background, allowing more focus on the perception of motion. Hence, extracting features from each frame of our videos and then composing them onto LSTM lead us into naming our model Frame Composition LSTM. Ishraqul Islam Md. Saqif Islam Mahin Islam Provat Shaneen Shadman Khandakar Fardin Junayed Karim B.Sc. in Computer Science 2023-10-16T04:17:33Z 2023-10-16T04:17:33Z ©2022 2022-09-28 Thesis ID 19141008 ID 19101238 ID 19101074 ID 19101176 ID 19101198 http://hdl.handle.net/10361/21831 en Brac University theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. 48 pages application/pdf Brac University |
| institution |
Brac University |
| collection |
Institutional Repository |
| language |
English |
| topic |
Frame composition LSTM ASL MediaPipe holistic Hand gesture recognition Human-computer interaction Computer communication systems |
| spellingShingle |
Frame composition LSTM ASL MediaPipe holistic Hand gesture recognition Human-computer interaction Computer communication systems Islam, Ishraqul Islam, Md. Saqif Provat, Mahin Islam Khandakar, Shaneen Shadman Karim, Fardin Junayed Motion based gesture detection using frame composition LSTM |
| description |
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science, 2022. |
| author2 |
Rhaman, Md. Khalilur |
| author_facet |
Rhaman, Md. Khalilur Islam, Ishraqul Islam, Md. Saqif Provat, Mahin Islam Khandakar, Shaneen Shadman Karim, Fardin Junayed |
| format |
Thesis |
| author |
Islam, Ishraqul Islam, Md. Saqif Provat, Mahin Islam Khandakar, Shaneen Shadman Karim, Fardin Junayed |
| author_sort |
Islam, Ishraqul |
| title |
Motion based gesture detection using frame composition LSTM |
| title_short |
Motion based gesture detection using frame composition LSTM |
| title_full |
Motion based gesture detection using frame composition LSTM |
| title_fullStr |
Motion based gesture detection using frame composition LSTM |
| title_full_unstemmed |
Motion based gesture detection using frame composition LSTM |
| title_sort |
motion based gesture detection using frame composition lstm |
| publisher |
Brac University |
| publishDate |
2023 |
| url |
http://hdl.handle.net/10361/21831 |
| work_keys_str_mv |
AT islamishraqul motionbasedgesturedetectionusingframecompositionlstm AT islammdsaqif motionbasedgesturedetectionusingframecompositionlstm AT provatmahinislam motionbasedgesturedetectionusingframecompositionlstm AT khandakarshaneenshadman motionbasedgesturedetectionusingframecompositionlstm AT karimfardinjunayed motionbasedgesturedetectionusingframecompositionlstm |
| _version_ |
1814307218284085248 |