A smart avatar tutor for mimicking characters of Bangla sign language

This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science, 2024.

Մատենագիտական մանրամասներ
Հիմնական հեղինակներ: Islam, Apu, Rahman, Somaya Al Sadia, Bhowmick, Pratick
Այլ հեղինակներ: Alam, Md. Golam Rabiul
Ձևաչափ: Թեզիս
Լեզու:English
Հրապարակվել է: Brac University 2024
Խորագրեր:
Առցանց հասանելիություն:http://hdl.handle.net/10361/22866
id 10361-22866
record_format dspace
spelling 10361-228662024-05-19T21:01:28Z A smart avatar tutor for mimicking characters of Bangla sign language Islam, Apu Rahman, Somaya Al Sadia Bhowmick, Pratick Alam, Md. Golam Rabiul Department of Computer Science and Engineering, Brac University Sign language Bangla language Image processing Cosine similarity YOLOv8 Image processing--Digital techniques Sign language This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science, 2024. Cataloged from PDF version of thesis. Includes bibliographical references (pages 43-44). This paper presents an efficient novel approach to developing a smart avatar tutor for teaching Bangla Sign Language (BSL). The avatar is designed to mimic the numbers and alphabets used in BSL, providing an interactive and engaging tool for learners. The system employs image processing and machine learning techniques to identify and analyze hand gestures and signs in a dataset, generating corresponding animated sequences that the avatar can use to replicate them. Following preliminary pre-processing of the dataset, we collected hand gestures and signs to train the system. The avatar’s user interface (UI) is designed to be intuitive and user-friendly, allowing learners to practice physically to engage their sensorimotor skills, making the learning more efficient, and receiving instant feedback on their performance using cosine similarity. The results of a user study, conducted with 10 participants from the National Federation of the Deaf, showed that the avatar was effective in improving learners’ BSL skills and was perceived positively in terms of usability and engagement. Though there is a little research on American Sign Language avatar tutors or a learning system for American Sign Language, there isn’t any research conducted on a smart avatar tutor for teaching Bangla Sign Language (BSL). The proposed system has the potential to make BSL learning more accessible and enjoyable for a wider audience. Apu Islam Somaya Al Sadia Rahman Pratick Bhowmick B.Sc in Computer Science 2024-05-19T06:36:02Z 2024-05-19T06:36:02Z ©2024 2024-01 Thesis ID: 23241069 ID: 20101560 ID: 20101262 http://hdl.handle.net/10361/22866 en Brac University theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. 51 pages application/pdf Brac University
institution Brac University
collection Institutional Repository
language English
topic Sign language
Bangla language
Image processing
Cosine similarity
YOLOv8
Image processing--Digital techniques
Sign language
spellingShingle Sign language
Bangla language
Image processing
Cosine similarity
YOLOv8
Image processing--Digital techniques
Sign language
Islam, Apu
Rahman, Somaya Al Sadia
Bhowmick, Pratick
A smart avatar tutor for mimicking characters of Bangla sign language
description This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science, 2024.
author2 Alam, Md. Golam Rabiul
author_facet Alam, Md. Golam Rabiul
Islam, Apu
Rahman, Somaya Al Sadia
Bhowmick, Pratick
format Thesis
author Islam, Apu
Rahman, Somaya Al Sadia
Bhowmick, Pratick
author_sort Islam, Apu
title A smart avatar tutor for mimicking characters of Bangla sign language
title_short A smart avatar tutor for mimicking characters of Bangla sign language
title_full A smart avatar tutor for mimicking characters of Bangla sign language
title_fullStr A smart avatar tutor for mimicking characters of Bangla sign language
title_full_unstemmed A smart avatar tutor for mimicking characters of Bangla sign language
title_sort smart avatar tutor for mimicking characters of bangla sign language
publisher Brac University
publishDate 2024
url http://hdl.handle.net/10361/22866
work_keys_str_mv AT islamapu asmartavatartutorformimickingcharactersofbanglasignlanguage
AT rahmansomayaalsadia asmartavatartutorformimickingcharactersofbanglasignlanguage
AT bhowmickpratick asmartavatartutorformimickingcharactersofbanglasignlanguage
AT islamapu smartavatartutorformimickingcharactersofbanglasignlanguage
AT rahmansomayaalsadia smartavatartutorformimickingcharactersofbanglasignlanguage
AT bhowmickpratick smartavatartutorformimickingcharactersofbanglasignlanguage
_version_ 1814307673804374016