Multiclass emotion classification by using Spectrogram image analysis: A CNN-XGBoost fusion approach
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2023.
| Autori principali: | , , , |
|---|---|
| Altri autori: | |
| Natura: | Tesi |
| Lingua: | English |
| Pubblicazione: |
Brac University
2023
|
| Soggetti: | |
| Accesso online: | http://hdl.handle.net/10361/19477 |
| id |
10361-19477 |
|---|---|
| record_format |
dspace |
| spelling |
10361-194772023-08-20T21:02:49Z Multiclass emotion classification by using Spectrogram image analysis: A CNN-XGBoost fusion approach Esha, Ishraq Ahmed Rahman, Shahrin Chowdhury, Sayem Kader Mim, Jannatul Ferdous Rabiul Alam, Md. Golam Rahman, Rafeed Department of Computer Science and Engineering, Brac University Emotion EEG Spectrogram NN XGBoost AI Affective-computing Human computer interaction Emotion recognition This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2023. Cataloged from PDF version of thesis. Includes bibliographical references (pages 52-55). In recent times, AI based emotion recognition also known as affective-computing which is a burgeoning branch of artificial intelligence to some extent also helping the computers to become more intelligent by scrutinizing the non-verbal signals or sentiments of humans. An essential component of human-computer interaction is emotion recognition, which has attracted a lot of interest recently because of its potential uses in a variety of industries, including psychology, business, neuro marketing strategy, education, and entertainment. In this research, we propose a combination of Convolutional Neural Networks (CNNs) and XGBoost algorithms on Electroencephalogram (EEG) spectrogram images to propose an intriguing fusion based model for identify four different classsed emotion, namely happy, sad, fear, and neutral. It has been researched that EEG signals hold important information about emotional states, and spectrogram images offer a good way to visualize this informa tion. Before feeding the spectrogram images into the CNN-XGBoost model, Before transforming the EEG data to RGB pictures, we first use a Short-Time Fourier Transform (STFT). The XGBoost method is utilized for multiclass classification, while the CNN retrieves pertinent features from the spectrogram images. On our benchmark dataset called SEED-IV dataset which is publically accessible dataset for EEG-based emotion identification, our proposed approach was validated and it exhibited top-of-the-line precision and F1-score results. To do this, we extracted features from the signals using a range of feature extraction approaches, includ ing the Short Time Fourier Transformation, Discrete Cosine Transformation, Power Spectral Density, Differential Entropy factors, and certain statistical traits. In order to demonstrate that the model we suggest is better in terms of accuracy and com puting efficiency, we also conducted comparisons with a number of other well-known models. The performance analysis demonstrates that the suggested CNN-XGBoost fusion approach, which is based on spectrogram images, excels over conventional feature-based CNN, LSTM, and various pretrained models, including the VGG16 and VGG19 methods. Our stated CNN-XGBoost fusion-based framework using EEG spectrogram images delivers a promising method for precise and effective mul ticlass emotion identification, which has significant ramifications for facilitating the development of future systems for human-computer interaction. Ishraq Ahmed Esha Shahrin Rahman Sayem Kader Chowdhury Jannatul Ferdous Mim B. Computer Science and Engineering 2023-08-20T09:35:30Z 2023-08-20T09:35:30Z 2023 2023-05 Thesis ID: 19301261 ID: 20101464 ID: 19101076 ID: 23141096 http://hdl.handle.net/10361/19477 en Brac University theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. 55 pages application/pdf Brac University |
| institution |
Brac University |
| collection |
Institutional Repository |
| language |
English |
| topic |
Emotion EEG Spectrogram NN XGBoost AI Affective-computing Human computer interaction Emotion recognition |
| spellingShingle |
Emotion EEG Spectrogram NN XGBoost AI Affective-computing Human computer interaction Emotion recognition Esha, Ishraq Ahmed Rahman, Shahrin Chowdhury, Sayem Kader Mim, Jannatul Ferdous Multiclass emotion classification by using Spectrogram image analysis: A CNN-XGBoost fusion approach |
| description |
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2023. |
| author2 |
Rabiul Alam, Md. Golam |
| author_facet |
Rabiul Alam, Md. Golam Esha, Ishraq Ahmed Rahman, Shahrin Chowdhury, Sayem Kader Mim, Jannatul Ferdous |
| format |
Thesis |
| author |
Esha, Ishraq Ahmed Rahman, Shahrin Chowdhury, Sayem Kader Mim, Jannatul Ferdous |
| author_sort |
Esha, Ishraq Ahmed |
| title |
Multiclass emotion classification by using Spectrogram image analysis: A CNN-XGBoost fusion approach |
| title_short |
Multiclass emotion classification by using Spectrogram image analysis: A CNN-XGBoost fusion approach |
| title_full |
Multiclass emotion classification by using Spectrogram image analysis: A CNN-XGBoost fusion approach |
| title_fullStr |
Multiclass emotion classification by using Spectrogram image analysis: A CNN-XGBoost fusion approach |
| title_full_unstemmed |
Multiclass emotion classification by using Spectrogram image analysis: A CNN-XGBoost fusion approach |
| title_sort |
multiclass emotion classification by using spectrogram image analysis: a cnn-xgboost fusion approach |
| publisher |
Brac University |
| publishDate |
2023 |
| url |
http://hdl.handle.net/10361/19477 |
| work_keys_str_mv |
AT eshaishraqahmed multiclassemotionclassificationbyusingspectrogramimageanalysisacnnxgboostfusionapproach AT rahmanshahrin multiclassemotionclassificationbyusingspectrogramimageanalysisacnnxgboostfusionapproach AT chowdhurysayemkader multiclassemotionclassificationbyusingspectrogramimageanalysisacnnxgboostfusionapproach AT mimjannatulferdous multiclassemotionclassificationbyusingspectrogramimageanalysisacnnxgboostfusionapproach |
| _version_ |
1814307143632814080 |