Comparison of different POS tagging techniques for some South Asian languages
This thesis report is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2006.
| Главный автор: | |
|---|---|
| Другие авторы: | |
| Формат: | Диссертация |
| Опубликовано: |
BRAC University
2010
|
| Предметы: | |
| Online-ссылка: | http://hdl.handle.net/10361/83 |
| id |
10361-83 |
|---|---|
| record_format |
dspace |
| spelling |
10361-832022-01-26T10:10:26Z Comparison of different POS tagging techniques for some South Asian languages Hasan, Fahim Muhammad Khan, Mumit UzZaman, Naushad Department of Computer Science and Engineering, BRAC University Computer science and engineering This thesis report is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2006. Cataloged from PDF version of thesis report. Includes bibliographical references (page 47). There are different approaches to the problem of assigning a part of speech (POS) tag to each word of a natural language sentence. We present a comparison of the different approaches of POS tagging for the Bangla language and two other South Asian languages, as well as the baseline performances of different POS tagging techniques for the English language. The most widely used methods for English are the statistical methods i.e. n-gram based tagging or Hidden Markov Model (HMM) based tagging, the rule based or transformation based methods i.e. Brill’s tagger. Subsequent researches add various modifications to these basic approaches to improve the performance of the taggers for English. Here, we present an elaborate review of previous work in the area with the focus on South Asian Languages such as Hindi and Bangla. We experiment with Brill’s transformation based tagger and the supervised HMM based tagger without modifications for added improvement in accuracy, on English using training corpora of different sizes from the Brown corpus. We also compare the performances of these taggers on three South Asian languages with the focus on Bangla using two different tagsets and corpora of different sizes, which reveals that Brill's transformation based tagger performs considerably well for South Asian languages. We also check the baseline performances of the taggers for English and try to conclude how these approaches might perform if we use a considerable amount of annotated training corpus. Fahim Muhammad Hasan B. Computer Science and Engineering 2010-09-16T07:14:09Z 2010-09-16T07:14:09Z 2006 2006-12 Thesis ID 03101057 http://hdl.handle.net/10361/83 BRAC University thesis are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. 63 pages application/pdf BRAC University |
| institution |
Brac University |
| collection |
Institutional Repository |
| topic |
Computer science and engineering |
| spellingShingle |
Computer science and engineering Hasan, Fahim Muhammad Comparison of different POS tagging techniques for some South Asian languages |
| description |
This thesis report is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2006. |
| author2 |
Khan, Mumit |
| author_facet |
Khan, Mumit Hasan, Fahim Muhammad |
| format |
Thesis |
| author |
Hasan, Fahim Muhammad |
| author_sort |
Hasan, Fahim Muhammad |
| title |
Comparison of different POS tagging techniques for some South Asian languages |
| title_short |
Comparison of different POS tagging techniques for some South Asian languages |
| title_full |
Comparison of different POS tagging techniques for some South Asian languages |
| title_fullStr |
Comparison of different POS tagging techniques for some South Asian languages |
| title_full_unstemmed |
Comparison of different POS tagging techniques for some South Asian languages |
| title_sort |
comparison of different pos tagging techniques for some south asian languages |
| publisher |
BRAC University |
| publishDate |
2010 |
| url |
http://hdl.handle.net/10361/83 |
| work_keys_str_mv |
AT hasanfahimmuhammad comparisonofdifferentpostaggingtechniquesforsomesouthasianlanguages |
| _version_ |
1814307771524317184 |