A study on part of speech tagging

Publish Year: 1390
نوع سند: مقاله کنفرانسی
زبان: English
View: 1,787

This Paper With 9 Page And PDF Format Ready To Download

  • Certificate
  • من نویسنده این مقاله هستم

استخراج به نرم افزارهای پژوهشی:

لینک ثابت به این Paper:

شناسه ملی سند علمی:

SASTECH05_159

تاریخ نمایه سازی: 22 مرداد 1391

Abstract:

Part of Speech (POS) tagging has high importance in the domain of Natural Language Processing (NLP). POS tagging determines grammatical category to any token, such as noun, verb, adjective, person, gender, etc. Some of the words are ambiguous in their categories and what tagging does is to clear of ambiguous word according to their context. Many taggers are designed with different approaches to reach high accuracy. In this paper we present a new tagging algorithm with a Hybrid algorithm. This algorithm combines the statistics and the rule based tagger to tag Persian unknown words. These algorithms use morphological and syntactical rules for tagging. These algorithms are applied in Gate package.This package has two parts in tagging; part of tokenization and part of tagging. Many problems depend on part of tokenization. Tokenization is detecting of tokens in a text. In this part, morphological analysis is very important and makes some problems in computational analysis. Persian morphological makes some problems in computational analysis. There is another case which causes some problems in tokenization and is called Persian script.In this paper, we elaborate some problems in Persian morphology in tokenization and Persian script.The purpose of this paper is to improve tagging and also to study problems in Gate package in tokenization part according to study of linguistics.After improving and studying of problems, this package was evaluated with two kinds of texts; standard and non standard texts. Accuracy of Gate package with the standard text and non standard text are 97 and 92%, respectively

Authors

N Jahangiri

Professor of linguistics Department, Mashhad, Iran

M Kahani

professor of computer Department, Mashhad, Iran

R Ahamdi

computational linguistics,Mashhad, Iran

M Sazvar

engineering, Mashhad, Iran

مراجع و منابع این Paper:

لیست زیر مراجع و منابع استفاده شده در این Paper را نمایش می دهد. این مراجع به صورت کاملا ماشینی و بر اساس هوش مصنوعی استخراج شده اند و لذا ممکن است دارای اشکالاتی باشند که به مرور زمان دقت استخراج این محتوا افزایش می یابد. مراجعی که مقالات مربوط به آنها در سیویلیکا نمایه شده و پیدا شده اند، به خود Paper لینک شده اند :
  • Aleahmad, A., & Ramezani, Y., & Oroumchian, F.(2008). Using OW ...
  • Amiri, H., & Raja, F., & Sarmadi, M., &Tasharofi, S., ...
  • Assi, M., & Haj iabdolho sseyni, M. (2000). Grammatical tagging ...
  • Azimzadeh, A., & Arab, M. (2007). The Persian morphological parser ...
  • Jabbari, S., & Ben, A. (2007). Pos tagging for Persian. ...
  • Katamba, F., & Stonham, J. (2006). Morphology. New York, NY: ...
  • Megerdo omian, K .(2004). Finite-state morphological analysis of Persian. Ih ...
  • Megerdo omian, K. (2004). Developing a Persian part-of-speech tagge. In ...
  • Meshkatodini, M. (2008). dasture zabane farsi: vajegan va peyvanhaye sakhti. ...
  • Mohseni, M., & Bidgoli, B. (2008). A Persian pos tagger ...
  • Quchani, S., & Azimzadeh, A., & Arab, M.(2008). _ conference ...
  • sAsTech 2011, Khavaran Higher-education Institute, Mashhad, Iran. May 12-14. ...
  • Raja, F., &, Amiri, H., &, Tasharofi, S, . & ...
  • Shamsfard, M., & Fadaee, H. (2008). A Hybrid Morphology - ...
  • S h arifi-Atashgah , M., & Bijankhan, M. (2009) .Corpus-based ...
  • نمایش کامل مراجع