A new model for persian multi-part words edition based on statistical machine translation
Publish Year: 1395
نوع سند: مقاله ژورنالی
زبان: English
View: 350
This Paper With 8 Page And PDF Format Ready To Download
- Certificate
- من نویسنده این مقاله هستم
استخراج به نرم افزارهای پژوهشی:
شناسه ملی سند علمی:
JR_JADM-4-1_004
تاریخ نمایه سازی: 19 تیر 1398
Abstract:
Multi-part words in English language are hyphenated and hyphen is used to separate different parts. Persian language consists of multi-part words as well. Based on Persian morphology, half-space character is needed to separate parts of multi-part words where in many cases people incorrectly use space character instead of half-space character. This common incorrectly use of space leads to some serious issues in Persian text processing and text readability. In order to cope with the issues, this work proposes a new model to correct spacing in multi-part words. The proposed method is based on statistical machine translation paradigm. In machine translation paradigm, text in source language is translated into a text in destination language on the basis of statistical models whose parameters are derived from the analysis of bilingual text corpora. The proposed method uses statistical machine translation techniques considering unedited multi-part words as a source language and the space-edited multi-part words as a destination language. The results show that the proposed method can edit and improve spacing correction process of Persian multi-part words with a statistically significant accuracy rate.
Keywords:
Authors
M. Zahedi
School of Computer Engineering & Information Technology, University of Shahrood, Shahrood,Iran.
A. Arjomandzadeh
School of Computer Engineering & Information Technology, University of Shahrood, Shahrood,Iran.