PersianWord Sense Disambiguation Corpus Extraction Based onWeb CrawlerMethod

Finding an appropriate dataset for natural language processing applications is one of the main challenges for researches of this field. This issue is more problematic in Non-Latin languagesespecially Persian language. Access to an appropriate dataset that can be used in development of practical programs in languageprocessing field, helps us to validate the obtained results and provide the feasibility for comparison and precise analysis of theresearch studies in this field. This paper presents the procedure for extracting a standard dataset in Persian language. This datasetcan only be used for research studies in the field of word-sensedisambiguation in Persian language. The required documents that include the ambiguous words of interest are collected by acrawling robot; then these words are processed and registered in Persian dataset for ambiguous words. In this research, threeprevalent Persian ambiguous word are used for extracting appropriate phrases that included these words. Finally, aframework for creating the proper configuration for applicationin word-sense disambiguation problems is presented. By using of this method, we have a solution for absence of suitable word sense disambiguation corpus in Persian language

PersianWord Sense Disambiguation Corpus Extraction Based onWeb CrawlerMethod Keywords:

Natural language processing , Word sense disambiguation , Information Extraction , Corpus , Machine learning