AWS: Automatic Webpage Segmentation
Publish place: The Second International Conference on Web research
Publish Year: 1395
نوع سند: مقاله کنفرانسی
زبان: English
View: 755
- Certificate
- من نویسنده این مقاله هستم
استخراج به نرم افزارهای پژوهشی:
شناسه ملی سند علمی:
IRANWEB02_032
تاریخ نمایه سازی: 9 مرداد 1395
Abstract:
a webpage contains many blocks of data, which can be informative or non-informative. In content extraction methods, informative data such as page title, headlines, news article and post body are distinguished from non-informative data such as advertisement, sidebar and navigational menus. The content extraction tasks have many difficulties because of the variety structure of webpages. In this paper, we proposed a content extraction method named Automatic Webpage Segmentation, AWS, which classifies the main content of a given webpage using a feature set consisting of structural and shallow text features. We benefit DOM tree of webpages for feature extraction. The obtained results are promising due to the effectiveness of proposed method to classify individual text elements of a webpage. Besides, feature selection methods such as wrapper and filter are utilized to improve performance of AWS.
Keywords:
Authors
Mohammad Mehdi Yadollahi
Social Networks Lab., Faculty of Electrical and Computer Engineering, University of Tehran, Tehran, Iran
Masoud Asadpour
Social Networks Lab., Faculty of Electrical and ComputerEngineering, University of Tehran, Tehran, Iran