A Survey on Distributed Web Crawler Assignment Techniques

Publish Year: 1394
نوع سند: مقاله کنفرانسی
زبان: English
View: 657

This Paper With 11 Page And PDF Format Ready To Download

  • Certificate
  • من نویسنده این مقاله هستم

استخراج به نرم افزارهای پژوهشی:

لینک ثابت به این Paper:

شناسه ملی سند علمی:

ICESCON02_013

تاریخ نمایه سازی: 16 شهریور 1395

Abstract:

In this paper, we study the techniques of assigning objectives to distributed web crawlers and evaluate their strengths and weaknesses. Considering the fact that the Internet is growing, it is better to use parallel methods in crawling the web. In this paper, we study methods of assigning to distributed crawlers, after which we choose one of them as future research works

Keywords:

distributed web crawler , methods of assigning to distributed crawlers , search engines , web crawler

Authors

Masoud Vahidi

University of Tehran, Kish campus, Iran

Amir Minbashi

Islamic Azad University, Qazvin Branch, Iran

Mehrdad Masoumi

Islamic Azad University, Qazvin Branch, Iran

Sepideh Kolahdooz

University of Tehran, Kish campus, Iran