Web Domains Ranking with Real User Traffic Based on the Big Data Platform

Disseminating information through the World Wide Web as the most popular medium has resulted in creating a huge number of web pages and so growing the dimension of the web. In this era of big data, an efficient website ranking to satisfy the web user requirements in different areas such as marketing and E-commerce is a major challenge in the current Internet. In this context, the role of ranking algorithms as a tool to provide services such as measuring the website visibility and comparing the website position to the competitors is crucial. In this paper, we propose an architecture for web domain ranking which includes processing capability required for handling Big Data available on the web. The proposed architecture presents a new method for web domain ranking that is independent of the link structure of the web graph. The proposed method provides web domain ranking based on the number of unique visitors, the number of user sessions, and session duration.

Keywords:

Web domain ranking , Web domain importance metric , Web traffic , Traffic analysis component , Big data