The classification power of web features

Miklós Erdélyi, András A. Benczúr, Bálint Daróczy, András Garzó, Tamás Kis, Dávid Siklósi

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

In this article we give a comprehensive overview of features devised for web spam detection and investigate how much various classes, some requiring very high computational effort, add to the classification accuracy. We collect and handle a large number of features based on recent advances in web spam filtering, including temporal ones; in particular, we analyze the strength and sensitivity of linkage change. We propose new, temporal link-similarity-based features and show how to compute them efficiently on large graphs. We show that machine learning techniques, including ensemble selection, Logit- Boost, and random forest significantly improve accuracy. We conclude that, with appropriate learning techniques, a simple and computationally inexpensive feature subset outperforms all previous results published so far on our dataset and can be further improved only slightly by computationally expensive features. We test our method on three major publicly available datasets: the Web Spam Challenge 2008 dataset WEBSPAM-UK2007, the ECML/PKDD Discovery Challenge dataset DC2010, and the Waterloo Spam Rankings for ClueWeb09. Our classifier ensemble sets the strongest classification benchmark compared to participants of the Web Spam and ECML/PKDD Discovery Challenges as well as the TREC Web track. To foster research in the area, we make several feature sets and source codes public,1 including the temporal features of eight.uk crawl snapshots that include WEBSPAMUK2007 as well as the Web Spam Challenge features for the labeled part of ClueWeb09.

Original languageEnglish
Pages (from-to)421-457
Number of pages37
JournalInternet Mathematics
Volume10
Issue number3-4
DOIs
Publication statusPublished - Jan 1 2014

ASJC Scopus subject areas

  • Modelling and Simulation
  • Computational Mathematics
  • Applied Mathematics

Fingerprint Dive into the research topics of 'The classification power of web features'. Together they form a unique fingerprint.

  • Cite this

    Erdélyi, M., Benczúr, A. A., Daróczy, B., Garzó, A., Kis, T., & Siklósi, D. (2014). The classification power of web features. Internet Mathematics, 10(3-4), 421-457. https://doi.org/10.1080/15427951.2013.850456