Detecting splogs via temporal dynamics using self-similarity analysis

Yu Ru Lin, Hari Sundaram, Yun Chi, Junichi Tatemura, Belle L. Tseng

Research output: Contribution to journalArticlepeer-review

Abstract

This article addresses the problem of spam blog (splog) detection using temporal and structural regularity of content, post time and links. Splogs are undesirable blogs meant to attract search engine traffic, used solely for promoting affiliate sites. Blogs represent popular online media, and splogs not only degrade the quality of search engine results, but also waste network resources. The splog detection problem is made difficult due to the lack of stable content descriptors. We have developed a new technique for detecting splogs, based on the observation that a blog is a dynamic, growing sequence of entries (or posts) rather than a collection of individual pages. In our approach, splogs are recognized by their temporal characteristics and content. There are three key ideas in our splog detection framework. (a) We represent the blog temporal dynamics using self-similarity matrices defined on the histogram intersection similarity measure of the time, content, and link attributes of posts, to investigate the temporal changes of the post sequence. (b) We study the blog temporal characteristics using a visual representation derived from the self-similarity measures. The visual signature reveals correlation between attributes and posts, depending on the type of blogs (normal blogs and splogs). (c) We propose two types of novel temporal features to capture the splog temporal characteristics. In our splog detector, these novel features are combined with content based features. We extract a content based feature vector from blog home pages as well as from different parts of the blog. The dimensionality of the feature vector is reduced by Fisher linear discriminant analysis. We have tested an SVM-based splog detector using proposed features on real world datasets, with appreciable results (90% accuracy).

Original languageEnglish (US)
Article number4
JournalACM Transactions on the Web
Volume2
Issue number1
DOIs
StatePublished - Feb 1 2008
Externally publishedYes

Keywords

  • Blogs
  • Regularity
  • Self-similarity
  • Spam
  • Splog detection
  • Temporal dynamics
  • Topology

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Detecting splogs via temporal dynamics using self-similarity analysis'. Together they form a unique fingerprint.

Cite this