Re-examination of interestingness measures in pattern mining: A unified framework

Research output: Contribution to journalArticlepeer-review

Abstract

Numerous interestingness measures have been proposed in statistics and data mining to assess object relationships. This is especially important in recent studies of association or correlation pattern mining. However, it is still not clear whether there is any intrinsic relationship among many proposed measures, and which one is truly effective at gauging object relationships in large data sets. Recent studies have identified a critical property, null-(transaction) invariance, for measuring associations among events in large data sets, but many measures do not have this property. In this study, we re-examine a set of null-invariant interestingnessmeasures and find that they can be expressed as the generalized mathematical mean, leading to a total ordering of them. Such a unified framework provides insights into the underlying philosophy of the measures and helps us understand and select the proper measure for different applications. Moreover, we propose a new measure called Imbalance Ratio to gauge the degree of skewness of a data set. We also discuss the efficient computation of interesting patterns of different null-invariant interestingness measures by proposing an algorithm, GAMiner, which complements previous studies. Experimental evaluation verifies the effectiveness of the unified framework and shows that GAMiner speeds up the state-of-the-art algorithm by an order of magnitude.

Original languageEnglish (US)
Pages (from-to)371-397
Number of pages27
JournalData Mining and Knowledge Discovery
Volume21
Issue number3
DOIs
StatePublished - Nov 2010

Keywords

  • Association rules
  • Frequent pattern
  • Generalized mean
  • Interestingness measure
  • Null-invariant measure

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Re-examination of interestingness measures in pattern mining: A unified framework'. Together they form a unique fingerprint.

Cite this