The music information retrieval evaluation exchange (2005-2007): A window into music information retrieval research

Research output: Contribution to journalReview articlepeer-review


The Music Information Retrieval Evaluation eXchange (MIREX) is the community-based framework for the formal evaluation of Music Information Retrieval (MIR) systems and algorithms. By looking at the background, structure, challenges, and contributions of MIREX this paper provides some insights into the world of MIR research. Because MIREX tasks are defined by the community they reflect the interests, techniques, and research paradigms of the community as a whole. Both MIREX and MIR have a strong bias toward audio-based approaches as most MIR researchers have strengths in signal processing. Spectral-based approaches to MIR tasks have led to advancements in the MIR field but they now appear to be reaching their limits of effectiveness. This limitation is called the "glass ceiling" problem and the MIREX results data support its existence. The post-hoc analyses of MIREX results data indicate that there are groups of systems that perform equally well within various MIR tasks. There are many challenges facing MIREX and MIR research most of which have their root causes in the intellectual property issues surrounding music. The current inability of researchers to test their approaches against the MIREX test collections outside the annual MIREX cycle is hindering the rapid development of improved MIR systems.

Original languageEnglish (US)
Pages (from-to)247-255
Number of pages9
JournalAcoustical Science and Technology
Issue number4
StatePublished - 2008


  • Evaluation
  • Music information retrieval

ASJC Scopus subject areas

  • Acoustics and Ultrasonics


Dive into the research topics of 'The music information retrieval evaluation exchange (2005-2007): A window into music information retrieval research'. Together they form a unique fingerprint.

Cite this