Human similarity judgments: Implications for the design of formal evaluations

M. Cameron Jones, J. Stephen Downie, Andreas F. Ehmann

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents findings of a series of analyses of human similarity judgments from the Symbolic Melodic Similarity, and Audio Music Similarity tasks from the Music Information Retrieval Evaluation Exchange (MIREX) 2006. The categorical judgment data generated by the evaluators is analyzed with regard to judgment stability, inter-grader reliability, and patterns of disagreement, both within and between the two tasks. An exploration of this space yields implications for the design of MIREX-like evaluations.

Original languageEnglish (US)
Title of host publicationProceedings of the 8th International Conference on Music Information Retrieval, ISMIR 2007
Pages539-542
Number of pages4
StatePublished - 2007
Event8th International Conference on Music Information Retrieval, ISMIR 2007 - Vienna, Austria
Duration: Sep 23 2007Sep 27 2007

Publication series

NameProceedings of the 8th International Conference on Music Information Retrieval, ISMIR 2007

Other

Other8th International Conference on Music Information Retrieval, ISMIR 2007
Country/TerritoryAustria
CityVienna
Period9/23/079/27/07

ASJC Scopus subject areas

  • Music
  • Information Systems

Fingerprint

Dive into the research topics of 'Human similarity judgments: Implications for the design of formal evaluations'. Together they form a unique fingerprint.

Cite this