Multi-version music search using acoustic feature union and exact soft mapping

Yi Yu, Kazuki Joe, Vincent Oria, Fabian Moerchen, J. Stephen Downie, L. E.I. Chen

Research output: Contribution to journalArticlepeer-review


Research on audio-based music retrieval has primarily concentrated on refining audio features to improve search quality. However, much less work has been done on improving the time efficiency of music audio searches. Representing music audio documents in an indexable format provides a mechanism for achieving efficiency. To address this issue, in this work Exact Locality Sensitive Mapping (ELSM) is suggested to join the concatenated feature sets and soft hash values. On this basis we propose audio-based music indexing techniques, ELSM and Soft Locality Sensitive Hash (SoftLSH) using an optimized Feature Union (FU) set of extracted audio features. Two contributions are made here. First, the principle of similarity-invariance is applied in summarizing audio feature sequences and utilized in training semantic audio representations based on regression. Second, soft hash values are pre-calculated to help locate the searching range more accurately and improve collision probability among features similar to each other. Our algorithms are implemented in a demonstration system to show how to retrieve and evaluate multi-version audio documents. Experimental evaluation over a real "multi-version" audio dataset confirms the practicality of ELSM and SoftLSH with FU and proves that our algorithms are effective for both multi-version detection (online query, one-query vs. multi-object) and same content detection (batch queries, multi-queries vs. one-object).

Original languageEnglish (US)
Pages (from-to)209-234
Number of pages26
JournalInternational Journal of Semantic Computing
Issue number2
StatePublished - Jun 1 2009


  • Query-by-audio
  • exact locality sensitive mapping/hashing
  • feature union
  • music information retrieval
  • musical audio sequence summarization

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Linguistics and Language
  • Computer Science Applications
  • Computer Networks and Communications
  • Artificial Intelligence


Dive into the research topics of 'Multi-version music search using acoustic feature union and exact soft mapping'. Together they form a unique fingerprint.

Cite this