Second fiddle is important too: Pitch tracking individual voices in polyphonic music

Mert Bay, Andreas F. Ehmann, James W. Beauchamp, Paris Smaragdis, J Stephen Downie

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recently, there has been much interest in automatic pitch estimation and note tracking of polyphonic music. To date, however, most techniques produce a representation where pitch estimates are not associated with any particular instrument or voice. Therefore, the actual tracks for each instrument are not readily accessible. Access to individual tracks is needed for more complete music transcription and additionally will provide a window to the analysis of higher constructs such as counterpoint and instrument theme imitation during a composition. In this paper, we present a method for tracking the pitches (F0s) of individual instruments in polyphonic music. The system uses a pre-learned dictionary of spectral basis vectors for each note for a variety of musical instruments. The method then formulates the tracking of pitches of individual voices in a probabilistic manner by attempting to explain the input spectrum as the most likely combination of musical instruments and notes drawn from the dictionary. The method has been evaluated on a subset of the MIREX multiple-F0 estimation test dataset, showing promising results.

Original languageEnglish (US)
Title of host publicationProceedings of the 13th International Society for Music Information Retrieval Conference, ISMIR 2012
Pages319-324
Number of pages6
StatePublished - Dec 1 2012
Event13th International Society for Music Information Retrieval Conference, ISMIR 2012 - Porto, Portugal
Duration: Oct 8 2012Oct 12 2012

Publication series

NameProceedings of the 13th International Society for Music Information Retrieval Conference, ISMIR 2012

Other

Other13th International Society for Music Information Retrieval Conference, ISMIR 2012
CountryPortugal
CityPorto
Period10/8/1210/12/12

ASJC Scopus subject areas

  • Music
  • Information Systems

Fingerprint Dive into the research topics of 'Second fiddle is important too: Pitch tracking individual voices in polyphonic music'. Together they form a unique fingerprint.

  • Cite this

    Bay, M., Ehmann, A. F., Beauchamp, J. W., Smaragdis, P., & Downie, J. S. (2012). Second fiddle is important too: Pitch tracking individual voices in polyphonic music. In Proceedings of the 13th International Society for Music Information Retrieval Conference, ISMIR 2012 (pp. 319-324). (Proceedings of the 13th International Society for Music Information Retrieval Conference, ISMIR 2012).