Towards expressive instrument synthesis through smooth frame-by-frame reconstruction: From string to woodwind

Sanna Wager, Liang Chen, Minje Kim, Christopher Raphael

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We consider the task of mapping the performance of a musical excerpt on one instrument to another. Our focus is on excitation-continuous instruments, where pitch, amplitude, spectrum, and time envelope are controlled continuously by the player. The synthesized instrument should follow the target instrument's expressive gestures as much as possible, while also following its natural characteristics. We develop an objective function that balances distance of the synthesis to the target and smoothness in the spectral domain. An experiment mapping violin to bassoon playing by concatenating together short excerpts of audio from a database of solo bassoon recordings serves as an illustration.

Original languageEnglish (US)
Title of host publication2017 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2017 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages391-395
Number of pages5
ISBN (Electronic)9781509041176
DOIs
StatePublished - Jun 16 2017
Externally publishedYes
Event2017 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2017 - New Orleans, United States
Duration: Mar 5 2017Mar 9 2017

Publication series

NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
ISSN (Print)1520-6149

Other

Other2017 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2017
Country/TerritoryUnited States
CityNew Orleans
Period3/5/173/9/17

Keywords

  • Concatenative Sound Synthesis
  • Instrumental Synthesis

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Towards expressive instrument synthesis through smooth frame-by-frame reconstruction: From string to woodwind'. Together they form a unique fingerprint.

Cite this