Comparison of measures of speech quality for listening tests of text-to-speech systems

M. Viswanathan; M. Viswanathan

doi:10.1109/WSS.2002.1224361

Comparison of measures of speech quality for listening tests of text-to-speech systems

M. Viswanathan
, M. Viswanathan

Business Administration

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Text-to-speech system improvements are best assessed by periodic listening tests. The paper reports on the results of two listening test methodologies: measurement of perceptions of speech quality using a single-item scale and a nine-item scale. The tests engender two important conclusions. First, TTS systems, as well as individual synthesized sentences used to test the system, are factors that affect a listener's perception. Second, the single-item scale can be a reliable and valid substitute for the nine-item scale with appropriate empirical justification when pragmatic considerations such as respondent fatigue necessitate the use of a shorter scale.

Original language	English (US)
Title of host publication	Proceedings of 2002 IEEE Workshop on Speech Synthesis
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	11-14
Number of pages	4
ISBN (Electronic)	0780373952, 9780780373952
DOIs	https://doi.org/10.1109/WSS.2002.1224361
State	Published - 2002
Event	2002 IEEE Workshop on Speech Synthesis - Santa Monica, United States Duration: Sep 11 2002 → Sep 13 2002

Publication series

Name	Proceedings of 2002 IEEE Workshop on Speech Synthesis

Other

Other	2002 IEEE Workshop on Speech Synthesis
Country/Territory	United States
City	Santa Monica
Period	9/11/02 → 9/13/02

ASJC Scopus subject areas

Language and Linguistics
Cultural Studies

Online availability

10.1109/WSS.2002.1224361

Library availability

Discover UIUC Full Text

Cite this

Viswanathan, M., & Viswanathan, M. (2002). Comparison of measures of speech quality for listening tests of text-to-speech systems. In Proceedings of 2002 IEEE Workshop on Speech Synthesis (pp. 11-14). Article 1224361 (Proceedings of 2002 IEEE Workshop on Speech Synthesis). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WSS.2002.1224361

Comparison of measures of speech quality for listening tests of text-to-speech systems. / Viswanathan, M.; Viswanathan, M.
Proceedings of 2002 IEEE Workshop on Speech Synthesis. Institute of Electrical and Electronics Engineers Inc., 2002. p. 11-14 1224361 (Proceedings of 2002 IEEE Workshop on Speech Synthesis).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Viswanathan, M & Viswanathan, M 2002, Comparison of measures of speech quality for listening tests of text-to-speech systems. in Proceedings of 2002 IEEE Workshop on Speech Synthesis., 1224361, Proceedings of 2002 IEEE Workshop on Speech Synthesis, Institute of Electrical and Electronics Engineers Inc., pp. 11-14, 2002 IEEE Workshop on Speech Synthesis, Santa Monica, United States, 9/11/02. https://doi.org/10.1109/WSS.2002.1224361

@inproceedings{18717e5b63e4489887d329554a3a9b75,

title = "Comparison of measures of speech quality for listening tests of text-to-speech systems",

abstract = "Text-to-speech system improvements are best assessed by periodic listening tests. The paper reports on the results of two listening test methodologies: measurement of perceptions of speech quality using a single-item scale and a nine-item scale. The tests engender two important conclusions. First, TTS systems, as well as individual synthesized sentences used to test the system, are factors that affect a listener's perception. Second, the single-item scale can be a reliable and valid substitute for the nine-item scale with appropriate empirical justification when pragmatic considerations such as respondent fatigue necessitate the use of a shorter scale.",

author = "M. Viswanathan and M. Viswanathan",

note = "Publisher Copyright: {\textcopyright} 2002 IEEE.; 2002 IEEE Workshop on Speech Synthesis ; Conference date: 11-09-2002 Through 13-09-2002",

year = "2002",

doi = "10.1109/WSS.2002.1224361",

language = "English (US)",

series = "Proceedings of 2002 IEEE Workshop on Speech Synthesis",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "11--14",

booktitle = "Proceedings of 2002 IEEE Workshop on Speech Synthesis",

address = "United States",

}

TY - GEN

T1 - Comparison of measures of speech quality for listening tests of text-to-speech systems

AU - Viswanathan, M.

PY - 2002

Y1 - 2002

N2 - Text-to-speech system improvements are best assessed by periodic listening tests. The paper reports on the results of two listening test methodologies: measurement of perceptions of speech quality using a single-item scale and a nine-item scale. The tests engender two important conclusions. First, TTS systems, as well as individual synthesized sentences used to test the system, are factors that affect a listener's perception. Second, the single-item scale can be a reliable and valid substitute for the nine-item scale with appropriate empirical justification when pragmatic considerations such as respondent fatigue necessitate the use of a shorter scale.

AB - Text-to-speech system improvements are best assessed by periodic listening tests. The paper reports on the results of two listening test methodologies: measurement of perceptions of speech quality using a single-item scale and a nine-item scale. The tests engender two important conclusions. First, TTS systems, as well as individual synthesized sentences used to test the system, are factors that affect a listener's perception. Second, the single-item scale can be a reliable and valid substitute for the nine-item scale with appropriate empirical justification when pragmatic considerations such as respondent fatigue necessitate the use of a shorter scale.

UR - https://www.scopus.com/pages/publications/84966392165

UR - https://www.scopus.com/pages/publications/84966392165#tab=citedBy

U2 - 10.1109/WSS.2002.1224361

DO - 10.1109/WSS.2002.1224361

M3 - Conference contribution

AN - SCOPUS:84966392165

T3 - Proceedings of 2002 IEEE Workshop on Speech Synthesis

SP - 11

EP - 14

BT - Proceedings of 2002 IEEE Workshop on Speech Synthesis

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2002 IEEE Workshop on Speech Synthesis

Y2 - 11 September 2002 through 13 September 2002

ER -

Comparison of measures of speech quality for listening tests of text-to-speech systems

Abstract

Publication series

Other

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this