Overview of the Tenth Dialog System Technology Challenge: DSTC10

Koichiro Yoshino; Yun Nung Chen; Paul Crook; Satwik Kottur; Jinchao Li; Behnam Hedayatnia; Seungwhan Moon; Zhengcong Fei; Zekang Li; Jinchao Zhang; Yang Feng; Jie Zhou; Seokhwan Kim; Yang Liu; Di Jin; Alexandros Papangelis; Karthik Gopalakrishnan; Dilek Hakkani-Tur; Babak Damavandi; Alborz Geramifard; Chiori Hori; Ankit Shah; Chen Zhang; Haizhou Li; Joao Sedoc; Luis F. D'haro; Rafael Banchs; Alexander Rudnicky

doi:10.1109/TASLP.2023.3293030

Overview of the Tenth Dialog System Technology Challenge: DSTC10

Koichiro Yoshino, Yun Nung Chen, Paul Crook, Satwik Kottur, Jinchao Li, Behnam Hedayatnia, Seungwhan Moon, Zhengcong Fei, Zekang Li, Jinchao Zhang, Yang Feng, Jie Zhou, Seokhwan Kim, Yang Liu, Di Jin, Alexandros Papangelis, Karthik Gopalakrishnan, Dilek Hakkani-Tur, Babak Damavandi, Alborz GeramifardChiori Hori, Ankit Shah, Chen Zhang, Haizhou Li, Joao Sedoc, Luis F. D'haro, Rafael Banchs, Alexander Rudnicky

Research output: Contribution to journal › Article › peer-review

Abstract

This article introduces the Tenth Dialog System Technology Challenge (DSTC-10). This edition of the DSTC focuses on applying end-to-end dialog technologies for five distinct tasks in dialog systems, namely 1. Incorporation of Meme images into open domain dialogs, 2. Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations, 3. Situated Interactive Multimodal dialogs, 4. Reasoning for Audio Visual Scene-Aware Dialog, and 5. Automatic Evaluation and Moderation of Open-domainDialogue Systems. This article describes the task definition, provided datasets, baselines, and evaluation setup for each track. We also summarize the results of the submitted systems to highlight the general trends of the state-of-the-art technologies for the tasks.

Original language	English (US)
Pages (from-to)	765-778
Number of pages	14
Journal	IEEE/ACM Transactions on Audio Speech and Language Processing
Volume	32
DOIs	https://doi.org/10.1109/TASLP.2023.3293030
State	Published - 2024
Externally published	Yes

Keywords

Dialog systems
multimodal sensors
natural language processing
speech processing

ASJC Scopus subject areas

Computer Science (miscellaneous)
Acoustics and Ultrasonics
Computational Mathematics
Electrical and Electronic Engineering

Online availability

10.1109/TASLP.2023.3293030

Library availability

Discover UIUC Full Text

Cite this

Yoshino, K., Chen, Y. N., Crook, P., Kottur, S., Li, J., Hedayatnia, B., Moon, S., Fei, Z., Li, Z., Zhang, J., Feng, Y., Zhou, J., Kim, S., Liu, Y., Jin, D., Papangelis, A., Gopalakrishnan, K., Hakkani-Tur, D., Damavandi, B., ... Rudnicky, A. (2024). Overview of the Tenth Dialog System Technology Challenge: DSTC10. IEEE/ACM Transactions on Audio Speech and Language Processing, 32, 765-778. https://doi.org/10.1109/TASLP.2023.3293030

Yoshino, K, Chen, YN, Crook, P, Kottur, S, Li, J, Hedayatnia, B, Moon, S, Fei, Z, Li, Z, Zhang, J, Feng, Y, Zhou, J, Kim, S, Liu, Y, Jin, D, Papangelis, A, Gopalakrishnan, K, Hakkani-Tur, D, Damavandi, B, Geramifard, A, Hori, C, Shah, A, Zhang, C, Li, H, Sedoc, J, D'haro, LF, Banchs, R & Rudnicky, A 2024, 'Overview of the Tenth Dialog System Technology Challenge: DSTC10', IEEE/ACM Transactions on Audio Speech and Language Processing, vol. 32, pp. 765-778. https://doi.org/10.1109/TASLP.2023.3293030

@article{fa0d65a0daf84221a6956684e8f9d4dd,

title = "Overview of the Tenth Dialog System Technology Challenge: DSTC10",

abstract = "This article introduces the Tenth Dialog System Technology Challenge (DSTC-10). This edition of the DSTC focuses on applying end-to-end dialog technologies for five distinct tasks in dialog systems, namely 1. Incorporation of Meme images into open domain dialogs, 2. Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations, 3. Situated Interactive Multimodal dialogs, 4. Reasoning for Audio Visual Scene-Aware Dialog, and 5. Automatic Evaluation and Moderation of Open-domainDialogue Systems. This article describes the task definition, provided datasets, baselines, and evaluation setup for each track. We also summarize the results of the submitted systems to highlight the general trends of the state-of-the-art technologies for the tasks.",

keywords = "Dialog systems, multimodal sensors, natural language processing, speech processing",

author = "Koichiro Yoshino and Chen, {Yun Nung} and Paul Crook and Satwik Kottur and Jinchao Li and Behnam Hedayatnia and Seungwhan Moon and Zhengcong Fei and Zekang Li and Jinchao Zhang and Yang Feng and Jie Zhou and Seokhwan Kim and Yang Liu and Di Jin and Alexandros Papangelis and Karthik Gopalakrishnan and Dilek Hakkani-Tur and Babak Damavandi and Alborz Geramifard and Chiori Hori and Ankit Shah and Chen Zhang and Haizhou Li and Joao Sedoc and D'haro, {Luis F.} and Rafael Banchs and Alexander Rudnicky",

note = "Publisher Copyright: {\textcopyright} 2023 The Authors.",

year = "2024",

doi = "10.1109/TASLP.2023.3293030",

language = "English (US)",

volume = "32",

pages = "765--778",

journal = "IEEE/ACM Transactions on Audio Speech and Language Processing",

issn = "2329-9290",

publisher = "IEEE Advancing Technology for Humanity",

}

TY - JOUR

T1 - Overview of the Tenth Dialog System Technology Challenge

T2 - DSTC10

AU - Yoshino, Koichiro

AU - Chen, Yun Nung

AU - Crook, Paul

AU - Kottur, Satwik

AU - Li, Jinchao

AU - Hedayatnia, Behnam

AU - Moon, Seungwhan

AU - Fei, Zhengcong

AU - Li, Zekang

AU - Zhang, Jinchao

AU - Feng, Yang

AU - Zhou, Jie

AU - Kim, Seokhwan

AU - Liu, Yang

AU - Jin, Di

AU - Papangelis, Alexandros

AU - Gopalakrishnan, Karthik

AU - Hakkani-Tur, Dilek

AU - Damavandi, Babak

AU - Geramifard, Alborz

AU - Hori, Chiori

AU - Shah, Ankit

AU - Zhang, Chen

AU - Li, Haizhou

AU - Sedoc, Joao

AU - D'haro, Luis F.

AU - Banchs, Rafael

AU - Rudnicky, Alexander

PY - 2024

Y1 - 2024

N2 - This article introduces the Tenth Dialog System Technology Challenge (DSTC-10). This edition of the DSTC focuses on applying end-to-end dialog technologies for five distinct tasks in dialog systems, namely 1. Incorporation of Meme images into open domain dialogs, 2. Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations, 3. Situated Interactive Multimodal dialogs, 4. Reasoning for Audio Visual Scene-Aware Dialog, and 5. Automatic Evaluation and Moderation of Open-domainDialogue Systems. This article describes the task definition, provided datasets, baselines, and evaluation setup for each track. We also summarize the results of the submitted systems to highlight the general trends of the state-of-the-art technologies for the tasks.

AB - This article introduces the Tenth Dialog System Technology Challenge (DSTC-10). This edition of the DSTC focuses on applying end-to-end dialog technologies for five distinct tasks in dialog systems, namely 1. Incorporation of Meme images into open domain dialogs, 2. Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations, 3. Situated Interactive Multimodal dialogs, 4. Reasoning for Audio Visual Scene-Aware Dialog, and 5. Automatic Evaluation and Moderation of Open-domainDialogue Systems. This article describes the task definition, provided datasets, baselines, and evaluation setup for each track. We also summarize the results of the submitted systems to highlight the general trends of the state-of-the-art technologies for the tasks.

KW - Dialog systems

KW - multimodal sensors

KW - natural language processing

KW - speech processing

UR - http://www.scopus.com/inward/record.url?scp=85164398846&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85164398846&partnerID=8YFLogxK

U2 - 10.1109/TASLP.2023.3293030

DO - 10.1109/TASLP.2023.3293030

M3 - Article

AN - SCOPUS:85164398846

SN - 2329-9290

VL - 32

SP - 765

EP - 778

JO - IEEE/ACM Transactions on Audio Speech and Language Processing

JF - IEEE/ACM Transactions on Audio Speech and Language Processing

ER -

Overview of the Tenth Dialog System Technology Challenge: DSTC10

Abstract

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this