Team ELISA system for DARPA LORELEI speech evaluation 2016

Pavlos Papadopoulos; Ruchir Travadi; Colin Vaz; Nikolaos Malandrakis; Ulf Hermjakob; Nima Pourdamghani; Michael Pust; Boliang Zhang; Xiaoman Pan; Di Lu; Ying Lin; Ondřej Glembek; Murali Karthick Baskar; Martin Karafiát; Lukáš Burget; Mark Hasegawa-Johnson; Heng Ji; Jonathan May; Kevin Knight; Shrikanth Narayanan

doi:10.21437/Interspeech.2017-180

Team ELISA system for DARPA LORELEI speech evaluation 2016

Pavlos Papadopoulos, Ruchir Travadi, Colin Vaz, Nikolaos Malandrakis, Ulf Hermjakob, Nima Pourdamghani, Michael Pust, Boliang Zhang, Xiaoman Pan, Di Lu, Ying Lin, Ondřej Glembek, Murali Karthick Baskar, Martin Karafiát, Lukáš Burget, Mark Hasegawa-Johnson, Heng Ji, Jonathan May, Kevin Knight, Shrikanth Narayanan

Research output: Contribution to journal › Conference article › peer-review

Abstract

In this paper, we describe the system designed and developed by team ELISA for DARPA's LORELEI (Low Resource Languages for Emergent Incidents) pilot speech evaluation. The goal of the LORELEI program is to guide rapid resource deployment for humanitarian relief (e.g. for natural disasters), with a focus on "low-resource" language locations, where the cost of developing technologies for automated human language tools can be prohibitive both in monetary terms and timewise. In this phase of the program, the speech evaluation consisted of three separate tasks: detecting presence of an incident, classifying incident type, and classifying incident type along with identifying the location where it occurs. The performance metric was area under curve of precision-recall curves. Team ELISA competed against five other teams and won all the subtasks.

Original language	English (US)
Pages (from-to)	2053-2057
Number of pages	5
Journal	Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Volume	2017-August
DOIs	https://doi.org/10.21437/Interspeech.2017-180
State	Published - 2017
Event	18th Annual Conference of the International Speech Communication Association, INTERSPEECH 2017 - Stockholm, Sweden Duration: Aug 20 2017 → Aug 24 2017

ASJC Scopus subject areas

Language and Linguistics
Human-Computer Interaction
Signal Processing
Software
Modeling and Simulation

Online availability

10.21437/Interspeech.2017-180

Library availability

Discover UIUC Full Text

Cite this

Papadopoulos, P., Travadi, R., Vaz, C., Malandrakis, N., Hermjakob, U., Pourdamghani, N., Pust, M., Zhang, B., Pan, X., Lu, D., Lin, Y., Glembek, O., Baskar, M. K., Karafiát, M., Burget, L., Hasegawa-Johnson, M., Ji, H., May, J., Knight, K., & Narayanan, S. (2017). Team ELISA system for DARPA LORELEI speech evaluation 2016. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2017-August, 2053-2057. https://doi.org/10.21437/Interspeech.2017-180

Papadopoulos, P, Travadi, R, Vaz, C, Malandrakis, N, Hermjakob, U, Pourdamghani, N, Pust, M, Zhang, B, Pan, X, Lu, D, Lin, Y, Glembek, O, Baskar, MK, Karafiát, M, Burget, L, Hasegawa-Johnson, M , Ji, H, May, J, Knight, K & Narayanan, S 2017, 'Team ELISA system for DARPA LORELEI speech evaluation 2016', Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, vol. 2017-August, pp. 2053-2057. https://doi.org/10.21437/Interspeech.2017-180

@article{fb845719bed846ae8c6a5e90c990ed0d,

title = "Team ELISA system for DARPA LORELEI speech evaluation 2016",

abstract = "In this paper, we describe the system designed and developed by team ELISA for DARPA's LORELEI (Low Resource Languages for Emergent Incidents) pilot speech evaluation. The goal of the LORELEI program is to guide rapid resource deployment for humanitarian relief (e.g. for natural disasters), with a focus on {"}low-resource{"} language locations, where the cost of developing technologies for automated human language tools can be prohibitive both in monetary terms and timewise. In this phase of the program, the speech evaluation consisted of three separate tasks: detecting presence of an incident, classifying incident type, and classifying incident type along with identifying the location where it occurs. The performance metric was area under curve of precision-recall curves. Team ELISA competed against five other teams and won all the subtasks.",

author = "Pavlos Papadopoulos and Ruchir Travadi and Colin Vaz and Nikolaos Malandrakis and Ulf Hermjakob and Nima Pourdamghani and Michael Pust and Boliang Zhang and Xiaoman Pan and Di Lu and Ying Lin and Ond{\v r}ej Glembek and Baskar, {Murali Karthick} and Martin Karafi{\'a}t and Luk{\'a}{\v s} Burget and Mark Hasegawa-Johnson and Heng Ji and Jonathan May and Kevin Knight and Shrikanth Narayanan",

note = "Publisher Copyright: Copyright {\textcopyright} 2017 ISCA.; 18th Annual Conference of the International Speech Communication Association, INTERSPEECH 2017 ; Conference date: 20-08-2017 Through 24-08-2017",

year = "2017",

doi = "10.21437/Interspeech.2017-180",

language = "English (US)",

volume = "2017-August",

pages = "2053--2057",

journal = "Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH",

issn = "2308-457X",

}

TY - JOUR

T1 - Team ELISA system for DARPA LORELEI speech evaluation 2016

AU - Papadopoulos, Pavlos

AU - Travadi, Ruchir

AU - Vaz, Colin

AU - Malandrakis, Nikolaos

AU - Hermjakob, Ulf

AU - Pourdamghani, Nima

AU - Pust, Michael

AU - Zhang, Boliang

AU - Pan, Xiaoman

AU - Lu, Di

AU - Lin, Ying

AU - Glembek, Ondřej

AU - Baskar, Murali Karthick

AU - Karafiát, Martin

AU - Burget, Lukáš

AU - Hasegawa-Johnson, Mark

AU - Ji, Heng

AU - May, Jonathan

AU - Knight, Kevin

AU - Narayanan, Shrikanth

PY - 2017

Y1 - 2017

N2 - In this paper, we describe the system designed and developed by team ELISA for DARPA's LORELEI (Low Resource Languages for Emergent Incidents) pilot speech evaluation. The goal of the LORELEI program is to guide rapid resource deployment for humanitarian relief (e.g. for natural disasters), with a focus on "low-resource" language locations, where the cost of developing technologies for automated human language tools can be prohibitive both in monetary terms and timewise. In this phase of the program, the speech evaluation consisted of three separate tasks: detecting presence of an incident, classifying incident type, and classifying incident type along with identifying the location where it occurs. The performance metric was area under curve of precision-recall curves. Team ELISA competed against five other teams and won all the subtasks.

AB - In this paper, we describe the system designed and developed by team ELISA for DARPA's LORELEI (Low Resource Languages for Emergent Incidents) pilot speech evaluation. The goal of the LORELEI program is to guide rapid resource deployment for humanitarian relief (e.g. for natural disasters), with a focus on "low-resource" language locations, where the cost of developing technologies for automated human language tools can be prohibitive both in monetary terms and timewise. In this phase of the program, the speech evaluation consisted of three separate tasks: detecting presence of an incident, classifying incident type, and classifying incident type along with identifying the location where it occurs. The performance metric was area under curve of precision-recall curves. Team ELISA competed against five other teams and won all the subtasks.

UR - http://www.scopus.com/inward/record.url?scp=85039161955&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85039161955&partnerID=8YFLogxK

U2 - 10.21437/Interspeech.2017-180

DO - 10.21437/Interspeech.2017-180

M3 - Conference article

AN - SCOPUS:85039161955

SN - 2308-457X

VL - 2017-August

SP - 2053

EP - 2057

JO - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

JF - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

T2 - 18th Annual Conference of the International Speech Communication Association, INTERSPEECH 2017

Y2 - 20 August 2017 through 24 August 2017

ER -

Team ELISA system for DARPA LORELEI speech evaluation 2016

Abstract

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this