Team ELISA system for DARPA LORELEI speech evaluation 2016

Pavlos Papadopoulos, Ruchir Travadi, Colin Vaz, Nikolaos Malandrakis, Ulf Hermjakob, Nima Pourdamghani, Michael Pust, Boliang Zhang, Xiaoman Pan, Di Lu, Ying Lin, Ondřej Glembek, Murali Karthick Baskar, Martin Karafiát, Lukáš Burget, Mark Allan Hasegawa-Johnson, Heng Ji, Jonathan May, Kevin Knight, Shrikanth Narayanan

Research output: Contribution to journalConference article

Abstract

In this paper, we describe the system designed and developed by team ELISA for DARPA's LORELEI (Low Resource Languages for Emergent Incidents) pilot speech evaluation. The goal of the LORELEI program is to guide rapid resource deployment for humanitarian relief (e.g. for natural disasters), with a focus on "low-resource" language locations, where the cost of developing technologies for automated human language tools can be prohibitive both in monetary terms and timewise. In this phase of the program, the speech evaluation consisted of three separate tasks: detecting presence of an incident, classifying incident type, and classifying incident type along with identifying the location where it occurs. The performance metric was area under curve of precision-recall curves. Team ELISA competed against five other teams and won all the subtasks.

Original languageEnglish (US)
Pages (from-to)2053-2057
Number of pages5
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Volume2017-August
DOIs
StatePublished - Jan 1 2017
Event18th Annual Conference of the International Speech Communication Association, INTERSPEECH 2017 - Stockholm, Sweden
Duration: Aug 20 2017Aug 24 2017

Fingerprint

Enzyme-linked Immunosorbent Assay
Resources
Evaluation
Disasters
Curve
Performance Metrics
Disaster
Costs
Language
Speech
Term

ASJC Scopus subject areas

  • Language and Linguistics
  • Human-Computer Interaction
  • Signal Processing
  • Software
  • Modeling and Simulation

Cite this

Papadopoulos, P., Travadi, R., Vaz, C., Malandrakis, N., Hermjakob, U., Pourdamghani, N., ... Narayanan, S. (2017). Team ELISA system for DARPA LORELEI speech evaluation 2016. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2017-August, 2053-2057. https://doi.org/10.21437/Interspeech.2017-180

Team ELISA system for DARPA LORELEI speech evaluation 2016. / Papadopoulos, Pavlos; Travadi, Ruchir; Vaz, Colin; Malandrakis, Nikolaos; Hermjakob, Ulf; Pourdamghani, Nima; Pust, Michael; Zhang, Boliang; Pan, Xiaoman; Lu, Di; Lin, Ying; Glembek, Ondřej; Baskar, Murali Karthick; Karafiát, Martin; Burget, Lukáš; Hasegawa-Johnson, Mark Allan; Ji, Heng; May, Jonathan; Knight, Kevin; Narayanan, Shrikanth.

In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, Vol. 2017-August, 01.01.2017, p. 2053-2057.

Research output: Contribution to journalConference article

Papadopoulos, P, Travadi, R, Vaz, C, Malandrakis, N, Hermjakob, U, Pourdamghani, N, Pust, M, Zhang, B, Pan, X, Lu, D, Lin, Y, Glembek, O, Baskar, MK, Karafiát, M, Burget, L, Hasegawa-Johnson, MA, Ji, H, May, J, Knight, K & Narayanan, S 2017, 'Team ELISA system for DARPA LORELEI speech evaluation 2016', Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, vol. 2017-August, pp. 2053-2057. https://doi.org/10.21437/Interspeech.2017-180
Papadopoulos, Pavlos ; Travadi, Ruchir ; Vaz, Colin ; Malandrakis, Nikolaos ; Hermjakob, Ulf ; Pourdamghani, Nima ; Pust, Michael ; Zhang, Boliang ; Pan, Xiaoman ; Lu, Di ; Lin, Ying ; Glembek, Ondřej ; Baskar, Murali Karthick ; Karafiát, Martin ; Burget, Lukáš ; Hasegawa-Johnson, Mark Allan ; Ji, Heng ; May, Jonathan ; Knight, Kevin ; Narayanan, Shrikanth. / Team ELISA system for DARPA LORELEI speech evaluation 2016. In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. 2017 ; Vol. 2017-August. pp. 2053-2057.
@article{fb845719bed846ae8c6a5e90c990ed0d,
title = "Team ELISA system for DARPA LORELEI speech evaluation 2016",
abstract = "In this paper, we describe the system designed and developed by team ELISA for DARPA's LORELEI (Low Resource Languages for Emergent Incidents) pilot speech evaluation. The goal of the LORELEI program is to guide rapid resource deployment for humanitarian relief (e.g. for natural disasters), with a focus on {"}low-resource{"} language locations, where the cost of developing technologies for automated human language tools can be prohibitive both in monetary terms and timewise. In this phase of the program, the speech evaluation consisted of three separate tasks: detecting presence of an incident, classifying incident type, and classifying incident type along with identifying the location where it occurs. The performance metric was area under curve of precision-recall curves. Team ELISA competed against five other teams and won all the subtasks.",
author = "Pavlos Papadopoulos and Ruchir Travadi and Colin Vaz and Nikolaos Malandrakis and Ulf Hermjakob and Nima Pourdamghani and Michael Pust and Boliang Zhang and Xiaoman Pan and Di Lu and Ying Lin and Ondřej Glembek and Baskar, {Murali Karthick} and Martin Karafi{\'a}t and Luk{\'a}š Burget and Hasegawa-Johnson, {Mark Allan} and Heng Ji and Jonathan May and Kevin Knight and Shrikanth Narayanan",
year = "2017",
month = "1",
day = "1",
doi = "10.21437/Interspeech.2017-180",
language = "English (US)",
volume = "2017-August",
pages = "2053--2057",
journal = "Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH",
issn = "2308-457X",

}

TY - JOUR

T1 - Team ELISA system for DARPA LORELEI speech evaluation 2016

AU - Papadopoulos, Pavlos

AU - Travadi, Ruchir

AU - Vaz, Colin

AU - Malandrakis, Nikolaos

AU - Hermjakob, Ulf

AU - Pourdamghani, Nima

AU - Pust, Michael

AU - Zhang, Boliang

AU - Pan, Xiaoman

AU - Lu, Di

AU - Lin, Ying

AU - Glembek, Ondřej

AU - Baskar, Murali Karthick

AU - Karafiát, Martin

AU - Burget, Lukáš

AU - Hasegawa-Johnson, Mark Allan

AU - Ji, Heng

AU - May, Jonathan

AU - Knight, Kevin

AU - Narayanan, Shrikanth

PY - 2017/1/1

Y1 - 2017/1/1

N2 - In this paper, we describe the system designed and developed by team ELISA for DARPA's LORELEI (Low Resource Languages for Emergent Incidents) pilot speech evaluation. The goal of the LORELEI program is to guide rapid resource deployment for humanitarian relief (e.g. for natural disasters), with a focus on "low-resource" language locations, where the cost of developing technologies for automated human language tools can be prohibitive both in monetary terms and timewise. In this phase of the program, the speech evaluation consisted of three separate tasks: detecting presence of an incident, classifying incident type, and classifying incident type along with identifying the location where it occurs. The performance metric was area under curve of precision-recall curves. Team ELISA competed against five other teams and won all the subtasks.

AB - In this paper, we describe the system designed and developed by team ELISA for DARPA's LORELEI (Low Resource Languages for Emergent Incidents) pilot speech evaluation. The goal of the LORELEI program is to guide rapid resource deployment for humanitarian relief (e.g. for natural disasters), with a focus on "low-resource" language locations, where the cost of developing technologies for automated human language tools can be prohibitive both in monetary terms and timewise. In this phase of the program, the speech evaluation consisted of three separate tasks: detecting presence of an incident, classifying incident type, and classifying incident type along with identifying the location where it occurs. The performance metric was area under curve of precision-recall curves. Team ELISA competed against five other teams and won all the subtasks.

UR - http://www.scopus.com/inward/record.url?scp=85039161955&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85039161955&partnerID=8YFLogxK

U2 - 10.21437/Interspeech.2017-180

DO - 10.21437/Interspeech.2017-180

M3 - Conference article

AN - SCOPUS:85039161955

VL - 2017-August

SP - 2053

EP - 2057

JO - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

JF - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

SN - 2308-457X

ER -