Linguistic Unit Discovery from Multi-Modal Inputs in Unwritten Languages: Summary of the 'Speaking Rosetta' JSALT 2017 Workshop

Odette Scharenborg; Laurent Besacier; Alan Black; Mark Hasegawa-Johnson; Florian Metze; Graham Neubig; Sebastian Stuker; Pierre Godard; Markus Muller; Lucas Ondel; Shruti Palaskar; Philip Arthur; Francesco Ciannella; Mingxing Du; Elin Larsen; Danny Merkx; Rachid Riad; Liming Wang; Emmanuel Dupoux

doi:10.1109/ICASSP.2018.8461761

Linguistic Unit Discovery from Multi-Modal Inputs in Unwritten Languages: Summary of the 'Speaking Rosetta' JSALT 2017 Workshop

Odette Scharenborg, Laurent Besacier, Alan Black, Mark Hasegawa-Johnson, Florian Metze, Graham Neubig, Sebastian Stuker, Pierre Godard, Markus Muller, Lucas Ondel, Shruti Palaskar, Philip Arthur, Francesco Ciannella, Mingxing Du, Elin Larsen, Danny Merkx, Rachid Riad, Liming Wang, Emmanuel Dupoux

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We summarize the accomplishments of a multi-disciplinary workshop exploring the computational and scientific issues surrounding the discovery of linguistic units (subwords and words) in a language without orthography. We study the replacement of orthographic transcriptions by images and/or translated text in a well-resourced language to help unsupervised discovery from raw speech.

Original language	English (US)
Title of host publication	2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	4979-4983
Number of pages	5
ISBN (Print)	9781538646588
DOIs	https://doi.org/10.1109/ICASSP.2018.8461761
State	Published - Sep 10 2018
Event	2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Calgary, Canada Duration: Apr 15 2018 → Apr 20 2018

Publication series

Name	ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Volume	2018-April
ISSN (Print)	1520-6149

Other

Other	2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018
Country	Canada
City	Calgary
Period	4/15/18 → 4/20/18

Fingerprint

Keywords

Image retrieval
Machine translation
Multi-modal data
Unsupervised unit discovery
Unwritten languages

ASJC Scopus subject areas

Software
Signal Processing
Electrical and Electronic Engineering

Cite this

Scharenborg, O., Besacier, L., Black, A., Hasegawa-Johnson, M., Metze, F., Neubig, G., Stuker, S., Godard, P., Muller, M., Ondel, L., Palaskar, S., Arthur, P., Ciannella, F., Du, M., Larsen, E., Merkx, D., Riad, R., Wang, L., & Dupoux, E. (2018). Linguistic Unit Discovery from Multi-Modal Inputs in Unwritten Languages: Summary of the 'Speaking Rosetta' JSALT 2017 Workshop. In 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings (pp. 4979-4983). [8461761] (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings; Vol. 2018-April). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICASSP.2018.8461761

Linguistic Unit Discovery from Multi-Modal Inputs in Unwritten Languages : Summary of the 'Speaking Rosetta' JSALT 2017 Workshop. / Scharenborg, Odette; Besacier, Laurent; Black, Alan; Hasegawa-Johnson, Mark; Metze, Florian; Neubig, Graham; Stuker, Sebastian; Godard, Pierre; Muller, Markus; Ondel, Lucas; Palaskar, Shruti; Arthur, Philip; Ciannella, Francesco; Du, Mingxing; Larsen, Elin; Merkx, Danny; Riad, Rachid; Wang, Liming; Dupoux, Emmanuel.

2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2018. p. 4979-4983 8461761 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings; Vol. 2018-April).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Scharenborg, O, Besacier, L, Black, A, Hasegawa-Johnson, M, Metze, F, Neubig, G, Stuker, S, Godard, P, Muller, M, Ondel, L, Palaskar, S, Arthur, P, Ciannella, F, Du, M, Larsen, E, Merkx, D, Riad, R, Wang, L & Dupoux, E 2018, Linguistic Unit Discovery from Multi-Modal Inputs in Unwritten Languages: Summary of the 'Speaking Rosetta' JSALT 2017 Workshop. in 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings., 8461761, ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, vol. 2018-April, Institute of Electrical and Electronics Engineers Inc., pp. 4979-4983, 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018, Calgary, Canada, 4/15/18. https://doi.org/10.1109/ICASSP.2018.8461761

Scharenborg O, Besacier L, Black A, Hasegawa-Johnson M, Metze F, Neubig G et al. Linguistic Unit Discovery from Multi-Modal Inputs in Unwritten Languages: Summary of the 'Speaking Rosetta' JSALT 2017 Workshop. In 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2018. p. 4979-4983. 8461761. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings). https://doi.org/10.1109/ICASSP.2018.8461761

Scharenborg, Odette ; Besacier, Laurent ; Black, Alan ; Hasegawa-Johnson, Mark ; Metze, Florian ; Neubig, Graham ; Stuker, Sebastian ; Godard, Pierre ; Muller, Markus ; Ondel, Lucas ; Palaskar, Shruti ; Arthur, Philip ; Ciannella, Francesco ; Du, Mingxing ; Larsen, Elin ; Merkx, Danny ; Riad, Rachid ; Wang, Liming ; Dupoux, Emmanuel. / Linguistic Unit Discovery from Multi-Modal Inputs in Unwritten Languages : Summary of the 'Speaking Rosetta' JSALT 2017 Workshop. 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 4979-4983 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

@inproceedings{07a928cf996e422dbc6926751327e8b9,

title = "Linguistic Unit Discovery from Multi-Modal Inputs in Unwritten Languages: Summary of the 'Speaking Rosetta' JSALT 2017 Workshop",

abstract = "We summarize the accomplishments of a multi-disciplinary workshop exploring the computational and scientific issues surrounding the discovery of linguistic units (subwords and words) in a language without orthography. We study the replacement of orthographic transcriptions by images and/or translated text in a well-resourced language to help unsupervised discovery from raw speech.",

keywords = "Image retrieval, Machine translation, Multi-modal data, Unsupervised unit discovery, Unwritten languages",

author = "Odette Scharenborg and Laurent Besacier and Alan Black and Mark Hasegawa-Johnson and Florian Metze and Graham Neubig and Sebastian Stuker and Pierre Godard and Markus Muller and Lucas Ondel and Shruti Palaskar and Philip Arthur and Francesco Ciannella and Mingxing Du and Elin Larsen and Danny Merkx and Rachid Riad and Liming Wang and Emmanuel Dupoux",

year = "2018",

month = sep,

day = "10",

doi = "10.1109/ICASSP.2018.8461761",

language = "English (US)",

isbn = "9781538646588",

series = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "4979--4983",

booktitle = "2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings",

address = "United States",

note = "2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 ; Conference date: 15-04-2018 Through 20-04-2018",

}

TY - GEN

T1 - Linguistic Unit Discovery from Multi-Modal Inputs in Unwritten Languages

T2 - 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018

AU - Scharenborg, Odette

AU - Besacier, Laurent

AU - Black, Alan

AU - Hasegawa-Johnson, Mark

AU - Metze, Florian

AU - Neubig, Graham

AU - Stuker, Sebastian

AU - Godard, Pierre

AU - Muller, Markus

AU - Ondel, Lucas

AU - Palaskar, Shruti

AU - Arthur, Philip

AU - Ciannella, Francesco

AU - Du, Mingxing

AU - Larsen, Elin

AU - Merkx, Danny

AU - Riad, Rachid

AU - Wang, Liming

AU - Dupoux, Emmanuel

PY - 2018/9/10

Y1 - 2018/9/10

N2 - We summarize the accomplishments of a multi-disciplinary workshop exploring the computational and scientific issues surrounding the discovery of linguistic units (subwords and words) in a language without orthography. We study the replacement of orthographic transcriptions by images and/or translated text in a well-resourced language to help unsupervised discovery from raw speech.

AB - We summarize the accomplishments of a multi-disciplinary workshop exploring the computational and scientific issues surrounding the discovery of linguistic units (subwords and words) in a language without orthography. We study the replacement of orthographic transcriptions by images and/or translated text in a well-resourced language to help unsupervised discovery from raw speech.

KW - Image retrieval

KW - Machine translation

KW - Multi-modal data

KW - Unsupervised unit discovery

KW - Unwritten languages

UR - http://www.scopus.com/inward/record.url?scp=85054264895&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054264895&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2018.8461761

DO - 10.1109/ICASSP.2018.8461761

M3 - Conference contribution

AN - SCOPUS:85054264895

SN - 9781538646588

T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

SP - 4979

EP - 4983

BT - 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 15 April 2018 through 20 April 2018

ER -

Access to Document

10.1109/ICASSP.2018.8461761