Modeling Global Syntactic Variation in English Using Dialect Classification

Jonathan E Dunn

doi:10.18653/v1/W19-1405

Modeling Global Syntactic Variation in English Using Dialect Classification

Jonathan E Dunn

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper evaluates global-scale dialect identification for 14 national varieties of English on both web-crawled data and Twitter data. The paper makes three main contributions: (i) introducing data-driven language mapping as a method for selecting the inventory of national varieties to include in the task; (ii) producing a large and dynamic set of syntactic features using grammar induction rather than focusing on a few hand-selected features such as function words; and (iii) comparing models across both web corpora and social media corpora in order to measure the robustness of syntactic variation across registers.

Original language	English (US)
Title of host publication	Proceedings of the Sixth Workshop on NLP for Similar Languages, Varieties and Dialects
Editors	Marcos Zampieri, Preslav Nakov, Shervin Malmasi, Nikola Ljubešić, Jörg Tiedemann, Ahmed Ali
Publisher	Association for Computational Linguistics
Pages	42-53
ISBN (Electronic)	9781950737116
DOIs	https://doi.org/10.18653/v1/W19-1405
State	Published - Jun 2019
Externally published	Yes

Online availability

10.18653/v1/W19-1405License: CC BY

Library availability

Discover UIUC Full Text

Cite this

Modeling Global Syntactic Variation in English Using Dialect Classification. / Dunn, Jonathan E.
Proceedings of the Sixth Workshop on NLP for Similar Languages, Varieties and Dialects. ed. / Marcos Zampieri; Preslav Nakov; Shervin Malmasi; Nikola Ljubešić; Jörg Tiedemann; Ahmed Ali. Association for Computational Linguistics, 2019. p. 42-53.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

@inproceedings{76b8639b25614b3dac0d30c1285e5c84,

title = "Modeling Global Syntactic Variation in English Using Dialect Classification",

abstract = "This paper evaluates global-scale dialect identification for 14 national varieties of English on both web-crawled data and Twitter data. The paper makes three main contributions: (i) introducing data-driven language mapping as a method for selecting the inventory of national varieties to include in the task; (ii) producing a large and dynamic set of syntactic features using grammar induction rather than focusing on a few hand-selected features such as function words; and (iii) comparing models across both web corpora and social media corpora in order to measure the robustness of syntactic variation across registers.",

author = "Dunn, \{Jonathan E\}",

year = "2019",

month = jun,

doi = "10.18653/v1/W19-1405",

language = "English (US)",

pages = "42--53",

editor = "Marcos Zampieri and Preslav Nakov and Shervin Malmasi and Nikola Ljube{\v s}i{\'c} and J{\"o}rg Tiedemann and Ahmed Ali",

booktitle = "Proceedings of the Sixth Workshop on NLP for Similar Languages, Varieties and Dialects",

publisher = "Association for Computational Linguistics",

}

TY - GEN

T1 - Modeling Global Syntactic Variation in English Using Dialect Classification

AU - Dunn, Jonathan E

PY - 2019/6

Y1 - 2019/6

N2 - This paper evaluates global-scale dialect identification for 14 national varieties of English on both web-crawled data and Twitter data. The paper makes three main contributions: (i) introducing data-driven language mapping as a method for selecting the inventory of national varieties to include in the task; (ii) producing a large and dynamic set of syntactic features using grammar induction rather than focusing on a few hand-selected features such as function words; and (iii) comparing models across both web corpora and social media corpora in order to measure the robustness of syntactic variation across registers.

AB - This paper evaluates global-scale dialect identification for 14 national varieties of English on both web-crawled data and Twitter data. The paper makes three main contributions: (i) introducing data-driven language mapping as a method for selecting the inventory of national varieties to include in the task; (ii) producing a large and dynamic set of syntactic features using grammar induction rather than focusing on a few hand-selected features such as function words; and (iii) comparing models across both web corpora and social media corpora in order to measure the robustness of syntactic variation across registers.

U2 - 10.18653/v1/W19-1405

DO - 10.18653/v1/W19-1405

M3 - Conference contribution

SP - 42

EP - 53

BT - Proceedings of the Sixth Workshop on NLP for Similar Languages, Varieties and Dialects

A2 - Zampieri, Marcos

A2 - Nakov, Preslav

A2 - Malmasi, Shervin

A2 - Ljubešić, Nikola

A2 - Tiedemann, Jörg

A2 - Ali, Ahmed

PB - Association for Computational Linguistics

ER -

Modeling Global Syntactic Variation in English Using Dialect Classification

Abstract

Online availability

Library availability

Fingerprint

Cite this