A stochastic finite-state word-segmentation algorithm for Chinese

Richard Sproat; Chilin Shih; William Gale; Nancy Chang

A stochastic finite-state word-segmentation algorithm for Chinese

Richard Sproat
, Chilin Shih
, William Gale
, Nancy Chang

Research output: Contribution to journal › Conference article › peer-review

Abstract

We present a stochastic finite-state model for segmenting Chinese text into dictionary entries and productively derived words, and providing pronunciations for these words; the method incorporates a class-based model in its treatment of personal names. We also evaluate the system's performance, taking into account the fact that people often do not agree on a single segmentation.

Original language	English (US)
Pages (from-to)	66-73
Number of pages	8
Journal	Proceedings of the Annual Meeting of the Association for Computational Linguistics
Volume	1994-June
State	Published - 1994
Externally published	Yes
Event	32nd Annual Meeting of the Association for Computational Linguistics, ACL 1994 - Las Cruces, United States Duration: Jun 27 1994 → Jun 30 1994

ASJC Scopus subject areas

Computer Science Applications
Linguistics and Language
Language and Linguistics

Library availability

Discover UIUC Full Text

Cite this

@article{a804a82838d3470a99f51c6e31554e77,

title = "A stochastic finite-state word-segmentation algorithm for Chinese",

abstract = "We present a stochastic finite-state model for segmenting Chinese text into dictionary entries and productively derived words, and providing pronunciations for these words; the method incorporates a class-based model in its treatment of personal names. We also evaluate the system's performance, taking into account the fact that people often do not agree on a single segmentation.",

author = "Richard Sproat and Chilin Shih and William Gale and Nancy Chang",

note = "Publisher Copyright: {\textcopyright} 1994, Association for Computational Linguistics.; 32nd Annual Meeting of the Association for Computational Linguistics, ACL 1994 ; Conference date: 27-06-1994 Through 30-06-1994",

year = "1994",

language = "English (US)",

volume = "1994-June",

pages = "66--73",

journal = "Proceedings of the Annual Meeting of the Association for Computational Linguistics",

issn = "0736-587X",

publisher = "Association for Computational Linguistics (ACL)",

}

TY - JOUR

T1 - A stochastic finite-state word-segmentation algorithm for Chinese

AU - Sproat, Richard

AU - Shih, Chilin

AU - Gale, William

AU - Chang, Nancy

PY - 1994

Y1 - 1994

N2 - We present a stochastic finite-state model for segmenting Chinese text into dictionary entries and productively derived words, and providing pronunciations for these words; the method incorporates a class-based model in its treatment of personal names. We also evaluate the system's performance, taking into account the fact that people often do not agree on a single segmentation.

AB - We present a stochastic finite-state model for segmenting Chinese text into dictionary entries and productively derived words, and providing pronunciations for these words; the method incorporates a class-based model in its treatment of personal names. We also evaluate the system's performance, taking into account the fact that people often do not agree on a single segmentation.

UR - https://www.scopus.com/pages/publications/34548519400

UR - https://www.scopus.com/pages/publications/34548519400#tab=citedBy

M3 - Conference article

AN - SCOPUS:34548519400

SN - 0736-587X

VL - 1994-June

SP - 66

EP - 73

JO - Proceedings of the Annual Meeting of the Association for Computational Linguistics

JF - Proceedings of the Annual Meeting of the Association for Computational Linguistics

T2 - 32nd Annual Meeting of the Association for Computational Linguistics, ACL 1994

Y2 - 27 June 1994 through 30 June 1994

ER -

A stochastic finite-state word-segmentation algorithm for Chinese

Abstract

ASJC Scopus subject areas

Library availability

Related links

Fingerprint

Cite this