Text segmentation: Difference between revisions

Revision as of 23:29, 23 July 2014

Revision as of 09:20, 13 October 2014

Line 16:

In some writing systems however, such as the [[Ge'ez script]] used for [[Amharic]] and [[Tigrinya]] among other languages, words are explicitly delimited (at least historically) with a non-[[Space (punctuation)|whitespace]] character.

The [http://www.unicode.org [Unicode Consortium]] has published a [http://www.unicode.org/reports/tr29/ Standard Annex] on Text Segmentation, exploring the issues of segmentation in multiscript texts.

'''Word splitting''' is the process of [[parsing]] [[concatenated]] text (i.e. text that contains no spaces or other word separators) to infer where word breaks exist.