Natural language processing: Difference between revisions

Revision as of 08:12, 20 November 2003

Revision as of 11:38, 28 November 2003

Line 17:

Some problems which make NLP difficult:

; [[Word boundary detection]] : In spoken language, there are no gaps between words; where to place the word boundary often depends on what choice makes the most sense grammatically and given the context. In written form, languages like [[Chinese language|Chinese]] do not have word boundaries either.

; [[Word sense disambiguation]] : Any given word can have several different meanings; we have to select the meaning which makes the most sense in context.

; [[Syntactic ambiguity]] : The [[grammar]] for [[natural language]]s is not [[unambiguous grammar|unambiguous]], i.e. there are often multiple possible parse trees for a given sentence. Choosing the most appropriate one usually requires [[semantics|semantic]] and contextual information.