Factored language model: Difference between revisions

Revision as of 14:54, 19 August 2006

Revision as of 22:55, 10 December 2006

Line 1:

{{linkless-dateOrphan|August 2006}}

The '''factored language model''' ('''FLM''') is an extension of conventional [[Language model]]. In an FLM, each word is viewed as a vector of ''k'' factors: <math>w_i = \{f_i^1, ..., f_i^k\}</math>. An FLM provides the probabilistic model <math>P(f|f_i, ..., f_N)</math> where the prediction of factor <math>f</math> is based on <math>N</math> parents <math>\{f_1, ..., f_N\}</math>. For an example, if <math>w</math> represents word token and <math>t</math> represents [[Part of speech]] tag for English, the model <math>P(w_i|w_{i-2}, w_{i-1}, t_{i-1})</math> gives a model for predicting current work token based on traditional [[Ngram]] model as well as [[Part of speech]] tag of the previous word.