History of natural language processing: Difference between revisions

Revision as of 20:25, 16 March 2021

Revision as of 14:23, 8 June 2021

Line 27:

Many of the notable early successes occurred in the field of [[machine translation]], due especially to work at IBM Research, where successively more complicated statistical models were developed. These systems were able to take advantage of existing multilingual [[text corpus|textual corpora]] that had been produced by the [[Parliament of Canada]] and the [[European Union]] as a result of laws calling for the translation of all governmental proceedings into all official languages of the corresponding systems of government. However, most other systems depended on corpora specifically developed for the tasks implemented by these systems, which was (and often continues to be) a major limitation in the success of these systems. As a result, a great deal of research has gone into methods of more effectively learning from limited amounts of data.

Recent research has increasingly focused on [[unsupervised learning|unsupervised]] and [[semi-supervised learning|semi-supervised]] learning algorithms. Such algorithms are able to learn from data that has not been hand-annotated with the desired answers, or using [http://a combination of annotated and non%20combination%20of%20annotated%20and%20non-annotated%20data. datahttps://www.elinext.com/industries/healthcare/trends/natural-language-processing-in-healthcare/] Generally, this task is much more difficult than [[supervised learning]], and typically produces less accurate results for a given amount of input data. However, there is an enormous amount of non-annotated data available (including, among other things, the entire content of the [[World Wide Web]]), which can often make up for the inferior results.

==Software==