Wikipedia

Outline of natural language processing: Difference between revisions

Browse history interactively
← Previous editNext edit →
Content deleted Content added
VisualWikitext
mNo edit summary
mNo edit summary
Line 1:
{{Short description|1=Overview of and topical guide to natural -language processing}}
<!--... Attention: THIS IS AN OUTLINE
 
Line 15:
to this outline are on the way
...-->
The following [[Outline (list)|outline]] is provided as an overview of and topical guide to natural -language processing:
 
'''[[Natural language processing|natural-language processing]]''' &ndash; computer activity in which computers are entailed to [[natural -language understanding|analyze, understand]], [[natural language generation|alter, or generate]] [[natural language]]. This includes the [[automation]] of any or all linguistic forms, activities, or methods of communication, such as [[conversation]], correspondence, [[Readingreading (process)|reading]], [[Compositioncomposition (language)|written composition]], [[dictation (exercise)|dictation]], [[publishing]], [[translation]], [[lip reading]], and so on. Natural -language processing is also the name of the branch of [[computer science]], [[artificial intelligence]], and [[linguistics]] concerned with enabling computers to engage in communication using natural language(s) in all forms, including but not limited to [[speech]], [[written language|print]], [[writing]], and [[sign language|signing]].
 
{{TOC limit|limit=2}}
 
== Natural -language processing ==
 
Natural -language processing can be described as all of the following:
* A field of [[science]] &ndash; systematic enterprise that builds and organizes knowledge in the form of testable explanations and predictions about the universe.<ref>"... modern science is a discovery as well as an invention. It was a discovery that nature generally acts regularly enough to be described by laws and even by mathematics; and required invention to devise the techniques, abstractions, apparatus, and organization for exhibiting the regularities and securing their law-like descriptions."&nbsp;—p.vii, [[J. L. Heilbron]], (2003, editor-in-chief) ''The Oxford Companion to the History of Modern Science'' New York: Oxford University Press {{ISBN|0-19-511229-6}}
*{{cite dictionary |encyclopedia=Merriam-Webster Online Dictionary |title=science |url=http://www.merriam-webster.com/dictionary/science |access-date=2011-10-16 |publisher=[[Merriam-Webster]], Inc |quote='''3 a:''' knowledge or a system of knowledge covering general truths or the operation of general laws especially as obtained and tested through scientific method '''b:''' such knowledge or such a system of knowledge concerned with the physical world and its phenomena }}
Line 29:
** An [[applied science]] &ndash; field that applies human knowledge to build or design useful things.
*** A field of [[computer science]] &ndash; scientific and practical approach to computation and its applications.
**** A branch of [[artificial intelligence]] &ndash; intelligence of machines and robots and the branch of computer science that aims to create it.
**** A subfield of [[computational linguistics]] &ndash; interdisciplinary field dealing with the statistical or rule-based modeling of natural language from a computational perspective.
** An application of [[engineering]] &ndash; science, skill, and profession of acquiring and applying scientific, economic, social, and practical knowledge, in order to design and also build structures, machines, devices, systems, materials and processes.
*** An application of [[software engineering]] &ndash; application of a systematic, disciplined, quantifiable approach to the design, development, operation, and maintenance of software, and the study of these approaches; that is, the application of engineering to software.<ref name="BoDu04">[[Software Engineering Body of Knowledge|SWEBOK]] {{Cite book|editor1= Pierre Bourque |editor2=Robert Dupuis | title = Guide to the Software Engineering Body of Knowledge - 2004 Version | publisher = [[IEEE Computer Society]] | year = 2004 | pages = 1 | isbn = 0-7695-2330-7 | url = http://www.swebok.org | others = executive editors, Alain Abran, James W. Moore ; editors, Pierre Bourque, Robert Dupuis.}}</ref><ref>{{cite web
Line 49:
***** A subfield of [[artificial intelligence]] programming &ndash;
* A type of [[system]] &ndash; set of interacting or interdependent components forming an integrated whole or a set of elements (often called 'components' ) and relationships which are different from relationships of the set or its elements to other elements or sets.
** A system that includes [[software]] &ndash; software is a collection of computer programs and related data that provides the instructions for telling a computer what to do and how to do it. Software refers to one or more computer programs and data held in the storage of the computer. In other words, software is a set of programs, procedures, algorithms and its documentation concerned with the operation of a data processing system.
* A type of [[technology]] &ndash; making, modification, usage, and knowledge of tools, machines, techniques, crafts, systems, methods of organization, in order to solve a problem, improve a preexisting solution to a problem, achieve a goal, handle an applied input/output relation or perform a specific function. It can also refer to the collection of such tools, machinery, modifications, arrangements and procedures. Technologies significantly affect human as well as other animal species' ability to control and adapt to their natural environments.
** A form of [[computer technology]] &ndash; computers and their application. NLP makes use of computers, image scanners, microphones, and many types of software programs.
*** [[Language technology]] &ndash; consists of natural -language processing (NLP) and computational linguistics (CL) on the one hand, and speech technology on the other. It also includes many application oriented aspects of these. It is often called human language technology (HLT).
 
== Prerequisite technologies ==
The following technologies make natural -language processing possible:
 
* [[Communication]] &ndash; the activity of a source sending a message to a [[Receiver (information theory)|receiver]]
Line 73:
**** [[Image scanner]]s &ndash;
 
== Subfields of natural -language processing ==
* [[Information extraction]] (IE) &ndash; field concerned in general with the extraction of semantic information from text. This covers tasks such as [[named -entity recognition]], [[Coreference|coreference resolution]], [[relationship extraction]], etc.▼
 
▲* [[Information extraction]] (IE) &ndash; field concerned in general with the extraction of semantic information from text. This covers tasks such as [[named entity recognition]], [[Coreference|coreference resolution]], [[relationship extraction]], etc.
* [[Ontology engineering]] &ndash; field that studies the methods and methodologies for building ontologies, which are formal representations of a set of concepts within a ___domain and the relationships between those concepts.
* [[Speech processing]] &ndash; field that covers [[speech recognition]], [[text-to-speech]] and related tasks.
* [[Statistical natural -language processing]] &ndash;
** [[Statistical semantics]] &ndash; a subfield of [[computational semantics]] that establishes semantic relations between words to examine their contexts.
*** [[Distributional semantics]] &ndash; a subfield of [[statistical semantics]] that examines the semantic relationship of words across a corpora or in large samples of data.
 
== Related fields ==
Natural -language processing contributes to, and makes use of (the theories, tools, and methodologies from), the following fields:
 
* [[Automated reasoning]] &ndash; area of computer science and mathematical logic dedicated to understanding various aspects of reasoning, and producing software which allows computers to reason completely, or nearly completely, automatically. A sub-field of artificial intelligence, automatic reasoning is also grounded in theoretical computer science and philosophy of mind.
* [[Linguistics]] &ndash; scientific study of human language. Natural -language processing requires understanding of the structure and application of language, and therefore it draws heavily from linguistics.
** [[Applied linguistics]] &ndash; interdisciplinary field of study that identifies, investigates, and offers solutions to language-related real-life problems. Some of the academic fields related to applied linguistics are education, linguistics, psychology, computer science, anthropology, and sociology. Some of the subfields of applied linguistics relevant to natural -language processing are:
*** [[Multilingualism|Bilingualism / Multilingualism]] &ndash;
*** [[Computer-mediated communication]] (CMC) &ndash; any communicative transaction that occurs through the use of two or more networked computers.<ref>McQuail, Denis. (2005). ''Mcquail's Mass Communication Theory''. 5th ed. London: SAGE Publications.</ref> Research on CMC focuses largely on the social effects of different computer-supported communication technologies. Many recent studies involve Internet-based [[social networking]] supported by [[social software]].
Line 96 ⟶ 95:
*** [[Interlinguistics]] &ndash; study of improving communications between people of different first languages with the use of ethnic and auxiliary languages (lingua franca). For instance by use of intentional international auxiliary languages, such as Esperanto or Interlingua, or spontaneous interlanguages known as pidgin languages.
*** [[Language assessment]] &ndash; assessment of first, second or other language in the school, college, or university context; assessment of language use in the workplace; and assessment of language in the immigration, citizenship, and asylum contexts. The assessment may include analyses of listening, speaking, reading, writing or cultural understanding, with respect to understanding how the language works theoretically and the ability to use the language practically.
*** [[Language pedagogy]] &ndash; science and art of language education, including approaches and methods of language teaching and study. Natural -language processing is used in programs designed to teach language, including first- and second -language training.
*** [[Language planning]] &ndash;
*** [[Language policy]] &ndash;
Line 102 ⟶ 101:
*** [[literacy|Literacies]] &ndash;
*** [[Pragmatics]] &ndash;
*** [[Second -language acquisition]] &ndash;
*** [[stylistics (literature)|Stylistics]] &ndash;
*** [[Translation]] &ndash;
** [[Computational linguistics]] &ndash; interdisciplinary field dealing with the statistical or rule-based modeling of natural language from a computational perspective. The models and tools of computational linguistics are used extensively in the field of natural -language processing, and vice versa.
*** [[Computational semantics]] &ndash;
*** [[Corpus linguistics]] &ndash; study of language as expressed in samples ''(corpora)'' of "real world" text. ''Corpora'' is the plural of ''corpus'', and a corpus is a specifically selected collection of texts (or speech segments) composed of natural language. After it is constructed (gathered or composed), a corpus is analyzed with the methods of computational linguistics to infer the meaning and context of its components (words, phrases, and sentences), and the relationships between them. Optionally, a corpus can be annotated ("tagged") with data (manually or automatically) to make the corpus easier to understand (e.g., [[part-of-speech tagging]]). This data is then applied to make sense of user input, for example, to make better (automated) guesses of what people are talking about or saying, perhaps to achieve more narrowly focused web searches, or for speech recognition.
Line 119 ⟶ 118:
** [[Statistical classification]] &ndash;
 
== Structures used in natural -language processing ==
* [[Anaphora (linguistics)|Anaphora]] &ndash; type of expression whose reference depends upon another referential element. E.g., in the sentence 'Sally preferred the company of herself', 'herself' is an anaphoric expression in that it is coreferential with 'Sally', the sentence's subject.
* [[Context-free language]] &ndash;
Line 147 ⟶ 146:
*** [[Taxonomy for search engines]] &ndash; typically called a "taxonomy of entities". It is a [[tree structure|tree]] in which nodes are labelled with entities which are expected to occur in a web search query. These trees are used to match keywords from a search query with the keywords from relevant answers (or snippets).
* [[Textual entailment]] – directional relation between text fragments. The relation holds whenever the truth of one text fragment follows from another text. In the TE framework, the entailing and entailed texts are termed text (t) and hypothesis (h), respectively. The relation is directional because even if "t entails h", the reverse "h entails t" is much less certain.
* [[Triphone]] – sequence of three phonemes. Triphones are useful in models of natural -language processing where they are used to establish the various contexts in which a phoneme can occur in a particular natural language.
 
== Processes of NLP ==
 
=== Applications ===
* [[Automated essay scoring]] (AES) &ndash; the use of specialized computer programs to assign grades to essays written in an educational setting. It is a method of educational assessment and an application of natural -language processing. Its objective is to classify a large set of textual entities into a small number of discrete categories, corresponding to the possible grades—for example, the numbers 1 to 6. Therefore, it can be considered a problem of statistical classification.
* [[Automatic image annotation]] &ndash; process by which a computer system automatically assigns textual metadata in the form of captioning or keywords to a digital image. The annotations are used in image retrieval systems to organize and locate images of interest from a database.
* [[Automatic summarization]] &ndash; process of reducing a text document with a computer program in order to create a summary that retains the most important points of the original document. Often used to provide summaries of text of a known type, such as articles in the financial section of a newspaper.
Line 172 ⟶ 171:
* [[Dialog system]] &ndash;
* [[Foreign-language reading aid]] &ndash; computer program that assists a non-native language user to read properly in their target language. The proper reading means that the pronunciation should be correct and stress to different parts of the words should be proper.
* [[Foreign -language writing aid]] &ndash; computer program or any other instrument that assists a non-native language user (also referred to as a foreign -language learner) in writing decently in their target language. Assistive operations can be classified into two categories: on-the-fly prompts and post-writing checks.
* [[Grammar checker|Grammar checking]] &ndash; the act of verifying the grammatical correctness of written text, especially if this act is performed by a [[computer program]].
* [[Information retrieval]] –
Line 183 ⟶ 182:
** [[Example-based machine translation]] &ndash;
** [[Rule-based machine translation]] &ndash;
* [[Natural -language programming]] &ndash; interpreting and compiling instructions communicated in natural language into computer instructions (machine code).
* [[Natural -language user interface|Natural -language search]] &ndash;
* [[Optical character recognition]] (OCR) &ndash; given an image representing printed text, determine the corresponding text.
* [[Question answering]] &ndash; given a human-language question, determine its answer. Typical questions have a specific right answer (such as "What is the capital of Canada?"), but sometimes open-ended questions are also considered (such as "What is the meaning of life?").
Line 195 ⟶ 194:
* [[Text simplification]] &ndash; automated editing a document to include fewer words, or use easier words, while retaining its underlying meaning and information.
 
=== Component processes ===
* [[Natural -language understanding]] &ndash; converts chunks of text into more formal representations such as [[first-order logic]] structures that are easier for [[computer]] programs to manipulate. Natural -language understanding involves the identification of the intended semantic from the multiple possible semantics which can be derived from a natural -language expression which usually takes the form of organized notations of natural -languages concepts. Introduction and creation of language metamodel and ontology are efficient however empirical solutions. An explicit formalization of natural -languages semantics without confusions with implicit assumptions such as [[closed-world assumption]] (CWA) vs. [[open-world assumption]], or subjective Yes/No vs. objective True/False is expected for the construction of a basis of semantics formalization.<ref>Yucong Duan, Christophe Cruz (2011), ''[http &ndash;//www.ijimt.org/abstract/100-E00187.htm Formalizing Semantic of Natural Language through Conceptualization from Existence]''. International Journal of Innovation, Management and Technology(2011) 2 (1), pp. 37-4237–42.</ref>
* [[Natural language generation|Natural-language generation]] &ndash; task of converting information from computer databases into readable human language.
 
==== Component processes of natural -language understanding ====
* [[Automatic document classification]] (text categorization) &ndash;
** [[Automatic language identification]] &ndash;
Line 212 ⟶ 211:
* [[Information extraction]] &ndash;
** [[Text mining]] &ndash; process of deriving high-quality information from text. High-quality information is typically derived through the devising of patterns and trends through means such as statistical pattern learning.
*** [[Biomedical text mining]] &ndash; (also known as BioNLP), this is text mining applied to texts and literature of the biomedical and molecular biology ___domain. It is a rather recent research field drawing elements from natural -language processing, bioinformatics, medical informatics and computational linguistics. There is an increasing interest in text mining and information extraction strategies applied to the biomedical and molecular biology literature due to the increasing number of electronically available publications stored in databases such as PubMed.
*** [[Decision tree learning]] &ndash;
*** [[Sentence extraction]] &ndash;
Line 219 ⟶ 218:
* [[Lemmatisation]] &ndash; groups together all like terms that share a same lemma such that they are classified as a single item.
* [[Morphology (linguistics)|Morphological segmentation]] &ndash; separates words into individual [[morphemes]] and identifies the class of the morphemes. The difficulty of this task depends greatly on the complexity of the [[morphology (linguistics)|morphology]] (i.e. the structure of words) of the language being considered. [[English language|English]] has fairly simple morphology, especially [[inflectional morphology]], and thus it is often possible to ignore this task entirely and simply model all possible forms of a word (e.g. "open, opens, opened, opening") as separate words. In languages such as [[Turkish language|Turkish]], however, such an approach is not possible, as each dictionary entry has thousands of possible word forms.
* [[Named -entity recognition]] (NER) &ndash; given a stream of text, determines which items in the text map to proper names, such as people or places, and what the type of each such name is (e.g. person, ___location, organization). Although [[capitalization]] can aid in recognizing named entities in languages such as English, this information cannot aid in determining the type of named entity, and in any case is often inaccurate or insufficient. For example, the first word of a sentence is also capitalized, and named entities often span several words, only some of which are capitalized. Furthermore, many other languages in non-Western scripts (e.g. [[Chinese language|Chinese]] or [[Arabic language|Arabic]]) do not have any capitalization at all, and even languages with capitalization may not consistently use it to distinguish names. For example, [[German language|German]] capitalizes all [[noun]]s, regardless of whether they refer to names, and [[French language|French]] and [[Spanish language|Spanish]] do not capitalize names that serve as [[adjective]]s.
* [[Ontology learning]] &ndash; automatic or semi-automatic creation of [[Ontology (information science)|ontologies]], including extracting the corresponding ___domain's terms and the relationships between those concepts from a corpus of natural -language text, and encoding them with an [[ontology language]] for easy retrieval. Also called "ontology extraction", "ontology generation", and "ontology acquisition".
* [[Parsing]] &ndash; determines the [[parse tree]] (grammatical analysis) of a given sentence. The [[grammar]] for [[natural language]]s is [[ambiguous]] and typical sentences have multiple possible analyses. In fact, perhaps surprisingly, for a typical sentence there may be thousands of potential parses (most of which will seem completely nonsensical to a human).
** [[Shallow parsing]] &ndash;
Line 239 ⟶ 238:
* [[Word segmentation]] &ndash; separates a chunk of continuous text into separate words. For a language like [[English language|English]], this is fairly trivial, since words are usually separated by spaces. However, some written languages like [[Chinese language|Chinese]], [[Japanese language|Japanese]] and [[Thai language|Thai]] do not mark word boundaries in such a fashion, and in those languages text segmentation is a significant task requiring knowledge of the [[vocabulary]] and [[morphology (linguistics)|morphology]] of words in the language.
* [[Word-sense disambiguation]] (WSD) &ndash; because many words have more than one [[Meaning (linguistics)|meaning]], word-sense disambiguation is used to select the meaning which makes the most sense in context. For this problem, we are typically given a list of words and associated word senses, e.g. from a dictionary or from an online resource such as [[WordNet]].
** [[Word-sense induction]] – open problem of natural -language processing, which concerns the automatic identification of the senses of a word (i.e. meanings). Given that the output of word-sense induction is a set of senses for the target word (sense inventory), this task is strictly related to that of word-sense disambiguation (WSD), which relies on a predefined sense inventory and aims to solve the ambiguity of words in context.
** [[Automatic acquisition of sense-tagged corpora]] &ndash;
* [[W-shingling]] – set of unique "shingles"—contiguous subsequences of tokens in a document—that can be used to gauge the similarity of two documents. The w denotes the number of tokens in each shingle in the set.
 
==== Component processes of natural -language generation ====
[[Natural language generation|Natural-language generation]] &ndash; task of converting information from computer databases into readable human language.
* [[Automatic taxonomy induction]] (ATI) &ndash; automated building of [[tree structure]]s from a corpus. While ATI is used to construct the core of ontologies (and doing so makes it a component process of natural -language understanding), when the ontologies being constructed are end user readable (such as a subject outline), and these are used for the construction of further documentation (such as using an outline as the basis to construct a report or treatise) this also becomes a component process of natural -language generation.
* [[Document structuring]] –
 
== History of natural -language processing ==
[[History of natural language processing|History of natural-language processing]]▼
 
▲[[History of natural language processing]]
* [[History of machine translation]]
* [[Automated essay scoring#History|History of automated essay scoring]]
* [[Natural -language user interface#History|History of natural -language user interface]]
* [[Natural -language understanding#History|History of natural -language understanding]]
* [[Optical character recognition#History|History of optical character recognition]]
* [[Question answering#History|History of question answering]]
* [[Speech synthesis#History|History of speech synthesis]]
* [[Turing test]] &ndash; test of a machine's ability to exhibit intelligent behavior, equivalent to or indistinguishable from, that of an actual human. In the original illustrative example, a human judge engages in a natural -language conversation with a human and a machine designed to generate performance indistinguishable from that of a human being. All participants are separated from one another. If the judge cannot reliably tell the machine from the human, the machine is said to have passed the test. The test was introduced by Alan Turing in his 1950 paper "Computing Machinery and Intelligence," which opens with the words: "I propose to consider the question, 'Can machines think?'"
* [[Universal grammar]] &ndash; theory in [[linguistics]], usually credited to [[Noam Chomsky]], proposing that the ability to learn grammar is hard-wired into the brain.<ref>{{cite web|url=http://thebrain.mcgill.ca/flash/capsules/outil_rouge06.html|title=Tool Module: Chomsky's Universal Grammar|website=thebrain.mcgill.ca}}</ref> The theory suggests that linguistic ability manifests itself without being taught (''see'' [[poverty of the stimulus]]), and that there are properties that all natural [[human languages]] share. It is a matter of observation and experimentation to determine precisely what abilities are innate and what properties are shared by all languages.
* [[ALPAC]] &ndash; was a committee of seven scientists led by John R. Pierce, established in 1964 by the U. S. Government in order to evaluate the progress in computational linguistics in general and machine translation in particular. Its report, issued in 1966, gained notoriety for being very skeptical of research done in machine translation so far, and emphasizing the need for basic research in computational linguistics; this eventually caused the U. S. Government to reduce its funding of the topic dramatically.
* [[Conceptual dependency theory]] &ndash; a model of natural -language understanding used in artificial intelligence systems. [[Roger Schank]] at Stanford University introduced the model in 1969, in the early days of artificial intelligence.<ref>[[Roger Schank]], 1969, ''A conceptual dependency parser for natural language'' Proceedings of the 1969 conference on Computational linguistics, Sång-Säby, Sweden pages 1-3</ref> This model was extensively used by Schank's students at Yale University such as Robert Wilensky, Wendy Lehnert, and Janet Kolodner.
* [[Augmented transition network]] &ndash; type of graph theoretic structure used in the operational definition of formal languages, used especially in parsing relatively complex natural languages, and having wide application in artificial intelligence. Introduced by William A. Woods in 1970.
* [[Distributed Language Translation]] (project) &ndash;
 
=== Timeline of NLP software ===
 
{|
! style="background-color:#ECE9EF;" | Software
Line 295 ⟶ 292:
|1970
|[[Terry Winograd]]
|a natural -language system working in restricted "[[blocks world]]s" with restricted vocabularies, worked extremely well
|
|-
Line 328 ⟶ 325:
|1978
|Hendrix
| a natural -language interface to a database of information about US Navy ships.
|
|-
Line 407 ⟶ 404:
|}
 
== General natural -language processing concepts ==
* [[Sukhotin's algorithm]] – statistical classification algorithm for classifying characters in a text as vowels or consonants. It was initially created by Boris V. Sukhotin.
* [[T9 (predictive text)]] – stands for "Text on 9 keys", is a USA-patented predictive text technology for mobile phones (specifically those that contain a 3x4 numeric keypad), originally developed by Tegic Communications, now part of Nuance Communications.
* [[Tatoeba]] – free collaborative online database of example sentences geared towards foreign -language learners.
* [[Teragram Corporation]] – fully owned subsidiary of SAS Institute, a major producer of statistical analysis software, headquartered in Cary, North Carolina, USA. Teragram is based in Cambridge, Massachusetts and specializes in the application of computational linguistics to multilingual natural -language processing.
* [[TipTop Technologies]] – company that developed TipTop Search, a real-time web, social search engine with a unique platform for semantic analysis of natural language. TipTop Search provides results capturing individual and group sentiment, opinions, and experiences from content of various sorts including real-time messages from Twitter or consumer product reviews on Amazon.com.
* [[Transderivational search]] – when a search is being conducted for a fuzzy match across a broad field. In computing the equivalent function can be performed using content-addressable memory.
Line 475 ⟶ 472:
* [[Naive semantics]] –
* [[Natural language]] –
* [[Natural language interface|Natural-language interface]] –
* [[Natural -language user interface]] –
* [[News analytics]] –
* [[Nondeterministic polynomial]] –
Line 498 ⟶ 495:
* [[String kernel]] –
 
== Natural -language processing tools ==
* [[Google Ngram Viewer]] &ndash; graphs ''n''-gram usage from a corpus of more than 5.2 million books
 
=== Corpora ===
 
* [[Text corpus]] (see [[List of text corpora|list]]) &ndash; large and structured set of texts (nowadays usually electronically stored and processed). They are used to do statistical analysis and hypothesis testing, checking occurrences or validating linguistic rules within a specific language territory.
** [[Bank of English]]
Line 509 ⟶ 505:
** [[Oxford English Corpus]]
 
=== Natural -language processing toolkits ===
The following '''natural -language processing [[List of toolkits|toolkits]]''' are notable collections of [[natural language processing|natural-language processing]] software. They are suites of [[Library (computer science)|libraries]], [[Software framework|frameworks]], and [[Software application|applications]] for symbolic, statistical natural -language and speech processing.
 
{|class="wikitable sortable"
Line 552 ⟶ 548:
|}
 
=== Named -entity recognizers ===
* ABNER (A Biomedical Named -Entity Recognizer) &ndash; open source text mining program that uses linear-chain conditional random field sequence models. It automatically tags genes, proteins and other entity names in text. Written by Burr Settles of the University of Wisconsin-Madison.
* Stanford NER (Named -Entity Recognizer) — Java implementation of a Named -Entity Recognizer that uses linear-chain conditional random field sequence models. It automatically tags persons, organizations, and locations in text in English, German, Chinese, and Spanish languages. Written by Jenny Finkel and other members of the Stanford NLP Group at Stanford University.
 
=== Translation software ===
Line 568 ⟶ 564:
 
=== Other software ===
* [[CTAKES]] &ndash; open-source natural -language processing system for information extraction from electronic medical record clinical free-text. It processes clinical notes, identifying types of clinical named entities — drugs, diseases/disorders, signs/symptoms, anatomical sites and procedures. Each named entity has attributes for the text span, the ontology mapping code, context (family history of, current, unrelated to patient), and negated/not negated. Also known as Apache cTAKES.
* [[Digital Media Access Protocol|DMAP]] &ndash;
* [[ETAP-3]] &ndash; proprietary linguistic processing system focusing on English and Russian.<ref>{{cite web|url=http://www.iitp.ru/ru/science/works/452.htm |title=МНОГОЦЕЛЕВОЙ ЛИНГВИСТИЧЕСКИЙ ПРОЦЕССОР ЭТАП-3 |publisher=Iitp.ru |access-date=2012-02-14}}</ref> It is a [[Rule-based machine translation|rule-based system]] which uses the [[Meaning-Text Theory]] as its theoretical foundation.
* [[JAPE (linguistics)|JAPE]] &ndash; the Java Annotation Patterns Engine, a component of the open-source General Architecture for Text Engineering (GATE) platform. JAPE is a finite state transducer that operates over annotations based on regular expressions.
* [[LOLITA]] &ndash; "Large-scale, Object-based, Linguistic Interactor, Translator and Analyzer". LOLITA was developed by Roberto Garigliano and colleagues between 1986 and 2000. It was designed as a general-purpose tool for processing unrestricted text that could be the basis of a wide variety of applications. At its core was a semantic network containing some 90,000 interlinked concepts.
* [[Maluuba]] &ndash; intelligent personal assistant for Android devices, that uses a contextual approach to search which takes into account the user's geographic ___location, contacts, and language.
* [[METAL MT]] &ndash; machine translation system developed in the 1980s at the University of Texas and at Siemens which ran on Lisp Machines.
* [[Never-Ending Language Learning]] &ndash; semantic machine learning system developed by a research team at Carnegie Mellon University, and supported by grants from DARPA, Google, and the NSF, with portions of the system running on a supercomputing cluster provided by Yahoo!.<ref name=NYT2010>{{cite news |title=Aiming to Learn as We Do, a Machine Teaches Itself |url=https://www.nytimes.com/2010/10/05/science/05compute.html?hpw=&pagewanted=all |quote=Since the start of the year, a team of researchers at Carnegie Mellon University — supported by grants from the Defense Advanced Research Projects Agency and Google, and tapping into a research supercomputing cluster provided by Yahoo — has been fine-tuning a computer system that is trying to master semantics by learning more like a human. |work=[[New York Times]] |date=October 4, 2010 |access-date=2010-10-05 }}</ref> NELL was programmed by its developers to be able to identify a basic set of fundamental semantic relationships between a few hundred predefined categories of data, such as cities, companies, emotions and sports teams. Since the beginning of 2010, the Carnegie Mellon research team has been running NELL around the clock, sifting through hundreds of millions of web pages looking for connections between the information it already knows and what it finds through its search process – to make new connections in a manner that is intended to mimic the way humans learn new information.<ref>[http://rtw.ml.cmu.edu/rtw/overview Project Overview], [[Carnegie Mellon University]]. Accessed October 5, 2010.</ref>
* [[NLTK]] &ndash;
Line 585 ⟶ 581:
* [[Weka (machine learning)|Weka's]] classification tools &ndash;
* [[word2vec]] &ndash; models that were developed by a team of researchers led by Thomas Milkov at Google to generate word embeddings that can reconstruct some of the linguistic context of words using shallow, two dimensional neural nets derived from a much larger vector space.
* [[Festival Speech Synthesis System]] &ndash;
* [[CMU Sphinx]] speech recognition system &ndash;
* [[Language Grid]] -&ndash; Open source platform for language web services, which can customize language services by combining existing language services.
 
=== Chatterbots ===
{{mainMain|List of chatbots}}
{{For|online chatterbots with [[avatar (computing)|avatars]]|Automated online assistant}}
[[Chatterbot]] &ndash; a text-based conversation [[Software agent|agent]] that can interact with human users through some medium, such as an [[instant message]] service. Some chatterbots are designed for specific purposes, while others converse with human users on a wide range of topics.<!--
Line 596 ⟶ 592:
Please add new entries alphabetically to the appropriate section according to the guidelines on the TalkPage regarding encyclopaedic relevance. Provide references and short descriptions as appropriate.-->
 
==== Classic chatterbots ====
* [[Dr. Sbaitso]]▼
* [[ELIZA]]▼
* [[PARRY]]▼
* [[Racter]] (or Claude Chatterbot)▼
* [[Mark V Shaney]]▼
 
====Instant messengerGeneral chatterbots ====▼
▲*[[Dr. Sbaitso]]
* [[Albert One]] -&ndash; 1998 and 1999 [[Loebner Prize|Loebner]] winner, by [[Robby Garner]].▼
▲*[[ELIZA]]
* [[Artificial Linguistic Internet Computer Entity|A.L.I.C.E.]] -&ndash; 2001, 2002, and 2004 [[Loebner Prize]] winner developed by [[Richard Wallace (scientist)|Richard Wallace]].▼
▲*[[PARRY]]
* [[Charlix]]▼
▲*[[Racter]] (or Claude Chatterbot)
* [[Cleverbot]] (winner of the 2010 Mechanical Intelligence Competition)▼
▲*[[Mark V Shaney]]
* [[Elbot]] -&ndash; 2008 [[Loebner Prize]] winner, by [[Fred Roberts]].▼
* [[Eugene Goostman]] -&ndash; 2012 Turing 100 winner, by [[Vladimir Veselov]].▼
* [[Fred (chatterbot)|Fred]] -&ndash; an early chatterbot by [[Robby Garner]].▼
* [[Jabberwacky]]▼
* [[Jeeney AI]]▼
* [[MegaHAL]]▼
* [[Mitsuku]], 2013 and 2016 [[Loebner Prize]] winner<ref>{{cite web|url=http://www.paulmckevitt.com/loebner2013/|title=Loebner Prize Contest 2013 |publisher=People.exeter.ac.uk |date=2013-09-14 |access-date=2013-12-02}}</ref>▼
* Rose - ... 2015 - 3x [[Loebner Prize]] winner, by [[Bruce Wilcox]].▼
* [[SimSimi]] -&ndash; A popular artificial intelligence conversation program that was created in 2002 by ISMaker.▼
* [[Starship Titanic#Gameplay|Spookitalk]] -&ndash; A chatterbot used for [[Non-player character|NPCs]] in [[Douglas Adams]]' ''[[Starship Titanic]]'' video game.▼
* [[Ultra Hal Assistant|Ultra Hal]] -&ndash; 2007 [[Loebner Prize]] winner, by [[Robert Medeksza]].▼
* [[Verbot]]▼
 
====General Instant messenger chatterbots ====
* [[GooglyMinotaur]], specializing in [[Radiohead]], the first bot released by [[ActiveBuddy]] (June 2001-March 2002)<ref>{{Cite news▼
 
▲*[[Albert One]] - 1998 and 1999 [[Loebner Prize|Loebner]] winner, by [[Robby Garner]].
▲*[[Artificial Linguistic Internet Computer Entity|A.L.I.C.E.]] - 2001, 2002, and 2004 [[Loebner Prize]] winner developed by [[Richard Wallace (scientist)|Richard Wallace]].
▲*[[Charlix]]
▲*[[Cleverbot]] (winner of the 2010 Mechanical Intelligence Competition)
▲*[[Elbot]] - 2008 [[Loebner Prize]] winner, by [[Fred Roberts]].
▲*[[Eugene Goostman]] - 2012 Turing 100 winner, by [[Vladimir Veselov]].
▲*[[Fred (chatterbot)|Fred]] - an early chatterbot by [[Robby Garner]].
▲*[[Jabberwacky]]
▲*[[Jeeney AI]]
▲*[[MegaHAL]]
▲*[[Mitsuku]], 2013 and 2016 [[Loebner Prize]] winner<ref>{{cite web|url=http://www.paulmckevitt.com/loebner2013/|title=Loebner Prize Contest 2013 |publisher=People.exeter.ac.uk |date=2013-09-14 |access-date=2013-12-02}}</ref>
▲*Rose - ... 2015 - 3x [[Loebner Prize]] winner, by [[Bruce Wilcox]].
▲*[[SimSimi]] - A popular artificial intelligence conversation program that was created in 2002 by ISMaker.
▲*[[Starship Titanic#Gameplay|Spookitalk]] - A chatterbot used for [[Non-player character|NPCs]] in [[Douglas Adams]]' ''[[Starship Titanic]]'' video game.
▲*[[Ultra Hal Assistant|Ultra Hal]] - 2007 [[Loebner Prize]] winner, by [[Robert Medeksza]].
▲*[[Verbot]]
 
▲====Instant messenger chatterbots====
▲*[[GooglyMinotaur]], specializing in [[Radiohead]], the first bot released by [[ActiveBuddy]] (June 2001-March 2002)<ref>{{Cite news
| last = Gibes
| first = Al
Line 631 ⟶ 625:
| date = 2002-03-25
}}</ref>
* [[SmarterChild]], developed by [[ActiveBuddy]] and released in June 2001<ref>{{Cite news
|url=http://www.thefreelibrary.com/ActiveBuddy+Introduces+Software+to+Create+and+Deploy+Interactive...-a088988298
| title = ActiveBuddy Introduces Software to Create and Deploy Interactive Agents for Text Messaging; ActiveBuddy Developer Site Now Open: www.BuddyScript.com
Line 649 ⟶ 643:
| url = http://www.foo.be/docs/tpj/issues/vol3_2/tpj0302-0002.html
}}</ref>
* [[Negobot]], a bot designed to catch online pedophiles by posing as a young girl and attempting to elicit personal details from people it speaks to.<ref>{{cite book|last1=Laorden|first1=Carlos|last2=Galan-Garcia|first2=Patxi|last3=Santos|first3=Igor|last4=Sanz|first4=Borja|last5=Hidalgo|first5=Jose Maria Gomez|last6=Bringas|first6=Pablo G.|title=Negobot: A conversational agent based on game theory for the detection of paedophile behaviour|date=23 August 2012|url=http://paginaspersonales.deusto.es/isantos/publications/2012/Laorden_2012_CISIS_Negobot.pdf|isbn=978-3-642-33018-6|url-status=dead|archive-url=https://web.archive.org/web/20130917013039/http://paginaspersonales.deusto.es/isantos/publications/2012/Laorden_2012_CISIS_Negobot.pdf|archive-date=2013-09-17}}</ref>
 
== Natural -language processing organizations ==
* [[AFNLP]] (Asian Federation of Natural Language Processing Associations) &ndash; the organization for coordinating the natural -language processing related activities and events in the Asia-Pacific region.
* [[Australasian Language Technology Association]] &ndash;
* [[Association for Computational Linguistics]] &ndash; international scientific and professional society for people working on problems involving natural -language processing.
 
=== Natural -language processing-related conferences ===
* [[Annual Meeting of the Association for Computational Linguistics]] (ACL)
* [[International Conference on Intelligent Text Processing and Computational Linguistics]] (CICLing)
* [[International Conference on Language Resources and Evaluation]] – biennial conference organised by the European Language Resources Association with the support of institutions and organisations involved in Natural natural-language processing
* [[Annual Conference of the North American Chapter of the Association for Computational Linguistics]] (NAACL)
* [[Text, Speech and Dialogue]] (TSD) – annual conference
* [[Text Retrieval Conference]] (TREC) – on-going series of workshops focusing on various information retrieval (IR) research areas, or tracks
 
=== Companies involved in natural -language processing ===
* [[AlchemyAPI]] &ndash; service provider of a natural -language processing API.
* [[Google, Inc.]] &ndash; the Google search engine is an example of automatic summarization, utilizing keyphrase extraction.
* [[Calais (Reuters product)]] &ndash; provider of a natural -language processing services.
* [[Wolfram Research, Inc.]] developer of natural -language processing computation engine [[Wolfram Alpha]].
 
== Natural -language processing publications ==
 
=== Books ===
 
* ''[https://www.amazon.com/Connectionist-Statistical-Symbolic-Approaches-Processing/dp/3540609253 Connectionist, Statistical and Symbolic Approaches to Learning for Natural Language Processing ]'' &ndash; Wermter, S., Riloff E. and Scheler, G. (editors).<ref>{{cite book |last1=Wermter |first1=Stephan |title=Connectionist, Statistical and Symbolic Approaches to Learning for Natural Language Processing |year=1996|publisher=Springer |author2=Ellen Riloff |author3=Gabriele Scheler }}</ref> First book that addressed statistical and neural network learning of language.
* ''[http://www.cs.colorado.edu/~martin/slp.html Speech and Language Processing: An Introduction to Natural Language Processing, Speech Recognition, and Computational Linguistics]'' &ndash; by [[Daniel Jurafsky]] and [[James H. Martin]].<ref>{{cite book |last1=Jurafsky |first1=Dan |title=Speech and Language Processing. An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition |year=2008|publisher=Prentice Hall |___location=Upper Saddle River (N.J.) |page=2 |url=http://www.cs.colorado.edu/~martin/slp.html |author2=James H. Martin |edition=2nd}}</ref> Introductory book on language technology.
Line 683 ⟶ 676:
* ''[[Computational Linguistics (journal)|Computational Linguistics]]'' &ndash; peer-reviewed academic journal in the field of computational linguistics. It is published quarterly by MIT Press for the Association for Computational Linguistics (ACL)
 
== People influential in natural -language processing ==
* [[Daniel Bobrow]] &ndash;
* [[Rollo Carpenter]] &ndash; creator of Jabberwacky and Cleverbot.
Line 695 ⟶ 688:
* [[Lyn Frazier]] &ndash;
* [[Daniel Jurafsky]] &ndash; Professor of Linguistics and Computer Science at Stanford University. With [[James H. Martin]], he wrote the textbook ''Speech and Language Processing: An Introduction to Natural Language Processing, Speech Recognition, and Computational Linguistics''
* [[Roger Schank]] &ndash; introduced the [[conceptual dependency theory]] for natural -language understanding.<ref>[[Roger Schank]], 1969, ''A conceptual dependency parser for natural language'' Proceedings of the 1969 conference on Computational linguistics, Sång-Säby, Sweden, pages 1-3</ref>
* [[Jean E. Fox Tree]] &ndash;
* [[Alan Turing]] &ndash; originator of the [[Turing Test]].
Line 702 ⟶ 695:
* [[William Aaron Woods]] &ndash;
* [[Maurice Gross]] &ndash; author of the concept of local grammar,<ref name="AHI">[http://hdl.handle.net/2042/14456 Ibrahim, Amr Helmy. 2002. "Maurice Gross (1934-2001). À la mémoire de Maurice Gross". ''Hermès'' 34.]</ref> taking finite automata as the competence model of language.<ref name="RD">[http://www.nyu.edu/pages/linguistics/kaliedoscope/mauricegross13.pdf Dougherty, Ray. 2001. ''Maurice Gross Memorial Letter''.]</ref>
* [[Stephen Wolfram]] &ndash; CEO and founder of [[Wolfram Research]], creator of the programming language (natural -language understanding) [[Wolfram Language]], and natural -language processing computation engine [[Wolfram Alpha]].<ref>{{cite web|url=https://blog.wolfram.com/2010/11/16/programming-with-natural-language-is-actually-going-to-work/|title=Programming with Natural Language Is Actually Going to Work—Wolfram Blog}}</ref>
* [[Victor Yngve]] &ndash;
 
Line 711 ⟶ 704:
* [[Watson (computer)]]
* [[Biomedical text mining]]
* [[Compound -term processing]]
* [[Computer-assisted reviewing]]
* [[Controlled natural language]]
* [[Deep linguistic processing]]
* [[Foreign -language reading aid]]
* [[Foreign -language writing aid]]
* [[Language technology]]
* [[Latent Dirichlet allocation|Latent Dirichlet allocation (LDA)]]
* [[Latent semantic indexing]]
* [[List of natural language processing projects|List of natural-language processing projects]]
* [[LRE Map]]
* [[Natural -language programming]]
* [[Reification (linguistics)]]
* [[Semantic folding]]
Line 736 ⟶ 729:
== Bibliography ==
* {{Crevier 1993}}
* {{Citation | last=McCorduck | first=Pamela | title = Machines Who Think | year = 2004 | edition=2nd | ___location=Natick, MA | publisher=A. K. Peters, Ltd. | isbn=978-1-56881-205-2 | oclc=52197627}}.
* {{Russell Norvig 2003}}.
 
Retrieved from "https://en.wikipedia.org/wiki/Outline_of_natural_language_processing"