General Architecture for Text Engineering: Difference between revisions

Revision as of 16:59, 12 June 2015

Latest revision as of 22:10, 13 August 2025

(32 intermediate revisions by 25 users not shown)

Line 1:

{{Infobox software

| name = GATE

| screenshot = [[Image:GATE5 main window.png|250px]]

| screenshot size = 250px

| caption = GATE Developer v5 main window

| developer = [httphttps://gate.ac.uk/people GATE research team], [http://www.dcs.shef.ac.uk/ Dept. Computer Science, University of Sheffield]

| released = {{start date and age |1995}}

| frequently_updated = yes<!-- Release version update? Don't edit this page, just click on the version number! -->

| programming language = [[Java (programming language)|Java]]

| operating system = [[Cross-platform]]

| language = English

| genre = [[Text mining]] [[Information Extractionextraction]]

| license = [[LGPL]]

| website = {{url|httphttps://gate.ac.uk}}

}}

'''General Architecture for Text Engineering''' or ('''GATE''') is a [[Java (programming language)|Java]] suite of tools originally developed at the [[Universitynatural oflanguage Sheffieldprocessing]] beginning(NLP) in 1995 and now used worldwide by a wide community of scientists, companies, teachers and studentstools for many [[natural language processing]]man tasks, including [[information extraction]] in many languages.<ref>Languages mentioned on httphttps://gate.ac.uk/gate/plugins/ include Arabic, Bulgarian, Cebuano, Chinese, French, German, Hindi, Italian, Romanian and Russian.</ref> It is now used worldwide by a wide community of scientists, companies, teachers and students. It was originally developed at the [[University of Sheffield]] beginning in 1995.

As of May 28, 2011, 881 people are on the gate-users mailing list at SourceForge.net, and 111,932 downloads from [[SourceForge]] are recorded since the project moved to SourceForge in 2005.<ref>[http{{cite web|url=https://sourceforge.net/projects/gate/ |title=GATE|access-date=17 projectDecember page on SourceForge]2016}}</ref> The paper "GATE: A Frameworkframework and Graphicalgraphical Developmentdevelopment Environmentenvironment for Robustrobust NLP Toolstools and Applicationsapplications"<ref>[httphttps://gatewww.acaclweb.ukorg/saleanthology/acl02P02-1022/acl-main.pdf "GATE: A Frameworkframework and Graphicalgraphical Developmentdevelopment Environmentenvironment for Robustrobust NLP Toolstools and Applicationsapplications"], by Cunningham H., [[Diana Maynard|Maynard D.]], Bontcheva K. and Tablan V. (In proc. of the 40th Anniversary Meeting of the Association for Computational Linguistics, 2002)]</ref> has received over 8002000 citations in the seven years since publication (according to Google Scholar). Books covering the use of GATE, in addition to the GATE User Guide,<ref>[http{{cite web|url=https://gate.ac.uk/userguide/ |title=GATE.ac.uk User- Guide]sale/tao/split.html|access-date=17 December 2016}}</ref> include "Building Search Applications: Lucene, LingPipe, and Gate", by Manu Konchady,<ref>Konchady, Manu. [httphttps://books.google.cacom/books?id=mcM-OAAACAAJ&dqq=Building+Search+Applications:+Lucene,+LingPipe,+and+Gate&hl=en&ei=avbDTczPJITqrQfk1IXQBA&sa=X&oi=book_result&ct=result&resnum=1&ved=0CDEQ6AEwAA Building Search Applications: Lucene, LingPipe, and Gate]. Mustru Publishing. 2008.</ref> and "Introduction to Linguistic Annotation and Text Analytics", by Graham Wilcock.<ref>[http{{cite book|url=https://books.google.co.ukcom/books?id=TDQJb1UgVywC&dqq=Introduction+%20to%20Linguistic%20Annotation%20and%20Text%20Analytics|title=Introduction to+ Linguistic+ Annotation+ and+ Text+ Analytics&printsec|first=frontcover&sourceGraham|last=bl&otsWilcock|date=bAF26ZQSTx&sig1 January 2009|publisher=TbxZ_-3tRy3IeDBKFofeVN6bAIcMorgan &hl Claypool Publishers|isbn=en&ei=vc0gS7PlLo9781598297386|access-64QaSgqnfCQ&sadate=X&oi=book_result&ct=result&resnum=2&ved=0CBcQ6AEwAQ#v=onepage&q=&f=false17 "IntroductionDecember to2016|via=Google Linguistic Annotation and Text Analytics", by Graham Wilcock]Books}}</ref>

GATE has been compared to [[NLTK]], [[R (programming_language)|R]] and [[RapidMiner]].<ref>[http://www.b-eye-network.com/view/9516 "Open Source Text Analytics" web article by Seth Grimes]</ref> As well as being widely used in its own right, it forms the basis of the KIM semantic platform.<ref>[http://journals.cambridge.org/action/displayAbstract?fromPage=online&aid=252243 "KIM – a semantic platform for information extraction and retrieval", by Popov et al (Natural Language Engineering (2004), 10:375-392)]</ref>

GATE community and research has been involved in several European research projects including: [[Transitioning Applications to Ontologies|TAO]], [[SEKT]], NeOn, Media-Campaign, Musing, [[Service-Finder]], LIRICS and [[KnowledgeWeb Project|KnowledgeWeb]], as well as many other projects.

As of May 28, 2011, 881 people are on the gate-users mailing list at SourceForge.net, and 111,932 downloads from [[SourceForge]] are recorded since the project moved to SourceForge in 2005.<ref>[http://sourceforge.net/projects/gate/ GATE project page on SourceForge]</ref> The paper "GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications"<ref>[http://gate.ac.uk/sale/acl02/acl-main.pdf "GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications", by Cunningham H., Maynard D., Bontcheva K. and Tablan V. (In proc. of the 40th Anniversary Meeting of the Association for Computational Linguistics, 2002)]</ref> has received over 800 citations in the seven years since publication (according to Google Scholar). Books covering the use of GATE, in addition to the GATE User Guide,<ref>[http://gate.ac.uk/userguide/ GATE User Guide]</ref> include "Building Search Applications: Lucene, LingPipe, and Gate", by Manu Konchady,<ref>Konchady, Manu. [http://books.google.ca/books?id=mcM-OAAACAAJ&dq=Building+Search+Applications:+Lucene,+LingPipe,+and+Gate&hl=en&ei=avbDTczPJITqrQfk1IXQBA&sa=X&oi=book_result&ct=result&resnum=1&ved=0CDEQ6AEwAA Building Search Applications: Lucene, LingPipe, and Gate]. Mustru Publishing. 2008.</ref> and "Introduction to Linguistic Annotation and Text Analytics", by Graham Wilcock.<ref>[http://books.google.co.uk/books?id=TDQJb1UgVywC&dq=Introduction+to+Linguistic+Annotation+and+Text+Analytics&printsec=frontcover&source=bl&ots=bAF26ZQSTx&sig=TbxZ_-3tRy3IeDBKFofeVN6bAIc&hl=en&ei=vc0gS7PlLo-64QaSgqnfCQ&sa=X&oi=book_result&ct=result&resnum=2&ved=0CBcQ6AEwAQ#v=onepage&q=&f=false "Introduction to Linguistic Annotation and Text Analytics", by Graham Wilcock]</ref>

== Features ==

Line 25 ⟶ 23:

GATE includes an [[information extraction]] system called '''ANNIE''' ('''A Nearly-New Information Extraction System''') which is a set of modules comprising a [[Lexical analysis|tokenizer]], a [[gazetteer]], a [[Sentence boundary disambiguation|sentence splitter]], a [[Part-of-speech tagging|part of speech tagger]], a [[Named entity recognition|named entities]] transducer and a [[coreference]] tagger. ANNIE can be used as-is to provide basic [[information extraction]] functionality, or provide a starting point for more specific tasks.

Languages currently handled in GATE include [[English language|English]], [[Spanish language|Spanish]], [[MandarinStandard Chinese|Chinese]], [[Arabic]], [[Bulgarian language|Bulgarian]], [[French language|French]], [[German language|German]], [[Hindi]], [[Italian language|Italian]], [[Cebuano language|Cebuano]], [[Romanian language|Romanian]], [[Russian language|Russian]], [[Danish language|Danish]].

Plugins are included for [[machine learning]] with [[Weka (machine learning)|Weka]], RASP, MAXENT, SVM Light, as well as a [[LIBSVM]] integration and an in-house [[perceptron]] implementation, for managing [[Ontology_Ontology (information_scienceinformation science)|ontologies]] like [[WordNet]], for querying [[search engines]] like [[Google]] or [[Yahoo]], for [[part of speech tagging]] with [[Brill tagger|Brill]] or TreeTagger, and many more. Many external plugins are also available, for handling e.g. [[Twitter|tweets]].<ref>[{{cite web|url=https://gate.ac.uk/wiki/twitie.html TwitIE|title=GATE.ac.uk - An Openwiki/twitie.html|access-Sourcedate=17 InformationDecember Extraction Pipeline for Microblog Text]2016}}</ref>

GATE accepts input in various formats, such as [[Text file|TXT]], [[HTML]], [[XML]], [[DOC (computing)|Doc]], [[PDF]] documents, and [[Serialization|Java Serial]], [[PostgreSQL]], [[Lucene]], [[Oracle database|Oracle]] Databases with help of [[RDBMS]] storage over [[JDBC]].

[[JAPE (linguistics)|JAPE]] transducers are used within GATE to manipulate annotations on text. Documentation is provided in the GATE User Guide.<ref>[http{{cite web|url=https://gate.ac.uk/userguide/chap:jape|title=GATE.ac.uk JAPE- chaptersale/tao/splitch8.html|access-date=17 inDecember the GATE User Guide]2016}}</ref> A tutorial has also been written by Press Association Images.<ref>[http{{cite web|url=https://realizingsemanticweb.blogspot.com/2009/07/jape-grammar-tutorial.html|title=Realizing ASemantic Web: JAPE grammar tutorial|first=Dhavalkumar|last=Thakker|date=17 fromJuly Press2009|access-date=17 AssociationDecember Images, UK]2016}}</ref>

== GATE Developer ==

Line 37 ⟶ 35:

[[Image:GATE5 main window.png|thumb|400px|GATE 5 main window.]]

The screenshot shows the document viewer used to display a document and its annotations. In pink are <A>{{tag|a|o}} hyperlink annotations from an [[Hypertext Markup Language|HTML]] file. The right list is the annotation sets list, and the bottom table is the annotation list. In the center is the annotation editor window.

== GATE Mímir ==

<!-- re-written to remove any lingering copyright worries -->

GATE based applications often generategenerates vast quantities of information including; natural language text, semantic annotations, and ontological information. Sometimes the data itself is the end product of an application but often the information would be more useful if it could be efficiently searched. GATE Mimir provides support for indexing and searching the linguistic and semantic information generated by such applications and allows for querying the information using arbitrary combinations of text, structural information, and [[SPARQL]].

==See also==

{{Portal|Free and open-source software}}

* [[Unstructured Information Management Architecture]] (UIMA)

* [[OpenNLP]]

* [[List of natural language processing toolkits]]

* [[Pheme (project)|Pheme]], a major EU project managed by the GATE group on early detection of false information in social media

==References==

<references/>

==External links==

* {{Official website|https://gate.ac.uk/}}

{{DEFAULTSORT:General Architecture For Text Engineering}}