Document clustering: Difference between revisions

Revision as of 16:32, 24 December 2019

Latest revision as of 02:19, 10 January 2025

(4 intermediate revisions by 4 users not shown)

Line 1:

{{Short description|Grouping texts by similarity}}

{{Multiple issues|

{{disputed|date=March 2014}}

{{more footnotes needed|date=March 2014}}

}}

Line 13 ⟶ 14:

In general, there are two common algorithms. The first one is the hierarchical based algorithm, which includes single link, complete linkage, group average and Ward's method. By aggregating or dividing, documents can be clustered into hierarchical structure, which is suitable for browsing. However, such an algorithm usually suffers from efficiency problems. The other algorithm is developed using the [[K-means algorithm]] and its variants. Generally hierarchical algorithms produce more in-depth information for detailed analyses, while algorithms based around variants of the [[K-means algorithm]] are more efficient and provide sufficient information for most purposes.<ref name="manning">Manning, Chris, and Hinrich Schütze, ''Foundations of Statistical Natural Language Processing'', MIT Press. Cambridge, MA: May 1999.</ref>{{rp|Ch.14}}

These algorithms can further be classified as hard or soft clustering algorithms. Hard clustering computes a hard assignment – each document is a member of exactly one cluster. The assignment of soft clustering algorithms is soft – a document’sdocument's assignment is a distribution over all clusters. In a soft assignment, a document has fractional membership in several clusters.<ref name="manning"/>{{rp|499}} [[Dimensionality reduction]] methods can be considered a subtype of soft clustering; for documents, these include [[latent semantic indexing]] ([[truncated singular value decomposition]] on term histograms)<ref>http://nlp.stanford.edu/IR-book/pdf/16flat.pdf {{Bare URL PDF|date=March 2022}}</ref> and [[topic model]]s.

Other algorithms involve graph based clustering, [[ontology (information science)|ontology]] supported clustering and order sensitive clustering.

Line 54 ⟶ 55:

==See also==

*[[Cluster (disambiguation)|Cluster]]

*[[Cluster Analysis]]

*[[Fuzzy clustering]]

Line 65:

* Claudio Carpineto, Stanislaw Osiński, Giovanni Romano, Dawid Weiss. A survey of Web clustering engines. ACM Computing Surveys, Volume 41, Issue 3 (July 2009), Article No. 17, {{ISSN|0360-0300}}

*Wui Lee Chang, Kai Meng Tay, and Chee Peng Lim, A New Evolving Tree-Based Model with Local Re-learning for Document Clustering and Visualization, Neural Processing Letters, DOI: 10.1007/s11063-017-9597-3. https://link.springer.com/article/10.1007/s11063-017-9597-3

{{Natural language processing}}

[[Category:Information retrieval techniques]]