Hoshen–Kopelman algorithm: Difference between revisions

Revision as of 05:02, 23 September 2016

Latest revision as of 04:02, 25 May 2025

(36 intermediate revisions by 30 users not shown)

Line 1:

{{short description|Algorithm for labeling clusters on a grid}}

{{Refimprove|date=September 2016}}

{{Machine learning bar}}

The '''Hoshen–Kopelman algorithm''' is a simple and efficient [[algorithm]] for labeling [[Cluster analysis|clusters]] on a grid., Wherewhere the grid is a regular [[Network theory|network]] of cells, with the cells being either occupied or unoccupied. This algorithm is based on a well-known [[Disjoint-set data structure|union-finding algorithm]].<ref>{{Cite web |title=Union-Find Algorithms |url=https://www.cs.princeton.edu/~rs/AlgsDS07/01UnionFind.pdf |url-status=usurped |archive-url=https://web.archive.org/web/20210530054627/https://www.cs.princeton.edu/~rs/AlgsDS07/01UnionFind.pdf |archive-date=2021-05-30 |website=Princeton Computer Science}}</ref> The algorithm was originally described in by J.Joseph Hoshen and R.[[Raoul Kopelman]] in their 1976 paper "Percolation and Cluster Distribution. I. Cluster Multiple Labeling Technique and Critical Concentration Algorithm".<ref>{{cite journal|url=http://link.aps.org/doi/10.1103/PhysRevB.14.3438|title=Percolation and cluster distribution. I. Cluster multiple labeling technique and critical concentration algorithm|first1=J.|last1=Hoshen|first2=R.|last2=Kopelman|date=15 October 1976|publisher=|journal=Phys. Rev. B|volume=14|issue=8|pages=3438–3445|via=APS|doi=10.1103/PhysRevB.14.3438|bibcode=1976PhRvB..14.3438H|url-access=subscription}}</ref>

== Percolation theory ==

[[Percolation theory]] is the study of the behavior and [[statistics]] of [[Clustercluster analysis|clusters]] on [[Lattice graph|lattices]]. Suppose we have a large square lattice where each cell can be occupied with the [[probability]] ''<code>p''</code> and can be empty with the probability <code>1&nbsp;–&nbsp;''p''</code>. Each group of neighboring occupied cells forms a cluster. Neighbors are defined as cells having a common side but not those sharing only a corner i.e. we consider 4x4the [[Pixel connectivity|4-connected neighborhood.]] that is (top, bottom, left, and right). Each occupied cell is occupied independentlyindependent of the status of its neighborhood. The number of clusters, athe size of each cluster and their distribution are important topics in percolation theory.

<center>

{| style="margin: auto;"

{|

|-

| <gallery>

Occupied_Grids_P_%3D_0.24.png | <{{center><strong>|'''Figure (a)</strong></center>'''}}

</gallery> || <gallery>

Occupied_Grids_P_%3D_0.64.png | <{{center><strong>|'''Figure (b)</strong></center>'''}}

</gallery> || Consider <code>5x5</code> grids in figurefigures (a) and (b).<br /> In figure (a), the probability of occupancy is <code>p = 6/25 = 0.24</code>.<br /> In figure (b), the probability of occupancy is <code>p = 16/25 = 0.64</code>.

|}

</center>

== Hoshen–Kopelman algorithm for cluster finding ==

In this algorithm, we scan through a grid looking for occupied cells and labeling them with cluster labels. The scanning process is called a [[raster scan]]. The algorithm begins with scanning the grid cell by cell and checkchecking ifwhether the cell is occupied, ifor not. If the cell is occupied, then this cellit must be labelledlabeled with a cluster label. This cluster label is decidedassigned based on the neighbors of thethat cell. which(For havethis beenwe previouslyare scannedgoing andto labelled,use and[[Union-find algorithm|Union-Find Algorithm]] which is explained in the next section.) ifIf the cell doesn’t have any occupied neighbors, then a new label is assigned to the cell.<ref name=":0" />

== Union-find algorithm ==

The union-findThis algorithm is aused simpleto methodrepresent fordisjoint computingsets. [[equivalence class]]es. Calling the function <code>union(x,y)</code> specifies thatplaces items <code>x</code> and <code>y</code> are members ofinto the same equivalence classset. BecauseA equivalencesecond relations are [[Transitive relation|transitive]]; all items equivalent tofunction <code>find(x)</code> arereturns equivalenta torepresentative allmember itemsof equivalentthe set to which <code>yx</code> belongs. Thus forThe anyrepresentative itemmember of the set containing <code>x</code>, there is athe setlabel ofwe itemswill whichapply areto allthe equivalentcluster to which <code>x</code> are;belongs. this setA iskey theto equivalencethe classefficiency of whichthe <code>x</code>[[Union-find isalgorithm|Union-Find aAlgorithm]] member.is Athat second functionthe <code>find(x)</code> returnsoperation aimproves representativethe memberunderlying offorest thedata equivalencestructure classthat torepresents whichthe sets, making future <code>xfind</code> belongsqueries more efficient.

== Pseudo-codePseudocode ==

So inDuring the [[raster scan]] of the grid in question, each timewhenever an occupied cell is encountered, aneighboring checkcells isare donescanned to seecheck whether this cell has any neighboringof cells whothem have already been scanned. If sowe find already scanned neighbors, first athe <code>union</code> operation is performed, to specify that these neighboring cells are in fact members of the same equivalence classset. Then a the<code>find</code> operation is performed to find a representative member of that equivalence classset with which to label the current cell. Ifwill onbe the other hand, the current cell has no neighbors, it is assigned a new, previously unused, labellabeled. The entire grid is processed in this way. The grid can be raster-scanned a second time, performing only <code>find</code> operations at each cell, to re-label the cells with their final assignment of a representative element.

Following pseudo-code is referred from one of the University of California Berkeley's projects.<ref>{{cite web|url=https://www.ocf.berkeley.edu/~fricke/projects/hoshenkopelman/hoshenkopelman.html |title=The Hoshen-Kopelman Algorithm |website=Ocf.berkeley.edu |date=2004-04-21 |accessdate=2016-09-17}}</ref>

<strong>Raster Scan and Labeling on the Grid</strong>

largest_label = 0;

for x in 0 to n_columns {

for y in 0 to n_rows {

if occupied[x,y] then

left = occupied[x-1,y];

above = occupied[x,y-1];

if (left == 0) and (above == 0) then /* Neither a label above nor to the left. */

largest_label = largest_label + 1; /* Make a new, as-yet-unused cluster label. */

label[x,y] = largest_label;

else if (left != 0) and (above == 0) then /* One neighbor, to the left. */

label[x,y] = find(left);

else if (left == 0) and (above != 0) then /* One neighbor, above. */

label[x,y] = find(above);

else /* Neighbors BOTH to the left and above. */

union(left,above); /* Link the left and above clusters. */

label[x,y] = find(left);

}

}

On the other hand, if the current cell has no neighbors, it is assigned a new, previously unused, label. The entire grid is processed in this way.

<strong>Union</strong>

void union(int x, int y) {

labels[find(x)] = find(y);

}

Following [[pseudocode]] is referred from [https://www.ocf.berkeley.edu/~fricke/ Tobin Fricke's] implementation of the same algorithm.<ref name=":0">{{cite web|url=https://www.ocf.berkeley.edu/~fricke/projects/hoshenkopelman/hoshenkopelman.html |title=The Hoshen-Kopelman Algorithm for cluster identification|first=Tobin |last=Fricke |website=ocf.berkeley.edu |date=2004-04-21 |access-date=2016-09-17}}</ref> On completion, the cluster labels may be found in <code>labels</code>. Not shown is the second raster scan of the grid needed to produce the example output. In that scan, the value at <code>label[x,y]</code> is replaced by <code>find(label[x,y])</code>.

'''Raster Scan and Labeling on the Grid'''

largest_label = 0;

label = zeros[n_columns, n_rows]

labels = [0:n_columns*n_rows] /* Array containing integers from 0 to the size of the image. */

for x in 0 to n_columns {

for y in 0 to n_rows {

if occupied[x, y] then

left = label[x-1, y];

above = label[x, y-1];

if (left == 0) and (above == 0) then /* Neither a label above nor to the left. */

largest_label = largest_label + 1; /* Make a new, as-yet-unused cluster label. */

label[x, y] = largest_label;

else if (left != 0) and (above == 0) then /* One neighbor, to the left. */

label[x, y] = find(left);

else if (left == 0) and (above != 0) then /* One neighbor, above. */

label[x, y] = find(above);

else /* Neighbors BOTH to the left and above. */

union(left,above); /* Link the left and above clusters. */

label[x, y] = find(left);

}

}

'''Union'''

void union(int x, int y) {

labels[find(x)] = find(y);

}

'''Find'''

int find(int x) {

int y = x;

while (labels[y] != y)

y = labels[y];

while (labels[x] != x) {

int z = labels[x];

labels[x] = y;

x = z;

}

return y;

<strong>Find</strong>

}

int find(int x) {

int y = x;

while (labels[y] != y)

y = labels[y];

while (labels[x] != x) {

int z = labels[x];

labels[x] = y;

x = z;

}

return y;

}

== Example ==

Consider the following example. The dark cells in the grid in <code>figureFigure (ac)</code> represent that they are occupied and the white ones are empty. So by running H–K algorithm on this input we would get the output as shown in <code>figureFigure (bd)</code> with all the clusters labeled.

The algorithm processes the input grid, cell by cell, as follows: Let's say that grid is a two-dimensional array.

Line 73 ⟶ 80:

* <code>grid[0][3]</code> is occupied so check cell to the left which is unoccupied so we increment the current label value and assign the label to the cell as <code>2</code>.

* <code>grid[0][4]</code>, <code>grid[0][5]</code> and <code>grid[1][0]</code> are unoccupied so they are not labeled.

* <code>grid[1][1]</code> is occupied so check cell to the left and above, both the cells are unoccupied so assign a new label <code>3</code>.

* <code>grid[1][2]</code> is occupied so check cell to the left and above, only the cell to the left is occupied so assign the label of a cell on the left to this cell <code>3</code>.

* <code>grid[1][3]</code> is occupied so check cell to the left and above, both the cells are occupied, so merge the two clusters and assign the cluster label of the cell above to the cell on the left and to this cell i.e. <code>2</code>. (Merging using union algorithm will label all the cells with label <code>3</code> to <code>2</code>)

* <code>grid[1][4]</code> is occupied so check cell to the left and above, only the cell to the left is occupied so assign the label of a cell on the left to this cell <code>2</code>.

* <code>grid[1][5]</code> , <code>grid[2][0]</code> and <code>grid[2][1]</code> are unoccupied so they are not labeled.

* <code>grid[2][2]</code> is occupied so check cell to the left and above, only cell above is occupied so assign the label of the cell above to this cell <code>2</code>.

* <code>grid[2][3]</code> , <code>grid[2][4]</code> and <code>grid[2][5]</code> are unoccupied so they are not labeled.

* <code>grid[3][0]</code> is occupied so check cell above which is unoccupied so we increment the current label value and assign the label to the cell as <code>4</code>.

* <code>grid[3][1]</code> is occupied so check cell to the left and above, only the cell to the left is occupied so assign the label of the cell on the left to this cell <code>4</code>.

* <code>grid[3][2]</code> is unoccupied so it is not labeled.

* <code>grid[3][3]</code> is occupied so check cell to the left and above, both the cells are unoccupied so assign a new label <code>5</code>.

* <code>grid[3][4]</code> is occupied so check cell to the left and above, only the cell to the left is occupied so assign the label of the cell on the left to this cell <code>5</code>.

* <code>grid[3][5]</code> , <code>grid[4][0]</code> and <code>grid[4][1]</code> are unoccupied so they are not labeled.

* <code>grid[4][2]</code> is occupied so check cell to the left and above, both the cells are unoccupied so assign a new label <code>6</code>.

* <code>grid[4][3]</code> is occupied so check cell to the left and above, both, cell to the left and above are occupied so merge the two clusters and assign the cluster label of the cell above to the cell on the left and to this cell i.e. <code>5</code>. (Merging using union algorithm will label all the cells with label <code>6</code> to <code>5</code>).

* <code>grid[4][4]</code> is unoccupied so it is not labeled.

* <code>grid[4][5]</code> is occupied so check cell to the left and above, both the cells are unoccupied so assign a new label <code>7</code>.

* <code>grid[5][0]</code> , <code>grid[5][1]</code> , <code>grid[5][2]</code> and <code>grid[5][3]</code> are unoccupied so they are not labeled.

* <code>grid[5][4]</code> is occupied so check cell to the left and above, both the cells are unoccupied so assign a new label <code>8</code>.

* <code>grid[5][5]</code> is occupied so check cell to the left and above, both, cell to the left and above are occupied so merge the two clusters and assign the cluster label of the cell above to the cell on the left and to this cell i.e. <code>7</code>. (Merging using union algorithm will label all the cells with label <code>8</code> to <code>7</code>).

<center>

{| style="margin: auto;"

{|

|-

| <gallery>

H-K algorithm Input.png | <{{center><strong>|'''Figure (ac)</strong></center>'''}}

</gallery> || <gallery>

H-K algorithm output.png | <{{center><strong>|'''Figure (bd)</strong></center>'''}}

</gallery> || Consider <code>6x6</code> grids in figure (ac) and (bd).<br /> Figure (ac), This is the input to the Hoshen–Kopelman algorithm.<br /> Figure (b), This is the output of the algorithm with all the clusters labeled.

|}

</center>

== Applications ==

* SegmentationDetermination andof ClusteringNodal ofDomain aArea Binaryand Nodal Line Lengths Image<ref>{{cite web|url=httphttps://wwwwebhome.scialertweizmann.net/qredirectac.php?doi=jasil/home/feamit/nodalweek/c_joas_nodalweek.2008.2474.2479&linkid=pdf |format=PDF |title=JournalIntroduction ofto Appliedthe SciencesHoshen-Kopelman algorithm and its application to nodal ___domain statistics |issnauthor=1812-5654Christian Joas |website=ScialertWebhome.netweizmann.ac.il |accessdateaccess-date=2016-09-17}}</ref>

* [[Connectivity (graph theory)|Nodal Connectivity Information]]

* Determination of Nodal Domain Area and Nodal Line Lengths<ref>{{cite web|url=https://webhome.weizmann.ac.il/home/feamit/nodalweek/c_joas_nodalweek.pdf |format=PDF |title=Introduction to the Hoshen-Kopelman algorithm and its application to nodal ___domain statistics |author=Christian Joas |website=Webhome.weizmann.ac.il |accessdate=2016-09-17}}</ref>

* Modeling of [[Electrical resistivity and conductivity|electrical conduction]]

* Nodal Connectivity Information

* Modeling of electrical conduction.

== MoreSee clustering algorithmsalso ==

* [[K-means clustering|K-means clustering algorithm]]

* [[Fuzzy clustering|Fuzzy clustering algorithm]]

* Gaussian (EM[[Expectation–maximization algorithm|Expectation Maximization]]) clustering algorithm

* Clustering Methods <ref>{{Cite web|url=https://web.stanford.edu/class/cs345a/slides/12-clustering.pdf|title=Clustering}}</ref>

* C-means Clustering Algorithm <ref>{{Cite web|url=https://sites.google.com/site/dataclusteringalgorithms/fuzzy-c-means-clustering-algorithm|title=Fuzzy c-means clustering}}</ref>

* [[Connected-component labeling]]

== References ==

{{Reflist}}

{{DEFAULTSORT:Hoshen-Kopelman algorithm}}

[[Category:Data clustering algorithms]]

[[Category:StatisticalCluster analysis algorithms]]