Choosing an Index¶
Each cluster validity index emphasizes different properties of a partition. Values from different index families are not on a common scale, so compare candidate partitions with the same index rather than comparing one index’s number directly with another’s.
Index |
Name |
Prefer |
Range |
Incremental |
Remove/merge |
|---|---|---|---|---|---|
|
Calinski–Harabasz |
Larger |
|
Yes |
Yes |
|
Connectivity |
Larger |
|
Fuzzy backend |
No |
|
Centroid-based Silhouette |
Larger |
|
Yes |
Yes |
|
Davies–Bouldin |
Smaller |
|
Yes |
Yes |
|
Generalized Dunn 43 |
Larger |
|
Yes |
Yes |
|
Generalized Dunn 53 |
Larger |
|
Yes |
Yes |
|
Partition Separation |
Larger |
|
Yes |
Yes |
|
Representative Cross Information Potential |
Smaller |
|
Yes |
Yes |
|
Within/Between |
Smaller |
|
Yes |
Yes |
|
Xie–Beni |
Smaller |
|
Yes |
Yes |
CH, DB, GD43, GD53, WB, and XB summarize variants of
within-cluster compactness and between-cluster separation. cSIL offers a
bounded, centroid-based silhouette measure. PS measures partition
separation, while rCIP uses distributional information. CONN is the
specialized choice when connectivity between learned prototypes is important;
see Using CONN before using it.
The value 0.0 is used when an index is not yet defined, including many
one-cluster states. When monitoring a stream, consider the trajectory only
after enough clusters and samples have been observed.