Clustering with Constraints: Feasibility Issues and the k-Means Algorithm

DMCA

Clustering with Constraints: Feasibility Issues and the k-Means Algorithm (2005)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Ian Davidson , S. S. Ravi

Citations:

89 - 9 self

BibTeX

@MISC{Davidson05clusteringwith,
    author = {Ian Davidson and S. S. Ravi},
    title = {Clustering with Constraints: Feasibility Issues and the k-Means Algorithm},
    year = {2005}
}

OpenURL

Abstract

Recent work has looked at extending the k-Means algorithm to incorporate background information in the form of instance level must-link and cannot-link constraints. We introduce two ways of specifying additional background information in the form of # and # constraints that operate on all instances but which can be interpreted as conjunctions or disjunctions of instance level constraints and hence are easy to implement. We present complexity results for the feasibility of clustering under each type of constraint individually and several types together. A key finding is that determining whether there is a feasible solution satisfying all constraints is, in general, NP-complete. Thus, an iterative algorithm such as k-Means should not try to find a feasible partitioning at each iteration. This motivates our derivation of a new version of the k-Means algorithm that minimizes the constrained vector quantization error but at each iteration does not attempt to satisfy all constraints. Using standard UCI datasets, we find that using constraints improves accuracy as others have reported, but we also show that our algorithm reduces the number of iterations until convergence. Finally, we illustrate these benefits and our new constraint types on a complex real world object identification problem using the infra-red detector on an Aibo robot.

Keyphrases

k-means algorithm feasibility issue new version cannot-link constraint present complexity result identification problem feasible solution recent work constrained vector quantization error infra-red detector aibo robot complex real world several type new constraint type iterative algorithm additional background information standard uci datasets key finding background information instance level constraint instance level must-link feasible partitioning

DMCA