To cluster increasingly massive data sets that are common today in data and text mining, we propose a parallel implementation of the k-means clustering algorithm based on the message passing model. The proposed algorithm exploits the inherent data-parallelism in the k-means algorithm. We analytically show that the speedup and the scaleup of our algorithm approach the optimal as the number of data points increases. We implemented our algorithm on an IBM POWERparallel SP2 with a maximum of 16 nodes. On typical test data sets, we observe nearly linear relative speedups, for example, 15:62 on 16 nodes, and essentially linear scaleup in the size of the data set and in the number of clusters desired. For a 2 gigabyte test data set, our implementation drives the 16 node SP2 at more than 1:8 gigaflops.
|
2961
|
Pattern Classification and Scene Analysis
– Duda, Hart
- 1973
|
|
1097
|
Vector Quantization and Signal Compression
– Gersho, Gray
- 1992
|
|
740
|
Using MPI: Portable Parallel Programming with the Message Passing Interface, 2nd edition
– Gropp, Lusk, et al.
- 1999
|
|
716
|
A K-means clustering algorithm
– HARTIGAN, WONG
- 1979
|
|
483
|
MPI: The Complete Reference
– Snir, Otto, et al.
- 1996
|
|
412
|
Scatter/Gather: a cluster-based approach to browsing large document collections
– Cutting, Karger, et al.
- 1992
|
|
339
|
Bayesian Classification (AutoClass): Theory and Results
– Cheeseman, Stutz
- 1996
|
|
251
|
Syntactic clustering of the Web
– Broder
- 1997
|
|
245
|
Birch: an efficient data clustering method for very large databases
– Zhang, Ramakrishnan, et al.
- 1996
|
|
206
|
SPRINT: a scalable parallel classifier for data mining
– Shafer, Agrawal, et al.
- 1996
|
|
204
|
Web document clustering: A feasibility demonstration
– Zamir, Etzioni
- 1998
|
|
174
|
Concept decompositions for large sparse text data using clustering
– Dhillon, Modha
- 2001
|
|
125
|
Scalable Parallel Data Mining for Association Rules
– Han, Karypis, et al.
- 1997
|
|
111
|
Clustering algorithms
– Rasmussen
- 1992
|
|
92
|
A Branch and Bound Algorithm for Computing k-Nearest Neighbors
– Fukunaga, Narendra
- 1975
|
|
74
|
Recent trends in hierarchical document clustering: a critical review
– Willet
- 1988
|
|
73
|
LogP: A practical model of parallel computation
– Culler, Karp, et al.
- 1996
|
|
69
|
Document categorization and query generation on the world wide web using webace
– Boley, Gini, et al.
- 1999
|
|
60
|
Mining Very Large Databases with Parallel Processing
– Freitas, Lavington
- 1998
|
|
54
|
Parallel mining of association rules: design, implementation and experience
– Agrawal, Shafer
- 1996
|
|
51
|
Convergence properties of the K-means algorithms
– BOTTOU, BENGIO
- 1995
|
|
43
|
W.Li. Parallel algorithms for fast discovery of association rules
– Zaki, Parthasarathy, et al.
- 1997
|
|
40
|
ScalParC: A new scalable and efficient parallel classification algorithm for mining large datasets
– Joshi, Karypis, et al.
- 1998
|
|
36
|
SONIA: A service for organizing networked information autonomously
– Sahami, Yusufali, et al.
- 1998
|
|
32
|
The complexity of the generalized Lloyd–Max problem
– Garey, Johnson, et al.
- 1982
|
|
26
|
An efficient k-means clustering algorithm
– Alsabti, Ranka, et al.
- 1998
|
|
25
|
Visualizing Class Structures of Multi-Dimensional Data
– Dhillon, Modha, et al.
- 1998
|
|
24
|
The communication software and parallel environment of the IBM SP2
– Snir, Hochschild, et al.
- 1995
|
|
22
|
Parallel formulations of decision-tree classification algorithms
– Srivastava, Han, et al.
- 1999
|
|
19
|
Almost-Constant-Time Clustering for Arbitrary Corpus Subsets
– Silverstein, Pedersen
- 1997
|
|
15
|
Parallel classification for data mining on shared-memory multiprocessors
– Zaki, Ho, et al.
- 1999
|
|
13
|
Large scale data mining: Challenges and responses
– Chattratichat, Darlington, et al.
- 1997
|
|
13
|
PADMA: Parallel Data Mining Agents For Scalable Text Classification
– Kargupta, Hamzaoglu, et al.
- 1996
|
|
10
|
Effect of data distribution in parallel mining of associations
– Cheung, Xiao
- 1999
|
|
10
|
The EM Algorithm and Extentions
– McLachlan, Krishnan
- 1996
|
|
9
|
Programming With Unix Threads
– NORTHRUP
- 1996
|
|
8
|
Detecting atmospheric regimes using cross-validated clustering
– Smyth, Ghil, et al.
- 1997
|
|
5
|
Using cluster analysis to classify time series
– Shaw, King
- 1992
|
|
4
|
An algorithm for creating artificial test clusters
– Milligan
- 1985
|
|
3
|
Scalable High Performance Computing for Knowledge Discovery and Data Mining
– Stolorz, Musick
- 1997
|
|
2
|
W.S.: Visualizing class structure of highdimensional data with applications
– Dhillon, Modha, et al.
- 1999
|
|
