2
Automatic Particle Swarm Optimization Clustering Algorithm Automatic Particle Swarm Optimization Clustering Algorithm Ching Ching- Yi Chen, Yi Chen, Hsuan Hsuan- - Ming Ming Feng Feng , and Fun Ye , and Fun Ye International Journal of Electrical Engineering. vol. 13, no. 4, International Journal of Electrical Engineering. vol. 13, no. 4, pp.379 pp.379- 387, 2006 387, 2006 Abstract •Automatic particle swarm optimization (AUTO-PSO) clustering algorithm with cluster validity measure is developed., •To efficiently decide the number of clusters, extract its associated cluster centers, and classify the correct catalog from various data sets. •Simulation results for two artificial data sets and one real-life IRIS data are proposed to show the efficiency of the AUTO-PSO algorithms. 1. Introduction Three important items in the design of clustering process, to choose the optimal number of clusters, to measure the similarity between training data points and des ired cluster centers , and to quickly approach the desired cluster centers. 2. AUTO-PSO CLUSTERING ALGORITHM •The proposed AUTO-PSO clustering algorithm is not only automatically determines the true number of the cluster centers but also extract real cluster centers and make a good classification.. Steps : (1) Randomly Initialize and its associ ated velocit y for all parti cles in the form (2) Select the active solution (i.e. active cluster centers) of every particle from initial population with the IF-THEN rules: IF THEN the   jth candidate cluster center is ACTIVE (2) ELSE IF THEN the  jth candidate cluster center is INACTIVE. (3) Determine unreasonable solutions (a) First calculate the counting number (b) Check if the counting number is smaller than 2 If Yes then (c) Refine cluster centers by the simple average computation with (4)Calculate fitness function of each particle with Fig. 1Response of AUTO-PSO algorithm in Example 1. (a) Fitness value against generation with (solid), average (dash) and avera ge particles (dash-dotted), (b) CS measure against generation for gbest, (c) Final selected , where ‘ is disa bled an d is active, (d)The optimal classific ation result by the sele cted cluster centers. 3. Simulation Results •(1) Simulation result for mixture of spherical and ellipsoidal data set is shown in Fig.1, Data set with five spherical clusters is shown in Fig.2, and IRIS data set with 150 data points separated into three subclasses is shown in Fig.3. 4 Conclusion An AUTO-PSO algorithm has been developed to solve several types of clustering problems, which automaticall y determines the real cluster number, selects desired cluster centers and finds good classification result at the same time. The evolutional PSO learning method with CS validity measure yields a very efficient and simple clustering analysis. The objective of the PSO is to minimize the CS measure for achieving proper clustering results. , where . •Where (5) Applied the PSO learning algorithm to determine optimization s from the initializations. Fig 2. Response of AUTO-PSO algorithm in example 2. (a) The data set used in example 3. (b) Final , where ‘ is disa ble and ‘ is active. (c) The optimal classification result by the selected cluster centers. Fig. 3 Response of AUTO-PSO algorithm in example 3. (a) The three- dimensional plot for the four-dimensio nal IRIS data . (b) The three-dimensional plot for the four-dimensional IRI S data: IRIS setosa ( ), IRIS versi colo r (), and IRIS virginica (+). (c) The clustering results achieved by the propo sed method. (4) (3) (5) ] ,..., , , ,..., , [ ] , [ 2 1 , , 2 , 1  p T  p  p  p i T  p i  p i  p  p  p z  z  z  z  X γ  γ  γ  γ  = = ) ( ) ( min max min , i i i  p i  j U U rand U  z + = λ ) ( ) ( min max , i i  p i  j U U rand v = { } { } { } { } { } { } = = = = = = K i  j i i  j K  j K i C  x k  j C  x i K i  j i i  j K  j K i C  x k  j C  x i  z  z d  x  x d  N  z  z d K  x  x d  N K K CS i  j i k i  j i k 1 , 1 1 , 1 ) , ( min ) , ( max 1 ) , ( min 1 ) , ( max 1 1 ) ( (1) K  N  / eps CS F i + = 1

autopso

Embed Size (px)

Citation preview

Page 1: autopso

8/3/2019 autopso

http://slidepdf.com/reader/full/autopso 1/1

Automatic Particle Swarm Optimization Clustering AlgorithmAutomatic Particle Swarm Optimization Clustering Algorithm

ChingChing--Yi Chen,Yi Chen, HsuanHsuan--MingMing FengFeng, and Fun Ye, and Fun Ye

International Journal of Electrical Engineering. vol. 13, no. 4,International Journal of Electrical Engineering. vol. 13, no. 4, pp.379pp.379--387, 2006387, 2006

Abstract

Automatic particle swarm optimization (AUTO-PSO) clustering

gorithm with cluster validity measure is developed.,

To efficiently decide the number of clusters, extract its associated

uster centers, and classify the correct catalog from various data sets.

Simulation results for two artificial data sets and one real-life IRIS

ata are proposed to show the efficiency of the AUTO-PSO algorithms.

1. Introduction

Three important items in the design of clustering process, to choose

he optimal number of clusters, to measure the similarity between

aining data points and desired cluster centers, and to quickly approach

he desired cluster centers.

. AUTO-PSO CLUSTERING ALGORITHM

The proposed AUTO-PSO clustering algorithm is not only automatically

etermines the true number of the cluster centers but also extract real

uster centers and make a good classification..

Steps :

1) Randomly Initialize and its associated velocity for all particles in the

orm

2) Select the active solution (i.e. active cluster centers) of every particle

om initial population with the IF-THEN rules:

IF THEN the  jth candidate cluster center is ACTIVE (2)

ELSE IF THEN the  jth candidate cluster center is INACTIVE.

3) Determine unreasonable solutions

(a) First calculate the counting number

(b) Check if the counting number is smaller than 2

If Yes then

(c) Refine cluster centers by the simple average computation with

4)Calculate fitness function of each particle with

Fig. 1Response of AUTO-PSO algorithm in Example 1. (a) Fitness value against

generation with (solid), average (dash) and average particles (dash-dotted), (b) CS

measure against generation for gbest, (c) Final selected , where ‘’ is disabled and

‘○’ is active, (d)The optimal classification result by the selected cluster centers.

. Simulation Results

1) Simulation result for mixture of spherical and ellipsoidal data set is

own in Fig.1, Data set with five spherical clusters is shown in Fig.2,

d IRIS data set with 150 data points separated into three subclasses is

own in Fig.3.

Conclusion

An AUTO-PSO algorithm has been developed to solve several types of 

ustering problems, which automatically determines the real cluster

umber, selects desired cluster centers and finds good classificationsult at the same time. The evolutional PSO learning method with CS

alidity measure yields a very efficient and simple clustering analysis.

• The objective of the PSO is to minimize the CS measurefor achieving proper clustering results.

•Where

5) Applied the PSO learning algorithm to determine optimizations

om the initializations.

Fig 2. Response of AUTO-PSO algorithm in example 2. (a) The data set used in

example 3. (b) Final , where ‘’ is disable and ‘○’ is active. (c) The optimal

classification result by the selected cluster centers.

Fig. 3 Response of AUTO-PSO algorithm in example 3. (a) The three-

dimensional plot for the four-dimensional IRIS data . (b) The three-dimensional

plot for the four-dimensional IRIS data: IRIS setosa (○), IRIS versicolor (△),and IRIS virginica (+). (c) The clustering results achieved by the proposed

method.

(4)

(3)

(5)

],...,,,,...,,[],[ 21,,2,1

 p

 p p p

iT 

 p

i

 p

i p p p z z z z X  γ  γ  γ  γ   == )()( minmaxmin

, iii

 p

i jU U rand U  z −⋅+=

λ 

)()(

minmax

,ii p

i j

U U rand v

−⋅=

{ }

{ }{ }

{ }

{ }{ }∑

∑ ∑

∑ ∑

=≠∈

= ∈∈

=≠∈

= ∈∈

=

=K 

i

 jii jK  j

i C  x

k  jC  x

i

i

 jii jK  j

i C  x

k  jC  x

i

 z zd 

 x xd  N 

 z zd K 

 x xd  N K 

K CSi j

ik i j

ik 

1,

1

1,

1

),(min

),(max1

),(min1

),(max11

)(

(1)

K  N  / 

epsCSF 

i +

=1