by Xin Yao, Yong Liu, Guangming Lin
IEEE Transactions on Evolutionary Computation
ftp://www.cs.adfa.edu.au/pub/xin/tec22r2_online.ps.gz
Add To MetaCart
Abstract:
Evolutionary programming (EP) has been applied with success to many numerical and combinatorial optimization problems in recent years. However, EP has rather slow convergence rates on some function optimization problems. In this paper, a "fast EP " (FEP) is proposed which uses a Cauchy instead of Gaussian mutation as the primary search operator. The relationship between FEP and classical EP (CEP) is similar to that between the fast simulated annealing and the classical version. Both analytical and empirical studies have been carried out to evaluate the performance of FEP and CEP for different function optimization problems. This paper shows that FEP is very good at search in a large neighborhood while CEP is better at search in a small local neighborhood. For a suite of 23 benchmark problems, FEP performs much better than CEP for multimodal functions with many local minima while being comparable to CEP in performance for unimodal and multimodal functions with only a few local minima. This paper also shows the relationship between the search step size and the probability of finding a global optimum, and thus explains why FEP performs better than CEP on some functions but not on others. In addition, the importance of the neighborhood size and its relationship to the probability of finding a near-optimum is investigated. Based on these analyses, an improved FEP (IFEP) is proposed and tested empirically. This technique mixes different search operators (mutations). The experimental results show that IFEP performs better than or as well as the better of FEP and CEP for most benchmark problems tested. 1
Citations
|
649
|
An Introduction to Probability Theory and Its
– Feller
- 1968
|
|
448
|
Artificial Intelligence through Simulated Evolution
– Fogel
- 1966
|
|
439
|
Evolution Computation: Toward a New Philosophy of Machine Intelligence
– Fogel
- 1995
|
|
384
|
Evolution and Optimum Seeking
– Schwefel
- 1995
|
|
348
|
No free lunch theorems for optimization
– Wolpert, Macready
- 1997
|
|
318
|
Nonuniform Random Variate Generation
– Devroye
- 2006
|
|
268
|
An overview of evolutionary algorithms for parameter optimization
– Bäck, Schwefel
- 1993
|
|
166
|
No-free-lunch theorems for search
– Wolpert, MacReady
- 1995
|
|
137
|
Zilinskas. Global optimization
– Törn
- 1989
|
|
129
|
An Introduction to Simulated Evolutionary Optimization
– Fogel
- 1994
|
|
52
|
Evolving Artificial Intelligence
– Fogel
- 1992
|
|
37
|
System Identification Through Simulated Evolution: A Machine Learning Approach to Modeling
– Fogel
- 1991
|
|
36
|
Applying Evolutionary Programming to Selected Traveling Salesman Problems
– Fogel
- 1993
|
|
23
|
Y.: Fast Evolution Strategies
– Yao, Liu
|
|
16
|
Tuning evolutionary programming for conformationally flexible molecular docking
– Gehlhaar, Fogel
- 1996
|
|
15
|
Combining mutation operators in evolutionary programming
– Chellapilla
- 1998
|
|
12
|
An overview of evolutionary computation
– Yao
- 1996
|
|
10
|
Are Evolutionary Algorithms Improved by Large Mutations� W
– Kappler�
|
|
9
|
Fast evolutionary programming," in Evolutionary Programming V
– Yao, Liu
- 1996
|
|
8
|
Fast evolutionary programming,” in Evolutionary Programming V
– Yao, Liu
- 1996
|
|
3
|
Free Lunch Theorems for Optimization
– “No
- 1997
|
|
3
|
Calculus with Analytic Geometry
– Hunt
- 1986
|
|
3
|
Global Optimisation
– Torn, Zilinskas
- 1989
|
|
1
|
An evolution strategy with adaptation of the step sizes by a variance function,” in Parallel Problem Solving from Nature (PPSN
– Born
- 1996
|
|
1
|
Introduction
– Yao
- 1994
|