Solving optimization problems with multiple (often conflicting) objectives is, generally, a very difficult goal. Evolutionary algorithms (EAs) were initially extended and applied during the mid-eighties in an attempt to stochastically solve problems of this generic class. During the past decade, a variety of multiobjective EA (MOEA) techniques have been proposed and applied to many scientific and engineering applications. Our discussion's intent is to rigorously define multiobjective optimization problems and certain related concepts, present an MOEA classification scheme, and evaluate the variety of contemporary MOEAs. Current MOEA theoretical developments are evaluated; specific topics addressed include fitness functions, Pareto ranking, niching, fitness sharing, mating restriction, and secondary populations. Since the development and application of MOEAs is a dynamic and rapidly growing activity, we focus on key analytical insights based upon critical MOEA evaluation of c...

We introduce a simple evolution scheme for multiobjective optimization problems, called the Pareto Archived Evolution Strategy (PAES). We argue that PAES may represent the simplest possible nontrivial algorithm capable of generating diverse solutions in the Pareto optimal set. The algorithm, in its simplest form, is a (1 + 1) evolution strategy employing local search but using a reference archive of previously found solutions in order to identify the approximate dominance ranking of the current and candidate solution vectors. (1 + 1)-PAES is intended to be a baseline approach against which more involved methods may be compared. It may also serve well in some real-world applications when local search seems superior to or competitive with population-based methods. We introduce (1 + λ) and (μ | λ) variants of PAES as extensions to the basic algorithm. Six variants of PAES are compared to variants of the Niched Pareto Genetic Algorithm and the Nondominated Sorting Genetic Algorithm over a diverse suite of six test functions. Results are analyzed and presented using techniques that reduce the attainment surfaces generated from several optimization runs into a set of univariate distributions. This allows standard statistical analysis to be carried out for comparative purposes. Our results provide strong evidence that PAES performs consistently well on a range of multiobjective optimization tasks.

In this paper, we study the problem features that may cause a multi-objective genetic algorithm (GA) difficulty in converging to the true Pareto-optimal front. Identification of such features helps us develop difficult test problems for multi-objective optimization. Multi-objective test problems are constructed from single-objective optimization problems, thereby allowing known difficult features of single-objective problems (such as multi-modality, isolation, or deception) to be directly transferred to the corresponding multi-objective problem. In addition, test problems having features specific to multiobjective optimization are also constructed. More importantly, these difficult test problems will enable researchers to test their algorithms for specific aspects of multi-objective optimization. Keywords Genetic algorithms, multi-objective optimization, niching, pareto-optimality, problem difficulties, test problems. 1 Introduction After a decade since the pioneering wor...

Over the past few years, the research on evolutionary algorithms has demonstrated their niche in solving multiobjective optimization problems, where the goal is to �nd a number of Pareto-optimal solutions in a single simulation run. Many studies have depicted different ways evolutionary algorithms can progress towards the Paretooptimal set with a widely spread distribution of solutions. However, none of the multiobjective evolutionary algorithms (MOEAs) has a proof of convergence to the true Pareto-optimal solutions with a wide diversity among the solutions. In this paper, we discuss why a number of earlier MOEAs do not have such properties. Based on the concept of-dominance, new archiving strategies are proposed that overcome this fundamental problem and provably lead to MOEAs that have both the desired convergence and distribution properties. A number of modi�cations to the baseline algorithm are also suggested. The concept of-dominance introduced in this paper is practical and should make the proposed algorithms useful to researchers and practitioners alike.

. The theory of evolutionary computation has been enhanced rapidly during the last decade. This survey is the attempt to summarize the results regarding the limit and finite time behavior of evolutionary algorithms with finite search spaces and discrete time scale. Results on evolutionary algorithms beyond finite space and discrete time are also presented but with reduced elaboration. Keywords: evolutionary algorithms, limit behavior, finite time behavior 1. Introduction The field of evolutionary computation is mainly engaged in the development of optimization algorithms which design is inspired by principles of natural evolution. In most cases, the optimization task is of the following type: Find an element x 2 X such that f(x ) f(x) for all x 2 X , where f : X ! IR is the objective function to be maximized and X the search set. In the terminology of evolutionary computation, an individual is represented by an element of the Cartesian product X \Theta A, where A is a possibly...

Although there are many versions of evolutionary algorithms that are tailored to multi-criteria optimization, theoretical results are apparently not yet available. Here, it is shown that results known from the theory of evolutionary algorithms in case of single criterion optimization do not carry over to the multi-criterion case. At first, three different step size rules are investigated numerically for a selected problem with two conflicting objectives. The empirical results obtained by these experiments lead to the observation that only one of these step size rules may have the property to ensure convergence to the Pareto set. A theoretical analysis finally shows that a special version of an evolutionary algorithm with this step size rule converges with probability one to the Pareto set for the test problem under consideration.

For the first time, a running time analysis of a multi-objective evolutionary algorithm for a discrete optimization problem is given. To this end, a simple pseudo-Boolean problem (Lotz: leading ones - trailing zeroes) is defined and a population-based optimization algorithm (FEMO). We show, that the algorithm performs a black box optimization in #(n 2 log n) function evaluations where n is the number of binary decision variables. 1

Mu l ip often conflicting objectives arise naturalj in most real worl optimization scenarios. As evol tionaryalAxjO hms possess several characteristics that are desirabl e for this type of probl em, this clOv of search strategies has been used for mul tiobjective optimization for more than a decade. Meanwhil e evol utionary mul tiobjective optimization has become establ ished as a separate subdiscipl ine combining the fiel ds of evol utionary computation and cl assical mul tipl e criteria decision ma ing. This paper gives an overview of evol tionary mu l iobjective optimization with the focus on methods and theory. On the one hand, basic principl es of mu l iobjective optimization and evol tionary alA#xv hms are presented, and various al gorithmic concepts such as fitness assignment, diversity preservation, and el itism are discussed. On the other hand, the tutorial incl udes some recent theoretical resul ts on the performance of mu l iobjective evol tionaryalvDfifl hms and addresses the question of how to simpl ify the exchange of methods and appl ications by means of a standardized interface. 1

We present four abstract evolutionary algorithms for multiobjective optimization and theoretical results that characterize their convergence behavior. Thanks to these results it is easy to verify whether a particular instantiation of these abstract evolutionary algorithms offers the desired limit behavior or not. Several examples are given.

Though it has been claimed that elitism could improve evolutionary multi-objective search significantly, a thorough and extensive evaluation of its effects is still missing. Guidelines on how elitism could successfully be incorporated have not yet been developed. This paper presents a unified model of multi-objective evolutionary algorithms, in which arbitrary variation and selection operators can be combined as building blocks, including archiving and re-insertion strategies. The presented model enables most specific multi-objective (evolutionary) algorithm to be formulated as an instance of it, which will be demonstrated by simple examples. We will further show how elitism can be quantified by the model's parameters and how this allows an easy evaluation of the effect of elitism on different algorithms. 1 Introduction The aim of this study is to provide a systematic approach to elitism in multi-objective evolutionary algorithms (MOEA). Multi-objective optimization can be seen as a ...