DMCA
Efficient multi-start strategies for local search algorithms (2009)
| Venue: | In |
| Citations: | 4 - 0 self |
BibTeX
@INPROCEEDINGS{György09efficientmulti-start,
author = {András György and Levente Kocsis},
title = {Efficient multi-start strategies for local search algorithms},
booktitle = {In},
year = {2009},
pages = {705--720},
publisher = {Springer Berlin/Heidelberg}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Local search algorithms applied to optimization problems often suffer from getting trapped in a local optimum. The common solution for this deficiency is to restart the algorithm when no progress is observed. Alternatively, one can start multiple instances of a local search algorithm, and allocate computational resources (in particular, processing time) to the instances depending on their behavior. Hence, a multi-start strategy has to decide (dynamically) when to allocate additional resources to a particular instance and when to start new instances. In this paper we propose multi-start strategies motivated by works on multi-armed bandit problems and Lipschitz optimization with an unknown constant. The strategies continuously estimate the potential performance of each algorithm instance by supposing a convergence rate of the local search algorithm up to an unknown constant, and in every phase allocate resources to those instances that could converge to the optimum for a particular range of the constant. Asymptotic bounds are given on the performance of the strategies. In particular, we prove that at most a quadratic increase in the number of times the target function is evaluated is needed to achieve the performance of a local search algorithm started from the attraction region of the optimum. Experiments are provided using SPSA (Simultaneous Perturbation Stochastic Approximation) and k-means as local search algorithms, and the results indicate that the proposed strategies work well in practice, and, in all cases studied, need only logarithmically more evaluations of the target function as opposed to the theoretically suggested quadratic increase. 1.
Keyphrases
local search algorithm efficient multi-start strategy unknown constant quadratic increase target function multi-start strategy computational resource convergence rate common solution particular range new instance potential performance multi-armed bandit problem processing time local search additional resource simultaneous perturbation stochastic approximation multiple instance phase allocate resource particular instance asymptotic bound local optimum attraction region algorithm instance lipschitz optimization
