• Documents
  • Authors
  • Tables
  • Log in
  • Sign up
  • MetaCart
  • DMCA
  • Donate

CiteSeerX logo

Advanced Search Include Citations
Advanced Search Include Citations | Disambiguate

Derivative-free optimization: a review of algorithms and comparison of software implementations,” (2013)

by L M Rios, N V Sahinidis
Venue:Journal of Global Optimization,
Add To MetaCart

Tools

Sorted by:
Results 1 - 10 of 32
Next 10 →

The Response of Drug Expenditures to Non-Linear Contract Design: Evidence from Medicare Part D

by Liran Einav, Amy Finkelstein, Paul Schrimpf - NBER Working Paper No. 19393, National Bureau of Economic Research , 2013
"... Abstract. We study the demand response to non-linear price schedules using data on insurance contracts and prescription drug purchases in Medicare Part D. We exploit the kink in individualsbudget set created by the famous donut hole,where insurance becomes discontinuously much less generous on the m ..."
Abstract - Cited by 12 (3 self) - Add to MetaCart
Abstract. We study the demand response to non-linear price schedules using data on insurance contracts and prescription drug purchases in Medicare Part D. We exploit the kink in individualsbudget set created by the famous donut hole,where insurance becomes discontinuously much less generous on the margin, to provide descriptive evi-dence of the drug purchase response to a price increase. We then specify and estimate a simple dynamic model of drug use that allows us to quantify the spending response along the entire non-linear budget set. We use the model for counterfactual analysis of the increase in spending from … llingthe donut hole, as will be required by 2020 under the A¤ordable Care Act. In our baseline model, which considers spending decisions within a single year, we estimate that … llingthe donut hole will increase annual drug spending by about $150, or about 8 percent. About one-quarter of this spending in-crease reects anticipatorybehavior, coming from bene…ciaries whose spending prior to the policy change would leave them short of reaching the donut hole. We also present descriptive evidence of cross-year substitution of spending by individuals who reach the kink, which motivates a simple extension to our baseline model that allows in a highly stylized way for individuals to engage in such cross year substitution. Our estimates from this extension suggest that a large share of the $150 drug spending increase could be attributed to cross-year substitution, and the net increase could be as little as $45 per year.

Smoothing and Worst-Case Complexity for Direct-Search Methods in Nonsmooth Optimization

by R. Garmanjani, et al. , 2012
"... In the context of the derivative-free optimization of a smooth objective function, it has been shown that the worst case complexity of direct-search methods is of the same order as the one of steepest descent for derivative-based optimization, more precisely that the number of iterations needed to r ..."
Abstract - Cited by 8 (2 self) - Add to MetaCart
In the context of the derivative-free optimization of a smooth objective function, it has been shown that the worst case complexity of direct-search methods is of the same order as the one of steepest descent for derivative-based optimization, more precisely that the number of iterations needed to reduce the norm of the gradient of the objective function below a certain threshold is proportional to the inverse of the threshold squared. Motivated by the lack of such a result in the non-smooth case, we propose, analyze, and test a class of smoothing direct-search methods for the unconstrained optimization of nonsmooth functions. Given a parameterized family of smoothing functions for the non-smooth objective function dependent on a smoothing parameter, this class of methods consists of applying a direct-search algorithm for a fixed value of the smoothing parameter until the step size is relatively small, after which the smoothing parameter is reduced and the process is repeated. One can show that the worst case complexity (or cost) of this procedure is roughly one order of magnitude worse than the one for direct search or steepest descent on smooth functions. The class of smoothing direct-search methods is also showed to enjoy asymptotic global convergence properties. Some preliminary numerical experiments indicates that this approach leads to better values of the objective function, pushing in some cases the optimization further, apparently without an additional cost in the number of function evaluations.

Task-Relevant Roadmaps: A Framework for Humanoid Motion Planning

by Marijn Stollenga, Leo Pape, Mikhail Frank, Jürgen Leitner, Er Förster, Jürgen Schmidhuber
"... Abstract — We introduce a novel framework that builds taskrelevant roadmaps (TRMs). TRMs can be used to plan complex task-relevant motions on robots with many degrees of freedom. To this end we create a new sampling based inverse kinematics optimizer called Natural Gradient Inverse Kinematics (NGIK) ..."
Abstract - Cited by 4 (4 self) - Add to MetaCart
Abstract — We introduce a novel framework that builds taskrelevant roadmaps (TRMs). TRMs can be used to plan complex task-relevant motions on robots with many degrees of freedom. To this end we create a new sampling based inverse kinematics optimizer called Natural Gradient Inverse Kinematics (NGIK), based on the principled heuristic solver called natural evolution strategies (NES). We build TRMs using a construction algorithm that iteratively optimizes postures using NGIK that cover an arbitrary task-space. NGIK can express constraints with arbitrary cost-functions and thus can transparently deal with hard and soft constraints. The construction algorithm can express the task-space by arbitrary task-functions and grows the TRM to maximally cover the task-space while minimizing the constraints. These properties make the framework very flexible while still handling complex movements in robots with high degrees of freedom. We show NGIK outperforms recent algorithms in this domain and show the effectiveness of our method on the iCub robot, using the 41 DOF of its full upper body, arms, hands, head, and eyes. A video-demo shows TRMs applied on real robotic tasks on the iCub humanoid
(Show Context)

Citation Context

...h space, which makes it particularly relevant to use the right search algorithm. Comparing a range of optimization methods on combinations of (non)convex (non)smooth optimization problems Rios et. al =-=[24]-=- found that evolutionary strategies perform exceptionally well in non-convex non-smooth optimization problems. We chosex the Natural Evolution Strategies (NES) algorithm [7] to minimize the cost-funct...

Black-box optimization benchmarking of the GLOBAL method

by László Pál, Tibor Csendes
"... GLOBAL is a multistart type stochastic method for bound constrained global optimization problems. Its goal is to find the best local minima that are potentially global. For this reason it involves a combination of sampling, clustering, and local search. The role of clustering is to reduce the number ..."
Abstract - Cited by 2 (1 self) - Add to MetaCart
GLOBAL is a multistart type stochastic method for bound constrained global optimization problems. Its goal is to find the best local minima that are potentially global. For this reason it involves a combination of sampling, clustering, and local search. The role of clustering is to reduce the number of local searches by forming groups of points around the local minimizers from a uniform sampled domain and to start few local searches in each of those groups. We evaluate the performance of the GLOBAL algorithm on the BBOB-2009 noiseless testbed, containing problems which reflect the typical difficulties arising in real-word applications. The results show that up to a small function evaluation budget, GLOBAL performs well. We improved the parametrization of it and compared the performance with the MATLAB R2010a GlobalSearch algorithm on the BBOB-2010 noiseless testbed between dimensions 2 and 20. According to the results the studied methods perform similar.
(Show Context)

Citation Context

...zation software TOMLAB/OQNLP; both of them are based on the paper (Ugray et al., 2007). Although GlobalSolver is not considered a state of the art algorithm, based on some recent comparative studies (=-=Rios and Sahinidis, 2010-=-) on bound constrained problems, its commercial counterpart show superior performance in terms of refining a near-optimal solution. The main reason of choosing the GlobalSolver for comparisons was tha...

A class of derivative-free nonmonotone optimization algorithms employing coordinate rotations and gradient approximations

by L Grippo , F Rinaldi - Computational Optimization and Applications
"... Abstract In this paper we study a class of derivative-free unconstrained minimization algorithms employing nonmonotone inexact linesearch techniques along a set of suitable search directions. In particular, we define globally convergent nonmonotone versions of some well-known derivativefree methods ..."
Abstract - Cited by 2 (0 self) - Add to MetaCart
Abstract In this paper we study a class of derivative-free unconstrained minimization algorithms employing nonmonotone inexact linesearch techniques along a set of suitable search directions. In particular, we define globally convergent nonmonotone versions of some well-known derivativefree methods and we propose a new algorithm combining coordinate rotations with approximate simplex gradients. Through extensive numerical experimentation, we show that the proposed algorithm is highly competitive in comparison with some of the most efficient direct search methods and model based methods on a large set of test problems.
(Show Context)

Citation Context

...define tp,a the number of function evaluations needed for algorithm a to satisfy (14) for a given tolerance τ , and we obtain the percentage of problems solved with ν function evaluations by means of the so called data profile: da(ν) = 1 |P| size{p ∈ P : tp,a np + 1 ≤ ν}, 19 where np is the number of variables in p ∈ P . If the convergence test (14) cannot be satisfied within the assigned computational budget, we set tp,a = ∞. The test set P we consider in the experiments consists of 38 problems from the CUTEr collection [12] and 49 nonsmooth problems from the collection of Luksan and Vlcek [22, 30]. Since the problems in P have at most 50 variables, in our numerical experience we set the maximum computational budget to be 5000 and we investigate the behavior of the solvers within this computational budget. We use both performance and data profile with the test (14) where τ = 10−l with l ∈ {3, 6}. In NMDFU, NMLSR Algorithm 1 and NMCS we used the following reference value: Wk = max 0≤j≤min(k,M) [f(xk−j)], with M = 3. In Figure 2, we report performance and data profiles related to the first experiment. As we can see, looking at the performance profiles, NMDFU is the fastest solver in at le...

VXQR: Derivative-free unconstrained optimization . . .

by Arnold Neumaier, Hannes Fendl, Harald Schilly, Thomas Leitner , 2010
"... ..."
Abstract - Cited by 1 (0 self) - Add to MetaCart
Abstract not found

Globally convergent evolution strategies for constrained optimization

by Y Diouane , S Gratton , L N Vicente - Comput. Optim. Appl , 2015
"... Abstract In this paper we propose, analyze, and test algorithms for linearly constrained optimization when no use of derivatives of the objective function is made. The proposed methodology is built upon the globally convergent evolution strategies previously introduced by the authors for unconstrai ..."
Abstract - Cited by 1 (1 self) - Add to MetaCart
Abstract In this paper we propose, analyze, and test algorithms for linearly constrained optimization when no use of derivatives of the objective function is made. The proposed methodology is built upon the globally convergent evolution strategies previously introduced by the authors for unconstrained optimization. Two approaches are encompassed to handle the constraints. In a first approach, feasibility is first enforced by a barrier function and the objective function is then evaluated directly at the feasible generated points. A second approach projects first all the generated points onto the feasible domain before evaluating the objective function. The resulting algorithms enjoy favorable global convergence properties (convergence to stationarity from arbitrary starting points), regardless of the linearity of the constraints. The algorithmic implementation (i) includes a step where previously evaluated points are used to accelerate the search (by minimizing quadratic models) and (ii) addresses general linearly constrained optimization. Our solver is compared to others, and the numerical results confirm its competitiveness in terms of efficiency and robustness.
(Show Context)

Citation Context

...ion for global search. Available for linear constraints. With the exception of BCDFO, these solvers are designed for global optimization (in an heuristic sense). In the comparative study published in =-=[49]-=-, MCS was among the best solvers in terms of both efficiency and robustness. Among the stochastic solvers tested there, CMA-ES and PSWARM have appeared well ranked. BCDFO was developed after this stud...

unknown title

by R. Garmanjani, L. N. Vicente , 2012
"... doi:10.1093/imanum/drs027 ..."
Abstract - Add to MetaCart
doi:10.1093/imanum/drs027
(Show Context)

Citation Context

...ith 2 n 12, and different initial points were considered. We chose sid-psm as our direct-search solver. This code performed relatively well in a number of benchmarking tests (Custódio et al., 2010; =-=Rios & Sahinidis, 2010-=-), especially among direct-search solvers, in particular, due to a search step where a quadratic model is fitted using previous function evaluations and minimized in a trust region, and due to a poll ...

UNCLASSIFIED An Advanced Computational Approach to System of Systems Analysis & Architecting Using Agent-Based Behavioral Model

by unknown authors , 2013
"... Report Documentation Page Form ApprovedOMB No. 0704-0188 Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing an ..."
Abstract - Add to MetaCart
Report Documentation Page Form ApprovedOMB No. 0704-0188 Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. 1. REPORT DATE
(Show Context)

Citation Context

...tic methods can be classified into gradientsbased methods (such as steepest descent, newton method, conjugate, penalty method) and derivativefree methods (such as simplex method, integer programming) =-=[92]-=-.sGradient-based algorithms can findslocal optima with high reliability and, in many cases, with high efficiency but might be trapped by localsoptima.sHeuristic based algorithms can escape local optim...

General solution methods for mixed integer . . .

by Eric Newby , 2013
"... In a number of situations the derivative of the objective function of an op-timization problem is not available. This thesis presents a novel algorithm for solving mixed integer programs when this is the case. The algorithm is the first developed for problems of this type which uses a trust region ..."
Abstract - Add to MetaCart
In a number of situations the derivative of the objective function of an op-timization problem is not available. This thesis presents a novel algorithm for solving mixed integer programs when this is the case. The algorithm is the first developed for problems of this type which uses a trust region methodology. Three implementations of the algorithm are developed and deterministic proofs of convergence to local minima are provided for two of the implementations. In the development of the algorithm several other contributions are made. The derivative free algorithm requires the solution of several mixed inte-ger quadratic programming subproblems and novel methods for solving non-convex instances of these problems are developed in this thesis. Additionally, it is shown that the current definitions of local minima for mixed integer pro-
Powered by: Apache Solr
  • About CiteSeerX
  • Submit and Index Documents
  • Privacy Policy
  • Help
  • Data
  • Source
  • Contact Us

Developed at and hosted by The College of Information Sciences and Technology

© 2007-2019 The Pennsylvania State University