Mesh Adaptive Direct Searches (MADS) algorithm for derivativefree and blackbox optimization
Description
An implementation of the Mesh Adaptive Direct Searches (MADS) algorithm for derivativefree and blackbox optimization. It uses a series of variable size meshes to search the space and to converge to (local) minima with mathematical proof of convergence. It is usable on unbounded and bounded unconstrained problems. The objective function can return “NA” if outofbound or violating constraints (strict barrier approach for constraints), or a penalty can be added to the objective function.
Usage
mads(par, fn, lower=Inf, upper=Inf, scale=1, control = list(), ...)
Arguments
par 
A starting vector of parameter values. Must be feasible, i.e. lie strictly between lower and upper bounds.

fn 
Noisy, nondifferentiable, nonconvex, piecewise or nonlinear objective function that is to be optimized. It takes a real vector as argument and returns a scalar or “NA” that is the value of the function at that point (see details).

lower 
Lower bounds on the parameters. A vector of the same length as the parameters. If a single value is specified, it is assumed that the same lower bound applies to all parameters. If all lower bounds are Inf and all upper bounds are Inf, then the problem is treated as unbounded.

upper 
Upper bounds on the parameters. A vector of the same length as the parameters. If a single value is specified, it is assumed that the same upper bound applies to all parameters. If all lower bounds are Inf and all upper bounds are Inf, then the problem is treated as unbounded.

scale 
Optional scaling, default is 1. A vector of the same length as the parameters. If a single value is specified, it is assumed that the same scale factor applies to all parameters. This scale factor can be customized for each parameter allowing nonproportional moves in the space (normally used for unbounded problems).

control 
A list of control parameters. See *Details* for more information.

... 
Additional arguments passed to fn

Details
Argument control
is a list specifing any changes to default values of algorithm control parameters for the outer loop. The list items are as follows:
tol
Convergence tolerance. Iteration is terminated when the absolute difference in function value between successive iteration is below tol
. Default is 1.e06.
maxfeval
: Maximum number of objective function evaluations allowed. Default is 10000).
trace
A logical variable indicating whether information is printed on the console during execution. Default is TRUE.
maximize
A logical variable indicating whether the objective function should be maximized. Default is FALSE (hence default is minimization).
pollStyle
A string variable indicating density of the poll set, or, number of vectors in the positive basis. Choices are: “lite” (n+1 points) or “full” (2n points). Default is “lite”.
deltaInit
A numerical value specifying the initial mesh size, between “tol” and 1 (mesh size is limited to 1). Default is 0.01.
expand
A numerical value >1 specifying the expansion (is success) and contraction (if no success) factor of the mesh at the end of an iteration. Default is 4.
lineSearch
A integer value indicating the maximum of search steps to consider. Line search is performed at the end of a successful poll set evaluation, along the line going from last to new “best” solution. Stepsize will be automatically increased according to the Fibonacci series. Default is 20. Set to 1 to disable the feature.
seed
Seed value for the internal pseudo random numbers generator. Default is 1138.
Value
A list with the following components:
par 
Best estimate of the parameter vector found by the algorithm.

value 
The value of the objective function at termination.

feval 
The number of times the objective fn was evaluated.

convergence 
Final mesh size, should be <tol if successfule convergence. If feval reached maxfeval, then the algorithm did not converge.

iterlog 
A dataframe used to log properties of the “best” solution at the end of each iteration.

Note
This algorithm is based on the Lower Triangular method described in the reference.
Author(s)
Vincent Bechard <[email protected]>, HEC Montreal (Montreal University)
URL:https://www.linkedin.com/in/vincentbechard
References
C. Audet and J. E. Dennis, Jr. Mesh adaptive direct search algorithms for constrained optimization. SIAM Journal on Optimization, 17(1): 188217, 2006.
See Also
optim
, hjk
, nmk
Examples
rosbkext < function(x){
n < length(x)
sum (100*(x[1:(n1)]^2  x[2:n])^2 + (x[1:(n1)]  1)^2)
}
np < 10
p0 < rnorm(np)
ans1 < mads(fn=rosbkext, par=p0, lower=10, upper=10, scale=1, control=list(trace=FALSE))
hs78 < function(x){
f < rep(NA, 3)
f[1] < sum(x^2)  10
f[2] < x[2]*x[3]  5*x[4]*x[5]
f[3] < x[1]^3 + x[2]^3 + 1
F < prod(x) + 10*sum(abs(f))
return(F)
}
p0 < c(2,1.5,2,1,1)
ans2 < mads(p0, hs78, control=list(trace=FALSE))