Grant: Discovery Grants Program - Individual
École Polytechnique de Montréal
$34,000.00
Derivative-free and blackbox optimization for engineering problems
FY 2018-19
Summary
This research project is the continuation of my prior work funded by NSERC on the development of the Mesh Adaptive Direct Search algorithm (MADS) for derivative-free and blackbox optimization problems. In many engineering optimization problems, the objective and constraint functions are nonsmooth and evaluated through a computer simulation. The outputs of these codes are often of limited precision, contaminated with numerical noise, expensive to evaluate, and sometimes the code fails to return a value. *There has been an important amount of work in developing models to improve the efficiency of direct search optimization methods. Quadratic models, Gaussian processes, kriging interpolation as well as radial basis functions are such examples. There has also been work on expanding the capabilities to integer, categorical and periodic variables, on efficient treatment of constraints, on bi- and multi objective problems. In the present proposal we plan to pursue the development of MADS methods in many ways.*The current MADS algorithm generates trial points on a discretization of the space of variables called the mesh. Several engineers that have applied MADS to practical problems complained that a consequence of the way that the mesh size parameter is updated leads to modifications in the values of the variables below a reasonable granularity. We plan to alter the way that the mesh size parameter is updated, which is at the heart of the MADS algorithm, and the cornerstone of the nonsmooth convergence analysis. *Some constraints return a binary value indicating if it is satisfied or not, e.g., a flag indicating if the simulation failed or not. Such a binary constraint is difficult to model using the above-mentioned modelling techniques. We plan to import classification methods and data mining tools from the machine learning community to model them. We proposed the BiMADS algorithm for biobjective blackbox constrained optimization. For such problems, BiMADS returns a finite list of trade-off solutions, with respect to two conflicting objectives. We plan to once again use classification tools to analyze the nature of the list of trade-off solutions, and to create representative solutions.*Surrogates are used by MADS as an inexpensive substitute of the true simulation. MADS uses them by sampling the surrogate several times before deciding where to launch the true simulation. Our numerical experiments systematically show that surrogates considerably help in finding better solutions. We plan to devise a generic framework to handle surrogates with parametrizable precision, and to build additional models to dynamically estimate the difference between the true and surrogate functions. *All the projects outlined in this proposal will be rigorously analyzed using nonsmooth calculus.*
Program
Discovery Grants Program - Individual
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2015-05311
Name nom
Audet, Charles
Department département
Mathématiques et génie industriel
Organization id
64
Institution établissement
École Polytechnique de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2018
Competition year année de concours
2015
Award amount
34000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
1206
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Engineering
Area of application fr
Génie
Research subject code
1601
Research subject group en
Industrial engineering
Research subject group fr
Génie industriel
Research subject en
Operations research and management science
Research subject fr
Recherche opérationnelle et science de la gestion
Partie
4
Nb partie
5
Application title
Derivative-free and blackbox optimization for engineering problems
Keyword
NSERC
Application summary
This research project is the continuation of my prior work funded by NSERC on the development of the Mesh Adaptive Direct Search algorithm (MADS) for derivative-free and blackbox optimization problems. In many engineering optimization problems, the objective and constraint functions are nonsmooth and evaluated through a computer simulation. The outputs of these codes are often of limited precision, contaminated with numerical noise, expensive to evaluate, and sometimes the code fails to return a value. *There has been an important amount of work in developing models to improve the efficiency of direct search optimization methods. Quadratic models, Gaussian processes, kriging interpolation as well as radial basis functions are such examples. There has also been work on expanding the capabilities to integer, categorical and periodic variables, on efficient treatment of constraints, on bi- and multi objective problems. In the present proposal we plan to pursue the development of MADS methods in many ways.*The current MADS algorithm generates trial points on a discretization of the space of variables called the mesh. Several engineers that have applied MADS to practical problems complained that a consequence of the way that the mesh size parameter is updated leads to modifications in the values of the variables below a reasonable granularity. We plan to alter the way that the mesh size parameter is updated, which is at the heart of the MADS algorithm, and the cornerstone of the nonsmooth convergence analysis. *Some constraints return a binary value indicating if it is satisfied or not, e.g., a flag indicating if the simulation failed or not. Such a binary constraint is difficult to model using the above-mentioned modelling techniques. We plan to import classification methods and data mining tools from the machine learning community to model them. We proposed the BiMADS algorithm for biobjective blackbox constrained optimization. For such problems, BiMADS returns a finite list of trade-off solutions, with respect to two conflicting objectives. We plan to once again use classification tools to analyze the nature of the list of trade-off solutions, and to create representative solutions.*Surrogates are used by MADS as an inexpensive substitute of the true simulation. MADS uses them by sampling the surrogate several times before deciding where to launch the true simulation. Our numerical experiments systematically show that surrogates considerably help in finding better solutions. We plan to devise a generic framework to handle surrogates with parametrizable precision, and to build additional models to dynamically estimate the difference between the true and surrogate functions. *All the projects outlined in this proposal will be rigorously analyzed using nonsmooth calculus.*