Grant: Discovery Grants Program - Individual
University of Prince Edward Island
$24,000.00
Improving Heuristic Search by Machine Learning
EF 2023-24
Résumé
Exploration and exploitation are two fundamental concepts in (meta)heuristic optimization. Surprisingly the lack of a formal definition has hindered the ability to measure and analyze them quantitatively. My most recent research has provided formal definitions for these concepts. Based on these definitions it has been possible to show the negative consequences of concurrent exploration and exploitation. We have also evidenced how selection in metaheuristic biases exploration, promoting failed exploration. These discoveries have been the base of a series of successful algorithms and diversifications techniques that we have developed during the past years (Leaders and Followers, Thresheld Convergence and Minimum Population Search). It has also motivated a new approach to optimization based on the idea of separating as much as possible both processes. The ultimate goal of this approach is the design of an exploration-only exploitation-only hybrid (EEH). The key challenge in such hybrid is the design of the exploration-only method. One of the limitations resides in the difficulty of measuring the effectiveness of exploration. Our definitions formalize these concepts, but there are few functions that allow measuring exploration in a practical way. Therefore the design of an "exploration benchmark" constitutes a fundamental intermediate goal to be achieved. The exploration benchmark and the EEH approach present exciting opportunities for the improvement of metaheuristics through machine learning. The ability to measure exploration on a broad number of functions will allow training deep learning models to estimate how promising an exploratory solution is, and thus avoid failed exploration. Selecting the best exploration strategy for a given function and predicting the optimum transition point from exploration to exploitation are also potential applications of machine learning into this new approach. The development of improved metaheuristics and the associated machine learning models provide a myriad of application opportunities; especially since this research is specifically focused on large scale domains. I will extend my previous experience in molecular docking with the aim of including a machine learning based optimizer, specifically designed for this problem, into the Autodock tool. In collaboration with the Quantum Computing research group at UPEI and Somru BioScience Inc. I will also apply these algorithms to a diversity of optimization and prediction problems in the fields of computational biology and chemistry.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Prince Edward Island, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2021-03205
Name nom
Bolufe-Rohler, Antonio
Department département
School of Mathematical and Computational Sciences
Organization id
88
Institution établissement
University of Prince Edward Island
Province en
Prince Edward Island
Province fr
Île-du-Prince-Édouard
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2021
Award amount
24000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1507
Committee name en
Computer Science
Committee name fr
Sciences informatiques
Area of application code
1200
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Advancement of knowledge
Area of application fr
Avancement des connaissances
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Artificial intelligence (computer vision, use2603)
Research subject en
Intelligence artificielle
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Application title
Improving Heuristic Search by Machine Learning
Keyword
Artificial Intelligence; Deep Learning; Evolutionary Computation; Metaheuristics; Optimization
Application summary
Exploration and exploitation are two fundamental concepts in (meta)heuristic optimization. Surprisingly the lack of a formal definition has hindered the ability to measure and analyze them quantitatively. My most recent research has provided formal definitions for these concepts. Based on these definitions it has been possible to show the negative consequences of concurrent exploration and exploitation. We have also evidenced how selection in metaheuristic biases exploration, promoting failed exploration. These discoveries have been the base of a series of successful algorithms and diversifications techniques that we have developed during the past years (Leaders and Followers, Thresheld Convergence and Minimum Population Search). It has also motivated a new approach to optimization based on the idea of separating as much as possible both processes. The ultimate goal of this approach is the design of an exploration-only exploitation-only hybrid (EEH). The key challenge in such hybrid is the design of the exploration-only method. One of the limitations resides in the difficulty of measuring the effectiveness of exploration. Our definitions formalize these concepts, but there are few functions that allow measuring exploration in a practical way. Therefore the design of an "exploration benchmark" constitutes a fundamental intermediate goal to be achieved. The exploration benchmark and the EEH approach present exciting opportunities for the improvement of metaheuristics through machine learning. The ability to measure exploration on a broad number of functions will allow training deep learning models to estimate how promising an exploratory solution is, and thus avoid failed exploration. Selecting the best exploration strategy for a given function and predicting the optimum transition point from exploration to exploitation are also potential applications of machine learning into this new approach. The development of improved metaheuristics and the associated machine learning models provide a myriad of application opportunities; especially since this research is specifically focused on large scale domains. I will extend my previous experience in molecular docking with the aim of including a machine learning based optimizer, specifically designed for this problem, into the Autodock tool. In collaboration with the Quantum Computing research group at UPEI and Somru BioScience Inc. I will also apply these algorithms to a diversity of optimization and prediction problems in the fields of computational biology and chemistry.