Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

University of Toronto

$27,000.00

Development and Evaluation of Real-like Synthetic Construction Images to Enhance the Performances of Deep Neural Network for Construction Applications

FY 2024-25

Summary
Deep neural networks (DNNs) are now seen as central to the future of artificial intelligence for construction robots. However, progress in robotics for the construction industry lags far behind that of other industries such as automobile and manufacturing. The problem-construction sites are extremely dynamic, rapidly changing, and crowded-poses an extreme challenge to the deployment of construction robots. DNN-powered AI is seen as the key to unlocking human-level understanding of construction sites. But DNN models need large sets of images to train on before they can obtain optimum performance. And these large training sets simply do not exist in the construction domain. Absent such training data, the outcome is a biased overfitted model with low accuracy and scalability. Against this backdrop, my short-term research goal is to improve the accuracy and scalability of DNN-based visual scene understanding models by deploying a novel training method that leverages non-real but real-looking virtual construction images. This short-term goal is an essential step in developing AI technology that achieves human-level visual scene understanding for construction contexts. It will be ground-breaking if we can automatically synthesize, generate, and label construction site images with no manual inputs, allowing DNNs to reach higher performance through a limitless quantity of training data, and allowing for the exploration of even deeper DNN architectures. There will be no legal issues in sharing non-real data; allowing such data to be used as the basis for fair competition and collaboration across research groups. To this end, my short-term research objectives are to: 1) Develop a computational framework that can automatically synthesize and label non-real but real-looking construction images that capture virtual construction worker avatars. 2) Build miniature-scale infrastructure that can record and label non-real but real-looking construction images that capture miniature-scale construction equipment. 3) Characterize the effect of the non-real images on a DNN's training, answering the following questions: (i) are the non-real construction images effective in improving the existing DNN models? and (ii) can a non-real construction image result in the same effect as a real image on DNN training? My short-term research outcome is to rapidly and efficiently expand training datasets of construction images by several orders of magnitude, with multiple important impacts on the study of DNNs in the construction domain, including: (i) dramatic improvements in DNN models for construction scene understanding; (ii) significant savings in time and resources; and (iii) enabling collective knowledge discovery across construction studies. Future construction robots will collaborate with field workers safely, improving productivity significantly and offsetting the growing labour shortage. The proposed research is essential to realizing this vision.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2022-04429
Name nom
Kim, Daeho
Department département
Civil and Mineral Engineering
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2022
Award amount
27000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
1001
Area of application group en
Northern development
Area of application group fr
Développement du nord
Area of application en
Construction, transportation and communications
Area of application fr
Construction, transports et communications
Research subject code
1001
Research subject group en
Civil engineering
Research subject group fr
Génie civil
Research subject en
Construction engineering and management
Research subject fr
Génie et gestion du bâtiment
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Development and Evaluation of Real-like Synthetic Construction Images to Enhance the Performances of Deep Neural Network for Construction Applications
Keywords
deep neural network (dnn); computer vision; dnn models for construction robotics; lack of training images and overfitting; potential of non-real but real-looking construction images
Application summary
Deep neural networks (DNNs) are now seen as central to the future of artificial intelligence for construction robots. However, progress in robotics for the construction industry lags far behind that of other industries such as automobile and manufacturing. The problem-construction sites are extremely dynamic, rapidly changing, and crowded-poses an extreme challenge to the deployment of construction robots. DNN-powered AI is seen as the key to unlocking human-level understanding of construction sites. But DNN models need large sets of images to train on before they can obtain optimum performance. And these large training sets simply do not exist in the construction domain. Absent such training data, the outcome is a biased overfitted model with low accuracy and scalability. Against this backdrop, my short-term research goal is to improve the accuracy and scalability of DNN-based visual scene understanding models by deploying a novel training method that leverages non-real but real-looking virtual construction images. This short-term goal is an essential step in developing AI technology that achieves human-level visual scene understanding for construction contexts. It will be ground-breaking if we can automatically synthesize, generate, and label construction site images with no manual inputs, allowing DNNs to reach higher performance through a limitless quantity of training data, and allowing for the exploration of even deeper DNN architectures. There will be no legal issues in sharing non-real data; allowing such data to be used as the basis for fair competition and collaboration across research groups. To this end, my short-term research objectives are to: 1) Develop a computational framework that can automatically synthesize and label non-real but real-looking construction images that capture virtual construction worker avatars. 2) Build miniature-scale infrastructure that can record and label non-real but real-looking construction images that capture miniature-scale construction equipment. 3) Characterize the effect of the non-real images on a DNN's training, answering the following questions: (i) are the non-real construction images effective in improving the existing DNN models? and (ii) can a non-real construction image result in the same effect as a real image on DNN training? My short-term research outcome is to rapidly and efficiently expand training datasets of construction images by several orders of magnitude, with multiple important impacts on the study of DNNs in the construction domain, including: (i) dramatic improvements in DNN models for construction scene understanding; (ii) significant savings in time and resources; and (iii) enabling collective knowledge discovery across construction studies. Future construction robots will collaborate with field workers safely, improving productivity significantly and offsetting the growing labour shortage. The proposed research is essential to realizing this vision.