Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Alliance Grants

University of Toronto

$65,010.00

Visual AI-driven Robotic Automation and Digital Management: Development, Demonstration, and Proof of Concept (PoC) on UofT's Construction Project Site.

FY 2024-25

Summary
This research partnership aims to revolutionize the construction industry by integrating visual artificial intelligence (AI)-driven robotic solutions. Our long-term goal is to demonstrate these innovations' effectiveness and return-on-investment in real-world projects, thereby inspiring leading construction enterprises to embrace this new paradigm. Central to our strategy is addressing the critical shortage of construction-specific training data for Deep Neural Networks (DNNs), the core element of visual AIs. We will introduce an automated method for synthesizing and labeling vast amounts of construction images, circumventing the current data scarcity and legal constraints. This approach promises to enhance DNN capabilities and foster deeper architectural exploration. Our immediate objectives include (1) advancing a construction image synthetization/labeling pipeline, (2) training and validating visual AIs for construction scenes to a Technology Readiness Level of 7 or higher (e.g., 3D worker detection or 3D excavator pose estimation), and (3) releasing a pioneering DNN benchmark dataset for construction equipment.
Program
Alliance Grants
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
597479-2024
Name nom
Kim, Daeho DH
Department département
Civil & Mineral Engineering, Dept of
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2024
Award amount
65010
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
603
Area of application group en
Construction, urban and rural planning
Area of application group fr
Construction, urbanisme et aménagement rural
Area of application en
Construction methods
Area of application fr
Méthodes de construction
Research subject code
1001
Research subject group en
Civil engineering
Research subject group fr
Génie civil
Research subject en
Construction engineering and management
Research subject fr
Génie et gestion du bâtiment
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Visual AI-driven Robotic Automation and Digital Management: Development, Demonstration, and Proof of Concept (PoC) on UofT's Construction Project Site.
Keywords
autonomous mobile robot; construction automation; construction digitization; deep neural network; dnn training data; image synthetization; multimodal labeling; visual artificial intelligence; visual scene understanding
Application summary
This research partnership aims to revolutionize the construction industry by integrating visual artificial intelligence (AI)-driven robotic solutions. Our long-term goal is to demonstrate these innovations' effectiveness and return-on-investment in real-world projects, thereby inspiring leading construction enterprises to embrace this new paradigm. Central to our strategy is addressing the critical shortage of construction-specific training data for Deep Neural Networks (DNNs), the core element of visual AIs. We will introduce an automated method for synthesizing and labeling vast amounts of construction images, circumventing the current data scarcity and legal constraints. This approach promises to enhance DNN capabilities and foster deeper architectural exploration. Our immediate objectives include (1) advancing a construction image synthetization/labeling pipeline, (2) training and validating visual AIs for construction scenes to a Technology Readiness Level of 7 or higher (e.g., 3D worker detection or 3D excavator pose estimation), and (3) releasing a pioneering DNN benchmark dataset for construction equipment.