Grant: Discovery Grants Program - Individual
University of Manitoba
$36,000.00
Deep learning based structural health monitoring with autonomous UAVs
EF 2024-25
Résumé
An automated reliable, efficient, and robust health monitoring system is urgently needed to detect damaged infrastructure in Canada's aging bridge system. Many vibration-based methods have been developed to detect bridge damage using contact sensors. However, these methods are unreliable and expensive, because they are vulnerable to uncertainties, noise, and environmental changes and require many installed sensors. Visual inspection by trained engineers is the current main approach, but is also costly, and biannual inspection cannot adequately prevent sudden collapse. Recently, computer vision (CV)-based damage detection methods have been proposed to support visual inspection. At present, this method is limited to detecting only one damage type. Additionally, it uses weak damage sensitive features extracted from traditional image processing and traditional machine learning to classify damage features. Thus, it is not robust to changes in the lighting conditions of input images.
Since 2017, I have pioneered deep learning (DL)-based damage detection to overcome the limitations of traditional CV-based approaches through my previous NSERC Discovery Grant. This research has received worldwide interest, and numerous follow-up studies have been conducted. I also initiated the development of an autonomous drone flight method to enable flight in global positioning system (GPS) denied areas using an ultrasonic beacon system (UBS). These areas include the space beneath a bridge deck, where GPS is unavailable, and safety-critical areas, where important structural members and their connections are found. However, extensive investigation is required to develop a fully automated bridge inspection and management system. Such a system is the long-term goal of the proposed research program. The short-term objectives of this proposal are to (1) develop pixel-level multiple-damage identification based on advanced DL methods for external and internal damage using regular and thermal cameras, (2) develop an autonomous flight method for an entire bridge system without using GPS or UBS, (3) develop a holistic three-dimensional (3D) damage mapping method for efficient bridge management, and (4) integrate of all the developed methods for the fully automated bridge inspection system.
This automated inspection system will be reliable, accurate, and cost-efficient by providing an explicit, visual, and holistic 3D damage map for efficient bridge management. Automation enables frequent inspection and can prevent sudden collapse by detecting early-stage internal and external damage. This research will produce a prototype of the automated bridge inspection system, which will be relevant to artificial intelligence and mechanical and electrical industries worldwide. The prototype will be developed using a DL method and the autonomous flight drone system with wireless auto-charging. Accordingly, University of Manitoba continues to be a world leader in this research topic.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Manitoba, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2022-04120
Name nom
Cha, Young Jin
Department département
Civil Engineering
Organization id
19
Institution établissement
University of Manitoba
Province en
Manitoba
Province fr
Manitoba
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2024
Competition year année de concours
2022
Award amount
36000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
601
Area of application group en
Construction, urban and rural planning
Area of application group fr
Construction, urbanisme et aménagement rural
Area of application en
Structural engineering
Area of application fr
Génie des charpentes
Research subject code
1000
Research subject group en
Civil engineering
Research subject group fr
Génie civil
Research subject en
Civil engineering
Research subject fr
Génie civil
Field of research list names en
Not available
Field of research list names fr
Non disponible
Socioeconomic objective list names en
Not available
Socioeconomic objective list names fr
Non disponible
Application title
Deep learning based structural health monitoring with autonomous UAVs
Keywords
deep learning; damage detection; infrastructure health monitoring; damage quantification; computer vision; automation; unmanned aerial vehicles; holistic damage mapping; semantic segmentation; real-time processing
Application summary
An automated reliable, efficient, and robust health monitoring system is urgently needed to detect damaged infrastructure in Canada's aging bridge system. Many vibration-based methods have been developed to detect bridge damage using contact sensors. However, these methods are unreliable and expensive, because they are vulnerable to uncertainties, noise, and environmental changes and require many installed sensors. Visual inspection by trained engineers is the current main approach, but is also costly, and biannual inspection cannot adequately prevent sudden collapse. Recently, computer vision (CV)-based damage detection methods have been proposed to support visual inspection. At present, this method is limited to detecting only one damage type. Additionally, it uses weak damage sensitive features extracted from traditional image processing and traditional machine learning to classify damage features. Thus, it is not robust to changes in the lighting conditions of input images.
Since 2017, I have pioneered deep learning (DL)-based damage detection to overcome the limitations of traditional CV-based approaches through my previous NSERC Discovery Grant. This research has received worldwide interest, and numerous follow-up studies have been conducted. I also initiated the development of an autonomous drone flight method to enable flight in global positioning system (GPS) denied areas using an ultrasonic beacon system (UBS). These areas include the space beneath a bridge deck, where GPS is unavailable, and safety-critical areas, where important structural members and their connections are found. However, extensive investigation is required to develop a fully automated bridge inspection and management system. Such a system is the long-term goal of the proposed research program. The short-term objectives of this proposal are to (1) develop pixel-level multiple-damage identification based on advanced DL methods for external and internal damage using regular and thermal cameras, (2) develop an autonomous flight method for an entire bridge system without using GPS or UBS, (3) develop a holistic three-dimensional (3D) damage mapping method for efficient bridge management, and (4) integrate of all the developed methods for the fully automated bridge inspection system.
This automated inspection system will be reliable, accurate, and cost-efficient by providing an explicit, visual, and holistic 3D damage map for efficient bridge management. Automation enables frequent inspection and can prevent sudden collapse by detecting early-stage internal and external damage. This research will produce a prototype of the automated bridge inspection system, which will be relevant to artificial intelligence and mechanical and electrical industries worldwide. The prototype will be developed using a DL method and the autonomous flight drone system with wireless auto-charging. Accordingly, University of Manitoba continues to be a world leader in this research topic.