Grant: Discovery Grants Program - Individual
Lakehead University
$23,000.00
Smart vision-based monitoring system for heavy construction and surface mining jobsites
EF 2017-18
Résumé
Construction operations, like other industrial and service processes, require real-time feedback systems to measure key performance indicators, such as productivity, and to take steps to correct problems that interfere with efficient operations. Currently, automated systems are broadly used in many industries and services and have improved productivity substantially. However, the construction industry has been slow to adopt automation. To develop effective automated feedback systems, researchers have tested different sensing technologies to monitor workers and equipment in the uniquely rugged environment of construction jobsites. Earthmoving projects, such as highway construction and surface mining operations, have been a primary initial focus in the industry for developing automated sensing systems. However, monitoring different types of equipment in a dynamic environment is a challenge; systems are challenged to understand the context of a construction site. For example, hydraulic excavators can take any number of shapes, which strains the ability of software to classify the actions of the equipment. Low-cost digital cameras, combined with promising advances in computer vision, make vision-based systems likely candidates for solutions in construction operations. The current systems using vision-based algorithms to monitor heavy operations, however, aren?t ideal and require some level of human intervention to operate successfully. For instance, they are not able to understand the scene and the user must determine the action type to be monitored; also, the user has to set the viewfinder of the camera on the operation of interest. The objective of this research program is to bridge the gap between theoretical computer vision and machine learning algorithms on one hand, and practical applications on the other, to develop a generic smart vision-based system to measure the productivity of earthmoving processes in construction and surface mining jobsites. Beyond object recognition and tracking, the proposed research program will investigate development of algorithms for action recognition and understanding the scene based on identified actions, automated control of panning and zooming features of a camera, proactive control of a network of cameras (including the ability to transfer tracking among cameras in the network), productivity estimation, deviation detection, and integration of developed modules. The final result will be an automated framework capable of tracking different kinds of machinery in different types of construction environments. This research plan could potentially transform earthmoving monitoring, making it an automated knowledge-based practice and leading to productivity increases, cost savings, improvement in the competitiveness of Canadian mining and heavy civil sectors, and reduction of greenhouse gas emissions of these operations.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
RGPIN-2015-03812
Name nom
RezazadehAzar, Ehsan
Department département
Civil Engineering - Civil Engineering
Organization id
25
Institution établissement
Lakehead University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2015
Award amount
23000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
603
Area of application group en
Construction, urban and rural planning
Area of application group fr
Construction, urbanisme et aménagement rural
Area of application en
Construction methods
Area of application fr
Méthodes de construction
Research subject code
1001
Research subject group en
Civil engineering
Research subject group fr
Génie civil
Research subject en
Construction engineering and management
Research subject fr
Génie et gestion du bâtiment
Partie
3
Nb partie
5
Application title
Smart vision-based monitoring system for heavy construction and surface mining jobsites
Keyword
NSERC
Application summary
Construction operations, like other industrial and service processes, require real-time feedback systems to measure key performance indicators, such as productivity, and to take steps to correct problems that interfere with efficient operations. Currently, automated systems are broadly used in many industries and services and have improved productivity substantially. However, the construction industry has been slow to adopt automation. To develop effective automated feedback systems, researchers have tested different sensing technologies to monitor workers and equipment in the uniquely rugged environment of construction jobsites. Earthmoving projects, such as highway construction and surface mining operations, have been a primary initial focus in the industry for developing automated sensing systems. However, monitoring different types of equipment in a dynamic environment is a challenge; systems are challenged to understand the context of a construction site. For example, hydraulic excavators can take any number of shapes, which strains the ability of software to classify the actions of the equipment. Low-cost digital cameras, combined with promising advances in computer vision, make vision-based systems likely candidates for solutions in construction operations. The current systems using vision-based algorithms to monitor heavy operations, however, aren?t ideal and require some level of human intervention to operate successfully. For instance, they are not able to understand the scene and the user must determine the action type to be monitored; also, the user has to set the viewfinder of the camera on the operation of interest. The objective of this research program is to bridge the gap between theoretical computer vision and machine learning algorithms on one hand, and practical applications on the other, to develop a generic smart vision-based system to measure the productivity of earthmoving processes in construction and surface mining jobsites. Beyond object recognition and tracking, the proposed research program will investigate development of algorithms for action recognition and understanding the scene based on identified actions, automated control of panning and zooming features of a camera, proactive control of a network of cameras (including the ability to transfer tracking among cameras in the network), productivity estimation, deviation detection, and integration of developed modules. The final result will be an automated framework capable of tracking different kinds of machinery in different types of construction environments. This research plan could potentially transform earthmoving monitoring, making it an automated knowledge-based practice and leading to productivity increases, cost savings, improvement in the competitiveness of Canadian mining and heavy civil sectors, and reduction of greenhouse gas emissions of these operations.