Canada Spends Logo

Explore our Budget 2026 analysis

Grant: Discovery Grants Program - Individual

Queen's University

$26,000.00

Diagnosis, Learning and Optimization of Smart and Connected Products

FY 2023-24

Summary
Today's smart product transmit real-time sensor data to a control centre that can monitor its condition, perform remote diagnosis, and adjust its configuration in real time to improve performance. Such products have revolutionized many industries, transforming traditional manufacturers into service providers. Tesla, for example, monitors its cars for malfunction via in-car sensors. The centre then advises when service is needed. Many issues can be rectified via "over-the-air" software updates. If on-site service is needed, the centre dispatches a service team with the right spare parts. Car configuration can also be adjusted via software so that the car can adapt to user behaviour to improve safety and efficiency. However, the imperfection of sensor data makes the operation of smart products complex. Many failure modes may share similar features and be hard to distinguish. To learn more about a product's true condition, the control centre can wait and monitor the product longer, but this invariably introduces delay. Faced with tension between learning and intervention, the centre must decide when to stop monitoring and what action to take in a timely and accurate fashion. This trade-off between learning and doing lies at the heart of the operations of smart and connected products. Existing models for the control of sensor-embedded systems fall mostly under the framework of partially observable Markov decision processes. It is known that multi-state problems suffer from the curse of dimensionality in dynamic programming and hence the optimal policy is difficult, if not impossible, to compute, and thus most existing work considers simple systems with binary states. A network of connected products requires one to generalize the optimization to multi-state systems, which is now possible due to recent advances in artificial intelligence that compresses the state space. Additionally, existing work often assumes model parameters are known, which is not always the case in reality. The proposed work will use a Bayes-adaptive approach to jointly learn model parameters and hidden system state while making sequential decisions. This research program will: develop the optimal monitoring and diagnostic algorithm for smart products by leveraging the full potential of imperfect sensor data; gain insight into how to optimally fine-tune a product in real time to maximize the performance; and develop a new framework that harnesses connectivity among products to aggregate and share information to improve efficiency of maintenance and operations. Research outcomes are important for manufacturers in the Internet of Things era and for academic researchers in industrial engineering and operations research. These topics also provide a strong opportunity to train HQP in data analytics and real-time optimization.
Program
Discovery Grants Program - Individual
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data

As published

Application id
RGPIN-2019-05671
Name nom
Wang, Jue
Department département
Smith School of Business
Organization id
29
Institution établissement
Queen's University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2019
Award amount
26000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1509
Committee name en
Civil, Industrial and Systems Engineering
Committee name fr
Génie civil, industriel et des systèmes
Area of application code
520
Area of application group en
Manufacturing processes and products
Area of application group fr
Procédés et produits industriels
Area of application en
Production and operations management
Area of application fr
Production et gestion des opérations
Research subject code
1604
Research subject group en
Industrial engineering
Research subject group fr
Manufacturing
Research subject en
Génie industriel
Research subject fr
Fabrication
Application title
Diagnosis, Learning and Optimization of Smart and Connected Products
Keyword
Bayesian decision theory; Diagnosis; Dynamic Programming and Optimal Control; Maintenance and reliability; Markov decision processes; Optimal control; Optimal Learning; Realtime monitoring; Reinforcement learning; Smart and Connected Products
Application summary
Today's smart product transmit real-time sensor data to a control centre that can monitor its condition, perform remote diagnosis, and adjust its configuration in real time to improve performance. Such products have revolutionized many industries, transforming traditional manufacturers into service providers. Tesla, for example, monitors its cars for malfunction via in-car sensors. The centre then advises when service is needed. Many issues can be rectified via "over-the-air" software updates. If on-site service is needed, the centre dispatches a service team with the right spare parts. Car configuration can also be adjusted via software so that the car can adapt to user behaviour to improve safety and efficiency. However, the imperfection of sensor data makes the operation of smart products complex. Many failure modes may share similar features and be hard to distinguish. To learn more about a product's true condition, the control centre can wait and monitor the product longer, but this invariably introduces delay. Faced with tension between learning and intervention, the centre must decide when to stop monitoring and what action to take in a timely and accurate fashion. This trade-off between learning and doing lies at the heart of the operations of smart and connected products. Existing models for the control of sensor-embedded systems fall mostly under the framework of partially observable Markov decision processes. It is known that multi-state problems suffer from the curse of dimensionality in dynamic programming and hence the optimal policy is difficult, if not impossible, to compute, and thus most existing work considers simple systems with binary states. A network of connected products requires one to generalize the optimization to multi-state systems, which is now possible due to recent advances in artificial intelligence that compresses the state space. Additionally, existing work often assumes model parameters are known, which is not always the case in reality. The proposed work will use a Bayes-adaptive approach to jointly learn model parameters and hidden system state while making sequential decisions. This research program will: develop the optimal monitoring and diagnostic algorithm for smart products by leveraging the full potential of imperfect sensor data; gain insight into how to optimally fine-tune a product in real time to maximize the performance; and develop a new framework that harnesses connectivity among products to aggregate and share information to improve efficiency of maintenance and operations. Research outcomes are important for manufacturers in the Internet of Things era and for academic researchers in industrial engineering and operations research. These topics also provide a strong opportunity to train HQP in data analytics and real-time optimization.