Grant: Alliance Grants
Université de Montréal
$44,900.00
Deep neural network uncertainty estimation for safe integration into autonomous driving autonomy systems
FY 2023-24
Summary
Deep learning based perception systems, such as object detectors, have shown incredible improvements inperformance in recent years. It is desireable to incorporate these tools into robotic systems such as self-drivingcars. However, in order to do so requires that these models also have the ability to output reliable confidenceand uncertainty measures associated with their predictions. One particular challenge with deep neural networksis that there are several sources of uncertainty that are difficult to disentangle. For example, an object might bevery occluded in which case it would be difficult for even a human to detect it, or the object might of a typethat is not seen in the training data. In both cases, the model will have high uncertainty about the about but forvery different reasons. Bayesian Neural Networks attempt to overcome this problem by outputing distributionsthat approximate the optimal Bayesian estimate. The issue with most of these methods is twofold: 1) they donot scale to the types of problems that are relevant in robotics, 2) they often provide uncertainty estimates thatare uncalibrated, meaning that they don't faithfully represent the actual uncertainty in the underlying process.The objective of this project is threefold. First, we will build new algorithms for estimating sharp andwell-calibrated uncertainty estimates in deep learning based object detection. Second, we will demonstrate thatthese uncertainty estimates can be used in other downstream components of a robotics autonomy stack, such assensor fusion and risk-based planning. Third, we will show that these methods are applicable to the more realistic continual learning setup where not all data is assumed to be available at once. We will demonstrate this on well-established datasets and also on a full-scale autonomous vehicle.
Program
Alliance Grants
Recipient
Location
Quebec, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
580895-2022
Name nom
Paull, Liam LD
Department département
Informatique et recherche opérationnelle
Organization id
63
Institution établissement
Université de Montréal
Province en
Québec
Province fr
Québec
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2023
Competition year année de concours
2022
Award amount
44900
Program id
ALLRP
Program name en
Alliance Grants
Program name fr
Subventions Alliance
Group en
RESEARCH PARTNERSHIPS
Group fr
PARTENARIATS DE RECHERCHE
Committee code
96
Committee name en
RPP Internal Decision Cttee
Committee name fr
Cté de décision interne - PPR
Area of application code
700
Area of application group en
Transportation systems and services
Area of application group fr
Services et systèmes de transport
Area of application en
Transportation systems and services
Area of application fr
Services et systèmes de transport
Research subject code
2800
Research subject group en
Artificial intelligence
Research subject group fr
Artificial intelligence (computer vision, use2603)
Research subject en
Intelligence artificielle
Research subject fr
Intelligence artificielle (vision artificielle, utiliser 2603)
Application title
Deep neural network uncertainty estimation for safe integration into autonomous driving autonomy systems
Keyword
Autonomous Vehicles; Autonomy; Deep Learning; Object Detection; Robotics; Robot Perception; Uncertainty Estimation
Application summary
Deep learning based perception systems, such as object detectors, have shown incredible improvements inperformance in recent years. It is desireable to incorporate these tools into robotic systems such as self-drivingcars. However, in order to do so requires that these models also have the ability to output reliable confidenceand uncertainty measures associated with their predictions. One particular challenge with deep neural networksis that there are several sources of uncertainty that are difficult to disentangle. For example, an object might bevery occluded in which case it would be difficult for even a human to detect it, or the object might of a typethat is not seen in the training data. In both cases, the model will have high uncertainty about the about but forvery different reasons. Bayesian Neural Networks attempt to overcome this problem by outputing distributionsthat approximate the optimal Bayesian estimate. The issue with most of these methods is twofold: 1) they donot scale to the types of problems that are relevant in robotics, 2) they often provide uncertainty estimates thatare uncalibrated, meaning that they don't faithfully represent the actual uncertainty in the underlying process.The objective of this project is threefold. First, we will build new algorithms for estimating sharp andwell-calibrated uncertainty estimates in deep learning based object detection. Second, we will demonstrate thatthese uncertainty estimates can be used in other downstream components of a robotics autonomy stack, such assensor fusion and risk-based planning. Third, we will show that these methods are applicable to the more realistic continual learning setup where not all data is assumed to be available at once. We will demonstrate this on well-established datasets and also on a full-scale autonomous vehicle.