Grant: Project Grant - PA : Population and Public Health - Equitable AI
Unity Health Toronto
$100,000.00
Identifying and mitigating bias in machine learning models used in population health
FY 2020-21
Summary
Machine learning (ML) is a form of artificial intelligence that has increasingly been used over the last decade in a variety of sectors, as computing power and the availability of data has increased exponentially. ML applies algorithms to vast amounts of data, and through doing so, are programmed to learn over time in an autonomous fashion. ML has begun to be applied to population-level data, both in health services and in public health. However, it is now well recognized that ML models can replicate biases related to numerous factors including that the data used to train models contains biases, the people developing the models bring their biases to their work, and ideas about causation are biased. As ML is applied in population health, including the COVID-19 pandemic, guidelines to identify and mitigate biases are needed. This project consists of two parts that will occur in tandem. Part 1: We will conduct a scoping review of the literature to identify ML models used in specific areas of population health and to examine whether and how biases were identified. Part 2: We will develop guidelines for model developers to identify and reduce bias in ML models used in population health. Our approach will be informed by standards from the Grading of Recommendations Assessment, Development and Evaluation (GRADE), the UK National Institute for Health and Care Excellence (NICE), and guidelines for statistical model development. We will engage a broad set of stakeholders in the guideline development process. Our diverse team includes national and international experts in computer sciences, statistical modeling, epidemiology, ethics, sociology, public health, and the social determinants of health. This project builds on previous work on public perspectives of AI, ML applied to predicting population health outcomes, and the ethics of AI. Our findings will support efforts to ensure AI applications contribute to reducing, rather than exacerbating, health inequities.
Department
Program
Project Grant - PA : Population and Public Health - Equitable AI
Recipient
Location
Ontario, Canada
Recipient Type
Other
Type
Grant
Source
CIHR Funding Decisions Database
As published
Id
442938
Name
Pinto Andrew D
Region
Ontario
Country
Canada
Orgtype
Institution Paid; Research Institution
Instname2
Population and Public Health
Theme2
Social / Cultural / Environmental / Population Health
Prcname2
Public, Community & Population Health
Projecttitle
Identifying and mitigating bias in machine learning models used in population health
Programtype2
Operating Grants
Orgnameinp2
Unity Health Toronto
Cihramount2
$100,000
Cihrequipment2
$0
Programname2
Project Grant - PA : Population and Public Health - Equitable AI
Keyworddelim
Artificial Intelligence; Bias; Equity; Guideline Development; Health Inequities; Machine Learning; Model Development; Population Health; Public Health
Abstract
Machine learning (ML) is a form of artificial intelligence that has increasingly been used over the last decade in a variety of sectors, as computing power and the availability of data has increased exponentially. ML applies algorithms to vast amounts of data, and through doing so, are programmed to learn over time in an autonomous fashion. ML has begun to be applied to population-level data, both in health services and in public health. However, it is now well recognized that ML models can replicate biases related to numerous factors including that the data used to train models contains biases, the people developing the models bring their biases to their work, and ideas about causation are biased. As ML is applied in population health, including the COVID-19 pandemic, guidelines to identify and mitigate biases are needed. This project consists of two parts that will occur in tandem. Part 1: We will conduct a scoping review of the literature to identify ML models used in specific areas of population health and to examine whether and how biases were identified. Part 2: We will develop guidelines for model developers to identify and reduce bias in ML models used in population health. Our approach will be informed by standards from the Grading of Recommendations Assessment, Development and Evaluation (GRADE), the UK National Institute for Health and Care Excellence (NICE), and guidelines for statistical model development. We will engage a broad set of stakeholders in the guideline development process. Our diverse team includes national and international experts in computer sciences, statistical modeling, epidemiology, ethics, sociology, public health, and the social determinants of health. This project builds on previous work on public perspectives of AI, ML applied to predicting population health outcomes, and the ethics of AI. Our findings will support efforts to ensure AI applications contribute to reducing, rather than exacerbating, health inequities.
Competitiondate
202010
Approvedterm2
1 yr 0 mth
Pinamesdelim
Pinto, Andrew D
Approvedterm
1 an 0 mois
Cihrcontribution2
~ $100,000~ $0~