Grant: Doctoral: Vanier Canada Graduate Scholarships
University of Toronto
$150,000.00
Inference From Observational Research Methods (INFORM) project: facilitating interpretation of evidence from nonrandomized studies through a bias-adjusted treatment estimate calculator accounting for typical methodological weaknesses in their study design
FY 2015-16
Summary
Examples of high profile medical device recalls and surgical techniques found to non-significantly improve or even cause harm, highlight the need for an interpretative tool whereby health technology agencies can assess the accuracy of medical claims. There has often been no rigorous methodological evaluation of treatment effectiveness of many medical devices and surgical procedures, whose use was often grounded only in historical precedent. Randomized controlled trials (RCTs) provide the best quality of evidence about treatment effectiveness but are rarely performed for non-drug health technologies due to a lack of legal requirements and funding. Health technology agencies make decisions about funding and adopting new medical devices and surgical procedures often based on low-quality evidence from nonrandomized studies (NRS). However, typical flaws in their study design overestimate treatment benefit and underestimate potential harm. This research will develop an evaluation tool that can adjust estimates of treatment effect in NRS for these typical flaws. Our specific aims include 1) conducting a literature search of diverse health interventions to understand how results differ between NRS and RCTs, 2) developing a tool using advanced statistical methods to adjust estimates of treatment effect for NRS elements associated with bias and 3) providing accessible guidance to technical and non-technical knowledge users in interpreting results from NRS. This will include an online calculator that provides a bias-adjusted estimate of what the study might have shown with a better quality design. The results of this study will help decision makers, researchers and health care providers make better decisions about the quality of health interventions, which will translate to the better use of health care resources and improved care for patients. Finally, it will enable the government to more effectively manage scarce healthcare dollars.
Department
Program
Doctoral: Vanier Canada Graduate Scholarships
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
CIHR Funding Decisions Database
As published
Id
339592
Name
Chrystoja Caitlin C
Region
Ontario
Country
Canada
Orgtype
Institution Paid; Research Institution
Instname2
Health Services and Policy Research
Theme2
Health systems / services
Prcname2
Vanier Canada Graduate Scholarships CIHR
Projecttitle
Inference From Observational Research Methods (INFORM) project: facilitating interpretation of evidence from nonrandomized studies through a bias-adjusted treatment estimate calculator accounting for typical methodological weaknesses in their study design
Programtype2
Studentship Programs
Orgnameinp2
University of Toronto
Cihramount2
$150,000
Cihrequipment2
$0
Programname2
Doctoral: Vanier Canada Graduate Scholarships
Keyworddelim
Health Technology Assessment; Measurement Of Bias; Meta-Analysis; Non-Randomized Studies; Quality Assessment Instruments; Selection Bias; Systematic Reviews
Abstract
Examples of high profile medical device recalls and surgical techniques found to non-significantly improve or even cause harm, highlight the need for an interpretative tool whereby health technology agencies can assess the accuracy of medical claims. There has often been no rigorous methodological evaluation of treatment effectiveness of many medical devices and surgical procedures, whose use was often grounded only in historical precedent. Randomized controlled trials (RCTs) provide the best quality of evidence about treatment effectiveness but are rarely performed for non-drug health technologies due to a lack of legal requirements and funding. Health technology agencies make decisions about funding and adopting new medical devices and surgical procedures often based on low-quality evidence from nonrandomized studies (NRS). However, typical flaws in their study design overestimate treatment benefit and underestimate potential harm. This research will develop an evaluation tool that can adjust estimates of treatment effect in NRS for these typical flaws. Our specific aims include 1) conducting a literature search of diverse health interventions to understand how results differ between NRS and RCTs, 2) developing a tool using advanced statistical methods to adjust estimates of treatment effect for NRS elements associated with bias and 3) providing accessible guidance to technical and non-technical knowledge users in interpreting results from NRS. This will include an online calculator that provides a bias-adjusted estimate of what the study might have shown with a better quality design. The results of this study will help decision makers, researchers and health care providers make better decisions about the quality of health interventions, which will translate to the better use of health care resources and improved care for patients. Finally, it will enable the government to more effectively manage scarce healthcare dollars.
Competitiondate
201511
Approvedterm2
3 yrs 0 mth
Pinamesdelim
Chrystoja, Caitlin C
Approvedterm
3 ans 0 mois
Cihrcontribution2
~ $150,000~ $0~