Grant: Discovery Grants Program - Individual
McMaster University
$16,000.00
Biostatistical issues in the design and analysis of experimental and observational studies, and in evaluating test accuracy
EF 2012-13
Résumé
This research concerns principles and applications in observational studies and randomised experiments. It is motivated by important practical questions, and the results should be widely applicable in research in health, and natural and social sciences. The major themes will be:
1.1 Experimental designs recognising participant preferences: In conventional experiments, all participants are randomised. Alternative designs have been proposed to allow some people to choose their intervention. Suitable data analysis can then estimate the effects of 1) treatment, 2) the participant's ideal treatment, and 3) whether the preferred treatment is the one received. The two latter effects are potentially important, but they are not estimable in conventional experiments. We will investigate optimization of the alternative designs; efficiency; sample size; power; and practical implementation.
1.2 Measurement error: We demonstrated earlier that in balanced randomised experiments, correction for measurement error in a baseline variable induces bias in the treatment effect. In contrast, in observational studies intuition suggests that failing to correct for measurement error may yield bias. Comparing these scenarios, we infer that there must be a threshold on the baseline difference, defining when correction is worthwhile. We propose to compare the corrected and uncorrected estimators of treatment effect, define the decision threshold, and provide practical advice about when to correct for measurement error.
2. Evaluation of test accuracy There is often no gold standard available for evaluating a new classifier (such as a diagnostic or screening test), so an imperfect reference standard must be substituted. It is not clear what impact this may have on assessing the new test. We will investigate how the apparent test accuracy may be biased when the reference standard is imperfect.
Programme
Discovery Grants Program - Individual
Bénéficiaire
Emplacement
Ontario, Canada
Type de bénéficiaire
Academia
Type
Grant
Source
NSERC's Awards Data
Tel que publié
Application id
8754-2011
Name nom
Walter, Stephen
Department département
Clinical Epidemiology and Biostatistics
Organization id
27
Institution établissement
McMaster University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2012
Competition year année de concours
2011
Award amount
16000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1508
Committee name en
Mathematics and Statistics
Committee name fr
Mathématiques et statistique
Area of application code
1101
Area of application group en
Health, education and social services
Area of application group fr
Santé publique, éducation et services sociaux
Area of application en
Human health (including medically-related psychological research)
Area of application fr
Santé publique (y compris recherche psychologique liée à la médecine)
Research subject code
3005
Research subject group en
Statistics and probability
Research subject group fr
Statistique et probabilité
Research subject en
Biostatistics
Research subject fr
Biostatistiques
Partie
2
Nb partie
5
Application title
Biostatistical issues in the design and analysis of experimental and observational studies, and in evaluating test accuracy
Keyword
NSERC
Application summary
This research concerns principles and applications in observational studies and randomised experiments. It is motivated by important practical questions, and the results should be widely applicable in research in health, and natural and social sciences. The major themes will be:
1.1 Experimental designs recognising participant preferences: In conventional experiments, all participants are randomised. Alternative designs have been proposed to allow some people to choose their intervention. Suitable data analysis can then estimate the effects of 1) treatment, 2) the participant's ideal treatment, and 3) whether the preferred treatment is the one received. The two latter effects are potentially important, but they are not estimable in conventional experiments. We will investigate optimization of the alternative designs; efficiency; sample size; power; and practical implementation.
1.2 Measurement error: We demonstrated earlier that in balanced randomised experiments, correction for measurement error in a baseline variable induces bias in the treatment effect. In contrast, in observational studies intuition suggests that failing to correct for measurement error may yield bias. Comparing these scenarios, we infer that there must be a threshold on the baseline difference, defining when correction is worthwhile. We propose to compare the corrected and uncorrected estimators of treatment effect, define the decision threshold, and provide practical advice about when to correct for measurement error.
2. Evaluation of test accuracy There is often no gold standard available for evaluating a new classifier (such as a diagnostic or screening test), so an imperfect reference standard must be substituted. It is not clear what impact this may have on assessing the new test. We will investigate how the apparent test accuracy may be biased when the reference standard is imperfect.