Grant: Discovery Grants Program - Individual
University of Toronto
$36,000.00
Reproducible Bayes, Higher order likelihood and Inference methodology
FY 2017-18
Summary
Statistics has a wealth of procedures that range from recording an average of collected data, to examining the experimental results on a drug, to the verifying that is needed in the recent search for the Higgs Boson; the amount of data can range from some minimal few to the truly massive. There is always some purpose for a procedure. And all serious participants would want to know how well the procedures accomplished or achieved the purpose. For an exploratory use this means calibration of the procedure, in the every day sense of calibration. And for verifying it means, in part at least, reproducibility. For some calibration this might amount to the familiar 19 out of 20: and for some verification it could involve 1 in 3 million for some opposite. All of this involves some level of modelling to assess what can happen with a procedure. The Higgs search intrinsically involved Poisson counts and our inference group was instrumental in promoting higher accuracy for that analysis, and switching to the needed one-sided confidence and testing procedures from the initial two-sided. This research program is focused on the calibration of exploratory procedures and the verification of reproducibility, all in the context of full or partial modelling of the object under investigation. We have previously developed highly accurate assessment procedures and investigated the statistical arguments being used. In particular the arbitrariness involved in obtaining testing procedures has now been removed for a broad class of regular statistical models, and the Bayesian procedures for such models have been clarified and a long standing and problematic proposal by Jeffreys for prior information has been reinstated by a simple procedural adjustment that had not been foreseen in the 65 years of its availability. The research program also broadens this to the large data contexts where information is assembled locally in space and time and convenience, and the resulting pieces of partially dependent information are to be combined accurately and efficiently. This issue arose as composite likelihood and is now being extended to the more important composite significance with huge needs in the context of large to massive data. For a wide range of models it is known that frequency and Bayes give closely equivalent results for linear parameters but then change in opposite directions in the presence of parameter curvature: as the frequency analysis is reproducible this says bluntly that the Bayes is usually not reproducible. The research program is seeking a broad context implementation of corrections for this, to allow the convenience of the Bayes approach; the methodology is now established and our research seeks wide implementation. The key tool of exponential models can be examined to second rather than third order. The simplified model then gives second order procedures easily, close to third. This technique will be examined widely.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2015-03794
Name nom
Fraser, Donald
Department département
Statistics (St. George Campus) - Statistics (St. George Campus)
Organization id
31
Institution établissement
University of Toronto
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2017
Competition year année de concours
2015
Award amount
36000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
Discovery grants programs
Group fr
Programmes de subventions à la découverte
Committee code
1508
Committee name en
Mathematics and Statistics
Committee name fr
Mathématiques et statistique
Area of application code
1205
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Mathematical sciences
Area of application fr
Sciences mathématiques
Research subject code
3004
Research subject group en
Statistics and probability
Research subject group fr
Statistique et probabilité
Research subject en
Applied statistics
Research subject fr
Statistique appliquée
Partie
3
Nb partie
5
Application title
Reproducible Bayes, Higher order likelihood and Inference methodology
Keyword
NSERC
Application summary
Statistics has a wealth of procedures that range from recording an average of collected data, to examining the experimental results on a drug, to the verifying that is needed in the recent search for the Higgs Boson; the amount of data can range from some minimal few to the truly massive. There is always some purpose for a procedure. And all serious participants would want to know how well the procedures accomplished or achieved the purpose. For an exploratory use this means calibration of the procedure, in the every day sense of calibration. And for verifying it means, in part at least, reproducibility. For some calibration this might amount to the familiar 19 out of 20: and for some verification it could involve 1 in 3 million for some opposite. All of this involves some level of modelling to assess what can happen with a procedure. The Higgs search intrinsically involved Poisson counts and our inference group was instrumental in promoting higher accuracy for that analysis, and switching to the needed one-sided confidence and testing procedures from the initial two-sided. This research program is focused on the calibration of exploratory procedures and the verification of reproducibility, all in the context of full or partial modelling of the object under investigation. We have previously developed highly accurate assessment procedures and investigated the statistical arguments being used. In particular the arbitrariness involved in obtaining testing procedures has now been removed for a broad class of regular statistical models, and the Bayesian procedures for such models have been clarified and a long standing and problematic proposal by Jeffreys for prior information has been reinstated by a simple procedural adjustment that had not been foreseen in the 65 years of its availability. The research program also broadens this to the large data contexts where information is assembled locally in space and time and convenience, and the resulting pieces of partially dependent information are to be combined accurately and efficiently. This issue arose as composite likelihood and is now being extended to the more important composite significance with huge needs in the context of large to massive data. For a wide range of models it is known that frequency and Bayes give closely equivalent results for linear parameters but then change in opposite directions in the presence of parameter curvature: as the frequency analysis is reproducible this says bluntly that the Bayes is usually not reproducible. The research program is seeking a broad context implementation of corrections for this, to allow the convenience of the Bayes approach; the methodology is now established and our research seeks wide implementation. The key tool of exponential models can be examined to second rather than third order. The simplified model then gives second order procedures easily, close to third. This technique will be examined widely.