Grant: Discovery Grants Program - Individual
Carleton University
$24,000.00
Signal Detection Theory in Single-Trial Human-Decision Tasks
FY 2019-20
Summary
The literature on Detection Theory has almost exclusively focused on repeated-measures tasks in which signal and noise trials are intermixed. The reliance on repeated-measures tasks is largely pragmatic (e.g., increased statistical power). But, the real world has some important single-trial tasks that have not been properly explored and tend to behave differently. I have recently made two discoveries related to diagnostic value in such tasks. First, the filler-control method, which involves surrounding a stimulus of interest with known-noise stimuli, does not improve discriminability but can improve diagnostic value. Because affirmatives on known-noise stimuli are detectable errors they are not as consequential as critical-noise errors. Further, because known-noise stimuli decrease critical-noise errors more than true positives, they improve diagnostic value. Second, a person who encounters a noise-only trial will tend to use a lower criterion than will someone who encounters a signal trial. Now that this discrepancy is known, one can devise interventions that reduce discrepancy and improve diagnostic value. ******The specific context in which these discoveries have been tested and developed is eyewitness memory, but the revised detection model shows that these general principles are applicable to other single-trial tasks. The model shows that many detection tasks, such as forensic-object recognition and forensic examination could benefit from the filler-control method. Further, these tasks are likely plagued by signal/noise criteria discrepancy and could benefit from reduced discrepancy. Through computational modeling and experimentation, the present research will refine understanding in the eyewitness context and extend these findings to other single-trial tasks. Within the eyewitness context, I will examine how these phenomena are moderated by memory strength, number of fillers, instructions, and presentation methods. Further, I will demonstrate the generality of these discoveries by applying this model to other applied contexts (e.g., fingerprint examination, handwriting analysis, bite-mark analysis). ******The research will be of interest to the scientific and legal communities. The benefit to Canadians is a better functioning legal system and potentially a superior diagnostic test that can be used in an array of different applied settings. The major deliverable is a better understanding of human cognition and Detection Theory. Indeed, without applying Detection Theory to single-trial tasks, signal/noise criteria discrepancy would not have been discovered. This discrepancy likely does not exist in repeated-measures tasks.
Program
Discovery Grants Program - Individual
Recipient
Location
Ontario, Canada
Recipient Type
Academia
Type
Grant
Source
NSERC's Awards Data
As published
Application id
RGPIN-2018-05336
Name nom
Smith, Andrew
Department département
Psychology
Organization id
23
Institution établissement
Carleton University
Province en
Ontario
Province fr
Ontario
Country en
CANADA
Country fr
CANADA
Fiscal year exercice financier
2019
Competition year année de concours
2018
Award amount
24000
Program id
RGPIN
Program name en
Discovery Grants Program - Individual
Program name fr
Programme de subventions à la découverte - individuelles
Group en
DISCOVERY RESEARCH
Group fr
RECHERCHE AXÉE SUR LA DÉCOUVERTE
Committee code
1502
Committee name en
Biological Systems and Functions
Committee name fr
Systèmes et fonctions biologiques
Area of application code
1210
Area of application group en
Advancement of knowledge
Area of application group fr
Avancement des connaissances
Area of application en
Psychology
Area of application fr
Psychologie
Research subject code
6307
Research subject group en
Psychology
Research subject group fr
Psychologie
Research subject en
Cognitive science -- other
Research subject fr
Science cognitive -- autres
Installment
NA
Partie
0
Nb partie
NA
Application title
Signal Detection Theory in Single-Trial Human-Decision Tasks
Keyword
NSERC
Application summary
The literature on Detection Theory has almost exclusively focused on repeated-measures tasks in which signal and noise trials are intermixed. The reliance on repeated-measures tasks is largely pragmatic (e.g., increased statistical power). But, the real world has some important single-trial tasks that have not been properly explored and tend to behave differently. I have recently made two discoveries related to diagnostic value in such tasks. First, the filler-control method, which involves surrounding a stimulus of interest with known-noise stimuli, does not improve discriminability but can improve diagnostic value. Because affirmatives on known-noise stimuli are detectable errors they are not as consequential as critical-noise errors. Further, because known-noise stimuli decrease critical-noise errors more than true positives, they improve diagnostic value. Second, a person who encounters a noise-only trial will tend to use a lower criterion than will someone who encounters a signal trial. Now that this discrepancy is known, one can devise interventions that reduce discrepancy and improve diagnostic value. ******The specific context in which these discoveries have been tested and developed is eyewitness memory, but the revised detection model shows that these general principles are applicable to other single-trial tasks. The model shows that many detection tasks, such as forensic-object recognition and forensic examination could benefit from the filler-control method. Further, these tasks are likely plagued by signal/noise criteria discrepancy and could benefit from reduced discrepancy. Through computational modeling and experimentation, the present research will refine understanding in the eyewitness context and extend these findings to other single-trial tasks. Within the eyewitness context, I will examine how these phenomena are moderated by memory strength, number of fillers, instructions, and presentation methods. Further, I will demonstrate the generality of these discoveries by applying this model to other applied contexts (e.g., fingerprint examination, handwriting analysis, bite-mark analysis). ******The research will be of interest to the scientific and legal communities. The benefit to Canadians is a better functioning legal system and potentially a superior diagnostic test that can be used in an array of different applied settings. The major deliverable is a better understanding of human cognition and Detection Theory. Indeed, without applying Detection Theory to single-trial tasks, signal/noise criteria discrepancy would not have been discovered. This discrepancy likely does not exist in repeated-measures tasks.