title: A Validation Study of Bullet and Cartridge Case Comparisons Using Samples Representative of Actual Casework.
abstract: The foundation of firearm and tool mark identification is that no two tools should produce the same microscopic marks on two separate objects that they would be inaccurately or wrongly identified. Studies addressing the validity of identification infrequently employ tests that mirror realistic casework scenarios. This study attempted to do so using a double-blind process, reducing test-taking bias. Test kits including bullets and cartridge cases but not the associated firearms were completed by 31 analysts from 22 agencies. Analysis of the results demonstrated an overall error rate of 0.303%, sensitivity of 85.2%, and specificity of 86.8%. Variability in performance across examiners is addressed, and the effect of examiners' years of experience on identification accuracy is explored. Finally, the article discusses the importance of studies using realistic case work scenarios when validating the field's performance and in providing courts with usable indicators of the accuracy of firearm and tool mark identification.
authors.affiliation: San Francisco Police, Department Crime Lab, 1245 3rd Street, San Francisco, CA, 94158.
authors.forename: Tasha P
authors.initials: TP
authors.lastname: Smith
authors.affiliation: San Francisco Police, Department Crime Lab, 1245 3rd Street, San Francisco, CA, 94158.
authors.forename: G
authors.initials: G
authors.lastname: Andrew Smith
authors.affiliation: Program in Criminal Justice Studies, San Francisco State University, San Francisco, CA.
authors.forename: Jeffrey B
authors.initials: JB
authors.lastname: Snipes
keywords: casework simulation; error rate studies; firearm and tool mark identification; forensic science; sensitivity and specificity; validation study