title: Pass-Fail Testing: Statistical Requirements and Interpretations.
abstract: Performance standards for detector systems often include requirements for probability of detection and probability of false alarm at a specified level of statistical confidence. This paper reviews the accepted definitions of confidence level and of critical value. It describes the testing requirements for establishing either of these probabilities at a desired confidence level. These requirements are computable in terms of functions that are readily available in statistical software packages and general spreadsheet applications. The statistical interpretations of the critical values are discussed. A table is included for illustration, and a plot is presented showing the minimum required numbers of pass-fail tests. The results given here are applicable to one-sided testing of any system with performance characteristics conforming to a binomial distribution.
authors: National Institute of Standards and Technology, Gaithersburg, MD 20899.
authors: David
authors: D
authors: Gilliam
authors: National Institute of Standards and Technology, Gaithersburg, MD 20899.
authors: Stefan
authors: S
authors: Leigh
authors: National Institute of Standards and Technology, Gaithersburg, MD 20899.
authors: Andrew
authors: A
authors: Rukhin
authors: National Institute of Standards and Technology, Gaithersburg, MD 20899.
authors: William
authors: W
authors: Strawderman
keywords: binomial distribution; confidence bounds; confidence coefficient; critical value; probability of detection; probability of false alarm