title: Integrating Human Factors Engineering and Information Processing Approaches to Facilitate Evaluations in Criminal Justice Technology Research.
abstract: BACKGROUND
  Evaluations are routinely conducted by government agencies and research organizations to assess the effectiveness of technology in criminal justice. Interdisciplinary research methods are salient to this effort. Technology evaluations are faced with a number of challenges including (1) the need to facilitate effective communication between social science researchers, technology specialists, and practitioners, (2) the need to better understand procedural and contextual aspects of a given technology, and (3) the need to generate findings that can be readily used for decision making and policy recommendations.
  
  
  OBJECTIVE
  Process and outcome evaluations of technology can be enhanced by integrating concepts from human factors engineering and information processing. This systemic approach, which focuses on the interaction between humans, technology, and information, enables researchers to better assess how a given technology is used in practice.
  
  
  METHODS
  Examples are drawn from complex technologies currently deployed within the criminal justice system where traditional evaluations have primarily focused on outcome metrics. Although this evidence-based approach has significant value, it is vulnerable to fully account for human and structural complexities that compose technology operations.
  
  
  CONCLUSIONS
  Guiding principles for technology evaluations are described for identifying and defining key study metrics, facilitating communication within an interdisciplinary research team, and for understanding the interaction between users, technology, and information. The approach posited here can also enable researchers to better assess factors that may facilitate or degrade the operational impact of the technology and answer fundamental questions concerning whether the technology works as intended, at what level, and cost.
authors.affiliation: Performance Criteria, Inc., Totowa, NJ, USA asalvemini@hfeaudit.com.
authors.forename: Anthony V
authors.initials: AV
authors.lastname: Salvemini
authors.affiliation: John Jay College of Criminal Justice, New York, NY, USA.
authors.forename: Eric L
authors.initials: EL
authors.lastname: Piza
authors.affiliation: Indiana University-Purdue University Indianapolis, Indianapolis, IN, USA.
authors.forename: Jeremy G
authors.initials: JG
authors.lastname: Carter
authors.affiliation: Indiana University-Purdue University Indianapolis, Indianapolis, IN, USA.
authors.forename: Eric L
authors.initials: EL
authors.lastname: Grommon
authors.affiliation: National Institute of Justice, Washington, DC, USA.
authors.forename: Nancy
authors.initials: N
authors.lastname: Merritt
mesh_terms: D003416:Criminal Law; D003657:Decision Making; D006804:Ergonomics; D055317:Evidence-Based Practice; D006801:Humans; D010043:Outcome and Process Assessment, Health Care; D011050:Policy Making; D012107:Research Design; D013673:Technology Assessment, Biomedical
keywords: criminal justice technology; evidence-based criminology; human factors engineering; research collaboration