title: Creating and field-testing child maltreatment definitions: improving the reliability of substantiation determinations.
abstract: The decision to substantiate a case of maltreatment is pivotal to myriad stakeholders; however, the reliability (and therefore, accuracy) of substantiation determinations is suspect. The authors tested if (a) they could develop more reliable substantiation definitions and processes and (b) case workers would be comfortable with and accepting of a new approach. Determinations from five field sites were compared with those of master reviewers (made while listening to the field sites' case presentations). Agreement, sensitivity, specificity, positive predictive values, and negative predictive values were high overall (.87, .96, .97, .89, and .97, respectively) and for each form of maltreatment. Agreement was substantially improved. The definitions and the determination process were well liked by case workers and other stakeholders. Clearly, implementing standardized definitions in a typical child protective environment would pose myriad political challenges. However, our results suggest achieving reliable substantiation determinations may be a feasible goal.
authors.affiliation: Department of Psychology, State University of New York at Stony Brook, 11794, USA. amy.slep@stonybrook.edu
authors.forename: Amy M Smith
authors.initials: AM
authors.lastname: Slep
authors.forename: Richard E
authors.initials: RE
authors.lastname: Heyman
mesh_terms: D000293:Adolescent; D019090:Case Management / Q000145:classification / Q000458:organization & administration; D002648:Child; D002649:Child Abuse / Q000145:classification / Q000175:diagnosis* / Q000523:psychology; D002650:Child Abuse, Sexual / Q000145:classification / Q000175:diagnosis* / Q000523:psychology; D002651:Child Advocacy; D002669:Child Welfare / Q000145:classification; D003299:Cooperative Behavior; D005260:Female; D006801:Humans; D007318:Inservice Training / Q000379:methods; D007400:Interprofessional Relations; D008297:Male; D018570:Risk Assessment; D012947:Social Work; D014481:United States