title: A new implicit review instrument for measuring quality of care delivered to pediatric patients in the emergency department.
abstract: BACKGROUND
  There are few outcomes experienced by children receiving care in the Emergency Department (ED) that are amenable to measuring for the purposes of assessing of quality of care. The purpose of this study was to develop, test, and validate a new implicit review instrument that measures quality of care delivered to children in EDs.
  
  
  METHODS
  We developed a 7-point structured implicit review instrument that encompasses four aspects of care, including the physician's initial data gathering, integration of information and development of appropriate diagnoses; initial treatment plan and orders; and plan for disposition and follow-up. Two pediatric emergency medicine physicians applied the 5-item instrument to children presenting in the highest triage category to four rural EDs, and we assessed the reliability of the average summary scores (possible range of 5-35) across the two reviewers using standard measures. We also validated the instrument by comparing this mean summary score between those with and without medication errors (ascertained independently by two pharmacists) using a two-sample t-test.
  
  
  RESULTS
  We reviewed the medical records of 178 pediatric patients for the study. The mean and median summary score for this cohort of patients were 27.4 and 28.5, respectively. Internal consistency was high (Cronbach's alpha of 0.92 and 0.89). All items showed a significant (p < 0.005) positive correlation between reviewers using the Spearman rank correlation (range 0.24 to 0.39). Exact agreement on individual items between reviewers ranged from 70.2% to 85.4%. The Intra-class Correlation Coefficient for the mean of the total summary score across the two reviewers was 0.65. The validity of the instrument was supported by the finding of a higher score for children without medication errors compared to those with medication errors which trended toward significance (mean score = 28.5 vs. 26.0, p = 0.076).
  
  
  CONCLUSIONS
  The instrument we developed to measure quality of care provided to children in the ED has high internal consistency, fair to good inter-rater reliability and inter-rater correlation, and high content validity. The validity of the instrument is supported by the fact that the instrument's average summary score was lower in the presence of medication errors, which trended towards statistical significance.
authors: Department of Pediatrics, University of California, Davis, USA. mdharmar@ucdavis.edu.
authors: Madan
authors: M
authors: Dharmar
authors: James P
authors: JP
authors: Marcin
authors: Nathan
authors: N
authors: Kuppermann
authors: Emily R
authors: ER
authors: Andrada
authors: Stacey
authors: S
authors: Cole
authors: Danielle J
authors: DJ
authors: Harvey
authors: Patrick S
authors: PS
authors: Romano
references: N Engl J Med. 1985 Oct 31;313(18):1131-7
references: 3930964
references: Med Care. 2000 Feb;38(2):152-61
references: 10659689
references: JAMA. 1990 Oct 17;264(15):1969-73
references: 2120476
references: Pediatrics. 2002 Oct;110(4):737-42
references: 12359787
references: JAMA. 1997 Nov 19;278(19):1573-8
references: 9370502
references: JAMA. 1992 May 6;267(17):2349-54
references: 1564775
references: Ann Emerg Med. 2004 Apr;43(4):461-8
references: 15039688
references: Pediatrics. 1987 May;79(5):718-22
references: 3575028
references: Eval Health Prof. 1994 Mar;17(1):3-21
references: 10132480
references: JAMA. 1990 Oct 17;264(15):1974-9
references: 2214062
references: Acad Emerg Med. 2001 Feb;8(2):156-62
references: 11157292
references: JAMA. 1988 Sep 23-30;260(12):1743-8
references: 3045356
references: JAMA. 1991 Apr 17;265(15):1957-60
references: 2008024
references: JAMA. 2001 Apr 25;285(16):2114-20
references: 11311101
references: Int J Qual Health Care. 2001 Oct;13(5):357-65
references: 11669563
references: Ann Intern Med. 1993 Apr 1;118(7):550-6
references: 8442625
references: Med Care. 1979 Mar;17(3 Suppl):i-vi, 1-73
references: 763009
references: JAMA. 1992 Feb 19;267(7):958-60
references: 1734109
references: J Gen Intern Med. 1995 Apr;10(4):199-205
references: 7790981
references: Pediatrics. 2002 Mar;109(3):505-8
references: 11875148
references: Psychol Bull. 1979 Mar;86(2):420-8
references: 18839484
references: Pediatrics. 2005 Feb;115(2):388-95
references: 15687449
references: Acad Emerg Med. 2000 Jan;7(1):21-7
references: 10894238
references: Emerg Med Serv. 2004 Nov;33(11):47-8, 50, 52 passim
references: 15682750
references: Biometrics. 1977 Mar;33(1):159-74
references: 843571
references: Lancet. 1989 Aug 12;2(8659):374-6
references: 2569561
references: Pediatr Emerg Care. 1998 Apr;14(2):89-94
references: 9583386
references: Pediatr Emerg Care. 1999 Feb;15(1):1-4
references: 10069301
references: Med Care. 1999 Aug;37(8):798-808
references: 10448722