Manual and automated methods for identifying potentially preventable readmissions: a comparison in a large healthcare system.
BACKGROUND
Identification of potentially preventable readmissions is typically accomplished through manual review or automated classification. Little is known about the concordance of these methods.


METHODS
We manually reviewed 459 30-day, all-cause readmissions at 18 Kaiser Permanente Northern California hospitals, determining potential preventability through a four-step manual review process that included a chart review tool, interviews with patients, their families, and treating providers, and nurse reviewer and physician evaluation of findings and determination of preventability on a five-point scale. We reassessed the same readmissions with 3 M's Potentially Preventable Readmission (PPR) software. We examined between-method agreement and the specificity and sensitivity of the PPR software using manual review as the reference.


RESULTS
Automated classification and manual review respectively identified 78% (358) and 47% (227) of readmissions as potentially preventable. Overall, the methods agreed about the preventability of 56% (258) of readmissions. Using manual review as the reference, the sensitivity of PPR was 85% and specificity was 28%.


CONCLUSIONS
Concordance between methods was not high enough to replace manual review with automated classification as the primary method of identifying preventable 30-day, all-cause readmission for quality improvement purposes.
Care Management Institute, Kaiser Permanente, Oakland, California, USA. ana.h.jackson@kp.org.
Ana H
AH
Jackson
Emily
E
Fireman
Paul
P
Feigenbaum
Estee
E
Neuwirth
Patricia
P
Kipnis
Jim
J
Bellows
D000368:Aged; D002140:California; D003695:Delivery of Health Care / Q000379:methods* / Q000592:standards; D005260:Female; D006751:Hospital Information Systems / Q000592:standards*; D006801:Humans; D008297:Male; D010359:Patient Readmission / Q000592:standards*; D036301:Qualitative Research; D011785:Quality Assurance, Health Care / Q000379:methods* / Q000592:standards; D012680:Sensitivity and Specificity