Is inter-rater reliability of Global Trigger Tool results altered when members of the review team are replaced?
OBJECTIVE
To evaluate the inter-rater reliability of results from Global Trigger Tool (GTT) reviews when one of the three reviewers remains consistent, while one or two reviewers rotate.


METHODS
Comparison of results from retrospective record review performed as a cross-sectional study with three review teams each consisting of two non-physicians and one physician; Team I (three consistent reviewers), Team II (one of the two non-physician reviewers or/and the physician from Team I are replaced for different review periods) and Team III (three consistent reviewers different from reviewers in Team I and Team II).


METHODS
Medium-sized hospital trust in Northern Norway.


METHODS
A total of 120 records were selected as biweekly samples of 10 from discharge lists between 1 July and 31 December 2010 for a 3-fold review.


METHODS
Replacement of review team members was tested to assess impact on inter-rater reliability and adverse events measurment.


METHODS
Inter-rater reliability assessed with the Cohen kappa coefficient between different teams regarding the presence and severity level of adverse events.


RESULTS
Substantial inter-rater reliability regarding the presence and severity level of adverse events was obtained between Teams I and II, while moderate inter-rater reliability was obtained between Teams I and III.


CONCLUSIONS
Replacement of reviewers did not influence the results provided that one of the non-physician reviewers remains consistent. The experience of the consistent reviewer can result in continued consistency in interpretation with the new reviewer through discussion of events. These findings could encourage more hospital to rotate reviewers in order to optimize resources when using the GTT.
Fran Griffin & Associates, LLC, 318 Sea Spray Lane Neptune, NJ USA 07753.
Kjersti
K
Mevik
Fran Griffin & Associates, LLC, 318 Sea Spray Lane Neptune, NJ USA 07753.
Frances A
FA
Griffin
Fran Griffin & Associates, LLC, 318 Sea Spray Lane Neptune, NJ USA 07753.
Tonje Elisabeth
TE
Hansen
Akershus University Hospital, Post box 1000, 1478 Lørenskog, Norway.
Ellen
E
Deilkås
Nordland Hospital Trust, Post box 1480, 8092 Bodø, Norway and Institute for Community Medicine, The Artic University of Norway, Post box 6050, Langnes 9037 Tromsø, Norway.
Barthold
B
Vonen
D000293:Adolescent; D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D003430:Cross-Sectional Studies; D005260:Female; D006779:Hospitals, Public; D006801:Humans; D008297:Male; D019300:Medical Errors; D008875:Middle Aged; D009664:Norway; D015588:Observer Variation; D015203:Reproducibility of Results; D012189:Retrospective Studies; D012308:Risk Management / Q000458:organization & administration*; D017751:Safety Management; D055815:Young Adult
Global Trigger Tool; adverse events; drug errors; incident reporting and analysis; inter-rater reliability; medical errors; quality measurement