title: Reliability of the assessment of appropriateness of diagnostic test request behavior.
abstract: We describe the reliability of the assessment of the appropriateness of requested diagnostic tests. We used a retrospective random selection of 253 request forms with in total 1217 requested tests. Three experts made an independent assessment of each requested test. Interrater kappa values ranged from 0.33 to 0.44. The kappa values of intrarater agreement ranged from 0.65 to 0.68. The reliability coefficient for all three reviewers was 0.66. This reliability is not sufficient to make case-by-case decisions, for example to give individual feedback on the appropriateness of requested tests. Sixteen reviewers are necessary to obtain a reference with a reliability of 0.95.
authors.affiliation: a Department of Medical Informatics, University Maastricht, 6200 MD Maastricht, The Netherlands. R.Bindels@mi.unimaas.nl
authors.forename: R
authors.initials: R
authors.lastname: Bindels
authors.forename: R A
authors.initials: RA
authors.lastname: Winkens
authors.forename: J W
authors.initials: JW
authors.lastname: van Wersch
authors.forename: P
authors.initials: P
authors.lastname: Pop
authors.forename: A
authors.initials: A
authors.lastname: Hasman
mesh_terms: D020000:Decision Support Systems, Clinical; D003955:Diagnostic Tests, Routine / Q000706:statistics & numerical data*; D006300:Health Services Misuse; D006801:Humans; D015588:Observer Variation; D018024:Peer Review, Health Care; D017410:Practice Guidelines as Topic; D011897:Random Allocation; D015203:Reproducibility of Results; D012189:Retrospective Studies