title: Assessment of family physicians' performance using patient charts: interrater reliability and concordance with chart-stimulated recall interview.
abstract: Peer-assessment processes with chart review have been used for many years to assess the clinical performance of physicians. The Quebec medical licensing authority has been required by provincial law to assess the practicing Quebec physicians on a nonvoluntary basis. During the period from January 2001 to November 2004, 25 family physicians in active practice were randomly selected from a pool of about 300. For each physician, 25 to 40 patients' medical charts were randomly selected to evaluate the interrater reliability of peer-review assessment of medical charts and to compare ratings based on chart review with a chart-stimulated recall interview to those based on chart review alone. The concordance between chart review alone and that of chart review with chart-stimulated recall interview was 75% for chart keeping, 69% for clinical investigation, 81% for diagnostic accuracy, and 74% for treatment plan. Ratings based on chart review alone achieve moderate levels of reliability (Kappa = 0.44 to 0.56). It appears that some important information about quality of care is missed when only chart review is used.
authors.affiliation: Collège des médecins du Québec, Montreal. goulet.cmq@sympatico.ca
authors.forename: François
authors.initials: F
authors.lastname: Goulet
authors.forename: André
authors.initials: A
authors.lastname: Jacques
authors.forename: Robert
authors.initials: R
authors.lastname: Gagnon
authors.forename: Pierre
authors.initials: P
authors.lastname: Racette
authors.forename: William
authors.initials: W
authors.lastname: Sieber
mesh_terms: D002983:Clinical Competence; D006801:Humans; D007407:Interviews as Topic; D008485:Medical Audit / Q000379:methods / Q000592:standards*; D008499:Medical Records; D011939:Mental Recall; D019370:Observation; D015588:Observer Variation; D018024:Peer Review, Health Care / Q000592:standards*; D010821:Physicians, Family / Q000523:psychology / Q000592:standards*; D011785:Quality Assurance, Health Care / Q000379:methods*; D011792:Quebec; D015203:Reproducibility of Results