title: Determining the number of patient charts necessary for a reliable assessment of practicing family physicians' performance.
abstract: In many countries, peer assessment programs based on the examination of patient charts are becoming a standard to assess physician's clinical performance. Although data on validity of the process are acceptable, reliability issues need some improvement. This article addresses the rarely studied aspect of optimal number of patient charts for an acceptable reliable assessment. Fifteen patient charts for each of a group of 20 practicing physicians were independently reviewed by 4 professional peer assessors. Generalizability (G) and decision (D) studies were applied to the data. It appears that as few as 10 patient charts are sufficient for any assessor to obtain a G coefficient of 0.80. Results of the current study suggest the possibility of getting generalizable assessments by peer reviewer with minimal information. These results are not in accordance with the concept of case specificity in which it is claimed that performance on a case is a poor predictor of performance on a different case.
authors.affiliation: Practice Enhancement Division, Collège des médecins du Québec, 2170 boulevard René-Lévesque ouest, Montreal, Quebec, Canada. robert.gagnon@umontreal.ca.
authors.forename: Robert
authors.initials: R
authors.lastname: Gagnon
authors.forename: André
authors.initials: A
authors.lastname: Jacques
authors.forename: Marc
authors.initials: M
authors.lastname: Billard
authors.forename: François
authors.initials: F
authors.lastname: Goulet
mesh_terms: D002170:Canada; D002983:Clinical Competence / Q000592:standards* / Q000706:statistics & numerical data; D016001:Confidence Intervals; D006801:Humans; D008499:Medical Records; D018024:Peer Review, Health Care / Q000379:methods*; D010821:Physicians, Family / Q000592:standards*; D015203:Reproducibility of Results; D013223:Statistics as Topic