Issues of variability and bias affecting multisite measurement of quality of care.
OBJECTIVE
Using data from a randomized trial to improve the quality of ambulatory care, the authors quantify the various sources of variability and bias that affect measures of quality of care and suggest experimental designs and analyses that reduce both bias and variability.


METHODS
There is a growing desire among health care researchers and government agencies to profile and compare practitioner performance. Such efforts are complicated by extreme inherent variability in most measures of quality of care, as well as potential biases introduced by "experiments," where patients cannot act as the unit of randomization. When the authors measured practitioner performance for eight patient-care guidelines, they found little association of level of performance across guidelines. Thus, the authors considered performance for each guideline separately, also taking into account variability between patients, practitioners, and practice conditions.


RESULTS
Randomization can reduce bias in large studies but should be supplemented by multivariate models. A preintervention and postintervention design can reduce variability, but much of the variability that remains is because of unmeasured patient/error variance.


CONCLUSIONS
Incorporation of these concepts into future studies using quality measurements will help researchers design smaller and more sensitive trials to draw more accurate and precise conclusions.
Orav
E J
EJ
Harvard School of Public Health, Boston, Massachusetts 02115, USA.
Wright
E A
EA
Palmer
R H
RH
Hargraves
J L
JL
D000328:Adult; D000553:Ambulatory Care / Q000458:organization & administration*; D015982:Bias; D002648:Child; D003627:Data Interpretation, Statistical; D006302:Health Services Research; D006801:Humans; D008485:Medical Audit; D015999:Multivariate Analysis; D017410:Practice Guidelines as Topic; D011785:Quality Assurance, Health Care / Q000458:organization & administration*; D012107:Research Design; D012680:Sensitivity and Specificity; D014481:United States