A multirater validation study to assess the reliability of acne lesion counting.
BACKGROUND
Despite widespread use of acne lesion counting, little has been published on its reliability, particularly for multiple raters.


OBJECTIVE
Our purpose was to assess reliability of acne lesion counting with the use of a five-segment facial template.


METHODS
After training, 12 raters each evaluated 12 patients in randomized order, in the morning and again in the afternoon, and recorded counts for different types of lesions on a five-segment facial template.


RESULTS
Individual raters could reproduce their total lesion counts (reliability estimates, 0.81 to 0.97). Variability between raters was high, and overall reliability estimated across raters was 0.61. For a subgroup of commonly trained raters, overall reliability was higher (0.80).


CONCLUSIONS
The reliability of acne lesion counting is excellent when performed by the same trained rater over time. The high variability between raters appears to be reduced by standardized training. Because fewer lesions are counted with less variation, use of a template may have contributed to the high within-rater reliability.
Lucky
A W
AW
Dermatology Research Associates, Cincinnati, USA.
Barber
B L
BL
Girman
C J
CJ
Williams
J
J
Ratterman
J
J
Waldstreicher
J
J
D000152:Acne Vulgaris / Q000473:pathology*; D000293:Adolescent; D000704:Analysis of Variance; D003880:Dermatology / Q000295:instrumentation / Q000706:statistics & numerical data; D005145:Face; D005260:Female; D006801:Humans; D008297:Male; D015588:Observer Variation; D015203:Reproducibility of Results; D012867:Skin / Q000473:pathology