Reliability of counting actinic keratoses before and after brief consensus discussion: the VA topical tretinoin chemoprevention (VATTC) trial.
OBJECTIVE
To assess the reliability of counts of actinic keratoses (AKs) and the effect of a brief joint discussion of discrepancies on that reliability.


METHODS
Seven dermatologists independently counted AKs on the face and ears before and after a brief joint discussion of discrepancies.


METHODS
A volunteer sample of 9 patients from the ongoing VA (Department of Veterans Affairs) Topical Tretinoin Chemoprevention (VATTC) Trial. All participating individuals are veterans and have had 2 or more keratinocyte carcinomas (basal or squamous cell carcinoma) in the 5 years before enrollment in the study.


METHODS
Standard deviation of estimates of the Poisson regression parameter for the dermatologists.


RESULTS
Substantial variation was found among the dermatologists in their AK counts. The SD of the parameter estimates for the dermatologists decreased from 0.45 to 0.24 after the brief joint discussion, a 47% decrease (P =.076). The variation attributable to the dermatologists also decreased substantially (chi(2)(6) decrease, 94 to 12).


CONCLUSIONS
Actinic keratoses are common, and there is a continuous spectrum of lesions that ranges from sun-damaged skin to squamous cell carcinoma in situ. Clinical distinguishing features may be difficult to delineate precisely. Counts of AK are commonly performed, but appear to be unreliable, even when performed by experienced dermatologists. Joint discussion of discrepancies may enhance the reliability of these counts, although substantial variation remains. Research that relied on these counts must be reevaluated in light of the marked variation among expert observers. Future studies should consider measures to assess and enhance reliability.
Weinstock
M A
MA
Dermatoepidemiology Unit, Veterans Affairs Medical Center-111D, 830 Chalkstone Ave, Providence, RI 02908-4799. maw@brown.edu
Bingham
S F
SF
Cole
G W
GW
Eilers
D
D
Naylor
M F
MF
Kalivas
J
J
Taylor
J R
JR
Gladstone
H B
HB
Piacquadio
D J
DJ
DiGiovanna
J J
JJ
D000368:Aged; D000369:Aged, 80 and over; D006801:Humans; D007641:Keratolytic Agents / Q000008:administration & dosage*; D007642:Keratosis / Q000150:complications / Q000473:pathology* / Q000517:prevention & control*; D008875:Middle Aged; D010787:Photosensitivity Disorders / Q000150:complications / Q000473:pathology* / Q000517:prevention & control*; D016032:Randomized Controlled Trials as Topic; D015203:Reproducibility of Results; D014212:Tretinoin / Q000008:administration & dosage*
D007641:Keratolytic Agents; D014212:Tretinoin