title: Lack of agreement between rheumatologists in defining digital ulceration in systemic sclerosis.
abstract: OBJECTIVE
  To test the intra- and interobserver variability, among clinicians with an interest in systemic sclerosis (SSc), in defining digital ulcers.
  
  
  METHODS
  Thirty-five images of finger lesions, incorporating a wide range of abnormalities at different sites, were duplicated, yielding a data set of 70 images. Physicians with an interest in SSc were invited to take part in the Web-based study, which involved looking through the images in a random sequence. The sequence differed for individual participants and prevented cross-checking with previous images. Participants were asked to grade each image as depicting "ulcer" or "no ulcer," and if "ulcer," then either "inactive" or "active." Images of a range of exemplar lesions were available for reference purposes while participants viewed the test images. Intrarater reliability was assessed using a weighted kappa coefficient with quadratic weights. Interrater reliability was estimated using a multirater weighted kappa coefficient.
  
  
  RESULTS
  Fifty individuals (most of them rheumatologists) from 15 countries participated in the study. There was a high level of intrarater reliability, with a mean weighted kappa value of 0.81 (95% confidence interval [95% CI] 0.77, 0.84). Interrater reliability was poorer (weighted kappa = 0.46 [95% CI 0.35, 0.57]).
  
  
  CONCLUSIONS
  The poor interrater reliability suggests that if digital ulceration is to be used as an end point in multicenter clinical trials of SSc, then strict definitions must be developed. The present investigation also demonstrates the feasibility of Web-based studies, for which large numbers of participants can be recruited over a short time frame.
authors.affiliation: University of Manchester, Manchester, UK, and Salford Royal National Health Service Foundation Trust, Salford, UK. ariane.herrick@manchester.ac.uk
authors.forename: Ariane L
authors.initials: AL
authors.lastname: Herrick
authors.forename: Christopher
authors.initials: C
authors.lastname: Roberts
authors.forename: Andrew
authors.initials: A
authors.lastname: Tracey
authors.forename: Alan
authors.initials: A
authors.lastname: Silman
authors.forename: Marina
authors.initials: M
authors.lastname: Anderson
authors.forename: Mark
authors.initials: M
authors.lastname: Goodfield
authors.forename: Neil
authors.initials: N
authors.lastname: McHugh
authors.forename: Lindsay
authors.initials: L
authors.lastname: Muir
authors.forename: Christopher P
authors.initials: CP
authors.lastname: Denton
mesh_terms: D006801:Humans; D020407:Internet; D015588:Observer Variation; D012219:Rheumatology / Q000592:standards*; D012595:Scleroderma, Systemic / Q000473:pathology*; D012883:Skin Ulcer / Q000175:diagnosis* / Q000453:epidemiology / Q000473:pathology*