title: Inter-rater reliability of symptom repertorisation: a pragmatic empirical study.
abstract: OBJECTIVE
  To determine the extent to which two homeopaths agree on whether symptoms reported by patients in a proving are possibly associated with Mercurius solubilis.
  
  
  METHODS
  Blinded, inter-rater reliability study.
  
  
  METHODS
  104 subjects in a randomised, double-blind mercury proving.
  
  
  METHODS
  557 symptom episodes spontaneously reported by subjects were classified as 'mercury' or 'not mercury' by two homeopaths working blind to each other's conclusions and to patient allocation.
  
  
  RESULTS
  Initial agreement between homeopaths was 70.2%, a kappa of 0.39, (95% CI 0.31, 0.47). Some disagreements appear to have resulted from differing interpretations of the study instructions. After suitable correction, agreement was 76.5% and kappa 0.56 (95% CI 0.49, 0.63).
  
  
  CONCLUSIONS
  The study homeopaths had only a moderate level degree of agreement greater than that expected by chance. The main factor seems to have been differences between data from different sources. There is an urgent need for more research on the methods of choosing homoeopathic medicines in order to improve the reliability and validity of homoeopathic diagnoses.
authors.affiliation: The Royal London Homoeopathic Hospital, UK.
authors.forename: A J
authors.initials: AJ
authors.lastname: Vickers
authors.forename: R A
authors.initials: RA
authors.lastname: van Haselen
authors.forename: L
authors.initials: L
authors.lastname: Pang
authors.forename: S
authors.initials: S
authors.lastname: Berkovitz
mesh_terms: D000293:Adolescent; D000328:Adult; D000368:Aged; D004311:Double-Blind Method; D005260:Female; D006705:Homeopathy / Q000592:standards*; D006801:Humans; D008297:Male; D008630:Mercury Poisoning / Q000175:diagnosis*; D008875:Middle Aged; D015588:Observer Variation