Inter-rater reliability of symptom repertorisation: a pragmatic empirical study.
OBJECTIVE
To determine the extent to which two homeopaths agree on whether symptoms reported by patients in a proving are possibly associated with Mercurius solubilis.


METHODS
Blinded, inter-rater reliability study.


METHODS
104 subjects in a randomised, double-blind mercury proving.


METHODS
557 symptom episodes spontaneously reported by subjects were classified as 'mercury' or 'not mercury' by two homeopaths working blind to each other's conclusions and to patient allocation.


RESULTS
Initial agreement between homeopaths was 70.2%, a kappa of 0.39, (95% CI 0.31, 0.47). Some disagreements appear to have resulted from differing interpretations of the study instructions. After suitable correction, agreement was 76.5% and kappa 0.56 (95% CI 0.49, 0.63).


CONCLUSIONS
The study homeopaths had only a moderate level degree of agreement greater than that expected by chance. The main factor seems to have been differences between data from different sources. There is an urgent need for more research on the methods of choosing homoeopathic medicines in order to improve the reliability and validity of homoeopathic diagnoses.
Vickers
A J
AJ
The Royal London Homoeopathic Hospital, UK.
van Haselen
R A
RA
Pang
L
L
Berkovitz
S
S
D000293:Adolescent; D000328:Adult; D000368:Aged; D004311:Double-Blind Method; D005260:Female; D006705:Homeopathy / Q000592:standards*; D006801:Humans; D008297:Male; D008630:Mercury Poisoning / Q000175:diagnosis*; D008875:Middle Aged; D015588:Observer Variation