Increasing the visibility of coding decisions in team-based qualitative research in nursing.
OBJECTIVE
To examine the use of the multi-rater Kappa measure of agreement (Nonparametric Statistics for the Behavioural Sciences, McGraw Hill, New York, 1988) in team based, mixed method, qualitative nursing research.


METHODS
The article presents an illustrative description of the application of the qualitative coding procedure and associated multi-rater Kappa measurement at four time points in 9 months amongst a five person health services research team.


METHODS
The multi-rater Kappa statistic. This is a measure of the extent to which observers achieve possible agreement beyond any agreement expected to occur by chance alone.


RESULTS
Closeness to primary qualitative research data, working relationships over time, and focused research team discussion can all lead to greater agreement and convergence at the level of descriptive coding. The method of measuring agreement between groups of coders was easily applied and appeared a feasible option for similar research projects wishing to demonstrate transparency in their coding procedures.


CONCLUSIONS
Measuring agreement beyond chance by the multi-rater Kappa statistic has some utility for research teams whose qualitative coding tasks are primarily descriptive. The method offers a standard and transparent approach for demonstrating agreement between coders and should be a feature of qualitative research reporting where appropriate.
Thompson
Carl
C
Department of Health Sciences, Alcuin Teaching Building, University of York, UK. cat4@york.ac.uk
McCaughan
Dorothy
D
Cullum
Nicky
N
Sheldon
Trevor A
TA
Raynor
Pauline
P
D000043:Abstracting and Indexing / Q000379:methods; D015982:Bias; D003299:Cooperative Behavior; D003627:Data Interpretation, Statistical; D003659:Decision Making, Organizational; D006801:Humans; D007400:Interprofessional Relations; D015404:Nursing Methodology Research / Q000458:organization & administration*; D010348:Patient Care Team / Q000458:organization & administration*; D036301:Qualitative Research; D012107:Research Design; D012108:Research Personnel / Q000458:organization & administration* / Q000523:psychology; D012680:Sensitivity and Specificity; D018709:Statistics, Nonparametric