title: Increasing the visibility of coding decisions in team-based qualitative research in nursing.
abstract: OBJECTIVE
  To examine the use of the multi-rater Kappa measure of agreement (Nonparametric Statistics for the Behavioural Sciences, McGraw Hill, New York, 1988) in team based, mixed method, qualitative nursing research.
  
  
  METHODS
  The article presents an illustrative description of the application of the qualitative coding procedure and associated multi-rater Kappa measurement at four time points in 9 months amongst a five person health services research team.
  
  
  METHODS
  The multi-rater Kappa statistic. This is a measure of the extent to which observers achieve possible agreement beyond any agreement expected to occur by chance alone.
  
  
  RESULTS
  Closeness to primary qualitative research data, working relationships over time, and focused research team discussion can all lead to greater agreement and convergence at the level of descriptive coding. The method of measuring agreement between groups of coders was easily applied and appeared a feasible option for similar research projects wishing to demonstrate transparency in their coding procedures.
  
  
  CONCLUSIONS
  Measuring agreement beyond chance by the multi-rater Kappa statistic has some utility for research teams whose qualitative coding tasks are primarily descriptive. The method offers a standard and transparent approach for demonstrating agreement between coders and should be a feature of qualitative research reporting where appropriate.
authors.affiliation: Department of Health Sciences, Alcuin Teaching Building, University of York, UK. cat4@york.ac.uk
authors.forename: Carl
authors.initials: C
authors.lastname: Thompson
authors.forename: Dorothy
authors.initials: D
authors.lastname: McCaughan
authors.forename: Nicky
authors.initials: N
authors.lastname: Cullum
authors.forename: Trevor A
authors.initials: TA
authors.lastname: Sheldon
authors.forename: Pauline
authors.initials: P
authors.lastname: Raynor
mesh_terms: D000043:Abstracting and Indexing / Q000379:methods; D015982:Bias; D003299:Cooperative Behavior; D003627:Data Interpretation, Statistical; D003659:Decision Making, Organizational; D006801:Humans; D007400:Interprofessional Relations; D015404:Nursing Methodology Research / Q000458:organization & administration*; D010348:Patient Care Team / Q000458:organization & administration*; D036301:Qualitative Research; D012107:Research Design; D012108:Research Personnel / Q000458:organization & administration* / Q000523:psychology; D012680:Sensitivity and Specificity; D018709:Statistics, Nonparametric