title: Educational portfolios in the assessment of general practice trainers: reliability of assessors.
abstract: OBJECTIVE
  This paper reports a project that assessed a series of portfolios assembled by a cohort of participants attending a course for prospective general practice trainers.
  
  
  METHODS
  The reliability of judgements about individual 'components', together with an overall global judgement about performance were studied.
  
  
  METHODS
  NHSE South & West, King Alfred's College, Winchester and Institute of Community Studies, Bournemouth University.
  
  
  METHODS
  Eight experienced general practice trainers recruited from around Wessex, which incorporates Hampshire, Dorset, Wiltshire and the Isle of Wight.
  
  
  RESULTS
  The reliability of individual assessor's judgements (i.e. their consistency) was moderate, but inter-rater reliability did not reach a level which could support making a safe summative judgement. The levels of reliability reached were similar to other subjective assessments and perhaps reflected individuality of personal agendas of both the assessed and the assessors, and variations in portfolio structure and content.
  
  
  CONCLUSIONS
  Suggestions for approaches in future are made.
authors.affiliation: King Alfred's University College, Winchester, UK.
authors.forename: J
authors.initials: J
authors.lastname: Pitts
authors.forename: C
authors.initials: C
authors.lastname: Coles
authors.forename: P
authors.initials: P
authors.lastname: Thomas
mesh_terms: D004502:Education, Medical, Continuing / Q000592:standards*; D005194:Family Practice / Q000193:education*; D015588:Observer Variation; D015203:Reproducibility of Results; D013663:Teaching / Q000592:standards*; D006113:United Kingdom