title: Dutch postgraduate GP selection procedure; reliability of interview assessments.
abstract: BACKGROUND
  Semi- structured interviews are the core of the Dutch selection procedure for postgraduate general practice (GP) training. A staff member, trainer and trainee independently assess personal qualities. Aiming to improve the selection procedure we were interested in the reliability aspects of these interviews. We investigated the inter-rater reliability of the interview for groups of two or three assessors and the degree to which candidates' characteristics and qualities assessed during interviews explained admission into GP training, controlled for differences between those who apply for the first versus the second or third application.
  
  
  METHODS
  An observational study was conducted of all candidates who entered the Utrecht selection procedure between April 2008 and 2010. Candidates' characteristics and qualities were collected. Inter-rater reliability of different compositions of the interview group per quality was estimated. Factors associated with admission into GP training were assessed.
  
  
  RESULTS
  The study population included 394 candidates. Twenty-six candidates were rejected based on their application letter (4.4%). Three candidates who applied more than 3 times were excluded. Ultimately, 206 of the 365 candidates were admitted to the GP training (56,4%). The inter-rater reliability was satisfactory (ICC: 0.78 - 0 .84). Reduction from three to two assessors slightly reduces the ICC. The candidates' qualities independently explained admission to GP training, whereas individual characteristics did not. These results did not differ for candidates who applied for the first time versus candidates applying for the second or third time.
  
  
  CONCLUSIONS
  Selection interviews with two assessors yielded a satisfactory level of reliability. Individual characteristics were not associated with admission, whereas scores related to candidate qualities did show such an association. The results of those applying for the second or third time were similar.
authors.affiliation: Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht, The Netherlands. M.I.Vermeulen@umcutrecht.nl
authors.forename: Margit I
authors.initials: MI
authors.lastname: Vermeulen
authors.forename: Marijke M
authors.initials: MM
authors.lastname: Kuyvenhoven
authors.forename: Nicolaas P A
authors.initials: NP
authors.lastname: Zuithoff
authors.forename: Yolanda
authors.initials: Y
authors.lastname: van der Graaf
authors.forename: Roger A M J
authors.initials: RA
authors.lastname: Damoiseaux
mesh_terms: D000328:Adult; D002983:Clinical Competence / Q000706:statistics & numerical data; D004502:Education, Medical, Continuing / Q000706:statistics & numerical data; D005194:Family Practice / Q000193:education; D005260:Female; D007722:Health Knowledge, Attitudes, Practice; D006801:Humans; D007407:Interviews as Topic / Q000379:methods*; D007586:Job Application; D008297:Male; D009426:Netherlands; D010552:Personality Assessment / Q000592:standards*; D010560:Personnel Selection / Q000592:standards* / Q000706:statistics & numerical data; D010821:Physicians, Family / Q000523:psychology / Q000706:statistics & numerical data; D036301:Qualitative Research; D012044:Regression Analysis; D015203:Reproducibility of Results; D013038:Specialization
references.citation: Adv Health Sci Educ Theory Pract. 2009 Dec;14(5):759-75
references.pmid: 19340597
references.citation: Adv Health Sci Educ Theory Pract. 2004;9(2):147-59
references.pmid: 15141132
references.citation: Acad Psychiatry. 2007 Nov-Dec;31(6):443-6
references.pmid: 18079505
references.citation: Acad Med. 1990 Mar;65(3):167-77
references.pmid: 2407259
references.citation: Can J Ophthalmol. 2007 Apr;42(2):299-304
references.pmid: 17392856
references.citation: BMJ. 2005 Mar 26;330(7493):711-4
references.pmid: 15790641
references.citation: Med Educ. 2009 Aug;43(8):767-75
references.pmid: 19659490
references.citation: Eur J Gen Pract. 2012 Dec;18(4):201-5
references.pmid: 22515833
references.citation: Acad Med. 1995 Jun;70(6):532-6
references.pmid: 7786374
references.citation: Med Educ. 2010 Nov;44(11):1077-83
references.pmid: 20946478
references.citation: Stat Med. 2000 Apr 30;19(8):1059-79
references.pmid: 10790680
references.citation: Med Teach. 2011;33(3):215-23
references.pmid: 21345061
references.citation: J Clin Epidemiol. 2006 Oct;59(10):1087-91
references.pmid: 16980149
references.citation: Med Educ. 2007 Jan;41(1):32-8
references.pmid: 17209890
references.citation: Adv Health Sci Educ Theory Pract. 2001;6(2):159-75
references.pmid: 11435766
references.citation: Acad Med. 2001 Jan;76(1):66-71
references.pmid: 11154199
references.citation: Med Educ. 2005 Mar;39(3):309-17
references.pmid: 15733167
references.citation: Am J Epidemiol. 2003 May 15;157(10):940-3
references.pmid: 12746247
references.citation: Acad Med. 2003 Mar;78(3):313-21
references.pmid: 12634215
references.citation: Med Teach. 2006 Jun;28(4):335-40
references.pmid: 16807172