title: Systematic development of a proctor certification examination for the Fundamentals of Laparoscopic Surgery testing program.
abstract: BACKGROUND
  The fundamentals of laparoscopic surgery (FLS) examination is administered by proctors around the world. Inconsistent administration represents a threat to test validity. We systematically developed a test to assess the FLS proctors knowledge and skills relating to FLS test administration.
  
  
  METHODS
  Downing's 12 steps for test development were used. subject matter expert's created a job and/or task analysis inventory of the knowledge and skills of an FLS proctor. Using the weighted blueprint, a 45 question examination was created using online testing software and piloted.
  
  
  RESULTS
  The blueprint generated 38 job and/or task analysis items in 4 domains. Items on the test had an average content validity index of .9. The mean score during beta testing was 32 of 45 (71%). Reliability was good at .72. Mean item difficulty and discrimination were .71 and .28, respectively. The cut score was set at 62% resulting in a pass rate of 83%.
  
  
  CONCLUSIONS
  We developed a test representing the skills of the FLS proctor that demonstrates considerable validity evidence. Incorporation of this examination into proctor training should reduce the threats to validity for the FLS examination.
authors.affiliation: Department of Surgery, Uniformed Services University/Walter Reed National Military Medical Center, 4301 Jones Bridge Road, Bethesda, MD, USA. Electronic address: eritter@usuhs.edu.
authors.forename: E Matthew
authors.initials: EM
authors.lastname: Ritter
authors.affiliation: Society of American Gastrointestinal and Endoscopic Surgeons Fundamentals of Laparoscopic Surgery Program, Los Angeles, CA, USA.
authors.forename: Inga C
authors.initials: IC
authors.lastname: Brissman
mesh_terms: D002568:Certification; D004521:Educational Measurement; D006801:Humans; D010535:Laparoscopy / Q000193:education*; D015203:Reproducibility of Results; D014481:United States; D000066477:Work Performance
keywords: Assessment; Certification examinationination; Fundamentals of laparoscopic surgery; Job task analysis; Test development; Validity evidence