title: Automatic scoring of medical students' clinical notes to monitor learning in the workplace.
abstract: BACKGROUND
  Educators need efficient and effective means to track students' clinical experiences to monitor their progress toward competency goals.
  
  
  OBJECTIVE
  To validate an electronic scoring system that rates medical students' clinical notes for relevance to priority topics of the medical school curriculum.
  
  
  METHODS
  The Vanderbilt School of Medicine Core Clinical Curriculum enumerates 25 core clinical problems (CCP) that graduating medical students must understand. Medical students upload clinical notes pertinent to each CCP to a web-based dashboard, but criteria for determining relevance of a note and consistent uploading practices by students are lacking. The Vanderbilt Learning Portfolio (VLP) system automates both tasks by rating relevance for each CCP and uploading the note to the student's electronic dashboard. We validated this electronic scoring system by comparing the relevance of 265 clinical notes written by third year medical students to each of the 25 core patient problems as scored by VLP verses an expert panel of raters.
  
  
  RESULTS
  We established the threshold score which yielded 75% positive prediction of relevance for 16 of the 25 clinical problems to expert opinion.
  
  
  CONCLUSIONS
  Automated scoring of student's clinical notes provides a novel, efficient and standardized means of tracking student's progress toward institutional competency goals.
authors.affiliation: Vanderbilt University School of Medicine , USA.
authors.forename: Anderson
authors.initials: A
authors.lastname: Spickard
authors.forename: Heather
authors.initials: H
authors.lastname: Ridinger
authors.forename: Jesse
authors.initials: J
authors.lastname: Wrenn
authors.forename: Nathan
authors.initials: N
authors.lastname: O'brien
authors.forename: Adam
authors.initials: A
authors.lastname: Shpigel
authors.forename: Michael
authors.initials: M
authors.lastname: Wolf
authors.forename: Glenn
authors.initials: G
authors.lastname: Stein
authors.forename: Joshua
authors.initials: J
authors.lastname: Denny
mesh_terms: D002982:Clinical Clerkship / Q000379:methods / Q000458:organization & administration / Q000592:standards*; D002983:Clinical Competence / Q000592:standards*; D004504:Education, Medical, Undergraduate / Q000458:organization & administration / Q000592:standards; D004521:Educational Measurement / Q000379:methods / Q000592:standards*; D057286:Electronic Health Records / Q000458:organization & administration / Q000592:standards*; D006801:Humans; D009323:Natural Language Processing; D013337:Students, Medical; D013714:Tennessee