title: Learnings From the Pilot Implementation of Mobile Medical Milestones Application.
abstract: BACKGROUND
  Implementation of the educational milestones benefits from mobile technology that facilitates ready assessments in the clinical environment. We developed a point-of-care resident evaluation tool, the Mobile Medical Milestones Application (M3App), and piloted it in 8 North Carolina family medicine residency programs.
  
  
  OBJECTIVE
  We sought to examine variations we found in the use of the tool across programs and explored the experiences of program directors, faculty, and residents to better understand the perceived benefits and challenges of implementing the new tool.
  
  
  METHODS
  Residents and faculty completed presurveys and postsurveys about the tool and the evaluation process in their program. Program directors were interviewed individually. Interviews and open-ended survey responses were analyzed and coded using the constant comparative method, and responses were tabulated under themes.
  
  
  RESULTS
  Common perceptions included increased data collection, enhanced efficiency, and increased perceived quality of the information gathered with the M3App. Residents appreciated the timely, high-quality feedback they received. Faculty reported becoming more comfortable with the tool over time, and a more favorable evaluation of the tool was associated with higher utilization. Program directors reported improvements in faculty knowledge of the milestones and resident satisfaction with feedback.
  
  
  CONCLUSIONS
  Faculty and residents credited the M3App with improving the quality and efficiency of resident feedback. Residents appreciated the frequency, proximity, and specificity of feedback, and faculty reported the app improved their familiarity with the milestones. Implementation challenges included lack of a physician champion and competing demands on faculty time.
authors: Cristen P
authors: CP
authors: Page
authors: Alfred
authors: A
authors: Reid
authors: Catherine L
authors: CL
authors: Coe
authors: Martha
authors: M
authors: Carlough
authors: Daryl
authors: D
authors: Rosenbaum
authors: Janalynn
authors: J
authors: Beste
authors: Blake
authors: B
authors: Fagan
authors: Erika
authors: E
authors: Steinbacher
authors: Geoffrey
authors: G
authors: Jones
authors: Warren P
authors: WP
authors: Newton
mesh_terms: D002983:Clinical Competence; D004503:Education, Medical, Graduate / Q000458:organization & administration*; D004521:Educational Measurement / Q000379:methods*; D005180:Faculty, Medical; D005194:Family Practice / Q000193:education; D005246:Feedback; D006801:Humans; D007396:Internship and Residency / Q000458:organization & administration*; D063731:Mobile Applications; D009657:North Carolina; D010865:Pilot Projects