Piloting the Mobile Medical Milestones Application (M3App©): A Multi-Institution Evaluation.
OBJECTIVE
Competency-based evaluation of the Accreditation Council for Graduate Medical Education (ACGME) Milestones requires the development of new evaluation tools that can better capture learners' behavior. This study describes the implementation and initial assessment of an innovative point-of-care mobile application, the M3App,© linked to the Family Medicine Milestones.


METHODS
Seven family medicine residency programs in North Carolina implemented the M3App.© Program faculty and residents were surveyed prior to implementation regarding current evaluation methods and their quality and use and acceptability of electronic evaluation tools. Surveys were repeated after implementation for comparison.


RESULTS
All seven programs successfully implemented the M3App. Most faculty members found the tool well designed, easy to use, beneficial to the quality and efficiency of feedback they provide, and to their knowledge of Milestones. Residents reported significant increases in the volume and quality of written feedback they receive.


CONCLUSIONS
The M3App provides an efficient, convenient tool for assessing Milestones that can improve the quantity and quality of feedback residents receive from faculty. Improved faculty perception of knowledge of Milestones after M3App implementation suggests that the tool is also effective for faculty development.
Department of Family Medicine, University of North Carolina at Chapel Hill.
Cristen
C
Page
Alfred
A
Reid
Catherine L
CL
Coe
Janalynn
J
Beste
Blake
B
Fagan
Erica
E
Steinbacher
Warren P
WP
Newton
D002983:Clinical Competence / Q000592:standards*; D004503:Education, Medical, Graduate; D004521:Educational Measurement / Q000379:methods; D005194:Family Practice / Q000193:education; D005246:Feedback; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D063731:Mobile Applications / Q000706:statistics & numerical data*; D009657:North Carolina; D011795:Surveys and Questionnaires