Performance Assessment for Mastoidectomy.
Objective The aim of this report is to provide a review of the current literature for assessment of performance for mastoidectomy, to identify the current assessment tools available in the literature, and to summarize the evidence for their validity. Data Sources The MEDLINE database was accessed via PubMed. Review Methods Inclusion criteria consisted of English-language published articles that reported use of a mastoidectomy performance assessment tool. Studies ranged from 2007 to November 2015 and were divided into 2 groups: intraoperative assessments and those performed with simulation (cadaveric laboratory or virtual reality). Studies that contained specific reliability analyses were also highlighted. For each publication, validity evidence data were analyzed and interpreted according to conceptual definitions provided in a recent systematic review on the modern framework of validity evidence. Conclusions Twenty-three studies were identified that met our inclusion criteria for review, including 4 intraoperative objective assessment studies, 5 cadaveric studies, 10 virtual reality simulation studies, and 4 that used both cadaveric assessment and virtual reality. Implications for Practice A review of the literature revealed a wide variety of mastoidectomy assessment tools and varying levels of reliability and validity evidence. The assessment tool developed at Johns Hopkins possesses the most validity evidence of those reviewed. However, a number of agreed-on specific metrics could be integrated into a standardized assessment instrument to be used nationally. A universally agreed-on assessment tool will provide a means for developing standardized benchmarks for performing mastoid surgery.
1 College of Medicine, The Ohio State University, Columbus, Ohio, USA.
Rishabh
R
Sethia
2 Ohio Supercomputer Center, Columbus, Ohio, USA.
Thomas F
TF
Kerwin
3 Department of Otolaryngology, The Ohio State University, Columbus, Ohio, USA.|4 Department of Otolaryngology, Nationwide Children's Hospital, Columbus, Ohio, USA.
Gregory J
GJ
Wiet
D002983:Clinical Competence; D006801:Humans; D008416:Mastoid / Q000601:surgery*; D010027:Osteotomy; D011785:Quality Assurance, Health Care
mastoidectomy; objective assessment; operative competency; technical performance; validity evidence
Acad Med. 2007 Jun;82(6):569-73
17525542
Acad Med. 2013 Jun;88(6):872-83
23619073
Laryngoscope. 2007 Feb;117(2):258-63
17204992
Ann Otol Rhinol Laryngol. 2007 Nov;116(11):793-8
18074662
Otol Neurotol. 2010 Jul;31(5):759-65
20517169
Qual Health Care. 2001 Dec;10 Suppl 2:ii64-9
11700382
J Grad Med Educ. 2012 Dec;4(4):425-33
24294417
JAMA Otolaryngol Head Neck Surg. 2015 Oct;141(10):913-8
26334610
Laryngoscope. 2011 Apr;121(4):831-7
21433021
Am J Surg. 2011 Oct;202(4):469-480.e6
21798511
Int J Comput Assist Radiol Surg. 2012 Jan;7(1):1-11
21538158
Laryngoscope. 2012 Jun;122(6):1385-91
22487895
Otolaryngol Head Neck Surg. 2015 Jun;152(6):1082-8
25681488
Laryngoscope. 2010 Jul;120(7):1422-7
20564671
Laryngoscope. 2010 Jul;120(7):1417-21
20578231
Laryngoscope. 2016 Feb;126(2):E74-9
26153783
Biomed Res Int. 2014;2014:192741
25114897
Laryngoscope. 2013 Dec;123(12):3162-7
23878112
Otol Neurotol. 2012 Sep;33(7):1225-31
22858711
Stud Health Technol Inform. 2007;125:421-6
17377316
Surgery. 2004 Jan;135(1):6-20
14694296
Surgery. 2005 Feb;137(2):141-7
15674193
Laryngoscope. 2015 Oct;125 Suppl 8:S1-14
26154861
Br J Surg. 1997 Feb;84(2):273-8
9052454
Otol Neurotol. 2014 Jan;35(1):77-83
23988999
Laryngoscope. 2010 Jun;120(6):1152-8
20513032
Am J Surg. 1997 Mar;173(3):226-30
9124632
Laryngoscope. 2015 Oct;125(10):2376-81
25891034
Laryngoscope. 2016 Aug;126(8):1883-8
26452157
Eval Health Prof. 2008 Dec;31(4):419-36
18842619
Adv Health Sci Educ Theory Pract. 2014 May;19(2):233-50
23636643
J Laryngol Otol. 2015 Nov;129(11):1091-6
26391052
BJU Int. 2001 Nov;88(7):655-60
11890231
Laryngoscope. 2012 Nov;122(11):2418-21
22865665
Laryngoscope. 2015 Feb;125(2):431-5
25043448
Laryngoscope. 2009 Dec;119(12):2402-10
19885831
Acta Otorhinolaryngol Ital. 2013 Aug;33(4):273-81
24043916
Laryngoscope. 2007 Oct;117(10):1803-8
17721407