Latent class analysis: an illustrative application for education in the assessment of resident otoscopic skills.
BACKGROUND
There is no gold standard readily available in several components of the routine physical exam: one example is the otoscopic exam, where the gold standard is confirmation by tympanocentesis. Resident education does not typically include routine assessment by the gold standard, making estimates of trainee performance extremely difficult. This is one reason why the otoscopic examination is difficult to teach. Available techniques can assess diagnostic exams when there is no gold standard-one of these is latent class analysis.


METHODS
We use latent class analysis, a form of regression analysis, to compare the ability of pediatric residents to diagnose effusion with pediatric otolaryngologists and tympanometry. We briefly outline the technique of how to complete latent class analysis and provide an operational plan to use the method to assess resident performance.


RESULTS
The sensitivity and specificity of pediatric resident otoscopic examination to diagnose the presence of effusion was 72% and 84%, respectively. Pediatric otolaryngologist sensitivity and specificity was 91% and 82%; tympanometry had a sensitivity of 70% and specificity 76%. Our estimates of the performance of otolaryngologists and tympanometry to diagnose effusion were the same as previously reported when these diagnosticians have been compared with the gold standard of tympanocentesis.


CONCLUSIONS
Latent class analysis can help estimate otoscopic examination performance of residents. This technique can be incorporated into assessment in medical education.
Benjamin
Daniel K
DK
Duke University Medical Center Department of Pediatrics, Duke Clinical Research Institute, Durham, NC 27715, USA. danny.benjamin@duke.edu
DeLong
Elizabeth
E
Steinbach
William J
WJ
D000158:Acoustic Impedance Tests / Q000592:standards; D000293:Adolescent; D000328:Adult; D002648:Child; D002675:Child, Preschool; D002983:Clinical Competence / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D007223:Infant; D007396:Internship and Residency / Q000592:standards*; D015233:Models, Statistical; D010034:Otitis Media with Effusion / Q000175:diagnosis*; D010036:Otolaryngology / Q000592:standards; D038781:Otoscopy / Q000592:standards*; D010372:Pediatrics / Q000592:standards*; D012044:Regression Analysis; D012680:Sensitivity and Specificity