title: A benchmark for comparison of dental radiography analysis algorithms.
abstract: Dental radiography plays an important role in clinical diagnosis, treatment and surgery. In recent years, efforts have been made on developing computerized dental X-ray image analysis systems for clinical usages. A novel framework for objective evaluation of automatic dental radiography analysis algorithms has been established under the auspices of the IEEE International Symposium on Biomedical Imaging 2015 Bitewing Radiography Caries Detection Challenge and Cephalometric X-ray Image Analysis Challenge. In this article, we present the datasets, methods and results of the challenge and lay down the principles for future uses of this benchmark. The main contributions of the challenge include the creation of the dental anatomy data repository of bitewing radiographs, the creation of the anatomical abnormality classification data repository of cephalometric radiographs, and the definition of objective quantitative evaluation for comparison and ranking of the algorithms. With this benchmark, seven automatic methods for analysing cephalometric X-ray image and two automatic methods for detecting bitewing radiography caries have been compared, and detailed quantitative evaluation results are presented in this paper. Based on the quantitative evaluation results, we believe automatic dental radiography analysis is still a challenging and unsolved problem. The datasets and the evaluation software will be made available to the research community, further encouraging future developments in this field. (http://www-o.ntust.edu.tw/~cweiwang/ISBI2015/).
authors.affiliation: Graduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taiwan; NTUST Center of Computer Vision and Medical Imaging, Taiwan. Electronic address: cweiwang@mail.ntust.edu.tw.
authors.forename: Ching-Wei
authors.initials: CW
authors.lastname: Wang
authors.affiliation: Graduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taiwan; NTUST Center of Computer Vision and Medical Imaging, Taiwan.
authors.forename: Cheng-Ta
authors.initials: CT
authors.lastname: Huang
authors.affiliation: Graduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taiwan; NTUST Center of Computer Vision and Medical Imaging, Taiwan.
authors.forename: Jia-Hong
authors.initials: JH
authors.lastname: Lee
authors.affiliation: Orthodontics and Pediatric Dentistry Division, Dental Department, Tri-Service General Hospital, Taiwan; School of Dentistry and Graduate Institute of Dental Science, National Defense Medical Center, Taipei, Taiwan.
authors.forename: Chung-Hsing
authors.initials: CH
authors.lastname: Li
authors.affiliation: Orthodontics and Pediatric Dentistry Division, Dental Department, Tri-Service General Hospital, Taiwan.
authors.forename: Sheng-Wei
authors.initials: SW
authors.lastname: Chang
authors.affiliation: Orthodontics and Pediatric Dentistry Division, Dental Department, Tri-Service General Hospital, Taiwan.
authors.forename: Ming-Jhih
authors.initials: MJ
authors.lastname: Siao
authors.affiliation: Department of Dentistry, Cardinal Tien Hospital, Taipei, Taiwan.
authors.forename: Tat-Ming
authors.initials: TM
authors.lastname: Lai
authors.affiliation: Faculty of Electrical Engineering, University of Ljubljana, Tržaška 25, SI-1000 Ljubljana, Slovenia.
authors.forename: Bulat
authors.initials: B
authors.lastname: Ibragimov
authors.affiliation: Faculty of Electrical Engineering, University of Ljubljana, Tržaška 25, SI-1000 Ljubljana, Slovenia.
authors.forename: Tomaž
authors.initials: T
authors.lastname: Vrtovec
authors.affiliation: University of Freiburg, Germany.
authors.forename: Olaf
authors.initials: O
authors.lastname: Ronneberger
authors.affiliation: University of Freiburg, Germany.
authors.forename: Philipp
authors.initials: P
authors.lastname: Fischer
authors.affiliation: Centre for Imaging Sciences, The University of Manchester, UK.
authors.forename: Tim F
authors.initials: TF
authors.lastname: Cootes
authors.affiliation: Centre for Imaging Sciences, The University of Manchester, UK.
authors.forename: Claudia
authors.initials: C
authors.lastname: Lindner
mesh_terms: D000465:Algorithms; D019985:Benchmarking / Q000379:methods* / Q000592:standards*; D002508:Cephalometry / Q000592:standards; D006801:Humans; D011856:Radiographic Image Enhancement / Q000592:standards; D011857:Radiographic Image Interpretation, Computer-Assisted / Q000379:methods* / Q000592:standards; D016300:Radiography, Bitewing / Q000592:standards; D011861:Radiography, Dental / Q000379:methods* / Q000592:standards*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013624:Taiwan
keywords: Anatomical segmentation and classification; Bitewing radiography analysis; Cephalometric tracing; Challenge and benchmark