title: Multimodal registration of SD-OCT volumes and fundus photographs using histograms of oriented gradients.
abstract: With availability of different retinal imaging modalities such as fundus photography and spectral domain optical coherence tomography (SD-OCT), having a robust and accurate registration scheme to enable utilization of this complementary information is beneficial. The few existing fundus-OCT registration approaches contain a vessel segmentation step, as the retinal blood vessels are the most dominant structures that are in common between the pair of images. However, errors in the vessel segmentation from either modality may cause corresponding errors in the registration. In this paper, we propose a feature-based registration method for registering fundus photographs and SD-OCT projection images that benefits from vasculature structural information without requiring blood vessel segmentation. In particular, after a preprocessing step, a set of control points (CPs) are identified by looking for the corners in the images. Next, each CP is represented by a feature vector which encodes the local structural information via computing the histograms of oriented gradients (HOG) from the neighborhood of each CP. The best matching CPs are identified by calculating the distance of their corresponding feature vectors. After removing the incorrect matches the best affine transform that registers fundus photographs to SD-OCT projection images is computed using the random sample consensus (RANSAC) method. The proposed method was tested on 44 pairs of fundus and SD-OCT projection images of glaucoma patients and the result showed that the proposed method successfully registers the multimodal images and produced a registration error of 25.34 ± 12.34μm (0.84 ± 0.41 pixels).
authors.affiliation: Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA 52242, USA.
authors.forename: Mohammad Saleh
authors.initials: MS
authors.lastname: Miri
authors.affiliation: Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA 52242, USA; Department of Ophthalmology and Visual Sciences, The University of Iowa, Iowa City, IA 52242, USA; Iowa City VA Health Care System, Iowa City, IA 52246, USA.
authors.forename: Michael D
authors.initials: MD
authors.lastname: Abràmoff
authors.affiliation: Department of Ophthalmology and Visual Sciences, The University of Iowa, Iowa City, IA 52242, USA.
authors.forename: Young H
authors.initials: YH
authors.lastname: Kwon
authors.affiliation: Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA 52242, USA; Iowa City VA Health Care System, Iowa City, IA 52246, USA.
authors.forename: Mona K
authors.initials: MK
authors.lastname: Garvin
keywords: (100.2960) Image analysis; (110.4500) Optical coherence tomography