title: Mitigation of Effects of Occlusion on Object Recognition with Deep Neural Networks through Low-Level Image Completion.
abstract: Heavily occluded objects are more difficult for classification algorithms to identify correctly than unoccluded objects. This effect is rare and thus hard to measure with datasets like ImageNet and PASCAL VOC, however, owing to biases in human-generated image pose selection. We introduce a dataset that emphasizes occlusion and additions to a standard convolutional neural network aimed at increasing invariance to occlusion. An unmodified convolutional neural network trained and tested on the new dataset rapidly degrades to chance-level accuracy as occlusion increases. Training with occluded data slows this decline but still yields poor performance with high occlusion. Integrating novel preprocessing stages to segment the input and inpaint occlusions is an effective mitigation. A convolutional network so modified is nearly as effective with more than 81% of pixels occluded as it is with no occlusion. Such a network is also more accurate on unoccluded images than an otherwise identical network that has been trained with only unoccluded images. These results depend on successful segmentation. The occlusions in our dataset are deliberately easy to segment from the figure and background. Achieving similar results on a more challenging dataset would require finding a method to split figure, background, and occluding pixels in the input.
authors.affiliation: Hewlett Packard Labs, Hewlett Packard Enterprise, 3000 Hanover Street, Palo Alto, CA 94304-1112, USA.
authors.forename: Benjamin
authors.identifier: 0000-0001-5416-309X
authors.initials: B
authors.lastname: Chandler
authors.affiliation: Department of Communication Sciences and Disorders, Northeastern University, 360 Huntington Avenue FR226, Boston, MA 02115, USA.
authors.forename: Ennio
authors.initials: E
authors.lastname: Mingolla
mesh_terms: D000465:Algorithms; D066264:Datasets as Topic; D006801:Humans; D007091:Image Processing, Computer-Assisted; D016571:Neural Networks, Computer; D010363:Pattern Recognition, Automated; D014796:Visual Perception / Q000502:physiology*