title: Object class segmentation of RGB-D video using recurrent convolutional neural networks.
abstract: Object class segmentation is a computer vision task which requires labeling each pixel of an image with the class of the object it belongs to. Deep convolutional neural networks (DNN) are able to learn and take advantage of local spatial correlations required for this task. They are, however, restricted by their small, fixed-sized filters, which limits their ability to learn long-range dependencies. Recurrent Neural Networks (RNN), on the other hand, do not suffer from this restriction. Their iterative interpretation allows them to model long-range dependencies by propagating activity. This property is especially useful when labeling video sequences, where both spatial and temporal long-range dependencies occur. In this work, a novel RNN architecture for object class segmentation is presented. We investigate several ways to train such a network. We evaluate our models on the challenging NYU Depth v2 dataset for object class segmentation and obtain competitive results.
authors.affiliation: Universität Bonn, Computer Science Institute VI, Friedrich-Ebert-Allee 144, 53113 Bonn, Germany. Electronic address: pavel@cs.uni-bonn.de.
authors.forename: Mircea Serban
authors.initials: MS
authors.lastname: Pavel
authors.affiliation: Universität Bonn, Computer Science Institute VI, Friedrich-Ebert-Allee 144, 53113 Bonn, Germany. Electronic address: schulzh@ais.uni-bonn.de.
authors.forename: Hannes
authors.initials: H
authors.lastname: Schulz
authors.affiliation: Universität Bonn, Computer Science Institute VI, Friedrich-Ebert-Allee 144, 53113 Bonn, Germany. Electronic address: behnke@cs.uni-bonn.de.
authors.forename: Sven
authors.initials: S
authors.lastname: Behnke
mesh_terms: D001185:Artificial Intelligence; D006801:Humans; D016571:Neural Networks, Computer; D010363:Pattern Recognition, Automated / Q000379:methods*; D014741:Video Recording / Q000379:methods*
keywords: Computer vision; Object class-segmentation; Recurrent neural networks