title: An Evaluation of the Pedestrian Classification in a Multi-Domain Multi-Modality Setup.
abstract: The objective of this article is to study the problem of pedestrian classification across different light spectrum domains (visible and far-infrared (FIR)) and modalities (intensity, depth and motion). In recent years, there has been a number of approaches for classifying and detecting pedestrians in both FIR and visible images, but the methods are difficult to compare, because either the datasets are not publicly available or they do not offer a comparison between the two domains. Our two primary contributions are the following: (1) we propose a public dataset, named RIFIR , containing both FIR and visible images collected in an urban environment from a moving vehicle during daytime; and (2) we compare the state-of-the-art features in a multi-modality setup: intensity, depth and flow, in far-infrared over visible domains. The experiments show that features families, intensity self-similarity (ISS), local binary patterns (LBP), local gradient patterns (LGP) and histogram of oriented gradients (HOG), computed from FIR and visible domains are highly complementary, but their relative performance varies across different modalities. In our experiments, the FIR domain has proven superior to the visible one for the task of pedestrian classification, but the overall best results are obtained by a multi-domain multi-modality multi-feature fusion.
authors.affiliation: ISR Laboratory, University of Reading, Reading RG6 6AY, UK. a.d.miron@reading.ac.uk.
authors.forename: Alina
authors.initials: A
authors.lastname: Miron
authors.affiliation: INSA Rouen/LITIS laboratory - EA4108, Saint-Etienne du Rouvray 76801, France. alexandrina.rogozan@insa-rouen.fr.
authors.forename: Alexandrina
authors.initials: A
authors.lastname: Rogozan
authors.affiliation: INSA Rouen/LITIS laboratory - EA4108, Saint-Etienne du Rouvray 76801, France. samia.ainouz@insa-rouen.fr.
authors.forename: Samia
authors.initials: S
authors.lastname: Ainouz
authors.affiliation: INSA Rouen/LITIS laboratory - EA4108, Saint-Etienne du Rouvray 76801, France. abdelaziz.bensrhair@insa-rouen.fr.
authors.forename: Abdelaziz
authors.initials: A
authors.lastname: Bensrhair
authors.affiliation: VisLab, University of Parma, Parco Area delle Scienze 181A, 43100 Parma, Italy. broggi@vislab.it.
authors.forename: Alberto
authors.initials: A
authors.lastname: Broggi
keywords: benchmark; feature comparison; infrared pedestrian classification; intensity self-similarity; multi-cue; multi-domain; multi-modality; stereovision