Spectral Skyline Separation: Extended Landmark Databases and Panoramic Imaging.
Evidence from behavioral experiments suggests that insects use the skyline as a cue for visual navigation. However, changes of lighting conditions, over hours, days or possibly seasons, significantly affect the appearance of the sky and ground objects. One possible solution to this problem is to extract the "skyline" by an illumination-invariant classification of the environment into two classes, ground objects and sky. In a previous study (Insect models of illumination-invariant skyline extraction from UV (ultraviolet) and green channels), we examined the idea of using two different color channels available for many insects (UV and green) to perform this segmentation. We found out that for suburban scenes in temperate zones, where the skyline is dominated by trees and artificial objects like houses, a "local" UV segmentation with adaptive thresholds applied to individual images leads to the most reliable classification. Furthermore, a "global" segmentation with fixed thresholds (trained on an image dataset recorded over several days) using UV-only information is only slightly worse compared to using both the UV and green channel. In this study, we address three issues: First, to enhance the limited range of environments covered by the dataset collected in the previous study, we gathered additional data samples of skylines consisting of minerals (stones, sand, earth) as ground objects. We could show that also for mineral-rich environments, UV-only segmentation achieves a quality comparable to multi-spectral (UV and green) segmentation. Second, we collected a wide variety of ground objects to examine their spectral characteristics under different lighting conditions. On the one hand, we found that the special case of diffusely-illuminated minerals increases the difficulty to reliably separate ground objects from the sky. On the other hand, the spectral characteristics of this collection of ground objects covers well with the data collected in the skyline databases, increasing, due to the increased variety of ground objects, the validity of our findings for novel environments. Third, we collected omnidirectional images, as often used for visual navigation tasks, of skylines using an UV-reflective hyperbolic mirror. We could show that "local" separation techniques can be adapted to the use of panoramic images by splitting the image into segments and finding individual thresholds for each segment. Contrarily, this is not possible for 'global' separation techniques.
Computer Engineering Group, Faculty of Technology, Bielefeld University, D-33594 Bielefeld, Germany. dario.differt@uni-bielefeld.de.
Dario
D
Differt
Computer Engineering Group, Faculty of Technology, Bielefeld University, D-33594 Bielefeld, Germany. moeller@ti.uni-bielefeld.de.
Ralf
R
Möller
UV; color vision; insect vision; linear separation
Neural Netw. 2015 May;65:18-43
25659941
PLoS One. 2013 Nov 18;8(11):e79534
24260244
J Comp Physiol A Neuroethol Sens Neural Behav Physiol. 2009 Jul;195(7):681-9
19404647
J Exp Biol. 2011 May 15;214(Pt 10):1629-41
21525309
J Forensic Sci. 2014 Jan;59(1):117-22
24117678
Vision Res. 1994 Jun;34(11):1461-70
8023458
J Opt Soc Am A Opt Image Sci Vis. 2007 Jan;24(1):1-10
17164837
J Theor Biol. 2015 Sep 7;380:444-62
26113191
J Theor Biol. 2002 Feb 21;214(4):619-31
11851371
J Exp Biol. 1989 Sep;146:39-62
2689569
J Comp Physiol A Neuroethol Sens Neural Behav Physiol. 2015 Jun;201(6):517-32
25663391
Biol Cybern. 2010 May;102(5):413-25
20300942
Curr Opin Neurobiol. 2012 Apr;22(2):285-93
22221863
Proc Biol Sci. 2015 Jun 7;282(1808):20150673
25994678