title: Automatic large-scale classification of bird sounds is strongly improved by unsupervised feature learning.
abstract: Automatic species classification of birds from their sound is a computational tool of increasing importance in ecology, conservation monitoring and vocal communication studies. To make classification useful in practice, it is crucial to improve its accuracy while ensuring that it can run at big data scales. Many approaches use acoustic measures based on spectrogram-type data, such as the Mel-frequency cepstral coefficient (MFCC) features which represent a manually-designed summary of spectral information. However, recent work in machine learning has demonstrated that features learnt automatically from data can often outperform manually-designed feature transforms. Feature learning can be performed at large scale and "unsupervised", meaning it requires no manual data labelling, yet it can improve performance on "supervised" tasks such as classification. In this work we introduce a technique for feature learning from large volumes of bird sound recordings, inspired by techniques that have proven useful in other domains. We experimentally compare twelve different feature representations derived from the Mel spectrum (of which six use this technique), using four large and diverse databases of bird vocalisations, classified using a random forest classifier. We demonstrate that in our classification tasks, MFCCs can often lead to worse performance than the raw Mel spectral data from which they are derived. Conversely, we demonstrate that unsupervised feature learning provides a substantial boost over MFCCs and Mel spectra without adding computational complexity after the model has been trained. The boost is particularly notable for single-label classification tasks at large scale. The spectro-temporal activations learned through our procedure resemble spectro-temporal receptive fields calculated from avian primary auditory forebrain. However, for one of our datasets, which contains substantial audio data but few annotations, increased performance is not discernible. We study the interaction between dataset characteristics and choice of feature representation through further empirical analysis.
authors.affiliation: Centre for Digital Music, Queen Mary University of London , UK.
authors.forename: Dan
authors.initials: D
authors.lastname: Stowell
authors.affiliation: Centre for Digital Music, Queen Mary University of London , UK.
authors.forename: Mark D
authors.initials: MD
authors.lastname: Plumbley
keywords: Bioacoustics; Birds; Birdsong; Classification; Machine learning; Vocalisation
references.citation: Behav Brain Res. 2000 Sep;114(1-2):89-95
references.pmid: 10996050
references.citation: Curr Opin Neurobiol. 2004 Aug;14(4):481-7
references.pmid: 15321069
references.citation: J Acoust Soc Am. 2012 Jun;131(6):4640-50
references.pmid: 22712937
references.citation: Curr Opin Neurobiol. 2006 Aug;16(4):400-7
references.pmid: 16842993
references.citation: PeerJ. 2013 Jul 16;1:e103
references.pmid: 23882441
references.citation: IEEE Trans Pattern Anal Mach Intell. 2013 Aug;35(8):1798-828
references.pmid: 23787338
references.citation: J Acoust Soc Am. 1996 Aug;100(2 Pt 1):1209-19
references.pmid: 8759970
references.citation: An Acad Bras Cienc. 2004 Jun;76(2):455-65
references.pmid: 15258666
references.citation: PLoS One. 2014 May 14;9(5):e96936
references.pmid: 24826989