title: Robust Real-Time Music Transcription with a Compositional Hierarchical Model.
abstract: The paper presents a new compositional hierarchical model for robust music transcription. Its main features are unsupervised learning of a hierarchical representation of input data, transparency, which enables insights into the learned representation, as well as robustness and speed which make it suitable for real-world and real-time use. The model consists of multiple layers, each composed of a number of parts. The hierarchical nature of the model corresponds well to hierarchical structures in music. The parts in lower layers correspond to low-level concepts (e.g. tone partials), while the parts in higher layers combine lower-level representations into more complex concepts (tones, chords). The layers are learned in an unsupervised manner from music signals. Parts in each layer are compositions of parts from previous layers based on statistical co-occurrences as the driving force of the learning process. In the paper, we present the model's structure and compare it to other hierarchical approaches in the field of music information retrieval. We evaluate the model's performance for the multiple fundamental frequency estimation. Finally, we elaborate on extensions of the model towards other music information retrieval tasks.
authors.affiliation: University of Ljubljana, Faculty of Computer and Information Science, Laboratory for computer graphics and multimedia, Ljubljana, Slovenia.
authors.forename: Matevž
authors.initials: M
authors.lastname: Pesek
authors.affiliation: University of Ljubljana, Faculty of Computer and Information Science, Laboratory for computer graphics and multimedia, Ljubljana, Slovenia.|University of Birmingham, School of Computer Science, Centre for Computational Neuroscience and Cognitive Robotics, Birmingham, United Kingdom of Great Britain and Northern Ireland.
authors.forename: Aleš
authors.initials: A
authors.lastname: Leonardis
authors.affiliation: University of Ljubljana, Faculty of Computer and Information Science, Laboratory for computer graphics and multimedia, Ljubljana, Slovenia.
authors.forename: Matija
authors.initials: M
authors.lastname: Marolt
mesh_terms: D000465:Algorithms; D006801:Humans; D007858:Learning; D015233:Models, Statistical; D008962:Models, Theoretical; D009146:Music; D010465:Perception; D010898:Pitch Perception; D012984:Software