title: An analysis dictionary learning algorithm under a noisy data model with orthogonality constraint.
abstract: Two common problems are often encountered in analysis dictionary learning (ADL) algorithms. The first one is that the original clean signals for learning the dictionary are assumed to be known, which otherwise need to be estimated from noisy measurements. This, however, renders a computationally slow optimization process and potentially unreliable estimation (if the noise level is high), as represented by the Analysis K-SVD (AK-SVD) algorithm. The other problem is the trivial solution to the dictionary, for example, the null dictionary matrix that may be given by a dictionary learning algorithm, as discussed in the learning overcomplete sparsifying transform (LOST) algorithm. Here we propose a novel optimization model and an iterative algorithm to learn the analysis dictionary, where we directly employ the observed data to compute the approximate analysis sparse representation of the original signals (leading to a fast optimization procedure) and enforce an orthogonality constraint on the optimization criterion to avoid the trivial solutions. Experiments demonstrate the competitive performance of the proposed algorithm as compared with three baselines, namely, the AK-SVD, LOST, and NAAOLA algorithms.
authors.affiliation: Department of Electronic Information Engineering, Nanchang University, Nanchang 330031, China.
authors.forename: Ye
authors.initials: Y
authors.lastname: Zhang
authors.affiliation: Department of Electronic Information Engineering, Nanchang University, Nanchang 330031, China.
authors.forename: Tenglong
authors.initials: T
authors.lastname: Yu
authors.affiliation: Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford GU2 7XH, UK.
authors.forename: Wenwu
authors.identifier: 0000-0002-8393-5703
authors.initials: W
authors.lastname: Wang
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D004014:Dictionaries as Topic; D008962:Models, Theoretical