Share Email Print

Proceedings Paper

K-SVD and its non-negative variant for dictionary design
Author(s): Michal Aharon; Michael Elad; Alfred M. Bruckstein
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In recent years there is a growing interest in the study of sparse representation for signals. Using an overcomplete dictionary that contains prototype signal-atoms, signals are described as sparse linear combinations of these atoms. Recent activity in this field concentrated mainly on the study of pursuit algorithms that decompose signals with respect to a given dictionary. Designing dictionaries to better fit the above model can be done by either selecting pre-specified transforms, or by adapting the dictionary to a set of training signals. Both these techniques have been considered in recent years, however this topic is largely still open. In this paper we address the latter problem of designing dictionaries, and introduce the K-SVD algorithm for this task. We show how this algorithm could be interpreted as a generalization of the K-Means clustering process, and demonstrate its behavior in both synthetic tests and in applications on real data. Finally, we turn to describe its generalization to nonnegative matrix factorization problem that suits signals generated under an additive model with positive atoms. We present a simple and yet efficient variation of the K-SVD that handles such extraction of non-negative dictionaries.

Paper Details

Date Published: 17 September 2005
PDF: 13 pages
Proc. SPIE 5914, Wavelets XI, 591411 (17 September 2005); doi: 10.1117/12.613878
Show Author Affiliations
Michal Aharon, Technion - Israel Institute of Technology (Israel)
Michael Elad, Technion - Israel Institute of Technology (Israel)
Alfred M. Bruckstein, Technion - Israel Institute of Technology (Israel)

Published in SPIE Proceedings Vol. 5914:
Wavelets XI
Manos Papadakis; Andrew F. Laine; Michael A. Unser, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?