Title:When can dictionary learning uniquely recover sparse data from subsamples?

Abstract:Sparse coding or sparse dictionary learning has been widely used to reveal the sparse underlying structure of many kinds of sensory data. A related advance in signal processing is compressed sensing, a theory explaining how sometimes sparse data can be subsampled below the Nyquist-Shannon limit yet still be accurately recovered. In the classical theory, the compressive sampling matrix for the data must be known for recovery. In contrast, sparse dictionary learning algorithms assume no direct access to this matrix nor to the original sparse codes representing the data. Nonetheless, we prove, under a necessary condition for compressed sensing, that if sparse coding succeeds at reconstructing a sufficiently large number of compressed samples, the sampling matrix and sparse codes are uniquely determined (up to the natural equivalences of permutation and scaling). A surprising ingredient in our argument is a result in combinatorial Ramsey theory. We also describe potential applications for data analysis and neuroscience.