Title:Algorithmic rate-distortion theory

Abstract: Kolmogorov complexity is the accepted absolute measure of the information content of an individual finite object. It gives the ultimate limit on the number of bits resulting from lossless compression of the object--more precisely, the number of bits from which effective lossless decompression of the object is possible. A similar absolute approach is needed for lossy compression, that is, a rate-distortion theory giving the ultimate effective limits for individual finite data objects. We give natural definitions of the rate-distortion functions of individual data (independent of a random source producing those data). We analyze the possible shapes of the rate-distortion graphs for all data and all computable distortions. We formulate a new problem related to the practice of lossy compression. Is it the case that a lossily compressed representation that realizes least distortion of the source object at a given rate also captures an appropriate part of the ``essence'' or ``meaning'' of that object? We are deliberately vague here until we introduce the appropriate formalism. Clearly, this question cannot be well posed in the Shannon setting, where we deal with expected distortion in communication, but explicitly not with ``meaning.'' We show that in our setting this question is answered in the affirmative for every distortion measure that satisfies a certain parsimony-of-covering property.