Computer Science > Information Theory
[Submitted on 10 Aug 2016 (this version), latest version 3 May 2017 (v2)]
Title:Linear Programming based Converses for Finite Blocklength Lossy Joint Source-Channel Coding
View PDFAbstract:A linear programming (LP) based framework is presented for obtaining converses for finite blocklength lossy joint source-channel coding problems. The framework applies for any loss criterion, generalizes certain previously known converses, and also extends to multi-terminal settings. The finite blocklength problem is posed equivalently as a nonconvex optimization problem and using a lift-and-project-like method, a close but tractable LP relaxation of this problem is derived. Lower bounds on the original problem are obtained by the construction of feasible points for the dual of the LP relaxation. A particular application of this approach leads to the converse of Kostina and Verd{ú} on the minimum excess distortion probability of a finite blocklength lossy joint source-channel code and to the converse of Wolfowitz for channel coding, showing thereby that our LP relaxation is asymptotically tight with increasing blocklengths for channel coding, lossless source coding and joint source-channel coding with the excess distortion probability as the loss criterion. The relaxation is also shown to be tight for all blocklengths for the minimization of the expected average bit-wise Hamming distortion of a binary uniform source over a binary symmetric memoryless channel. Using a duality based argument, a new general converse is derived for finite blocklength joint source-channel coding for a class of channels called the metric channels. We demonstrate how the optimization formulation and the lift-and-project method can be extended to networked settings.
Submission history
From: Ankur Kulkarni [view email][v1] Wed, 10 Aug 2016 13:28:44 UTC (134 KB)
[v2] Wed, 3 May 2017 10:15:21 UTC (351 KB)
Current browse context:
cs.IT
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.