Information Theory

Authors and titles for June 2015

[201] arXiv:1506.00981 (cross-list from quant-ph) [pdf, other]

Title: Swiveled Rényi entropies

Frédéric Dupuis, Mark M. Wilde

Comments: v4: 33 pages, published in Quantum Information Processing

Journal-ref: Quantum Information Processing, vol. 15, no. 3, pages 1309-1345, March 2016

Subjects: Quantum Physics (quant-ph); Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); High Energy Physics - Theory (hep-th); Mathematical Physics (math-ph)

[202] arXiv:1506.00982 (cross-list from cs.GT) [pdf, other]

Title: Game Theory for Signal Processing in Networks

Giacomo Bacci, Samson Lasaulce, Walid Saad, Luca Sanguinetti

Comments: 44 pages, 14 figures, To appear in IEEE Signal Processing Magazine

Subjects: Computer Science and Game Theory (cs.GT); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)

[203] arXiv:1506.00998 (cross-list from math.NA) [pdf, other]

Title: One-Bit Compressive Sensing with Partial Support

Phillip North, Deanna Needell

Subjects: Numerical Analysis (math.NA); Information Theory (cs.IT)

[204] arXiv:1506.01338 (cross-list from math.ST) [pdf, other]

Title: Optimal change point detection in Gaussian processes

Hossein Keshavarz, Clayton Scott, XuanLong Nguyen

Comments: 42 pages, 2 figures

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[205] arXiv:1506.01367 (cross-list from cs.DS) [pdf, other]

Title: A Nearly Optimal and Agnostic Algorithm for Properly Learning a Mixture of k Gaussians, for any Constant k

Jerry Li, Ludwig Schmidt

Subjects: Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[206] arXiv:1506.01437 (cross-list from cs.CV) [pdf, other]

Title: ShapeFit: Exact location recovery from corrupted pairwise directions

Paul Hand, Choongbum Lee, Vladislav Voroninski

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Combinatorics (math.CO); Optimization and Control (math.OC)

[207] arXiv:1506.02181 (cross-list from math.ST) [pdf, other]

Title: The LASSO with Non-linear Measurements is Equivalent to One With Linear Measurements

Chrtistos Thrampoulidis, Ehsan Abbasi, Babak Hassibi

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT)

[208] arXiv:1506.02228 (cross-list from quant-ph) [pdf, other]

Title: Strong converse exponents for the feedback-assisted classical capacity of entanglement-breaking channels

Dawei Ding, Mark M. Wilde

Comments: 24 pages, 2 figures, v4: final version accepted for publication in Problems of Information Transmission

Journal-ref: Problems of Information Transmission, vol. 54, no. 1, pages 1-19, January 2018

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[209] arXiv:1506.02245 (cross-list from cs.HC) [pdf, other]

Title: What May Visualization Processes Optimize?

Min Chen, Amos Golan

Comments: 10 pages

Journal-ref: IEEE Transactions on Visualization and Computer Graphics, 22(12):2619-2632, 2016

Subjects: Human-Computer Interaction (cs.HC); Information Theory (cs.IT)

[210] arXiv:1506.02344 (cross-list from stat.ML) [pdf, other]

Title: Stay on path: PCA along graph paths

Megasthenis Asteris, Anastasios Kyrillidis, Alexandros G. Dimakis, Han-Gyol Yi and, Bharath Chandrasekaran

Comments: 12 pages, 5 figures, In Proceedings of International Conference on Machine Learning (ICML) 2015

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Optimization and Control (math.OC)

[211] arXiv:1506.02517 (cross-list from math.CO) [pdf, other]

Title: Perfect codes in the lp metric

Antonio Campello, Grasiele C. Jorge, and João Strapasson, Sueli I. R. Costa

Comments: 21 pages, 9 figures, minor corrections, accepted for publication European Journal of Combinatorics

Subjects: Combinatorics (math.CO); Information Theory (cs.IT)

[212] arXiv:1506.02548 (cross-list from math.CO) [pdf, other]

Title: An asymptotic formula for the number of irreducible transformation shift registers

Stephen D. Cohen, Sartaj Ul Hasan, Daniel Panario, Qiang Wang

Comments: 14 pages

Journal-ref: Linear Algebra Appl. 484 (2015), 46-62

Subjects: Combinatorics (math.CO); Information Theory (cs.IT)

[213] arXiv:1506.02732 (cross-list from cs.LG) [pdf, other]

Title: Empirical Studies on Symbolic Aggregation Approximation Under Statistical Perspectives for Knowledge Discovery in Time Series

Wei Song, Zhiguang Wang, Yangdong Ye, Ming Fan

Comments: 7 pages, 6 figures. Accepted by FSKD 2015

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[214] arXiv:1506.02742 (cross-list from math.CO) [pdf, other]

Title: Polynomial Expressions of Carries in p-ary Arithmetics

Shizuo Kaji, Toshiaki Maeno, Koji Nuida, Yasuhide Numata

Comments: (v2) Improved results and new observations (v3) The authors are notified that our main theorem (Theorem 2) appears (by a different approach) in [C. Sturtivant, G. S. Frandsen: Theoretical Computer Science 112 (1993) 291-309]. The authors would like to keep this preprint online for reference purposes

Subjects: Combinatorics (math.CO); Cryptography and Security (cs.CR); Information Theory (cs.IT); Number Theory (math.NT)

[215] arXiv:1506.03144 (cross-list from math.OC) [pdf, other]

Title: Superresolution without Separation

Geoffrey Schiebinger, Elina Robeva, Benjamin Recht

Comments: 23 pages, 8 figures

Subjects: Optimization and Control (math.OC); Information Theory (cs.IT)

[216] arXiv:1506.03382 (cross-list from math.ST) [pdf, other]

Title: Optimal Rates of Convergence for Noisy Sparse Phase Retrieval via Thresholded Wirtinger Flow

T. Tony Cai, Xiaodong Li, Zongming Ma

Comments: 28 pages, 4 figures

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[217] arXiv:1506.03688 (cross-list from math.NT) [pdf, other]

Title: Diophantine Approximation and applications in Interference Alignment

Faustin Adiceam, Victor Beresnevich, Jason Levesley, Sanju Velani, Evgeniy Zorin

Comments: 44 pages

Subjects: Number Theory (math.NT); Information Theory (cs.IT)

[218] arXiv:1506.03729 (cross-list from math.PR) [pdf, other]

Title: Recovering communities in the general stochastic block model without knowing the parameters

Emmanuel Abbe, Colin Sandon

Comments: arXiv admin note: substantial text overlap with arXiv:1503.00609

Subjects: Probability (math.PR); Information Theory (cs.IT); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[219] arXiv:1506.03998 (cross-list from cs.CV) [pdf, other]

Title: Sparse Multi-layer Image Approximation: Facial Image Compression

Sohrab Ferdowsi, Svyatoslav Voloshynovskiy, Dimche Kostadinov

Comments: Submitted to the MLSP 2015

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

[220] arXiv:1506.04013 (cross-list from math.PR) [pdf, other]

Title: Stationary and Ergodic Properties of Stochastic Non-Linear Systems Controlled over Communication Channels

Serdar Yüksel

Comments: To appear in SIAM Journal on Control and Optimization

Subjects: Probability (math.PR); Information Theory (cs.IT)

[221] arXiv:1506.04440 (cross-list from math.NT) [pdf, other]

Title: Traces of Hecke Operators and Refined Weight Enumerators of Reed-Solomon Codes

Nathan Kaplan, Ian Petrow

Journal-ref: Trans. Amer. Math. Soc. 370 (2018), 2537-2561

Subjects: Number Theory (math.NT); Information Theory (cs.IT)

[222] arXiv:1506.04497 (cross-list from math.DS) [pdf, other]

Title: Lower bounds for the dynamically defined measures

Ivan Werner

Comments: Slightly improved the introduction

Subjects: Dynamical Systems (math.DS); Information Theory (cs.IT); Mathematical Physics (math-ph)

[223] arXiv:1506.04518 (cross-list from math.PR) [pdf, other]

Title: Cepstral Analysis of Random Variables: Muculants

Christian Knoll, Bernhard C. Geiger, Gernot Kubin

Comments: 5 pages

Subjects: Probability (math.PR); Information Theory (cs.IT)

[224] arXiv:1506.04830 (cross-list from cs.SY) [pdf, other]

Title: Maximizing the Link Throughput between Smart-meters and Aggregators as Secondary Users under Power and Outage Constraints

Pedro H. J. Nardelli, Mauricio de Castro Tomé, Hirley Alves, Carlos H. M. de Lima, Matti Latva-aho

Subjects: Systems and Control (eess.SY); Information Theory (cs.IT)

[225] arXiv:1506.04885 (cross-list from cs.GT) [pdf, other]

Title: Entropy Games and Matrix Multiplication Games

Eugene Asarin (LIAFA), Julien Cervelle (LACL), Aldric Degorre (LIAFA), Catalin Dima (LACL), Florian Horn (LIAFA), Victor Kozyakin (IITP)

Comments: Accepted to STACS 2016

Subjects: Computer Science and Game Theory (cs.GT); Information Theory (cs.IT)

[226] arXiv:1506.04902 (cross-list from cs.NI) [pdf, other]

Title: Performance Evaluation Of Qos In Wimax Network

Ahmed Hassan M. Hassan, Elrasheed Ismail M. Zayid, Mohammed Altayeb Awad, Ahmed Salah Mohammed, Samreen Tarig Hassan

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[227] arXiv:1506.04999 (cross-list from quant-ph) [pdf, other]

Title: Achieving the Holevo bound via a bisection decoding protocol

Matteo Rosati, Vittorio Giovannetti

Comments: Updated version: added statement of the main theorem; 35 pages and 2 figures

Journal-ref: J. Math. Phys. 57, 062204 (2016)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Mathematical Physics (math-ph)

[228] arXiv:1506.05173 (cross-list from stat.ML) [pdf, other]

Title: Feature Selection for Ridge Regression with Provable Guarantees

Saurabh Paul, Petros Drineas

Comments: To appear in Neural Computation. A shorter version of this paper appeared at ECML-PKDD 2014 under the title "Deterministic Feature Selection for Regularized Least Squares Classification."

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[229] arXiv:1506.05547 (cross-list from quant-ph) [pdf, other]

Title: Quantum Gaussian Channels with Weak Measurements

Boaz Tamir, Eliahu Cohen

Comments: 9 pages, 1 figure. Accepted for publication in QIC

Journal-ref: Quantum Information and Computation, Vol. 15, No. 13,14 (2015) 1185-1196

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[230] arXiv:1506.05549 (cross-list from cs.NI) [pdf, other]

Title: Decentralized Energy Allocation for Wireless Networks with Renewable Energy Powered Base Stations

Dapeng Li, Walid Saad, Ismail Guvenc, Abolfazl Mehbodniya, Fumiyuki Adachi

Subjects: Networking and Internet Architecture (cs.NI); Computer Science and Game Theory (cs.GT); Information Theory (cs.IT)

[231] arXiv:1506.05819 (cross-list from cs.NI) [pdf, other]

Title: Asymptotic Analysis for Reliable Data Dissemination in Shared loss Multicast Trees

Ron Yadgar, Asaf Cohen, Omer Gurewitz

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[232] arXiv:1506.06055 (cross-list from eess.SP) [pdf, other]

Title: Low PMEPR OFDM radar waveform design using the iterative least squares algorithm

Tianyao Huang, Tong Zhao

Comments: 6 pages, 8 figures

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[233] arXiv:1506.06138 (cross-list from q-bio.NC) [pdf, other]

Title: The evolution of lossy compression

Sarah E. Marzen, Simon DeDeo

Comments: 14 pages, 4 figures

Journal-ref: Journal of the Royal Society Interface 14: 20170166 (2017)

Subjects: Neurons and Cognition (q-bio.NC); Information Theory (cs.IT); Adaptation and Self-Organizing Systems (nlin.AO); Physics and Society (physics.soc-ph); Populations and Evolution (q-bio.PE)

[234] arXiv:1506.06199 (cross-list from math.ST) [pdf, other]

Title: Non-parametric Quickest Change Detection for Large Scale Random Matrices

Taposh Banerjee, Hamed Firouzi, Alfred O. Hero III

Comments: Proc. of ISIT, Hong Kong, 2015

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Methodology (stat.ME)

[235] arXiv:1506.06216 (cross-list from cs.NI) [pdf, other]

Title: Next Generation M2M Cellular Networks: Challenges and Practical Considerations

Abdelmohsen Ali, Walaa Hamouda, Murat Uysal

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[236] arXiv:1506.06479 (cross-list from quant-ph) [pdf, other]

Title: The Classical-Quantum Channel with Random State Parameters Known to the Sender

Holger Boche, Ning Cai, Janis Nötzel

Comments: 26 pages, no figures. Many typos corrected. More details added to the proofs. Added proof for the direct part of capacity theorem for causal encoding

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[237] arXiv:1506.06534 (cross-list from cs.CL) [pdf, other]

Title: Distributional Sentence Entailment Using Density Matrices

Esma Balkir, Mehrnoosh Sadrzadeh, Bob Coecke

Comments: 11 pages

Subjects: Computation and Language (cs.CL); Information Theory (cs.IT); Logic in Computer Science (cs.LO); Category Theory (math.CT)

[238] arXiv:1506.06671 (cross-list from cs.SI) [pdf, other]

Title: Beyond Triangles: A Distributed Framework for Estimating 3-profiles of Large Graphs

Ethan R. Elenberg, Karthikeyan Shanmugam, Michael Borokhovich, Alexandros G. Dimakis

Comments: To appear in part at KDD'15

Subjects: Social and Information Networks (cs.SI); Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT)

[239] arXiv:1506.06801 (cross-list from quant-ph) [pdf, other]

Title: Matrix Poincaré, Φ-Sobolev inequalities, and quantum ensembles

Hao-Chung Cheng, Min-Hsiu Hsieh

Journal-ref: Journal of Mathematical Physics, 60(3), 032201, Mar 2019

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Mathematical Physics (math-ph); Probability (math.PR)

[240] arXiv:1506.06918 (cross-list from math.NA) [pdf, other]

Title: Implementation of discretized Gabor frames and their duals

Tobias Kloos, Joachim Stöckler, Karlheinz Gröchenig

Comments: 16 pages, 4 figures

Subjects: Numerical Analysis (math.NA); Information Theory (cs.IT)

[241] arXiv:1506.06988 (cross-list from q-bio.PE) [pdf, other]

Title: From Entropy to Information: Biased Typewriters and the Origin of Life

Christoph Adami, Thomas LaBar

Comments: 19 pages, 8 figures in "From Matter to Life: Information and Causality", S.I. Walker, P.C.W. Davies, and G. F. R. Ellis, eds., (Cambridge University Press, 2017) pp. 130-154

Subjects: Populations and Evolution (q-bio.PE); Information Theory (cs.IT); Adaptation and Self-Organizing Systems (nlin.AO); Biomolecules (q-bio.BM)

[242] arXiv:1506.07139 (cross-list from quant-ph) [pdf, other]

Title: Optimal Encoding Capacity of a Linear Optical Quantum Channel

Jake A. Smith, Dmitry B. Uskov, Lev Kaplan

Comments: 6 pages, 4 figures

Journal-ref: Phys. Rev. A 92, 022324 (2015)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[243] arXiv:1506.07216 (cross-list from cs.LG) [pdf, other]

Title: Communication Lower Bounds for Statistical Estimation Problems via a Distributed Data Processing Inequality

Mark Braverman, Ankit Garg, Tengyu Ma, Huy L. Nguyen, David P. Woodruff

Comments: To appear at STOC 2016. Fixed typos in theorem 4.5 and incorporated reviewers' suggestions

Subjects: Machine Learning (cs.LG); Computational Complexity (cs.CC); Information Theory (cs.IT); Machine Learning (stat.ML)

[244] arXiv:1506.07437 (cross-list from math.CO) [pdf, other]

Title: The Truncated & Supplemented Pascal Matrix and Applications

M. Hua, S. B. Damelin, J. Sun, M. Yu

Journal-ref: Involve 11 (2018) 243-251

Subjects: Combinatorics (math.CO); Information Theory (cs.IT)

[245] arXiv:1506.07613 (cross-list from cs.CV) [pdf, other]

Title: Generalized Majorization-Minimization

Sobhan Naderi Parizi, Kun He, Reza Aghajani, Stan Sclaroff, Pedro Felzenszwalb

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[246] arXiv:1506.07902 (cross-list from stat.ML) [pdf, other]

Title: Minimax Structured Normal Means Inference

Akshay Krishnamurthy

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT)

[247] arXiv:1506.07947 (cross-list from cs.LG) [pdf, other]

Title: Collaboratively Learning Preferences from Ordinal Data

Sewoong Oh, Kiran K. Thekumparampil, Jiaming Xu

Comments: 38 pages 2 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[248] arXiv:1506.08159 (cross-list from math.ST) [pdf, other]

Title: Near-Optimal Estimation of Simultaneously Sparse and Low-Rank Matrices from Nested Linear Measurements

Sohail Bahmani, Justin Romberg

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Optimization and Control (math.OC); Applications (stat.AP)

[249] arXiv:1506.09109 (cross-list from cs.NI) [pdf, other]

Title: Smart Small Cell with Hybrid Beamforming for 5G: Theoretical Feasibility and Prototype Results

Jinyoung Jang, MinKeun Chung, Hae Gwang Hwang, Yeon-Geun Lim, Hong-jib Yoon, TaeckKeun Oh, Byung-Wook Min, Yongshik Lee, Kwang Soon Kim, Chan-Byoung Chae, Dong Ku Kim

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)