Information Theory

Authors and titles for January 2021

[251] arXiv:2101.05113 (cross-list from eess.SP) [pdf, other]

Title: Beyond Procrustes: Balancing-Free Gradient Descent for Asymmetric Low-Rank Matrix Sensing

Cong Ma, Yuanxin Li, Yuejie Chi

Comments: To appear on IEEE Trans. on Signal Processing

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (stat.ML)

[252] arXiv:2101.05544 (cross-list from cs.LG) [pdf, other]

Title: DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation

Alexandre Rame, Matthieu Cord

Comments: Published as a conference paper at ICLR 2021. 9 main pages, 13 figures, 12 tables

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

[253] arXiv:2101.06197 (cross-list from cs.LG) [pdf, other]

Title: Deciding What to Learn: A Rate-Distortion Approach

Dilip Arumugam, Benjamin Van Roy

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[254] arXiv:2101.06406 (cross-list from cs.SI) [pdf, other]

Title: Community Detection in Blockchain Social Networks

Sissi Xiaoxiao Wu, Zixian Wu, Shihui Chen, Gangqiang Li, Shengli Zhang

Subjects: Social and Information Networks (cs.SI); Information Theory (cs.IT)

[255] arXiv:2101.06453 (cross-list from stat.CO) [pdf, other]

Title: An MCMC Method to Sample from Lattice Distributions

Anand Jerry George, Navin Kashyap

Comments: 11 pages, 7 figures

Subjects: Computation (stat.CO); Information Theory (cs.IT); Machine Learning (stat.ML)

[256] arXiv:2101.06572 (cross-list from math.OA) [pdf, other]

Title: Tracial smooth functions of non-commuting variables and the free Wasserstein manifold

David Jekel, Wuchen Li, Dimitri Shlyakhtenko

Comments: 134 pages, revised

Subjects: Operator Algebras (math.OA); Information Theory (cs.IT)

[257] arXiv:2101.06676 (cross-list from cs.CR) [pdf, other]

Title: A Technical Report for Light-Edge: A Lightweight Authentication Protocol for IoT Devices in an Edge-Cloud Environment

Ali Shahidinejad, Mostafa Ghobaei-Arani, Alireza Souri, Mohammad Shojafar, Saru Kumari

Comments: 5 pages, 13 figures, 5 tables, technical report of IEEE Consumer Electronics Magazine paper (Light-Edge)

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[258] arXiv:2101.06917 (cross-list from cs.LG) [pdf, other]

Title: Detection of Insider Attacks in Distributed Projected Subgradient Algorithms

Sissi Xiaoxiao Wu, Gangqiang Li, Shengli Zhang, Xiaohui Lin

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[259] arXiv:2101.07250 (cross-list from stat.ME) [pdf, other]

Title: Query-Based Selection of Optimal Candidates under the Mallows Model

Xujun Liu, Olgica Milenkovic, George V. Moustakides

Comments: 28 pages, 2 figures, 2 tables

Subjects: Methodology (stat.ME); Discrete Mathematics (cs.DM); Information Theory (cs.IT); Combinatorics (math.CO)

[260] arXiv:2101.07969 (cross-list from math.ST) [pdf, other]

Title: Robust W-GAN-Based Estimation Under Wasserstein Contamination

Zheng Liu, Po-Ling Loh

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[261] arXiv:2101.08390 (cross-list from cs.LG) [pdf, other]

Title: An Information-Theoretic Analysis of the Impact of Task Similarity on Meta-Learning

Sharu Theresa Jose, Osvaldo Simeone

Comments: Accepted to ISIT 2021

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP)

[262] arXiv:2101.08415 (cross-list from cs.CV) [pdf, other]

Title: Finger Vein Recognition by Generating Code

Zhongxia Zhang, Mingwen Wang

Comments: 11pages,1 figure, 6 tables

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

[263] arXiv:2101.08435 (cross-list from cs.LG) [pdf, other]

Title: Learning based signal detection for MIMO systems with unknown noise statistics

Ke He, Le He, Lisheng Fan, Yansha Deng, George K. Karagiannidis, Arumugam Nallanathan

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[264] arXiv:2101.08607 (cross-list from eess.SP) [pdf, other]

Title: Path Loss Modeling and Measurements for Reconfigurable Intelligent Surfaces in the Millimeter-Wave Frequency Band

Wankai Tang, Xiangyu Chen, Ming Zheng Chen, Jun Yan Dai, Yu Han, Marco Di Renzo, Shi Jin, Qiang Cheng, Tie Jun Cui

Comments: Model refinements are introduced to previously proposed free-space path loss model for RISs in order to make it simpler and easier to use. The properties of a single unit cell are evaluated in terms of scattering performance, power, and area, as it is the basic element of an RIS. We report the world's first measurement campaign in the mmWave frequency band to validate the path loss model for RISs

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[265] arXiv:2101.08837 (cross-list from cs.LG) [pdf, other]

Title: Time-Correlated Sparsification for Communication-Efficient Federated Learning

Emre Ozfatura, Kerem Ozfatura, Deniz Gunduz

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[266] arXiv:2101.08917 (cross-list from stat.ML) [pdf, other]

Title: SGA: A Robust Algorithm for Partial Recovery of Tree-Structured Graphical Models with Noisy Samples

Anshoo Tandon, Aldric H. J. Yuan, Vincent Y. F. Tan

Comments: 23 pages, 14 figures

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[267] arXiv:2101.09137 (cross-list from eess.SP) [pdf, other]

Title: Multi-hop RIS-Empowered Terahertz Communications: A DRL-based Hybrid Beamforming Design

Chongwen Huang, Zhaohui Yang, George C. Alexandropoulos, Kai Xiong, Li Wei, Chau Yuen, Zhaoyang Zhang, Merouane Debbah

Comments: IEEE Journal on Selected Areas in Communications, Special issue: TeraHertz Communications and Networking. arXiv admin note: substantial text overlap with arXiv:2009.09380

Journal-ref: in IEEE Journal on Selected Areas in Communications, vol. 39, no. 6, pp. 1663-1677, June 2021

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)

[268] arXiv:2101.09139 (cross-list from cs.CR) [pdf, other]

Title: The Privacy-Utility Tradeoff of Robust Local Differential Privacy

Milan Lopuhaä-Zwakenberg, Jasper Goseling

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[269] arXiv:2101.09181 (cross-list from cs.NE) [pdf, other]

Title: Approximation capability of two hidden layer feedforward neural networks with fixed weights

Namig J. Guliyev, Vugar E. Ismailov

Comments: 13 pages, 3 figures; this article uses the algorithm from arXiv:1708.06219; for associated SageMath worksheet, see this https URL

Journal-ref: Neurocomputing, 316 (2018), 262-269

Subjects: Neural and Evolutionary Computing (cs.NE); Information Theory (cs.IT); Numerical Analysis (math.NA)

[270] arXiv:2101.09207 (cross-list from cs.LG) [pdf, other]

Title: Differentiable Trust Region Layers for Deep Reinforcement Learning

Fabian Otto, Philipp Becker, Ngo Anh Vien, Hanna Carolin Ziesche, Gerhard Neumann

Comments: Accepted at ICLR 2021, camera ready version

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[271] arXiv:2101.09315 (cross-list from stat.ML) [pdf, other]

Title: Tighter expected generalization error bounds via Wasserstein distance

Borja Rodríguez-Gálvez, Germán Bassi, Ragnar Thobaben, Mikael Skoglund

Comments: 29 pages: 9 of the main text, 3 of references, and 17 of appendices. Presented at ITR3 at ICML 2021. Accepted at NeurIPS 2021

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[272] arXiv:2101.09774 (cross-list from q-bio.NC) [pdf, other]

Title: What If Memory Information is Stored Inside the Neuron, Instead of in the Synapse?

James Tee, Desmond P. Taylor

Comments: 8 pages, 9 figures

Subjects: Neurons and Cognition (q-bio.NC); Information Theory (cs.IT)

[273] arXiv:2101.09856 (cross-list from eess.SP) [pdf, other]

Title: UAV-Assisted Over-the-Air Computation

Min Fu, Yong Zhou, Yuanming Shi, Ting Wang, Wei Chen

Comments: 6 pages, 5 figures. This paper has been accepted by Pro. IEEE Int. Conf. Commun. (ICC), Jun. 2021

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[274] arXiv:2101.09952 (cross-list from eess.SY) [pdf, other]

Title: Blind Diagnosis for Millimeter-wave Large-scale Antenna Systems

Rui Sun, Weidong Wang, Li Chen, Guo Wei, Wenyi Zhang

Subjects: Systems and Control (eess.SY); Information Theory (cs.IT); Signal Processing (eess.SP)

[275] arXiv:2101.09973 (cross-list from cs.LG) [pdf, other]

Title: Approximating Probability Distributions by ReLU Networks

Manuj Mukherjee, Aslan Tchamkerten, Mansoor Yousefi

Comments: Longer version of a paper accepted for presentation at the ITW 2020

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)