Information Theory

Authors and titles for October 2021

[226] arXiv:2110.00926 (cross-list from cs.LG) [pdf, other]

Title: Information-Theoretic Characterization of the Generalization Error for Iterative Semi-Supervised Learning

Haiyun He, Hanshu Yan, Vincent Y. F. Tan

Comments: 52 pages, 17 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[227] arXiv:2110.01195 (cross-list from cs.CR) [pdf, other]

Title: Virtual Private Mobile Network with Multiple Gateways for B5G Location Privacy

Stefano Tomasin, Javier German Luzon Hidalgo

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[228] arXiv:2110.01440 (cross-list from math.ST) [pdf, other]

Title: Arithmetic Average Density Fusion -- Part I: Some Statistic and Information-theoretic Results

Tiancheng Li, Yan Song, Enbin Song, Hongqi Fan

Comments: 30 pages, 14 figures, 3 tables. Information Fusion, 2024

Journal-ref: Information Fusion, Vol.104, April 2024, 102199

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT)

[229] arXiv:2110.01602 (cross-list from stat.ML) [pdf, other]

Title: Clustering a Mixture of Gaussians with Unknown Covariance

Damek Davis, Mateo Díaz, Kaizheng Wang

Comments: 89 pages

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST)

[230] arXiv:2110.01722 (cross-list from eess.SP) [pdf, other]

Title: Wireless Link Scheduling via Graph Representation Learning: A Comparative Study of Different Supervision Levels

Navid Naderializadeh

Comments: Code available at this https URL

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[231] arXiv:2110.01726 (cross-list from cs.NI) [pdf, other]

Title: On-Demand Networking for Ubiquitous Connectivity and Network Resilience: A Network-in-a-Box Solution

Ki-Hong Park, Mohamed-Slim Alouini, Yunfei Chen

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[232] arXiv:2110.01901 (cross-list from cs.DS) [pdf, other]

Title: Inferring Hidden Structures in Random Graphs

Wasim Huleihel

Comments: 43 pages

Subjects: Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[233] arXiv:2110.01968 (cross-list from math.ST) [pdf, other]

Title: Missing $g$-mass: Investigating the Missing Parts of Distributions

Prafulla Chandra, Andrew Thangaraj

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT)

[234] arXiv:2110.02159 (cross-list from cs.LG) [pdf, other]

Title: Label differential privacy via clustering

Hossein Esfandiari, Vahab Mirrokni, Umar Syed, Sergei Vassilvitskii

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT)

[235] arXiv:2110.02161 (cross-list from cs.LG) [pdf, other]

Title: Optimal N-ary ECOC Matrices for Ensemble Classification

Hieu D. Nguyen, Lucas J. Lavalva, Shen-Shyang Ho, Mohammed Sarosh Khan, Nicholas Kaegi

Comments: 20 pages, 75 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[236] arXiv:2110.02177 (cross-list from cs.LG) [pdf, other]

Title: Secure Aggregation for Buffered Asynchronous Federated Learning

Jinhyun So, Ramy E. Ali, Başak Güler, A. Salman Avestimehr

Comments: arXiv admin note: substantial overlap with arXiv:2109.14236

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Machine Learning (stat.ML)

[237] arXiv:2110.02341 (cross-list from cs.LG) [pdf, other]

Title: How to Query An Oracle? Efficient Strategies to Label Data

Farshad Lahouti, Victoria Kostina, Babak Hassibi

Comments: To Appear in IEEE Transactions on Pattern Analysis and Machine Intelligence

Subjects: Machine Learning (cs.LG); Databases (cs.DB); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT)

[238] arXiv:2110.02343 (cross-list from quant-ph) [pdf, other]

Title: Quantum Semi-Supervised Learning with Quantum Supremacy

Zhou Shangnan

Comments: Acknowledgement modified to reflect truth

Subjects: Quantum Physics (quant-ph); Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Machine Learning (cs.LG); High Energy Physics - Theory (hep-th)

[239] arXiv:2110.02800 (cross-list from quant-ph) [pdf, other]

Title: Unital Qubit Queue-channels: Classical Capacity and Product Decoding

Vikesh Siddhu, Avhishek Chatterjee, Krishna Jagannathan, Prabha Mandayam, Sridhar Tayur

Comments: 25 pages with 3 Figures. Merges and supersedes our prior submissions arXiv:2107.13486 and arXiv:2110.02800

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[240] arXiv:2110.03128 (cross-list from cs.LG) [pdf, other]

Title: On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications

Ziqiao Wang, Yongyi Mao

Comments: Accepted to ICLR2022

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[241] arXiv:2110.03523 (cross-list from eess.SP) [pdf, other]

Title: Range and Bearing Data Fusion for Precise Convex Network Localization

Claudia Soares, Filipa Valdeira, Joao Gomes

Journal-ref: IEEE Signal Processing Letters 27 (2020): 670-674

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Optimization and Control (math.OC)

[242] arXiv:2110.03743 (cross-list from cs.LG) [pdf, other]

Title: Reinforcement Learning in Reward-Mixing MDPs

Jeongyeol Kwon, Yonathan Efroni, Constantine Caramanis, Shie Mannor

Comments: NeurIPS 2021; fixed typo

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[243] arXiv:2110.04073 (cross-list from eess.SP) [pdf, other]

Title: Optimization of Reconfigurable Intelligent Surfaces Through Trace Maximization

Akbar Sayeed

Journal-ref: IEEE ICC 2021 IEEE ICC 2021

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[244] arXiv:2110.04074 (cross-list from stat.ML) [pdf, other]

Title: Active inference, Bayesian optimal design, and expected utility

Noor Sajid, Lancelot Da Costa, Thomas Parr, Karl Friston

Comments: 19 pages; 3 figures

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[245] arXiv:2110.04127 (cross-list from cs.LG) [pdf, other]

Title: Deep Upper Confidence Bound Algorithm for Contextual Bandit Ranking of Information Selection

Michael Rawson, Jade Freeman

Journal-ref: Proceedings of Joint Statistical Meetings 2021, Statistical Learning and Data Science Section. Alexandria, VA: American Statistical Association

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Statistics Theory (math.ST)

[246] arXiv:2110.04660 (cross-list from cs.CV) [pdf, other]

Title: K-Splits: Improved K-Means Clustering Algorithm to Automatically Detect the Number of Clusters

Seyed Omid Mohammadi, Ahmad Kalhor, Hossein Bodaghi (University of Tehran, College of Engineering, School of Electrical and Computer Engineering, Tehran, Iran)

Comments: 16 pages, 6 figures

Journal-ref: Computer Networks, Big Data and IoT. Lecture Notes on Data Engineering and Communications Technologies, vol 117, 2022, Springer, Singapore

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[247] arXiv:2110.05256 (cross-list from math.CO) [pdf, other]

Title: On $q$-ary shortened-$1$-perfect-like codes

Minjia Shi, Rongsheng Wu, Denis S. Krotov

Journal-ref: IEEE Trans. Inf. Theory 68(11) 2022, 7100-7106

Subjects: Combinatorics (math.CO); Discrete Mathematics (cs.DM); Information Theory (cs.IT)

[248] arXiv:2110.05554 (cross-list from cs.NI) [pdf, other]

Title: Towards a Cost vs. Quality Sweet Spot for Monitoring Networks

Nofel Yaseen, Behnaz Arzani, Krishna Chintalapudi, Vaishnavi Ranganathan, Felipe Frujeri, Kevin Hsieh, Daniel Berger, Vincent Liu, Srikanth Kandula

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[249] arXiv:2110.05587 (cross-list from cs.SD) [pdf, other]

Title: Evaluation of Latent Space Disentanglement in the Presence of Interdependent Attributes

Karn N. Watcharasupat, Alexander Lerch

Comments: Submitted to the Late-Breaking Demo Session of the 22nd International Society for Music Information Retrieval Conference

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Information Theory (cs.IT); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[250] arXiv:2110.05649 (cross-list from cs.LG) [pdf, other]

Title: Learned Robust PCA: A Scalable Deep Unfolding Approach for High-Dimensional Outlier Detection

HanQin Cai, Jialin Liu, Wotao Yin

Comments: NeurIPS 2021

Journal-ref: Advances in Neural Information Processing Systems 34 (2021): 16977-16989

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Numerical Analysis (math.NA)