Information Theory

Authors and titles for July 2021

[201] arXiv:2107.14163 [pdf, other]

Title: Achievable Regions and Precoder Designs for the Multiple Access Wiretap Channels with Confidential and Open Messages

Hao Xu, Tianyu Yang, Kai-Kit Wong, Giuseppe Caire

Comments: 19 pages, 12 figures

Subjects: Information Theory (cs.IT)

[202] arXiv:2107.14218 [pdf, other]

Title: Gossiping with Binary Freshness Metric

Melih Bastopcu, Baturalp Buyukates, Sennur Ulukus

Subjects: Information Theory (cs.IT); Networking and Internet Architecture (cs.NI); Signal Processing (eess.SP)

[203] arXiv:2107.14264 [pdf, other]

Title: An Information-Theoretic Approach to Joint Sensing and Communication

Mehrasa Ahmadipour, Mari Kobayashi, Miche`le Wigger, Giuseppe Caire

Subjects: Information Theory (cs.IT)

[204] arXiv:2107.14270 [pdf, other]

Title: Secure Swarm UAV-assisted Communications with Cooperative Friendly Jamming

Hanh Dang-Ngoc, Diep N. Nguyen, Khuong Ho-Van, Dinh Thai Hoang, Eryk Dutkiewicz, Quoc-Viet Pham, Won-Joo Hwang

Comments: 30 pages, 7 figures, journal

Subjects: Information Theory (cs.IT); Signal Processing (eess.SP)

[205] arXiv:2107.14396 [pdf, other]

Title: Combined Radar and Communications with Phase-Modulated Frequency Permutations

Tian Han, Rajitha Senanayake, Peter Smith, Jamie Evans, William Moran, Robin Evans

Journal-ref: IEEE Open Journal of the Communications Society, vol. 4, pp. 967-989, 2023

Subjects: Information Theory (cs.IT); Signal Processing (eess.SP)

[206] arXiv:2107.14404 [pdf, other]

Title: Towards Efficient Large-Scale Network Slicing: An LP Dynamic Rounding-and-Refinement Approach

Wei-Kun Chen, Ya-Feng Liu, Fan Liu, Yu-Hong Dai, Zhi-Quan Luo

Comments: 16 pages, 8 figures, accepted for publication in the IEEE Transactions on Signal Processing. arXiv admin note: text overlap with arXiv:2102.02563

Subjects: Information Theory (cs.IT); Signal Processing (eess.SP); Optimization and Control (math.OC)

[207] arXiv:2107.14576 [pdf, other]

Title: On weight spectrum of linear codes

Vladimir N. Potapov

Journal-ref: Proceedings of 2021 XVII International Symposium on Problems of Redundancy in Information and Control Systems

Subjects: Information Theory (cs.IT); Combinatorics (math.CO)

[208] arXiv:2107.14577 [pdf, other]

Title: Fast direct access to variable length codes

Boris Ryabko

Subjects: Information Theory (cs.IT); Data Structures and Algorithms (cs.DS)

[209] arXiv:2107.14583 [pdf, other]

Title: An Upper Bound on the Number of Bent Functions

Vladimir N. Potapov

Journal-ref: Proceedings of 2021 XVII International Symposium on Problems of Redundancy in Information and Control Systems

Subjects: Information Theory (cs.IT)

[210] arXiv:2107.14669 [pdf, other]

Title: Representing preorders with injective monotones

Pedro Hack, Daniel A. Braun, Sebastian Gottwald

Subjects: Information Theory (cs.IT)

[211] arXiv:2107.00314 (cross-list from cs.DS) [pdf, other]

Title: Backtracking (the) Algorithms on the Hamiltonian Cycle Problem

Joeri Sleegers, Daan van den Berg

Comments: Peer-reviewed and published in IARIA journals

Subjects: Data Structures and Algorithms (cs.DS); Computational Complexity (cs.CC); Information Theory (cs.IT)

[212] arXiv:2107.00392 (cross-list from quant-ph) [pdf, other]

Title: Coherent information of a quantum channel or its complement is generically positive

Satvik Singh, Nilanjana Datta

Comments: Minor modifications with updated references

Journal-ref: Quantum 6, 775 (2022)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Mathematical Physics (math-ph)

[213] arXiv:2107.00838 (cross-list from cs.LG) [pdf, other]

Title: RL-NCS: Reinforcement learning based data-driven approach for nonuniform compressed sensing

Nazmul Karim, Alireza Zaeemzadeh, Nazanin Rahnavard

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP)

[214] arXiv:2107.00990 (cross-list from cond-mat.stat-mech) [pdf, other]

Title: Minimizing couplings in renormalization by preserving short-range mutual information

Christian Bertoni, Joseph M. Renes

Comments: 5 pages, 4 figures

Journal-ref: J. Phys. A 55, 375004 (2022)

Subjects: Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT)

[215] arXiv:2107.01131 (cross-list from stat.ML) [pdf, other]

Title: Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization

Qing Guo, Junya Chen, Dong Wang, Yuewei Yang, Xinwei Deng, Lawrence Carin, Fan Li, Jing Huang, Chenyang Tao

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[216] arXiv:2107.01152 (cross-list from stat.ML) [pdf, other]

Title: Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE

Junya Chen, Zhe Gan, Xuan Li, Qing Guo, Liqun Chen, Shuyang Gao, Tagyoung Chung, Yi Xu, Belinda Zeng, Wenlian Lu, Fan Li, Lawrence Carin, Chenyang Tao

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG)

[217] arXiv:2107.01274 (cross-list from eess.SP) [pdf, other]

Title: Unbiasing Procedures for Scale-invariant Multi-reference Alignment

Matthew Hirn, Anna Little

Comments: 12 pages, 5 figures. Code reproducing numerical results at this https URL

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[218] arXiv:2107.01305 (cross-list from math.ST) [pdf, other]

Title: Maximum likelihood for high-noise group orbit estimation and single-particle cryo-EM

Zhou Fan, Roy R. Lederman, Yi Sun, Tianhao Wang, Sheng Xu

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Optimization and Control (math.OC)

[219] arXiv:2107.01410 (cross-list from cs.LG) [pdf, other]

Title: Maximum Entropy Weighted Independent Set Pooling for Graph Neural Networks

Amirhossein Nouranizadeh, Mohammadjavad Matinkia, Mohammad Rahmati, Reza Safabakhsh

Comments: 21 pages, 12 figures, under review in 35th Conference on Neural Information Processing Systems (NeurIPS 2021)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Neural and Evolutionary Computing (cs.NE)

[220] arXiv:2107.01458 (cross-list from quant-ph) [pdf, other]

Title: Quantum Error Mitigation Relying on Permutation Filtering

Yifeng Xiong, Soon Xin Ng, Lajos Hanzo

Journal-ref: IEEE Transactions on Communications, 70(3), 2022

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[221] arXiv:2107.01816 (cross-list from quant-ph) [pdf, other]

Title: Sets of Marginals and Pearson-Correlation-based CHSH Inequalities for a Two-Qubit System

Yuwen Huang, Pascal O. Vontobel

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[222] arXiv:2107.01952 (cross-list from cs.LG) [pdf, other]

Title: Partition and Code: learning how to compress graphs

Giorgos Bouritsas, Andreas Loukas, Nikolaos Karalias, Michael M. Bronstein

Comments: Published at NeurIPS 2021

Journal-ref: Proc. Adv. Neur. Inf. Process. Syst. (NeurIPS) vol. 34 pp. 18603 - 18619 (2021)

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[223] arXiv:2107.02027 (cross-list from cs.CL) [pdf, other]

Title: Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance

Mario Michael Krell, Matej Kosec, Sergio P. Perez, Andrew Fitzgibbon

Comments: Significantly new version with different authors and much more content. Much larger variety in experiments and exhaustive SOTA analysis

Subjects: Computation and Language (cs.CL); Computational Complexity (cs.CC); Information Theory (cs.IT); Machine Learning (cs.LG)

[224] arXiv:2107.02520 (cross-list from eess.SP) [pdf, other]

Title: Deep Learning Methods for Joint Optimization of Beamforming and Fronthaul Quantization in Cloud Radio Access Networks

Daesung Yu, Hoon Lee, Seok-Hwan Park, Seung-Eun Hong

Comments: accepted for publication on IEEE Wireless Communications Letters

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)

[225] arXiv:2107.02565 (cross-list from cs.LG) [pdf, other]

Title: Prioritized training on points that are learnable, worth learning, and not yet learned (workshop version)

Sören Mindermann, Muhammed Razzak, Winnie Xu, Andreas Kirsch, Mrinank Sharma, Adrien Morisot, Aidan N. Gomez, Sebastian Farquhar, Jan Brauner, Yarin Gal

Journal-ref: ICML 2021 Workshop on Subset Selection in Machine Learning

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[226] arXiv:2107.02567 (cross-list from quant-ph) [pdf, other]

Title: On a tracial version of Haemers bound

Li Gao, Sander Gribling, Yinan Li

Comments: Accepted for publication at IEEE transactions on information theory. Close to the published version

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Combinatorics (math.CO)

[227] arXiv:2107.02816 (cross-list from hep-th) [pdf, other]

Title: Non-rational Narain CFTs from codes over $F_4$

Anatoly Dymarsky, Adar Sharon

Journal-ref: High Energ. Phys. 2021, 16 (2021)

Subjects: High Energy Physics - Theory (hep-th); Information Theory (cs.IT); Quantum Physics (quant-ph)

[228] arXiv:2107.03046 (cross-list from cs.NI) [pdf, other]

Title: 6G: from Densification to Diversification

Hyunsoo Kim, Taehyung Kim, Hyejin Kim, Insik Jung, Hakkeon Lee, Hyunmin Seo, Daesik Hong

Comments: 11 pages, 5 figures, 3 tables

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[229] arXiv:2107.03433 (cross-list from cs.LG) [pdf, other]

Title: In-Network Learning: Distributed Training and Inference in Networks

Matei Moldoveanu, Abdellatif Zaidi

Comments: Extended version of Globecom'2021 paper; 11 double-column pages; 11 figures; 1 Table. arXiv admin note: substantial text overlap with arXiv:2104.14929

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[230] arXiv:2107.03455 (cross-list from stat.ML) [pdf, other]

Title: Model Selection for Generic Contextual Bandits

Avishek Ghosh, Abishek Sankararaman, Kannan Ramchandran

Comments: Accepted at IEEE Transactions on Information Theory. arXiv admin note: text overlap with arXiv:2006.02612

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[231] arXiv:2107.03772 (cross-list from physics.hist-ph) [pdf, other]

Title: Degrees of riskiness, falsifiability, and truthlikeness. A neo-Popperian account applicable to probabilistic theories

Leander Vignero, Sylvia Wenmackers

Comments: 41 pages; 3 figures; accepted for publication in Synthese

Subjects: History and Philosophy of Physics (physics.hist-ph); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Probability (math.PR); Statistics Theory (math.ST)

[232] arXiv:2107.03836 (cross-list from stat.ME) [pdf, other]

Title: Consistency of the Maximal Information Coefficient Estimator

John Lazarsfeld, Aaron Johnson

Subjects: Methodology (stat.ME); Information Theory (cs.IT); Machine Learning (cs.LG); Machine Learning (stat.ML)

[233] arXiv:2107.03948 (cross-list from quant-ph) [pdf, other]

Title: Lower bounds on the error probability of multiple quantum channel discrimination by the Bures angle and the trace distance

Ryo Ito, Ryuhei Mori

Comments: 17 pages, 6 figures

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[234] arXiv:2107.04145 (cross-list from cs.MA) [pdf, other]

Title: Intelligent Link Adaptation for Grant-Free Access Cellular Networks: A Distributed Deep Reinforcement Learning Approach

Joao V.C. Evangelista, Zeeshan Sattar, Georges Kaddoum, Bassant Selim, Aydin Sarraf

Comments: 14 pages, 8 Figures

Subjects: Multiagent Systems (cs.MA); Information Theory (cs.IT); Signal Processing (eess.SP)

[235] arXiv:2107.04637 (cross-list from math-ph) [pdf, other]

Title: Moments of quantum purity and biorthogonal polynomial recurrence

Shi-Hao Li, Lu Wei

Comments: 25 pages, 1 figure

Journal-ref: J. Phys. A: Math. Theor. 54 445204, 2021

Subjects: Mathematical Physics (math-ph); Information Theory (cs.IT); Quantum Physics (quant-ph)

[236] arXiv:2107.05008 (cross-list from cond-mat.stat-mech) [pdf, other]

Title: Jaynes & Shannon's Constrained Ignorance and Surprise

Thomas Cailleteau

Subjects: Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Probability (math.PR); Statistics Theory (math.ST)

[237] arXiv:2107.05121 (cross-list from eess.SP) [pdf, other]

Title: eGHWT: The Extended Generalized Haar-Walsh Transform

Naoki Saito, Yiqun Shao

Subjects: Signal Processing (eess.SP); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Combinatorics (math.CO); Numerical Analysis (math.NA)

[238] arXiv:2107.05161 (cross-list from math.MG) [pdf, other]

Title: Bounds for Multiple Packing and List-Decoding Error Exponents

Yihan Zhang, Shashank Vatedka

Comments: This paper has been split into three parts (arXiv:2211.04406, arXiv:2211.04407, arXiv:2211.04408) with new results added and significant revision. The current version is therefore dated

Subjects: Metric Geometry (math.MG); Computational Complexity (cs.CC); Information Theory (cs.IT); Combinatorics (math.CO)

[239] arXiv:2107.05174 (cross-list from quant-ph) [pdf, other]

Title: Partially Concatenated Calderbank-Shor-Steane Codes Achieving the Quantum Gilbert-Varshamov Bound Asymptotically

Jihao Fan, Jun Li, Ya Wang, Yonghui Li, Min-Hsiu Hsieh, Jiangfeng Du

Comments: 11 pages,2 figures

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[240] arXiv:2107.05246 (cross-list from eess.SP) [pdf, other]

Title: Joint Activity Detection, Channel Estimation, and Data Decoding for Grant-free Massive Random Access

Xinyu Bian, Yuyi Mao, Jun Zhang

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[241] arXiv:2107.05298 (cross-list from cs.LG) [pdf, other]

Title: HEMP: High-order Entropy Minimization for neural network comPression

Enzo Tartaglione, Stéphane Lathuilière, Attilio Fiandrotti, Marco Cagnazzo, Marco Grangetto

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[242] arXiv:2107.05383 (cross-list from cs.DL) [pdf, other]

Title: Not Quite 'Ask a Librarian': AI on the Nature, Value, and Future of LIS

Jesse David Dinneen, Helen Bubinger

Comments: Final version to appear in ASIS&T '21: Proceedings of the 84th Annual Meeting of the Association for Information Science & Technology, 58

Subjects: Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Information Theory (cs.IT)

[243] arXiv:2107.05610 (cross-list from q-bio.PE) [pdf, other]

Title: The Fundamental Theorem of Natural Selection

John C. Baez

Comments: 6 pages

Subjects: Populations and Evolution (q-bio.PE); Information Theory (cs.IT)

[244] arXiv:2107.05675 (cross-list from eess.SP) [pdf, other]

Title: Quality of Service Guarantees for Physical Unclonable Functions

Onur Günlü, Rafael F. Schaefer, H. Vincent Poor

Comments: To appear in the IEEE International Workshop on Information Forensics and Security 2021

Subjects: Signal Processing (eess.SP); Cryptography and Security (cs.CR); Information Theory (cs.IT); Machine Learning (cs.LG)

[245] arXiv:2107.05849 (cross-list from stat.ML) [pdf, other]

Title: Model Selection for Generic Reinforcement Learning

Avishek Ghosh, Sayak Ray Chowdhury, Kannan Ramchandran

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[246] arXiv:2107.06170 (cross-list from eess.SP) [pdf, other]

Title: Robust Blind Source Separation by Soft Decision-Directed Non-Unitary Joint Diagonalization

Wenjuan Liu, Dazheng Feng, Bingnan Pei, Mengdao Xing, Xinhong Meng, Qianru Wei

Comments: 19 pages, 9 figures

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Optimization and Control (math.OC)

[247] arXiv:2107.06173 (cross-list from eess.SP) [pdf, other]

Title: Orthogonal and Non-Orthogonal Signal Representations Using New Transformation Matrices Having NPM Structure

Shaik Basheeruddin Shah, Vijay Kumar Chakka, Arikatla Satyanarayana Reddy

Comments: 13 pages, 5 figures,

Journal-ref: IEEE Transactions on Signal Processing, 06 February 2020

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[248] arXiv:2107.06195 (cross-list from cs.LG) [pdf, other]

Title: Transfer Learning in Multi-Agent Reinforcement Learning with Double Q-Networks for Distributed Resource Sharing in V2X Communication

Hammad Zafar, Zoran Utkovski, Martin Kasparick, Slawomir Stanczak

Comments: Submitted for publication

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP)

[249] arXiv:2107.06406 (cross-list from quant-ph) [pdf, other]

Title: A Theoretical Framework for Learning from Quantum Data

Mohsen Heidari, Arun Padakandla, Wojciech Szpankowski

Journal-ref: IEEE International Symposium on Information Theory (ISIT), 2021

Subjects: Quantum Physics (quant-ph); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT)

[250] arXiv:2107.06767 (cross-list from math.ST) [pdf, other]

Title: Correlated Stochastic Block Models: Exact Graph Matching with Applications to Recovering Communities

Miklos Z. Racz, Anirudh Sridhar

Comments: 42 pages, 4 figures

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Probability (math.PR)