Information Theory

Authors and titles for July 2021

[201] arXiv:2107.14163 [pdf, other]

Title: Achievable Regions and Precoder Designs for the Multiple Access Wiretap Channels with Confidential and Open Messages

Hao Xu, Tianyu Yang, Kai-Kit Wong, Giuseppe Caire

Comments: 19 pages, 12 figures

Subjects: Information Theory (cs.IT)

[202] arXiv:2107.14218 [pdf, other]

Title: Gossiping with Binary Freshness Metric

Melih Bastopcu, Baturalp Buyukates, Sennur Ulukus

Subjects: Information Theory (cs.IT); Networking and Internet Architecture (cs.NI); Signal Processing (eess.SP)

[203] arXiv:2107.14264 [pdf, other]

Title: An Information-Theoretic Approach to Joint Sensing and Communication

Mehrasa Ahmadipour, Mari Kobayashi, Miche`le Wigger, Giuseppe Caire

Subjects: Information Theory (cs.IT)

[204] arXiv:2107.14270 [pdf, other]

Title: Secure Swarm UAV-assisted Communications with Cooperative Friendly Jamming

Hanh Dang-Ngoc, Diep N. Nguyen, Khuong Ho-Van, Dinh Thai Hoang, Eryk Dutkiewicz, Quoc-Viet Pham, Won-Joo Hwang

Comments: 30 pages, 7 figures, journal

Subjects: Information Theory (cs.IT); Signal Processing (eess.SP)

[205] arXiv:2107.14396 [pdf, other]

Title: Combined Radar and Communications with Phase-Modulated Frequency Permutations

Tian Han, Rajitha Senanayake, Peter Smith, Jamie Evans, William Moran, Robin Evans

Journal-ref: IEEE Open Journal of the Communications Society, vol. 4, pp. 967-989, 2023

Subjects: Information Theory (cs.IT); Signal Processing (eess.SP)

[206] arXiv:2107.14404 [pdf, other]

Title: Towards Efficient Large-Scale Network Slicing: An LP Dynamic Rounding-and-Refinement Approach

Wei-Kun Chen, Ya-Feng Liu, Fan Liu, Yu-Hong Dai, Zhi-Quan Luo

Comments: 16 pages, 8 figures, accepted for publication in the IEEE Transactions on Signal Processing. arXiv admin note: text overlap with arXiv:2102.02563

Subjects: Information Theory (cs.IT); Signal Processing (eess.SP); Optimization and Control (math.OC)

[207] arXiv:2107.14576 [pdf, other]

Title: On weight spectrum of linear codes

Vladimir N. Potapov

Journal-ref: Proceedings of 2021 XVII International Symposium on Problems of Redundancy in Information and Control Systems

Subjects: Information Theory (cs.IT); Combinatorics (math.CO)

[208] arXiv:2107.14577 [pdf, other]

Title: Fast direct access to variable length codes

Boris Ryabko

Subjects: Information Theory (cs.IT); Data Structures and Algorithms (cs.DS)

[209] arXiv:2107.14583 [pdf, other]

Title: An Upper Bound on the Number of Bent Functions

Vladimir N. Potapov

Journal-ref: Proceedings of 2021 XVII International Symposium on Problems of Redundancy in Information and Control Systems

Subjects: Information Theory (cs.IT)

[210] arXiv:2107.14669 [pdf, other]

Title: Representing preorders with injective monotones

Pedro Hack, Daniel A. Braun, Sebastian Gottwald

Subjects: Information Theory (cs.IT)

[211] arXiv:2107.00314 (cross-list from cs.DS) [pdf, other]

Title: Backtracking (the) Algorithms on the Hamiltonian Cycle Problem

Joeri Sleegers, Daan van den Berg

Comments: Peer-reviewed and published in IARIA journals

Subjects: Data Structures and Algorithms (cs.DS); Computational Complexity (cs.CC); Information Theory (cs.IT)

[212] arXiv:2107.00392 (cross-list from quant-ph) [pdf, other]

Title: Coherent information of a quantum channel or its complement is generically positive

Satvik Singh, Nilanjana Datta

Comments: Minor modifications with updated references

Journal-ref: Quantum 6, 775 (2022)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Mathematical Physics (math-ph)

[213] arXiv:2107.00838 (cross-list from cs.LG) [pdf, other]

Title: RL-NCS: Reinforcement learning based data-driven approach for nonuniform compressed sensing

Nazmul Karim, Alireza Zaeemzadeh, Nazanin Rahnavard

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP)

[214] arXiv:2107.00990 (cross-list from cond-mat.stat-mech) [pdf, other]

Title: Minimizing couplings in renormalization by preserving short-range mutual information

Christian Bertoni, Joseph M. Renes

Comments: 5 pages, 4 figures

Journal-ref: J. Phys. A 55, 375004 (2022)

Subjects: Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT)

[215] arXiv:2107.01131 (cross-list from stat.ML) [pdf, other]

Title: Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization

Qing Guo, Junya Chen, Dong Wang, Yuewei Yang, Xinwei Deng, Lawrence Carin, Fan Li, Jing Huang, Chenyang Tao

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[216] arXiv:2107.01152 (cross-list from stat.ML) [pdf, other]

Title: Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE

Junya Chen, Zhe Gan, Xuan Li, Qing Guo, Liqun Chen, Shuyang Gao, Tagyoung Chung, Yi Xu, Belinda Zeng, Wenlian Lu, Fan Li, Lawrence Carin, Chenyang Tao

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG)

[217] arXiv:2107.01274 (cross-list from eess.SP) [pdf, other]

Title: Unbiasing Procedures for Scale-invariant Multi-reference Alignment

Matthew Hirn, Anna Little

Comments: 12 pages, 5 figures. Code reproducing numerical results at this https URL

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[218] arXiv:2107.01305 (cross-list from math.ST) [pdf, other]

Title: Maximum likelihood for high-noise group orbit estimation and single-particle cryo-EM

Zhou Fan, Roy R. Lederman, Yi Sun, Tianhao Wang, Sheng Xu

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Optimization and Control (math.OC)

[219] arXiv:2107.01410 (cross-list from cs.LG) [pdf, other]

Title: Maximum Entropy Weighted Independent Set Pooling for Graph Neural Networks

Amirhossein Nouranizadeh, Mohammadjavad Matinkia, Mohammad Rahmati, Reza Safabakhsh

Comments: 21 pages, 12 figures, under review in 35th Conference on Neural Information Processing Systems (NeurIPS 2021)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Neural and Evolutionary Computing (cs.NE)

[220] arXiv:2107.01458 (cross-list from quant-ph) [pdf, other]

Title: Quantum Error Mitigation Relying on Permutation Filtering

Yifeng Xiong, Soon Xin Ng, Lajos Hanzo

Journal-ref: IEEE Transactions on Communications, 70(3), 2022

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[221] arXiv:2107.01816 (cross-list from quant-ph) [pdf, other]

Title: Sets of Marginals and Pearson-Correlation-based CHSH Inequalities for a Two-Qubit System

Yuwen Huang, Pascal O. Vontobel

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[222] arXiv:2107.01952 (cross-list from cs.LG) [pdf, other]

Title: Partition and Code: learning how to compress graphs

Giorgos Bouritsas, Andreas Loukas, Nikolaos Karalias, Michael M. Bronstein

Comments: Published at NeurIPS 2021

Journal-ref: Proc. Adv. Neur. Inf. Process. Syst. (NeurIPS) vol. 34 pp. 18603 - 18619 (2021)

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[223] arXiv:2107.02027 (cross-list from cs.CL) [pdf, other]

Title: Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance

Mario Michael Krell, Matej Kosec, Sergio P. Perez, Andrew Fitzgibbon

Comments: Significantly new version with different authors and much more content. Much larger variety in experiments and exhaustive SOTA analysis

Subjects: Computation and Language (cs.CL); Computational Complexity (cs.CC); Information Theory (cs.IT); Machine Learning (cs.LG)

[224] arXiv:2107.02520 (cross-list from eess.SP) [pdf, other]

Title: Deep Learning Methods for Joint Optimization of Beamforming and Fronthaul Quantization in Cloud Radio Access Networks

Daesung Yu, Hoon Lee, Seok-Hwan Park, Seung-Eun Hong

Comments: accepted for publication on IEEE Wireless Communications Letters

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)

[225] arXiv:2107.02565 (cross-list from cs.LG) [pdf, other]

Title: Prioritized training on points that are learnable, worth learning, and not yet learned (workshop version)

Sören Mindermann, Muhammed Razzak, Winnie Xu, Andreas Kirsch, Mrinank Sharma, Adrien Morisot, Aidan N. Gomez, Sebastian Farquhar, Jan Brauner, Yarin Gal

Journal-ref: ICML 2021 Workshop on Subset Selection in Machine Learning

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)