Information Theory

Authors and titles for October 2024

[301] arXiv:2410.19866 (cross-list from physics.data-an) [pdf, html, other]

Title: A totally empirical basis of science

Orestis Loukas, Ho-Ryun Chung

Comments: Main Article and Supplementary Material, 1 Table, 2 Figures

Subjects: Data Analysis, Statistics and Probability (physics.data-an); Information Theory (cs.IT)

[302] arXiv:2410.19917 (cross-list from cs.CR) [pdf, html, other]

Title: Collaborative Inference over Wireless Channels with Feature Differential Privacy

Mohamed Seif, Yuqi Nie, Andrea J. Goldsmith, H. Vincent Poor

Comments: This work is under review for possible IEEE publication. arXiv admin note: substantial text overlap with arXiv:2406.00256

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT); Machine Learning (cs.LG)

[303] arXiv:2410.20332 (cross-list from cs.ET) [pdf, other]

Title: The maximum storage capacity of open-loop written RRAM is around 4 bits

Yongxiang Li, Shiqing Wang, Zhong Sun

Comments: This work has been presented at the conference ICSICT 2024

Subjects: Emerging Technologies (cs.ET); Hardware Architecture (cs.AR); Information Theory (cs.IT)

[304] arXiv:2410.20344 (cross-list from eess.SP) [pdf, html, other]

Title: Deep Learning-Assisted Jamming Mitigation with Movable Antenna Array

Xiao Tang, Yudan Jiang, Jinxin Liu, Qinghe Du, Dusit Niyato, Zhu Han

Comments: Accepted @ IEEE TVT

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[305] arXiv:2410.20646 (cross-list from stat.ML) [pdf, html, other]

Title: Injectivity capacity of ReLU gates

Mihailo Stojnic

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Theory (cs.IT); Machine Learning (cs.LG)

[306] arXiv:2410.21020 (cross-list from eess.SP) [pdf, html, other]

Title: Performance of User-Assisted Nonlinear Energy Harvesting NOMA Network with Alamouti/MRC

Büşra Demirkol, Oğuz Kucur

Comments: 6 pages, 5 figures

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[307] arXiv:2410.21124 (cross-list from quant-ph) [pdf, html, other]

Title: Quantum channel coding: Approximation algorithms and strong converse exponents

Aadil Oufkir, Mario Berta

Comments: 27+4 pages, 1 Figure

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[308] arXiv:2410.21192 (cross-list from cs.CR) [pdf, html, other]

Title: On Homomorphic Encryption Based Strategies for Class Imbalance in Federated Learning

Arpit Guleria, J. Harshan, Ranjitha Prasad, B. N. Bharath

Comments: Accepted for Presentation at CODS COMAD 2024

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT); Machine Learning (cs.LG)

[309] arXiv:2410.21201 (cross-list from quant-ph) [pdf, html, other]

Title: Sample-Optimal Quantum Estimators for Pure-State Trace Distance and Fidelity via Samplizer

Qisheng Wang, Zhicheng Zhang

Comments: 24 pages, 3 figures, 1 table, 1 algorithm

Subjects: Quantum Physics (quant-ph); Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT)

[310] arXiv:2410.21393 (cross-list from quant-ph) [pdf, html, other]

Title: Extendibility limits quantum-secured communication and key distillation

Vishal Singh, Mark M. Wilde

Comments: 50+30 pages, 9 figures

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[311] arXiv:2410.21548 (cross-list from cs.CL) [pdf, html, other]

Title: MultiTok: Variable-Length Tokenization for Efficient LLMs Adapted from LZW Compression

Noel Elias, Homa Esfahanizadeh, Kaan Kale, Sriram Vishwanath, Muriel Medard

Subjects: Computation and Language (cs.CL); Information Theory (cs.IT); Machine Learning (cs.LG)

[312] arXiv:2410.21666 (cross-list from cs.LG) [pdf, html, other]

Title: Minimum Entropy Coupling with Bottleneck

M.Reza Ebrahimi, Jun Chen, Ashish Khisti

Comments: 38th Conference on Neural Information Processing Systems (NeurIPS 2024) - Spotlight

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[313] arXiv:2410.21782 (cross-list from eess.SP) [pdf, html, other]

Title: Optimal Power Allocation and Time Sharing in Low Rank Multi-carrier Wi-Fi Channels

Sagnik Bhattacharya, Kamyar Rajabalifardi, Muhammad Ahmed Mohsin, Rohan Pote, John M. Cioffi

Comments: IEEE GLOBECOM 2024

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[314] arXiv:2410.21786 (cross-list from eess.SP) [pdf, html, other]

Title: Scaling 6G Subscribers with Fewer BS Antennas using Multi-carrier NOMA in Fixed Wireless Access

Kamyar Rajabalifardi, Sagnik Bhattacharya, Mehrnaz Afshang, Mohammad Mozaffari, John M. Cioffi

Comments: IEEE GLOBECOM 2024

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[315] arXiv:2410.21937 (cross-list from math.CO) [pdf, html, other]

Title: On the number of relevant variables for discrete functions

V. N. Potapov

Subjects: Combinatorics (math.CO); Information Theory (cs.IT)

[316] arXiv:2410.22192 (cross-list from cs.LG) [pdf, html, other]

Title: $r$Age-$k$: Communication-Efficient Federated Learning Using Age Factor

Matin Mortaheb, Priyanka Kaswan, Sennur Ulukus

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP); Machine Learning (stat.ML)

[317] arXiv:2410.22354 (cross-list from eess.SP) [pdf, html, other]

Title: Solve Mismatch Problem in Compressed Sensing

Le Yang

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[318] arXiv:2410.22746 (cross-list from eess.SP) [pdf, html, other]

Title: Unauthorized UAV Countermeasure for Low-Altitude Economy: Joint Communications and Jamming based on MIMO Cellular Systems

Zhuoran Li, Zhen Gao, Kuiyu Wang, Yikun Mei, Chunli Zhu, Lei Chen, Xiaomei Wu, Dusit Niyato

Comments: The paper has been accepted by IEEE IoTJ, and the code is available for result reproduction

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[319] arXiv:2410.22784 (cross-list from cs.LG) [pdf, html, other]

Title: Contrastive Learning and Adversarial Disentanglement for Privacy-Preserving Task-Oriented Semantic Communications

Omar Erak, Omar Alhussein, Wen Tong

Comments: Submitted to EEE Journal on Selected Areas in Communications (JSAC): Intelligent Communications for Real-Time Computer Vision (Comm4CV)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Image and Video Processing (eess.IV)

[320] arXiv:2410.22887 (cross-list from stat.ML) [pdf, html, other]

Title: Generalization Bounds via Conditional $f$-Information

Ziqiao Wang, Yongyi Mao

Comments: Accepted at NeurIPS 2024

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[321] arXiv:2410.23097 (cross-list from math.NT) [pdf, html, other]

Title: A proof of a conjecture on trivariate permutations

Daniele Bartoli, Mohit Pal, Pantelimon Stanica, Tommaso Toccotelli

Subjects: Number Theory (math.NT); Information Theory (cs.IT); Algebraic Geometry (math.AG); Combinatorics (math.CO)

[322] arXiv:2410.23263 (cross-list from quant-ph) [pdf, other]

Title: Computation with quantum Reed-Muller codes and their mapping onto 2D atom arrays

Anqi Gong, Joseph M. Renes

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[323] arXiv:2410.23470 (cross-list from eess.SP) [pdf, other]

Title: Advancing Free-Space Optical Communication System Architecture: Performance Analysis of Varied Optical Ground Station Network Configurations

Eugene Rotherham, Connor Casey, Eva Fernandez Rodriguez, Karen Wendy Vidaurre Torrez, Maren Mashor, Isaac Pike

Comments: 24 pages, 15 figures, Published at IAC '24 & the code is available at this https URL

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)

[324] arXiv:2410.23611 (cross-list from math.CO) [pdf, html, other]

Title: Focal-free uniform hypergraphs and codes

Xinqi Huang, Chong Shangguan, Xiande Zhang, Yuhao Zhao

Subjects: Combinatorics (math.CO); Information Theory (cs.IT)

[325] arXiv:2410.23996 (cross-list from cs.LG) [pdf, html, other]

Title: An Information Criterion for Controlled Disentanglement of Multimodal Data

Chenyu Wang, Sharut Gupta, Xinyi Zhang, Sana Tonekaboni, Stefanie Jegelka, Tommi Jaakkola, Caroline Uhler

Comments: ICLR 2025

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[326] arXiv:2410.24127 (cross-list from quant-ph) [pdf, html, other]

Title: More global randomness from less random local gates

Ryotaro Suzuki, Hosho Katsura, Yosuke Mitsuhashi, Tomohiro Soejima, Jens Eisert, Nobuyuki Yoshioka

Comments: 35 pages, 5 figures

Subjects: Quantum Physics (quant-ph); Strongly Correlated Electrons (cond-mat.str-el); Information Theory (cs.IT)