Information Theory

Authors and titles for October 2024

[251] arXiv:2410.09703 (cross-list from quant-ph) [pdf, html, other]

Title: Universal scaling laws in quantum-probabilistic machine learning by tensor network towards interpreting representation and generalization powers

Sheng-Chen Bai, Shi-Ju Ran

Comments: 5 pages (main text) + 3 pages (appendices), 5 figures (main text) + 4 figures (appendices)

Journal-ref: Chinese Physics Letters 41, 120701 (2024)

Subjects: Quantum Physics (quant-ph); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[252] arXiv:2410.10024 (cross-list from cs.LG) [pdf, html, other]

Title: Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods

Hossein Taheri, Christos Thrampoulidis, Arya Mazumdar

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[253] arXiv:2410.10147 (cross-list from math.PR) [pdf, html, other]

Title: Local Optimality of Dictator Functions with Applications to Courtade--Kumar and Li--Médard Conjectures

Lei Yu

Comments: We correct and strength the bound in Theorem 3

Subjects: Probability (math.PR); Information Theory (cs.IT)

[254] arXiv:2410.10426 (cross-list from math.NT) [pdf, html, other]

Title: On Sum-Free Functions

Alyssa Ebeling, Xiang-dong Hou, Ashley Rydell, Shujun Zhao

Comments: 25 pages

Subjects: Number Theory (math.NT); Information Theory (cs.IT)

[255] arXiv:2410.10679 (cross-list from cs.LG) [pdf, html, other]

Title: Combinatorial Multi-armed Bandits: Arm Selection via Group Testing

Arpan Mukherjee, Shashanka Ubaru, Keerthiram Murugesan, Karthikeyan Shanmugam, Ali Tajer

Comments: 26 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (stat.ML)

[256] arXiv:2410.10699 (cross-list from math.ST) [pdf, html, other]

Title: Fast Convergence of $Φ$-Divergence Along the Unadjusted Langevin Algorithm and Proximal Sampler

Siddharth Mitra, Andre Wibisono

Comments: v2: Minor changes and reorganization. Accepted at ALT 2025

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (stat.ML)

[257] arXiv:2410.10737 (cross-list from cs.LG) [pdf, html, other]

Title: Asymptotic Analysis of Sample-averaged Q-learning

Saunak Kumar Panda, Ruiqi Liu, Yisha Xiang

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[258] arXiv:2410.10770 (cross-list from quant-ph) [pdf, html, other]

Title: Exponents for classical-quantum channel simulation in purified distance

Aadil Oufkir, Yongsheng Yao, Mario Berta

Comments: 27+5 pages

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[259] arXiv:2410.11151 (cross-list from stat.ME) [pdf, other]

Title: Discovering the critical number of respondents to validate an item in a questionnaire: The Binomial Cut-level Content Validity proposal

Helder Gomes Costa, Eduardo Shimoda, José Fabiano da Serra Costa, Aldo Shimoya, Edilvando Pereira Eufrazio

Comments: 17 pages, 1 figure

Subjects: Methodology (stat.ME); Information Theory (cs.IT); Applications (stat.AP)

[260] arXiv:2410.11179 (cross-list from cs.LG) [pdf, html, other]

Title: Interpretability as Compression: Reconsidering SAE Explanations of Neural Activations with MDL-SAEs

Kola Ayonrinde, Michael T. Pearce, Lee Sharkey

Comments: 8 pages, 5 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[261] arXiv:2410.11316 (cross-list from eess.SY) [pdf, html, other]

Title: Communication-Control Codesign for Large-Scale Wireless Networked Control Systems

Gaoyang Pang, Wanchun Liu, Dusit Niyato, Branka Vucetic, Yonghui Li

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Systems and Control (eess.SY); Information Theory (cs.IT); Machine Learning (cs.LG); Signal Processing (eess.SP)

[262] arXiv:2410.11778 (cross-list from cs.LG) [pdf, html, other]

Title: On the Training Convergence of Transformers for In-Context Classification of Gaussian Mixtures

Wei Shen, Ruida Zhou, Jing Yang, Cong Shen

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[263] arXiv:2410.11968 (cross-list from math.AG) [pdf, html, other]

Title: Codes on Weighted Projective Planes

Yağmur Çakıroğlu, Jade Nardi, Mesut Şahin

Subjects: Algebraic Geometry (math.AG); Information Theory (cs.IT)

[264] arXiv:2410.11980 (cross-list from cs.DS) [pdf, html, other]

Title: The Quasi-probability Method and Applications for Trace Reconstruction

Ittai Rubinstein

Comments: 26 pages, 0 figures

Subjects: Data Structures and Algorithms (cs.DS); Information Theory (cs.IT)

[265] arXiv:2410.12393 (cross-list from math.CO) [pdf, html, other]

Title: The geometry of covering codes in the sum-rank metric

Matteo Bonini, Martino Borello, Eimear Byrne

Subjects: Combinatorics (math.CO); Information Theory (cs.IT)

[266] arXiv:2410.12712 (cross-list from quant-ph) [pdf, html, other]

Title: On the sample complexity of purity and inner product estimation

Weiyuan Gong, Jonas Haferkamp, Qi Ye, Zhihan Zhang

Comments: 33 pages, 1 figure

Subjects: Quantum Physics (quant-ph); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG)

[267] arXiv:2410.12721 (cross-list from math.PR) [pdf, html, other]

Title: Geometry and Duality of Alternating Markov Chains

Deven Mithal, Lorenzo Orecchia

Subjects: Probability (math.PR); Information Theory (cs.IT)

[268] arXiv:2410.13938 (cross-list from quant-ph) [pdf, html, other]

Title: Photonic Simulation of Localization Phenomena Using Boson Sampling

Anuprita V. Kulkarni, Vatsana Tiwari, Auditya Sharma, Ankur Raina

Comments: 14 pages, 11 figures

Journal-ref: Phys. Rev. A 111, 032622 (2025)

Subjects: Quantum Physics (quant-ph); Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Theory (cs.IT)

[269] arXiv:2410.14168 (cross-list from eess.SY) [pdf, html, other]

Title: Elements of disinformation theory: cyber engagement via increasing adversary information consumption

Travis Cuvelier, Sean Ha, Maretta Morovitz

Comments: 8 pages, 5 figures, to appear in the Proceedings of the 2024 IEEE MILCOM Workshop on Threat Informed Defense Technologies

Subjects: Systems and Control (eess.SY); Cryptography and Security (cs.CR); Information Theory (cs.IT); Optimization and Control (math.OC)

[270] arXiv:2410.14215 (cross-list from eess.SP) [pdf, html, other]

Title: Jamming Detection and Channel Estimation for Spatially Correlated Beamspace Massive MIMO

Pengguang Du, Cheng Zhang, Yindi Jing, Chao Fang, Zhilei Zhang, Yongming Huang

Comments: 13 pages, 9 figures. The paper has been submitted to an IEEE journal for possible publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[271] arXiv:2410.14547 (cross-list from quant-ph) [pdf, html, other]

Title: Surpassing the fundamental limits of distillation with catalysts

Kun Fang, Zi-Wen Liu

Comments: 13 pages, 3 figures; comments are welcome

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[272] arXiv:2410.14599 (cross-list from astro-ph.IM) [pdf, html, other]

Title: Bayesian Multi-wavelength Imaging of the LMC SN1987A with SRG/eROSITA

Vincent Eberle, Matteo Guardiani, Margret Westerkamp, Philipp Frank, Michael Freyberg, Mara Salvato, Torsten Enßlin

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); High Energy Astrophysical Phenomena (astro-ph.HE); Information Theory (cs.IT); Data Analysis, Statistics and Probability (physics.data-an)

[273] arXiv:2410.14615 (cross-list from stat.ML) [pdf, html, other]

Title: Asymptotically Optimal Change Detection for Unnormalized Pre- and Post-Change Distributions

Arman Adibi, Sanjeev Kulkarni, H. Vincent Poor, Taposh Banerjee, Vahid Tarokh

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG); Signal Processing (eess.SP)

[274] arXiv:2410.14631 (cross-list from quant-ph) [pdf, html, other]

Title: Transversal non-Clifford gates for quantum LDPC codes on sheaves

Ting-Chun Lin

Subjects: Quantum Physics (quant-ph); Computational Complexity (cs.CC); Information Theory (cs.IT)

[275] arXiv:2410.14662 (cross-list from quant-ph) [pdf, other]

Title: Quantum LDPC Codes with Transversal Non-Clifford Gates via Products of Algebraic Codes

Louis Golowich, Ting-Chun Lin

Subjects: Quantum Physics (quant-ph); Computational Complexity (cs.CC); Information Theory (cs.IT)

[276] arXiv:2410.15358 (cross-list from eess.SP) [pdf, html, other]

Title: A New Adaptive Balanced Augmented Lagrangian Method with Application to ISAC Beamforming Design

Jiageng Wu, Bo Jiang, Xinxin Li, Ya-Feng Liu, Jianhua Yuan

Comments: 7 pages, 1 table

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Optimization and Control (math.OC)

[277] arXiv:2410.15502 (cross-list from math.CO) [pdf, html, other]

Title: Attempting the impossible: enumerating extremal submodular functions for n=6

Elod P. Csirmaz, Laszlo Csirmaz

Subjects: Combinatorics (math.CO); Information Theory (cs.IT)

[278] arXiv:2410.15546 (cross-list from cs.NI) [pdf, html, other]

Title: Improved Contact Graph Routing in Delay Tolerant Networks with Capacity and Buffer Constraints

Tania Alhajj, Vincent Corlay

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[279] arXiv:2410.15563 (cross-list from math.LO) [pdf, html, other]

Title: Variants of Solovay reducibility

Ivan Titov

Comments: submitted for a conference

Subjects: Logic (math.LO); Information Theory (cs.IT); Logic in Computer Science (cs.LO)

[280] arXiv:2410.15888 (cross-list from stat.ML) [pdf, html, other]

Title: Conditional Dependence via U-Statistics Pruning

Ferran de Cabrera, Marc Vilà-Insa, Jaume Riba

Comments: Accepted version of the article published in IEEE Signal Processing Letters, 2025. DOI: https://doi.org/10.1109/LSP.2025.3539587

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT)

[281] arXiv:2410.16013 (cross-list from cs.LG) [pdf, html, other]

Title: Information-Theoretic Minimax Regret Bounds for Reinforcement Learning based on Duality

Raghav Bongole, Amaury Gouverneur, Borja Rodríguez-Gálvez, Tobias J. Oechtering, Mikael Skoglund

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[282] arXiv:2410.16362 (cross-list from quant-ph) [pdf, html, other]

Title: Semidefinite optimization of the quantum relative entropy of channels

Gereon Koßmann, Mark M. Wilde

Comments: 13 pages

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[283] arXiv:2410.16377 (cross-list from stat.ML) [pdf, html, other]

Title: A Simple Model of Inference Scaling Laws

Noam Levi

Comments: 12 pages, 7 figures

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[284] arXiv:2410.16660 (cross-list from math.MG) [pdf, html, other]

Title: Difficulties Constructing Lattices with Exponential Kissing Number from Codes

Huck Bennett, Alexander Golovnev, Noah Stephens-Davidowitz

Subjects: Metric Geometry (math.MG); Information Theory (cs.IT); Number Theory (math.NT)

[285] arXiv:2410.16692 (cross-list from stat.ML) [pdf, html, other]

Title: Lower Bounds for Time-Varying Kernelized Bandits

Xu Cai, Jonathan Scarlett

Comments: AISTATS 2025

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[286] arXiv:2410.16704 (cross-list from quant-ph) [pdf, html, other]

Title: Resolvability of classical-quantum channels

Masahito Hayashi, Hao-Chung Cheng, Li Gao

Comments: 20 pages, 3 figures. Comments are welcome!

Subjects: Quantum Physics (quant-ph); Emerging Technologies (cs.ET); Information Theory (cs.IT)

[287] arXiv:2410.16813 (cross-list from cs.LG) [pdf, html, other]

Title: Klein Model for Hyperbolic Neural Networks

Yidan Mao, Jing Gu, Marcus C. Werner, Dongmian Zou

Comments: Accepted to NeurIPS 2024 Symmetry and Geometry in Neural Representations Workshop

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[288] arXiv:2410.17000 (cross-list from cs.CR) [pdf, html, other]

Title: Beyond Yao's Millionaires: Secure Multi-Party Computation of Non-Polynomial Functions

Seyed Reza Hoseini Najarkolaei, Mohammad Mahdi Mojahedian, Mohammad Reza Aref

Comments: 11 pages, 4 figures

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[289] arXiv:2410.17259 (cross-list from cs.NI) [pdf, html, other]

Title: Large Language Models for Knowledge-Free Network Management: Feasibility Study and Opportunities

Hoon Lee, Mintae Kim, Seunghwan Baek, Namyoon Lee, Merouane Debbah, Inkyu Lee

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT); Machine Learning (cs.LG)

[290] arXiv:2410.17367 (cross-list from physics.soc-ph) [pdf, html, other]

Title: Generalizing Geometric Partition Entropy for the Estimation of Mutual Information in the Presence of Informative Outliers

C. Tyler Diggans, Abd AlRahman R. AlMomani

Subjects: Physics and Society (physics.soc-ph); Information Theory (cs.IT); Chaotic Dynamics (nlin.CD)

[291] arXiv:2410.17908 (cross-list from quant-ph) [pdf, other]

Title: Fully smooth one shot multipartite soft covering of quantum states without pairwise independence

Pranab Sen

Comments: 53 pages

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[292] arXiv:2410.18005 (cross-list from math.NA) [pdf, html, other]

Title: Random space-time sampling and reconstruction of sparse bandlimited graph diffusion field

Longxiu Huang, Dongyang Li, Sui Tang, Qing Yao

Comments: 23 pages

Subjects: Numerical Analysis (math.NA); Information Theory (cs.IT)

[293] arXiv:2410.18075 (cross-list from cs.LG) [pdf, html, other]

Title: ProFL: Performative Robust Optimal Federated Learning

Xue Zheng, Tian Xie, Xuwei Tan, Aylin Yener, Xueru Zhang, Ali Payani, Myungjin Lee

Comments: 27 pages with Appendix, 18 figures. The paper has been submitted and is currently under review

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[294] arXiv:2410.18116 (cross-list from eess.SP) [pdf, html, other]

Title: Reconstruction with prior support information and non-Gaussian constraints

Xiaotong Liu, Yiyu Liang

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Classical Analysis and ODEs (math.CA)

[295] arXiv:2410.18234 (cross-list from cs.CL) [pdf, html, other]

Title: Multi-Draft Speculative Sampling: Canonical Architectures and Theoretical Limits

Ashish Khisti, M.Reza Ebrahimi, Hassan Dbouk, Arash Behboodi, Roland Memisevic, Christos Louizos

Subjects: Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Machine Learning (cs.LG)

[296] arXiv:2410.18254 (cross-list from quant-ph) [pdf, html, other]

Title: Refining Ky Fan's majorization relation with linear programming

Mohammad A. Alhejji

Comments: 36 pages, 2 figures, error in version 1 corrected

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Rings and Algebras (math.RA)

[297] arXiv:2410.18757 (cross-list from eess.SP) [pdf, html, other]

Title: Sliding DFT-based Signal Recovery for Modulo ADC with 1-bit Folding Information

Neil Irwin Bernardo

Comments: 11 pages, 7 figures, this work has been submitted to the IEEE for possible publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[298] arXiv:2410.19454 (cross-list from math.CO) [pdf, html, other]

Title: On combinatorial descriptions of faces of the cone of supermodular functions

Milan Studený

Comments: 47 pages

Subjects: Combinatorics (math.CO); Information Theory (cs.IT); Algebraic Geometry (math.AG); Metric Geometry (math.MG)

[299] arXiv:2410.19626 (cross-list from math.DG) [pdf, html, other]

Title: On warped product on information geometry: statistical manifolds and statistical models

Nicolás Martínez Alba, Olga Garatejo Escobar

Subjects: Differential Geometry (math.DG); Information Theory (cs.IT)

[300] arXiv:2410.19854 (cross-list from eess.SP) [pdf, html, other]

Title: Dynamic User Grouping based on Location and Heading in 5G NR Systems

Dino Pjanić, Korkut Emre Arslantürk, Xuesong Cai, Fredrik Tufvesson

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)