Information Theory

Authors and titles for October 2024

[201] arXiv:2410.01374 (cross-list from math.OC) [pdf, html, other]

Title: Newton Meets Marchenko-Pastur: Massively Parallel Second-Order Optimization with Hessian Sketching and Debiasing

Elad Romanov, Fangzhao Zhang, Mert Pilanci

Subjects: Optimization and Control (math.OC); Information Theory (cs.IT); Signal Processing (eess.SP); Machine Learning (stat.ML)

[202] arXiv:2410.01444 (cross-list from cs.CL) [pdf, html, other]

Title: Geometric Signatures of Compositionality Across a Language Model's Lifetime

Jin Hwa Lee, Thomas Jiralerspong, Lei Yu, Yoshua Bengio, Emily Cheng

Comments: Under review at ARR

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[203] arXiv:2410.01673 (cross-list from quant-ph) [pdf, html, other]

Title: MaxSAT decoders for arbitrary CSS codes

Mohammadreza Noormandipour, Tobias Haug

Comments: 11 pages including appendix, 7 figures

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[204] arXiv:2410.02450 (cross-list from cs.LG) [pdf, html, other]

Title: Personalized Federated Learning for Generative AI-Assisted Semantic Communications

Yubo Peng, Feibo Jiang, Li Dong, Kezhi Wang, Kun Yang

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[205] arXiv:2410.02575 (cross-list from cs.CR) [pdf, html, other]

Title: Assessing the Viability of Synthetic Physical Copy Detection Patterns on Different Imaging Systems

Roman Chaban, Brian Pulfer, Slava Voloshynovskiy

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)

[206] arXiv:2410.02583 (cross-list from quant-ph) [pdf, html, other]

Title: Sample-Optimal Quantum State Tomography for Structured Quantum States in One Dimension

Zhen Qin, Casey Jameson, Alireza Goldar, Michael B. Wakin, Zhexuan Gong, Zhihui Zhu

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Signal Processing (eess.SP); Optimization and Control (math.OC)

[207] arXiv:2410.02686 (cross-list from quant-ph) [pdf, html, other]

Title: Optimal continuity bound for the von Neumann entropy under energy constraints

S.Becker, N.Datta, M.G.Jabbour, M.E.Shirokov

Comments: 15 pages, any comments are still welcome

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Mathematical Physics (math-ph)

[208] arXiv:2410.02733 (cross-list from cs.LG) [pdf, html, other]

Title: Data Similarity-Based One-Shot Clustering for Multi-Task Hierarchical Federated Learning

Abdulmoneam Ali, Ahmed Arafa

Comments: To appear in Asilomar 2024

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI); Signal Processing (eess.SP)

[209] arXiv:2410.02775 (cross-list from eess.SP) [pdf, html, other]

Title: A Deep Learning Approach for User-Centric Clustering in Cell-Free Massive MIMO Systems

Giovanni Di Gennaro, Amedeo Buonanno, Gianmarco Romano, Stefano Buzzi, Francesco A.N Palmieri

Comments: Accepted to 25th IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), 2024

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)

[210] arXiv:2410.02796 (cross-list from eess.SP) [pdf, html, other]

Title: Toward Adaptive Tracking and Communication via an Airborne Maneuverable Bi-Static ISAC System

Mingliang Wei, Ruoguang Li, Li Wang, Lianming Xu, Zhu Han

Subjects: Signal Processing (eess.SP); Emerging Technologies (cs.ET); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI)

[211] arXiv:2410.02833 (cross-list from stat.ML) [pdf, other]

Title: Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization

Francisco Daunas, Iñaki Esnaola, Samir M. Perlaza, H. Vincent Poor

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[212] arXiv:2410.02890 (cross-list from cs.CR) [pdf, html, other]

Title: Theoretically Grounded Framework for LLM Watermarking: A Distribution-Adaptive Approach

Haiyun He, Yepeng Liu, Ziqiao Wang, Yongyi Mao, Yuheng Bu

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT); Machine Learning (cs.LG)

[213] arXiv:2410.02983 (cross-list from cs.RO) [pdf, html, other]

Title: Information-Driven Search and Track of Novel Space Objects

Trevor N. Wolf, Brandon A. Jones

Comments: Submitted to the Journal of Astronautical Sciences

Subjects: Robotics (cs.RO); Information Theory (cs.IT); Systems and Control (eess.SY)

[214] arXiv:2410.03395 (cross-list from physics.bio-ph) [pdf, html, other]

Title: Receptors cluster in high-curvature membrane regions for optimal spatial gradient sensing

Albert Alonso, Robert G. Endres, Julius B. Kirkegaard

Journal-ref: Phys. Rev. Lett. 134, 158401 (2025)

Subjects: Biological Physics (physics.bio-ph); Soft Condensed Matter (cond-mat.soft); Information Theory (cs.IT); Cell Behavior (q-bio.CB)

[215] arXiv:2410.03459 (cross-list from cs.SD) [pdf, html, other]

Title: Generative Semantic Communication for Text-to-Speech Synthesis

Jiahao Zheng, Jinke Ren, Peng Xu, Zhihao Yuan, Jie Xu, Fangxin Wang, Gui Gui, Shuguang Cui

Comments: The paper has been accepted by IEEE Globecom Workshop

Subjects: Sound (cs.SD); Information Theory (cs.IT); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[216] arXiv:2410.03562 (cross-list from quant-ph) [pdf, html, other]

Title: Class of codes correcting absorptions and emissions

Arda Aydin, Alexander Barg

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[217] arXiv:2410.03674 (cross-list from cs.NI) [pdf, other]

Title: Trends, Advancements and Challenges in Intelligent Optimization in Satellite Communication

Philippe Krajsic, Viola Suess, Zehong Cao, Ryszard Kowalczyk, Bogdan Franczyk

Comments: 10 pages, 2 figures, 3 tables

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT); Machine Learning (cs.LG); Signal Processing (eess.SP)

[218] arXiv:2410.03972 (cross-list from cs.LG) [pdf, html, other]

Title: Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networks

Ann Huang, Satpreet H. Singh, Kanaka Rajan

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Neural and Evolutionary Computing (cs.NE); Neurons and Cognition (q-bio.NC)

[219] arXiv:2410.05078 (cross-list from cs.LG) [pdf, html, other]

Title: Compression via Pre-trained Transformers: A Study on Byte-Level Multimodal Data

David Heurtel-Depeiges, Anian Ruoss, Joel Veness, Tim Genewein

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[220] arXiv:2410.05117 (cross-list from cs.LG) [pdf, html, other]

Title: Assouad, Fano, and Le Cam with Interaction: A Unifying Lower Bound Framework and Characterization for Bandit Learnability

Fan Chen, Dylan J. Foster, Yanjun Han, Jian Qian, Alexander Rakhlin, Yunbei Xu

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)

[221] arXiv:2410.05493 (cross-list from cs.LG) [pdf, html, other]

Title: Transformers learn variable-order Markov chains in-context

Ruida Zhou, Chao Tian, Suhas Diggavi

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[222] arXiv:2410.05646 (cross-list from cs.LG) [pdf, html, other]

Title: Score-Based Variational Inference for Inverse Problems

Zhipeng Xue, Penghao Cai, Xiaojun Yuan, Xiqi Gao

Comments: 10 pages, 7 figures, conference

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[223] arXiv:2410.05734 (cross-list from cs.LG) [pdf, html, other]

Title: Diminishing Exploration: A Minimalist Approach to Piecewise Stationary Multi-Armed Bandits

Kuan-Ta Li, Ping-Chun Hsieh, Yu-Chih Huang

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[224] arXiv:2410.05844 (cross-list from eess.SY) [pdf, html, other]

Title: Spectrally Efficient LDPC Codes For IRIG-106 Waveforms via Random Puncturing

Andrew D. Cummins, David G. M. Mitchell, Erik Perrins

Comments: Accepted for inclusion in the 2024 International Telemetry Conference

Subjects: Systems and Control (eess.SY); Information Theory (cs.IT); Signal Processing (eess.SP)

[225] arXiv:2410.05911 (cross-list from cs.LG) [pdf, html, other]

Title: Accelerating Error Correction Code Transformers

Matan Levy, Yoni Choukroun, Lior Wolf

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)