Machine Learning

Authors and titles for October 2024

[26] arXiv:2410.02833 [pdf, other]

Title: Asymmetry of the Relative Entropy in the Regularization of Empirical Risk Minimization

Francisco Daunas, Iñaki Esnaola, Samir M. Perlaza, H. Vincent Poor

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[27] arXiv:2410.02844 [pdf, html, other]

Title: CAnDOIT: Causal Discovery with Observational and Interventional Data from Time-Series

Luca Castri, Sariah Mghames, Marc Hanheide, Nicola Bellotto

Comments: Published in Advanced Intelligent Systems

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO)

[28] arXiv:2410.02935 [pdf, other]

Title: On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functions

Huy Nguyen, Xing Han, Carl Harris, Suchi Saria, Nhat Ho

Comments: Huy Nguyen and Xing Han contributed equally to this work

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[29] arXiv:2410.02979 [pdf, html, other]

Title: Optimization, Isoperimetric Inequalities, and Sampling via Lyapunov Potentials

August Y. Chen, Karthik Sridharan

Comments: 52 pages. New version with new results on Weak Poincaré Inequalities and improved presentation

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[30] arXiv:2410.03011 [pdf, html, other]

Title: Towards Understanding the Universality of Transformers for Next-Token Prediction

Michael E. Sander, Gabriel Peyré

Comments: ICLR 2025, 20 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[31] arXiv:2410.03098 [pdf, html, other]

Title: Forest Proximities for Time Series

Ben Shaw, Jake Rhodes, Soukaina Filali Boubrahimi, Kevin R. Moon

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[32] arXiv:2410.03191 [pdf, html, other]

Title: Nested Deep Learning Model Towards A Foundation Model for Brain Signal Data

Fangyi Wei, Jiajie Mo, Kai Zhang, Haipeng Shen, Srikantan Nagarajan, Fei Jiang

Comments: 43 pages; title modified; typo corrected

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[33] arXiv:2410.03221 [pdf, html, other]

Title: Learning to steer with Brownian noise

Stefan Ankirchner, Sören Christensen, Jan Kallsen, Philip Le Borne, Stefan Perko

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)

[34] arXiv:2410.03229 [pdf, html, other]

Title: Elucidating the Design Choice of Probability Paths in Flow Matching for Forecasting

Soon Hoe Lim, Yijin Wang, Annan Yu, Emma Hart, Michael W. Mahoney, Xiaoye S. Li, N. Benjamin Erichson

Comments: 33 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[35] arXiv:2410.03267 [pdf, html, other]

Title: Optimal Transport for $ε$-Contaminated Credal Sets: To the Memory of Sayan Mukherjee

Michele Caprio

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[36] arXiv:2410.03406 [pdf, html, other]

Title: Conformal confidence sets for biomedical image segmentation

Samuel Davenport

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[37] arXiv:2410.03581 [pdf, html, other]

Title: Nonstationary Sparse Spectral Permanental Process

Zicheng Sun, Yixuan Zhang, Zenan Ling, Xuhui Fan, Feng Zhou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[38] arXiv:2410.03651 [pdf, html, other]

Title: Minimax-optimal trust-aware multi-armed bandits

Changxiao Cai, Jiacheng Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[39] arXiv:2410.03974 [pdf, html, other]

Title: Robust Barycenter Estimation using Semi-Unbalanced Neural Optimal Transport

Milena Gazdieva, Jaemoo Choi, Alexander Kolesov, Jaewoong Choi, Petr Mokrov, Alexander Korotin

Comments: 30 pages, 7 figures

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[40] arXiv:2410.03988 [pdf, html, other]

Title: Implicit Bias of Mirror Flow for Shallow Neural Networks in Univariate Regression

Shuang Liang, Guido Montúfar

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[41] arXiv:2410.04037 [pdf, html, other]

Title: Is Score Matching Suitable for Estimating Point Processes?

Haoqun Cao, Zizhuo Meng, Tianjun Ke, Feng Zhou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[42] arXiv:2410.04058 [pdf, html, other]

Title: pFedGame -- Decentralized Federated Learning using Game Theory in Dynamic Topology

Monik Raj Behera, Suchetana Chakraborty

Journal-ref: 16th International Conference on COMmunication Systems & NETworkS (COMSNETS), Bengaluru, India, 2024, pp. 651-655

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG)

[43] arXiv:2410.04264 [pdf, html, other]

Title: Visualising Feature Learning in Deep Neural Networks by Diagonalizing the Forward Feature Map

Yoonsoo Nam, Chris Mingard, Seok Hyeong Lee, Soufiane Hayou, Ard Louis

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[44] arXiv:2410.04489 [pdf, html, other]

Title: Grokking at the Edge of Linear Separability

Alon Beck, Noam Levi, Yohai Bar-Sinai

Comments: 24 pages, 13 figures

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Mathematical Physics (math-ph)

[45] arXiv:2410.04760 [pdf, other]

Title: Stochastic Runge-Kutta Methods: Provable Acceleration of Diffusion Models

Yuchen Wu, Yuxin Chen, Yuting Wei

Comments: 45 pages, 3 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[46] arXiv:2410.05124 [pdf, html, other]

Title: Agnostic Smoothed Online Learning

Moïse Blanchard

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[47] arXiv:2410.05177 [pdf, other]

Title: Are causal effect estimations enough for optimal recommendations under multitreatment scenarios?

Sherly Alfonso-Sánchez, Kristina P. Sendova, Cristián Bravo

Comments: 34 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[48] arXiv:2410.05263 [pdf, html, other]

Title: Regression Conformal Prediction under Bias

Matt Y. Cheung, Tucker J. Netherton, Laurence E. Court, Ashok Veeraraghavan, Guha Balakrishnan

Comments: 17 pages, 6 figures, code available at: this https URL

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[49] arXiv:2410.05441 [pdf, other]

Title: Thompson Sampling For Combinatorial Bandits: Polynomial Regret and Mismatched Sampling Paradox

Raymond Zhang, Richard Combes

Comments: NeurIPS 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[50] arXiv:2410.05454 [pdf, html, other]

Title: Meta-Dynamical State Space Models for Integrative Neural Data Analysis

Ayesha Vermani, Josue Nassar, Hyungju Jeon, Matthew Dowling, Il Memming Park

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

[51] arXiv:2410.05552 [pdf, other]

Title: Optimal Adaptive Experimental Design for Estimating Treatment Effect

Jiachun Li, David Simchi-Levi, Yunxiao Zhao

Comments: Delete unrelated figure, update new lower bound results

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[52] arXiv:2410.05597 [pdf, html, other]

Title: SMART: A Flexible Approach to Regression using Spline-Based Multivariate Adaptive Regression Trees

William Pattie, Arvind Krishna

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[53] arXiv:2410.05602 [pdf, html, other]

Title: Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series

Byoungwoo Park, Hyungi Lee, Juho Lee

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[54] arXiv:2410.05609 [pdf, other]

Title: The Breakdown of Gaussian Universality in Classification of High-dimensional Linear Factor Mixtures

Xiaoyi Mai, Zhenyu Liao

Comments: 34 pages, 10 figures, accepted by ICLR 2025 (this https URL)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[55] arXiv:2410.05626 [pdf, html, other]

Title: On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory

Guhan Chen, Yicheng Li, Qian Lin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[56] arXiv:2410.05690 [pdf, html, other]

Title: Long-Context Linear System Identification

Oğuz Kaan Yüksel, Mathieu Even, Nicolas Flammarion

Comments: 30 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Systems and Control (eess.SY); Statistics Theory (math.ST)

[57] arXiv:2410.05753 [pdf, html, other]

Title: Pathwise Gradient Variance Reduction with Control Variates in Variational Inference

Kenyon Ng, Susan Wei

Comments: 9 (+16 appendix) pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[58] arXiv:2410.05757 [pdf, html, other]

Title: Temperature Optimization for Bayesian Deep Learning

Kenyon Ng, Chris van der Heide, Liam Hodgkinson, Susan Wei

Comments: 11 pages (+5 reference, +16 appendix)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[59] arXiv:2410.05810 [pdf, html, other]

Title: Uncertainty-Aware Fairness-Adaptive Classification Trees

Anna Gottard, Vanessa Verrina, Sabrina Giordano

Comments: 14 pages, 3 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[60] arXiv:2410.05856 [pdf, html, other]

Title: Stochastic Bandits for Egalitarian Assignment

Eugene Lim, Vincent Y. F. Tan, Harold Soh

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[61] arXiv:2410.05898 [pdf, html, other]

Title: Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion

Enrico Ventura, Beatrice Achilli, Gianluigi Silvestri, Carlo Lucibello, Luca Ambrogioni

Comments: 22 pages, 13 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[62] arXiv:2410.06012 [pdf, html, other]

Title: Generalized Sparse Additive Model with Unknown Link Function

Peipei Yuan, Xinge You, Hong Chen, Xuelin Zhang, Qinmu Peng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[63] arXiv:2410.06163 [pdf, html, other]

Title: Markov Equivalence and Consistency in Differentiable Structure Learning

Chang Deng, Kevin Bello, Pradeep Ravikumar, Bryon Aragam

Comments: 38 pages, 14 figures, to appear at NeurIPS 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[64] arXiv:2410.06171 [pdf, html, other]

Title: Stochastic Kernel Regularisation Improves Generalisation in Deep Kernel Machines

Edward Milsom, Ben Anson, Laurence Aitchison

Comments: Neurips 2024 Camera Ready Version (without checklist)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[65] arXiv:2410.06329 [pdf, html, other]

Title: Bayesian Estimation and Tuning-Free Rank Detection for Probability Mass Function Tensors

Joseph K. Chege, Arie Yeredor, Martin Haardt

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[66] arXiv:2410.06378 [pdf, html, other]

Title: Covering Numbers for Deep ReLU Networks with Applications to Function Approximation and Nonparametric Regression

Weigutian Ou, Helmut Bölcskei

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[67] arXiv:2410.06731 [pdf, html, other]

Title: Gridded Transformer Neural Processes for Large Unstructured Spatio-Temporal Data

Matthew Ashman, Cristiana Diaconu, Eric Langezaal, Adrian Weller, Richard E. Turner

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[68] arXiv:2410.06921 [pdf, html, other]

Title: Adversarial Vulnerability as a Consequence of On-Manifold Inseparibility

Rajdeep Haldar, Yue Xing, Qifan Song, Guang Lin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[69] arXiv:2410.07021 [pdf, html, other]

Title: Do Contemporary Causal Inference Models Capture Real-World Heterogeneity? Findings from a Large-Scale Benchmark

Haining Yu, Yizhou Sun

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[70] arXiv:2410.07548 [pdf, html, other]

Title: Hybrid Summary Statistics

T. Lucas Makinen, Ce Sui, Benjamin D. Wandelt, Natalia Porqueres, Alan Heavens

Comments: 7 pages, 4 figures. Accepted to ML4PS2024 at NeurIPS 2024

Subjects: Machine Learning (stat.ML); Cosmology and Nongalactic Astrophysics (astro-ph.CO); Information Theory (cs.IT); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)

[71] arXiv:2410.07574 [pdf, other]

Title: Gap-Dependent Bounds for Q-Learning using Reference-Advantage Decomposition

Zhong Zheng, Haochen Zhang, Lingzhou Xue

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[72] arXiv:2410.07643 [pdf, html, other]

Title: On Reward Transferability in Adversarial Inverse Reinforcement Learning: Insights from Random Matrix Theory

Yangchun Zhang, Wang Zhou, Yirui Zhou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[73] arXiv:2410.07651 [pdf, html, other]

Title: Theoretical limits of descending $\ell_0$ sparse-regression ML algorithms

Mihailo Stojnic

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[74] arXiv:2410.07685 [pdf, other]

Title: Breaking the curse of dimensionality in structured density estimation

Robert A. Vandermeulen, Wai Ming Tai, Bryon Aragam

Comments: Work accepted to NeurIPS 2024

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Statistics Theory (math.ST)

[75] arXiv:2410.07778 [pdf, html, other]

Title: On the grid-sampling limit SDE

Christian Bender, Nguyen Tran Thuan

Comments: This note provides supplementary materials to arXiv:2409.17200 in a self-contained way

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)