Machine Learning

Authors and titles for October 2024

[51] arXiv:2410.05552 [pdf, other]

Title: Optimal Adaptive Experimental Design for Estimating Treatment Effect

Jiachun Li, David Simchi-Levi, Yunxiao Zhao

Comments: Delete unrelated figure, update new lower bound results

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[52] arXiv:2410.05597 [pdf, html, other]

Title: SMART: A Flexible Approach to Regression using Spline-Based Multivariate Adaptive Regression Trees

William Pattie, Arvind Krishna

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[53] arXiv:2410.05602 [pdf, html, other]

Title: Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series

Byoungwoo Park, Hyungi Lee, Juho Lee

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[54] arXiv:2410.05609 [pdf, other]

Title: The Breakdown of Gaussian Universality in Classification of High-dimensional Linear Factor Mixtures

Xiaoyi Mai, Zhenyu Liao

Comments: 34 pages, 10 figures, accepted by ICLR 2025 (this https URL)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[55] arXiv:2410.05626 [pdf, html, other]

Title: On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory

Guhan Chen, Yicheng Li, Qian Lin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[56] arXiv:2410.05690 [pdf, html, other]

Title: Long-Context Linear System Identification

Oğuz Kaan Yüksel, Mathieu Even, Nicolas Flammarion

Comments: 30 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Systems and Control (eess.SY); Statistics Theory (math.ST)

[57] arXiv:2410.05753 [pdf, html, other]

Title: Pathwise Gradient Variance Reduction with Control Variates in Variational Inference

Kenyon Ng, Susan Wei

Comments: 9 (+16 appendix) pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[58] arXiv:2410.05757 [pdf, html, other]

Title: Temperature Optimization for Bayesian Deep Learning

Kenyon Ng, Chris van der Heide, Liam Hodgkinson, Susan Wei

Comments: 11 pages (+5 reference, +16 appendix)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[59] arXiv:2410.05810 [pdf, html, other]

Title: Uncertainty-Aware Fairness-Adaptive Classification Trees

Anna Gottard, Vanessa Verrina, Sabrina Giordano

Comments: 14 pages, 3 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[60] arXiv:2410.05856 [pdf, html, other]

Title: Stochastic Bandits for Egalitarian Assignment

Eugene Lim, Vincent Y. F. Tan, Harold Soh

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[61] arXiv:2410.05898 [pdf, html, other]

Title: Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion

Enrico Ventura, Beatrice Achilli, Gianluigi Silvestri, Carlo Lucibello, Luca Ambrogioni

Comments: 22 pages, 13 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[62] arXiv:2410.06012 [pdf, html, other]

Title: Generalized Sparse Additive Model with Unknown Link Function

Peipei Yuan, Xinge You, Hong Chen, Xuelin Zhang, Qinmu Peng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[63] arXiv:2410.06163 [pdf, html, other]

Title: Markov Equivalence and Consistency in Differentiable Structure Learning

Chang Deng, Kevin Bello, Pradeep Ravikumar, Bryon Aragam

Comments: 38 pages, 14 figures, to appear at NeurIPS 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[64] arXiv:2410.06171 [pdf, html, other]

Title: Stochastic Kernel Regularisation Improves Generalisation in Deep Kernel Machines

Edward Milsom, Ben Anson, Laurence Aitchison

Comments: Neurips 2024 Camera Ready Version (without checklist)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[65] arXiv:2410.06329 [pdf, html, other]

Title: Bayesian Estimation and Tuning-Free Rank Detection for Probability Mass Function Tensors

Joseph K. Chege, Arie Yeredor, Martin Haardt

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[66] arXiv:2410.06378 [pdf, html, other]

Title: Covering Numbers for Deep ReLU Networks with Applications to Function Approximation and Nonparametric Regression

Weigutian Ou, Helmut Bölcskei

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[67] arXiv:2410.06731 [pdf, html, other]

Title: Gridded Transformer Neural Processes for Large Unstructured Spatio-Temporal Data

Matthew Ashman, Cristiana Diaconu, Eric Langezaal, Adrian Weller, Richard E. Turner

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[68] arXiv:2410.06921 [pdf, html, other]

Title: Adversarial Vulnerability as a Consequence of On-Manifold Inseparibility

Rajdeep Haldar, Yue Xing, Qifan Song, Guang Lin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[69] arXiv:2410.07021 [pdf, html, other]

Title: Do Contemporary Causal Inference Models Capture Real-World Heterogeneity? Findings from a Large-Scale Benchmark

Haining Yu, Yizhou Sun

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[70] arXiv:2410.07548 [pdf, html, other]

Title: Hybrid Summary Statistics

T. Lucas Makinen, Ce Sui, Benjamin D. Wandelt, Natalia Porqueres, Alan Heavens

Comments: 7 pages, 4 figures. Accepted to ML4PS2024 at NeurIPS 2024

Subjects: Machine Learning (stat.ML); Cosmology and Nongalactic Astrophysics (astro-ph.CO); Information Theory (cs.IT); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)

[71] arXiv:2410.07574 [pdf, other]

Title: Gap-Dependent Bounds for Q-Learning using Reference-Advantage Decomposition

Zhong Zheng, Haochen Zhang, Lingzhou Xue

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[72] arXiv:2410.07643 [pdf, html, other]

Title: On Reward Transferability in Adversarial Inverse Reinforcement Learning: Insights from Random Matrix Theory

Yangchun Zhang, Wang Zhou, Yirui Zhou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[73] arXiv:2410.07651 [pdf, html, other]

Title: Theoretical limits of descending $\ell_0$ sparse-regression ML algorithms

Mihailo Stojnic

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[74] arXiv:2410.07685 [pdf, other]

Title: Breaking the curse of dimensionality in structured density estimation

Robert A. Vandermeulen, Wai Ming Tai, Bryon Aragam

Comments: Work accepted to NeurIPS 2024

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Statistics Theory (math.ST)

[75] arXiv:2410.07778 [pdf, html, other]

Title: On the grid-sampling limit SDE

Christian Bender, Nguyen Tran Thuan

Comments: This note provides supplementary materials to arXiv:2409.17200 in a self-contained way

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[76] arXiv:2410.07786 [pdf, html, other]

Title: Orthogonal Nonnegative Matrix Factorization with the Kullback-Leibler divergence

Jean Pacifique Nkurunziza, Fulgence Nahayo, Nicolas Gillis

Comments: 10 pages, corrected some typos

Subjects: Machine Learning (stat.ML); Information Retrieval (cs.IR); Machine Learning (cs.LG); Signal Processing (eess.SP)

[77] arXiv:2410.07890 [pdf, html, other]

Title: Identifying latent disease factors differently expressed in patient subgroups using group factor analysis

Fabio S. Ferreira, John Ashburner, Arabella Bouzigues, Chatrin Suksasilp, Lucy L. Russell, Phoebe H. Foster, Eve Ferry-Bolder, John C. van Swieten, Lize C. Jiskoot, Harro Seelaar, Raquel Sanchez-Valle, Robert Laforce, Caroline Graff, Daniela Galimberti, Rik Vandenberghe, Alexandre de Mendonca, Pietro Tiraboschi, Isabel Santana, Alexander Gerhard, Johannes Levin, Sandro Sorbi, Markus Otto, Florence Pasquier, Simon Ducharme, Chris R. Butler, Isabelle Le Ber, Elizabeth Finger, Maria C. Tartaglia, Mario Masellis, James B. Rowe, Matthis Synofzik, Fermin Moreno, Barbara Borroni, Samuel Kaski, Jonathan D. Rohrer, Janaina Mourao-Miranda

Comments: 38 pages, 14 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[78] arXiv:2410.07930 [pdf, html, other]

Title: Cost-aware simulation-based inference

Ayush Bharti, Daolang Huang, Samuel Kaski, François-Xavier Briol

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[79] arXiv:2410.07976 [pdf, html, other]

Title: Addressing Rotational Learning Dynamics in Multi-Agent Reinforcement Learning

Baraah A. M. Sidahmed, Tatjana Chavdarova

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[80] arXiv:2410.08194 [pdf, html, other]

Title: Features are fate: a theory of transfer learning in high-dimensional regression

Javan Tahir, Surya Ganguli, Grant M. Rotskoff

Comments: 29 pages, 7 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[81] arXiv:2410.08311 [pdf, html, other]

Title: Correspondence of NNGP Kernel and the Matern Kernel

Amanda Muyskens, Benjamin W. Priest, Imene R. Goumiri, Michael D. Schneider

Comments: 17 pages, 11 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[82] arXiv:2410.08315 [pdf, html, other]

Title: Avoiding mode collapse in diffusion models fine-tuned with reinforcement learning

Roberto Barceló, Cristóbal Alcázar, Felipe Tobar

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[83] arXiv:2410.08361 [pdf, html, other]

Title: Upper Bounds for Learning in Reproducing Kernel Hilbert Spaces for Non IID Samples

Priyanka Roy, Susanne Saminger-Platz

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Functional Analysis (math.FA)

[84] arXiv:2410.08643 [pdf, html, other]

Title: SOAK: Same/Other/All K-fold cross-validation for estimating similarity of patterns in data subsets

Toby Dylan Hocking, Gabrielle Thibault, Cameron Scott Bodine, Paul Nelson Arellano, Alexander F Shenkin, Olivia Jasmine Lindly

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[85] arXiv:2410.08727 [pdf, html, other]

Title: Losing dimensions: Geometric memorization in generative diffusion

Beatrice Achilli, Enrico Ventura, Gianluigi Silvestri, Bao Pham, Gabriel Raya, Dmitry Krotov, Carlo Lucibello, Luca Ambrogioni

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[86] arXiv:2410.08796 [pdf, html, other]

Title: Calibrated Computation-Aware Gaussian Processes

Disha Hegde, Mohamed Adil, Jon Cockayne

Comments: Accepted at the 28th International Conference on Artificial Intelligence and Statistics (AISTATS), 2025

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[87] arXiv:2410.08934 [pdf, html, other]

Title: The Effect of Personalization in FedProx: A Fine-grained Analysis on Statistical Accuracy and Communication Efficiency

Xin Yu, Zelin He, Ying Sun, Lingzhou Xue, Runze Li

Subjects: Machine Learning (stat.ML); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Statistics Theory (math.ST); Computation (stat.CO)

[88] arXiv:2410.08958 [pdf, html, other]

Title: Lifted Coefficient of Determination: Fast model-free prediction intervals and likelihood-free model comparison

Daniel Salnikov, Kevin Michalewicz, Dan Leonte

Comments: 14 pages, 5 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[89] arXiv:2410.08977 [pdf, html, other]

Title: Online-to-PAC generalization bounds under graph-mixing dependencies

Baptiste Abélès, Eugenio Clerico, Gergely Neu

Comments: 13 pages (10 main + 3 supplementary material). All authors contributed equally

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[90] arXiv:2410.08994 [pdf, html, other]

Title: Optimal Downsampling for Imbalanced Classification with Generalized Linear Models

Yan Chen, Jose Blanchet, Krzysztof Dembczynski, Laura Fee Nern, Aaron Flores

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[91] arXiv:2410.09005 [pdf, html, other]

Title: Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra

Roman Worschech, Bernd Rosenow

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[92] arXiv:2410.09046 [pdf, html, other]

Title: Linear Convergence of Diffusion Models Under the Manifold Hypothesis

Peter Potaptchik, Iskander Azangulov, George Deligiannidis

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[93] arXiv:2410.09133 [pdf, html, other]

Title: MVG-CRPS: A Robust Loss Function for Multivariate Probabilistic Forecasting

Vincent Zhihao Zheng, Lijun Sun

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[94] arXiv:2410.09311 [pdf, html, other]

Title: Data Deletion for Linear Regression with Noisy SGD

Zhangjie Xia, Chi-Hua Wang, Guang Cheng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[95] arXiv:2410.09316 [pdf, html, other]

Title: Combinatorial optimization of the coefficient of determination

Marc Harary

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Combinatorics (math.CO)

[96] arXiv:2410.09480 [pdf, html, other]

Title: Identification of Non-causal Graphical Models

Junyao You, Mattia Zorzi

Comments: Accepted to the IEEE CDC 2024 conference

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[97] arXiv:2410.09638 [pdf, html, other]

Title: On Goodhart's law, with an application to value alignment

El-Mahdi El-Mhamdi, Lê-Nguyên Hoang

Comments: 47 pages, 11 figures

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Statistics Theory (math.ST)

[98] arXiv:2410.09697 [pdf, html, other]

Title: Provable Convergence and Limitations of Geometric Tempering for Langevin Dynamics

Omar Chehab, Anna Korba, Austin Stromme, Adrien Vacher

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[99] arXiv:2410.09701 [pdf, html, other]

Title: Transformers as Game Players: Provable In-context Game-playing Capabilities of Pre-trained Models

Chengshuai Shi, Kun Yang, Jing Yang, Cong Shen

Comments: Accepted to NeurIPS 2024

Subjects: Machine Learning (stat.ML); Computer Science and Game Theory (cs.GT); Information Theory (cs.IT); Machine Learning (cs.LG); Multiagent Systems (cs.MA)

[100] arXiv:2410.09945 [pdf, html, other]

Title: Variational Diffusion Posterior Sampling with Midpoint Guidance

Badr Moufad, Yazid Janati, Lisa Bedin, Alain Durmus, Randal Douc, Eric Moulines, Jimmy Olsson

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)