Machine Learning

Authors and titles for October 2024

[101] arXiv:2410.09973 [pdf, html, other]

Title: Gradient Span Algorithms Make Predictable Progress in High Dimension

Felix Benning, Leif Döring

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Probability (math.PR)

[102] arXiv:2410.10044 [pdf, html, other]

Title: DAG-aware Transformer for Causal Effect Estimation

Manqing Liu, David R. Bellamy, Andrew L. Beam

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[103] arXiv:2410.10082 [pdf, other]

Title: fastHDMI: Fast Mutual Information Estimation for High-Dimensional Data

Kai Yang, Masoud Asgharian, Nikhil Bhagwat, Jean-Baptiste Poline, Celia M.T. Greenwood

Comments: 31 pages, 5 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Computation (stat.CO)

[104] arXiv:2410.10098 [pdf, other]

Title: Queueing Matching Bandits with Preference Feedback

Jung-hun Kim, Min-hwan Oh

Comments: NeurIPS2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[105] arXiv:2410.10216 [pdf, html, other]

Title: Neural Quasiprobabilistic Likelihood Ratio Estimation with Negatively Weighted Data

Matthew Drnevich, Stephen Jiggins, Judith Katzy, Kyle Cranmer

Comments: 59 pages, 29 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); High Energy Physics - Experiment (hep-ex)

[106] arXiv:2410.10230 [pdf, other]

Title: Learning via Surrogate PAC-Bayes

Antoine Picard-Weibel, Roman Moscoviz, Benjamin Guedj

Comments: 20 pages

Journal-ref: Neurips 2024, Dec 2024, Vancouver, Canada

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[107] arXiv:2410.10309 [pdf, html, other]

Title: Optimal lower bounds for logistic log-likelihoods

Niccolò Anceschi, Tommaso Rigon, Giacomo Zanella, Daniele Durante

Subjects: Machine Learning (stat.ML); Computation (stat.CO); Methodology (stat.ME)

[108] arXiv:2410.10384 [pdf, html, other]

Title: Bayesian Optimisation with Unknown Hyperparameters: Regret Bounds Logarithmically Closer to Optimal

Juliusz Ziomek, Masaki Adachi, Michael A. Osborne

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[109] arXiv:2410.10415 [pdf, html, other]

Title: Coupled autoregressive active inference agents for control of multi-joint dynamical systems

Tim N. Nisslbeck, Wouter M. Kouw

Comments: 14 pages, 3 figures, accepted to the International Workshop on Active Inference 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Systems and Control (eess.SY)

[110] arXiv:2410.10523 [pdf, other]

Title: Inverse Problems and Data Assimilation: A Machine Learning Approach

Eviatar Bach, Ricardo Baptista, Daniel Sanz-Alonso, Andrew Stuart

Comments: 254 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[111] arXiv:2410.10538 [pdf, other]

Title: Data-Driven Approaches for Modelling Target Behaviour

Isabel Schlangen, André Brandenburger, Mengwei Sun, James R. Hopgood

Comments: 11 pages, 9 figures. Submitted to IEEE Transactions on Signal Processing on October 14, 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[112] arXiv:2410.10623 [pdf, html, other]

Title: Robust Gradient Descent for Phase Retrieval

Alex Buna, Patrick Rebeschini

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[113] arXiv:2410.10637 [pdf, html, other]

Title: High-Dimensional Differential Parameter Inference in Exponential Family using Time Score Matching

Daniel J. Williams, Leyang Wang, Qizhen Ying, Song Liu, Mladen Kolar

Comments: Daniel J. Williams and Leyang Wang contributed equally to this work

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[114] arXiv:2410.10892 [pdf, html, other]

Title: Replicable Uniformity Testing

Sihan Liu, Christopher Ye

Comments: To appear in NeurIPS 2024

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG)

[115] arXiv:2410.10894 [pdf, html, other]

Title: COME: Test-time adaption by Conservatively Minimizing Entropy

Qingyang Zhang, Yatao Bian, Xinke Kong, Peilin Zhao, Changqing Zhang

Comments: Ongoing work

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[116] arXiv:2410.10924 [pdf, html, other]

Title: A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets

Kyungeun Lee, Wonjong Rhee

Comments: NeurIPS 2024

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[117] arXiv:2410.11067 [pdf, html, other]

Title: Variational Inference in Location-Scale Families: Exact Recovery of the Mean and Correlation Matrix

Charles C. Margossian, Lawrence K. Saul

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[118] arXiv:2410.11101 [pdf, html, other]

Title: A Two-Stage Federated Learning Approach for Industrial Prognostics Using Large-Scale High-Dimensional Signals

Yuqi Su, Xiaolei Fang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP)

[119] arXiv:2410.11113 [pdf, other]

Title: Statistical Properties of Deep Neural Networks with Dependent Data

Chad Brown

Comments: 86 pages, 2 figures, removed partially linear model section and uploaded as a separate paper (arXiv:2410.22574v1)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Econometrics (econ.EM)

[120] arXiv:2410.11222 [pdf, html, other]

Title: Quadratic Gating Functions in Mixture of Experts: A Statistical Insight

Pedram Akbarian, Huy Nguyen, Xing Han, Nhat Ho

Comments: Pedram Akbarian, Huy Nguyen, and Xing Han made equal contributions to this work

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[121] arXiv:2410.11227 [pdf, html, other]

Title: Guarantees for Nonlinear Representation Learning: Non-identical Covariates, Dependent Data, Fewer Samples

Thomas T. Zhang, Bruce D. Lee, Ingvar Ziemann, George J. Pappas, Nikolai Matni

Comments: Appeared at ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Systems and Control (eess.SY)

[122] arXiv:2410.11500 [pdf, html, other]

Title: On Rank-Dependent Generalisation Error Bounds for Transformers

Lan V. Truong

Comments: 20 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Functional Analysis (math.FA)

[123] arXiv:2410.11613 [pdf, html, other]

Title: Stochastic diagonal estimation with adaptive parameter selection

Zongyuan Han, Wenhao Li, Shengxin Zhu

Subjects: Machine Learning (stat.ML); Numerical Analysis (math.NA)

[124] arXiv:2410.11711 [pdf, html, other]

Title: Zero-shot Model-based Reinforcement Learning using Large Language Models

Abdelhakim Benechehab, Youssef Attia El Hili, Ambroise Odonnat, Oussama Zekri, Albert Thomas, Giuseppe Paolo, Maurizio Filippone, Ievgen Redko, Balázs Kégl

Journal-ref: The Thirteenth International Conference on Learning Representations (ICLR 2025)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[125] arXiv:2410.11771 [pdf, html, other]

Title: l_inf-approximation of localized distributions

Tiangang Cui, Shuigen Liu, Xin Tong

Subjects: Machine Learning (stat.ML); Numerical Analysis (math.NA)

[126] arXiv:2410.11826 [pdf, html, other]

Title: Bayesian Experimental Design via Contrastive Diffusions

Jacopo Iollo, Christophe Heinkelé, Pierre Alliez, Florence Forbes

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[127] arXiv:2410.12000 [pdf, html, other]

Title: Parametric model reduction of mean-field and stochastic systems via higher-order action matching

Jules Berman, Tobias Blickhan, Benjamin Peherstorfer

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[128] arXiv:2410.12035 [pdf, other]

Title: Learning with Importance Weighted Variational Inference: Asymptotics for Gradient Estimators of the VR-IWAE Bound

Kamélia Daudel, François Roueff

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[129] arXiv:2410.12036 [pdf, html, other]

Title: Deep Optimal Sensor Placement for Black Box Stochastic Simulations

Paula Cordero-Encinar, Tobias Schröder, Peter Yatsyshin, Andrew Duncan

Comments: 23 pages

Journal-ref: Camera ready version for the 28th International Conference on Artificial Intelligence and Statistics (AISTATS 2025)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP)

[130] arXiv:2410.12209 [pdf, html, other]

Title: Global Censored Quantile Random Forest

Siyu Zhou, Limin Peng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[131] arXiv:2410.12677 [pdf, html, other]

Title: Efficient Optimization Algorithms for Linear Adversarial Training

Antônio H. RIbeiro, Thomas B. Schön, Dave Zahariah, Francis Bach

Comments: Paper accepted at AISTATS 2025

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Optimization and Control (math.OC)

[132] arXiv:2410.12690 [pdf, html, other]

Title: Local transfer learning Gaussian process modeling, with applications to surrogate modeling of expensive computer simulators

Xinming Wang, Simon Mak, John Miller, Jianguo Wu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Methodology (stat.ME)

[133] arXiv:2410.12921 [pdf, html, other]

Title: Credal Two-Sample Tests of Epistemic Uncertainty

Siu Lun Chau, Antonin Schrab, Arthur Gretton, Dino Sejdinovic, Krikamol Muandet

Comments: 64 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[134] arXiv:2410.13109 [pdf, html, other]

Title: Contextual Bandits with Arm Request Costs and Delays

Lai Wei, Ambuj Tewari, Michael A. Cianfrocco

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[135] arXiv:2410.13112 [pdf, html, other]

Title: Distributional Matrix Completion via Nearest Neighbors in the Wasserstein Space

Jacob Feitelberg, Kyuseong Choi, Anish Agarwal, Raaz Dwivedi

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[136] arXiv:2410.13171 [pdf, html, other]

Title: L1-Regularized ICA: A Novel Method for Analysis of Task-related fMRI Data

Yusuke Endo, Koujin Takeda

Comments: 29 pages, 9 figures, 4 tables. Python code is available. Please contact the corresponding author for the code

Journal-ref: Neural Computation (2024) 36 (11) 2540-2570

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

[137] arXiv:2410.13300 [pdf, html, other]

Title: A theoretical perspective on mode collapse in variational inference

Roman Soletskyi, Marylou Gabrié, Bruno Loureiro

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG); Statistics Theory (math.ST)

[138] arXiv:2410.13381 [pdf, html, other]

Title: Learning Counterfactual Distributions via Kernel Nearest Neighbors

Kyuseong Choi, Jacob Feitelberg, Caleb Chin, Anish Agarwal, Raaz Dwivedi

Comments: 39 pages, 8 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[139] arXiv:2410.13681 [pdf, html, other]

Title: Ab initio nonparametric variable selection for scalable Symbolic Regression with large $p$

Shengbin Ye, Meng Li

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[140] arXiv:2410.13738 [pdf, html, other]

Title: Improved Convergence Rate for Diffusion Probabilistic Models

Gen Li, Yuchen Jiao

Comments: 20 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[141] arXiv:2410.13770 [pdf, html, other]

Title: Probing the Latent Hierarchical Structure of Data via Diffusion Models

Antonio Sclocchi, Alessandro Favero, Noam Itzhak Levi, Matthieu Wyart

Comments: 10 pages, 6 figures

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[142] arXiv:2410.13800 [pdf, html, other]

Title: Discrete distributions are learnable from metastable samples

Abhijith Jayakumar, Andrey Y. Lokhov, Sidhant Misra, Marc Vuffray

Comments: Updated version, 31 pages

Subjects: Machine Learning (stat.ML); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG)

[143] arXiv:2410.13986 [pdf, html, other]

Title: Recurrent Neural Goodness-of-Fit Test for Time Series

Aoran Zhang, Wenbin Zhou, Liyan Xie, Shixiang Zhu

Comments: 27 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[144] arXiv:2410.14046 [pdf, other]

Title: Tensor Decomposition with Unaligned Observations

Runshi Tang, Tamara Kolda, Anru R. Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA); Computation (stat.CO); Methodology (stat.ME)

[145] arXiv:2410.14055 [pdf, html, other]

Title: Feedback Schrödinger Bridge Matching

Panagiotis Theodoropoulos, Nikolaos Komianos, Vincent Pacelli, Guan-Horng Liu, Evangelos A. Theodorou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[146] arXiv:2410.14061 [pdf, html, other]

Title: Gradual Domain Adaptation via Manifold-Constrained Distributionally Robust Optimization

Amir Hossein Saberi, Amir Najafi, Ala Emrani, Amin Behjati, Yasaman Zolfimoselo, Mahdi Shadrooy, Abolfazl Motahari, Babak H. Khalaj

Comments: Published at Proceedings of Neural Information Processing Systems (NeurIPS) 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[147] arXiv:2410.14090 [pdf, html, other]

Title: A Statistical Machine Learning Approach for Adapting Reduced-Order Models using Projected Gaussian Process

Xiao Liu, Xinchao Liu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS); Applications (stat.AP)

[148] arXiv:2410.14127 [pdf, other]

Title: Estimating the Causal Effects of T Cell Receptors

Eli N. Weinstein, Elizabeth B. Wood, David M. Blei

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Genomics (q-bio.GN)

[149] arXiv:2410.14183 [pdf, other]

Title: In-context Learning for Mixture of Linear Regressions: Existence, Generalization and Training Dynamics

Yanhao Jin, Krishnakumar Balasubramanian, Lifeng Lai

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[150] arXiv:2410.14212 [pdf, html, other]

Title: Comparative Evaluation of Clustered Federated Learning Methods

Michael Ben Ali (IRIT), Omar El-Rifai (IRIT), Imen Megdiche (IRIT, IRIT-SIG, INUC), André Peninou (IRIT, IRIT-SIG, UT2J), Olivier Teste (IRIT-SIG, IRIT, UT2J, UT)

Journal-ref: The 2nd IEEE International Conference on Federated Learning Technologies and Applications (FLTA24), Sep 2024, Valencia (Espagne), Spain

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)