Machine Learning

Authors and titles for May 2024

[1] arXiv:2405.00385 [pdf, html, other]

Title: Variational Bayesian Methods for a Tree-Structured Stick-Breaking Process Mixture of Gaussians by Application of the Bayes Codes for Context Tree Models

Yuta Nakahara

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[2] arXiv:2405.00442 [pdf, other]

Title: Geometric Insights into Focal Loss: Reducing Curvature for Enhanced Model Calibration

Masanari Kimura, Hiroki Naganuma

Comments: This paper is under consideration at Pattern Recognition Letters

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[3] arXiv:2405.00592 [pdf, html, other]

Title: Scaling and renormalization in high-dimensional regression

Alexander Atanasov, Jacob A. Zavatone-Veth, Cengiz Pehlevan

Comments: 68 pages, 17 figures

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (cs.LG)

[4] arXiv:2405.00642 [pdf, html, other]

Title: Gaussian Universality in Neural Network Dynamics with Generalized Structured Input Distributions

Jaeyong Bae, Hawoong Jeong

Comments: Accepted for Bridging the Gap Between Practice and Theory in Deep Learning (BGPT) Workshop at ICLR 2024, [v1] 23 pages, 16 figures

Subjects: Machine Learning (stat.ML); Disordered Systems and Neural Networks (cond-mat.dis-nn); Statistical Mechanics (cond-mat.stat-mech); Machine Learning (cs.LG)

[5] arXiv:2405.01015 [pdf, html, other]

Title: Network reconstruction via the minimum description length principle

Tiago P. Peixoto

Comments: 17 pages, 10 figures. Code and documentation are available at this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Data Analysis, Statistics and Probability (physics.data-an); Populations and Evolution (q-bio.PE)

[6] arXiv:2405.01124 [pdf, html, other]

Title: Investigating Self-Supervised Image Denoising with Denaturation

Hiroki Waida, Kimihiro Yamazaki, Atsushi Tokuhisa, Mutsuyo Wada, Yuichiro Wada

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV); Statistics Theory (math.ST)

[7] arXiv:2405.01404 [pdf, html, other]

Title: Random Pareto front surfaces

Ben Tu, Nikolas Kantas, Robert M. Lee, Behrang Shafei

Comments: The code is available at: this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Methodology (stat.ME)

[8] arXiv:2405.01737 [pdf, html, other]

Title: Sample-efficient neural likelihood-free Bayesian inference of implicit HMMs

Sanmitra Ghosh, Paul J. Birrell, Daniela De Angelis

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Computation (stat.CO)

[9] arXiv:2405.01761 [pdf, html, other]

Title: Multivariate Bayesian Last Layer for Regression: Uncertainty Quantification and Disentanglement

Han Wang, Eiji Kawasaki, Guillaume Damblin, Geoffrey Daniel

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[10] arXiv:2405.01952 [pdf, html, other]

Title: Three Quantization Regimes for ReLU Networks

Weigutian Ou, Philipp Schenkel, Helmut Bölcskei

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[11] arXiv:2405.01964 [pdf, other]

Title: Position: Understanding LLMs Requires More Than Statistical Generalization

Patrik Reizinger, Szilvia Ujváry, Anna Mészáros, Anna Kerekes, Wieland Brendel, Ferenc Huszár

Comments: Accepted as a position paper at ICML2024, Code: this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[12] arXiv:2405.01994 [pdf, other]

Title: Mathematics of statistical sequential decision-making: concentration, risk-awareness and modelling in stochastic bandits, with applications to bariatric surgery

Patrick Saux

Comments: Doctoral thesis. Some pdf readers (e.g. Firefox) have trouble rendering the theorems/definitions environment. When reading online, please prefer e.g. Chrome

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[13] arXiv:2405.02082 [pdf, other]

Title: A comparative study of conformal prediction methods for valid uncertainty quantification in machine learning

Nicolas Dewolf

Comments: At 339 pages, this document is a live/working version of my PhD dissertation published in 2024 by the University of Ghent (UGent)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Statistics Theory (math.ST)

[14] arXiv:2405.02188 [pdf, html, other]

Title: Optimistic Regret Bounds for Online Learning in Adversarial Markov Decision Processes

Sang Bin Moon, Abolfazl Hashemi

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[15] arXiv:2405.02225 [pdf, html, other]

Title: Fair Risk Control: A Generalized Framework for Calibrating Multi-group Fairness Risks

Lujing Zhang, Aaron Roth, Linjun Zhang

Comments: 28 pages, 8 figures, accepted by ICML2024

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG); Methodology (stat.ME)

[16] arXiv:2405.02372 [pdf, other]

Title: Triadic-OCD: Asynchronous Online Change Detection with Provable Robustness, Optimality, and Convergence

Yancheng Huang, Kai Yang, Zelin Zhu, Leian Chen

Comments: Accepted at ICML2024

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[17] arXiv:2405.02383 [pdf, html, other]

Title: A Fresh Look at Sanity Checks for Saliency Maps

Anna Hedström, Leander Weber, Sebastian Lapuschkin, Marina Höhne

Comments: arXiv admin note: text overlap with arXiv:2401.06465

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[18] arXiv:2405.02449 [pdf, html, other]

Title: Quality-Weighted Vendi Scores And Their Application To Diverse Experimental Design

Quan Nguyen, Adji Bousso Dieng

Comments: Published in International Conference on Machine Learning, ICML 2024. Code can be found in the Vertaix GitHub: this https URL. Paper dedicated to Kwame Nkrumah

Subjects: Machine Learning (stat.ML); Materials Science (cond-mat.mtrl-sci); Machine Learning (cs.LG); Biomolecules (q-bio.BM)

[19] arXiv:2405.02488 [pdf, html, other]

Title: Modelling Sampling Distributions of Test Statistics with Autograd

Ali Al Kadhim, Harrison B. Prosper

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); High Energy Physics - Experiment (hep-ex); Computation (stat.CO)

[20] arXiv:2405.02783 [pdf, html, other]

Title: Linear Noise Approximation Assisted Bayesian Inference on Mechanistic Model of Partially Observed Stochastic Reaction Network

Wandi Xu, Wei Xie

Comments: 11 pages, 2 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[21] arXiv:2405.03130 [pdf, html, other]

Title: Deep Learning for Causal Inference: A Comparison of Architectures for Heterogeneous Treatment Effect Estimation

Demetrios Papakostas, Andrew Herren, P. Richard Hahn, Francisco Castillo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[22] arXiv:2405.03180 [pdf, html, other]

Title: Braced Fourier Continuation and Regression for Anomaly Detection

Josef Sabuda

Comments: 16 pages, 9 figures, associated Github link: this https URL -6/30/2024 update corrected and reworded erroneous figure references, minor typos

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[23] arXiv:2405.03198 [pdf, html, other]

Title: Stability Evaluation via Distributional Perturbation Analysis

Jose Blanchet, Peng Cui, Jiajin Li, Jiashuo Liu

Comments: Accepted by ICML 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[24] arXiv:2405.03468 [pdf, html, other]

Title: Hierarchic Flows to Estimate and Sample High-dimensional Probabilities

Etienne Lempereur, Stéphane Mallat

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Fluid Dynamics (physics.flu-dyn)

[25] arXiv:2405.03549 [pdf, html, other]

Title: Bridging discrete and continuous state spaces: Exploring the Ehrenfest process in time-continuous diffusion models

Ludwig Winkler, Lorenz Richter, Manfred Opper

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS); Probability (math.PR)

[26] arXiv:2405.03879 [pdf, html, other]

Title: Scalable Amortized GPLVMs for Single Cell Transcriptomics Data

Sarah Zhao, Aditya Ravuri, Vidhi Lalchand, Neil D. Lawrence

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Genomics (q-bio.GN); Applications (stat.AP)

[27] arXiv:2405.04026 [pdf, html, other]

Title: Federated Control in Markov Decision Processes

Hao Jin, Yang Peng, Liangyu Zhang, Zhihua Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[28] arXiv:2405.04147 [pdf, html, other]

Title: Multiparameter regularization and aggregation in the context of polynomial functional regression

Elke R. Gizewski, Markus Holzleitner, Lukas Mayer-Suess, Sergiy Pereverzyev Jr., Sergei V. Pereverzyev

Comments: 18 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA); Statistics Theory (math.ST)

[29] arXiv:2405.04393 [pdf, html, other]

Title: Efficient Online Set-valued Classification with Bandit Feedback

Zhou Wang, Xingye Qiao

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[30] arXiv:2405.04539 [pdf, html, other]

Title: Some variation of COBRA in sequential learning setup

Aryan Bhambu, Arabin Kumar Dey

Subjects: Machine Learning (stat.ML); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG); Signal Processing (eess.SP); Computational Finance (q-fin.CP)

[31] arXiv:2405.04919 [pdf, html, other]

Title: Fast Computation of Leave-One-Out Cross-Validation for $k$-NN Regression

Motonobu Kanagawa

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME)

[32] arXiv:2405.05025 [pdf, html, other]

Title: Learning Structural Causal Models through Deep Generative Models: Methods, Guarantees, and Challenges

Audrey Poinsot, Alessandro Leite, Nicolas Chesneau, Michèle Sébag, Marc Schoenauer

Comments: Accepted to the 33rd International Joint Conference on Artificial Intelligence

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[33] arXiv:2405.05081 [pdf, html, other]

Title: Robust deep learning from weakly dependent data

William Kengne, Modou Wade

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[34] arXiv:2405.05190 [pdf, html, other]

Title: Is Transductive Learning Equivalent to PAC Learning?

Shaddin Dughmi, Yusuf Kalayci, Grayson York

Subjects: Machine Learning (stat.ML); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST)

[35] arXiv:2405.05646 [pdf, html, other]

Title: Outlier-robust Kalman Filtering through Generalised Bayes

Gerardo Duran-Martin, Matias Altamirano, Alexander Y. Shestopaloff, Leandro Sánchez-Betancourt, Jeremias Knoblauch, Matt Jones, François-Xavier Briol, Kevin Murphy

Comments: 41st International Conference on Machine Learning (ICML 2024)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Systems and Control (eess.SY)

[36] arXiv:2405.05733 [pdf, html, other]

Title: Batched Stochastic Bandit for Nondegenerate Functions

Yu Liu, Yunlu Shu, Tianyu Wang

Comments: 34 pages, 14 colored figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[37] arXiv:2405.06003 [pdf, html, other]

Title: Binary Hypothesis Testing for Softmax Models and Leverage Score Models

Yeqi Gao, Yuzhou Gu, Zhao Song

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[38] arXiv:2405.06415 [pdf, html, other]

Title: Generalization analysis with deep ReLU networks for metric and similarity learning

Junyu Zhou, Puyu Wang, Ding-Xuan Zhou

Comments: 15 pages, 1 figure

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[39] arXiv:2405.06546 [pdf, html, other]

Title: Sharp analysis of out-of-distribution error for "importance-weighted" estimators in the overparameterized regime

Kuo-Wei Lai, Vidya Muthukumar

Comments: A short version of this work will be presented at IEEE ISIT 2024

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[40] arXiv:2405.06558 [pdf, html, other]

Title: Random matrix theory improved Fr\'echet mean of symmetric positive definite matrices

Florent Bouchard, Ammar Mian, Malik Tiomoko, Guillaume Ginolhac, Frédéric Pascal

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP); Methodology (stat.ME)

[41] arXiv:2405.06672 [pdf, html, other]

Title: Liouville Flow Importance Sampler

Yifeng Tian, Nishant Panda, Yen Ting Lin

Comments: 25 pages, 7 figures, 15 tables. Submitted to and accepted by the 41th International Conference on Machine Learning (Vienna, Austria)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Data Analysis, Statistics and Probability (physics.data-an); Computation (stat.CO)

[42] arXiv:2405.06727 [pdf, html, other]

Title: Approximation Error and Complexity Bounds for ReLU Networks on Low-Regular Function Spaces

Owen Davis, Gianluca Geraci, Mohammad Motamed

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[43] arXiv:2405.07432 [pdf, html, other]

Title: Compressed Online Learning of Conditional Mean Embedding

Boya Hou, Sina Sanjari, Alec Koppel, Subhonmesh Bose

Comments: 39 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Systems and Control (eess.SY)

[44] arXiv:2405.07482 [pdf, html, other]

Title: Marginal Fairness Sliced Wasserstein Barycenter

Khai Nguyen, Hai Nguyen, Nhat Ho

Comments: 33 pages, 14 figures, 6 tables

Subjects: Machine Learning (stat.ML); Graphics (cs.GR); Machine Learning (cs.LG)

[45] arXiv:2405.07552 [pdf, html, other]

Title: Distributed High-Dimensional Quantile Regression: Estimation Efficiency and Support Recovery

Caixing Wang, Ziliang Shen

Comments: Forty-first International Conference on Machine Learning (ICML 2024), 27 pages, 4 figures, 14 tables

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[46] arXiv:2405.07619 [pdf, html, other]

Title: Analysis of the rate of convergence of an over-parametrized convolutional neural network image classifier learned by gradient descent

Michael Kohler, Adam Krzyzak, Benjamin Walter

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[47] arXiv:2405.07795 [pdf, html, other]

Title: Improved Bound for Robust Causal Bandits with Linear Models

Zirui Yan, Arpan Mukherjee, Burak Varıcı, Ali Tajer

Comments: 11 pages, 3 figures. arXiv admin note: substantial text overlap with arXiv:2310.19794

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[48] arXiv:2405.07971 [pdf, html, other]

Title: Sensitivity Analysis for Active Sampling, with Applications to the Simulation of Analog Circuits

Reda Chhaibi, Fabrice Gamboa, Christophe Oger, Vinicius Oliveira, Clément Pellegrini, Damien Remot

Comments: 7 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP); Methodology (stat.ME)

[49] arXiv:2405.07976 [pdf, html, other]

Title: Localized Adaptive Risk Control

Matteo Zecchin, Osvaldo Simeone

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[50] arXiv:2405.08235 [pdf, html, other]

Title: Additive-Effect Assisted Learning

Jiawei Zhang, Yuhong Yang, Jie Ding

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)