Machine Learning

Authors and titles for March 2024

[51] arXiv:2403.06816 [pdf, html, other]

Title: Efficient first-order algorithms for large-scale, non-smooth maximum entropy models with application to wildfire science

Gabriel P. Langlois, Jatan Buch, Jérôme Darbon

Comments: The main text of our manuscript is 20 pages long, the appendices are 4 pages long, and the references are 4 pages long,for a total of 28 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC)

[52] arXiv:2403.07207 [pdf, html, other]

Title: Tracking Dynamic Gaussian Density with a Theoretically Optimal Sliding Window Approach

Yinsong Wang, Yu Ding, Shahin Shahrampour

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[53] arXiv:2403.07264 [pdf, html, other]

Title: Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization

Yutong Wang, Rishi Sonthalia, Wei Hu

Comments: AISTATS 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[54] arXiv:2403.07310 [pdf, other]

Title: How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance

Hongkang Li, Shuai Zhang, Yihua Zhang, Meng Wang, Sijia Liu, Pin-Yu Chen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[55] arXiv:2403.07431 [pdf, html, other]

Title: Knowledge Transfer across Multiple Principal Component Analysis Studies

Zeyu Li, Kangxiang Qin, Yong He, Wang Zhou, Xinsheng Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[56] arXiv:2403.07454 [pdf, html, other]

Title: Fast, accurate and lightweight sequential simulation-based inference using Gaussian locally linear mappings

Henrik Häggström, Pedro L. C. Rodrigues, Geoffroy Oudoumanessah, Florence Forbes, Umberto Picchini

Comments: 69 pages, 66 figures: new case study added (Biological model of the translation kinetics after mRNA transfection)

Journal-ref: Transactions on Machine Learning Research 2024, https://openreview.net/forum?id=Q0nzpRcwWn

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[57] arXiv:2403.07471 [pdf, html, other]

Title: On the nonconvexity of some push-forward constraints and its consequences in machine learning

Lucas de Lara (UT3, IMT), Mathis Deronzier (UT3, IMT), Alberto González-Sanz, Virgile Foy (UT3, IMT)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)

[58] arXiv:2403.07728 [pdf, html, other]

Title: CAP: A General Algorithm for Online Selective Conformal Prediction with FCR Control

Yajie Bao, Yuyang Huo, Haojie Ren, Changliang Zou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[59] arXiv:2403.07745 [pdf, other]

Title: Probabilistic Easy Variational Causal Effect

Usef Faghihi, Amir Saki

Comments: 45 pages, 9 Figures

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[60] arXiv:2403.07780 [pdf, html, other]

Title: FairRR: Pre-Processing for Group Fairness through Randomized Response

Xianli Zeng, Joshua Ward, Guang Cheng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[61] arXiv:2403.08160 [pdf, other]

Title: Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime

Hong Hu, Yue M. Lu, Theodor Misiakiewicz

Comments: 106 pages, 8 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[62] arXiv:2403.08362 [pdf, html, other]

Title: Mean-Field Microcanonical Gradient Descent

Marcus Häggbom, Morten Karlsmark, Joakim Andén

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistical Finance (q-fin.ST); Computation (stat.CO)

[63] arXiv:2403.08627 [pdf, html, other]

Title: Multifidelity linear regression for scientific machine learning from scarce data

Elizabeth Qian, Dayoung Kang, Vignesh Sella, Anirban Chaudhuri

Subjects: Machine Learning (stat.ML); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG)

[64] arXiv:2403.08750 [pdf, html, other]

Title: Neural reproducing kernel Banach spaces and representer theorems for deep networks

Francesca Bartolucci, Ernesto De Vito, Lorenzo Rosasco, Stefano Vigogna

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Functional Analysis (math.FA)

[65] arXiv:2403.08757 [pdf, html, other]

Title: Efficient Combinatorial Optimization via Heat Diffusion

Hengyuan Ma, Wenlian Lu, Jianfeng Feng

Comments: After the rebuttal version for NeurIPS 2024 (poster). Code is available in this https URL

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Combinatorics (math.CO); Applied Physics (physics.app-ph)

[66] arXiv:2403.08831 [pdf, html, other]

Title: Majority-of-Three: The Simplest Optimal Learner?

Ishaq Aden-Ali, Mikael Møller Høgsgaard, Kasper Green Larsen, Nikita Zhivotovskiy

Comments: 22 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[67] arXiv:2403.08938 [pdf, other]

Title: A non-asymptotic theory of Kernel Ridge Regression: deterministic equivalents, test error, and GCV estimator

Theodor Misiakiewicz, Basil Saeed

Comments: 131 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[68] arXiv:2403.08941 [pdf, html, other]

Title: Towards Model-Agnostic Posterior Approximation for Fast and Accurate Variational Autoencoders

Yaniv Yacoby, Weiwei Pan, Finale Doshi-Velez

Comments: Accepted at the Workshop at the 6th Symposium on Advances in Approximate Bayesian Inference (AABI) 2024

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[69] arXiv:2403.09206 [pdf, html, other]

Title: Upper Bound of Bayesian Generalization Error in Partial Concept Bottleneck Model (CBM): Partial CBM outperforms naive CBM

Naoki Hayashi, Yoshihide Sawada

Comments: 17 pages, 1 figure, submitted to TMLR

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Statistics Theory (math.ST)

[70] arXiv:2403.09383 [pdf, html, other]

Title: Pantypes: Diverse Representatives for Self-Explainable Models

Rune Kjærsgaard, Ahcène Boubekki, Line Clemmensen

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[71] arXiv:2403.09429 [pdf, html, other]

Title: VISA: Variational Inference with Sequential Sample-Average Approximations

Heiko Zimmermann, Christian A. Naesseth, Jan-Willem van de Meent

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[72] arXiv:2403.09755 [pdf, html, other]

Title: Estimating the history of a random recursive tree

Simon Briend, Christophe Giraud, Gábor Lugosi, Déborah Sulem

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[73] arXiv:2403.09869 [pdf, html, other]

Title: Mind the GAP: Improving Robustness to Subpopulation Shifts with Group-Aware Priors

Tim G. J. Rudner, Ya Shi Zhang, Andrew Gordon Wilson, Julia Kempe

Comments: Published in Proceedings of the 27th International Conference on Artificial Intelligence and Statistics (AISTATS 2024)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Methodology (stat.ME)

[74] arXiv:2403.10070 [pdf, other]

Title: A Structure-Preserving Kernel Method for Learning Hamiltonian Systems

Jianyu Hu, Juan-Pablo Ortega, Daiying Yin

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Dynamical Systems (math.DS)

[75] arXiv:2403.10250 [pdf, html, other]

Title: Interpretable Machine Learning for Survival Analysis

Sophie Hanna Langbein, Mateusz Krzyziński, Mikołaj Spytek, Hubert Baniecki, Przemysław Biecek, Marvin N. Wright

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)