Machine Learning

Authors and titles for June 2024

[201] arXiv:2406.01378 (cross-list from cs.LG) [pdf, html, other]

Title: A Theory of Learnability for Offline Decision Making

Chenjie Mao, Qiaosheng Zhang

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[202] arXiv:2406.01416 (cross-list from cs.LG) [pdf, html, other]

Title: Adapting Conformal Prediction to Distribution Shifts Without Labels

Kevin Kasa, Zhiyu Zhang, Heng Yang, Graham W. Taylor

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[203] arXiv:2406.01435 (cross-list from cs.LG) [pdf, other]

Title: Learning Analysis of Kernel Ridgeless Regression with Asymmetric Kernel Learning

Fan He, Mingzhen He, Lei Shi, Xiaolin Huang, Johan A.K. Suykens

Comments: arXiv admin note: text overlap with arXiv:2310.05236

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[204] arXiv:2406.01461 (cross-list from cs.LG) [pdf, html, other]

Title: Hardness of Learning Neural Networks under the Manifold Hypothesis

Bobak T. Kiani, Jason Wang, Melanie Weber

Subjects: Machine Learning (cs.LG); Differential Geometry (math.DG); Machine Learning (stat.ML)

[205] arXiv:2406.01477 (cross-list from cs.LG) [pdf, html, other]

Title: Finding Optimally Robust Data Mixtures via Concave Maximization

Anvith Thudi, Chris J. Maddison

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[206] arXiv:2406.01478 (cross-list from math.OC) [pdf, html, other]

Title: Stochastic Newton Proximal Extragradient Method

Ruichen Jiang, Michał Dereziński, Aryan Mokhtari

Comments: 32 pages, 1 figure

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[207] arXiv:2406.01494 (cross-list from cs.CV) [pdf, html, other]

Title: Robust Classification by Coupling Data Mollification with Label Smoothing

Markus Heinonen, Ba-Hien Tran, Michael Kampffmeyer, Maurizio Filippone

Comments: Under review

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[208] arXiv:2406.01506 (cross-list from cs.CL) [pdf, html, other]

Title: The Geometry of Categorical and Hierarchical Concepts in Large Language Models

Kiho Park, Yo Joong Choe, Yibo Jiang, Victor Veitch

Comments: Best Paper Award at the ICML 2024 Workshop on Mechanistic Interpretability. Code is available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[209] arXiv:2406.01561 (cross-list from cs.CV) [pdf, html, other]

Title: Long and Short Guidance in Score identity Distillation for One-Step Text-to-Image Generation

Mingyuan Zhou, Zhendong Wang, Huangjie Zheng, Hai Huang

Comments: Code and model checkpoints available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[210] arXiv:2406.01570 (cross-list from cs.LG) [pdf, html, other]

Title: Single Trajectory Conformal Prediction

Brian Lee, Nikolai Matni

Comments: 16 pages

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Machine Learning (stat.ML)

[211] arXiv:2406.01575 (cross-list from math.OC) [pdf, other]

Title: Stochastic Bilevel Optimization with Lower-Level Contextual Markov Decision Processes

Vinzenz Thoma, Barna Pasztor, Andreas Krause, Giorgia Ramponi, Yifan Hu

Comments: 54 pages, 18 Figures

Subjects: Optimization and Control (math.OC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[212] arXiv:2406.01577 (cross-list from cs.LG) [pdf, other]

Title: An Equivalence Between Static and Dynamic Regret Minimization

Andrew Jacobsen, Francesco Orabona

Comments: 36 pages; v2: NeurIPS 2024

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[213] arXiv:2406.01581 (cross-list from cs.LG) [pdf, html, other]

Title: Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit

Jason D. Lee, Kazusato Oko, Taiji Suzuki, Denny Wu

Comments: 34 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[214] arXiv:2406.01588 (cross-list from cs.LG) [pdf, other]

Title: nn2poly: An R Package for Converting Neural Networks into Interpretable Polynomials

Pablo Morala (1 and 2), Jenny Alexandra Cifuentes (3), Rosa E. Lillo (1 and 2), Iñaki Ucar (1 and 2) ((1) uc3m-Santander Big Data Institute, Universidad Carlos III de Madrid. Spain., (2) Department of Statistics, Universidad Carlos III de Madrid. Spain., (3) ICADE, Department of Quantitative Methods, Faculty of Economics and Business Administration and the Institute for Research in Technology (IIT), ICAI School of Engineering, Universidad Pontificia Comillas. Spain.)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[215] arXiv:2406.01611 (cross-list from cs.IR) [pdf, html, other]

Title: System-2 Recommenders: Disentangling Utility and Engagement in Recommendation Systems via Temporal Point-Processes

Arpit Agarwal, Nicolas Usunier, Alessandro Lazaric, Maximilian Nickel

Comments: Accepted at FAccT'24

Subjects: Information Retrieval (cs.IR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[216] arXiv:2406.01660 (cross-list from cs.LG) [pdf, html, other]

Title: Self-Improving Robust Preference Optimization

Eugene Choi, Arash Ahmadian, Matthieu Geist, Oilvier Pietquin, Mohammad Gheshlaghi Azar

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[217] arXiv:2406.01661 (cross-list from cs.LG) [pdf, html, other]

Title: A Diffusion Model Framework for Unsupervised Neural Combinatorial Optimization

Sebastian Sanokowski, Sepp Hochreiter, Sebastian Lehner

Comments: Accepted at ICML 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Discrete Mathematics (cs.DM); Machine Learning (stat.ML)

[218] arXiv:2406.01753 (cross-list from cs.LG) [pdf, other]

Title: Optimizing the Optimal Weighted Average: Efficient Distributed Sparse Classification

Fred Lu, Ryan R. Curtin, Edward Raff, Francis Ferraro, James Holt

Comments: Under review

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[219] arXiv:2406.01762 (cross-list from cs.LG) [pdf, other]

Title: Non-Asymptotic Analysis for Single-Loop (Natural) Actor-Critic with Compatible Function Approximation

Yudan Wang, Yue Wang, Yi Zhou, Shaofeng Zou

Comments: ICML 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[220] arXiv:2406.01766 (cross-list from cs.LG) [pdf, html, other]

Title: How Does Gradient Descent Learn Features -- A Local Analysis for Regularized Two-Layer Neural Networks

Mo Zhou, Rong Ge

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[221] arXiv:2406.01793 (cross-list from cs.LG) [pdf, html, other]

Title: Towards the Transferability of Rewards Recovered via Regularized Inverse Reinforcement Learning

Andreas Schlaginhaufen, Maryam Kamgarpour

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[222] arXiv:2406.01799 (cross-list from cs.LG) [pdf, html, other]

Title: Online Control in Population Dynamics

Noah Golowich, Elad Hazan, Zhou Lu, Dhruv Rohatgi, Y. Jennifer Sun

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[223] arXiv:2406.01818 (cross-list from stat.AP) [pdf, html, other]

Title: Long-term foehn reconstruction combining unsupervised and supervised learning

Reto Stauffer, Achim Zeileis, Georg J. Mayr

Comments: 14 pages, 8 figures, 1 Table plus appendix. Submitted (as is) to the International Journal of Climatology (this https URL)

Subjects: Applications (stat.AP); Atmospheric and Oceanic Physics (physics.ao-ph); Machine Learning (stat.ML)

[224] arXiv:2406.01823 (cross-list from cs.LG) [pdf, html, other]

Title: Causal Discovery with Fewer Conditional Independence Tests

Kirankumar Shiragur, Jiaqi Zhang, Caroline Uhler

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Methodology (stat.ME); Machine Learning (stat.ML)

[225] arXiv:2406.01870 (cross-list from cs.LG) [pdf, html, other]

Title: Understanding Stochastic Natural Gradient Variational Inference

Kaiwen Wu, Jacob R. Gardner

Comments: ICML 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[226] arXiv:2406.01895 (cross-list from cs.LG) [pdf, html, other]

Title: Explicitly Encoding Structural Symmetry is Key to Length Generalization in Arithmetic Tasks

Mahdi Sabbaghi, George Pappas, Hamed Hassani, Surbhi Goel

Comments: 32 pages, 16 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[227] arXiv:2406.01982 (cross-list from stat.AP) [pdf, html, other]

Title: Variable importance measure for spatial machine learning models with application to air pollution exposure prediction

Si Cheng, Magali N. Blanco, Lianne Sheppard, Ali Shojaie, Adam Szpiro

Subjects: Applications (stat.AP); Machine Learning (stat.ML)

[228] arXiv:2406.02016 (cross-list from math.OC) [pdf, html, other]

Title: Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimization

Ruichen Jiang, Ali Kavis, Qiujiang Jin, Sujay Sanghavi, Aryan Mokhtari

Comments: 33 pages, 2 figures

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[229] arXiv:2406.02017 (cross-list from cs.LG) [pdf, html, other]

Title: On the Mode-Seeking Properties of Langevin Dynamics

Xiwei Cheng, Kexin Fu, Farzan Farnia

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[230] arXiv:2406.02052 (cross-list from cs.LG) [pdf, other]

Title: PETRA: Parallel End-to-end Training with Reversible Architectures

Stéphane Rivaud (MLIA), Louis Fournier (MLIA), Thomas Pumir, Eugene Belilovsky (MILA), Michael Eickenberg, Edouard Oyallon

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[231] arXiv:2406.02105 (cross-list from cs.LG) [pdf, html, other]

Title: Kernel vs. Kernel: Exploring How the Data Structure Affects Neural Collapse

Vignesh Kothapalli, Tom Tirer

Comments: 34 pages, 14 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (stat.ML)

[232] arXiv:2406.02177 (cross-list from cs.LG) [pdf, html, other]

Title: One-Shot Federated Learning with Bayesian Pseudocoresets

Tim d'Hondt, Mykola Pechenizkiy, Robert Peharz

Comments: 10 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[233] arXiv:2406.02180 (cross-list from cs.LG) [pdf, html, other]

Title: On The Statistical Representation Properties Of The Perturb-Softmax And The Perturb-Argmax Probability Distributions

Hedda Cohen Indelman, Tamir Hazan

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[234] arXiv:2406.02225 (cross-list from math.OC) [pdf, html, other]

Title: Riemannian coordinate descent algorithms on matrix manifolds

Andi Han, Pratik Jawanpuria, Bamdev Mishra

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[235] arXiv:2406.02234 (cross-list from cs.LG) [pdf, html, other]

Title: On the Limitations of Fractal Dimension as a Measure of Generalization

Charlie B. Tan, Inés García-Redondo, Qiquan Wang, Michael M. Bronstein, Anthea Monod

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Dynamical Systems (math.DS); Machine Learning (stat.ML)

[236] arXiv:2406.02258 (cross-list from cs.LG) [pdf, other]

Title: Reinforcement Learning with Lookahead Information

Nadav Merlis

Comments: Accepted to NeurIPS 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[237] arXiv:2406.02317 (cross-list from cs.LG) [pdf, html, other]

Title: Generative Conditional Distributions by Neural (Entropic) Optimal Transport

Bao Nguyen, Binh Nguyen, Hieu Trung Nguyen, Viet Anh Nguyen

Comments: 15 pages, 8 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[238] arXiv:2406.02354 (cross-list from cs.LG) [pdf, html, other]

Title: Label-wise Aleatoric and Epistemic Uncertainty Quantification

Yusuf Sale, Paul Hofman, Timo Löhr, Lisa Wimmer, Thomas Nagler, Eyke Hüllermeier

Comments: Uncertainty in Artificial Intelligence. arXiv admin note: substantial text overlap with arXiv:2401.00276

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[239] arXiv:2406.02362 (cross-list from cs.LG) [pdf, html, other]

Title: Temporal Graph Rewiring with Expander Graphs

Katarina Petrović, Shenyang Huang, Farimah Poursafaei, Petar Veličković

Comments: 14 pages, 2 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[240] arXiv:2406.02402 (cross-list from math.OC) [pdf, html, other]

Title: Online Fair Allocation of Perishable Resources

Siddhartha Banerjee, Chamsi Hssaine, Sean R. Sinclair

Comments: 51 pages, 8 figures

Subjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Machine Learning (stat.ML)

[241] arXiv:2406.02413 (cross-list from math.OC) [pdf, html, other]

Title: Accelerated Variance-Reduced Forward-Reflected Methods for Root-Finding Problems

Quoc Tran-Dinh

Comments: 26 pages, 2 figures

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[242] arXiv:2406.02431 (cross-list from cs.DS) [pdf, html, other]

Title: Reweighted Solutions for Weighted Low Rank Approximation

David P. Woodruff, Taisuke Yasuda

Comments: ICML 2024

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[243] arXiv:2406.02432 (cross-list from cs.DS) [pdf, html, other]

Title: Coresets for Multiple $\ell_p$ Regression

David P. Woodruff, Taisuke Yasuda

Comments: ICML 2024

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[244] arXiv:2406.02464 (cross-list from cs.LG) [pdf, html, other]

Title: Meta-Learners for Partially-Identified Treatment Effects Across Multiple Environments

Jonas Schweisthal, Dennis Frauen, Mihaela van der Schaar, Stefan Feuerriegel

Comments: Accepted at ICML 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[245] arXiv:2406.02490 (cross-list from cs.LG) [pdf, html, other]

Title: Ai-Sampler: Adversarial Learning of Markov kernels with involutive maps

Evgenii Egorov, Ricardo Valperga, Efstratios Gavves

Journal-ref: Proceedings of the 41 st International Conference on Machine Learning, Vienna, Austria. PMLR 235, 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[246] arXiv:2406.02507 (cross-list from cs.CV) [pdf, html, other]

Title: Guiding a Diffusion Model with a Bad Version of Itself

Tero Karras, Miika Aittala, Tuomas Kynkäänniemi, Jaakko Lehtinen, Timo Aila, Samuli Laine

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[247] arXiv:2406.02550 (cross-list from cs.LG) [pdf, html, other]

Title: Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks

Tianyu He, Darshil Doshi, Aritra Das, Andrey Gromov

Comments: Camera-ready version, NeurIPS 2024 (Oral)

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); High Energy Physics - Theory (hep-th); Machine Learning (stat.ML)

[248] arXiv:2406.02581 (cross-list from cs.LG) [pdf, html, other]

Title: Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Data

Grant Norman, Jacqueline Wentz, Hemanth Kolla, Kurt Maute, Alireza Doostan

Comments: Minor changes: added references, clarified use of classical solvers over PINNs, minor notation changes. 39 pages, 18 figures

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[249] arXiv:2406.02584 (cross-list from cs.LG) [pdf, html, other]

Title: A Scoping Review of Earth Observation and Machine Learning for Causal Inference: Implications for the Geography of Poverty

Kazuki Sakamoto, Connor T. Jerzak, Adel Daoud

Comments: To appear as: Sakamoto, Kazuki, Connor T. Jerzak, and Adel Daoud. "A Scoping Review of Earth Observation and Machine Learning for Causal Inference: Implications for the Geography of Poverty." In Geography of Poverty, edited by Ola Hall and Ibrahim Wahab. Edward Elgar Publishing (Cheltenham, UK), 2025

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Methodology (stat.ME); Machine Learning (stat.ML)

[250] arXiv:2406.02585 (cross-list from cs.LG) [pdf, html, other]

Title: Contextual Counting: A Mechanistic Study of Transformers on a Quantitative Task

Siavash Golkar, Alberto Bietti, Mariel Pettee, Michael Eickenberg, Miles Cranmer, Keiya Hirashima, Geraud Krawezik, Nicholas Lourie, Michael McCabe, Rudy Morel, Ruben Ohana, Liam Holden Parker, Bruno Régaldo-Saint Blancard, Kyunghyun Cho, Shirley Ho

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)