Machine Learning

Authors and titles for October 2024

[751] arXiv:2410.21858 (cross-list from stat.ME) [pdf, html, other]

Title: Joint Estimation of Conditional Mean and Covariance for Unbalanced Panels

Damir Filipovic, Paul Schneider

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Statistical Finance (q-fin.ST); Machine Learning (stat.ML)

[752] arXiv:2410.21869 (cross-list from cs.LG) [pdf, other]

Title: Cross-Entropy Is All You Need To Invert the Data Generating Process

Patrik Reizinger, Alice Bizeul, Attila Juhos, Julia E. Vogt, Randall Balestriero, Wieland Brendel, David Klindt

Comments: ICLR 2025 (oral) camera ready

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[753] arXiv:2410.22069 (cross-list from cs.LG) [pdf, html, other]

Title: Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks

Nikolaos Tsilivis, Gal Vardi, Julia Kempe

Comments: The earlier conference version (ICLR 2025) of this paper showed a bias towards KKT points of the max-margin problem only in the case of 'smooth' norms. The current version (submitted to JMLR) proves that this holds true for any norm. It also includes new experiments on the implicit bias of the Shampoo algorithm

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[754] arXiv:2410.22113 (cross-list from cs.LG) [pdf, html, other]

Title: Where Do Large Learning Rates Lead Us?

Ildus Sadrtdinov, Maxim Kodryan, Eduard Pokonechny, Ekaterina Lobacheva, Dmitry Vetrov

Comments: Published in NeurIPS 2024. First three authors contributed equally, last two authors share senior authorship

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[755] arXiv:2410.22192 (cross-list from cs.LG) [pdf, html, other]

Title: $r$Age-$k$: Communication-Efficient Federated Learning Using Age Factor

Matin Mortaheb, Priyanka Kaswan, Sennur Ulukus

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP); Machine Learning (stat.ML)

[756] arXiv:2410.22244 (cross-list from cs.LG) [pdf, other]

Title: Abrupt Learning in Transformers: A Case Study on Matrix Completion

Pulkit Gopalani, Ekdeep Singh Lubana, Wei Hu

Comments: NeurIPS 2024 Poster

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[757] arXiv:2410.22248 (cross-list from stat.ME) [pdf, html, other]

Title: Model-free Estimation of Latent Structure via Multiscale Nonparametric Maximum Likelihood

Bryon Aragam, Ruiyi Yang

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[758] arXiv:2410.22258 (cross-list from cs.LG) [pdf, html, other]

Title: LipKernel: Lipschitz-Bounded Convolutional Neural Networks via Dissipative Layers

Patricia Pauli, Ruigang Wang, Ian Manchester, Frank Allgöwer

Subjects: Machine Learning (cs.LG); Image and Video Processing (eess.IV); Systems and Control (eess.SY); Machine Learning (stat.ML)

[759] arXiv:2410.22269 (cross-list from cs.LG) [pdf, html, other]

Title: Fourier Head: Helping Large Language Models Learn Complex Probability Distributions

Nate Gillman, Daksh Aggarwal, Michael Freeman, Saurabh Singh, Chen Sun

Comments: Camera ready version (ICLR 2025). Code at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[760] arXiv:2410.22297 (cross-list from math.OC) [pdf, other]

Title: Shuffling Gradient-Based Methods for Nonconvex-Concave Minimax Optimization

Quoc Tran-Dinh, Trang H. Tran, Lam M. Nguyen

Comments: 45 pages, 5 figures (38th Conference on Neural Information Processing Systems (NeurIPS 2024))

Journal-ref: 38th Conference on Neural Information Processing Systems (NeurIPS 2024

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[761] arXiv:2410.22322 (cross-list from cs.LG) [pdf, html, other]

Title: Optimizing Posterior Samples for Bayesian Optimization via Rootfinding

Taiwo A. Adebiyi, Bach Do, Ruda Zhang

Comments: Published at the Thirteenth International Conference on Learning Representations (ICLR 2025)

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[762] arXiv:2410.22381 (cross-list from cs.LG) [pdf, html, other]

Title: Robust training of implicit generative models for multivariate and heavy-tailed distributions with an invariant statistical loss

José Manuel de Frutos, Manuel A. Vázquez, Pablo Olmos, Joaquín Míguez

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation (stat.CO); Machine Learning (stat.ML)

[763] arXiv:2410.22493 (cross-list from cs.LG) [pdf, html, other]

Title: Unlocking Point Processes through Point Set Diffusion

David Lüdke, Enric Rabasseda Raventós, Marcel Kollovieh, Stephan Günnemann

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[764] arXiv:2410.22559 (cross-list from cs.LG) [pdf, html, other]

Title: Unpicking Data at the Seams: Understanding Disentanglement in VAEs

Carl Allen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[765] arXiv:2410.22573 (cross-list from cs.LG) [pdf, html, other]

Title: Flow Matching for Posterior Inference with Simulator Feedback

Benjamin Holzschuh, Nils Thuerey

Comments: Code available at this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[766] arXiv:2410.22574 (cross-list from econ.EM) [pdf, html, other]

Title: Inference in Partially Linear Models under Dependent Data with Deep Neural Networks

Chad Brown

Comments: 26 pages, 1 figure. arXiv admin note: substantial text overlap with arXiv:2410.11113

Subjects: Econometrics (econ.EM); Machine Learning (stat.ML)

[767] arXiv:2410.22749 (cross-list from cs.LG) [pdf, html, other]

Title: Understanding Aggregations of Proper Learners in Multiclass Classification

Julian Asilis, Mikael Møller Høgsgaard, Grigoris Velegkas

Comments: 23 pages

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[768] arXiv:2410.22812 (cross-list from cs.LG) [pdf, html, other]

Title: Universality of the $π^2/6$ Pathway in Avoiding Model Collapse

Apratim Dey, David Donoho

Comments: 30 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET); Statistics Theory (math.ST); Machine Learning (stat.ML)

[769] arXiv:2410.22872 (cross-list from cs.LG) [pdf, html, other]

Title: Data subsampling for Poisson regression with pth-root-link

Han Cheng Lie, Alexander Munteanu

Comments: NeurIPS 2024

Journal-ref: Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[770] arXiv:2410.22908 (cross-list from cs.LG) [pdf, other]

Title: Federated UCBVI: Communication-Efficient Federated Regret Minimization with Heterogeneous Agents

Safwan Labbi, Daniil Tiapkin, Lorenzo Mancini, Paul Mangold, Eric Moulines

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[771] arXiv:2410.22948 (cross-list from cs.LG) [pdf, other]

Title: ELBOing Stein: Variational Bayes with Stein Mixture Inference

Ola Rønning, Eric Nalisnick, Christophe Ley, Padhraic Smyth, Thomas Hamelryck

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[772] arXiv:2410.23087 (cross-list from cs.DS) [pdf, html, other]

Title: Statistical-Computational Trade-offs for Density Estimation

Anders Aamand, Alexandr Andoni, Justin Y. Chen, Piotr Indyk, Shyam Narayanan, Sandeep Silwal, Haike Xu

Comments: To appear at NeurIPS 2024

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[773] arXiv:2410.23129 (cross-list from cs.LG) [pdf, other]

Title: Why Fine-grained Labels in Pretraining Benefit Generalization?

Guan Zhe Hong, Yin Cui, Ariel Fuxman, Stanley Chan, Enming Luo

Comments: arXiv admin note: substantial text overlap with arXiv:2303.16887

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[774] arXiv:2410.23147 (cross-list from cs.LG) [pdf, html, other]

Title: FoLDTree: A ULDA-Based Decision Tree Framework for Efficient Oblique Splits and Feature Selection

Siyu Wang

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[775] arXiv:2410.23155 (cross-list from cs.LG) [pdf, html, other]

Title: QWO: Speeding Up Permutation-Based Causal Discovery in LiGAMs

Mohammad Shahverdikondori, Ehsan Mokhtarian, Negar Kiyavash

Comments: 21 pages, 4 figures

Subjects: Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[776] arXiv:2410.23222 (cross-list from cs.LG) [pdf, other]

Title: Partial Channel Dependence with Channel Masks for Time Series Foundation Models

Seunghan Lee, Taeyoung Park, Kibok Lee

Comments: NeurIPS Workshop on Time Series in the Age of Large Models, 2024. Oral presentation

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[777] arXiv:2410.23246 (cross-list from stat.ME) [pdf, html, other]

Title: Progression: an extrapolation principle for regression

Gloria Buriticá, Sebastian Engelke

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[778] arXiv:2410.23275 (cross-list from q-fin.RM) [pdf, html, other]

Title: Conditional Forecasting of Margin Calls using Dynamic Graph Neural Networks

Matteo Citterio, Marco D'Errico, Gabriele Visentin

Subjects: Risk Management (q-fin.RM); Machine Learning (cs.LG); Machine Learning (stat.ML)

[779] arXiv:2410.23285 (cross-list from cs.LG) [pdf, other]

Title: Provable Acceleration for Diffusion Models under Minimal Assumptions

Gen Li, Changxiao Cai

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)

[780] arXiv:2410.23356 (cross-list from cs.LG) [pdf, other]

Title: Sequential Order-Robust Mamba for Time Series Forecasting

Seunghan Lee, Juri Hong, Kibok Lee, Taeyoung Park

Comments: NeurIPS Workshop on Time Series in the Age of Large Models, 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[781] arXiv:2410.23405 (cross-list from cs.LG) [pdf, html, other]

Title: FlowLLM: Flow Matching for Material Generation with Large Language Models as Base Distributions

Anuroop Sriram, Benjamin Kurt Miller, Ricky T. Q. Chen, Brandon M. Wood

Journal-ref: NeurIPS 2024

Subjects: Machine Learning (cs.LG); Materials Science (cond-mat.mtrl-sci); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[782] arXiv:2410.23412 (cross-list from stat.ME) [pdf, html, other]

Title: BAMITA: Bayesian Multiple Imputation for Tensor Arrays

Ziren Jiang, Gen Li, Eric F. Lock

Comments: 27 pages, 5 tables, 2 figures

Subjects: Methodology (stat.ME); Quantitative Methods (q-bio.QM); Machine Learning (stat.ML)

[783] arXiv:2410.23450 (cross-list from cs.LG) [pdf, html, other]

Title: Return Augmented Decision Transformer for Off-Dynamics Reinforcement Learning

Ruhan Wang, Yu Yang, Zhishuai Liu, Dongruo Zhou, Pan Xu

Comments: 26 pages, 10 tables, 10 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Robotics (cs.RO); Machine Learning (stat.ML)

[784] arXiv:2410.23482 (cross-list from cs.LG) [pdf, html, other]

Title: Multi-fidelity Machine Learning for Uncertainty Quantification and Optimization

Ruda Zhang, Negin Alemazkoor

Journal-ref: Journal of Machine Learning for Modeling and Computing, Vol. 5, No. 4, pp. 77--94, (2024)

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[785] arXiv:2410.23498 (cross-list from cs.LG) [pdf, html, other]

Title: Kernel-Based Function Approximation for Average Reward Reinforcement Learning: An Optimist No-Regret Algorithm

Sattar Vakili, Julia Olkhovskaya

Comments: 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[786] arXiv:2410.23499 (cross-list from cs.LG) [pdf, html, other]

Title: Tangent Space Causal Inference: Leveraging Vector Fields for Causal Discovery in Dynamical Systems

Kurt Butler, Daniel Waxman, Petar M. Djurić

Comments: 18 pages, 7 figures. Accepted to NeurIPS 2024

Subjects: Machine Learning (cs.LG); Chaotic Dynamics (nlin.CD); Machine Learning (stat.ML)

[787] arXiv:2410.23594 (cross-list from cs.LG) [pdf, html, other]

Title: How Do Flow Matching Models Memorize and Generalize in Sample Data Subspaces?

Weiguo Gao, Ming Li

Comments: 33 pages, 9 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[788] arXiv:2410.23601 (cross-list from cs.LG) [pdf, html, other]

Title: Stabilizing Linear Passive-Aggressive Online Learning with Weighted Reservoir Sampling

Skyler Wu, Fred Lu, Edward Raff, James Holt

Comments: To appear in the 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[789] arXiv:2410.23620 (cross-list from cs.LG) [pdf, html, other]

Title: Identifiability Guarantees for Causal Disentanglement from Purely Observational Data

Ryan Welch, Jiaqi Zhang, Caroline Uhler

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[790] arXiv:2410.23632 (cross-list from cs.LG) [pdf, html, other]

Title: Sample-Efficient Agnostic Boosting

Udaya Ghai, Karan Singh

Comments: NeurIPS 2024 camera ready version

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[791] arXiv:2410.23644 (cross-list from cs.LG) [pdf, html, other]

Title: Online Consistency of the Nearest Neighbor Rule

Sanjoy Dasgupta, Geelon So

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[792] arXiv:2410.23667 (cross-list from cs.LG) [pdf, html, other]

Title: Projected Neural Differential Equations for Learning Constrained Dynamics

Alistair White, Anna Büttner, Maximilian Gelbrecht, Valentin Duruisseaux, Niki Kilbertus, Frank Hellmann, Niklas Boers

Comments: 17 pages, 6 figures

Subjects: Machine Learning (cs.LG); Computational Physics (physics.comp-ph); Machine Learning (stat.ML)

[793] arXiv:2410.23672 (cross-list from cs.LG) [pdf, other]

Title: Provable Benefit of Cutout and CutMix for Feature Learning

Junsoo Oh, Chulhee Yun

Comments: NeurIPS 2024 camera-ready version, 81 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[794] arXiv:2410.23677 (cross-list from cs.LG) [pdf, other]

Title: Wide Two-Layer Networks can Learn from Adversarial Perturbations

Soichiro Kumano, Hiroshi Kera, Toshihiko Yamasaki

Comments: NeurIPS24

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[795] arXiv:2410.23772 (cross-list from cs.LG) [pdf, html, other]

Title: Disentangling Interactions and Dependencies in Feature Attribution

Gunnar König, Eric Günther, Ulrike von Luxburg

Comments: GK and EG contributed equally to this article

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[796] arXiv:2410.23937 (cross-list from cs.LG) [pdf, html, other]

Title: Robust Sparse Regression with Non-Isotropic Designs

Chih-Hung Liu, Gleb Novikov

Comments: NeurIPS 2024; Authors have equal contribution

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[797] arXiv:2410.24050 (cross-list from cs.LG) [pdf, html, other]

Title: Clustering Head: A Visual Case Study of the Training Dynamics in Transformers

Ambroise Odonnat, Wassim Bouaziz, Vivien Cabannes

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[798] arXiv:2410.24059 (cross-list from cs.LG) [pdf, html, other]

Title: Identifying General Mechanism Shifts in Linear Causal Representations

Tianyu Chen, Kevin Bello, Francesco Locatello, Bryon Aragam, Pradeep Ravikumar

Comments: NeurIPS 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[799] arXiv:2410.24079 (cross-list from cs.LG) [pdf, html, other]

Title: Hamiltonian Monte Carlo Inference of Marginalized Linear Mixed-Effects Models

Jinlin Lai, Justin Domke, Daniel Sheldon

Comments: 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[800] arXiv:2410.24206 (cross-list from cs.LG) [pdf, other]

Title: Understanding Optimization in Deep Learning with Central Flows

Jeremy M. Cohen, Alex Damian, Ameet Talwalkar, Zico Kolter, Jason D. Lee

Comments: first two authors contributed equally; author order determined by coin flip

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)