Machine Learning

Authors and titles for September 2024

[301] arXiv:2409.10673 (cross-list from cs.LG) [pdf, html, other]

Title: A Bayesian Interpretation of Adaptive Low-Rank Adaptation

Haolin Chen, Philip N. Garner

Comments: ICASSP 2025

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[302] arXiv:2409.10773 (cross-list from math.OC) [pdf, html, other]

Title: Tight Lower Bounds under Asymmetric High-Order Hölder Smoothness and Uniform Convexity

Site Bai, Brian Bullins

Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)

[303] arXiv:2409.10855 (cross-list from stat.ME) [pdf, html, other]

Title: Calibrated Multivariate Regression with Localized PIT Mappings

Lucas Kock, G. S. Rodrigues, Scott A. Sisson, Nadja Klein, David J. Nott

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[304] arXiv:2409.11008 (cross-list from cs.LG) [pdf, html, other]

Title: Latent mixed-effect models for high-dimensional longitudinal data

Priscilla Ong, Manuel Haußmann, Otto Lönnroth, Harri Lähdesmäki

Comments: Under review

Subjects: Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)

[305] arXiv:2409.11100 (cross-list from cs.LG) [pdf, html, other]

Title: Fractional Naive Bayes (FNB): non-convex optimization for a parsimonious weighted selective naive Bayes classifier

Carine Hue, Marc Boullé

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[306] arXiv:2409.11141 (cross-list from eess.SY) [pdf, html, other]

Title: Sample Complexity Bounds for Linear System Identification from a Finite Set

Nicolas Chatzikiriakos, Andrea Iannelli

Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Machine Learning (stat.ML)

[307] arXiv:2409.11265 (cross-list from stat.ME) [pdf, html, other]

Title: Performance of Cross-Validated Targeted Maximum Likelihood Estimation

Matthew J. Smith, Rachael V. Phillips, Camille Maringe, Miguel Angel Luque-Fernandez

Comments: 20 pages, 3 figures, 1 table

Subjects: Methodology (stat.ME); Applications (stat.AP); Machine Learning (stat.ML)

[308] arXiv:2409.11497 (cross-list from stat.ME) [pdf, html, other]

Title: Decomposing Gaussians with Unknown Covariance

Ameer Dharamshi, Anna Neufeld, Lucy L. Gao, Jacob Bien, Daniela Witten

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[309] arXiv:2409.11519 (cross-list from physics.comp-ph) [pdf, html, other]

Title: On the generalization ability of coarse-grained molecular dynamics models for non-equilibrium processes

Liyao Lyu, Huan Lei

Subjects: Computational Physics (physics.comp-ph); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[310] arXiv:2409.11521 (cross-list from cs.LG) [pdf, html, other]

Title: Partially Observable Contextual Bandits with Linear Payoffs

Sihan Zeng, Sujay Bhatt, Alec Koppel, Sumitra Ganesh

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[311] arXiv:2409.11583 (cross-list from eess.SP) [pdf, html, other]

Title: Uncertainty Decomposition and Error Margin Detection of Homodyned-K Distribution in Quantitative Ultrasound

Dorsa Ameri, Ali K. Z. Tehrani, Ivan M. Rosado-Mendez, Hassan Rivaz

Comments: 4 pages, 2 figures

Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV); Medical Physics (physics.med-ph); Machine Learning (stat.ML)

[312] arXiv:2409.11597 (cross-list from cs.CC) [pdf, html, other]

Title: The Sample Complexity of Smooth Boosting and the Tightness of the Hardcore Theorem

Guy Blanc, Alexandre Hayderi, Caleb Koch, Li-Yang Tan

Comments: 46 pages, FOCS 2024

Subjects: Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[313] arXiv:2409.11618 (cross-list from cs.LG) [pdf, html, other]

Title: PieClam: A Universal Graph Autoencoder Based on Overlapping Inclusive and Exclusive Communities

Daniel Zilberg, Ron Levie

Subjects: Machine Learning (cs.LG); Social and Information Networks (cs.SI); Machine Learning (stat.ML)

[314] arXiv:2409.11684 (cross-list from cs.LG) [pdf, html, other]

Title: Recurrent Interpolants for Probabilistic Time Series Prediction

Yu Chen, Marin Biloš, Sarthak Mittal, Wei Deng, Kashif Rasul, Anderson Schneider

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[315] arXiv:2409.12255 (cross-list from cs.LG) [pdf, html, other]

Title: Efficient Data Subset Selection to Generalize Training Across Models: Transductive and Inductive Networks

Eeshaan Jain, Tushar Nandy, Gaurav Aggarwal, Ashish Tendulkar, Rishabh Iyer, Abir De

Comments: Published at NeurIPS 2023

Journal-ref: Advances in Neural Information Processing Systems, 36 (2024)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[316] arXiv:2409.12264 (cross-list from cs.LG) [pdf, html, other]

Title: User-friendly Foundation Model Adapters for Multivariate Time Series Classification

Vasilii Feofanov, Romain Ilbert, Malik Tiomoko, Themis Palpanas, Ievgen Redko

Comments: The first two authors contributed equally

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[317] arXiv:2409.12293 (cross-list from cs.LG) [pdf, html, other]

Title: Provable In-Context Learning of Linear Systems and Linear Elliptic PDEs with Transformers

Frank Cole, Yulong Lu, Riley O'Neill, Tianhao Zhang

Comments: Code available at this https URL LuGroupUMN/ICL-EllipticPDEs

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[318] arXiv:2409.12295 (cross-list from cs.LG) [pdf, other]

Title: SANE: Strategic Autonomous Non-Smooth Exploration for Multiple Optima Discovery in Multi-modal and Non-differentiable Black-box Functions

Arpan Biswas, Rama Vasudevan, Rohit Pant, Ichiro Takeuchi, Hiroshi Funakubo, Yongtao Liu

Comments: 25 pages, 7 figures in main text, 2 figures in Supp Mat

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[319] arXiv:2409.12335 (cross-list from cs.LG) [pdf, other]

Title: Bridging the Gap Between Approximation and Learning via Optimal Approximation by ReLU MLPs of Maximal Regularity

Ruiyang Hong, Anastasis Kratsios

Comments: 16 pages main body, 40 pages proofs, 7 figures, 1 table

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Functional Analysis (math.FA); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[320] arXiv:2409.12371 (cross-list from cs.LG) [pdf, html, other]

Title: Communication-Efficient Federated Low-Rank Update Algorithm and its Connection to Implicit Regularization

Haemin Park, Diego Klabjan

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[321] arXiv:2409.12446 (cross-list from cs.LG) [pdf, html, other]

Title: Neural Networks Generalize on Low Complexity Data

Sourav Chatterjee, Timothy Sudijono

Comments: 28 pages. V2: Further references added

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Statistics Theory (math.ST); Machine Learning (stat.ML)

[322] arXiv:2409.12693 (cross-list from quant-ph) [pdf, html, other]

Title: Coherence influx is indispensable for quantum reservoir computing

Shumpei Kobayashi, Quoc Hoan Tran, Kohei Nakajima

Comments: 21 pages, 9 figures

Subjects: Quantum Physics (quant-ph); Dynamical Systems (math.DS); Machine Learning (stat.ML)

[323] arXiv:2409.12877 (cross-list from physics.comp-ph) [pdf, html, other]

Title: Physics aware machine learning for micromagnetic energy minimization: recent algorithmic developments

Sebastian Schaffer, Thomas Schrefl, Harald Oezelt, Norbert J Mauser, Lukas Exl

Comments: 39 pages, 9 figures

Subjects: Computational Physics (physics.comp-ph); Machine Learning (stat.ML)

[324] arXiv:2409.12913 (cross-list from cs.LG) [pdf, html, other]

Title: Universal approximation theorem for neural networks with inputs from a topological vector space

Vugar Ismailov

Comments: 10 pages

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[325] arXiv:2409.12947 (cross-list from cs.LG) [pdf, html, other]

Title: Unrolled denoising networks provably learn optimal Bayesian inference

Aayush Karan, Kulin Shah, Sitan Chen, Yonina C. Eldar

Comments: 32 pages

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[326] arXiv:2409.13000 (cross-list from cs.LG) [pdf, other]

Title: Introducing the Large Medical Model: State of the art healthcare cost and risk prediction with transformers trained on patient event sequences

Ricky Sahu, Eric Marriott, Ethan Siegel, David Wagner, Flore Uzan, Troy Yang, Asim Javed

Comments: 10 pages, 10 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Applications (stat.AP); Machine Learning (stat.ML)

[327] arXiv:2409.13053 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Unbiased Evaluation of Time-series Anomaly Detector

Debarpan Bhattacharya, Sumanta Mukherjee, Chandramouli Kamanchi, Vijay Ekambaram, Arindam Jati, Pankaj Dayama

Comments: 5 pages, 6 figures

Subjects: Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)

[328] arXiv:2409.13074 (cross-list from cs.LG) [pdf, html, other]

Title: What does guidance do? A fine-grained analysis in a simple setting

Muthu Chidambaram, Khashayar Gatmiry, Sitan Chen, Holden Lee, Jianfeng Lu

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[329] arXiv:2409.13098 (cross-list from cs.SI) [pdf, html, other]

Title: Predicting soccer matches with complex networks and machine learning

Eduardo Alves Baratela, Felipe Jordão Xavier, Thomas Peron, Paulino Ribeiro Villas-Boas, Francisco Aparecido Rodrigues

Comments: To appear in Journal of Complex Networks

Subjects: Social and Information Networks (cs.SI); Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)

[330] arXiv:2409.13198 (cross-list from cs.CL) [pdf, html, other]

Title: Exploring Scaling Laws for Local SGD in Large Language Model Training

Qiaozhi He, Xiaomin Zhuang, Zhihua Wu

Comments: Technical Report

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[331] arXiv:2409.13280 (cross-list from cs.LG) [pdf, html, other]

Title: Efficient Training of Deep Neural Operator Networks via Randomized Sampling

Sharmila Karumuri, Lori Graham-Brady, Somdatta Goswami

Subjects: Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[332] arXiv:2409.13453 (cross-list from math.NA) [pdf, html, other]

Title: Data Compression using Rank-1 Lattices for Parameter Estimation in Machine Learning

Michael Gnewuch, Kumar Harsha, Marcin Wnuk

Comments: 25 pages, 1 figure

Subjects: Numerical Analysis (math.NA); Machine Learning (cs.LG); Machine Learning (stat.ML)

[333] arXiv:2409.13728 (cross-list from cs.CL) [pdf, other]

Title: Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts

Anna Mészáros, Szilvia Ujváry, Wieland Brendel, Patrik Reizinger, Ferenc Huszár

Comments: Accepted as a spotlight poster at NeurIPS2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[334] arXiv:2409.13745 (cross-list from cs.CL) [pdf, html, other]

Title: Context-Aware Membership Inference Attacks against Pre-trained Large Language Models

Hongyan Chang, Ali Shahin Shamsabadi, Kleomenis Katevas, Hamed Haddadi, Reza Shokri

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[335] arXiv:2409.13876 (cross-list from cs.LG) [pdf, other]

Title: Physics-Informed Variational State-Space Gaussian Processes

Oliver Hamelijnck, Arno Solin, Theodoros Damoulas

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[336] arXiv:2409.13888 (cross-list from cs.LG) [pdf, html, other]

Title: Causal Feature Selection Method for Contextual Multi-Armed Bandits in Recommender System

Zhenyu Zhao, Yexi Jiang

Subjects: Machine Learning (cs.LG); Information Retrieval (cs.IR); Machine Learning (stat.ML)

[337] arXiv:2409.13940 (cross-list from cs.LG) [pdf, html, other]

Title: Learning Recourse Costs from Pairwise Feature Comparisons

Kaivalya Rawal, Himabindu Lakkaraju

Comments: "Recourse for Humans", paper 49 from the Participatory Approaches to Machine Learning workshop at the International Conference on Machine Learning (ICML) 2020. For workshop website, see this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (stat.ML)

[338] arXiv:2409.14016 (cross-list from astro-ph.SR) [pdf, html, other]

Title: Enhancing Multivariate Time Series-based Solar Flare Prediction with Multifaceted Preprocessing and Contrastive Learning

MohammadReza EskandariNasab, Shah Muhammad Hamdi, Soukaina Filali Boubrahimi

Comments: This work has been accepted at ICMLA 2024 on September 7, 2024, as a regular paper for an oral presentation

Subjects: Solar and Stellar Astrophysics (astro-ph.SR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[339] arXiv:2409.14157 (cross-list from q-fin.ST) [pdf, html, other]

Title: Price predictability in limit order book with deep learning model

Kyungsub Lee

Subjects: Statistical Finance (q-fin.ST); Trading and Market Microstructure (q-fin.TR); Machine Learning (stat.ML)

[340] arXiv:2409.14202 (cross-list from econ.EM) [pdf, html, other]

Title: Mining Causality: AI-Assisted Search for Instrumental Variables

Sukjin Han

Subjects: Econometrics (econ.EM); Applications (stat.AP); Methodology (stat.ME); Machine Learning (stat.ML)

[341] arXiv:2409.14513 (cross-list from cs.LG) [pdf, html, other]

Title: Order of Magnitude Speedups for LLM Membership Inference

Rongting Zhang, Martin Bertran, Aaron Roth

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[342] arXiv:2409.14585 (cross-list from math.NA) [pdf, other]

Title: A convergent scheme for the Bayesian filtering problem based on the Fokker--Planck equation and deep splitting

Kasper Bågmark, Adam Andersson, Stig Larsson, Filip Rydin

Comments: 25 pages, 2 figures

Subjects: Numerical Analysis (math.NA); Probability (math.PR); Computation (stat.CO); Machine Learning (stat.ML)

[343] arXiv:2409.14590 (cross-list from cs.LG) [pdf, html, other]

Title: Explainable AI needs formal notions of explanation correctness

Stefan Haufe, Rick Wilming, Benedict Clark, Rustam Zhumagambetov, Danny Panknin, Ahcène Boubekki

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[344] arXiv:2409.14593 (cross-list from cs.LG) [pdf, other]

Title: Testing Causal Models with Hidden Variables in Polynomial Delay via Conditional Independencies

Hyunchai Jeong, Adiba Ejaz, Jin Tian, Elias Bareinboim

Comments: 34 total pages, 14 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Methodology (stat.ME); Machine Learning (stat.ML)

[345] arXiv:2409.14906 (cross-list from cs.LG) [pdf, other]

Title: Kriformer: A Novel Spatiotemporal Kriging Approach Based on Graph Transformers

Renbin Pan, Feng Xiao, Hegui Zhang, Minyu Shen

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[346] arXiv:2409.15143 (cross-list from cs.LG) [pdf, html, other]

Title: Designing an Interpretable Interface for Contextual Bandits

Andrew Maher, Matia Gobbo, Lancelot Lachartre, Subash Prabanantham, Rowan Swiers, Puli Liyanagama

Comments: 10 pages, 1 figure, Accepted at the IntRS 24 workshop, co-located with ACM RecSys 24

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[347] arXiv:2409.15156 (cross-list from cs.LG) [pdf, html, other]

Title: Rethinking Conventional Wisdom in Machine Learning: From Generalization to Scaling

Lechao Xiao

Comments: 25 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[348] arXiv:2409.15252 (cross-list from math.ST) [pdf, other]

Title: Precise Asymptotics of Bagging Regularized M-estimators

Takuya Koriyama, Pratik Patil, Jin-Hong Du, Kai Tan, Pierre C. Bellec

Comments: 72 pages, 14 figures, 6 tables

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[349] arXiv:2409.15393 (cross-list from cs.LG) [pdf, html, other]

Title: Approximated Orthogonal Projection Unit: Stabilizing Regression Network Training Using Natural Gradient

Shaoqi Wang, Chunjie Yang, Siwei Lou

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[350] arXiv:2409.15530 (cross-list from econ.EM) [pdf, other]

Title: Identifying Elasticities in Autocorrelated Time Series Using Causal Graphs

Silvana Tiedemann (1), Jorge Sanchez Canales (1), Felix Schur (2), Raffaele Sgarlato (1), Lion Hirth (1), Oliver Ruhnau (3), Jonas Peters (2) ((1) Centre for Sustainability, Hertie School, (2) Department of Mathematics, ETH Zurich, (3) Department of Economics and Institute of Energy Economics, University of Cologne)

Subjects: Econometrics (econ.EM); Methodology (stat.ME); Machine Learning (stat.ML)