Statistics Theory

Authors and titles for March 2024

[126] arXiv:2403.08160 (cross-list from stat.ML) [pdf, other]

Title: Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime

Hong Hu, Yue M. Lu, Theodor Misiakiewicz

Comments: 106 pages, 8 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[127] arXiv:2403.08691 (cross-list from math.PR) [pdf, html, other]

Title: Large deviations for Independent Metropolis Hastings and Metropolis-adjusted Langevin algorithm

Federica Milinanni, Pierre Nyquist

Comments: 26 pages, 0 figures, 1 table; changed title, improved abstract and introduction

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[128] arXiv:2403.08831 (cross-list from stat.ML) [pdf, html, other]

Title: Majority-of-Three: The Simplest Optimal Learner?

Ishaq Aden-Ali, Mikael Møller Høgsgaard, Kasper Green Larsen, Nikita Zhivotovskiy

Comments: 22 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[129] arXiv:2403.08938 (cross-list from stat.ML) [pdf, other]

Title: A non-asymptotic theory of Kernel Ridge Regression: deterministic equivalents, test error, and GCV estimator

Theodor Misiakiewicz, Basil Saeed

Comments: 131 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[130] arXiv:2403.09206 (cross-list from stat.ML) [pdf, html, other]

Title: Upper Bound of Bayesian Generalization Error in Partial Concept Bottleneck Model (CBM): Partial CBM outperforms naive CBM

Naoki Hayashi, Yoshihide Sawada

Comments: 17 pages, 1 figure, submitted to TMLR

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Statistics Theory (math.ST)

[131] arXiv:2403.09416 (cross-list from stat.CO) [pdf, html, other]

Title: Scalability of Metropolis-within-Gibbs schemes for high-dimensional Bayesian models

Filippo Ascolani, Gareth O. Roberts, Giacomo Zanella

Subjects: Computation (stat.CO); Statistics Theory (math.ST); Machine Learning (stat.ML)

[132] arXiv:2403.09503 (cross-list from stat.ME) [pdf, html, other]

Title: Shrinkage for Extreme Partial Least-Squares

Julyan Arbel, Stéphane Girard, Hadrien Lorenzo

Comments: 33 pages, 10 figures

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Computation (stat.CO)

[133] arXiv:2403.09604 (cross-list from stat.ME) [pdf, html, other]

Title: Extremal graphical modeling with latent variables via convex optimization

Sebastian Engelke, Armeen Taeb

Comments: Journal of Machine Learning Research, 2025

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[134] arXiv:2403.09877 (cross-list from stat.ME) [pdf, other]

Title: Quantifying Distributional Input Uncertainty via Inflated Kolmogorov-Smirnov Confidence Band

Motong Chen, Henry Lam, Zhenyuan Liu

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[135] arXiv:2403.10352 (cross-list from econ.EM) [pdf, other]

Title: Goodness-of-Fit for Conditional Distributions: An Approach Using Principal Component Analysis and Component Selection

Cui Rui, Li Yuhao

Subjects: Econometrics (econ.EM); Statistics Theory (math.ST)

[136] arXiv:2403.10416 (cross-list from cs.LG) [pdf, html, other]

Title: Robust Sparse Estimation for Gaussians with Optimal Error under Huber Contamination

Ilias Diakonikolas, Daniel M. Kane, Sushrut Karmalkar, Ankit Pensia, Thanasis Pittas

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[137] arXiv:2403.10711 (cross-list from math.PR) [pdf, other]

Title: Gaussian universality for approximately polynomial functions of high-dimensional data

Kevin Han Huang, Morgane Austern, Peter Orbanz

Comments: Fixed a missing m in the upper bound; added a necessary and sufficient condition for asymptotic normality

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[138] arXiv:2403.11013 (cross-list from cs.LG) [pdf, html, other]

Title: Improved Algorithm and Bounds for Successive Projection

Jiashun Jin, Zheng Tracy Ke, Gabriel Moryoussef, Jiajun Tang, Jingming Wang

Comments: 32 pages, 5 figures

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST)

[139] arXiv:2403.11163 (cross-list from stat.ME) [pdf, html, other]

Title: A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques

Xuetong Li, Yuan Gao, Hong Chang, Danyang Huang, Yingying Ma, Rui Pan, Haobo Qi, Feifei Wang, Shuyuan Wu, Ke Xu, Jing Zhou, Xuening Zhu, Yingqiu Zhu, Hansheng Wang

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Statistics Theory (math.ST); Computation (stat.CO)

[140] arXiv:2403.11175 (cross-list from stat.ML) [pdf, html, other]

Title: Prior-dependent analysis of posterior sampling reinforcement learning with function approximation

Yingru Li, Zhi-Quan Luo

Comments: Published in the 27th International Conference on Artificial Intelligence and Statistics (AISTATS)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[141] arXiv:2403.11343 (cross-list from cs.LG) [pdf, other]

Title: Federated Transfer Learning with Differential Privacy

Mengchu Li, Ye Tian, Yang Feng, Yi Yu

Comments: 89 pages, 4 figures

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)

[142] arXiv:2403.11356 (cross-list from stat.ME) [pdf, html, other]

Title: Multiscale Quantile Regression with Local Error Control

Zhi Liu, Housen Li

Comments: The implementation is in R package muscle, available at \url{this https URL}

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[143] arXiv:2403.11374 (cross-list from math.NA) [pdf, html, other]

Title: Quasi-Monte Carlo and importance sampling methods for Bayesian inverse problems

Zhijian He, Hejin Wang, Xiaoqun Wang

Subjects: Numerical Analysis (math.NA); Statistics Theory (math.ST)

[144] arXiv:2403.11438 (cross-list from stat.ME) [pdf, other]

Title: Models of linkage error for capture-recapture estimation without clerical reviews

Abel Dasylva, Arthur Goussanou, Christian-Olivier Nambeu

Comments: 42 pages

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[145] arXiv:2403.11564 (cross-list from stat.ME) [pdf, html, other]

Title: Spatio-temporal point process intensity estimation using zero-deflated subsampling applied to a lightning strikes dataset in France

Jean-François Coeurjolly (SVH), Thibault Espinasse (PSPM, ICJ, UCBL FS), Anne-Laure Fougères (PSPM, ICJ, UCBL FS), Mathieu Ribatet (Nantes Univ - ECN, LMJL)

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[146] arXiv:2403.11954 (cross-list from stat.ME) [pdf, html, other]

Title: Robust Estimation and Inference for Categorical Data

Max Welz

Comments: 47 pages, 3 figures, 1 table (corrected properties of the matrix V)

Subjects: Methodology (stat.ME); Econometrics (econ.EM); Statistics Theory (math.ST)

[147] arXiv:2403.11963 (cross-list from cs.LG) [pdf, html, other]

Title: Transfer Learning Beyond Bounded Density Ratios

Alkis Kalavasis, Ilias Zadik, Manolis Zampetakis

Comments: Abstract shortened to fit ArXiv requirements

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[148] arXiv:2403.11968 (cross-list from cs.LG) [pdf, other]

Title: Unveil Conditional Diffusion Models with Classifier-free Guidance: A Sharp Statistical Theory

Hengyu Fu, Zhuoran Yang, Mengdi Wang, Minshuo Chen

Comments: 92 pages, 5 figures

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[149] arXiv:2403.12158 (cross-list from stat.ML) [pdf, html, other]

Title: Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models

Samyajoy Pal, Christian Heumann

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[150] arXiv:2403.12187 (cross-list from stat.ML) [pdf, html, other]

Title: Approximation of RKHS Functionals by Neural Networks

Tian-Yi Zhou, Namjoon Suh, Guang Cheng, Xiaoming Huo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)