Statistics Theory

Authors and titles for March 2024

[126] arXiv:2403.08160 (cross-list from stat.ML) [pdf, other]

Title: Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime

Hong Hu, Yue M. Lu, Theodor Misiakiewicz

Comments: 106 pages, 8 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[127] arXiv:2403.08691 (cross-list from math.PR) [pdf, html, other]

Title: Large deviations for Independent Metropolis Hastings and Metropolis-adjusted Langevin algorithm

Federica Milinanni, Pierre Nyquist

Comments: 26 pages, 0 figures, 1 table; changed title, improved abstract and introduction

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[128] arXiv:2403.08831 (cross-list from stat.ML) [pdf, html, other]

Title: Majority-of-Three: The Simplest Optimal Learner?

Ishaq Aden-Ali, Mikael Møller Høgsgaard, Kasper Green Larsen, Nikita Zhivotovskiy

Comments: 22 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[129] arXiv:2403.08938 (cross-list from stat.ML) [pdf, other]

Title: A non-asymptotic theory of Kernel Ridge Regression: deterministic equivalents, test error, and GCV estimator

Theodor Misiakiewicz, Basil Saeed

Comments: 131 pages, 4 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[130] arXiv:2403.09206 (cross-list from stat.ML) [pdf, html, other]

Title: Upper Bound of Bayesian Generalization Error in Partial Concept Bottleneck Model (CBM): Partial CBM outperforms naive CBM

Naoki Hayashi, Yoshihide Sawada

Comments: 17 pages, 1 figure, submitted to TMLR

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Statistics Theory (math.ST)

[131] arXiv:2403.09416 (cross-list from stat.CO) [pdf, html, other]

Title: Scalability of Metropolis-within-Gibbs schemes for high-dimensional Bayesian models

Filippo Ascolani, Gareth O. Roberts, Giacomo Zanella

Subjects: Computation (stat.CO); Statistics Theory (math.ST); Machine Learning (stat.ML)

[132] arXiv:2403.09503 (cross-list from stat.ME) [pdf, html, other]

Title: Shrinkage for Extreme Partial Least-Squares

Julyan Arbel, Stéphane Girard, Hadrien Lorenzo

Comments: 33 pages, 10 figures

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Computation (stat.CO)

[133] arXiv:2403.09604 (cross-list from stat.ME) [pdf, html, other]

Title: Extremal graphical modeling with latent variables via convex optimization

Sebastian Engelke, Armeen Taeb

Comments: Journal of Machine Learning Research, 2025

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[134] arXiv:2403.09877 (cross-list from stat.ME) [pdf, other]

Title: Quantifying Distributional Input Uncertainty via Inflated Kolmogorov-Smirnov Confidence Band

Motong Chen, Henry Lam, Zhenyuan Liu

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[135] arXiv:2403.10352 (cross-list from econ.EM) [pdf, other]

Title: Goodness-of-Fit for Conditional Distributions: An Approach Using Principal Component Analysis and Component Selection

Cui Rui, Li Yuhao

Subjects: Econometrics (econ.EM); Statistics Theory (math.ST)

[136] arXiv:2403.10416 (cross-list from cs.LG) [pdf, html, other]

Title: Robust Sparse Estimation for Gaussians with Optimal Error under Huber Contamination

Ilias Diakonikolas, Daniel M. Kane, Sushrut Karmalkar, Ankit Pensia, Thanasis Pittas

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[137] arXiv:2403.10711 (cross-list from math.PR) [pdf, other]

Title: Gaussian universality for approximately polynomial functions of high-dimensional data

Kevin Han Huang, Morgane Austern, Peter Orbanz

Comments: Fixed a missing m in the upper bound; added a necessary and sufficient condition for asymptotic normality

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[138] arXiv:2403.11013 (cross-list from cs.LG) [pdf, html, other]

Title: Improved Algorithm and Bounds for Successive Projection

Jiashun Jin, Zheng Tracy Ke, Gabriel Moryoussef, Jiajun Tang, Jingming Wang

Comments: 32 pages, 5 figures

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST)

[139] arXiv:2403.11163 (cross-list from stat.ME) [pdf, html, other]

Title: A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques

Xuetong Li, Yuan Gao, Hong Chang, Danyang Huang, Yingying Ma, Rui Pan, Haobo Qi, Feifei Wang, Shuyuan Wu, Ke Xu, Jing Zhou, Xuening Zhu, Yingqiu Zhu, Hansheng Wang

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Statistics Theory (math.ST); Computation (stat.CO)

[140] arXiv:2403.11175 (cross-list from stat.ML) [pdf, html, other]

Title: Prior-dependent analysis of posterior sampling reinforcement learning with function approximation

Yingru Li, Zhi-Quan Luo

Comments: Published in the 27th International Conference on Artificial Intelligence and Statistics (AISTATS)

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[141] arXiv:2403.11343 (cross-list from cs.LG) [pdf, other]

Title: Federated Transfer Learning with Differential Privacy

Mengchu Li, Ye Tian, Yang Feng, Yi Yu

Comments: 89 pages, 4 figures

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)

[142] arXiv:2403.11356 (cross-list from stat.ME) [pdf, html, other]

Title: Multiscale Quantile Regression with Local Error Control

Zhi Liu, Housen Li

Comments: The implementation is in R package muscle, available at \url{this https URL}

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[143] arXiv:2403.11374 (cross-list from math.NA) [pdf, html, other]

Title: Quasi-Monte Carlo and importance sampling methods for Bayesian inverse problems

Zhijian He, Hejin Wang, Xiaoqun Wang

Subjects: Numerical Analysis (math.NA); Statistics Theory (math.ST)

[144] arXiv:2403.11438 (cross-list from stat.ME) [pdf, other]

Title: Models of linkage error for capture-recapture estimation without clerical reviews

Abel Dasylva, Arthur Goussanou, Christian-Olivier Nambeu

Comments: 42 pages

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[145] arXiv:2403.11564 (cross-list from stat.ME) [pdf, html, other]

Title: Spatio-temporal point process intensity estimation using zero-deflated subsampling applied to a lightning strikes dataset in France

Jean-François Coeurjolly (SVH), Thibault Espinasse (PSPM, ICJ, UCBL FS), Anne-Laure Fougères (PSPM, ICJ, UCBL FS), Mathieu Ribatet (Nantes Univ - ECN, LMJL)

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[146] arXiv:2403.11954 (cross-list from stat.ME) [pdf, html, other]

Title: Robust Estimation and Inference for Categorical Data

Max Welz

Comments: 47 pages, 3 figures, 1 table (corrected properties of the matrix V)

Subjects: Methodology (stat.ME); Econometrics (econ.EM); Statistics Theory (math.ST)

[147] arXiv:2403.11963 (cross-list from cs.LG) [pdf, html, other]

Title: Transfer Learning Beyond Bounded Density Ratios

Alkis Kalavasis, Ilias Zadik, Manolis Zampetakis

Comments: Abstract shortened to fit ArXiv requirements

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[148] arXiv:2403.11968 (cross-list from cs.LG) [pdf, other]

Title: Unveil Conditional Diffusion Models with Classifier-free Guidance: A Sharp Statistical Theory

Hengyu Fu, Zhuoran Yang, Mengdi Wang, Minshuo Chen

Comments: 92 pages, 5 figures

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[149] arXiv:2403.12158 (cross-list from stat.ML) [pdf, html, other]

Title: Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models

Samyajoy Pal, Christian Heumann

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[150] arXiv:2403.12187 (cross-list from stat.ML) [pdf, html, other]

Title: Approximation of RKHS Functionals by Neural Networks

Tian-Yi Zhou, Namjoon Suh, Guang Cheng, Xiaoming Huo

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[151] arXiv:2403.12610 (cross-list from math.PR) [pdf, html, other]

Title: Parameter estimation and singularity of laws on the path space for SDEs driven by Rosenblatt processes

Petr Čoupek, Pavel Kříž, Bohdan Maslowski

Comments: 22 pages, 6 figures

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[152] arXiv:2403.12711 (cross-list from stat.ME) [pdf, html, other]

Title: Tests for categorical data beyond Pearson: A distance covariance and energy distance approach

Fernando Castro-Prado, Wenceslao González-Manteiga, Javier Costas, Fernando Facal, Dominic Edelmann

Comments: 15 pages with 2 figures

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Applications (stat.AP)

[153] arXiv:2403.12757 (cross-list from stat.ME) [pdf, html, other]

Title: On Equivalence of Likelihood-Based Confidence Bands for Fatigue-Life and Fatigue-Strength Distributions

Peng Liu, Yili Hong, Luis A. Escobar, William Q. Meeker

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[154] arXiv:2403.12815 (cross-list from stat.ME) [pdf, other]

Title: A Unified Framework for Rerandomization using Quadratic Forms

Kyle Schindl, Zach Branson

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[155] arXiv:2403.12946 (cross-list from cs.LG) [pdf, html, other]

Title: Sample Complexity of Offline Distributionally Robust Linear Markov Decision Processes

He Wang, Laixi Shi, Yuejie Chi

Comments: accepted by Reinforcement Learning Conference (RLC)

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST)

[156] arXiv:2403.13203 (cross-list from math.NA) [pdf, html, other]

Title: Quadratic Point Estimate Method for Probabilistic Moments Computation

Minhyeok Ko, Konstantinos G. Papakonstantinou

Subjects: Numerical Analysis (math.NA); Probability (math.PR); Statistics Theory (math.ST); Computation (stat.CO); Methodology (stat.ME)

[157] arXiv:2403.13361 (cross-list from q-fin.MF) [pdf, html, other]

Title: Multifractal wavelet dynamic mode decomposition modeling for marketing time series

Mohamed Elshazli A. Zidan, Anouar Ben Mabrouk, Nidhal Ben Abdallah, Tawfeeq M. Alanazi

Comments: 57 pages, 25 figures

Subjects: Mathematical Finance (q-fin.MF); Econometrics (econ.EM); Statistics Theory (math.ST)

[158] arXiv:2403.13565 (cross-list from stat.ML) [pdf, html, other]

Title: AdaTrans: Feature-wise and Sample-wise Adaptive Transfer Learning for High-dimensional Regression

Zelin He, Ying Sun, Jingyuan Liu, Runze Li

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[159] arXiv:2403.13750 (cross-list from stat.ME) [pdf, html, other]

Title: Data integration of non-probability and probability samples with predictive mean matching

Piotr Chlebicki, Łukasz Chrostowski, Maciej Beręsewicz

Comments: 52 pages; codes: this https URL

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[160] arXiv:2403.13828 (cross-list from eess.SY) [pdf, html, other]

Title: Optimal State Estimation in the Presence of Non-Gaussian Uncertainty via Wasserstein Distance Minimization

Himanshu Prabhat, Raktim Bhattacharya

Subjects: Systems and Control (eess.SY); Statistics Theory (math.ST)

[161] arXiv:2403.13864 (cross-list from cs.LG) [pdf, html, other]

Title: Optimal Transport for Fairness: Archival Data Repair using Small Research Data Sets

Abigail Langbridge, Anthony Quinn, Robert Shorten

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Statistics Theory (math.ST)

[162] arXiv:2403.13868 (cross-list from stat.ML) [pdf, html, other]

Title: Analysing heavy-tail properties of Stochastic Gradient Descent by means of Stochastic Recurrence Equations

Ewa Damek, Sebastian Mentemeier

Comments: 25 pages, 2 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Probability (math.PR); Statistics Theory (math.ST)

[163] arXiv:2403.14122 (cross-list from math.PR) [pdf, html, other]

Title: Moderate Deviation and Berry-Esseen Bounds in the $p$-Spin Curie-Weiss Model

Somabha Mukherjee, Tianyu Liu, Bhaswar B. Bhattacharya

Comments: 22 pages

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[164] arXiv:2403.14152 (cross-list from stat.ME) [pdf, html, other]

Title: Generalized Rosenbaum Bounds Sensitivity Analysis for Matched Observational Studies with Treatment Doses: Sufficiency, Consistency, and Efficiency

Siyu Heng, Hyunseung Kang

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[165] arXiv:2403.15108 (cross-list from cs.LG) [pdf, html, other]

Title: Active Learning for Regression based on Wasserstein distance and GroupSort Neural Networks

Benjamin Bobbia, Matthias Picard

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[166] arXiv:2403.16297 (cross-list from stat.ME) [pdf, html, other]

Title: Round Robin Active Sequential Change Detection for Dependent Multi-Channel Data

Anamitra Chaudhuri, Georgios Fellouris, Ali Tajer

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[167] arXiv:2403.16336 (cross-list from stat.ML) [pdf, html, other]

Title: Predictive Inference in Multi-environment Scenarios

John C. Duchi, Suyash Gupta, Kuanhao Jiang, Pragya Sur

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[168] arXiv:2403.16459 (cross-list from cs.LG) [pdf, html, other]

Title: On the rates of convergence for learning with convolutional neural networks

Yunfei Yang, Han Feng, Ding-Xuan Zhou

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[169] arXiv:2403.16590 (cross-list from stat.ME) [pdf, html, other]

Title: Extremal properties of max-autoregressive moving average processes for modelling extreme river flows

Eleanor D'Arcy, Jonathan A Tawn

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Applications (stat.AP)

[170] arXiv:2403.16651 (cross-list from math.PR) [pdf, html, other]

Title: A short proof of the Dvoretzky--Kiefer--Wolfowitz--Massart inequality

Henry W J Reeve

Subjects: Probability (math.PR); Statistics Theory (math.ST)

[171] arXiv:2403.17868 (cross-list from quant-ph) [pdf, html, other]

Title: An invitation to the sample complexity of quantum hypothesis testing

Hao-Chung Cheng, Nilanjana Datta, Nana Liu, Theshani Nuradha, Robert Salzmann, Mark M. Wilde

Comments: v3: 58 pages, 1 figure, correction to Corollary 10; see independent and concurrent work of Pensia, Jog, Loh at arXiv:2403.16981

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[172] arXiv:2403.18127 (cross-list from cs.LG) [pdf, html, other]

Title: A Correction of Pseudo Log-Likelihood Method

Shi Feng, Nuoya Xiong, Zhijie Zhang, Wei Chen

Comments: 7 pages

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[173] arXiv:2403.18216 (cross-list from stat.ML) [pdf, html, other]

Title: Minimax Optimal Fair Classification with Bounded Demographic Disparity

Xianli Zeng, Guang Cheng, Edgar Dobriban

Subjects: Machine Learning (stat.ML); Computers and Society (cs.CY); Machine Learning (cs.LG); Statistics Theory (math.ST)

[174] arXiv:2403.18685 (cross-list from cs.IT) [pdf, html, other]

Title: Representatividad Muestral en la Incertidumbre Simétrica Multivariada para la Selección de Atributos

Gustavo Sosa-Cabrera

Comments: 52 pages, in Spanish. Advisors: Miguel García-Torres, Santiago Gómez-Guerrero, Christian E. Schaerer Serra

Subjects: Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)

[175] arXiv:2403.19082 (cross-list from cs.LG) [pdf, html, other]

Title: Enhancing Conformal Prediction Using E-Test Statistics

A.A.Balinsky, A.D.Balinsky

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Statistics Theory (math.ST)

[176] arXiv:2403.19157 (cross-list from math.PR) [pdf, html, other]

Title: Correlation functions between singular values and eigenvalues

Matthias Allard, Mario Kieburg

Comments: 48 pages, 1 figure. Updated version: Extension of the previous results to 1,k-point correlation functions. New and shorter proofs

Subjects: Probability (math.PR); Mathematical Physics (math-ph); Statistics Theory (math.ST)

[177] arXiv:2403.19300 (cross-list from math.PR) [pdf, other]

Title: Random Multi-Type Spanning Forests for Synchronization on Sparse Graphs

Hugo Jaquard, Pierre-Olivier Amblard, Simon Barthelmé, Nicolas Tremblay

Subjects: Probability (math.PR); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST)

[178] arXiv:2403.19516 (cross-list from stat.ML) [pdf, html, other]

Title: Maximum Likelihood Estimation on Stochastic Blockmodels for Directed Graph Clustering

Mihai Cucuringu, Xiaowen Dong, Ning Zhang

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Statistics Theory (math.ST)

[179] arXiv:2403.19818 (cross-list from stat.ME) [pdf, html, other]

Title: Testing for common structures in high-dimensional factor models

Marie-Christine Düker, Vladas Pipiras

Subjects: Methodology (stat.ME); Statistics Theory (math.ST)

[180] arXiv:2403.20027 (cross-list from math.PR) [pdf, html, other]

Title: Interplay between Negation of a Probability Distribution and Jensen Inequality

Amit Srivastava

Subjects: Probability (math.PR); Statistics Theory (math.ST)