Machine Learning

Authors and titles for June 2021

[501] arXiv:2106.08377 (cross-list from cs.LG) [pdf, other]

Title: Implicit Finite-Horizon Approximation and Efficient Optimal Algorithms for Stochastic Shortest Path

Liyu Chen, Mehdi Jafarnia-Jahromi, Rahul Jain, Haipeng Luo

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[502] arXiv:2106.08414 (cross-list from cs.LG) [pdf, other]

Title: On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control

Amrit Singh Bedi, Anjaly Parayil, Junyu Zhang, Mengdi Wang, Alec Koppel

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Systems and Control (eess.SY); Optimization and Control (math.OC); Machine Learning (stat.ML)

[503] arXiv:2106.08441 (cross-list from cs.LG) [pdf, other]

Title: Online Learning with Uncertain Feedback Graphs

Pouya M Ghari, Yanning Shen

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[504] arXiv:2106.08444 (cross-list from cs.LG) [pdf, other]

Title: CODA: Constructivism Learning for Instance-Dependent Dropout Architecture Construction

Xiaoli Li

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[505] arXiv:2106.08453 (cross-list from cs.LG) [pdf, other]

Title: How to Train Your Wide Neural Network Without Backprop: An Input-Weight Alignment Perspective

Akhilan Boopathy, Ila Fiete

Comments: Published at ICML 2022, 28 pages, 9 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[506] arXiv:2106.08477 (cross-list from cs.LG) [pdf, other]

Title: Fundamental Limits of Reinforcement Learning in Environment with Endogeneous and Exogeneous Uncertainty

Rongpeng Li

Comments: Manuscript has been submitted to an IEEE journal. Copyright may be transferred without further notice

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[507] arXiv:2106.08537 (cross-list from cs.DS) [pdf, other]

Title: Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimation

Ilias Diakonikolas, Daniel M. Kane, Daniel Kongsgaard, Jerry Li, Kevin Tian

Comments: 64 pages, 1 figure. v2 improves results on bounded-covariance clustering, polishes exposition

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[508] arXiv:2106.08544 (cross-list from cs.LG) [pdf, other]

Title: Non-PSD Matrix Sketching with Applications to Regression and Optimization

Zhili Feng, Fred Roosta, David P. Woodruff

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[509] arXiv:2106.08598 (cross-list from cs.LG) [pdf, other]

Title: Ada-BKB: Scalable Gaussian Process Optimization on Continuous Domains by Adaptive Discretization

Marco Rando, Luigi Carratino, Silvia Villa, Lorenzo Rosasco

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[510] arXiv:2106.08687 (cross-list from cs.LG) [pdf, other]

Title: Leveraging Probabilistic Circuits for Nonparametric Multi-Output Regression

Zhongjie Yu, Mingye Zhu, Martin Trapp, Arseny Skryagin, Kristian Kersting

Comments: Accepted for the 37th Conference on Uncertainty in Artificial Intelligence (UAI 2021)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[511] arXiv:2106.08769 (cross-list from cs.LG) [pdf, other]

Title: Knowledge-Adaptation Priors

Mohammad Emtiyaz Khan, Siddharth Swaroop

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[512] arXiv:2106.08775 (cross-list from math.OC) [pdf, other]

Title: Momentum-inspired Low-Rank Coordinate Descent for Diagonally Constrained SDPs

Junhyung Lyle Kim, JA Lara Benitez, Mohammad Taha Toghani, Cameron Wolfe, Zhiwei Zhang, Anastasios Kyrillidis

Comments: 10 pages, 8 figures, preprint under review

Subjects: Optimization and Control (math.OC); Information Theory (cs.IT); Machine Learning (cs.LG); Mathematical Software (cs.MS); Machine Learning (stat.ML)

[513] arXiv:2106.08808 (cross-list from cs.CV) [pdf, other]

Title: Contrastive Learning with Continuous Proxy Meta-Data for 3D MRI Classification

Benoit Dufumier, Pietro Gori, Julie Victor, Antoine Grigis, Michel Wessa, Paolo Brambilla, Pauline Favre, Mircea Polosan, Colm McDonald, Camille Marie Piguet, Edouard Duchesnay

Comments: MICCAI 2021

Journal-ref: MICCAI 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[514] arXiv:2106.08812 (cross-list from cs.LG) [pdf, other]

Title: Costs and Benefits of Fair Regression

Han Zhao

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (stat.ML)

[515] arXiv:2106.08852 (cross-list from cs.LG) [pdf, other]

Title: Multilinear Dirichlet Processes

Xiaoli Li

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[516] arXiv:2106.08855 (cross-list from cs.LG) [pdf, other]

Title: Beyond Tikhonov: Faster Learning with Self-Concordant Losses via Iterative Regularization

Gaspard Beugnot, Julien Mairal, Alessandro Rudi

Comments: To be published in NeurIPS 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[517] arXiv:2106.08864 (cross-list from cs.LG) [pdf, other]

Title: Multi-Class Classification from Single-Class Data with Confidences

Yuzhou Cao, Lei Feng, Senlin Shu, Yitian Xu, Bo An, Gang Niu, Masashi Sugiyama

Comments: 23 pages, 1 figure

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[518] arXiv:2106.08882 (cross-list from cs.LG) [pdf, other]

Title: Robust Training in High Dimensions via Block Coordinate Geometric Median Descent

Anish Acharya, Abolfazl Hashemi, Prateek Jain, Sujay Sanghavi, Inderjit S. Dhillon, Ufuk Topcu

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC); Machine Learning (stat.ML)

[519] arXiv:2106.08900 (cross-list from cs.LG) [pdf, other]

Title: Random feature neural networks learn Black-Scholes type PDEs without curse of dimensionality

Lukas Gonon

Subjects: Machine Learning (cs.LG); Probability (math.PR); Mathematical Finance (q-fin.MF); Machine Learning (stat.ML)

[520] arXiv:2106.08903 (cross-list from physics.comp-ph) [pdf, other]

Title: GemNet: Universal Directional Graph Neural Networks for Molecules

Johannes Gasteiger, Florian Becker, Stephan Günnemann

Comments: Published as a conference paper at NeurIPS 2021. Author name changed from Johannes Klicpera to Johannes Gasteiger

Subjects: Computational Physics (physics.comp-ph); Machine Learning (cs.LG); Chemical Physics (physics.chem-ph); Machine Learning (stat.ML)

[521] arXiv:2106.08909 (cross-list from cs.LG) [pdf, other]

Title: Offline RL Without Off-Policy Evaluation

David Brandfonbrener, William F. Whitney, Rajesh Ranganath, Joan Bruna

Comments: Thirty-fifth Conference on Neural Information Processing Systems, 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[522] arXiv:2106.08943 (cross-list from cs.LG) [pdf, other]

Title: Banker Online Mirror Descent

Jiatai Huang, Longbo Huang

Comments: Preliminary work, merged to arXiv:2301.10500

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[523] arXiv:2106.09017 (cross-list from cs.LG) [pdf, other]

Title: Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation

Haoxiang Wang, Han Zhao, Bo Li

Comments: ICML 2021 camera-ready version. Code is released at this https URL

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[524] arXiv:2106.09028 (cross-list from quant-ph) [pdf, other]

Title: Exponential Error Convergence in Data Classification with Optimized Random Features: Acceleration by Quantum Machine Learning

Hayata Yamasaki, Sho Sonoda

Comments: 42 pages, no figure

Subjects: Quantum Physics (quant-ph); Machine Learning (cs.LG); Machine Learning (stat.ML)

[525] arXiv:2106.09070 (cross-list from cs.LG) [pdf, other]

Title: Identifiability-Guaranteed Simplex-Structured Post-Nonlinear Mixture Learning via Autoencoder

Qi Lyu, Xiao Fu

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Machine Learning (stat.ML)

[526] arXiv:2106.09071 (cross-list from stat.ME) [pdf, other]

Title: Pre-processing with Orthogonal Decompositions for High-dimensional Explanatory Variables

Xu Han, Ethan X Fang, Cheng Yong Tang

Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)

[527] arXiv:2106.09111 (cross-list from cs.LG) [pdf, other]

Title: An Imprecise SHAP as a Tool for Explaining the Class Probability Distributions under Limited Training Data

Lev V. Utkin, Andrei V. Konstantinov, Kirill A. Vishniakov

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[528] arXiv:2106.09114 (cross-list from stat.ME) [pdf, other]

Title: Semiparametric count data regression for self-reported mental health

Daniel R. Kowal, Bohan Wu

Subjects: Methodology (stat.ME); Applications (stat.AP); Machine Learning (stat.ML)

[529] arXiv:2106.09136 (cross-list from math.ST) [pdf, other]

Title: Binary classification with corrupted labels

Yonghoon Lee, Rina Foygel Barber

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[530] arXiv:2106.09158 (cross-list from math.OC) [pdf, other]

Title: Mixed-Integer Nonlinear Programming for State-based Non-Intrusive Load Monitoring

Marco Balletti, Veronica Piccialli, Antonio M. Sudoso

Journal-ref: IEEE Transactions on Smart Grid 2022

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[531] arXiv:2106.09179 (cross-list from cs.LG) [pdf, other]

Title: Amortized Auto-Tuning: Cost-Efficient Bayesian Transfer Optimization for Hyperparameter Recommendation

Yuxin Xiao, Eric P. Xing, Willie Neiswanger

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[532] arXiv:2106.09207 (cross-list from cs.LG) [pdf, other]

Title: On the Power of Preconditioning in Sparse Linear Regression

Jonathan Kelner, Frederic Koehler, Raghu Meka, Dhruv Rohatgi

Comments: 73 pages, 5 figures

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Statistics Theory (math.ST); Machine Learning (stat.ML)

[533] arXiv:2106.09226 (cross-list from cs.LG) [pdf, other]

Title: Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning

Colin Wei, Sang Michael Xie, Tengyu Ma

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[534] arXiv:2106.09246 (cross-list from cs.CV) [pdf, other]

Title: Federated CycleGAN for Privacy-Preserving Image-to-Image Translation

Joonyoung Song, Jong Chul Ye

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[535] arXiv:2106.09269 (cross-list from cs.LG) [pdf, other]

Title: Pruning Randomly Initialized Neural Networks with Iterative Randomization

Daiki Chijiwa, Shin'ya Yamaguchi, Yasutoshi Ida, Kenji Umakoshi, Tomohiro Inoue

Comments: 35th Conference on Neural Information Processing Systems (NeurIPS 2021); Selected for a spotlight presentation

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[536] arXiv:2106.09291 (cross-list from cs.LG) [pdf, other]

Title: Towards Understanding Deep Learning from Noisy Labels with Small-Loss Criterion

Xian-Jin Gui, Wei Wang, Zhang-Hao Tian

Comments: Accepted to International Joint Conference on Artificial Intelligence (IJCAI) 2021, includes non-archival supplementary material

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[537] arXiv:2106.09327 (cross-list from eess.SP) [pdf, other]

Title: Minimax Estimation of Partially-Observed Vector AutoRegressions

Guillaume Dalle (CERMICS), Yohann de Castro (ICJ, ECL)

Subjects: Signal Processing (eess.SP); Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)

[538] arXiv:2106.09350 (cross-list from cs.DS) [pdf, other]

Title: Identifiability of AMP chain graph models

Yuhao Wang, Arnab Bhattacharyya

Comments: 16 pages, 4 figures

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[539] arXiv:2106.09370 (cross-list from cs.LG) [pdf, other]

Title: A deep generative model for probabilistic energy forecasting in power systems: normalizing flows

Jonathan Dumas, Antoine Wehenkel Damien Lanaspeze, Bertrand Cornélusse, Antonio Sutera

Comments: Version accepted to be published on Applied Energy

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Machine Learning (stat.ML)

[540] arXiv:2106.09387 (cross-list from math.ST) [pdf, other]

Title: Taming Nonconvexity in Kernel Feature Selection -- Favorable Properties of the Laplace Kernel

Feng Ruan, Keli Liu, Michael I. Jordan

Comments: 26 pages main text; 74 pages total; appendix rewritten (typo fixed; proof structure reorganized)

Subjects: Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)

[541] arXiv:2106.09467 (cross-list from cs.LG) [pdf, other]

Title: Algorithmic Bias and Data Bias: Understanding the Relation between Distributionally Robust Optimization and Data Curation

Agnieszka Słowik, Léon Bottou

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[542] arXiv:2106.09533 (cross-list from cs.IR) [pdf, other]

Title: Author Clustering and Topic Estimation for Short Texts

Graham Tierney, Christopher Bail, Alexander Volfovsky

Subjects: Information Retrieval (cs.IR); Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[543] arXiv:2106.09564 (cross-list from cs.CV) [pdf, other]

Title: Knowledge distillation from multi-modal to mono-modal segmentation networks

Minhao Hu, Matthis Maillard, Ya Zhang, Tommaso Ciceri, Giammarco La Barbera, Isabelle Bloch, Pietro Gori

Comments: MICCAI 2020

Journal-ref: MICCAI 2020

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[544] arXiv:2106.09613 (cross-list from cs.LG) [pdf, other]

Title: Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error

Ondrej Bohdal, Yongxin Yang, Timothy Hospedales

Comments: Published in Transactions on Machine Learning Research (08/2023)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[545] arXiv:2106.09647 (cross-list from cs.LG) [pdf, other]

Title: Deep Learning Through the Lens of Example Difficulty

Robert J. N. Baldock, Hartmut Maennel, Behnam Neyshabur

Comments: Main paper: 15 pages, 8 figures. Appendix: 31 pages, 40 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[546] arXiv:2106.09663 (cross-list from math.OC) [pdf, other]

Title: A Short Note of PAGE: Optimal Convergence Rates for Nonconvex Optimization

Zhize Li

Comments: 4 pages

Subjects: Optimization and Control (math.OC); Artificial Intelligence (cs.AI); Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[547] arXiv:2106.09683 (cross-list from cs.LG) [pdf, other]

Title: PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classes

Peter Grünwald, Thomas Steinke, Lydia Zakynthinou

Comments: 24 pages, accepted for publication at COLT 2021

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[548] arXiv:2106.09689 (cross-list from cs.DS) [pdf, other]

Title: Statistical Query Lower Bounds for List-Decodable Linear Regression

Ilias Diakonikolas, Daniel M. Kane, Ankit Pensia, Thanasis Pittas, Alistair Stewart

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[549] arXiv:2106.09702 (cross-list from stat.ME) [pdf, other]

Title: Spectral goodness-of-fit tests for complete and partial network data

Shane Lubold, Bolun Liu, Tyler H. McCormick

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Applications (stat.AP); Machine Learning (stat.ML)

[550] arXiv:2106.09756 (cross-list from cs.LG) [pdf, other]

Title: PyKale: Knowledge-Aware Machine Learning from Multiple Sources in Python

Haiping Lu, Xianyuan Liu, Robert Turner, Peizhen Bai, Raivo E Koot, Shuo Zhou, Mustafa Chasmai, Lawrence Schobs

Comments: This library is available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)