Machine Learning

Authors and titles for April 2021

[301] arXiv:2104.12036 (cross-list from math.PR) [pdf, other]

Title: A Class of Dimension-free Metrics for the Convergence of Empirical Measures

Jiequn Han, Ruimeng Hu, Jihao Long

Subjects: Probability (math.PR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[302] arXiv:2104.12119 (cross-list from stat.ME) [pdf, other]

Title: System identification using Bayesian neural networks with nonparametric noise models

Christos Merkatas, Simo Särkkä

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[303] arXiv:2104.12225 (cross-list from cs.LG) [pdf, other]

Title: DC3: A learning method for optimization with hard constraints

Priya L. Donti, David Rolnick, J. Zico Kolter

Comments: In ICLR 2021. Code available at this https URL

Journal-ref: International Conference on Learning Representations 2021

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[304] arXiv:2104.12232 (cross-list from math.ST) [pdf, other]

Title: Variational Inference in high-dimensional linear regression

Sumit Mukherjee, Subhabrata Sen

Comments: 39 pages

Subjects: Statistics Theory (math.ST); Probability (math.PR); Machine Learning (stat.ML)

[305] arXiv:2104.12437 (cross-list from cs.LG) [pdf, other]

Title: Towards Rigorous Interpretations: a Formalisation of Feature Attribution

Darius Afchar, Romain Hennequin, Vincent Guigue

Comments: 38th International Conference on Machine Learning (ICML 2021)

Journal-ref: PMLR 139:76-86, 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[306] arXiv:2104.12476 (cross-list from cs.CV) [pdf, other]

Title: EigenGAN: Layer-Wise Eigen-Learning for GANs

Zhenliang He, Meina Kan, Shiguang Shan

Comments: ICCV 2021. Code: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[307] arXiv:2104.12506 (cross-list from physics.ao-ph) [pdf, other]

Title: Bridging observation, theory and numerical simulation of the ocean using Machine Learning

Maike Sonnewald, Redouane Lguensat, Daniel C. Jones, Peter D. Dueben, Julien Brajard, Venkatramani Balaji

Comments: Topical review submitted to Environmental Research Letters

Subjects: Atmospheric and Oceanic Physics (physics.ao-ph); Machine Learning (stat.ML)

[308] arXiv:2104.12576 (cross-list from cs.LG) [pdf, other]

Title: A Splicing Approach to Best Subset of Groups Selection

Yanhang Zhang, Junxian Zhu, Jin Zhu, Xueqin Wang

Comments: 49 pages, 7 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[309] arXiv:2104.12587 (cross-list from math.NA) [pdf, other]

Title: Bayesian Numerical Methods for Nonlinear Partial Differential Equations

Junyang Wang, Jon Cockayne, Oksana Chkrebtii, T. J. Sullivan, Chris. J. Oates

Journal-ref: Stat. Comput. 31(5):no. 55, 20pp., 2021

Subjects: Numerical Analysis (math.NA); Computation (stat.CO); Methodology (stat.ME); Machine Learning (stat.ML)

[310] arXiv:2104.12676 (cross-list from math.OC) [pdf, other]

Title: Solving a class of non-convex min-max games using adaptive momentum methods

Babak Barazandeh, Davoud Ataee Tarzanagh, George Michailidis

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[311] arXiv:2104.12696 (cross-list from cs.LG) [pdf, other]

Title: Towards Sustainable Census Independent Population Estimation in Mozambique

Isaac Neal, Sohan Seth, Gary Watmough, Mamadou Saliou Diallo

Comments: 5 pages, 2 figures, published in the AI for Public Health Workshop, ICLR 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[312] arXiv:2104.12733 (cross-list from hep-ph) [pdf, other]

Title: Invariant polynomials and machine learning

Ward Haddadin

Comments: 27 pages, 5 figures, 3 tables

Subjects: High Energy Physics - Phenomenology (hep-ph); Machine Learning (cs.LG); Machine Learning (stat.ML)

[313] arXiv:2104.12852 (cross-list from stat.AP) [pdf, other]

Title: Geographic ratemaking with spatial embeddings

Christopher Blier-Wong, Hélène Cossette, Luc Lamontagne, Etienne Marceau

Journal-ref: ASTIN Bull. 52 (2022) 1-31

Subjects: Applications (stat.AP); Machine Learning (stat.ML)

[314] arXiv:2104.12909 (cross-list from econ.EM) [pdf, other]

Title: Algorithm as Experiment: Machine Learning, Market Design, and Policy Eligibility Rules

Yusuke Narita, Kohei Yata

Subjects: Econometrics (econ.EM); Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[315] arXiv:2104.12953 (cross-list from cs.LG) [pdf, other]

Title: Exploring Uncertainty in Deep Learning for Construction of Prediction Intervals

Yuandu Lai, Yucheng Shi, Yahong Han, Yunfeng Shao, Meiyu Qi, Bingshuai Li

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[316] arXiv:2104.13020 (cross-list from stat.ME) [pdf, other]

Title: Simple yet Sharp Sensitivity Analysis for Unmeasured Confounding

Jose M. Peña

Subjects: Methodology (stat.ME); Machine Learning (cs.LG); Machine Learning (stat.ML)

[317] arXiv:2104.13289 (cross-list from cs.LG) [pdf, other]

Title: Model-centric Data Manifold: the Data Through the Eyes of the Model

Luca Grementieri, Rita Fioresi

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[318] arXiv:2104.13326 (cross-list from cs.LG) [pdf, other]

Title: Fast Distributionally Robust Learning with Variance Reduced Min-Max Optimization

Yaodong Yu, Tianyi Lin, Eric Mazumdar, Michael I. Jordan

Comments: Accepted by AISTATS 2022; The first three authors contributed equally to this work; 43 pages, 28 figures

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[319] arXiv:2104.13343 (cross-list from cs.LG) [pdf, other]

Title: Sifting out the features by pruning: Are convolutional networks the winning lottery ticket of fully connected ones?

Franco Pellegrini, Giulio Biroli

Comments: 25 pages, 18 figures; typos corrected, references added

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[320] arXiv:2104.13369 (cross-list from cs.CV) [pdf, other]

Title: Explaining in Style: Training a GAN to explain a classifier in StyleSpace

Oran Lang, Yossi Gandelsman, Michal Yarom, Yoav Wald, Gal Elidan, Avinatan Hassidim, William T. Freeman, Phillip Isola, Amir Globerson, Michal Irani, Inbar Mosseri

Comments: Accepted to ICCV 2021. Project page: this https URL, Code: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Image and Video Processing (eess.IV); Machine Learning (stat.ML)

[321] arXiv:2104.13417 (cross-list from cs.CV) [pdf, other]

Title: Towards Fair Federated Learning with Zero-Shot Data Augmentation

Weituo Hao, Mostafa El-Khamy, Jungwon Lee, Jianyi Zhang, Kevin J Liang, Changyou Chen, Lawrence Carin

Comments: Accepted by IEEE CVPR Workshop on Fair, Data Efficient And Trusted Computer Vision

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Machine Learning (stat.ML)

[322] arXiv:2104.13478 (cross-list from cs.LG) [pdf, other]

Title: Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges

Michael M. Bronstein, Joan Bruna, Taco Cohen, Petar Veličković

Comments: 156 pages. Work in progress -- comments welcome!

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computational Geometry (cs.CG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[323] arXiv:2104.13504 (cross-list from cs.LG) [pdf, other]

Title: Learning Fair Canonical Polyadical Decompositions using a Kernel Independence Criterion

Kevin Kim, Alex Gittens

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[324] arXiv:2104.13517 (cross-list from math.ST) [pdf, other]

Title: Detection of Signal in the Spiked Rectangular Models

Ji Hyung Jung, Hye Won Chung, Ji Oon Lee

Comments: 38 pages, 6 figures

Subjects: Statistics Theory (math.ST); Machine Learning (cs.LG); Probability (math.PR); Machine Learning (stat.ML)

[325] arXiv:2104.13621 (cross-list from cs.LG) [pdf, other]

Title: MLDemon: Deployment Monitoring for Machine Learning Systems

Antonio Ginart, Martin Zhang, James Zou

Comments: Accepted to AISTATS 2022. Significant changes to algorithm, theory, and experiments since previous versions

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[326] arXiv:2104.13628 (cross-list from cs.LG) [pdf, other]

Title: Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian Mixtures

Yuan Cao, Quanquan Gu, Mikhail Belkin

Comments: 27 pages, 3 figures. In NeurIPS 2021

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[327] arXiv:2104.13662 (cross-list from cs.IT) [pdf, other]

Title: A coding theorem for the rate-distortion-perception function

Lucas Theis, Aaron B. Wagner

Journal-ref: ICLR 2021 Neural Compression Workshop

Subjects: Information Theory (cs.IT); Machine Learning (stat.ML)

[328] arXiv:2104.13790 (cross-list from cs.LG) [pdf, other]

Title: FastAdaBelief: Improving Convergence Rate for Belief-based Adaptive Optimizers by Exploiting Strong Convexity

Yangfan Zhou, Kaizhu Huang, Cheng Cheng, Xuguang Wang, Amir Hussain, Xin Liu

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[329] arXiv:2104.13818 (cross-list from cs.LG) [pdf, other]

Title: NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization

Ali Ramezani-Kebrya, Fartash Faghri, Ilya Markov, Vitalii Aksenov, Dan Alistarh, Daniel M. Roy

Comments: This entry is redundant and was created in error. See arXiv:1908.06077 for the latest version

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[330] arXiv:2104.13877 (cross-list from cs.LG) [pdf, other]

Title: Autoregressive Dynamics Models for Offline Policy Evaluation and Optimization

Michael R. Zhang, Tom Le Paine, Ofir Nachum, Cosmin Paduraru, George Tucker, Ziyu Wang, Mohammad Norouzi

Comments: ICLR 2021. 17 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[331] arXiv:2104.14014 (cross-list from cs.LG) [pdf, other]

Title: Algorithmic Factors Influencing Bias in Machine Learning

William Blanzeisky, Pádraig Cunningham

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[332] arXiv:2104.14033 (cross-list from cs.LG) [pdf, other]

Title: A Study of the Mathematics of Deep Learning

Anirbit Mukherjee

Comments: (A) Our PAC-Bayes risk bounds on neural nets given in Section 6 here does not yet occur in any other file on arXiv. (B) In our paper arXiv:/2005.04211, there is a significantly improved version of Section 3.3 of this thesis

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Applications (stat.AP); Machine Learning (stat.ML)

[333] arXiv:2104.14129 (cross-list from cs.LG) [pdf, other]

Title: ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training

Jianfei Chen, Lianmin Zheng, Zhewei Yao, Dequan Wang, Ion Stoica, Michael W. Mahoney, Joseph E. Gonzalez

Comments: to be published in ICML 2021

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[334] arXiv:2104.14210 (cross-list from cs.LG) [pdf, other]

Title: FairDrop: Biased Edge Dropout for Enhancing Fairness in Graph Representation Learning

Indro Spinelli, Simone Scardapane, Amir Hussain, Aurelio Uncini

Comments: Submitted to a journal for the peer-review process

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[335] arXiv:2104.14290 (cross-list from cs.LG) [pdf, other]

Title: Meta-learning using privileged information for dynamics

Ben Day, Alexander Norcliffe, Jacob Moss, Pietro Liò

Comments: Published as a workshop paper at the Learning to Learn and SimDL workshops at ICLR 2021. 4 pages, 3 pages of appendices

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[336] arXiv:2104.14379 (cross-list from cs.LG) [pdf, other]

Title: Learning Robust Variational Information Bottleneck with Reference

Weizhu Qian, Bowei Chen, Xiaowei Huang

Comments: 8 pages, 5 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[337] arXiv:2104.14421 (cross-list from cs.LG) [pdf, other]

Title: What Are Bayesian Neural Network Posteriors Really Like?

Pavel Izmailov, Sharad Vikram, Matthew D. Hoffman, Andrew Gordon Wilson

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[338] arXiv:2104.14526 (cross-list from cs.LG) [pdf, other]

Title: Scaling and Scalability: Provable Nonconvex Low-Rank Tensor Estimation from Incomplete Measurements

Tian Tong, Cong Ma, Ashley Prater-Bennette, Erin Tripp, Yuejie Chi

Comments: Accepted to Journal of Machine Learning Research

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Signal Processing (eess.SP); Optimization and Control (math.OC); Machine Learning (stat.ML)

[339] arXiv:2104.14527 (cross-list from cs.LG) [pdf, other]

Title: Online certification of preference-based fairness for personalized recommender systems

Virginie Do, Sam Corbett-Davies, Jamal Atif, Nicolas Usunier

Comments: AAAI 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (stat.ML)

[340] arXiv:2104.14534 (cross-list from cs.RO) [pdf, other]

Title: On the Emergence of Whole-body Strategies from Humanoid Robot Push-recovery Learning

Diego Ferigo, Raffaello Camoriano, Paolo Maria Viceconte, Daniele Calandriello, Silvio Traversaro, Lorenzo Rosasco, Daniele Pucci

Comments: Co-first authors: Diego Ferigo and Raffaello Camoriano; 8 pages

Journal-ref: IEEE Robotics and Automation Letters (RA-L) 2021

Subjects: Robotics (cs.RO); Machine Learning (cs.LG); Machine Learning (stat.ML)

[341] arXiv:2104.14538 (cross-list from cs.LG) [pdf, other]

Title: Distributed Multigrid Neural Solvers on Megavoxel Domains

Aditya Balu, Sergio Botelho, Biswajit Khara, Vinay Rao, Chinmay Hegde, Soumik Sarkar, Santi Adavani, Adarsh Krishnamurthy, Baskar Ganapathysubramanian

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[342] arXiv:2104.14543 (cross-list from quant-ph) [pdf, other]

Title: Optimal training of variational quantum algorithms without barren plateaus

Tobias Haug, M.S. Kim

Comments: 15 pages, 17 figures

Subjects: Quantum Physics (quant-ph); Machine Learning (cs.LG); Machine Learning (stat.ML)

[343] arXiv:2104.14581 (cross-list from stat.CO) [pdf, other]

Title: MuyGPs: Scalable Gaussian Process Hyperparameter Estimation Using Local Cross-Validation

Amanda Muyskens, Benjamin Priest, Imène Goumiri, Michael Schneider

Comments: 15 pages, 5 figures

Subjects: Computation (stat.CO); Machine Learning (stat.ML)

[344] arXiv:2104.14672 (cross-list from cs.LG) [pdf, other]

Title: Analytical bounds on the local Lipschitz constants of ReLU networks

Trevor Avant, Kristi A. Morgansen

Comments: 11 pages, 8 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[345] arXiv:2104.14847 (cross-list from cs.LG) [pdf, other]

Title: Active WeaSuL: Improving Weak Supervision with Active Learning

Samantha Biegel, Rafah El-Khatib, Luiz Otavio Vilas Boas Oliveira, Max Baak, Nanne Aben

Comments: Accepted to the ICLR 2021 Workshop on Weakly Supervised Learning

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[346] arXiv:2104.14910 (cross-list from stat.AP) [pdf, other]

Title: Calibration of wind speed ensemble forecasts for power generation

Sándor Baran, Ágnes Baran

Comments: 15 pages, 5 figures

Journal-ref: Id\^oj\'ar\'as 125 (2021), no. 4, 609-624

Subjects: Applications (stat.AP); Machine Learning (stat.ML)

[347] arXiv:2104.14936 (cross-list from cs.LG) [pdf, other]

Title: Low-Rank Autoregressive Tensor Completion for Spatiotemporal Traffic Data Imputation

Xinyu Chen, Mengying Lei, Nicolas Saunier, Lijun Sun

Journal-ref: IEEE Transactions on Intelligent Transportation Systems (2022)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[348] arXiv:2104.14962 (cross-list from cs.LG) [pdf, other]

Title: PSEUDo: Interactive Pattern Search in Multivariate Time Series with Locality-Sensitive Hashing and Relevance Feedback

Yuncong Yu, Dylan Kruyff, Tim Becker, Michael Behrisch

Comments: 11 pages including 2 pages for references, 10 figures including 1 teaser figure, sumbitted to IEEE VIS 2021, gitlab repository this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[349] arXiv:2104.15010 (cross-list from cs.LG) [pdf, other]

Title: Degenerate Gaussian factors for probabilistic inference

J. C. Schoeman, C. E. van Daalen, J. A. du Preez

Comments: Accepted by International Journal of Approximate Reasoning on 17 January 2022

Journal-ref: International Journal of Approximate Reasoning, vol. 143, pp. 159-191, 2022

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[350] arXiv:2104.15061 (cross-list from cs.LG) [pdf, other]

Title: Black-box Gradient Attack on Graph Neural Networks: Deeper Insights in Graph-based Attack and Defense

Haoxi Zhan, Xiaobing Pei

Comments: A new version of this work has been submitted to the IEEE for possible publication

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)