Machine Learning

Authors and titles for October 2020

[101] arXiv:2010.09929 [pdf, other]

Title: On the Sample Complexity of Privately Learning Unbounded High-Dimensional Gaussians

Ishaq Aden-Ali, Hassan Ashtiani, Gautam Kamath

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT); Machine Learning (cs.LG)

[102] arXiv:2010.09941 [pdf, other]

Title: Multiple-view clustering for identifying subject clusters and brain sub-networks using functional connectivity matrices without vectorization

Tomoki Tokuda, Okito Yamashita, Junichiro Yoshimoto

Journal-ref: Neural Networks, 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[103] arXiv:2010.10079 [pdf, other]

Title: Neural Approximate Sufficient Statistics for Implicit Models

Yanzhi Chen, Dinghuai Zhang, Michael Gutmann, Aaron Courville, Zhanxing Zhu

Comments: ICLR2021 spotlight

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Applications (stat.AP)

[104] arXiv:2010.10168 [pdf, other]

Title: A Continuous-Time Mirror Descent Approach to Sparse Phase Retrieval

Fan Wu, Patrick Rebeschini

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[105] arXiv:2010.10177 [pdf, other]

Title: Sparse Gaussian Process Variational Autoencoders

Matthew Ashman, Jonathan So, Will Tebbutt, Vincent Fortuin, Michael Pearce, Richard E. Turner

Comments: 19 pages, 6 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[106] arXiv:2010.10181 [pdf, other]

Title: Robust Imitation Learning from Noisy Demonstrations

Voot Tangkaratt, Nontawat Charoenphakdee, Masashi Sugiyama

Comments: 16 pages, 9 figures. Accepted to AISTATS 2021

Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[107] arXiv:2010.10182 [pdf, other]

Title: The Elliptical Potential Lemma Revisited

Alexandra Carpentier, Claire Vernade, Yasin Abbasi-Yadkori

Comments: 8 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[108] arXiv:2010.10241 [pdf, other]

Title: BYOL works even without batch statistics

Pierre H. Richemond, Jean-Bastien Grill, Florent Altché, Corentin Tallec, Florian Strub, Andrew Brock, Samuel Smith, Soham De, Razvan Pascanu, Bilal Piot, Michal Valko

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[109] arXiv:2010.10436 [pdf, other]

Title: VarGrad: A Low-Variance Gradient Estimator for Variational Inference

Lorenz Richter, Ayman Boustati, Nikolas Nüsken, Francisco J. R. Ruiz, Ömer Deniz Akyildiz

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[110] arXiv:2010.10569 [pdf, other]

Title: Bayesian Algorithms for Decentralized Stochastic Bandits

Anusha Lalitha, Andrea Goldsmith

Comments: Submitted to IEEE Journal on Selected Areas in Information Theory (JSAIT) issue on Sequential, Active, and Reinforcement Learning

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[111] arXiv:2010.10604 [pdf, other]

Title: Bayesian Attention Modules

Xinjie Fan, Shujian Zhang, Bo Chen, Mingyuan Zhou

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[112] arXiv:2010.10797 [pdf, other]

Title: Tensor Train Random Projection

Yani Feng, Kejun Tang, Lianxing He, Pingqiang Zhou, Qifeng Liao

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[113] arXiv:2010.10973 [pdf, other]

Title: Regularised Least-Squares Regression with Infinite-Dimensional Output Space

Junhyunng Park, Krikamol Muandet

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[114] arXiv:2010.11039 [pdf, other]

Title: How to Control the Error Rates of Binary Classifiers

Miloš Simić

Comments: 14 pages, 2 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[115] arXiv:2010.11176 [pdf, other]

Title: Riemannian Langevin Algorithm for Solving Semidefinite Programs

Mufan Bill Li, Murat A. Erdogdu

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[116] arXiv:2010.11213 [pdf, other]

Title: Precise Statistical Analysis of Classification Accuracies for Adversarial Training

Adel Javanmard, Mahdi Soltanolkotabi

Comments: 80 pages; to appear in the Annals of Statistics

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[117] arXiv:2010.11345 [pdf, other]

Title: Network topology change-point detection from graph signals with prior spectral signatures

Chiraag Kaushik, T. Mitchell Roddenberry, Santiago Segarra

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Signal Processing (eess.SP)

[118] arXiv:2010.11356 [pdf, other]

Title: Beyond Lazy Training for Over-parameterized Tensor Decomposition

Xiang Wang, Chenwei Wu, Jason D. Lee, Tengyu Ma, Rong Ge

Comments: NeurIPS 2020; the first two authors contribute equally

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[119] arXiv:2010.11366 [pdf, other]

Title: Random Coordinate Underdamped Langevin Monte Carlo

Zhiyan Ding, Qin Li, Jianfeng Lu, Stephen J. Wright

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[120] arXiv:2010.11518 [pdf, other]

Title: Geometry-Aware Hamiltonian Variational Auto-Encoder

Clément Chadebec (CRC, Université de Paris), Clément Mantoux (ARAMIS), Stéphanie Allassonnière (CRC, Université de Paris)

Comments: 44 pages, 23 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Differential Geometry (math.DG); Statistics Theory (math.ST)

[121] arXiv:2010.11530 [pdf, other]

Title: Model updating after interventions paradoxically introduces bias

James Liley, Samuel R Emerson, Bilal A Mateen, Catalina A Vallejos, Louis J M Aslett, Sebastian J Vollmer

Comments: Sections of this preprint on 'Successive adjuvancy' (section 4, theorem 2, figures 4,5, and associated discussions) were not included in the originally submitted version of this paper due to length. This material does not appear in the published version of this manuscript, and the reader should be aware that these sections did not undergo peer review

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[122] arXiv:2010.11595 [pdf, other]

Title: Early Anomaly Detection in Time Series: A Hierarchical Approach for Predicting Critical Health Episodes

Vitor Cerqueira, Luis Torgo, Carlos Soares

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[123] arXiv:2010.11642 [pdf, other]

Title: The Role of Mutual Information in Variational Classifiers

Matias Vera, Leonardo Rey Vega, Pablo Piantanida

Comments: Accepted for publication to Machine Learning Springer

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[124] arXiv:2010.11665 [pdf, other]

Title: Spike and slab variational Bayes for high dimensional logistic regression

Kolyan Ray, Botond Szabo, Gabriel Clara

Comments: NeurIPS 2020. Several typos corrected

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)

[125] arXiv:2010.11748 [pdf, other]

Title: Classification with Rejection Based on Cost-sensitive Classification

Nontawat Charoenphakdee, Zhenghang Cui, Yivan Zhang, Masashi Sugiyama

Comments: 40 pages. Added the discussion of the recent work by Gangrade et al. (2021) at the end of Section 3.4, where the idea of constructing cost-sensitive classifiers for classification with rejection has also been explored in a different framework of classification with rejection (where the goal is not minimizing the 0-1-c risk as in our paper)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[126] arXiv:2010.11750 [pdf, other]

Title: Precise High-Dimensional Asymptotics for Quantifying Heterogeneous Transfers

Fan Yang, Hongyang R. Zhang, Sen Wu, Christopher Ré, Weijie J. Su

Comments: 64 pages, 6 figures; We thoroughly revised the paper by adding new results and reorganizing the presentation

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[127] arXiv:2010.11825 [pdf, other]

Title: Model identification and local linear convergence of coordinate descent

Quentin Klopfenstein, Quentin Bertrand, Alexandre Gramfort, Joseph Salmon, Samuel Vaiter

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[128] arXiv:2010.11970 [pdf, html, other]

Title: Two-sample Test using Projected Wasserstein Distance

Jie Wang, Rui Gao, Yao Xie

Comments: 10 pages, 3 figures. Accepted in ISIT-21, typo in Proposition 3 has been corrected

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[129] arXiv:2010.11994 [pdf, other]

Title: Thresholded Lasso Bandit

Kaito Ariu, Kenshi Abe, Alexandre Proutière

Comments: International Conference on Machine Learning (ICML 2022), Proceedings of Machine Learning Research

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[130] arXiv:2010.12059 [pdf, html, other]

Title: Principled Interpolation in Normalizing Flows

Samuel G. Fadel, Sebastian Mair, Ricardo da S. Torres, Ulf Brefeld

Comments: 20 pages, 11 figures, accepted at the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD 2021)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[131] arXiv:2010.12087 [pdf, other]

Title: Recovery of sparse linear classifiers from mixture of responses

Venkata Gandikota, Arya Mazumdar, Soumyabrata Pal

Comments: 31 pages, 2 figures (To Appear at NeurIPS 2020)

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[132] arXiv:2010.12362 [pdf, other]

Title: Rescuing neural spike train models from bad MLE

Diego M. Arribas, Yuan Zhao, Il Memming Park

Comments: To appear in Advances in Neural Information Processing 2020

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[133] arXiv:2010.12363 [pdf, other]

Title: Regret in Online Recommendation Systems

Kaito Ariu, Narae Ryu, Se-Young Yun, Alexandre Proutière

Comments: Advances in Neural Information Processing Systems (NeurIPS 2020)

Subjects: Machine Learning (stat.ML); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[134] arXiv:2010.12487 [pdf, other]

Title: An Analysis of LIME for Text Data

Dina Mardaoui, Damien Garreau

Comments: 29 pages, 17 figures, accepted to AISTATS 2021

Subjects: Machine Learning (stat.ML); Computation and Language (cs.CL); Machine Learning (cs.LG)

[135] arXiv:2010.12605 [pdf, other]

Title: Using machine learning to correct model error in data assimilation and forecast applications

Alban Farchi, Patrick Laloyaux, Massimo Bonavita, Marc Bocquet

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)

[136] arXiv:2010.12618 [pdf, other]

Title: Counterfactual Representation Learning with Balancing Weights

Serge Assaad, Shuxi Zeng, Chenyang Tao, Shounak Datta, Nikhil Mehta, Ricardo Henao, Fan Li, Lawrence Carin

Comments: Accepted to International Conference on Artificial Intelligence and Statistics (AISTATS 2021)

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[137] arXiv:2010.12687 [pdf, other]

Title: Robust Correction of Sampling Bias Using Cumulative Distribution Functions

Bijan Mazaheri, Siddharth Jain, Jehoshua Bruck

Comments: Accepted in Neurips 2020

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[138] arXiv:2010.12842 [pdf, other]

Title: Stochastic Gradient Descent Meets Distribution Regression

Nicole Mücke

Journal-ref: Proceedings of the 24th International Conference on Artificial Intelligence and Statistics (AISTATS) 2021, San Diego, California, USA. PMLR: Volume 130

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[139] arXiv:2010.12887 [pdf, other]

Title: Nearly Optimal Variational Inference for High Dimensional Regression with Shrinkage Priors

Jincheng Bai, Qifan Song, Guang Cheng

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[140] arXiv:2010.13018 [pdf, html, other]

Title: Adversarial Robust Low Rank Matrix Estimation: Compressed Sensing and Matrix Completion

Takeyuki Sasai, Hironori Fujisawa

Comments: The lasso part of this manuscript with contaminated input as well as output is investigated in arXiv:2208.11592. This manuscript will not be submitted for publications

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST)

[141] arXiv:2010.13064 [pdf, other]

Title: Further Analysis of Outlier Detection with Deep Generative Models

Ziyu Wang, Bin Dai, David Wipf, Jun Zhu

Comments: NeurIPS 2020

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[142] arXiv:2010.13152 [pdf, other]

Title: A Simple Spectral Failure Mode for Graph Convolutional Networks

Carey E. Priebe, Cencheng Shen, Ningyuan Huang, Tianyi Chen

Journal-ref: IEEE Transactions on Pattern Analysis and Machine Intelligence 44(11), 8689-8693, 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[143] arXiv:2010.13187 [pdf, html, other]

Title: Improving the Reconstruction of Disentangled Representation Learners via Multi-Stage Modeling

Akash Srivastava, Yamini Bansal, Yukun Ding, Cole Lincoln Hurwitz, Kai Xu, Bernhard Egger, Prasanna Sattigeri, Joshua B. Tenenbaum, Agus Sudjianto, Phuong Le, Arun Prakash R, Nengfeng Zhou, Joel Vaughan, Yaqun Wang, Anwesha Bhattacharyya, Kristjan Greenewald, David D. Cox, Dan Gutfreund

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[144] arXiv:2010.13275 [pdf, other]

Title: Asymptotic Behavior of Adversarial Training in Binary Classification

Hossein Taheri, Ramtin Pedarsani, Christos Thrampoulidis

Comments: V3: additional theoretical results, extensions to correlated features

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG); Signal Processing (eess.SP)

[145] arXiv:2010.13472 [pdf, other]

Title: Scalable Gaussian Process Variational Autoencoders

Metod Jazbec, Matthew Ashman, Vincent Fortuin, Michael Pearce, Stephan Mandt, Gunnar Rätsch

Comments: Published at AISTATS 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[146] arXiv:2010.13491 [pdf, other]

Title: Query Complexity of k-NN based Mode Estimation

Anirudh Singhal, Subham Pirojiwala, Nikhil Karamchandani

Comments: 10 pages

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[147] arXiv:2010.13498 [pdf, other]

Title: Scalable Bayesian neural networks by layer-wise input augmentation

Trung Trinh, Samuel Kaski, Markus Heinonen

Comments: 8 pages

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[148] arXiv:2010.13511 [pdf, other]

Title: Efficient Optimization Methods for Extreme Similarity Learning with Nonlinear Embeddings

Bowen Yuan, Yu-Sheng Li, Pengrui Quan, Chih-Jen Lin

Comments: Published as a conference paper at KDD 2021

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)

[149] arXiv:2010.13523 [pdf, other]

Title: Kernel Smoothing, Mean Shift, and Their Learning Theory with Directional Data

Yikun Zhang, Yen-Chi Chen

Comments: 92 pages, 11 figures. Accepted to the Journal of Machine Learning Research

Journal-ref: Journal of Machine Learning Research 2021, Vol.22, No.154, 1-92

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)

[150] arXiv:2010.13551 [pdf, other]

Title: From the Expectation Maximisation Algorithm to Autoencoded Variational Bayes

Graham W. Pulford

Comments: 27 pages, 5 figures

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)