Machine Learning

Authors and titles for May 2021

[401] arXiv:2105.14559 (cross-list from cs.LG) [pdf, other]

Title: Active Learning in Bayesian Neural Networks with Balanced Entropy Learning Principle

Jae Oh Woo

Journal-ref: International Conference on Learning Representations 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[402] arXiv:2105.14573 (cross-list from cs.LG) [pdf, other]

Title: Embedding Principle of Loss Landscape of Deep Neural Networks

Yaoyu Zhang, Zhongwang Zhang, Tao Luo, Zhi-Qin John Xu

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[403] arXiv:2105.14602 (cross-list from cs.LG) [pdf, other]

Title: On the geometry of generalization and memorization in deep neural networks

Cory Stephenson, Suchismita Padhy, Abhinav Ganesh, Yue Hui, Hanlin Tang, SueYeon Chung

Comments: ICLR 2021

Subjects: Machine Learning (cs.LG); Disordered Systems and Neural Networks (cond-mat.dis-nn); Machine Learning (stat.ML)

[404] arXiv:2105.14648 (cross-list from cs.LG) [pdf, other]

Title: Sharper bounds for online learning of smooth functions of a single variable

Jesse Geneson

Subjects: Machine Learning (cs.LG); Discrete Mathematics (cs.DM); Machine Learning (stat.ML)

[405] arXiv:2105.14673 (cross-list from cs.LG) [pdf, other]

Title: A Minimax Lower Bound for Low-Rank Matrix-Variate Logistic Regression

Batoul Taki, Mohsen Ghassemi, Anand D. Sarwate, Waheed U. Bajwa

Comments: 8 pages; published in Proc. 55th Asilomar Conf. Signals, Systems, and Computers, Pacific Grove, CA, Oct. 31-Nov. 3, 2021

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Statistics Theory (math.ST); Machine Learning (stat.ML)

[406] arXiv:2105.14710 (cross-list from cs.LG) [pdf, other]

Title: Robustifying $\ell_\infty$ Adversarial Training to the Union of Perturbation Models

Ameya D. Patil, Michael Tuttle, Alexander G. Schwing, Naresh R. Shanbhag

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[407] arXiv:2105.14835 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Lower Bounds on the Depth of ReLU Neural Networks

Christoph Hertrich, Amitabh Basu, Marco Di Summa, Martin Skutella

Comments: Authors' accepted manuscript for SIAM Journal on Discrete Mathematics. A preliminary conference version appeared at NeurIPS 2021

Journal-ref: SIAM Journal on Discrete Mathematics 2023 37:2, 997-1029

Subjects: Machine Learning (cs.LG); Discrete Mathematics (cs.DM); Neural and Evolutionary Computing (cs.NE); Combinatorics (math.CO); Machine Learning (stat.ML)

[408] arXiv:2105.14876 (cross-list from cs.LG) [pdf, other]

Title: Fast, Accurate and Interpretable Time Series Classification Through Randomization

Nestor Cabello, Elham Naghizade, Jianzhong Qi, Lars Kulik

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[409] arXiv:2105.14890 (cross-list from cs.LG) [pdf, other]

Title: Rawlsian Fair Adaptation of Deep Learning Classifiers

Kulin Shah, Pooja Gupta, Amit Deshpande, Chiranjib Bhattacharyya

Comments: 24 figures, 19 figures

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Machine Learning (stat.ML)

[410] arXiv:2105.14900 (cross-list from cs.LG) [pdf, other]

Title: A unified view of likelihood ratio and reparameterization gradients

Paavo Parmas, Masashi Sugiyama

Comments: AISTATS2021; Earlier paper was split in two (arXiv:1910.06419). Refer to the current paper for the unified view, but see the earlier paper for discussion on an importance sampling technique

Journal-ref: In International Conference on Artificial Intelligence and Statistics (pp. 4078-4086). PMLR (2021, March)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[411] arXiv:2105.14957 (cross-list from stat.ME) [pdf, other]

Title: Conformal Uncertainty Sets for Robust Optimization

Chancellor Johnstone, Bruce Cox

Comments: 19 pages, 7 figures, submitted to COPA 2021, accepted

Subjects: Methodology (stat.ME); Optimization and Control (math.OC); Machine Learning (stat.ML)

[412] arXiv:2105.15069 (cross-list from cs.LG) [pdf, other]

Title: On the Consistency of Max-Margin Losses

Alex Nowak-Vila, Alessandro Rudi, Francis Bach

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[413] arXiv:2105.15081 (cross-list from math.ST) [pdf, other]

Title: Optimal Spectral Recovery of a Planted Vector in a Subspace

Cheng Mao, Alexander S. Wein

Comments: 54 pages

Subjects: Statistics Theory (math.ST); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[414] arXiv:2105.15134 (cross-list from cs.LG) [pdf, other]

Title: Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning

Zixin Wen, Yuanzhi Li

Comments: V3 corrected related works. Accepted to ICML2021

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[415] arXiv:2105.15183 (cross-list from cs.LG) [pdf, other]

Title: Efficient and Modular Implicit Differentiation

Mathieu Blondel, Quentin Berthet, Marco Cuturi, Roy Frostig, Stephan Hoyer, Felipe Llinares-López, Fabian Pedregosa, Jean-Philippe Vert

Comments: V3: added more related work and Jacobian precision figure

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)