Machine Learning

Authors and titles for June 2021

[701] arXiv:2106.14338 (cross-list from cs.LG) [pdf, other]

Title: Regret Analysis in Deterministic Reinforcement Learning

Damianos Tranos, Alexandre Proutiere

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[702] arXiv:2106.14342 (cross-list from cs.LG) [pdf, other]

Title: Stabilizing Equilibrium Models by Jacobian Regularization

Shaojie Bai, Vladlen Koltun, J. Zico Kolter

Comments: ICML 2021 Short Oral

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[703] arXiv:2106.14343 (cross-list from cs.LG) [pdf, other]

Title: High-probability Bounds for Non-Convex Stochastic Optimization with Heavy Tails

Ashok Cutkosky, Harsh Mehta

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[704] arXiv:2106.14384 (cross-list from stat.AP) [pdf, other]

Title: Towards Model-informed Precision Dosing with Expert-in-the-loop Machine Learning

Yihuang Kang, Yi-Wen Chiu, Ming-Yen Lin, Fang-yi Su, Sheng-Tai Huang

Subjects: Applications (stat.AP); Machine Learning (cs.LG); Machine Learning (stat.ML)

[705] arXiv:2106.14406 (cross-list from cs.LG) [pdf, other]

Title: Poisoning the Search Space in Neural Architecture Search

Robert Wu, Nayan Saxena, Rohan Jain

Comments: All authors contributed equally. Appears in AdvML Workshop @ ICML2021: A Blessing in Disguise: The Prospects and Perils of Adversarial Machine Learning

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[706] arXiv:2106.14588 (cross-list from math.OC) [pdf, other]

Title: The Convergence Rate of SGD's Final Iterate: Analysis on Dimension Dependence

Daogao Liu, Zhou Lu

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[707] arXiv:2106.14648 (cross-list from cs.LG) [pdf, other]

Title: On Locality of Local Explanation Models

Sahra Ghalebikesabi, Lucile Ter-Minassian, Karla Diaz-Ordaz, Chris Holmes

Comments: Submitted to NeurIPS 2021

Subjects: Machine Learning (cs.LG); Computation (stat.CO); Methodology (stat.ME); Machine Learning (stat.ML)

[708] arXiv:2106.14806 (cross-list from cs.LG) [pdf, other]

Title: Laplace Redux -- Effortless Bayesian Deep Learning

Erik Daxberger, Agustinus Kristiadi, Alexander Immer, Runa Eschenhagen, Matthias Bauer, Philipp Hennig

Comments: NeurIPS 2021 camera-ready version; source code: this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[709] arXiv:2106.14836 (cross-list from cs.LG) [pdf, other]

Title: Understanding Dynamics of Nonlinear Representation Learning and Its Application

Kenji Kawaguchi, Linjun Zhang, Zhun Deng

Journal-ref: Neural computation, volume 34, pages 991-1018 (2022)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC); Machine Learning (stat.ML)

[710] arXiv:2106.14857 (cross-list from math.ST) [pdf, other]

Title: Bootstrapping the error of Oja's algorithm

Robert Lunde, Purnamrita Sarkar, Rachel Ward

Journal-ref: Neurips 2021

Subjects: Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)

[711] arXiv:2106.14876 (cross-list from cs.LG) [pdf, other]

Title: Multi-task curriculum learning in a complex, visual, hard-exploration domain: Minecraft

Ingmar Kanitscheider, Joost Huizinga, David Farhi, William Hebgen Guss, Brandon Houghton, Raul Sampedro, Peter Zhokhov, Bowen Baker, Adrien Ecoffet, Jie Tang, Oleg Klimov, Jeff Clune

Comments: first submission

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[712] arXiv:2106.14956 (cross-list from math.OC) [pdf, other]

Title: Robust Distributed Optimization With Randomly Corrupted Gradients

Berkay Turan, Cesar A. Uribe, Hoi-To Wai, Mahnoosh Alizadeh

Comments: 21 pages, 5 figures

Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[713] arXiv:2106.14979 (cross-list from cs.IR) [pdf, other]

Title: On component interactions in two-stage recommender systems

Jiri Hron, Karl Krauth, Michael I. Jordan, Niki Kilbertus

Comments: Appears in the proceedings of the NeurIPS 2021 conference

Subjects: Information Retrieval (cs.IR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[714] arXiv:2106.14981 (cross-list from stat.ME) [pdf, other]

Title: Fast Bayesian Variable Selection in Binomial and Negative Binomial Regression

Martin Jankowiak

Comments: 18 pages; this work is superseded by arXiv:2208.01180

Subjects: Methodology (stat.ME); Computation (stat.CO); Machine Learning (stat.ML)

[715] arXiv:2106.14993 (cross-list from cs.LG) [pdf, other]

Title: Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignment

Michael Chang, Sidhant Kaushik, Sergey Levine, Thomas L. Griffiths

Comments: Long Presentation at the Thirty-eighth International Conference on Machine Learning (ICML) 2021. 21 pages, 11 figures. v2: updated acknowledgments. v3: clarified that the internal function nodes of the credit assignment mechanism are not considered O(1)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[716] arXiv:2106.15013 (cross-list from cs.LG) [pdf, other]

Title: Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction

Dominik Stöger, Mahdi Soltanolkotabi

Comments: 83 pages; published in NeurIPS 2021; corrected inaccuracies in the proofs of Lemma 9.5 and Theorem 9.6

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Optimization and Control (math.OC); Statistics Theory (math.ST); Machine Learning (stat.ML)

[717] arXiv:2106.15127 (cross-list from cs.LG) [pdf, other]

Title: Evolving-Graph Gaussian Processes

David Blanco-Mulero, Markus Heinonen, Ville Kyrki

Comments: 12 pages, 5 figures. Accepted for publication at ICML 2021 Time Series Workshop (TSW)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML); Other Statistics (stat.OT)

[718] arXiv:2106.15185 (cross-list from cs.LG) [pdf, other]

Title: INN: A Method Identifying Clean-annotated Samples via Consistency Effect in Deep Neural Networks

Dongha Kim, Yongchan Choi, Kunwoong Kim, Yongdai Kim

Comments: 17 pages, 9 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[719] arXiv:2106.15207 (cross-list from cs.LG) [pdf, other]

Title: Optimal Rates for Random Order Online Optimization

Uri Sherman, Tomer Koren, Yishay Mansour

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[720] arXiv:2106.15214 (cross-list from cs.LG) [pdf, other]

Title: Joint Majorization-Minimization for Nonnegative Matrix Factorization with the $β$-divergence

Arthur Marmin, José Henrique de Morais Goulart, Cédric Févotte

Journal-ref: Signal Processing, Volume 209, 2023,109048,ISSN 0165-1684

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[721] arXiv:2106.15307 (cross-list from eess.SP) [pdf, other]

Title: Deep Random Projection Outlyingness for Unsupervised Anomaly Detection

Martin Bauw, Santiago Velasco-Forero, Jesus Angulo, Claude Adnet, Olivier Airiau

Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[722] arXiv:2106.15356 (cross-list from cs.LG) [pdf, other]

Title: Scalable Gaussian Processes for Data-Driven Design using Big Data with Categorical Factors

Liwei Wang, Suraj Yerramilli, Akshay Iyer, Daniel Apley, Ping Zhu, Wei Chen

Comments: Preprint submitted to Journal of Mechanical Design

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[723] arXiv:2106.15400 (cross-list from cs.LG) [pdf, other]

Title: Online Interaction Detection for Click-Through Rate Prediction

Qiuqiang Lin, Chuanhou Gao

Comments: 11pages, 4 figures, 1 supplement

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[724] arXiv:2106.15416 (cross-list from cs.LG) [pdf, other]

Title: High-dimensional separability for one- and few-shot learning

Alexander N. Gorban, Bogdan Grechuk, Evgeny M. Mirkes, Sergey V. Stasenko, Ivan Y. Tyukin

Comments: Corrected and restructured version with some extensions

Journal-ref: Entropy. 2021; 23(8):1090

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[725] arXiv:2106.15481 (cross-list from cs.LG) [pdf, other]

Title: Interactive Dimensionality Reduction for Comparative Analysis

Takanori Fujiwara, Xinhai Wei, Jian Zhao, Kwan-Liu Ma

Comments: This is the author's version of the article that has been published in IEEE Transactions on Visualization and Computer Graphics. The final version of this record is available at: https://doi.org/10.1109/TVCG.2021.3114807

Subjects: Machine Learning (cs.LG); Human-Computer Interaction (cs.HC); Machine Learning (stat.ML)

[726] arXiv:2106.15482 (cross-list from cs.LG) [pdf, other]

Title: Personalized Federated Learning with Gaussian Processes

Idan Achituve, Aviv Shamsian, Aviv Navon, Gal Chechik, Ethan Fetaya

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[727] arXiv:2106.15493 (cross-list from cs.IT) [pdf, html, other]

Title: Generalized Orthogonal Procrustes Problem under Arbitrary Adversaries

Shuyang Ling

Comments: The first draft was posted in 2021; this version of manuscript has gone through a significant revision. The proof has been completely re-written and shortened to make it more readable. Accepted by SIMAX

Subjects: Information Theory (cs.IT); Optimization and Control (math.OC); Machine Learning (stat.ML)

[728] arXiv:2106.15563 (cross-list from cs.LG) [pdf, other]

Title: Learning latent causal graphs via mixture oracles

Bohdan Kivva, Goutham Rajendran, Pradeep Ravikumar, Bryon Aragam

Comments: To appear at NeurIPS 2021. 41 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[729] arXiv:2106.15566 (cross-list from cs.LG) [pdf, other]

Title: Near-Optimal Explainable $k$-Means for All Dimensions

Moses Charikar, Lunjia Hu

Comments: 34 pages, 2 figures, to appear in SODA 2022

Subjects: Machine Learning (cs.LG); Computational Geometry (cs.CG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[730] arXiv:2106.15577 (cross-list from cs.LG) [pdf, other]

Title: As easy as APC: overcoming missing data and class imbalance in time series with self-supervised learning

Fiorella Wever, T. Anderson Keller, Laura Symul, Victor Garcia

Comments: Accepted to the NeurIPS 2021 Workshop on Self-Supervised Learning: Theory and Practice

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[731] arXiv:2106.15580 (cross-list from cs.LG) [pdf, other]

Title: Continuous Latent Process Flows

Ruizhi Deng, Marcus A. Brubaker, Greg Mori, Andreas M. Lehrmann

Comments: Accepted to NeurIPS 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[732] arXiv:2106.15662 (cross-list from cs.LG) [pdf, other]

Title: Exponential Weights Algorithms for Selective Learning

Mingda Qiao, Gregory Valiant

Comments: To appear in COLT 2021

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[733] arXiv:2106.15685 (cross-list from q-bio.NC) [pdf, other]

Title: Tensor decomposition of higher-order correlations by nonlinear Hebbian plasticity

Gabriel Koch Ocker, Michael A. Buice

Comments: 9 pages, 3 figures + supplemental 20 pages, 4 figures; Neurips 2021

Subjects: Neurons and Cognition (q-bio.NC); Machine Learning (stat.ML)

[734] arXiv:2106.15735 (cross-list from stat.ME) [pdf, other]

Title: Active-set algorithms based statistical inference for shape-restricted generalized additive Cox regression models

Geng Deng, Guangning Xu, Qiang Fu, Xindong Wang, Jing Qin

Comments: Updated with new latex template, 33 pages

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[735] arXiv:2106.15737 (cross-list from stat.ME) [pdf, other]

Title: Two-Stage TMLE to Reduce Bias and Improve Efficiency in Cluster Randomized Trials

Laura B. Balzer, Mark van der Laan, James Ayieko, Moses Kamya, Gabriel Chamie, Joshua Schwab, Diane V. Havlir, Maya L. Petersen

Comments: 37 pages total; main text is 17 pgs with 2 figures and 3 tables; supp material is 14 pgs with 1 figure and 5 tables

Journal-ref: Biostatistics, kxab043, December 24, 2021

Subjects: Methodology (stat.ME); Applications (stat.AP); Machine Learning (stat.ML)

[736] arXiv:2106.15739 (cross-list from cs.LG) [pdf, other]

Title: On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay

Ekaterina Lobacheva, Maxim Kodryan, Nadezhda Chirkova, Andrey Malinin, Dmitry Vetrov

Comments: Published in NeurIPS 2021. First two authors contributed equally

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[737] arXiv:2106.15812 (cross-list from stat.ME) [pdf, other]

Title: AdaPT-GMM: Powerful and robust covariate-assisted multiple testing

Patrick Chao, William Fithian

Subjects: Methodology (stat.ME); Computation (stat.CO); Machine Learning (stat.ML)

[738] arXiv:2106.15821 (cross-list from cs.SI) [pdf, other]

Title: Multilayer Networks for Text Analysis with Multiple Data Types

Charles C. Hyland, Yuanming Tao, Lamiae Azizi, Martin Gerlach, Tiago P. Peixoto, Eduardo G. Altmann

Comments: 17 pages, 6 figures

Journal-ref: EPJ Data Science volume 10, Article number: 33 (2021)

Subjects: Social and Information Networks (cs.SI); Physics and Society (physics.soc-ph); Machine Learning (stat.ML)

[739] arXiv:2106.15927 (cross-list from cs.LG) [pdf, other]

Title: A Robust Classification-autoencoder to Defend Outliers and Adversaries

Lijia Yu, Xiao-Shan Gao

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[740] arXiv:2106.15962 (cross-list from cs.LG) [pdf, other]

Title: On the Generative Utility of Cyclic Conditionals

Chang Liu, Haoyue Tang, Tao Qin, Jintao Wang, Tie-Yan Liu

Comments: NeurIPS'21 camera-ready version

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[741] arXiv:2106.16004 (cross-list from cs.LG) [pdf, other]

Title: What can linear interpolation of neural network loss landscapes tell us?

Tiffany Vlaar, Jonathan Frankle

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[742] arXiv:2106.16049 (cross-list from cs.CE) [pdf, other]

Title: Relational VAE: A Continuous Latent Variable Model for Graph Structured Data

Charilaos Mylonas, Imad Abdallah, Eleni Chatzi

Comments: Code and simulated datasets will be released after finalization of peer review

Subjects: Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG); Machine Learning (stat.ML)

[743] arXiv:2106.16116 (cross-list from cs.LG) [pdf, other]

Title: PSD Representations for Effective Probability Models

Alessandro Rudi, Carlo Ciliberto

Comments: 50 pages, 1 table

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[744] arXiv:2106.16225 (cross-list from cs.LG) [pdf, other]

Title: Analytic Insights into Structure and Rank of Neural Network Hessian Maps

Sidak Pal Singh, Gregor Bachmann, Thomas Hofmann

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Statistics Theory (math.ST); Machine Learning (stat.ML)