Machine Learning

Authors and titles for July 2021

[326] arXiv:2107.09744 (cross-list from physics.plasm-ph) [pdf, other]

Title: Turbulent field fluctuations in gyrokinetic and fluid plasmas

Abhilash Mathews, Noah Mandell, Manaure Francisquez, Jerry Hughes, Ammar Hakim

Comments: 13 pages, 5 figures

Subjects: Plasma Physics (physics.plasm-ph); Machine Learning (cs.LG); Computational Physics (physics.comp-ph); Machine Learning (stat.ML)

[327] arXiv:2107.09773 (cross-list from cs.LG) [pdf, other]

Title: Statistical Estimation from Dependent Data

Yuval Dagan, Constantinos Daskalakis, Nishanth Dikkala, Surbhi Goel, Anthimos Vardis Kandiros

Comments: 41 pages, ICML 2021

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[328] arXiv:2107.09802 (cross-list from cs.LG) [pdf, other]

Title: Private Alternating Least Squares: Practical Private Matrix Completion with Tighter Rates

Steve Chien, Prateek Jain, Walid Krichene, Steffen Rendle, Shuang Song, Abhradeep Thakurta, Li Zhang

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[329] arXiv:2107.09853 (cross-list from eess.SP) [pdf, other]

Title: EMG Pattern Recognition via Bayesian Inference with Scale Mixture-Based Stochastic Generative Models

Akira Furui, Takuya Igaue, Toshio Tsuji

Comments: This paper is accepted for publication in Expert Systems with Applications

Journal-ref: Expert Systems with Applications, vol. 185, 115644, Dec 2021

Subjects: Signal Processing (eess.SP); Machine Learning (cs.LG); Machine Learning (stat.ML)

[330] arXiv:2107.09912 (cross-list from cs.LG) [pdf, other]

Title: Design of Experiments for Stochastic Contextual Linear Bandits

Andrea Zanette, Kefan Dong, Jonathan Lee, Emma Brunskill

Comments: Initial submission

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[331] arXiv:2107.09949 (cross-list from cs.LG) [pdf, other]

Title: Online structural kernel selection for mobile health

Eura Shin, Pedja Klasnja, Susan Murphy, Finale Doshi-Velez

Comments: Workshop paper in ICML IMLH 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[332] arXiv:2107.09950 (cross-list from cs.LG) [pdf, other]

Title: Boundary of Distribution Support Generator (BDSG): Sample Generation on the Boundary

Nikolaos Dionelis, Mehrdad Yaghoobi, Sotirios A. Tsaftaris

Comments: 5 pages, 2020 IEEE International Conference on Image Processing (ICIP)

Journal-ref: 2020 IEEE International Conference on Image Processing (ICIP)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[333] arXiv:2107.09957 (cross-list from cs.LG) [pdf, other]

Title: Memorization in Deep Neural Networks: Does the Loss Function matter?

Deep Patel, P.S. Sastry

Comments: Accepted at PAKDD 2021. 12 pages and 5 figures

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[334] arXiv:2107.10013 (cross-list from eess.SY) [pdf, other]

Title: Optimal Operation of Power Systems with Energy Storage under Uncertainty: A Scenario-based Method with Strategic Sampling

Ren Hu, Qifeng Li

Subjects: Systems and Control (eess.SY); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[335] arXiv:2107.10030 (cross-list from cs.LG) [pdf, other]

Title: Differentiable Feature Selection, a Reparameterization Approach

Jérémie Dona (MLIA), Patrick Gallinari (MLIA)

Journal-ref: European Conference (ECML-PKDD), In press

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[336] arXiv:2107.10043 (cross-list from eess.SP) [pdf, other]

Title: KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics

Guy Revach, Nir Shlezinger, Xiaoyong Ni, Adria Lopez Escoriza, Ruud J. G. van Sloun, Yonina C. Eldar

Comments: Accepted for publication in IEEE Transactions on Signal Processing - TSP

Subjects: Signal Processing (eess.SP); Machine Learning (cs.LG); Machine Learning (stat.ML)

[337] arXiv:2107.10072 (cross-list from cs.LG) [pdf, other]

Title: Interpreting diffusion score matching using normalizing flow

Wenbo Gong, Yingzhen Li

Comments: 8 pages, International Conference on Machine Learning (ICML) INNF+ 2021 Workshop Spotlight

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[338] arXiv:2107.10127 (cross-list from math.ST) [pdf, other]

Title: Extracting Governing Laws from Sample Path Data of Non-Gaussian Stochastic Dynamical Systems

Yang Li, Jinqiao Duan

Comments: arXiv admin note: substantial text overlap with arXiv:2005.03769

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[339] arXiv:2107.10143 (cross-list from cs.LG) [pdf, other]

Title: On the Memorization Properties of Contrastive Learning

Ildus Sadrtdinov, Nadezhda Chirkova, Ekaterina Lobacheva

Comments: Published in Workshop on Overparameterization: Pitfalls & Opportunities at ICML 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[340] arXiv:2107.10199 (cross-list from cs.LG) [pdf, other]

Title: Distribution of Classification Margins: Are All Data Equal?

Andrzej Banburski, Fernanda De La Torre, Nishka Pant, Ishana Shastri, Tomaso Poggio

Comments: Previously online as CBMM Memo 115 on the CBMM MIT site

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[341] arXiv:2107.10209 (cross-list from cs.LG) [pdf, other]

Title: Efficient Algorithms for Learning Depth-2 Neural Networks with General ReLU Activations

Pranjal Awasthi, Alex Tang, Aravindan Vijayaraghavan

Comments: 45 pages (including appendix). This version fixes an error in the previous version of the paper

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[342] arXiv:2107.10450 (cross-list from cs.DS) [pdf, other]

Title: Learning Sparse Fixed-Structure Gaussian Bayesian Networks

Arnab Bhattacharyya, Davin Choo, Rishikesh Gajjala, Sutanu Gayen, Yuhao Wang

Comments: 30 pages, 11 figures, acknowledgement added

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)

[343] arXiv:2107.10483 (cross-list from cs.LG) [pdf, other]

Title: Efficient Neural Causal Discovery without Acyclicity Constraints

Phillip Lippe, Taco Cohen, Efstratios Gavves

Comments: Published as a conference paper at the International Conference on Learning Representations (ICLR), 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[344] arXiv:2107.10492 (cross-list from cs.LG) [pdf, other]

Title: Bandit Quickest Changepoint Detection

Aditya Gopalan, Venkatesh Saligrama, Braghadeesh Lakshminarayanan

Comments: Some typos fixed in the NeurIPS 2021 version

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

[345] arXiv:2107.10703 (cross-list from cs.LG) [pdf, other]

Title: Typing assumptions improve identification in causal discovery

Philippe Brouillard, Perouz Taslakian, Alexandre Lacoste, Sebastien Lachapelle, Alexandre Drouin

Comments: 30 pages, 13 figures, accepted for the 1st conference on Causal Learning and Reasoning (CLeaR), 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[346] arXiv:2107.10731 (cross-list from cs.LG) [pdf, other]

Title: Neural Variational Gradient Descent

Lauro Langosco di Langosco, Vincent Fortuin, Heiko Strathmann

Subjects: Machine Learning (cs.LG); Computation (stat.CO); Machine Learning (stat.ML)

[347] arXiv:2107.10835 (cross-list from cs.SI) [pdf, other]

Title: Recovering lost and absent information in temporal networks

James P. Bagrow, Sune Lehmann

Comments: 19 pages, 5 figures, 1 table, plus supporting information

Subjects: Social and Information Networks (cs.SI); Physics and Society (physics.soc-ph); Applications (stat.AP); Machine Learning (stat.ML)

[348] arXiv:2107.10869 (cross-list from cs.HC) [pdf, other]

Title: Filament Plots for Data Visualization

Nate Strawn

Comments: 43 pages, 13 figures; newest version updates plots, clarifies some terminology, and clarifies proofs

Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[349] arXiv:2107.10947 (cross-list from stat.CO) [pdf, other]

Title: On Integral Theorems and their Statistical Properties

Nhat Ho, Stephen G. Walker

Comments: 21 pages, 5 figures. arXiv admin note: text overlap with arXiv:2106.06608

Subjects: Computation (stat.CO); Classical Analysis and ODEs (math.CA); Methodology (stat.ME); Machine Learning (stat.ML)

[350] arXiv:2107.10959 (cross-list from stat.ME) [pdf, other]

Title: Inference for High Dimensional Censored Quantile Regression

Zhe Fei, Qi Zheng, Hyokyoung G. Hong, Yi Li

Subjects: Methodology (stat.ME); Machine Learning (stat.ML)

[351] arXiv:2107.10960 (cross-list from cs.LG) [pdf, other]

Title: Implicit Rate-Constrained Optimization of Non-decomposable Objectives

Abhishek Kumar, Harikrishna Narasimhan, Andrew Cotter

Comments: ICML 2021; Code available at this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[352] arXiv:2107.11059 (cross-list from cs.LG) [pdf, other]

Title: LocalGLMnet: interpretable deep learning for tabular data

Ronald Richman, Mario V. Wüthrich

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Statistical Finance (q-fin.ST); Applications (stat.AP); Machine Learning (stat.ML)

[353] arXiv:2107.11136 (cross-list from cs.LG) [pdf, other]

Title: High Dimensional Differentially Private Stochastic Optimization with Heavy-tailed Data

Lijie Hu, Shuo Ni, Hanshen Xiao, Di Wang

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[354] arXiv:2107.11153 (cross-list from cs.LG) [pdf, other]

Title: Constellation: Learning relational abstractions over objects for compositional imagination

James C.R. Whittington, Rishabh Kabra, Loic Matthey, Christopher P. Burgess, Alexander Lerchner

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[355] arXiv:2107.11231 (cross-list from cond-mat.stat-mech) [pdf, other]

Title: Optimization on manifolds: A symplectic approach

Guilherme França, Alessandro Barp, Mark Girolami, Michael I. Jordan

Comments: additional results, including rates for constrained optimization on manifolds

Subjects: Statistical Mechanics (cond-mat.stat-mech); Optimization and Control (math.OC); Machine Learning (stat.ML)

[356] arXiv:2107.11433 (cross-list from cs.LG) [pdf, other]

Title: A general sample complexity analysis of vanilla policy gradient

Rui Yuan, Robert M. Gower, Alessandro Lazaric

Comments: Accepted at AISTATS 2022. This version updates references and adds acknowledgement to Matteo Papini who greatly improved our work before the submission

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[357] arXiv:2107.11609 (cross-list from cs.LG) [pdf, other]

Title: A Model-Agnostic Algorithm for Bayes Error Determination in Binary Classification

Umberto Michelucci, Michela Sperti, Dario Piga, Francesca Venturini, Marco A. Deriu

Comments: 21 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[358] arXiv:2107.11630 (cross-list from cs.LG) [pdf, other]

Title: Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Them

Florian Tramèr

Comments: ICML 2022 (Long Talk)

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

[359] arXiv:2107.11658 (cross-list from cs.LG) [pdf, other]

Title: Tail of Distribution GAN (TailGAN): Generative-Adversarial-Network-Based Boundary Formation

Nikolaos Dionelis, Mehrdad Yaghoobi, Sotirios A. Tsaftaris

Comments: 5 pages, 2020 Sensor Signal Processing for Defence Conference (SSPD)

Journal-ref: 2020 Sensor Signal Processing for Defence Conference (SSPD)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[360] arXiv:2107.11712 (cross-list from cs.DS) [pdf, other]

Title: Efficient inference of interventional distributions

Arnab Bhattacharyya, Sutanu Gayen, Saravanan Kandasamy, Vedant Raval, N. V. Vinodchandran

Comments: 16 pages, 2 figures

Subjects: Data Structures and Algorithms (cs.DS); Machine Learning (cs.LG); Machine Learning (stat.ML)

[361] arXiv:2107.11717 (cross-list from cs.LG) [pdf, other]

Title: Invariance-based Multi-Clustering of Latent Space Embeddings for Equivariant Learning

Chandrajit Bajaj, Avik Roy, Haoran Zhang

Comments: The codebase for MCEVAE is available at this https URL

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[362] arXiv:2107.11774 (cross-list from cs.LG) [pdf, other]

Title: SGD with a Constant Large Learning Rate Can Converge to Local Maxima

Liu Ziyin, Botao Li, James B. Simon, Masahito Ueda

Comments: Fixed typos

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[363] arXiv:2107.11858 (cross-list from math.ST) [pdf, other]

Title: Estimation of Stationary Optimal Transport Plans

Kevin O'Connor, Kevin McGoff, Andrew B Nobel

Subjects: Statistics Theory (math.ST); Dynamical Systems (math.DS); Machine Learning (stat.ML)

[364] arXiv:2107.11869 (cross-list from econ.EM) [pdf, other]

Title: Adaptive Estimation and Uniform Confidence Bands for Nonparametric Structural Functions and Elasticities

Xiaohong Chen, Timothy Christensen, Sid Kankanala

Comments: The data-driven choice of sieve dimension in this paper is based on and supersedes Section 3 of the preprint arXiv:1508.03365v1

Subjects: Econometrics (econ.EM); Methodology (stat.ME); Machine Learning (stat.ML)

[365] arXiv:2107.11892 (cross-list from cs.LG) [pdf, other]

Title: A brief note on understanding neural networks as Gaussian processes

Mengwu Guo

Subjects: Machine Learning (cs.LG); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (stat.ML)

[366] arXiv:2107.12034 (cross-list from cs.LG) [pdf, other]

Title: Workpiece Image-based Tool Wear Classification in Blanking Processes Using Deep Convolutional Neural Networks

Dirk Alexander Molitor, Christian Kubik, Ruben Helmut Hetfleisch, Peter Groche

Journal-ref: Production Engineering 16(4) (2022) 481-492

Subjects: Machine Learning (cs.LG); Image and Video Processing (eess.IV); Machine Learning (stat.ML)

[367] arXiv:2107.12100 (cross-list from cs.SI) [pdf, other]

Title: Predicting Influential Higher-Order Patterns in Temporal Network Data

Christoph Gote, Vincenzo Perri, Ingo Scholtes

Comments: 18 pages, 4 figures, 2 tables

Subjects: Social and Information Networks (cs.SI); Information Theory (cs.IT); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[368] arXiv:2107.12248 (cross-list from cs.LG) [pdf, other]

Title: Are Bayesian neural networks intrinsically good at out-of-distribution detection?

Christian Henning, Francesco D'Angelo, Benjamin F. Grewe

Comments: Published at UDL Workshop, ICML 2021

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[369] arXiv:2107.12250 (cross-list from cs.LG) [pdf, other]

Title: Uncertainty-Aware Time-to-Event Prediction using Deep Kernel Accelerated Failure Time Models

Zhiliang Wu, Yinchong Yang, Peter A. Fasching, Volker Tresp

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[370] arXiv:2107.12364 (cross-list from math.ST) [pdf, other]

Title: Plugin Estimation of Smooth Optimal Transport Maps

Tudor Manole, Sivaraman Balakrishnan, Jonathan Niles-Weed, Larry Wasserman

Comments: To appear in the Annals of Statistics

Subjects: Statistics Theory (math.ST); Machine Learning (stat.ML)

[371] arXiv:2107.12365 (cross-list from math.ST) [pdf, other]

Title: Inference for Heteroskedastic PCA with Missing Data

Yuling Yan, Yuxin Chen, Jianqing Fan

Comments: accepted to Annals of Statistics

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)

[372] arXiv:2107.12438 (cross-list from math.OC) [pdf, other]

Title: Debiasing In-Sample Policy Performance for Small-Data, Large-Scale Optimization

Vishal Gupta, Michael Huang, Paat Rusmevichientong

Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[373] arXiv:2107.12521 (cross-list from cs.LG) [pdf, other]

Title: Restricted Boltzmann Machine and Deep Belief Network: Tutorial and Survey

Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley

Comments: To appear as a part of an upcoming textbook on dimensionality reduction and manifold learning. v2: applied readers' feedback

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Data Analysis, Statistics and Probability (physics.data-an); Machine Learning (stat.ML)

[374] arXiv:2107.12525 (cross-list from math.ST) [pdf, other]

Title: Proof: Accelerating Approximate Aggregation Queries with Expensive Predicates

Daniel Kang, John Guibas, Peter Bailis, Tatsunori Hashimoto, Yi Sun, Matei Zaharia

Subjects: Statistics Theory (math.ST); Databases (cs.DB); Machine Learning (cs.LG); Machine Learning (stat.ML)

[375] arXiv:2107.12580 (cross-list from cs.LG) [pdf, other]

Title: Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization

Chiyuan Zhang, Maithra Raghu, Jon Kleinberg, Samy Bengio

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)