Machine Learning

Authors and titles for March 2023

[101] arXiv:2303.01272 [pdf, other]

Title: Navigating the Metric Maze: A Taxonomy of Evaluation Metrics for Anomaly Detection in Time Series

Sondre Sørbø, Massimiliano Ruocco

Comments: 29 pages, 28 figures and tables

Subjects: Machine Learning (cs.LG)

[102] arXiv:2303.01289 [pdf, other]

Title: Rethinking the Effect of Data Augmentation in Adversarial Contrastive Learning

Rundong Luo, Yifei Wang, Yisen Wang

Comments: ICLR 2023

Subjects: Machine Learning (cs.LG)

[103] arXiv:2303.01295 [pdf, other]

Title: Iterative Assessment and Improvement of DNN Operational Accuracy

Antonio Guerriero, Roberto Pietrantuono, Stefano Russo

Comments: Paper accepted at 45th International Conference on Software Engineering (ICSE'23 NIER), May 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Software Engineering (cs.SE)

[104] arXiv:2303.01335 [pdf, other]

Title: First-order ANIL provably learns representations despite overparametrization

Oğuz Kaan Yüksel, Etienne Boursier, Nicolas Flammarion

Comments: 42 pages, 17 figures

Journal-ref: O. K. Y\"uksel, E. Boursier and N. Flammarion, "First-order ANIL provably learns representations despite overparametrisation", in The Twelfth International Conference on Learning Representations, 2024

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[105] arXiv:2303.01372 [pdf, other]

Title: High-dimensional analysis of double descent for linear regression with random projections

Francis Bach (SIERRA)

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[106] arXiv:2303.01384 [pdf, other]

Title: DAVA: Disentangling Adversarial Variational Autoencoder

Benjamin Estermann, Roger Wattenhofer

Comments: Published as a conference paper at ICLR 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[107] arXiv:2303.01388 [pdf, other]

Title: Reinforced Labels: Multi-Agent Deep Reinforcement Learning for Point-Feature Label Placement

Petr Bobák, Ladislav Čmolík, Martin Čadík

Subjects: Machine Learning (cs.LG)

[108] arXiv:2303.01391 [pdf, other]

Title: The Ladder in Chaos: A Simple and Effective Improvement to General DRL Algorithms by Policy Path Trimming and Boosting

Hongyao Tang, Min Zhang, Jianye Hao

Comments: Rudimentary version. Work in progress

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[109] arXiv:2303.01412 [pdf, other]

Title: Hyperparameter Tuning and Model Evaluation in Causal Effect Estimation

Damian Machlanski, Spyridon Samothrakis, Paul Clarke

Comments: 36 pages, 3 figures

Subjects: Machine Learning (cs.LG); Methodology (stat.ME)

[110] arXiv:2303.01429 [pdf, other]

Title: Optimal transfer protocol by incremental layer defrosting

Federica Gerace, Diego Doimo, Stefano Sarao Mannelli, Luca Saglietti, Alessandro Laio

Subjects: Machine Learning (cs.LG)

[111] arXiv:2303.01433 [pdf, other]

Title: Do Machine Learning Models Learn Statistical Rules Inferred from Data?

Aaditya Naik, Yinjun Wu, Mayur Naik, Eric Wong

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[112] arXiv:2303.01456 [pdf, other]

Title: The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks

Spencer Frei, Gal Vardi, Peter L. Bartlett, Nathan Srebro

Comments: 42 pages; NeurIPS 2023 camera ready

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[113] arXiv:2303.01462 [pdf, other]

Title: Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization

Spencer Frei, Gal Vardi, Peter L. Bartlett, Nathan Srebro

Comments: 53 pages

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[114] arXiv:2303.01464 [pdf, other]

Title: Efficient Rate Optimal Regret for Adversarial Contextual MDPs Using Online Function Approximation

Orin Levy, Alon Cohen, Asaf Cassel, Yishay Mansour

Subjects: Machine Learning (cs.LG)

[115] arXiv:2303.01469 [pdf, other]

Title: Consistency Models

Yang Song, Prafulla Dhariwal, Mark Chen, Ilya Sutskever

Comments: ICML 2023

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[116] arXiv:2303.01475 [pdf, other]

Title: Over-training with Mixup May Hurt Generalization

Zixuan Liu, Ziqiao Wang, Hongyu Guo, Yongyi Mao

Comments: Accepted to ICLR 2023

Subjects: Machine Learning (cs.LG)

[117] arXiv:2303.01486 [pdf, other]

Title: Understanding plasticity in neural networks

Clare Lyle, Zeyu Zheng, Evgenii Nikishin, Bernardo Avila Pires, Razvan Pascanu, Will Dabney

Comments: Accepted to ICML 2023 (oral presentation)

Subjects: Machine Learning (cs.LG)

[118] arXiv:2303.01500 [pdf, other]

Title: Dropout Reduces Underfitting

Zhuang Liu, Zhiqiu Xu, Joseph Jin, Zhiqiang Shen, Trevor Darrell

Comments: ICML 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[119] arXiv:2303.01504 [pdf, html, other]

Title: Backdoor for Debias: Mitigating Model Bias with Backdoor Attack-based Artificial Bias

Shangxi Wu, Qiuyang He, Jian Yu, Jitao Sang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[120] arXiv:2303.01505 [pdf, other]

Title: Ternary Quantization: A Survey

Dan Liu, Xue Liu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computational Complexity (cs.CC)

[121] arXiv:2303.01506 [pdf, other]

Title: Understanding and Unifying Fourteen Attribution Methods with Taylor Interactions

Huiqi Deng, Na Zou, Mengnan Du, Weifu Chen, Guocan Feng, Ziwei Yang, Zheyang Li, Quanshi Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[122] arXiv:2303.01509 [pdf, other]

Title: EPAM: A Predictive Energy Model for Mobile AI

Anik Mallik, Haoxin Wang, Jiang Xie, Dawei Chen, Kyungtae Han

Comments: Accepted in IEEE International Conference on Communications (ICC); 28 May - 01 June 2023; Rome, Italy; six pages, seven figures, two tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[123] arXiv:2303.01510 [pdf, other]

Title: INO at Factify 2: Structure Coherence based Multi-Modal Fact Verification

Yinuo Zhang, Zhulin Tao, Xi Wang, Tongyue Wang

Comments: AAAI-23 DeFactify 2 Workshop (2nd Prize)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[124] arXiv:2303.01513 [pdf, other]

Title: Safe AI for health and beyond -- Monitoring to transform a health service

Mahed Abroshan, Michael Burkhart, Oscar Giles, Sam Greenbury, Zoe Kourtzi, Jack Roberts, Mihaela van der Schaar, Jannetta S Steyn, Alan Wilson, May Yong

Comments: 12 pages, 3 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[125] arXiv:2303.01538 [pdf, other]

Title: Feature Perturbation Augmentation for Reliable Evaluation of Importance Estimators in Neural Networks

Lennart Brocki, Neo Christopher Chung

Journal-ref: ICLR 2023 Workshop on Trustworthy ML; Full Paper in Pattern Recognition Letters

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[126] arXiv:2303.01557 [pdf, other]

Title: BenchDirect: A Directed Language Model for Compiler Benchmarks

Foivos Tsimpourlas, Pavlos Petoumenos, Min Xu, Chris Cummins, Kim Hazelwood, Ajitha Rajan, Hugh Leather

Comments: arXiv admin note: substantial text overlap with arXiv:2208.06555

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[127] arXiv:2303.01560 [pdf, html, other]

Title: Active Learning and Bayesian Optimization: a Unified Perspective to Learn with a Goal

Francesco Di Fiore, Michela Nardelli, Laura Mainini

Journal-ref: Archives of Computational Methods in Engineering (2024): 1-29

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[128] arXiv:2303.01567 [pdf, other]

Title: Deep Neural Networks with Efficient Guaranteed Invariances

Matthias Rath, Alexandru Paul Condurache

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[129] arXiv:2303.01569 [pdf, other]

Title: Chemically Transferable Generative Backmapping of Coarse-Grained Proteins

Soojung Yang, Rafael Gómez-Bombarelli

Comments: 18 pages

Subjects: Machine Learning (cs.LG); Biomolecules (q-bio.BM)

[130] arXiv:2303.01590 [pdf, other]

Title: Technical report: Graph Neural Networks go Grammatical

Jason Piquenot, Aldo Moscatelli, Maxime Bérar, Pierre Héroux, Romain raveaux, Jean-Yves Ramel, Sébastien Adam

Comments: 24 pages, 11 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[131] arXiv:2303.01610 [pdf, other]

Title: Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers

Tianlong Chen, Zhenyu Zhang, Ajay Jaiswal, Shiwei Liu, Zhangyang Wang

Comments: Codes and models are available in this https URL

Subjects: Machine Learning (cs.LG)

[132] arXiv:2303.01621 [pdf, other]

Title: GlucoSynth: Generating Differentially-Private Synthetic Glucose Traces

Josephine Lamp, Mark Derdzinski, Christopher Hannemann, Joost van der Linden, Lu Feng, Tianhao Wang, David Evans

Journal-ref: Advances in Neural Information Processing Systems 36 (2023)

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR)

[133] arXiv:2303.01630 [pdf, other]

Title: Learning to Adapt to Online Streams with Distribution Shifts

Chenyan Wu, Yimu Pan, Yandong Li, James Z. Wang

Subjects: Machine Learning (cs.LG)

[134] arXiv:2303.01668 [pdf, other]

Title: RePreM: Representation Pre-training with Masked Model for Reinforcement Learning

Yuanying Cai, Chuheng Zhang, Wei Shen, Xuyun Zhang, Wenjie Ruan, Longbo Huang

Comments: Accepted by AAAI-23

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[135] arXiv:2303.01682 [pdf, other]

Title: Neural-BO: A Black-box Optimization Algorithm using Deep Neural Networks

Dat Phan-Trong, Hung Tran-The, Sunil Gupta

Subjects: Machine Learning (cs.LG)

[136] arXiv:2303.01684 [pdf, other]

Title: BO-Muse: A human expert and AI teaming framework for accelerated experimental design

Sunil Gupta, Alistair Shilton, Arun Kumar A V, Shannon Ryan, Majid Abdolshah, Hung Le, Santu Rana, Julian Berk, Mahad Rashid, Svetha Venkatesh

Comments: 34 Pages, 7 Figures and 5 Tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[137] arXiv:2303.01687 [pdf, html, other]

Title: Differentially Private Neural Tangent Kernels for Privacy-Preserving Data Generation

Yilin Yang, Kamil Adamczewski, Danica J. Sutherland, Xiaoxiao Li, Mijung Park

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

[138] arXiv:2303.01692 [pdf, other]

Title: Travel Demand Forecasting: A Fair AI Approach

Xiaojian Zhang, Qian Ke, Xilei Zhao

Comments: improved the methodology; updated new contents

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[139] arXiv:2303.01704 [pdf, html, other]

Title: Feature Importance Disparities for Data Bias Investigations

Peter W. Chang, Leor Fishman, Seth Neel

Comments: ICML 2024 version. 9 pages, 5 figures, 3 tables. Appendix: 18 pages, 9 figures, 4 tables

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY)

[140] arXiv:2303.01713 [pdf, other]

Title: Convex Bounds on the Softmax Function with Applications to Robustness Verification

Dennis Wei, Haoze Wu, Min Wu, Pin-Yu Chen, Clark Barrett, Eitan Farchi

Comments: AISTATS 2023

Subjects: Machine Learning (cs.LG)

[141] arXiv:2303.01724 [pdf, other]

Title: Node-Specific Space Selection via Localized Geometric Hyperbolicity in Graph Neural Networks

See Hian Lee, Feng Ji, Wee Peng Tay

Subjects: Machine Learning (cs.LG)

[142] arXiv:2303.01728 [pdf, other]

Title: Guarded Policy Optimization with Imperfect Online Demonstrations

Zhenghai Xue, Zhenghao Peng, Quanyi Li, Zhihan Liu, Bolei Zhou

Comments: Accepted at ICLR 2023 (top 25%)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Robotics (cs.RO)

[143] arXiv:2303.01739 [pdf, other]

Title: Study of Distractors in Neural Models of Code

Md Rafiqul Islam Rabin, Aftab Hussain, Sahil Suneja, Mohammad Amin Alipour

Comments: The 1st International Workshop on Interpretability and Robustness in Neural Software Engineering, Co-located with ICSE (InteNSE'23)

Subjects: Machine Learning (cs.LG); Programming Languages (cs.PL); Software Engineering (cs.SE)

[144] arXiv:2303.01748 [pdf, other]

Title: A Complete Recipe for Diffusion Generative Models

Kushagra Pandey, Stephan Mandt

Comments: Accepted in ICCV'23 (Oral Presentation)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[145] arXiv:2303.01767 [pdf, other]

Title: Implicit Stochastic Gradient Descent for Training Physics-informed Neural Networks

Ye Li, Song-Can Chen, Sheng-Jun Huang

Comments: 17 pages, published as a conference paper at AAAI23

Subjects: Machine Learning (cs.LG)

[146] arXiv:2303.01768 [pdf, other]

Title: Toward Risk-based Optimistic Exploration for Cooperative Multi-Agent Reinforcement Learning

Jihwan Oh, Joonkee Kim, Minchan Jeong, Se-Young Yun

Comments: AAMAS2023 camera-ready version. First two authors contributed equally

Subjects: Machine Learning (cs.LG); Multiagent Systems (cs.MA)

[147] arXiv:2303.01774 [pdf, other]

Title: Bayesian Optimization over High-Dimensional Combinatorial Spaces via Dictionary-based Embeddings

Aryan Deshwal, Sebastian Ament, Maximilian Balandat, Eytan Bakshy, Janardhan Rao Doppa, David Eriksson

Comments: Appearing in AISTATS 2023

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[148] arXiv:2303.01775 [pdf, other]

Title: Continual Causal Inference with Incremental Observational Data

Zhixuan Chu, Ruopeng Li, Stephen Rathbun, Sheng Li

Comments: The 39th IEEE International Conference on Data Engineering (ICDE 2023). arXiv admin note: text overlap with arXiv:2301.01026

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[149] arXiv:2303.01778 [pdf, other]

Title: FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Training

Zhenheng Tang, Xiaowen Chu, Ryan Yide Ran, Sunwoo Lee, Shaohuai Shi, Yonggang Zhang, Yuxin Wang, Alex Qiaozhong Liang, Salman Avestimehr, Chaoyang He

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[150] arXiv:2303.01792 [pdf, other]

Title: Graph-based Extreme Feature Selection for Multi-class Classification Tasks

Shir Friedman, Gonen Singer, Neta Rabin

Subjects: Machine Learning (cs.LG)