Optimization and Control

Authors and titles for January 2022

[351] arXiv:2201.11137 (cross-list from cs.LG) [pdf, other]

Title: Born-Infeld (BI) for AI: Energy-Conserving Descent (ECD) for Optimization

G. Bruno De Luca, Eva Silverstein

Comments: ICML 2022. 9 pages + Appendix, 8 figures. Code available at this https URL

Journal-ref: Proceedings of the 39th International Conference on Machine Learning, PMLR 162:4918-4936, 2022

Subjects: Machine Learning (cs.LG); Cosmology and Nongalactic Astrophysics (astro-ph.CO); High Energy Physics - Theory (hep-th); Optimization and Control (math.OC); Machine Learning (stat.ML)

[352] arXiv:2201.11154 (cross-list from math.NA) [pdf, other]

Title: Sketching for low-rank nonnegative matrix approximation: Numerical study

Sergey A. Matveev, Stanislav Budzinskiy

Comments: Accepted version

Journal-ref: Russian Journal of Numerical Analysis and Mathematical Modelling 38, no. 2 (2023): 99-114

Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)

[353] arXiv:2201.11162 (cross-list from stat.ML) [pdf, other]

Title: Self-Certifying Classification by Linearized Deep Assignment

Bastian Boll, Alexander Zeilmann, Stefania Petra, Christoph Schnörr

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[354] arXiv:2201.11204 (cross-list from cs.LG) [pdf, other]

Title: On the Convergence of mSGD and AdaGrad for Stochastic Optimization

Ruinan Jin, Yu Xing, Xingkang He

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[355] arXiv:2201.11260 (cross-list from cs.LG) [pdf, other]

Title: To what extent should we trust AI models when they extrapolate?

Roozbeh Yousefzadeh, Xuenan Cao

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)

[356] arXiv:2201.11356 (cross-list from cs.LG) [pdf, other]

Title: Benchmarking learned non-Cartesian k-space trajectories and reconstruction networks

Chaithya G R (NEUROSPIN, PARIETAL), Philippe Ciuciu (NEUROSPIN, PARIETAL)

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Optimization and Control (math.OC); Machine Learning (stat.ML)

[357] arXiv:2201.11587 (cross-list from cs.CC) [pdf, other]

Title: Two-Commodity Flow is Equivalent to Linear Programming under Nearly-Linear Time Reductions

Ming Ding, Rasmus Kyng, Peng Zhang

Comments: 65 pages, 6 figures

Subjects: Computational Complexity (cs.CC); Data Structures and Algorithms (cs.DS); Optimization and Control (math.OC)

[358] arXiv:2201.11616 (cross-list from cs.LG) [pdf, other]

Title: On the Role of Multi-Objective Optimization to the Transit Network Design Problem

Vasco D. Silva, Anna Finamore, Rui Henriques

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)

[359] arXiv:2201.11640 (cross-list from eess.SY) [pdf, other]

Title: Towards Data-driven LQR with Koopmanizing Flows

Petar Bevanda, Max Beier, Shahab Heshmati-Alamdari, Stefan Sosnowski, Sandra Hirche

Comments: Final version, accepted for presentation at the 6th IFAC Conference on Intelligent Control and Automation Sciences (ICONS), 2022. arXiv admin note: text overlap with arXiv:2112.04085

Subjects: Systems and Control (eess.SY); Machine Learning (cs.LG); Dynamical Systems (math.DS); Optimization and Control (math.OC)

[360] arXiv:2201.11684 (cross-list from math.NA) [pdf, other]

Title: Optimization of Hopf bifurcation points

Nicolas Boullé, Patrick E. Farrell, Marie E. Rognes

Comments: 22 pages, 8 figures

Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)

[361] arXiv:2201.11825 (cross-list from eess.SY) [pdf, other]

Title: Adam-based Augmented Random Search for Control Policies for Distributed Energy Resource Cyber Attack Mitigation

Daniel Arnold, Sy-Toan Ngo, Ciaran Roberts, Yize Chen, Anna Scaglione, Sean Peisert

Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

[362] arXiv:2201.11876 (cross-list from cs.AI) [pdf, other]

Title: Regionalized Optimization

Grégoire Sergeant-Perthuis

Subjects: Artificial Intelligence (cs.AI); Optimization and Control (math.OC)

[363] arXiv:2201.11962 (cross-list from q-fin.TR) [pdf, other]

Title: Risk-Sensitive Optimal Execution via a Conditional Value-at-Risk Objective

Seungki Min, Ciamac C. Moallemi, Costis Maglaras

Subjects: Trading and Market Microstructure (q-fin.TR); Optimization and Control (math.OC)

[364] arXiv:2201.11968 (cross-list from cs.LG) [pdf, other]

Title: Training invariances and the low-rank phenomenon: beyond linear networks

Thien Le, Stefanie Jegelka

Comments: 26 pages, 3 figures, ICLR2022

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[365] arXiv:2201.11989 (cross-list from cs.LG) [pdf, other]

Title: Existence and Estimation of Critical Batch Size for Training Generative Adversarial Networks with Two Time-Scale Update Rule

Naoki Sato, Hideaki Iiduka

Comments: Accepted at the 40th International Conference on Machine Learning (ICML 2023)

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[366] arXiv:2201.12052 (cross-list from cs.LG) [pdf, other]

Title: Improved Overparametrization Bounds for Global Convergence of Stochastic Gradient Descent for Shallow Neural Networks

Bartłomiej Polaczyk, Jacek Cyranka

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[367] arXiv:2201.12124 (cross-list from cs.LG) [pdf, other]

Title: Adaptive Optimizer for Automated Hyperparameter Optimization Problem

Huayuan Sun

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[368] arXiv:2201.12224 (cross-list from cs.LG) [pdf, other]

Title: Learning Stationary Nash Equilibrium Policies in $n$-Player Stochastic Games with Independent Chains

S. Rasoul Etesami

Subjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Multiagent Systems (cs.MA); Systems and Control (eess.SY); Optimization and Control (math.OC)

[369] arXiv:2201.12248 (cross-list from math.CO) [pdf, other]

Title: Graphs with $G^p$-connected medians

Laurine Bénéteau, Jérémie Chalopin, Victor Chepoi, Yann Vaxès

Comments: 34 pages, 7 figures

Subjects: Combinatorics (math.CO); Discrete Mathematics (cs.DM); Optimization and Control (math.OC)

[370] arXiv:2201.12332 (cross-list from cs.LG) [pdf, other]

Title: On the Hidden Biases of Policy Mirror Ascent in Continuous Action Spaces

Amrit Singh Bedi, Souradip Chakraborty, Anjaly Parayil, Brian Sadler, Pratap Tokekar, Alec Koppel

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)

[371] arXiv:2201.12348 (cross-list from eess.IV) [pdf, html, other]

Title: End-to-End Optimization of Metasurfaces for Imaging with Compressed Sensing

Gaurav Arya, William F. Li, Charles Roques-Carmes, Marin Soljačić, Steven G. Johnson, Zin Lin

Journal-ref: ACS Photonics 2024, 11, 5, 2077-2087

Subjects: Image and Video Processing (eess.IV); Optimization and Control (math.OC); Optics (physics.optics)

[372] arXiv:2201.12426 (cross-list from cs.LG) [pdf, other]

Title: A Simple Guard for Learned Optimizers

Isabeau Prémont-Schwarz, Jaroslav Vítků, Jan Feyereisl

Comments: 8 pages main article, 19 figures total, 2 pages of references, 7 pages of appendix. ICML 2022. Added Appendix Section H with extra experiments about stability

Journal-ref: In Proc. 39th International Conference on Machine Learning (ICML 2022)

Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Optimization and Control (math.OC)

[373] arXiv:2201.12460 (cross-list from math.NA) [pdf, other]

Title: On the Global Convergence of Particle Swarm Optimization Methods

Hui Huang, Jinniao Qiu, Konstantin Riedl

Comments: 28 pages, 4 figures

Journal-ref: Appl. Math. Optim. 88.2 (2023), Paper No. 30

Subjects: Numerical Analysis (math.NA); Analysis of PDEs (math.AP); Optimization and Control (math.OC)

[374] arXiv:2201.12612 (cross-list from cs.GT) [pdf, html, other]

Title: On Non-Cooperative Perfect Information Semi-Markov Games

K. G. Bakshi, S. Sinha

Comments: The result in this paper is not true

Subjects: Computer Science and Game Theory (cs.GT); Optimization and Control (math.OC)

[375] arXiv:2201.12719 (cross-list from cs.LG) [pdf, html, other]

Title: Faster Convergence of Local SGD for Over-Parameterized Models

Tiancheng Qin, S. Rasoul Etesami, César A. Uribe

Journal-ref: Transactions on Machine Learning Research, ISSN 2835-8856, 2024

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[376] arXiv:2201.12767 (cross-list from cs.LG) [pdf, other]

Title: Bayesian Optimization For Multi-Objective Mixed-Variable Problems

Haris Moazam Sheikh, Philip S. Marcus

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Optimization and Control (math.OC)

[377] arXiv:2201.12795 (cross-list from cs.LG) [pdf, other]

Title: Training Thinner and Deeper Neural Networks: Jumpstart Regularization

Carles Riera, Camilo Rey, Thiago Serra, Eloi Puertas, Oriol Pujol

Comments: CPAIOR 2022 (to appear)

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[378] arXiv:2201.12932 (cross-list from math.PR) [pdf, other]

Title: A new proof of the description of the convex hull of space curves with totally positive torsion

Jaume de Dios Pont, Paata Ivanisvili, José Madrid

Comments: 36 pages, 10 figures. The main results of the paper follow (or are included) in two monographs M.G. Krein and A. A. Nudelman, The Markov Moment Problem and Extremal Problems; and S. Karlin and W. J. Studden, Tchebycheff Systems: With Applications in Analysis and Statistics. In our paper we give a new self contained proofs of these results

Subjects: Probability (math.PR); Classical Analysis and ODEs (math.CA); Differential Geometry (math.DG); Optimization and Control (math.OC)

[379] arXiv:2201.12933 (cross-list from math.FA) [pdf, other]

Title: Riemannian block SPD coupling manifold and its application to optimal transport

Andi Han, Bamdev Mishra, Pratik Jawanpuria, Junbin Gao

Subjects: Functional Analysis (math.FA); Optimization and Control (math.OC); Machine Learning (stat.ML)

[380] arXiv:2201.12975 (cross-list from cs.LG) [pdf, html, other]

Title: Rotting Infinitely Many-armed Bandits

Jung-hun Kim, Milan Vojnovic, Se-Young Yun

Comments: ICML2022

Subjects: Machine Learning (cs.LG); Data Structures and Algorithms (cs.DS); Optimization and Control (math.OC); Machine Learning (stat.ML)

[381] arXiv:2201.13012 (cross-list from cs.LG) [pdf, other]

Title: Topology-Preserving Dimensionality Reduction via Interleaving Optimization

Bradley J. Nelson, Yuan Luo

Subjects: Machine Learning (cs.LG); Computational Geometry (cs.CG); Optimization and Control (math.OC)

[382] arXiv:2201.13052 (cross-list from cs.LG) [pdf, other]

Title: Inductive Matrix Completion: No Bad Local Minima and a Fast Algorithm

Pini Zilber, Boaz Nadler

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[383] arXiv:2201.13221 (cross-list from eess.SY) [pdf, other]

Title: Risk-based Design of Regular Plane Frames Subject to Damage by Abnormal Events: a Conceptual Study

Andre T. Beck, Lucas da Rosa Ribeiro, Marcos Valdebenito, Hector Jensen

Comments: 36 pages 12 figures

Journal-ref: J. Struct. Eng. 2022, 148(1): 04021229

Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

[384] arXiv:2201.13281 (cross-list from math.AP) [pdf, other]

Title: Convergence of level sets in fractional Laplacian regularization

José A. Iglesias, Gwenael Mercier

Comments: 33 pages, 1 figure. V2: Accepted version, minor changes and new title

Journal-ref: Inverse Problems, 38(12):124003, 2022

Subjects: Analysis of PDEs (math.AP); Optimization and Control (math.OC)

[385] arXiv:2201.13320 (cross-list from cs.LG) [pdf, other]

Title: BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression

Haoyu Zhao, Boyue Li, Zhize Li, Peter Richtárik, Yuejie Chi

Comments: NeurIPS 2022

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS); Optimization and Control (math.OC); Machine Learning (stat.ML)

[386] arXiv:2201.13387 (cross-list from cs.LG) [pdf, other]

Title: L-SVRG and L-Katyusha with Adaptive Sampling

Boxin Zhao, Boxiang Lyu, Mladen Kolar

Comments: Published in Transactions on Machine Learning Research (03/2023)

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[387] arXiv:2201.13409 (cross-list from stat.ML) [pdf, other]

Title: A framework for bilevel optimization that enables stochastic and global variance reduction algorithms

Mathieu Dagréou, Pierre Ablin, Samuel Vaiter, Thomas Moreau

Comments: Accepted at NeurIPS 2022

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[388] arXiv:2201.13419 (cross-list from cs.LG) [pdf, other]

Title: Agnostic Learnability of Halfspaces via Logistic Loss

Ziwei Ji, Kwangjun Ahn, Pranjal Awasthi, Satyen Kale, Stefani Karp

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)