Optimization and Control

Authors and titles for June 2023

[276] arXiv:2306.02121 (cross-list from cs.LG) [pdf, other]

Title: Identifying Subgroups of ICU Patients Using End-to-End Multivariate Time-Series Clustering Algorithm Based on Real-World Vital Signs Data

Tongyue Shi, Zhilong Zhang, Wentie Liu, Junhua Fang, Jianguo Hao, Shuai Jin, Huiying Zhao, Guilan Kong

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Optimization and Control (math.OC)

[277] arXiv:2306.02223 (cross-list from cs.LG) [pdf, other]

Title: Prescriptive PCA: Dimensionality Reduction for Two-stage Stochastic Optimization

Long He, Ho-Yin Mak

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[278] arXiv:2306.02420 (cross-list from cs.LG) [pdf, other]

Title: Complexity of Block Coordinate Descent with Proximal Regularization and Applications to Wasserstein CP-dictionary Learning

Dohyun Kwon, Hanbaek Lyu

Comments: Proceedings of the 40th International Conference on Machine Learning

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Numerical Analysis (math.NA); Optimization and Control (math.OC)

[279] arXiv:2306.02570 (cross-list from cs.LG) [pdf, other]

Title: When Decentralized Optimization Meets Federated Learning

Hongchang Gao, My T. Thai, Jie Wu

Comments: Accepted to IEEE Network

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[280] arXiv:2306.02601 (cross-list from cs.LG) [pdf, other]

Title: Aiming towards the minimizers: fast convergence of SGD for overparametrized problems

Chaoyue Liu, Dmitriy Drusvyatskiy, Mikhail Belkin, Damek Davis, Yi-An Ma

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[281] arXiv:2306.02660 (cross-list from math.NA) [pdf, html, other]

Title: Automated Importance Sampling via Optimal Control for Stochastic Reaction Networks: A Markovian Projection-based Approach

Chiheb Ben Hammouda, Nadhir Ben Rached, Raúl Tempone, Sophia Wiechert

Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC); Molecular Networks (q-bio.MN); Quantitative Methods (q-bio.QM); Computation (stat.CO)

[282] arXiv:2306.02666 (cross-list from cs.NE) [pdf, other]

Title: Does a sparse ReLU network training problem always admit an optimum?

Quoc-Tung Le (LIP, OCKHAM), Elisa Riccietti (OCKHAM), Rémi Gribonval (OCKHAM)

Comments: NeurIPS 2023 - Thirty-seventh Conference on Neural Information Processing Systems, Dec 2023, New Orleans (Lousiane), United States

Subjects: Neural and Evolutionary Computing (cs.NE); Algebraic Geometry (math.AG); Functional Analysis (math.FA); Optimization and Control (math.OC)

[283] arXiv:2306.02689 (cross-list from cs.LG) [pdf, other]

Title: Equity-Transformer: Solving NP-hard Min-Max Routing Problems as Sequential Generation with Equity Context

Jiwoo Son, Minsu Kim, Sanghyeok Choi, Hyeonah Kim, Jinkyoo Park

Comments: AAAI 2024, 16 pages, 6 figures

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[284] arXiv:2306.02737 (cross-list from math.ST) [pdf, other]

Title: Comparative analysis of the existence and uniqueness conditions of parameter estimation in paired comparison models

László Gyarmati, Éva Orbán-Mihálykó, Csaba Mihálykó

Subjects: Statistics Theory (math.ST); Optimization and Control (math.OC)

[285] arXiv:2306.03065 (cross-list from cs.LG) [pdf, other]

Title: LibAUC: A Deep Learning Library for X-Risk Optimization

Zhuoning Yuan, Dixian Zhu, Zi-Hao Qiu, Gang Li, Xuanhui Wang, Tianbao Yang

Comments: Accepted by KDD2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)

[286] arXiv:2306.03202 (cross-list from stat.ML) [pdf, html, other]

Title: Nonlinear Distributionally Robust Optimization

Mohammed Rayyan Sheriff, Peyman Mohajerin Esfahani

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)

[287] arXiv:2306.03243 (cross-list from math.DS) [pdf, other]

Title: Equilibration of Coordinating Imitation and Best-Response Dynamics

Nazanin Hasheminejad, Pouria Ramazi

Journal-ref: IEEE Control Systems Letters, vol. 7, pp. 3078-3083, 2023

Subjects: Dynamical Systems (math.DS); Optimization and Control (math.OC); Physics and Society (physics.soc-ph)

[288] arXiv:2306.03401 (cross-list from cs.LG) [pdf, html, other]

Title: A Lightweight Method for Tackling Unknown Participation Statistics in Federated Averaging

Shiqiang Wang, Mingyue Ji

Comments: Accepted to ICLR 2024

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Optimization and Control (math.OC); Machine Learning (stat.ML)

[289] arXiv:2306.03458 (cross-list from eess.SY) [pdf, other]

Title: The Unscented Kalman Filter for Nonlinear Parameter Identification of Adaptive Cruise Control Systems

Konstantinos Ampountolas

Comments: 11 papes, 3 Figures

Journal-ref: IEEE Transactions on Intelligent Vehicles (2023)

Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

[290] arXiv:2306.03466 (cross-list from eess.IV) [pdf, other]

Title: Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problems

Samuel Hurault, Ulugbek Kamilov, Arthur Leclaire, Nicolas Papadakis

Subjects: Image and Video Processing (eess.IV); Machine Learning (cs.LG); Optimization and Control (math.OC)

[291] arXiv:2306.03613 (cross-list from math.CO) [pdf, other]

Title: From coordinate subspaces over finite fields to ideal multipartite uniform clutters

Ahmad Abdi, Dabeen Lee

Comments: 32 pages, 6 figures

Subjects: Combinatorics (math.CO); Optimization and Control (math.OC)

[292] arXiv:2306.03626 (cross-list from cs.LG) [pdf, other]

Title: Understanding Progressive Training Through the Framework of Randomized Coordinate Descent

Rafał Szlendak, Elnur Gasanov, Peter Richtárik

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[293] arXiv:2306.03638 (cross-list from cs.LG) [pdf, html, other]

Title: Provable convergence guarantees for black-box variational inference

Justin Domke, Guillaume Garrigos, Robert Gower

Comments: Accepted at NeurIPS 2023

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[294] arXiv:2306.03655 (cross-list from cs.LG) [pdf, other]

Title: Online Learning under Adversarial Nonlinear Constraints

Pavel Kolev, Georg Martius, Michael Muehlebach

Comments: NeurIPS 2023

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[295] arXiv:2306.03712 (cross-list from math.AP) [pdf, other]

Title: Exact controllability of incompressible ideal magnetohydrodynamics in $2$D

Manuel Rissel

Comments: 43 pages, 9 figures

Subjects: Analysis of PDEs (math.AP); Optimization and Control (math.OC)

[296] arXiv:2306.03785 (cross-list from cs.RO) [pdf, other]

Title: Development of On-Ground Hardware In Loop Simulation Facility for Space Robotics

Roshan Sah, Raunak Srivastava, Kaushik Das

Comments: 11 pages, 15 figures, Accepted at Small Satellite Conference 2023; Weekday Sessions: Orbital Debris, SSA & STM; Tuesday, 8th Aug 2023

Subjects: Robotics (cs.RO); Earth and Planetary Astrophysics (astro-ph.EP); Systems and Control (eess.SY); Optimization and Control (math.OC); Space Physics (physics.space-ph)

[297] arXiv:2306.03976 (cross-list from cs.AI) [pdf, other]

Title: Explainable AI using expressive Boolean formulas

Gili Rosenberg, J. Kyle Brubaker, Martin J. A. Schuetz, Grant Salton, Zhihuai Zhu, Elton Yechao Zhu, Serdar Kadıoğlu, Sima E. Borujeni, Helmut G. Katzgraber

Comments: 28 pages, 16 figures, 4 tables

Journal-ref: Mach. Learn. Knowl. Extr. 2023, 5(4), 1760-1795

Subjects: Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Optimization and Control (math.OC); Quantum Physics (quant-ph)

[298] arXiv:2306.04084 (cross-list from stat.ME) [pdf, other]

Title: Modelling the discretization error of initial value problems using the Wishart distribution

Naoki Marumo, Takeru Matsuda, Yuto Miyatake

Subjects: Methodology (stat.ME); Numerical Analysis (math.NA); Optimization and Control (math.OC); Statistics Theory (math.ST); Data Analysis, Statistics and Probability (physics.data-an)

[299] arXiv:2306.04087 (cross-list from cs.DC) [pdf, other]

Title: Accelerating 128-bit Floating-Point Matrix Multiplication on FPGAs

Fumiya Kono, Naohito Nakasato, Maho Nakata

Comments: 12 pages, 8 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR); Mathematical Software (cs.MS); Performance (cs.PF); Optimization and Control (math.OC)

[300] arXiv:2306.04169 (cross-list from cs.LG) [pdf, other]

Title: Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation

Zhao Song, Mingquan Ye, Junze Yin, Lichen Zhang

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[301] arXiv:2306.04264 (cross-list from math.CO) [pdf, html, other]

Title: Integer Carath\'eodory results with bounded multiplicity

Stefan Kuhlmann

Subjects: Combinatorics (math.CO); Optimization and Control (math.OC)

[302] arXiv:2306.04283 (cross-list from math.AP) [pdf, html, other]

Title: Stochastic optimal transport and Hamilton-Jacobi-Bellman equations on the set of probability measures

Charles Bertucci (CMAP)

Subjects: Analysis of PDEs (math.AP); Optimization and Control (math.OC); Probability (math.PR)

[303] arXiv:2306.04492 (cross-list from cs.IT) [pdf, other]

Title: A Bregman Proximal Perspective on Classical and Quantum Blahut-Arimoto Algorithms

Kerry He, James Saunderson, Hamza Fawzi

Comments: 30 pages. v2: Revised introduction and numerical experiments; strengthened proof for Theorem 4.7; other minor edits throughout. v3: Accepted into IEEE Transactions of Information Theory

Subjects: Information Theory (cs.IT); Optimization and Control (math.OC); Quantum Physics (quant-ph)

[304] arXiv:2306.04730 (cross-list from eess.SP) [pdf, other]

Title: Stochastic Natural Thresholding Algorithms

Rachel Grotheer, Shuang Li, Anna Ma, Deanna Needell, Jing Qin

Subjects: Signal Processing (eess.SP); Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC); Machine Learning (stat.ML)

[305] arXiv:2306.04815 (cross-list from cs.LG) [pdf, other]

Title: Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning

Libin Zhu, Chaoyue Liu, Adityanarayanan Radhakrishnan, Mikhail Belkin

Comments: ICML 2024

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[306] arXiv:2306.04836 (cross-list from stat.ML) [pdf, html, other]

Title: $K$-Nearest-Neighbor Resampling for Off-Policy Evaluation in Stochastic Control

Michael Giegrich, Roel Oomen, Christoph Reisinger

Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC); Statistics Theory (math.ST); Methodology (stat.ME)

[307] arXiv:2306.04848 (cross-list from cs.LG) [pdf, html, other]

Title: Interpreting and Improving Diffusion Models from an Optimization Perspective

Frank Permenter, Chenyang Yuan

Comments: 24 pages, 9 figures, 4 tables. To appear in ICML 2024

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC); Machine Learning (stat.ML)

[308] arXiv:2306.04961 (cross-list from cs.LG) [pdf, other]

Title: Recovering Simultaneously Structured Data via Non-Convex Iteratively Reweighted Least Squares

Christian Kümmerle, Johannes Maly

Comments: 35 pages, 7 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Optimization and Control (math.OC)

[309] arXiv:2306.05150 (cross-list from cs.LG) [pdf, other]

Title: Bayesian Optimization of Expensive Nested Grey-Box Functions

Wenjie Xu, Yuning Jiang, Bratislav Svetozarevic, Colin N. Jones

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC)

[310] arXiv:2306.05329 (cross-list from cs.RO) [pdf, other]

Title: Movement Optimization of Robotic Arms for Energy and Time Reduction using Evolutionary Algorithms

Abolfazl Akbari, Saeed Mozaffari, Rajmeet Singh, Majid Ahmadi, Shahpour Alirezaee

Subjects: Robotics (cs.RO); Systems and Control (eess.SY); Numerical Analysis (math.NA); Optimization and Control (math.OC)

[311] arXiv:2306.05581 (cross-list from eess.SY) [pdf, other]

Title: Risk-aware Urban Air Mobility Network Design with Overflow Redundancy

Qinshuang Wei, Zhenyu Gao, John-Paul Clarke, Ufuk Topcu

Comments: 44 pages, 10 figures

Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

[312] arXiv:2306.05655 (cross-list from cs.LG) [pdf, other]

Title: Communication-Efficient Zeroth-Order Distributed Online Optimization: Algorithm, Theory, and Applications

Ege C. Kaya, M. Berk Sahin, Abolfazl Hashemi

Comments: 21 pages, 5 figures, and this paper has been accepted by IEEE Access

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[313] arXiv:2306.05706 (cross-list from cs.LG) [pdf, other]

Title: Understanding How Consistency Works in Federated Learning via Stage-wise Relaxed Initialization

Yan Sun, Li Shen, Dacheng Tao

Comments: 32 pages

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[314] arXiv:2306.05732 (cross-list from cs.GT) [pdf, other]

Title: Computing Algorithm for an Equilibrium of the Generalized Stackelberg Game

Jaeyeon Jo, Jihwan Yu, Jinkyoo Park

Comments: 37 pages, 10 figures

Subjects: Computer Science and Game Theory (cs.GT); Optimization and Control (math.OC)

[315] arXiv:2306.05761 (cross-list from math.FA) [pdf, html, other]

Title: Sums of squares certificates for polynomial moment inequalities

Igor Klep, Victor Magron, Jurij Volčič

Comments: 35 pages

Subjects: Functional Analysis (math.FA); Optimization and Control (math.OC); Quantum Physics (quant-ph)

[316] arXiv:2306.05825 (cross-list from math.AP) [pdf, other]

Title: Extremal properties of the first eigenvalue and the fundamental gap of a sub-elliptic operator

Hongli Sun, Weijia Wu, Donghui Yang

Subjects: Analysis of PDEs (math.AP); Optimization and Control (math.OC)

[317] arXiv:2306.05905 (cross-list from cs.LG) [pdf, other]

Title: TreeDQN: Learning to minimize Branch-and-Bound tree

Dmitry Sorokin, Alexander Kostin

Comments: Submitted to NeurIPS 2023

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[318] arXiv:2306.06098 (cross-list from cs.LG) [pdf, html, other]

Title: Error Feedback Can Accurately Compress Preconditioners

Ionut-Vlad Modoranu, Aleksei Kalinov, Eldar Kurtic, Elias Frantar, Dan Alistarh

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Optimization and Control (math.OC)

[319] arXiv:2306.06101 (cross-list from cs.LG) [pdf, html, other]

Title: Prodigy: An Expeditiously Adaptive Parameter-Free Learner

Konstantin Mishchenko, Aaron Defazio

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Optimization and Control (math.OC); Machine Learning (stat.ML)

[320] arXiv:2306.06204 (cross-list from cs.DM) [pdf, other]

Title: Spectrahedral Geometry of Graph Sparsifiers

Catherine Babecki, Stefan Steinerberger, Rekha R. Thomas

Comments: 34 pages, 17 figures, 3 tables

Subjects: Discrete Mathematics (cs.DM); Combinatorics (math.CO); Optimization and Control (math.OC)

[321] arXiv:2306.06213 (cross-list from cs.LG) [pdf, html, other]

Title: Robust Twin Parametric Margin Support Vector Machine for Multiclass Classification

Renato De Leone, Francesca Maggioni, Andrea Spinelli

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[322] arXiv:2306.06375 (cross-list from cs.LG) [pdf, other]

Title: Optimized Gradient Tracking for Decentralized Online Learning

Shivangi Dubey Sharma (1), Ketan Rajawat (1), ((1) Indian Institute of Technology Kanpur)

Comments: 30 pages, 6 Figures

Subjects: Machine Learning (cs.LG); Signal Processing (eess.SP); Optimization and Control (math.OC)

[323] arXiv:2306.06383 (cross-list from math.NA) [pdf, other]

Title: Using orthogonally structured positive bases for constructing positive $k$-spanning sets with cosine measure guarantees

Warren Hare, Gabriel Jarry-Bolduc, Sébastien Kerleau, Clément W. Royer

Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)

[324] arXiv:2306.06520 (cross-list from cs.RO) [pdf, other]

Title: Learning optimal controllers: a dynamical motion primitive approach

Hugo T. M. Kussaba, Abdalla Swikir, Fan Wu, Anastasija Demerdjieva, Gitta Kutyniok, Sami Haddadin

Comments: This work has been accepted to the 22nd IFAC World Congress

Subjects: Robotics (cs.RO); Optimization and Control (math.OC)

[325] arXiv:2306.06525 (cross-list from cs.RO) [pdf, other]

Title: Fast yet predictable braking manoeuvers for real-time robot control

Mazin Hamad, Jesus Gutierrez-Moreno, Hugo T. M. Kussaba, Nico Mansfeld, Saeed Abdolshah, Abdalla Swikir, Wolfram Burgard, Sami Haddadin

Comments: This work has been accepted to the 22nd IFAC World Congress

Subjects: Robotics (cs.RO); Optimization and Control (math.OC)