Distributed, Parallel, and Cluster Computing

Authors and titles for April 2024

[151] arXiv:2404.02945 (cross-list from cs.LG) [pdf, html, other]

Title: Optimizing the Deployment of Tiny Transformers on Low-Power MCUs

Victor J.B. Jung, Alessio Burrello, Moritz Scherer, Francesco Conti, Luca Benini

Comments: Pre-print manuscript submitted for review to the IEEE Transactions on Computers

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[152] arXiv:2404.03299 (cross-list from cs.LG) [pdf, html, other]

Title: SiloFuse: Cross-silo Synthetic Data Generation with Latent Tabular Diffusion Models

Aditya Shankar, Hans Brouwer, Rihan Hai, Lydia Chen

Comments: Accepted at 40th IEEE International Conference on Data Engineering (ICDE 2024)

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)

[153] arXiv:2404.03524 (cross-list from cs.LG) [pdf, html, other]

Title: Approximate Gradient Coding for Privacy-Flexible Federated Learning with Non-IID Data

Okko Makkonen, Sampo Niemelä, Camilla Hollanti, Serge Kas Hanna

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT); Machine Learning (stat.ML)

[154] arXiv:2404.03874 (cross-list from cs.CR) [pdf, html, other]

Title: VELLET: Verifiable Embedded Wallet for Securing Authenticity and Integrity

Hiroki Watanabe, Kohei Ichihara, Takumi Aita

Comments: A shortened version is to be published at the IEEE International Conference on Blockchain and Cryptocurrency (ICBC) 2024

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[155] arXiv:2404.04118 (cross-list from cs.LG) [pdf, html, other]

Title: GNNBENCH: Fair and Productive Benchmarking for Single-GPU GNN System

Yidong Gong, Pradeep Kumar

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[156] arXiv:2404.04527 (cross-list from cs.CV) [pdf, html, other]

Title: VTR: An Optimized Vision Transformer for SAR ATR Acceleration on FPGA

Sachini Wickramasinghe, Dhruv Parikh, Bingyi Zhang, Rajgopal Kannan, Viktor Prasanna, Carl Busart

Comments: SPIE DCS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[157] arXiv:2404.04616 (cross-list from cs.LG) [pdf, html, other]

Title: Vanishing Variance Problem in Fully Decentralized Neural-Network Systems

Yongding Tian, Zaid Al-Ars, Maksim Kitsak, Peter Hofstee

Comments: 7 pages

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[158] arXiv:2404.04744 (cross-list from cs.SE) [pdf, html, other]

Title: Adapting Multi-objectivized Software Configuration Tuning

Tao Chen, Miqing Li

Comments: This paper has been accepted at ACM FSE'24

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[159] arXiv:2404.04948 (cross-list from cs.CR) [pdf, other]

Title: Iniva: Inclusive and Incentive-compatible Vote Aggregation

Arian Baloochestani, Hanish Gogada, Leander Jehl, Hein Meling

Comments: Committee-based blockchains, Vote omission attack, Vote inclusion, Signature aggregation, Incentive-compatible

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[160] arXiv:2404.05019 (cross-list from cs.LG) [pdf, html, other]

Title: Shortcut-connected Expert Parallelism for Accelerating Mixture-of-Experts

Weilin Cai, Juyong Jiang, Le Qin, Junwei Cui, Sunghun Kim, Jiayi Huang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[161] arXiv:2404.05085 (cross-list from cs.ET) [pdf, html, other]

Title: Fork is All You Need in Heterogeneous Systems

Zixuan Wang, Jishen Zhao

Comments: Presented at the 3rd Workshop on Heterogeneous Composable and Disaggregated Systems (HCDS 2024)

Subjects: Emerging Technologies (cs.ET); Distributed, Parallel, and Cluster Computing (cs.DC)

[162] arXiv:2404.05182 (cross-list from cs.LG) [pdf, html, other]

Title: DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model

Chao Gao, Sai Qian Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[163] arXiv:2404.05543 (cross-list from cs.GT) [pdf, html, other]

Title: Optimal Allocation of Tasks and Price of Anarchy of Distributed Optimization in Networked Computing Facilities

Vincenzo Mancuso, Paolo Castagno, Leonardo Badia, Matteo Sereno, Marco Ajmone Marsan

Comments: Edge-Cloud Continuum; Network servers; Optimization; Next generation networking; Game Theory; Price of Anarchy

Subjects: Computer Science and Game Theory (cs.GT); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[164] arXiv:2404.05598 (cross-list from cs.CR) [pdf, other]

Title: Hook-in Privacy Techniques for gRPC-based Microservice Communication

Louis Loechel, Siar-Remzi Akbayin, Elias Grünewald, Jannis Kiesel, Inga Strelnikova, Thomas Janke, Frank Pallas

Comments: 15 pages, accepted for the ICWE, International Conference on Web Engineering, 2024, research paper

Subjects: Cryptography and Security (cs.CR); Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC); Software Engineering (cs.SE)

[165] arXiv:2404.05838 (cross-list from cs.DM) [pdf, other]

Title: Space-time deterministic graph rewriting

Pablo Arrighi, Marin Costes, Gilles Dowek, Luidnel Maignan

Subjects: Discrete Mathematics (cs.DM); Distributed, Parallel, and Cluster Computing (cs.DC); General Relativity and Quantum Cosmology (gr-qc); Dynamical Systems (math.DS); Cellular Automata and Lattice Gases (nlin.CG)

[166] arXiv:2404.06230 (cross-list from cs.LG) [pdf, html, other]

Title: Aggressive or Imperceptible, or Both: Network Pruning Assisted Hybrid Byzantines in Federated Learning

Emre Ozfatura, Kerem Ozfatura, Alptekin Kupcu, Deniz Gunduz

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[167] arXiv:2404.06435 (cross-list from cs.CR) [pdf, html, other]

Title: Software-based Security Framework for Edge and Mobile IoT

José Cecílio, Alan Oliveira de Sá, André Souto

Comments: 6 pages and 2 figures

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[168] arXiv:2404.06467 (cross-list from cs.ET) [pdf, other]

Title: Scaling to 32 GPUs on a Novel Composable System Architecture

John Ihnotic

Comments: Presented at the 3rd Workshop on Heterogeneous Composable and Disaggregated Systems (HCDS 2024)

Subjects: Emerging Technologies (cs.ET); Distributed, Parallel, and Cluster Computing (cs.DC)

[169] arXiv:2404.06675 (cross-list from cs.LG) [pdf, html, other]

Title: Toward Cross-Layer Energy Optimizations in AI Systems

Jae-Won Chung, Nishil Talati, Mosharaf Chowdhury

Comments: 2024 Energy-Efficient Computing for Science Workshop

Subjects: Machine Learning (cs.LG); Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[170] arXiv:2404.07164 (cross-list from cs.AR) [pdf, other]

Title: PIM-Opt: Demystifying Distributed Optimization Algorithms on a Real-World Processing-In-Memory System

Steve Rhyner, Haocong Luo, Juan Gómez-Luna, Mohammad Sadrosadati, Jiawei Jiang, Ataberk Olgun, Harshita Gupta, Ce Zhang, Onur Mutlu

Comments: "PIM-Opt: Demystifying Distributed Optimization Algorithms on a Real-World Processing-In-Memory System" in Proceedings of the 33rd International Conference on Parallel Architectures and Compilation Techniques (PACT), Long Beach, CA, USA, October 2024

Subjects: Hardware Architecture (cs.AR); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[171] arXiv:2404.07532 (cross-list from cs.LG) [pdf, html, other]

Title: Bayesian Federated Model Compression for Communication and Computation Efficiency

Chengyu Xia, Danny H. K. Tsang, Vincent K. N. Lau

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[172] arXiv:2404.07861 (cross-list from cs.NI) [pdf, other]

Title: Konnektor: Connection Protocol for Ensuring Peer Uniqueness in Decentralized P2P Networks

Onur Ozkan

Comments: 15 pages, 8 figures

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[173] arXiv:2404.08003 (cross-list from cs.LG) [pdf, html, other]

Title: Asynchronous Federated Reinforcement Learning with Policy Gradient Updates: Algorithm Design and Convergence Analysis

Guangchen Lan, Dong-Jun Han, Abolfazl Hashemi, Vaneet Aggarwal, Christopher G. Brinton

Comments: Published as a conference paper at ICLR 2025

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)

[174] arXiv:2404.08028 (cross-list from cs.LG) [pdf, html, other]

Title: FedAuxHMTL: Federated Auxiliary Hard-Parameter Sharing Multi-Task Learning for Network Edge Traffic Classification

Faisal Ahmed, Myungjin Lee, Suresh Subramaniam, Motoharu Matsuura, Hiroshi Hasegawa, Shih-Chun Lin

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[175] arXiv:2404.08306 (cross-list from cs.CR) [pdf, html, other]

Title: Performance Analysis of Decentralized Physical Infrastructure Networks and Centralized Clouds

Jan von der Assen, Christian Killer, Alessandro De Carli, Burkhard Stiller

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[176] arXiv:2404.08398 (cross-list from cs.MA) [pdf, html, other]

Title: Multi-Agent eXperimenter (MAX)

Önder Gürcan

Comments: 3 pages, no figures

Subjects: Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[177] arXiv:2404.08573 (cross-list from cs.LG) [pdf, html, other]

Title: Going Forward-Forward in Distributed Deep Learning

Ege Aktemur, Ege Zorlutuna, Kaan Bilgili, Tacettin Emre Bok, Berrin Yanikoglu, Suha Orhun Mutluergil

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[178] arXiv:2404.08808 (cross-list from cs.CR) [pdf, html, other]

Title: Enhancing IoT Malware Detection through Adaptive Model Parallelism and Resource Optimization

Sreenitha Kasarapu, Sanket Shukla, Sai Manoj Pudukotai Dinakarrao

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[179] arXiv:2404.08950 (cross-list from cs.AR) [pdf, html, other]

Title: Deep Reinforcement Learning based Online Scheduling Policy for Deep Neural Network Multi-Tenant Multi-Accelerator Systems

Francesco G. Blanco, Enrico Russo, Maurizio Palesi, Davide Patti, Giuseppe Ascia, Vincenzo Catania

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[180] arXiv:2404.08973 (cross-list from cs.LG) [pdf, html, other]

Title: PraFFL: A Preference-Aware Scheme in Fair Federated Learning

Rongguang Ye, Wei-Bin Kou, Ming Tang

Comments: Accepted by KDD 2025

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC)

[181] arXiv:2404.09232 (cross-list from cs.LG) [pdf, html, other]

Title: MAP: Model Aggregation and Personalization in Federated Learning with Incomplete Classes

Xin-Chun Li, Shaoming Song, Yinchuan Li, Bingshuai Li, Yunfeng Shao, Yang Yang, De-Chuan Zhan

Comments: Accepted by TKDE (11-Apr-2024)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[182] arXiv:2404.09302 (cross-list from cs.LG) [pdf, html, other]

Title: High Significant Fault Detection in Azure Core Workload Insights

Pranay Lohia, Laurent Boue, Sharath Rangappa, Vijay Agneeswaran

Comments: Published in IAAI 2024, which is the Industrial track of AAAI 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[183] arXiv:2404.09443 (cross-list from cs.LG) [pdf, html, other]

Title: Hybrid FedGraph: An efficient hybrid federated learning algorithm using graph convolutional neural network

Jaeyeon Jang, Diego Klabjan, Veena Mendiratta, Fanfei Meng

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[184] arXiv:2404.09557 (cross-list from cs.RO) [pdf, other]

Title: Characterization and Mitigation of Insufficiencies in Automated Driving Systems

Yuting Fu, Jochen Seemann, Caspar Hanselaar, Tim Beurskens, Andrei Terechko, Emilia Silvas, Maurice Heemels

Comments: Published at the 27th International Technical Conference on the Enhanced Safety of Vehicles (ESV), Apr 2023, Yokohama, Japan. Original publication this https URL

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA); Systems and Control (eess.SY)

[185] arXiv:2404.09627 (cross-list from cs.GT) [pdf, html, other]

Title: Centralization in Proof-of-Stake Blockchains: A Game-Theoretic Analysis of Bootstrapping Protocols

Varul Srivastava, Sankarshan Damle, Sujit Gujar

Comments: Appears at the 6th Games, Agents, and Incentives Workshop (GAIW-24). Held as part of the Workshops at the 22st International Conference on Autonomous Agents and Multiagent Systems (AAMAS)

Subjects: Computer Science and Game Theory (cs.GT); Distributed, Parallel, and Cluster Computing (cs.DC)

[186] arXiv:2404.09686 (cross-list from cs.LG) [pdf, html, other]

Title: AntBatchInfer: Elastic Batch Inference in the Kubernetes Cluster

Siyuan Li, Youshao Xiao, Fanzhuang Meng, Lin Ju, Lei Liang, Lin Wang, Jun Zhou

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[187] arXiv:2404.10012 (cross-list from cs.CR) [pdf, html, other]

Title: Optimizing Malware Detection in IoT Networks: Leveraging Resource-Aware Distributed Computing for Enhanced Security

Sreenitha Kasarapu, Sanket Shukla, Sai Manoj Pudukotai Dinakarrao

Comments: arXiv admin note: substantial text overlap with arXiv:2404.08808

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[188] arXiv:2404.10110 (cross-list from cs.LG) [pdf, html, other]

Title: Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning

Chong Yu, Shuaiqi Shen, Shiqiang Wang, Kuan Zhang, Hai Zhao

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[189] arXiv:2404.10255 (cross-list from cs.LG) [pdf, html, other]

Title: Privacy-Enhanced Training-as-a-Service for On-Device Intelligence: Concept, Architectural Scheme, and Open Problems

Zhiyuan Wu, Sheng Sun, Yuwei Wang, Min Liu, Bo Gao, Tianliu He, Wen Wang

Comments: 14 pages, 3 figures

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[190] arXiv:2404.10389 (cross-list from cs.ET) [pdf, html, other]

Title: Paving the Way to Hybrid Quantum-Classical Scientific Workflows

Sandeep Suresh Cranganore, Vincenzo De Maio, Ivona Brandic, Ewa Deelman

Subjects: Emerging Technologies (cs.ET); Distributed, Parallel, and Cluster Computing (cs.DC)

[191] arXiv:2404.10491 (cross-list from cs.CR) [pdf, html, other]

Title: BoLD: Fast and Cheap Dispute Resolution

Mario M. Alvarez, Henry Arneson, Ben Berger, Lee Bousfield, Chris Buckland, Yafah Edelman, Edward W. Felten, Daniel Goldman, Raul Jordan, Mahimna Kelkar, Akaki Mamageishvili, Harry Ng, Aman Sanghi, Victor Shoup, Terence Tsao

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[192] arXiv:2404.10498 (cross-list from cs.AI) [pdf, html, other]

Title: LAECIPS: Large Vision Model Assisted Adaptive Edge-Cloud Collaboration for IoT-based Perception System

Shijing Hu, Ruijun Deng, Xin Du, Zhihui Lu, Qiang Duan, Yi He, Shih-Chia Huang, Jie Wu

Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[193] arXiv:2404.10748 (cross-list from quant-ph) [pdf, html, other]

Title: Classical and Quantum Distributed Algorithms for the Survivable Network Design Problem

Phillip Kerger, David E. Bernal Neira, Zoe Gonzalez Izquierdo, Eleanor G. Rieffel

Comments: 12 pages, 0 figures

Subjects: Quantum Physics (quant-ph); Distributed, Parallel, and Cluster Computing (cs.DC)

[194] arXiv:2404.10752 (cross-list from cs.FL) [pdf, html, other]

Title: Computing Inductive Invariants of Regular Abstraction Frameworks

Philipp Czerner, Javier Esparza, Valentin Krasotin, Christoph Welzel-Mohr

Comments: 25 pages

Subjects: Formal Languages and Automata Theory (cs.FL); Distributed, Parallel, and Cluster Computing (cs.DC)

[195] arXiv:2404.10861 (cross-list from cs.NE) [pdf, html, other]

Title: Trackable Agent-based Evolution Models at Wafer Scale

Matthew Andres Moreno, Connor Yang, Emily Dolson, Luis Zaman

Subjects: Neural and Evolutionary Computing (cs.NE); Distributed, Parallel, and Cluster Computing (cs.DC)

[196] arXiv:2404.10957 (cross-list from cs.LG) [pdf, html, other]

Title: Personalized Federated Learning via Stacking

Emilio Cantu-Cervini

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[197] arXiv:2404.11015 (cross-list from cs.LG) [pdf, html, other]

Title: FedFa: A Fully Asynchronous Training Paradigm for Federated Learning

Haotian Xu, Zhaorui Zhang, Sheng Di, Benben Liu, Khalid Ayed Alharthi, Jiannong Cao

Journal-ref: IJCAI 2024: the 33rd International Joint Conference on Artificial Intelligence

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[198] arXiv:2404.11035 (cross-list from cs.IT) [pdf, html, other]

Title: Approximate Wireless Communication for Lossy Gradient Updates in IoT Federated Learning

Xiang Ma, Haijian Sun, Rose Qingyang Hu, Yi Qian

Comments: submitted to IEEE journals for publication

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)

[199] arXiv:2404.11068 (cross-list from cs.LG) [pdf, html, other]

Title: ScaleFold: Reducing AlphaFold Initial Training Time to 10 Hours

Feiwen Zhu, Arkadiusz Nowaczynski, Rundong Li, Jie Xin, Yifei Song, Michal Marcinkiewicz, Sukru Burc Eryilmaz, Jun Yang, Michael Andersch

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Quantitative Methods (q-bio.QM)

[200] arXiv:2404.11105 (cross-list from cs.DB) [pdf, html, other]

Title: XMiner: Efficient Directed Subgraph Matching with Pattern Reduction

Pingpeng Yuan, Yujiang Wang, Tianyu Ma, Siyuan He, Ling Liu

Subjects: Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)