Distributed, Parallel, and Cluster Computing

Authors and titles for March 2025

[51] arXiv:2503.08223 [pdf, html, other]

Title: Will LLMs Scaling Hit the Wall? Breaking Barriers via Distributed Resources on Massive Edge Devices

Tao Shen, Didi Zhu, Ziyu Zhao, Chao Wu, Fei Wu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[52] arXiv:2503.08311 [pdf, html, other]

Title: Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference

Pol G. Recasens, Ferran Agullo, Yue Zhu, Chen Wang, Eun Kyung Lee, Olivier Tardieu, Jordi Torres, Josep Ll. Berral

Comments: Pol G. Recasens, Ferran Agullo: equal contribution

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[53] arXiv:2503.08415 [pdf, html, other]

Title: TokenSim: Enabling Hardware and Software Exploration for Large Language Model Inference Systems

Feiyang Wu, Zhuohang Bian, Guoyang Duan, Tianle Xu, Junchi Wu, Teng Ma, Yongqiang Yao, Ruihao Gong, Youwei Zhuo

Comments: 9 pages, 15 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[54] arXiv:2503.08607 [pdf, html, other]

Title: A Fair and Lightweight Consensus Algorithm for IoT

Sokratis Vavilis, Harris Niavis, Konstantinos Loupos

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Cryptography and Security (cs.CR)

[55] arXiv:2503.08914 [pdf, html, other]

Title: Cabinet: Dynamically Weighted Consensus Made Fast

Gengrui Zhang, Shiquan Zhang, Michail Bachras, Yuqiu Zhang, Hans-Arno Jacobsen

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[56] arXiv:2503.08935 [pdf, html, other]

Title: A Parallel and Highly-Portable HPC Poisson Solver: Preconditioned Bi-CGSTAB with alpaka

Luca Pennati, Måns I. Andersson, Klaus Steiniger, Rene Widera, Tapish Narwal, Michael Bussmann, Stefano Markidis

Comments: 10 pages, 8 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[57] arXiv:2503.08946 [pdf, html, other]

Title: SIMT/GPU Data Race Verification using ISCC and Intermediary Code Representations: A Case Study

Andrew Osterhout, Ganesh Gopalakrishnan

Comments: Formal Verification of Parallel Algorithms, Static Analysis, Intermediary Code Representations, CUDA, GPU

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[58] arXiv:2503.08966 [pdf, html, other]

Title: Performance Models for a Two-tiered Storage System

Aparna Sasidharan, Xian-He, Jay Lofstead, Scott Klasky

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[59] arXiv:2503.09318 [pdf, html, other]

Title: FpgaHub: Fpga-centric Hyper-heterogeneous Computing Platform for Big Data Analytics

Zeke Wang, Jie Zhang, Hongjing Huang, Yingtao Li, Xueying Zhu, Mo Sun, Zihan Yang, De Ma, Huajing Tang, Gang Pan, Fei Wu, Bingsheng He, Gustavo Alonso

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR)

[60] arXiv:2503.09450 [pdf, html, other]

Title: Energy Metrics for Edge Microservice Request Placement Strategies

Klervie Toczé, Simin Nadjm-Tehrani

Comments: This is a revised and extended version of arXiv:2408.13748. A shortened version of this work is accepted at ICPE'25

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[61] arXiv:2503.09546 [pdf, html, other]

Title: Evaluating Multi-Instance DNN Inferencing on Multiple Accelerators of an Edge Device

Mumuksh Tayal, Yogesh Simmhan

Comments: 5 pages, 1 figure

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[62] arXiv:2503.00170 (cross-list from cs.GT) [pdf, other]

Title: Elastic Restaking Networks

Roi Bar-Zur, Ittay Eyal

Subjects: Computer Science and Game Theory (cs.GT); Distributed, Parallel, and Cluster Computing (cs.DC)

[63] arXiv:2503.00221 (cross-list from quant-ph) [pdf, other]

Title: Distributed Variational Quantum Algorithm with Many-qubit for Optimization Challenges

Seongmin Kim, In-Saeng Suh

Subjects: Quantum Physics (quant-ph); Computational Engineering, Finance, and Science (cs.CE); Distributed, Parallel, and Cluster Computing (cs.DC)

[64] arXiv:2503.00323 (cross-list from cs.LG) [pdf, html, other]

Title: FLStore: Efficient Federated Learning Storage for non-training workloads

Ahmad Faraz Khan, Samuel Fountain, Ahmed M. Abdelmoniem, Ali R. Butt, Ali Anwar

Comments: 11 pages, 19 figures, 2 tables This paper has been accepted at the The Eighth Annual Conference on Machine Learning and Systems (MLSys 2025)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[65] arXiv:2503.00378 (cross-list from cs.LG) [pdf, html, other]

Title: Conditioning on Local Statistics for Scalable Heterogeneous Federated Learning

Rickard Brännvall

Comments: 7 pages, 2 figures, 7 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[66] arXiv:2503.00407 (cross-list from cs.LG) [pdf, other]

Title: Asynchronous Personalized Federated Learning through Global Memorization

Fan Wan, Yuchen Li, Xueqi Qiu, Rui Sun, Leyuan Zhang, Xingyu Miao, Tianyu Zhang, Haoran Duan, Yang Long

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[67] arXiv:2503.00569 (cross-list from cs.LG) [pdf, html, other]

Title: Communication-Efficient Device Scheduling for Federated Learning Using Lyapunov Optimization

Jake B. Perazzone, Shiqiang Wang, Mingyue Ji, Kevin Chan

Comments: Accepted in IEEE/ACM Transactions on Networking

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[68] arXiv:2503.01066 (cross-list from cs.LG) [pdf, html, other]

Title: Alchemist: Towards the Design of Efficient Online Continual Learning System

Yuyang Huang, Yuhan Liu, Haryadi S. Gunawi, Beibin Li, Changho Hwang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[69] arXiv:2503.01328 (cross-list from cs.LG) [pdf, html, other]

Title: PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization

Xinyi Wan, Penghui Qi, Guangxing Huang, Jialin Li, Min Lin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[70] arXiv:2503.01787 (cross-list from quant-ph) [pdf, html, other]

Title: Building a Software Stack for Quantum-HPC Integration

Amir Shehata, Peter Groszkowski, Thomas Naughton, Murali Gopalakrishnan Meena, Elaine Wong, Daniel Claudino, Rafael Ferreira da Silvaa, Thomas Beck

Comments: 14 pages, 14 figures

Subjects: Quantum Physics (quant-ph); Distributed, Parallel, and Cluster Computing (cs.DC)

[71] arXiv:2503.01838 (cross-list from cs.LG) [pdf, other]

Title: GRAIN: Exact Graph Reconstruction from Gradients

Maria Drencheva, Ivo Petrov, Maximilian Baader, Dimitar I. Dimitrov, Martin Vechev

Comments: Published at The Thirteenth International Conference on Learning Representations (ICLR) 2025

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[72] arXiv:2503.01868 (cross-list from cs.LG) [pdf, other]

Title: Systems and Algorithms for Convolutional Multi-Hybrid Language Models at Scale

Jerome Ku, Eric Nguyen, David W. Romero, Garyk Brixi, Brandon Yang, Anton Vorontsov, Ali Taghibakhshi, Amy X. Lu, Dave P. Burke, Greg Brockman, Stefano Massaroli, Christopher Ré, Patrick D. Hsu, Brian L. Hie, Stefano Ermon, Michael Poli

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[73] arXiv:2503.02134 (cross-list from cs.MS) [pdf, html, other]

Title: Enabling Mixed-Precision in Computational Fluids Dynamics Codes

Yanxiang Chen, Pablo de Oliveira Castro, Paolo Bientinesi, Niclas Jansson, Roman Iakymchuk

Comments: arXiv admin note: text overlap with arXiv:2405.11065

Subjects: Mathematical Software (cs.MS); Distributed, Parallel, and Cluster Computing (cs.DC)

[74] arXiv:2503.02154 (cross-list from cs.LG) [pdf, html, other]

Title: AugFL: Augmenting Federated Learning with Pretrained Models

Sheng Yue, Zerui Qin, Yongheng Deng, Ju Ren, Yaoxue Zhang, Junshan Zhang

Comments: to be published in Transactions on Networking

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[75] arXiv:2503.02772 (cross-list from cs.CR) [pdf, html, other]

Title: ESSPI: ECDSA/Schnorr Signed Program Input for BitVMX

Sergio Demian Lerner, Martin Jonas, Ariel Futoransky

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)