Distributed, Parallel, and Cluster Computing

Authors and titles for January 2024

[201] arXiv:2401.14211 (cross-list from cs.LG) [pdf, html, other]

Title: Communication-Efficient Federated Learning through Adaptive Weight Clustering and Server-Side Distillation

Vasileios Tsouvalas, Aaqib Saeed, Tanir Ozcelebi, Nirvana Meratnia

Comments: 9 pages, 2 figures, Accepted on ICASSP 2024

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[202] arXiv:2401.14351 (cross-list from cs.LG) [pdf, html, other]

Title: ServerlessLLM: Low-Latency Serverless Inference for Large Language Models

Yao Fu, Leyang Xue, Yeqi Huang, Andrei-Octavian Brabete, Dmitrii Ustiugov, Yuvraj Patel, Luo Mai

Comments: 18th USENIX Symposium on Operating Systems Design and Implementation

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[203] arXiv:2401.14527 (cross-list from cs.CR) [pdf, other]

Title: Unsealing the secrets of blockchain consensus: A systematic comparison of the formal security of proof-of-work and proof-of-stake

Iván Abellán Álvarez, Vincent Gramlich, Johannes Sedlmeir

Comments: To appear in the Decentralized Applications with Blockchain, DLT, and Crypto-Currencies track at ACM/SIGAPP SAC 2024

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[204] arXiv:2401.15607 (cross-list from eess.SY) [pdf, other]

Title: Survey of Distributed Algorithms for Resource Allocation over Multi-Agent Systems

Mohammadreza Doostmohammadian, Alireza Aghasi, Mohammad Pirani, Ehsan Nekouei, Houman Zarrabi, Reza Keypour, Apostolos I. Rikos, Karl H. Johansson

Comments: Submitted to annual reviews in control

Subjects: Systems and Control (eess.SY); Distributed, Parallel, and Cluster Computing (cs.DC); Signal Processing (eess.SP); Optimization and Control (math.OC)

[205] arXiv:2401.16265 (cross-list from cs.CL) [pdf, other]

Title: CO2: Efficient Distributed Training with Full Communication-Computation Overlap

Weigao Sun, Zhen Qin, Weixuan Sun, Shidi Li, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

Comments: ICLR 2024 Spotlight. Yiran Zhong is the corresponding author. Code is available at: this https URL

Subjects: Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[206] arXiv:2401.16350 (cross-list from cs.LG) [pdf, other]

Title: FedFair^3: Unlocking Threefold Fairness in Federated Learning

Simin Javaherian, Sanjeev Panta, Shelby Williams, Md Sirajul Islam, Li Chen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC)

[207] arXiv:2401.16445 (cross-list from cs.SE) [pdf, html, other]

Title: OMPGPT: A Generative Pre-trained Transformer Model for OpenMP

Le Chen, Arijit Bhattacharjee, Nesreen Ahmed, Niranjan Hasabnis, Gal Oren, Vy Vo, Ali Jannesari

Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[208] arXiv:2401.16492 (cross-list from cs.PF) [pdf, html, other]

Title: GPU Cluster Scheduling for Network-Sensitive Deep Learning

Aakash Sharma, Vivek M. Bhasi, Sonali Singh, George Kesidis, Mahmut T. Kandemir, Chita R. Das

Subjects: Performance (cs.PF); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[209] arXiv:2401.16603 (cross-list from cs.CR) [pdf, html, other]

Title: LeftoverLocals: Listening to LLM Responses Through Leaked GPU Local Memory

Tyler Sorensen, Heidy Khlaaf

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[210] arXiv:2401.16677 (cross-list from cs.AR) [pdf, html, other]

Title: T3: Transparent Tracking & Triggering for Fine-grained Overlap of Compute & Collectives

Suchita Pati, Shaizeen Aga, Mahzabeen Islam, Nuwan Jayasena, Matthew D. Sinclair

Comments: To appear at the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) 2024

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[211] arXiv:2401.16685 (cross-list from cs.LG) [pdf, html, other]

Title: Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection

Liangqi Yuan, Dong-Jun Han, Su Wang, Devesh Upadhyay, Christopher G. Brinton

Comments: arXiv admin note: text overlap with arXiv:2310.07048

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[212] arXiv:2401.16694 (cross-list from cs.LG) [pdf, html, other]

Title: etuner: A Redundancy-Aware Framework for Efficient Continual Learning Application on Edge Devices

Sheng Li, Geng Yuan, Yawen Wu, Yue Dai, Tianyu Wang, Chao Wu, Alex K. Jones, Jingtong Hu, Yanzhi Wang, Xulong Tang

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[213] arXiv:2401.16757 (cross-list from cs.LG) [pdf, other]

Title: SwapNet: Efficient Swapping for DNN Inference on Edge AI Devices Beyond the Memory Budget

Kun Wang, Jiani Cao, Zimu Zhou, Zhenjiang Li

Comments: 14 pages, 19 figures, accepted by IEEE Transactions on Mobile Computing

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[214] arXiv:2401.16906 (cross-list from cs.CR) [pdf, other]

Title: Quantum-Secure Hybrid Blockchain System for DID-based Verifiable Random Function with NTRU Linkable Ring Signature

Bong Gon Kim, Dennis Wong, Yoon Seok Yang

Comments: 25 pages, 5 figures, 2023 International Journal on Cryptography and Information Security (IJCIS). arXiv admin note: text overlap with arXiv:2311.11734

Journal-ref: Volume 13, Number 4, December 2023

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[215] arXiv:2401.16915 (cross-list from cs.IT) [pdf, html, other]

Title: Interactive Byzantine-Resilient Gradient Coding for General Data Assignments

Shreyas Jain, Luis Maßny, Christoph Hofmeister, Eitan Yaakobi, Rawad Bitar

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[216] arXiv:2401.17460 (cross-list from cs.LG) [pdf, html, other]

Title: Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Method

Elissa Mhanna, Mohamad Assaad

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA); Optimization and Control (math.OC)

[217] arXiv:2401.17493 (cross-list from math.OC) [pdf, other]

Title: CLAIRE: Scalable GPU-Accelerated Algorithms for Diffeomorphic Image Registration in 3D

Andreas Mang

Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC)

[218] arXiv:2401.17581 (cross-list from cs.CR) [pdf, html, other]

Title: Bitcoin Inscriptions: Foundations and Beyond

Ningran Li, Minfeng Qi, Qin Wang, Shiping Chen

Comments: 25 pages, 6 figures, 4 tables

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)