Distributed, Parallel, and Cluster Computing

Authors and titles for March 2025

[1] arXiv:2503.00279 [pdf, html, other]

Title: WgPy: GPU-accelerated NumPy-like array library for web browsers

Masatoshi Hidaka, Tatsuya Harada

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[2] arXiv:2503.00430 [pdf, html, other]

Title: Performance-Driven Optimization of Parallel Breadth-First Search

Marati Bhaskar, Raghavendra Kanakagiri

Comments: 5 pages, 3 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[3] arXiv:2503.00813 [pdf, html, other]

Title: HLoRA: Efficient Federated Learning System for LLM Heterogeneous Fine-Tuning

Qianli Liu, Zhaorui Zhang, Xin Yao, Benben Liu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[4] arXiv:2503.00974 [pdf, html, other]

Title: SAF: Scalable Acceleration Framework for dynamic and flexible scaling of FPGAs

Masudul Hassan Quraishi, Michael Riera, Fengbo Ren, Aman Arora, Aviral Shrivastava

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[5] arXiv:2503.01025 [pdf, html, other]

Title: Improving inference time in multi-TPU systems with profiled model segmentation

Jorge Villarrubia, Luis Costero, Francisco D. Igual, Katzalin Olcoz

Comments: Accepted for publication at the 2023 Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP). The final published version is available in IEEE Xplore: this https URL

Journal-ref: 2023 Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[6] arXiv:2503.01035 [pdf, html, other]

Title: Balanced segmentation of CNNs for multi-TPU inference

Jorge Villarrubia, Luis Costero, Francisco D. Igual, Katzalin Olcoz

Comments: Accepted for publication at The Journal of Supercomputing. The final published version is available in: this https URL

Journal-ref: The Journal of Supercomputing, 2025

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[7] arXiv:2503.01253 [pdf, html, other]

Title: NM-SpMM: Accelerating Matrix Multiplication Using N:M Sparsity with GPGPU

Cong Ma, Du Wu, Zhelang Deng, Jiang Chen, Xiaowen Huang, Jintao Meng, Wenxi Zhu, Bingqiang Wang, Amelie Chi Zhou, Peng Chen, Minwen Deng, Yanjie Wei, Shengzhong Feng, Yi Pan

Comments: 12 pages, 10 figures, accepted at IPDPS 2025. Code: this https URL

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[8] arXiv:2503.01313 [pdf, html, other]

Title: PVU: Design and Implementation of a Posit Vector Arithmetic Unit (PVU) for Enhanced Floating-Point Computing in Edge and AI Applications

Xinyu Wu, Yaobin Wang, Tianyi Zhao, Jiawei Qin, Zhu Liang, Jie Fu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[9] arXiv:2503.01861 [pdf, html, other]

Title: Towards Enterprise-Ready Computer Using Generalist Agent

Sami Marreed, Alon Oved, Avi Yaeli, Segev Shlomov, Ido Levy, Aviad Sela, Asaf Adi, Nir Mashkif

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)

[10] arXiv:2503.02164 [pdf, html, other]

Title: Relaxation for Efficient Asynchronous Queues

Samuel Baldwin, Cole Hausman, Mohamed Bakr, Edward Talmage

Comments: 20 pages Short version to appear in SIROCCO '25

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[11] arXiv:2503.02185 [pdf, html, other]

Title: A Distributed Partitioning Software and its Applications

Aparna Sasidharan

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[12] arXiv:2503.02236 [pdf, html, other]

Title: VQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference

Zihan Liu, Xinhao Luo, Junxian Guo, Wentao Ni, Yangjie Zhou, Yue Guan, Cong Guo, Weihao Cui, Yu Feng, Minyi Guo, Yuhao Zhu, Minjia Zhang, Jingwen Leng, Chen Jin

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[13] arXiv:2503.02354 [pdf, html, other]

Title: CoServe: Efficient Collaboration-of-Experts (CoE) Model Inference with Limited Memory

Jiashun Suo, Xiaojian Liao, Limin Xiao, Li Ruan, Jinquan Wang, Xiao Su, Zhisheng Huo

Comments: Accepted to ASPLOS '25

Journal-ref: Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2. 2025

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Performance (cs.PF)

[14] arXiv:2503.02356 [pdf, html, other]

Title: Efficient Long Context Fine-tuning with Chunk Flow

Xiulong Yuan, Hongtao Xu, Wenting Shen, Ang Wang, Xiafei Qiu, Jie Zhang, Yuqiong Liu, Bowen Yu, Junyang Lin, Mingzhen Li, Weile Jia, Yong Li, Wei Lin

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[15] arXiv:2503.02426 [pdf, html, other]

Title: 3-Majority and 2-Choices with Many Opinions

Nobutaka Shimizu, Takeharu Shiraga

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Discrete Mathematics (cs.DM)

[16] arXiv:2503.02550 [pdf, html, other]

Title: SpecInF: Exploiting Idle GPU Resources in Distributed DL Training via Speculative Inference Filling

Cunchi Lv, Xiao Shi, Dong Liang, Wenting Tan, Xiaofang Zhao

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[17] arXiv:2503.02556 [pdf, html, other]

Title: A Sheaf-Theoretic Characterization of Tasks in Distributed Systems

Stephan Felber, Bernardo Hummes Flores, Hugo Rincon Galeana

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Category Theory (math.CT)

[18] arXiv:2503.02960 [pdf, html, other]

Title: Deal: Distributed End-to-End GNN Inference for All Nodes

Shiyang Chen, Xiang Song, Vasiloudis Theodore, Hang Liu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[19] arXiv:2503.03070 [pdf, html, other]

Title: Environment-Aware Dynamic Pruning for Pipelined Edge Inference

Austin O'Quinn, Conor Snedeker, Siyuan Zhang, Jenna Kline

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[20] arXiv:2503.03140 [pdf, html, other]

Title: Knowledge Augmentation in Federation: Rethinking What Collaborative Learning Can Bring Back to Decentralized Data

Wentai Wu, Ligang He, Saiqin Long, Ahmed M. Abdelmoniem, Yingliang Wu, Rui Mao

Comments: preprint

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[21] arXiv:2503.03182 [pdf, html, other]

Title: Enhancing Memory Efficiency in Large Language Model Training Through Chronos-aware Pipeline Parallelism

Xinyuan Lin, Chenlu Li, Zongle Huang, Chunyu Wang, Bo Xiao, Huazhong Yang, Shishi Duan, Yongpan Liu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[22] arXiv:2503.03203 [pdf, other]

Title: Access Specification-Aware Software Transactional Memory Techniques for Efficient Execution of Smart Contract Transactions

Parwat Singh Anjana, Srivatsan Ravi, Raghavendra Ramesh, Joshua Tobkin, Rohit Kapoor, Rahul Parmar

Comments: 13 pages and 7 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[23] arXiv:2503.03274 [pdf, html, other]

Title: Benchmarking Dynamic SLO Compliance in Distributed Computing Continuum Systems

Alfreds Lapkovskis, Boris Sedlak, Sindri Magnússon, Schahram Dustdar, Praveen Kumar Donta

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Networking and Internet Architecture (cs.NI); Performance (cs.PF)

[24] arXiv:2503.03392 [pdf, html, other]

Title: SoK: Microservice Architectures from a Dependability Perspective

Dāvis Kažemaks, Jérémie Decouchant

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Software Engineering (cs.SE)

[25] arXiv:2503.03618 [pdf, html, other]

Title: Design and Implementation of an IoT Cluster with Raspberry Pi Powered by Solar Energy: A Theoretical Approach

Noel Portillo

Comments: This manuscript has been previously published on Zenodo and is available at this https URL. The content remains unchanged, and this submission to arXiv is intended to increase accessibility and facilitate further discussion within the research community

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR); Performance (cs.PF); Systems and Control (eess.SY)