Distributed, Parallel, and Cluster Computing

Authors and titles for recent submissions

• Tue, 15 Apr 2025
• Mon, 14 Apr 2025
• Fri, 11 Apr 2025
• Thu, 10 Apr 2025
• Wed, 9 Apr 2025

See today's new changes

Wed, 9 Apr 2025 (showing 5 of 5 entries )

[51] arXiv:2504.06254 [pdf, html, other]

Title: Fixing non-blocking data structures for better compatibility with memory reclamation schemes

MD Amit Hasan Arovi, Ruslan Nikolaev

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[52] arXiv:2504.06095 [pdf, html, other]

Title: Nonuniform-Tensor-Parallelism: Mitigating GPU failure impact for Scaled-up LLM Training

Daiyaan Arfeen, Dheevatsa Mudigere, Ankit More, Bhargava Gopireddy, Ahmet Inci, Gregory R. Ganger

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[53] arXiv:2504.05536 [pdf, html, other]

Title: dpBento: Benchmarking DPUs for Data Processing

Jiasheng Hu, Chihan Cui, Anna Li, Raahil Vora, Yuanfan Chen, Philip A. Bernstein, Jialin Li, Qizhen Zhang

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Databases (cs.DB)

[54] arXiv:2504.05897 (cross-list from cs.LG) [pdf, other]

Title: HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference

Shuzhang Zhong, Yanfan Sun, Ling Liang, Runsheng Wang, Ru Huang, Meng Li

Comments: Accepted by DAC 25

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[55] arXiv:2504.05638 (cross-list from cs.LG) [pdf, html, other]

Title: TAGC: Optimizing Gradient Communication in Distributed Transformer Training

Igor Polyakov, Alexey Dukhanov, Egor Spirin

Journal-ref: EuroMLSys '25: Proceedings of the 5th Workshop on Machine Learning and Systems. 2025. 254-260

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)