Distributed, Parallel, and Cluster Computing

Authors and titles for April 2024

[51] arXiv:2404.09267 [pdf, html, other]

Title: Tangram: High-resolution Video Analytics on Serverless Platform with SLO-aware Batching

Haosong Peng, Yufeng Zhan, Peng Li, Yuanqing Xia

Comments: Accepted by IEEE International Conference on Distributed Computing Systems (ICDCS) 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[52] arXiv:2404.09285 [pdf, html, other]

Title: Egret: Reinforcement Mechanism for Sequential Computation Offloading in Edge Computing

Haosong Peng, Yufeng Zhan, DiHua Zhai, Xiaopu Zhang, Yuanqing Xia

Comments: Submitted to IEEE TSC

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[53] arXiv:2404.09322 [pdf, other]

Title: The intelligent prediction and assessment of financial information risk in the cloud computing model

Yufu Wang, Mingwei Zhu, Jiaqiang Yuan, Guanghui Wang, Hong Zhou

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[54] arXiv:2404.09526 [pdf, html, other]

Title: LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism

Bingyang Wu, Shengyu Liu, Yinmin Zhong, Peng Sun, Xuanzhe Liu, Xin Jin

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[55] arXiv:2404.09536 [pdf, html, other]

Title: Noiseless Privacy-Preserving Decentralized Learning

Sayan Biswas, Mathieu Even, Anne-Marie Kermarrec, Laurent Massoulie, Rafael Pires, Rishi Sharma, Martijn de Vos

Comments: Accepted at PETS 2025

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[56] arXiv:2404.09679 [pdf, html, other]

Title: AntDT: A Self-Adaptive Distributed Training Framework for Leader and Straggler Nodes

Youshao Xiao, Lin Ju, Zhenglei Zhou, Siyuan Li, Zhaoxin Huan, Dalong Zhang, Rujie Jiang, Lin Wang, Xiaolu Zhang, Lei Liang, Jun Zhou

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[57] arXiv:2404.09782 [pdf, other]

Title: ChainScience 2024, Conference Proceedings

Nicolò Vallarano, Claudio J. Tessone

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[58] arXiv:2404.10087 [pdf, html, other]

Title: cuFastTuckerPlus: A Stochastic Parallel Sparse FastTucker Decomposition Using GPU Tensor Cores

Zixuan Li, Mingxing Duan, Huizhang Luo, Wangdong Yang, Kenli Li, Keqin Li

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[59] arXiv:2404.10091 [pdf, html, other]

Title: Empowering Federated Learning with Implicit Gossiping: Mitigating Connection Unreliability Amidst Unknown and Arbitrary Dynamics

Ming Xiang, Stratis Ioannidis, Edmund Yeh, Carlee Joe-Wong, Lili Su

Comments: This is a substantial extension of the conference paper "Towards Bias Correction of Fedavg over Nonuniform and Time-varying Communications", which was published in 2023 62nd IEEE Conference on Decision and Control (CDC), DOI: https://doi.org/10.1109/CDC49753.2023.10383258

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[60] arXiv:2404.10107 [pdf, other]

Title: Design and Implementation of a Java-Based Client-Server Application

Omkar Patil, Aarya Shirbhate

Comments: Attached is a 4-page report detailing the design and implementation of a Java-based client-server application, accompanied by one figure for illustrative purposes. Your consideration is appreciated. Thank you

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Human-Computer Interaction (cs.HC)

[61] arXiv:2404.10151 [pdf, html, other]

Title: Distributing Context-Aware Shared Memory Data Structures: A Case Study on Singly-Linked Lists

Raaghav Ravishankar, Sandeep Kulkarni, Sathya Peri, Gokarna Sharma

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[62] arXiv:2404.10253 [pdf, html, other]

Title: Kilometer-Level Coupled Modeling Using 40 Million Cores: An Eight-Year Journey of Model Development

Xiaohui Duan, Yuxuan Li, Zhao Liu, Bin Yang, Juepeng Zheng, Haohuan Fu, Shaoqing Zhang, Shiming Xu, Yang Gao, Wei Xue, Di Wei, Xiaojing Lv, Lifeng Yan, Haopeng Huang, Haitian Lu, Lingfeng Wan, Haoran Lin, Qixin Chang, Chenlin Li, Quanjie He, Zeyu Song, Xuantong Wang, Yangyang Yu, Xilong Fan, Zhaopeng Qu, Yankun Xu, Xiuwen Guo, Yunlong Fei, Zhaoying Wang, Mingkui Li, Yingjing Jiang, Lv Lu, Liang Su, Jiayu Fu, Peinan Yu, Weiguo Liu, Lixin Wu, Lanning Wang, Xin Liu, Dexun Chen, Guangwen Yang

Comments: 18 pages, 13 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[63] arXiv:2404.10270 [pdf, html, other]

Title: Optimizing BIT1, a Particle-in-Cell Monte Carlo Code, with OpenMP/OpenACC and GPU Acceleration

Jeremy J. Williams, Felix Liu, David Tskhakaya, Stefan Costea, Ales Podolnik, Stefano Markidis

Comments: Accepted by ICCS 2024 (The 24th International Conference on Computational Science), prepared in English, formatted according to the Springer LNCS templates and consists of 15 pages, which includes the main text, references, and figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF); Computational Physics (physics.comp-ph)

[64] arXiv:2404.10386 [pdf, html, other]

Title: I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Noah Lewis, Jean Luca Bez, Surendra Byna

Journal-ref: ACM Computing Surveys (CSUR), Vol. 1, No. 1, Article 1, January 2025

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[65] arXiv:2404.10536 [pdf, html, other]

Title: Benchmarking Machine Learning Applications on Heterogeneous Architecture using Reframe

Christopher Rae, Joseph K. L. Lee, James Richings, Michele Weiland

Comments: Author accepted version of paper in the PERMAVOST workshop at the 33rd International Symposium on High-Performance Parallel and Distributed Computing (HPDC 24)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[66] arXiv:2404.10617 [pdf, html, other]

Title: Optimizing Performance on Trinity Utilizing Machine Learning, Proxy Applications and Scheduling Priorities

Phil Romero

Comments: 7 pages, 11 figures, could not attend conference

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[67] arXiv:2404.10635 [pdf, html, other]

Title: Compressed Federated Reinforcement Learning with a Generative Model

Ali Beikmohammadi, Sarit Khirirat, Sindri Magnússon

Comments: European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD 2024)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Multiagent Systems (cs.MA)

[68] arXiv:2404.10641 [pdf, html, other]

Title: A Cloud Resources Portfolio Optimization Business Model -- From Theory to Practice

Valentin Haag, Maximilian Kiessler, Benedikt Pittl, Erich Schikuta

Comments: Cumulative paper on master theses of Valentin Haag and Maximilian Kiessler

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA)

[69] arXiv:2404.10786 [pdf, other]

Title: Sustainability of Data Center Digital Twins with Reinforcement Learning

Soumyendu Sarkar, Avisek Naug, Antonio Guillen, Ricardo Luna, Vineet Gundecha, Ashwin Ramesh Babu, Sajad Mousavi

Comments: 2024 Proceedings of the AAAI Conference on Artificial Intelligence

Journal-ref: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 20, pp. 22322-22330, Mar. 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Systems and Control (eess.SY)

[70] arXiv:2404.10928 [pdf, html, other]

Title: GPU-Based Parallel Computing Methods for Medical Photoacoustic Image Reconstruction

Xinyao Yi, Yuxin Qiao

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[71] arXiv:2404.11169 [pdf, html, other]

Title: Mutiny! How does Kubernetes fail, and what can we do about it?

Marco Barletta, Marcello Cinque, Catello Di Martino, Zbigniew T. Kalbarczyk, Ravishankar K. Iyer

Journal-ref: 54th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Brisbane, Australia, 2024, pp. 1-14

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[72] arXiv:2404.11308 [pdf, html, other]

Title: Undo and Redo Support for Replicated Registers

Leo Stewen, Martin Kleppmann

Comments: 6 pages, 3 figures

Journal-ref: PaPoC '24: Proceedings of the 11th Workshop on Principles and Practice of Consistency for Distributed Data, April 2024, Pages 1-7

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[73] arXiv:2404.11352 [pdf, html, other]

Title: Accelerating Geo-distributed Machine Learning with Network-Aware Adaptive Tree and Auxiliary Route

Zonghang Li, Wenjiao Feng, Weibo Cai, Hongfang Yu, Long Luo, Gang Sun, Hongyang Du, Dusit Niyato

Comments: 17 pages, 20 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[74] arXiv:2404.11481 [pdf, html, other]

Title: IoTSim-Osmosis-RES: Towards autonomic renewable energy-aware osmotic computing

Tomasz Szydlo, Amadeusz Szabala, Nazar Kordiumov, Konrad Siuzdak, Lukasz Wolski, Khaled Alwasel, Fawzy Habeeb, Rajiv Ranjan

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[75] arXiv:2404.11556 [pdf, html, other]

Title: Hierarchical storage management in user space for neuroimaging applications

Valérie Hayot-Sasson, Tristan Glatard

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[76] arXiv:2404.11631 [pdf, html, other]

Title: A Preliminary Study on Accelerating Simulation Optimization with GPU Implementation

Jinghai He, Haoyu Liu, Yuhang Wu, Zeyu Zheng, Tingyu Zhu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[77] arXiv:2404.12457 [pdf, html, other]

Title: RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation

Chao Jin, Zili Zhang, Xuanlin Jiang, Fangyue Liu, Xin Liu, Xuanzhe Liu, Xin Jin

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL); Machine Learning (cs.LG)

[78] arXiv:2404.12486 [pdf, html, other]

Title: Follow-Me AI: Energy-Efficient User Interaction with Smart Environments

Alaa Saleh, Praveen Kumar Donta, Roberto Morabito, Naser Hossein Motlagh, Lauri Lovén

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET); Machine Learning (cs.LG)

[79] arXiv:2404.12666 [pdf, html, other]

Title: A Survey on Federated Analytics: Taxonomy, Enabling Techniques, Applications and Open Issues

Zibo Wang, Haichao Ji, Yifei Zhu, Dan Wang, Zhu Han

Comments: This survey is to be published in by IEEE Communications Surveys & Tutorials

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Cryptography and Security (cs.CR); Emerging Technologies (cs.ET)

[80] arXiv:2404.12674 [pdf, html, other]

Title: Towards Universal Performance Modeling for Machine Learning Training on Multi-GPU Platforms

Zhongyi Lin, Ning Sun, Pallab Bhattacharya, Xizhou Feng, Louis Feng, John D. Owens

Comments: 13 pages, 11 figures, 4 tables

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Performance (cs.PF)

[81] arXiv:2404.12930 [pdf, html, other]

Title: Fast Broadcast in Highly Connected Networks

Shashwat Chandra, Yi-Jun Chang, Michal Dory, Mohsen Ghaffari, Dean Leitersdorf

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[82] arXiv:2404.12953 [pdf, html, other]

Title: Low-Depth Spatial Tree Algorithms

Yves Baumann, Tal Ben-Nun, Maciej Besta, Lukas Gianinazzi, Torsten Hoefler, Piotr Luczynski

Journal-ref: IEEE International Parallel and Distributed Processing Symposium, IPDPS 2024, San Francisco, CA, USA, May 27-31 (2024) 180-192

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[83] arXiv:2404.13179 [pdf, html, other]

Title: When Computing follows Vehicles: Decentralized Mobility-Aware Resource Allocation for Edge-to-Cloud Continuum

Zeinab Nezami, Emmanouil Chaniotakis, Evangelos Pournaras

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA)

[84] arXiv:2404.13195 [pdf, html, other]

Title: Automatic BLAS Offloading on Unified Memory Architecture: A Study on NVIDIA Grace-Hopper

Junjie Li, Yinzhi Wang, Xiao Liang, Hang Liu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[85] arXiv:2404.13236 [pdf, html, other]

Title: LLMChain: Blockchain-based Reputation System for Sharing and Evaluating Large Language Models

Mouhamed Amine Bouchiha, Quentin Telnoff, Souhail Bakkali, Ronan Champagnat, Mourad Rabah, Mickaël Coustaty, Yacine Ghamri-Doudane

Comments: Paper accepted at IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC) IEEE, Osaka, Japan (2024)

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET)

[86] arXiv:2404.13262 [pdf, html, other]

Title: An Accurate Beam-Tracking Algorithm with Adaptive Beam Reconstruction via UAV-BSs for Mobile Users

Jing Zhang, Sheng Gao, Xin Feng, Hongwei Yang, Geng Sun

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[87] arXiv:2404.13349 [pdf, html, other]

Title: Breaking the Memory Wall for Heterogeneous Federated Learning with Progressive Training

Yebo Wu, Li Li, Chunlin Tian, Chengzhong Xu

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[88] arXiv:2404.13470 [pdf, html, other]

Title: GWLZ: A Group-wise Learning-based Lossy Compression Framework for Scientific Data

Wenqi Jia, Sian Jin, Jinzhen Wang, Wei Niu, Dingwen Tao, Miao Yin

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)

[89] arXiv:2404.13614 [pdf, html, other]

Title: Enhancing ASIC Technology Mapping via Parallel Supergate Computing

Ye Cai, Zonglin Yang, Liwei Ni, Biwei Xie, Xingquan Li

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[90] arXiv:2404.13617 [pdf, html, other]

Title: Parallel AIG Refactoring via Conflict Breaking

Ye Cai, Zonglin Yang, Liwei Ni, Junfeng Liu, Biwei Xie, Xingquan Li

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[91] arXiv:2404.13683 [pdf, html, other]

Title: Low-ordered Orthogonal Voxel Finite Element with INT8 Tensor Cores for GPU-based Explicit Elastic Wave Propagation Analysis

Tsuyoshi Ichimura, Kohei Fujita, Muneo Hori, Maddegedara Lalith

Comments: 16 pages, 6 figures, accepted for IHPCES/ICCS 2024 (14th International Workshop on Advances in High-Performance Computational Earth Sciences: Numerical Methods, Frameworks & Applications / 24th International Conference on Computational Science)

Journal-ref: ICCS 2024. ICCS 2024. Lecture Notes in Computer Science, vol 14834. Springer, Cham

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[92] arXiv:2404.13804 [pdf, html, other]

Title: Adaptive Heterogeneous Client Sampling for Federated Learning over Wireless Networks

Bing Luo, Wenli Xiao, Shiqiang Wang, Jianwei Huang, Leandros Tassiulas

Comments: Published in IEEE Transactions on Mobile Computing (TMC). arXiv admin note: substantial text overlap with arXiv:2112.11256

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Networking and Internet Architecture (cs.NI); Systems and Control (eess.SY)

[93] arXiv:2404.14033 [pdf, html, other]

Title: Apodotiko: Enabling Efficient Serverless Federated Learning in Heterogeneous Environments

Mohak Chadha, Alexander Jensen, Jianfeng Gu, Osama Abboud, Michael Gerndt

Comments: Accepted at IEEE/ACM CCGrid'24

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[94] arXiv:2404.14074 [pdf, html, other]

Title: Towards Proxy Staking Accounts Based on NFTs in Ethereum

Viktor Valaštín, Roman Bitarovský, Kristián Košťál, Ivan Kotuliak

Comments: To be presented at IEEE International Conference on Blockchain and Cryptocurrency (ICBC) 2024

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Cryptography and Security (cs.CR)

[95] arXiv:2404.14193 [pdf, html, other]

Title: LLAMP: Assessing Network Latency Tolerance of HPC Applications with Linear Programming

Siyuan Shen, Langwen Huang, Marcin Chrapek, Timo Schneider, Jai Dayal, Manisha Gajbe, Robert Wisniewski, Torsten Hoefler

Comments: 19 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI); Performance (cs.PF)

[96] arXiv:2404.14250 [pdf, html, other]

Title: Frosty: Bringing strong liveness guarantees to the Snow family of consensus protocols

Aaron Buchwald, Stephen Buttolph, Andrew Lewis-Pye, Patrick O'Grady, Kevin Sekniqi

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[97] arXiv:2404.14282 [pdf, html, other]

Title: Blockchain in a box: A portable blockchain network implementation on Raspberry Pi's

Matija Piškorec, Anton Ivaskevich, Said Haji Abukar, Lundrim Azemi, Md Rezuanul Haque, Mostafa Chegenizadeh, Claudio J. Tessone

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[98] arXiv:2404.14527 [pdf, html, other]

Title: Mélange: Cost Efficient Large Language Model Serving by Exploiting GPU Heterogeneity

Tyler Griggs, Xiaoxuan Liu, Jiaxiang Yu, Doyoung Kim, Wei-Lin Chiang, Alvin Cheung, Ion Stoica

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[99] arXiv:2404.14691 [pdf, html, other]

Title: Towards Fast Setup and High Throughput of GPU Serverless Computing

Han Zhao, Weihao Cui, Quan Chen, Shulai Zhang, Zijun Li, Jingwen Leng, Chao Li, Deze Zeng, Minyi Guo

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)

[100] arXiv:2404.15043 [pdf, html, other]

Title: Mapping Parallel Matrix Multiplication in GotoBLAS2 to the AMD Versal ACAP for Deep Learning

Jie Lei, Enrique S. Quintana-Ortí

Comments: 12 pages

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)