Distributed, Parallel, and Cluster Computing

Authors and titles for November 2024

[151] arXiv:2411.01433 (cross-list from cs.LG) [pdf, html, other]

Title: HOBBIT: A Mixed Precision Expert Offloading System for Fast MoE Inference

Peng Tang, Jiacheng Liu, Xiaofeng Hou, Yifei Pu, Jing Wang, Pheng-Ann Heng, Chao Li, Minyi Guo

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[152] arXiv:2411.01458 (cross-list from cs.LG) [pdf, html, other]

Title: Two-Timescale Model Caching and Resource Allocation for Edge-Enabled AI-Generated Content Services

Zhang Liu, Hongyang Du, Xiangwang Hou, Lianfen Huang, Seyyedali Hosseinalipour, Dusit Niyato, Khaled Ben Letaief

Comments: 14 pages, 8 figures, 39 references

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[153] arXiv:2411.01490 (cross-list from cs.LG) [pdf, html, other]

Title: Anomalous Client Detection in Federated Learning

Dipanwita Thakur, Antonella Guzzo, Giancarlo Fortino

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[154] arXiv:2411.01548 (cross-list from cs.LG) [pdf, html, other]

Title: Analysis of regularized federated learning

Langming Liu, Dingxuan Zhou

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[155] arXiv:2411.01583 (cross-list from cs.CR) [pdf, html, other]

Title: Trustworthy Federated Learning: Privacy, Security, and Beyond

Chunlu Chen, Ji Liu, Haowen Tan, Xingjian Li, Kevin I-Kai Wang, Peng Li, Kouichi Sakurai, Dejing Dou

Comments: 32 pages, to appear in KAIS

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[156] arXiv:2411.01592 (cross-list from cs.FL) [pdf, html, other]

Title: Decidability Issues for Petri Nets -- a survey

Javier Esparza, Mogens Nielsen

Journal-ref: J. Inf. Process. Cybern. 30(3): 143-160 (1994)

Subjects: Formal Languages and Automata Theory (cs.FL); Distributed, Parallel, and Cluster Computing (cs.DC)

[157] arXiv:2411.01636 (cross-list from cs.CE) [pdf, other]

Title: Leveraging Microservices Architecture for Dynamic Pricing in the Travel Industry: Algorithms, Scalability, and Impact on Revenue and Customer Satisfaction

Biman Barua, M. Shamim Kaiser

Comments: 19 pages, 18 figures

Subjects: Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Computer Science and Game Theory (cs.GT)

[158] arXiv:2411.01689 (cross-list from cs.CR) [pdf, other]

Title: Consensus Under Adversary Majority Done Right

Srivatsan Sridhar, Ertem Nusret Tas, Joachim Neu, Dionysis Zindros, David Tse

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[159] arXiv:2411.01825 (cross-list from cs.LG) [pdf, html, other]

Title: FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

Han Liang, Ziwei Zhan, Weijie Liu, Xiaoxi Zhang, Chee Wei Tan, Xu Chen

Comments: 8 pages, 4 figures, accepted by European Conference on Artificial Intelligence (2024 ECAI)

Journal-ref: In ECAI 2024 (pp. 2090-2097). IOS Press (2024)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[160] arXiv:2411.02003 (cross-list from cs.LG) [pdf, html, other]

Title: Against Multifaceted Graph Heterogeneity via Asymmetric Federated Prompt Learning

Zhuoning Guo, Ruiqian Han, Hao Liu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[161] arXiv:2411.02086 (cross-list from cs.NI) [pdf, html, other]

Title: Real-time and Downtime-tolerant Fault Diagnosis for Railway Turnout Machines (RTMs) Empowered with Cloud-Edge Pipeline Parallelism

Fan Wu, Muhammad Bilal, Haolong Xiang, Heng Wang, Jinjun Yu, Xiaolong Xu

Subjects: Networking and Internet Architecture (cs.NI); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)

[162] arXiv:2411.02115 (cross-list from cs.LG) [pdf, html, other]

Title: FedMoE-DA: Federated Mixture of Experts via Domain Aware Fine-grained Aggregation

Ziwei Zhan, Wenkuan Zhao, Yuanqing Li, Weijie Liu, Xiaoxi Zhang, Chee Wei Tan, Chuan Wu, Deke Guo, Xu Chen

Comments: 8 pages, 5 figures, accepted by The 20th International Conference on Mobility, Sensing and Networking (MSN 2024)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[163] arXiv:2411.02268 (cross-list from cs.SI) [pdf, html, other]

Title: Memory-Efficient Community Detection on Large Graphs Using Weighted Sketches

Subhajit Sahu

Comments: 15 pages, 12 figures, 1 table

Subjects: Social and Information Networks (cs.SI); Distributed, Parallel, and Cluster Computing (cs.DC)

[164] arXiv:2411.02322 (cross-list from cs.LG) [pdf, html, other]

Title: LayerDAG: A Layerwise Autoregressive Diffusion Model for Directed Acyclic Graph Generation

Mufei Li, Viraj Shitole, Eli Chien, Changhai Man, Zhaodong Wang, Srinivas Sridharan, Ying Zhang, Tushar Krishna, Pan Li

Comments: Accepted by ICLR 2025 (Spotlight); Code available at this https URL

Subjects: Machine Learning (cs.LG); Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[165] arXiv:2411.02333 (cross-list from math.NA) [pdf, html, other]

Title: Discrete the solving model of time-variant standard Sylvester-conjugate matrix equations using Euler-forward formula

Jiakuang He, Dongqing Wu

Comments: An analysis of the differences between sampling discretion errors and space compressive approximation errors in optimizing neural dynamics

Subjects: Numerical Analysis (math.NA); Distributed, Parallel, and Cluster Computing (cs.DC); Neural and Evolutionary Computing (cs.NE); Systems and Control (eess.SY); Mathematical Physics (math-ph)

[166] arXiv:2411.02597 (cross-list from cs.CR) [pdf, html, other]

Title: Taming the Beast of User-Programmed Transactions on Blockchains: A Declarative Transaction Approach

Nodirbek Korchiev, Akash Pateria, Vodelina Samatova, Sogolsadat Mansouri, Kemafor Anyanwu

Subjects: Cryptography and Security (cs.CR); Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)

[167] arXiv:2411.02814 (cross-list from cs.PF) [pdf, other]

Title: The Hitchhiker's Guide to Programming and Optimizing CXL-Based Heterogeneous Systems

Zixuan Wang, Suyash Mahar, Luyi Li, Jangseon Park, Jinpyo Kim, Theodore Michailidis, Yue Pan, Tajana Rosing, Dean Tullsen, Steven Swanson, Kyung Chang Ryoo, Sungjoo Park, Jishen Zhao

Subjects: Performance (cs.PF); Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC); Operating Systems (cs.OS)

[168] arXiv:2411.02908 (cross-list from cs.LG) [pdf, other]

Title: Photon: Federated LLM Pre-Training

Lorenzo Sani, Alex Iacob, Zeyu Cao, Royson Lee, Bill Marino, Yan Gao, Dongqi Cai, Zexi Li, Wanru Zhao, Xinchi Qiu, Nicholas D. Lane

Comments: 13 pages, 9 appendix pages, 10 figures, 3 algorithms, 8 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[169] arXiv:2411.03231 (cross-list from cs.CR) [pdf, html, other]

Title: Formal Logic-guided Robust Federated Learning against Poisoning Attacks

Dung Thuy Nguyen, Ziyan An, Taylor T. Johnson, Meiyi Ma, Kevin Leach

Comments: 12 pages, 4 figures, 6 tables

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Logic in Computer Science (cs.LO)

[170] arXiv:2411.03344 (cross-list from cs.CR) [pdf, html, other]

Title: Comparing Security and Efficiency of WebAssembly and Linux Containers in Kubernetes Cloud Computing

Jasper Alexander Wiegratz

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[171] arXiv:2411.03357 (cross-list from cs.CR) [pdf, html, other]

Title: PipeLLM: Fast and Confidential Large Language Model Services with Speculative Pipelined Encryption

Yifan Tan, Cheng Tan, Zeyu Mi, Haibo Chen

Comments: To appear in ASPLOS 2025

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[172] arXiv:2411.03398 (cross-list from cs.AR) [pdf, html, other]

Title: DP-HLS: A High-Level Synthesis Framework for Accelerating Dynamic Programming Algorithms in Bioinformatics

Yingqi Cao, Anshu Gupta, Jason Liang, Yatish Turakhia (University of California San Diego)

Comments: * Both authors contributed equally to this research. Detailed Wiki: this https URL. DP-HLS codebase: this https URL

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[173] arXiv:2411.03643 (cross-list from math-ph) [pdf, other]

Title: Hierarchical Self-Organization in Fixed-Magnetization Particle Systems

Shunhao Oh, Jacob Calvert, Dana Randall

Subjects: Mathematical Physics (math-ph); Statistical Mechanics (cond-mat.stat-mech); Distributed, Parallel, and Cluster Computing (cs.DC); Probability (math.PR)

[174] arXiv:2411.03742 (cross-list from cs.LG) [pdf, html, other]

Title: Adaptive Consensus Gradients Aggregation for Scaled Distributed Training

Yoni Choukroun, Shlomi Azoulay, Pavel Kisilev

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[175] arXiv:2411.03832 (cross-list from cs.AR) [pdf, html, other]

Title: Accelerating DNA Read Mapping with Digital Processing-in-Memory

Rotem Ben-Hur, Orian Leitersdorf, Ronny Ronen, Lidor Goldshmidt, Idan Magram, Lior Kaplun, Leonid Yavitz, Shahar Kvatinsky

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC); Quantitative Methods (q-bio.QM)

[176] arXiv:2411.04112 (cross-list from cs.RO) [pdf, html, other]

Title: Fed-EC: Bandwidth-Efficient Clustering-Based Federated Learning For Autonomous Visual Robot Navigation

Shreya Gummadi, Mateus V. Gasparino, Deepak Vasisht, Girish Chowdhary

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[177] arXiv:2411.04159 (cross-list from cs.NI) [pdf, html, other]

Title: Cooperation and Personalization on a Seesaw: Choice-based FL for Safe Cooperation in Wireless Networks

Han Zhang, Medhat Elsayed, Majid Bavand, Raimundas Gaigalas, Yigit Ozcan, Melike Erol-Kantarci

Subjects: Networking and Internet Architecture (cs.NI); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[178] arXiv:2411.04936 (cross-list from cs.LG) [pdf, html, other]

Title: Fed-LDR: Federated Local Data-infused Graph Creation with Node-centric Model Refinement

Jiechao Gao, Yuangang Li, Syeda Faiza Ahmed

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[179] arXiv:2411.04975 (cross-list from cs.CL) [pdf, html, other]

Title: SuffixDecoding: A Model-Free Approach to Speeding Up Large Language Model Inference

Gabriele Oliaro, Zhihao Jia, Daniel Campos, Aurick Qiao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[180] arXiv:2411.05009 (cross-list from physics.plasm-ph) [pdf, html, other]

Title: A Study of Performance Portability in Plasma Physics Simulations

Josef Ruzicka, Christian Asch, Esteban Meneses, Markus Rampp, Erwin Laure

Comments: 15 pages, 8 figures, this is a pre-print to be published in the Latin America High Performance Computing Conference (CARLA) 2024 proceedings

Subjects: Plasma Physics (physics.plasm-ph); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF); Computational Physics (physics.comp-ph)

[181] arXiv:2411.05260 (cross-list from cs.CR) [pdf, html, other]

Title: QuanCrypt-FL: Quantized Homomorphic Encryption with Pruning for Secure Federated Learning

Md Jueal Mia, M. Hadi Amini

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[182] arXiv:2411.05323 (cross-list from cs.NI) [pdf, html, other]

Title: TraDE: Network and Traffic-aware Adaptive Scheduling for Microservices Under Dynamics

Ming Chen, Muhammed Tawfiqul Islam, Maria Rodriguez Read, Rajkumar Buyya

Comments: 13 pages

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET); Performance (cs.PF)

[183] arXiv:2411.05346 (cross-list from cs.LG) [pdf, other]

Title: Reinforcement Learning for Adaptive Resource Scheduling in Complex System Environments

Pochun Li, Yuyang Xiao, Jinghua Yan, Xuan Li, Xiaoye Wang

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[184] arXiv:2411.05349 (cross-list from cs.AI) [pdf, html, other]

Title: Enhancing Cluster Resilience: LLM-agent Based Autonomous Intelligent Cluster Diagnosis System and Evaluation Framework

Honghao Shi, Longkai Cheng, Wenli Wu, Yuhang Wang, Xuan Liu, Shaokai Nie, Weixv Wang, Xuebin Min, Chunlei Men, Yonghua Lin

Comments: 10 pages

Subjects: Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[185] arXiv:2411.05463 (cross-list from cs.CR) [pdf, other]

Title: Dave: a decentralized, secure, and lively fraud-proof algorithm

Diego Nehab, Gabriel Coutinho de Paula, Augusto Teixeira

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[186] arXiv:2411.05614 (cross-list from cs.LG) [pdf, html, other]

Title: Acceleration for Deep Reinforcement Learning using Parallel and Distributed Computing: A Survey

Zhihong Liu, Xin Xu, Peng Qiao, Dongsheng Li

Comments: This paper has been accepted by ACM Computing Surveys

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[187] arXiv:2411.05697 (cross-list from eess.IV) [pdf, html, other]

Title: IPMN Risk Assessment under Federated Learning Paradigm

Hongyi Pan, Ziliang Hong, Gorkem Durak, Elif Keles, Halil Ertugrul Aktas, Yavuz Taktak, Alpay Medetalibeyoglu, Zheyuan Zhang, Yury Velichko, Concetto Spampinato, Ivo Schoots, Marco J. Bruno, Pallavi Tiwari, Candice Bolan, Tamas Gonda, Frank Miller, Rajesh N. Keswani, Michael B. Wallace, Ziyue Xu, Ulas Bagci

Comments: This paper has been accepted to ISBI 2025

Subjects: Image and Video Processing (eess.IV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[188] arXiv:2411.05873 (cross-list from cs.LG) [pdf, html, other]

Title: Poor Man's Training on MCUs: A Memory-Efficient Quantized Back-Propagation-Free Approach

Yequan Zhao, Hai Li, Ian Young, Zheng Zhang

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Neural and Evolutionary Computing (cs.NE)

[189] arXiv:2411.06135 (cross-list from cs.LG) [pdf, html, other]

Title: Online Parallel Multi-Task Relationship Learning via Alternating Direction Method of Multipliers

Ruiyu Li, Peilin Zhao, Guangxia Li, Zhiqiang Xu, Xuewei Li

Comments: Accpeted by Neurocomputing

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[190] arXiv:2411.06137 (cross-list from cs.CR) [pdf, html, other]

Title: A Sharded Blockchain-Based Secure Federated Learning Framework for LEO Satellite Networks

Wenbo Wu, Cheng Tan, Kangcheng Yang, Zhishu Shen, Qiushi Zheng, Jiong Jin

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[191] arXiv:2411.06225 (cross-list from stat.CO) [pdf, html, other]

Title: RandNet-Parareal: a time-parallel PDE solver using Random Neural Networks

Guglielmo Gattiglio, Lyudmila Grigoryeva, Massimiliano Tamborrino

Comments: Accepted at the 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

Subjects: Computation (stat.CO); Distributed, Parallel, and Cluster Computing (cs.DC); Numerical Analysis (math.NA); Machine Learning (stat.ML)

[192] arXiv:2411.06465 (cross-list from cs.LG) [pdf, html, other]

Title: Accelerating Large Language Model Training with 4D Parallelism and Memory Consumption Estimator

Kazuki Fujii, Kohei Watanabe, Rio Yokota

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[193] arXiv:2411.06581 (cross-list from cs.LG) [pdf, html, other]

Title: Federated LLMs Fine-tuned with Adaptive Importance-Aware LoRA

Yang Su, Na Yan, Yansha Deng

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[194] arXiv:2411.06618 (cross-list from cs.LG) [pdf, html, other]

Title: Using Diffusion Models as Generative Replay in Continual Federated Learning -- What will Happen?

Yongsheng Mei, Liangqi Yuan, Dong-Jun Han, Kevin S. Chan, Christopher G. Brinton, Tian Lan

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[195] arXiv:2411.06681 (cross-list from cs.LG) [pdf, html, other]

Title: WDMoE: Wireless Distributed Mixture of Experts for Large Language Models

Nan Xue, Yaping Sun, Zhiyong Chen, Meixia Tao, Xiaodong Xu, Liang Qian, Shuguang Cui, Wenjun Zhang, Ping Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[196] arXiv:2411.06773 (cross-list from cs.LG) [pdf, html, other]

Title: Model Partition and Resource Allocation for Split Learning in Vehicular Edge Networks

Lu Yu, Zheng Chang, Yunjian Jia, Geyong Min

Comments: arXiv admin note: text overlap with arXiv:2306.12194 by other authors

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[197] arXiv:2411.06878 (cross-list from cs.LG) [pdf, html, other]

Title: GraphRPM: Risk Pattern Mining on Industrial Large Attributed Graphs

Sheng Tian, Xintan Zeng, Yifei Hu, Baokun Wang, Yongchao Liu, Yue Jin, Changhua Meng, Chuntao Hong, Tianyi Zhang, Weiqiang Wang

Comments: Accepted by ECML PKDD 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[198] arXiv:2411.06980 (cross-list from cs.OS) [pdf, html, other]

Title: xNVMe: Unleashing Storage Hardware-Software Co-design

Simon A. F. Lund, Vivek Shah

Subjects: Operating Systems (cs.OS); Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)

[199] arXiv:2411.07049 (cross-list from cs.DB) [pdf, other]

Title: Pushing the Limit: Verified Performance-Optimal Causally-Consistent Database Transactions

Shabnam Ghasemirad, Christoph Sprenger, Si Liu, Luca Multazzu, David Basin

Comments: This is the camera-ready version (full version with appendix) of our paper with minimal changes compared to the previous version

Subjects: Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Formal Languages and Automata Theory (cs.FL); Logic in Computer Science (cs.LO)

[200] arXiv:2411.07168 (cross-list from cs.LG) [pdf, html, other]

Title: Enhancing Predictive Maintenance in Mining Mobile Machinery through a TinyML-enabled Hierarchical Inference Network

Raúl de la Fuente, Luciano Radrigan, Anibal S Morales

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA); Networking and Internet Architecture (cs.NI); Signal Processing (eess.SP)