Distributed, Parallel, and Cluster Computing

Authors and titles for January 2024

[151] arXiv:2401.05562 (cross-list from cs.LG) [pdf, html, other]

Title: Brave: Byzantine-Resilient and Privacy-Preserving Peer-to-Peer Federated Learning

Zhangchen Xu, Fengqing Jiang, Luyao Niu, Jinyuan Jia, Radha Poovendran

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[152] arXiv:2401.05895 (cross-list from cs.LG) [pdf, html, other]

Title: Binary Linear Tree Commitment-based Ownership Protection for Distributed Machine Learning

Tianxiu Xie, Keke Gai, Jing Yu, Liehuang Zhu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[153] arXiv:2401.06089 (cross-list from cs.LG) [pdf, html, other]

Title: PANDORA: A Parallel Dendrogram Construction Algorithm for Single Linkage Clustering on GPU

Piyush Sao, Andrey Prokopenko, Damien Lebrun-Grandié

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[154] arXiv:2401.06180 (cross-list from eess.IV) [pdf, other]

Title: Decentralized Gossip Mutual Learning (GML) for automatic head and neck tumor segmentation

Jingyun Chen, Yading Yuan

Comments: 6 pages, 1 figure, accepted to SPIE Medical Imaging 2024

Subjects: Image and Video Processing (eess.IV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[155] arXiv:2401.06188 (cross-list from quant-ph) [pdf, html, other]

Title: State of practice: evaluating GPU performance of state vector and tensor network methods

Marzio Vallero, Flavio Vella, Paolo Rech

Comments: 13 pages, 10 figures, 1 table

Subjects: Quantum Physics (quant-ph); Distributed, Parallel, and Cluster Computing (cs.DC)

[156] arXiv:2401.06306 (cross-list from cs.NI) [pdf, html, other]

Title: Joint Network Slicing, Routing, and In-Network Computing for Energy-Efficient 6G

Zeinab Sasan, Masoud Shokrnezhad, Siavash Khorsandi, Tarik Taleb

Comments: Accepted at the 2024 IEEE Wireless Communications and Networking Conference (WCNC 2024)

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[157] arXiv:2401.06432 (cross-list from cs.LG) [pdf, html, other]

Title: Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models

Yae Jee Cho, Luyang Liu, Zheng Xu, Aldi Fahrezi, Gauri Joshi

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[158] arXiv:2401.06519 (cross-list from cs.LO) [pdf, html, other]

Title: Graded modal logic and counting message passing automata

Veeti Ahvonen, Damian Heiman, Antti Kuusisto

Subjects: Logic in Computer Science (cs.LO); Distributed, Parallel, and Cluster Computing (cs.DC)

[159] arXiv:2401.06953 (cross-list from cs.LG) [pdf, html, other]

Title: FedDriveScore: Federated Scoring Driving Behavior with a Mixture of Metric Distributions

Lin Lu

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[160] arXiv:2401.07119 (cross-list from cs.DB) [pdf, html, other]

Title: Curator: Efficient Indexing for Multi-Tenant Vector Databases

Yicheng Jin, Yongji Wu, Wenjun Hu, Bruce M. Maggs, Xiao Zhang, Danyang Zhuo

Subjects: Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[161] arXiv:2401.07162 (cross-list from cs.CR) [pdf, html, other]

Title: Pipelet: Practical Streamlined Blockchain Protocol

Vivek Karihaloo, Ruchi Shah, Panruo Wu, Aron Laszka

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[162] arXiv:2401.07788 (cross-list from cs.LG) [pdf, html, other]

Title: Activations and Gradients Compression for Model-Parallel Training

Mikhail Rudakov, Aleksandr Beznosikov, Yaroslav Kholodov, Alexander Gasnikov

Comments: 17 pages, 6 figures, 5 tables

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[163] arXiv:2401.07886 (cross-list from cs.LG) [pdf, html, other]

Title: Learned Best-Effort LLM Serving

Siddharth Jha, Coleman Hooper, Xiaoxuan Liu, Sehoon Kim, Kurt Keutzer

Comments: Es-FoMo @ ICML 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[164] arXiv:2401.07931 (cross-list from cs.CV) [pdf, html, other]

Title: Vertical Federated Image Segmentation

Paul K. Mandal, Cole Leo

Comments: 11 pages, 5 figures

Journal-ref: IFIP International Conference on Artificial Intelligence Applications and Innovations (2024) (pp. 54-65)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[165] arXiv:2401.08092 (cross-list from cs.LG) [pdf, html, other]

Title: A Survey of Resource-efficient LLM and Multimodal Foundation Models

Mengwei Xu, Wangsong Yin, Dongqi Cai, Rongjie Yi, Daliang Xu, Qipeng Wang, Bingyang Wu, Yihao Zhao, Chen Yang, Shihe Wang, Qiyang Zhang, Zhenyan Lu, Li Zhang, Shangguang Wang, Yuanchun Li, Yunxin Liu, Xin Jin, Xuanzhe Liu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[166] arXiv:2401.08183 (cross-list from eess.SP) [pdf, other]

Title: Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures

Martin Dahl, Erik G. Larsson

Comments: Accepted in CISS 2024

Subjects: Signal Processing (eess.SP); Distributed, Parallel, and Cluster Computing (cs.DC)

[167] arXiv:2401.08302 (cross-list from q-fin.TR) [pdf, other]

Title: Do backrun auctions protect traders?

Andrew W. Macpherson

Comments: Keywords: MEV, queue discipline, sandwich, CFMM, arbitrage, blockchain, Ethereum

Subjects: Trading and Market Microstructure (q-fin.TR); Distributed, Parallel, and Cluster Computing (cs.DC); Computer Science and Game Theory (cs.GT)

[168] arXiv:2401.08383 (cross-list from cs.LG) [pdf, html, other]

Title: Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference

Jinghan Yao, Quentin Anthony, Aamir Shafi, Hari Subramoni, Dhabaleswar K. (DK)Panda

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[169] arXiv:2401.08723 (cross-list from cs.CR) [pdf, html, other]

Title: HierSFL: Local Differential Privacy-aided Split Federated Learning in Mobile Edge Computing

Minh K. Quan, Dinh C. Nguyen, Van-Dinh Nguyen, Mayuri Wijayasundara, Sujeeva Setunge, Pubudu N. Pathirana

Comments: 6 Pages, 5 figures, IEEE Virtual Conference on Communications 2023

Subjects: Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[170] arXiv:2401.08895 (cross-list from cs.LG) [pdf, html, other]

Title: cedar: Optimized and Unified Machine Learning Input Data Pipelines

Mark Zhao, Emanuel Adamiak, Christos Kozyrakis

Comments: Published in PVLDB Volume 18, Issue 2

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[171] arXiv:2401.09240 (cross-list from cs.CR) [pdf, other]

Title: A Blockchain-based Model for Securing Data Pipeline in a Heterogeneous Information System

MN Ramahlosi, Y Madani, A Akanbi

Comments: 13 pages

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)

[172] arXiv:2401.09656 (cross-list from cs.LG) [pdf, html, other]

Title: Mobility Accelerates Learning: Convergence Analysis on Hierarchical Federated Learning in Vehicular Networks

Tan Chen, Jintao Yan, Yuxuan Sun, Sheng Zhou, Deniz Gündüz, Zhisheng Niu

Comments: Submitted to IEEE for possible publication

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[173] arXiv:2401.10042 (cross-list from cs.AR) [pdf, other]

Title: BlockAMC: Scalable In-Memory Analog Matrix Computing for Solving Linear Systems

Lunshuai Pan, Pushen Zuo, Yubiao Luo, Zhong Sun, Ru Huang

Comments: This paper has been accepted to the conference DATE 2024

Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

[174] arXiv:2401.10118 (cross-list from cs.DS) [pdf, other]

Title: Techniques for Authenticating Quantile Digests

Alessandro Scala

Comments: 14 pages, LaTeX; corrected layout problem in figure 4 caused by migration from LuaLaTex to pdfLaTex

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[175] arXiv:2401.10158 (cross-list from cs.NI) [pdf, html, other]

Title: DISTINQT: A Distributed Privacy Aware Learning Framework for QoS Prediction for Future Mobile and Wireless Networks

Nikolaos Koursioumpas, Lina Magoula, Ioannis Stavrakakis, Nancy Alonistioti, M. A. Gutierrez-Estevez, Ramin Khalili

Comments: 12 Pages Double Column, 10 Figures, (Minor Revised Version) Accepted for publication in the IEEE Transactions on Vehicular Technology (IEEE TVT)

Subjects: Networking and Internet Architecture (cs.NI); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[176] arXiv:2401.10361 (cross-list from cs.LG) [pdf, html, other]

Title: Hierarchical Federated Learning in Multi-hop Cluster-Based VANETs

M. Saeid HaghighiFard, Sinem Coleri

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI); Systems and Control (eess.SY)

[177] arXiv:2401.10367 (cross-list from cs.SE) [pdf, other]

Title: gFaaS: Enabling Generic Functions in Serverless Computing

Mohak Chadha, Paul Wieland, Michael Gerndt

Comments: IEEE SANER 2024

Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC)

[178] arXiv:2401.10375 (cross-list from cs.CR) [pdf, html, other]

Title: Foundation Models in Federated Learning: Assessing Backdoor Vulnerabilities

Xi Li, Chen Wu, Jiaqi Wang

Comments: Xi Li and Chen Wu are equal contribution. The corresponding author is Jiaqi Wang. This paper has been accepted by IJCNN 2025

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[179] arXiv:2401.10541 (cross-list from cs.LG) [pdf, html, other]

Title: I-SplitEE: Image classification in Split Computing DNNs with Early Exits

Divya Jyoti Bajpai, Aastha Jaiswal, Manjesh Kumar Hanawal

Comments: To appear in proceedings of IEEE International Conference on Communications 2024

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[180] arXiv:2401.10652 (cross-list from cs.PF) [pdf, html, other]

Title: AutoChunk: Automated Activation Chunk for Memory-Efficient Long Sequence Inference

Xuanlei Zhao, Shenggan Cheng, Guangyang Lu, Jiarui Fang, Haotian Zhou, Bin Jia, Ziming Liu, Yang You

Comments: ICLR 2024

Subjects: Performance (cs.PF); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[181] arXiv:2401.11018 (cross-list from cs.LG) [pdf, html, other]

Title: Communication Efficient and Provable Federated Unlearning

Youming Tao, Cheng-Long Wang, Miao Pan, Dongxiao Yu, Xiuzhen Cheng, Di Wang

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[182] arXiv:2401.11089 (cross-list from cs.CR) [pdf, html, other]

Title: FedRKG: A Privacy-preserving Federated Recommendation Framework via Knowledge Graph Enhancement

Dezhong Yao, Tongtong Liu, Qi Cao, Hai Jin

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR)

[183] arXiv:2401.11202 (cross-list from cs.LG) [pdf, html, other]

Title: PartIR: Composing SPMD Partitioning Strategies for Machine Learning

Sami Alabed, Daniel Belov, Bart Chrzaszcz, Juliana Franco, Dominik Grewe, Dougal Maclaurin, James Molloy, Tom Natan, Tamara Norman, Xiaoyue Pan, Adam Paszke, Norman A. Rink, Michael Schaarschmidt, Timur Sitdikov, Agnieszka Swietlik, Dimitrios Vytiniotis, Joel Wee

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Programming Languages (cs.PL)

[184] arXiv:2401.11415 (cross-list from cs.SI) [pdf, html, other]

Title: A Fast Parallel Approach for Neighborhood-based Link Prediction by Disregarding Large Hubs

Subhajit Sahu

Comments: 17 pages, 12 figures, 1 table

Subjects: Social and Information Networks (cs.SI); Distributed, Parallel, and Cluster Computing (cs.DC)

[185] arXiv:2401.11592 (cross-list from cs.LG) [pdf, html, other]

Title: Differentially-Private Multi-Tier Federated Learning

Evan Chen, Frank Po-Chen Lin, Dong-Jun Han, Christopher G. Brinton

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[186] arXiv:2401.11652 (cross-list from cs.CV) [pdf, html, other]

Title: OnDev-LCT: On-Device Lightweight Convolutional Transformers towards federated learning

Chu Myaet Thwal, Minh N.H. Nguyen, Ye Lin Tun, Seong Tae Kim, My T. Thai, Choong Seon Hong

Comments: Published in Neural Networks

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computational Complexity (cs.CC); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[187] arXiv:2401.11736 (cross-list from cs.LG) [pdf, html, other]

Title: Attention on Personalized Clinical Decision Support System: Federated Learning Approach

Chu Myaet Thwal, Kyi Thar, Ye Lin Tun, Choong Seon Hong

Comments: Published in IEEE BigComp 2021

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET)

[188] arXiv:2401.12012 (cross-list from cs.LG) [pdf, html, other]

Title: TurboSVM-FL: Boosting Federated Learning through SVM Aggregation for Lazy Clients

Mengdi Wang, Anna Bodonhelyi, Efe Bozkir, Enkelejda Kasneci

Comments: Proceedings of the AAAI Conference on Artificial Intelligence 2024 (AAAI'24)

Journal-ref: Proceedings of the AAAI Conference on Artificial Intelligence 2024 (AAAI'24)

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[189] arXiv:2401.12120 (cross-list from cs.GT) [pdf, other]

Title: Centralization in Block Building and Proposer-Builder Separation

Maryam Bahrani, Pranav Garimidi, Tim Roughgarden

Subjects: Computer Science and Game Theory (cs.GT); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Theoretical Economics (econ.TH)

[190] arXiv:2401.12151 (cross-list from cs.IT) [pdf, other]

Title: Uncoded Storage Coded Transmission Elastic Computing with Straggler Tolerance in Heterogeneous Systems

Xi Zhong, Joerg Kliewer, Mingyue Ji

Comments: 6 pages, 1 figure, accepted in ICC 2024

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[191] arXiv:2401.12356 (cross-list from cs.LG) [pdf, html, other]

Title: Efficient Collaborations through Weight-Driven Coalition Dynamics in Federated Learning Systems

Mohammed El Hanjri, Hamza Reguieg, Adil Attiaoui, Amine Abouaomar, Abdellatif Kobbane, Mohamed El Kamili

Comments: 6 pages, 4 figures, conference

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Computer Science and Game Theory (cs.GT)

[192] arXiv:2401.12438 (cross-list from eess.IV) [pdf, html, other]

Title: Secure Federated Learning Approaches to Diagnosing COVID-19

Rittika Adhikari, Christopher Settles

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[193] arXiv:2401.12815 (cross-list from cs.NI) [pdf, html, other]

Title: COREC: Concurrent Non-Blocking Single-Queue Receive Driver for Low Latency Networking

Marco Faltelli, Giacomo Belocchi, Francesco Quaglia, Giuseppe Bianchi

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[194] arXiv:2401.13004 (cross-list from math.OC) [pdf, html, other]

Title: Utilizing Graph Sparsification for Pre-processing in Maxcut QUBO Solver

Vorapong Suppakitpaisarn, Jin-Kao Hao

Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC); Quantum Physics (quant-ph)

[195] arXiv:2401.13216 (cross-list from cs.LG) [pdf, other]

Title: On Principled Local Optimization Methods for Federated Learning

Honglin Yuan

Comments: Stanford University Doctoral Dissertation

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC); Machine Learning (stat.ML)

[196] arXiv:2401.13236 (cross-list from cs.LG) [pdf, html, other]

Title: How to Collaborate: Towards Maximizing the Generalization Performance in Cross-Silo Federated Learning

Yuchang Sun, Marios Kountouris, Jun Zhang

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[197] arXiv:2401.13421 (cross-list from quant-ph) [pdf, other]

Title: Federated learning with distributed fixed design quantum chips and quantum channels

Ammar Daskin

Comments: a few typos are corrected and contribution and discussion sections are edited

Subjects: Quantum Physics (quant-ph); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[198] arXiv:2401.13569 (cross-list from cs.NI) [pdf, html, other]

Title: SPARC-LoRa: A Scalable, Power-efficient, Affordable, Reliable, and Cloud Service-enabled LoRa Networking System for Agriculture Applications

Xi Wang, Bryan Hatasaka, Zhengyan Liu, Sayali Tope, Mohit Karkhanis, Seungbeom Noh, Farhan Sium, Ravi V. Mural, Hanseup Kim, Carlos Mastrangelo, Ling Zang, James Schnable, Mingyue Ji

Comments: 6 pages, 8 figures, submitted for publication

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[199] arXiv:2401.13779 (cross-list from cs.IT) [pdf, html, other]

Title: Faster Convergence with Less Communication: Broadcast-Based Subgraph Sampling for Decentralized Learning over Wireless Networks

Daniel Pérez Herrera, Zheng Chen, Erik G. Larsson

Comments: 14 pages, 10 figures, accepted for publication at IEEE Open Journals of Communication. arXiv admin note: text overlap with arXiv:2310.16106

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Signal Processing (eess.SP)

[200] arXiv:2401.14132 (cross-list from cs.CV) [pdf, html, other]

Title: Enabling Cross-Camera Collaboration for Video Analytics on Distributed Smart Cameras

Chulhong Min, Juheon Yi, Utku Gunay Acer, Fahim Kawsar

Comments: 18 pages, under review

Subjects: Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)