Distributed, Parallel, and Cluster Computing

Authors and titles for May 2023

[201] arXiv:2305.07803 (cross-list from cs.CR) [pdf, other]

Title: The Case for the Anonymization of Offloaded Computation

Md Washik Al Azad, Shifat Sarwar, Sifat Ut Taki, Spyridon Mastorakis

Comments: Accepted for publication by IEEE CLOUD 2023

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[202] arXiv:2305.07815 (cross-list from cs.CV) [pdf, other]

Title: MetaMorphosis: Task-oriented Privacy Cognizant Feature Generation for Multi-task Learning

Md Adnan Arefeen, Zhouyu Li, Md Yusuf Sarwar Uddin, Anupam Das

Comments: Preprint version, 22 pages. Keywords: Multi-task learning, neural networks, collaborative intelligence, differential privacy, task privacy

Subjects: Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[203] arXiv:2305.08070 (cross-list from cs.LG) [pdf, other]

Title: A Survey of Federated Evaluation in Federated Learning

Behnaz Soltani, Yipeng Zhou, Venus Haghighi, John C.S. Lui

Comments: Accepted by IJCAI 2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[204] arXiv:2305.08307 (cross-list from quant-ph) [pdf, other]

Title: Fusion Blossom: Fast MWPM Decoders for QEC

Yue Wu, Lin Zhong

Subjects: Quantum Physics (quant-ph); Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)

[205] arXiv:2305.08358 (cross-list from cs.CR) [pdf, other]

Title: Quadratic Functional Encryption for Secure Training in Vertical Federated Learning

Shuangyi Chen, Anuja Modi, Shweta Agrawal, Ashish Khisti

Comments: Accepted to ISIT 2023

Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[206] arXiv:2305.08985 (cross-list from cs.LG) [pdf, other]

Title: Federated Learning over Harmonized Data Silos

Dimitris Stripelis, Jose Luis Ambite

Comments: Presented at the 7th International Workshop on Health Intelligence 2023 (W3PHIAI-23), 6 pages, 4 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[207] arXiv:2305.09266 (cross-list from cs.PF) [pdf, other]

Title: Case Study for Running Memory-Bound Kernels on RISC-V CPUs

Valentin Volokitin, Evgeny Kozinov, Valentina Kustikova, Alexey Liniov, Iosif Meyerov

Subjects: Performance (cs.PF); Distributed, Parallel, and Cluster Computing (cs.DC)

[208] arXiv:2305.09493 (cross-list from cs.SE) [pdf, other]

Title: Experiences in Building a Composable and Functional API for Runtime SPIR-V Code Generation

Juan Fumero, György Rethy, Athanasios Stratikopoulos, Nikos Foutris, Christos Kotselidis

Comments: 16 pages, 9 figures, 11 Listings

Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC)

[209] arXiv:2305.09729 (cross-list from cs.LG) [pdf, other]

Title: FedHGN: A Federated Framework for Heterogeneous Graph Neural Networks

Xinyu Fu, Irwin King

Comments: Accepted by IJCAI 2023; 11 pages, 4 figures, 9 tables; code available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Social and Information Networks (cs.SI)

[210] arXiv:2305.09781 (cross-list from cs.CL) [pdf, html, other]

Title: SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Zhengxin Zhang, Rae Ying Yee Wong, Alan Zhu, Lijie Yang, Xiaoxiang Shi, Chunan Shi, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia

Comments: ASPLOS'24

Subjects: Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[211] arXiv:2305.09856 (cross-list from cs.LG) [pdf, other]

Title: Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clients

Victoria Huang, Shaleeza Sohail, Michael Mayo, Tania Lorido Botran, Mark Rodrigues, Chris Anderson, Melanie Ooi

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[212] arXiv:2305.09864 (cross-list from cs.CL) [pdf, other]

Title: The Jaseci Programming Paradigm and Runtime Stack: Building Scale-out Production Applications Easy and Fast

Jason Mars, Yiping Kang, Roland Daynauth, Baichuan Li, Ashish Mahendra, Krisztian Flautner, Lingjia Tang

Subjects: Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Programming Languages (cs.PL); Software Engineering (cs.SE)

[213] arXiv:2305.09887 (cross-list from cs.LG) [pdf, other]

Title: Simplifying Distributed Neural Network Training on Massive Graphs: Randomized Partitions Improve Model Aggregation

Jiong Zhu, Aishwarya Reganti, Edward Huang, Charles Dickens, Nikhil Rao, Karthik Subbian, Danai Koutra

Comments: 14 pages, 3 figures

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[214] arXiv:2305.10166 (cross-list from physics.comp-ph) [pdf, other]

Title: The Virtual Research Environment: towards a comprehensive analysis platform

Elena Gazzarrini (1), Enrique Garcia (1), Domenic Gosein (1 and 2), Alba Vendrell Moya (1), Agisilaos Kounelis (1 and 3), Xavier Espinal (1) ((1) European Council for Nuclear Research (CERN), 1211 Meyrin, Switzerland, (2) Mannheim University of Applied Sciences, Germany, (3) Computer Engineering and Informatics Department, University of Patras, Greece)

Journal-ref: EPJ Web of Conf., 295 (2024) 08023

Subjects: Computational Physics (physics.comp-ph); Distributed, Parallel, and Cluster Computing (cs.DC); High Energy Physics - Experiment (hep-ex)

[215] arXiv:2305.10184 (cross-list from cs.NI) [pdf, other]

Title: Enhancement and Evaluation of MOXcatter

Yucong Gao

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[216] arXiv:2305.10618 (cross-list from cs.DS) [pdf, other]

Title: Fault-Tolerant Consensus in Quantum Networks

MohammadTaghi Hajiaghayi, Dariusz R. Kowalski, Jan Olkowski

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[217] arXiv:2305.10621 (cross-list from cs.NI) [pdf, other]

Title: TSoR: TCP Socket over RDMA Container Network for Cloud Native Computing

Yulin Sun, Qingming Qu, Chenxingyu Zhao, Arvind Krishnamurthy, Hong Chang, Ying Xiong

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[218] arXiv:2305.10977 (cross-list from cs.NI) [pdf, other]

Title: Multi-microservice migration modelling, comparison, and potential in 5G/6G mobile edge computing: A non-average parameter values approach

Arshin Rezazadeh, Hanan Lutfiyya

Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

[219] arXiv:2305.10997 (cross-list from cs.LG) [pdf, other]

Title: Sharing Lifelong Reinforcement Learning Knowledge via Modulating Masks

Saptarshi Nath, Christos Peridis, Eseoghene Ben-Iwhiwhu, Xinran Liu, Shirin Dora, Cong Liu, Soheil Kolouri, Andrea Soltoggio

Comments: 25 pages, 14 figures, 9 tables, to be published in the Second Conference on Lifelong Learning Agents (CoLLAs 2023), code can be found at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA)

[220] arXiv:2305.11162 (cross-list from cs.DB) [pdf, other]

Title: The Graph Database Interface: Scaling Online Transactional and Analytical Graph Workloads to Hundreds of Thousands of Cores

Maciej Besta, Robert Gerstenberger, Marc Fischer, Michał Podstawski, Nils Blach, Berke Egeli, Georgy Mitenkov, Wojciech Chlapek, Marek Michalewicz, Hubert Niewiadomski, Jürgen Müller, Torsten Hoefler

Comments: Best Paper Finalist at ACM Supercomputing '23 (SC '23)

Journal-ref: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, 2023 (SC '23)

Subjects: Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)

[221] arXiv:2305.11295 (cross-list from cs.MA) [pdf, other]

Title: Collective Reasoning for Safe Autonomous Systems

Selma Saidi (TU Dortmund University, Dortmund, Germany)

Subjects: Multiagent Systems (cs.MA); Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)

[222] arXiv:2305.11420 (cross-list from cs.LG) [pdf, other]

Title: Beyond Exponential Graph: Communication-Efficient Topologies for Decentralized Learning via Finite-time Convergence

Yuki Takezawa, Ryoma Sato, Han Bao, Kenta Niwa, Makoto Yamada

Comments: NeurIPS 2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (stat.ML)

[223] arXiv:2305.11584 (cross-list from cs.LG) [pdf, html, other]

Title: Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape

Yan Sun, Li Shen, Shixiang Chen, Liang Ding, Dacheng Tao

Comments: ICML2023, Oral Presentation

Journal-ref: PMLR 202:32991-33013, 2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[224] arXiv:2305.11639 (cross-list from cs.DS) [pdf, other]

Title: Distributed MIS with Low Energy and Time Complexities

Mohsen Ghaffari, Julian Portmann

Comments: to appear at PODC'23

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[225] arXiv:2305.11644 (cross-list from cs.DS) [pdf, other]

Title: Deterministic Fault-Tolerant Distributed Computing in Linear Time and Communication

Bogdan S. Chlebus, Dariusz R. Kowalski, Jan Olkowski

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[226] arXiv:2305.12019 (cross-list from math.OC) [pdf, other]

Title: A Foray into Parallel Optimisation Algorithms for High Dimension Low Sample Space Generalized Distance Weighted Discrimination problems

Srivathsan Amruth, Xin Yee Lam

Comments: 34 pages. arXiv admin note: substantial text overlap with arXiv:1604.05473

Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC)

[227] arXiv:2305.12114 (cross-list from cs.LG) [pdf, other]

Title: GFDC: A Granule Fusion Density-Based Clustering with Evidential Reasoning

Mingjie Cai, Zhishan Wu, Qingguo Li, Feng Xu, Jie Zhou

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[228] arXiv:2305.12213 (cross-list from cs.LG) [pdf, other]

Title: Taming Resource Heterogeneity In Distributed ML Training With Dynamic Batching

Sahil Tyagi, Prateek Sharma

Journal-ref: https://2020.acsos.org/

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[229] arXiv:2305.12407 (cross-list from cs.LG) [pdf, html, other]

Title: Federated Offline Policy Learning

Aldo Gael Carranza, Susan Athey

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Econometrics (econ.EM); Machine Learning (stat.ML)

[230] arXiv:2305.12699 (cross-list from cs.IT) [pdf, other]

Title: Comments on CausalEC: A Causally Consistent Data Storage Algorithm Based on Cross-Object Erasure Coding

Ramy E. Ali

Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC)

[231] arXiv:2305.12971 (cross-list from cs.NE) [pdf, other]

Title: Neural Cellular Automata Can Respond to Signals

James Stovold

Comments: Accepted to main track at ALIFE 2023

Subjects: Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[232] arXiv:2305.13052 (cross-list from cs.LG) [pdf, other]

Title: Federated Learning of Medical Concepts Embedding using BEHRT

Ofir Ben Shoham, Nadav Rappoport

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[233] arXiv:2305.13259 (cross-list from cs.CR) [pdf, other]

Title: Network Participation and Accessibility of Proof-of-Stake (PoS) Blockchains: A Cross-platform Comparative Analysis

Jiseong Noh, Donghwan Kwon, Soohwan Cho, Neo C.K. Yiu

Comments: 8 pages, 8 tables and 5 figures

Subjects: Cryptography and Security (cs.CR); Computers and Society (cs.CY); Distributed, Parallel, and Cluster Computing (cs.DC)

[234] arXiv:2305.13380 (cross-list from astro-ph.IM) [pdf, html, other]

Title: SWIFT: A modern highly-parallel gravity and smoothed particle hydrodynamics solver for astrophysical and cosmological applications

Matthieu Schaller (1), Josh Borrow, Peter W. Draper, Mladen Ivkovic, Stuart McAlpine, Bert Vandenbroucke, Yannick Bahé, Evgenii Chaikin, Aidan B. G. Chalk, Tsang Keung Chan, Camila Correa, Marcel van Daalen, Willem Elbers, Pedro Gonnet, Loïc Hausammann, John Helly, Filip Huško, Jacob A. Kegerreis, Folkert S. J. Nobels, Sylvia Ploeckinger, Yves Revaz, William J. Roper, Sergio Ruiz-Bonilla, Thomas D. Sandnes, Yolan Uyttenhove, James S. Willis, Zhen Xiang ((1) Lorentz Institute & Leiden Observatory)

Comments: 43 pages, 20 figures, accepted for publication in MNRAS. Code, documentation, and examples available at this http URL

Journal-ref: MNRAS, Volume 530, Issue 2, May 2024, Pages 2378-2419

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Cosmology and Nongalactic Astrophysics (astro-ph.CO); Earth and Planetary Astrophysics (astro-ph.EP); Astrophysics of Galaxies (astro-ph.GA); Distributed, Parallel, and Cluster Computing (cs.DC)

[235] arXiv:2305.13503 (cross-list from cs.LG) [pdf, other]

Title: Asynchronous Multi-Model Dynamic Federated Learning over Wireless Networks: Theory, Modeling, and Optimization

Zhan-Lun Chang, Seyyedali Hosseinalipour, Mung Chiang, Christopher G. Brinton

Comments: Completed the major revision for IEEE Transactions on Cognitive Communications and Networking

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[236] arXiv:2305.13525 (cross-list from cs.LG) [pdf, html, other]

Title: A 4D Hybrid Algorithm to Scale Parallel Training to Thousands of GPUs

Siddharth Singh, Prajwal Singhania, Aditya K. Ranjan, Zack Sating, Abhinav Bhatele

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

[237] arXiv:2305.13672 (cross-list from cs.LG) [pdf, other]

Title: Federated Variational Inference: Towards Improved Personalization and Generalization

Elahe Vedadi, Joshua V. Dillon, Philip Andrew Mansfield, Karan Singhal, Arash Afkanpour, Warren Richard Morningstar

Comments: 16 pages, 6 figures

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[238] arXiv:2305.14300 (cross-list from cs.DS) [pdf, other]

Title: Distributed CONGEST Algorithms against Mobile Adversaries

Orr Fischer, Merav Parter

Comments: Accepted to PODC23

Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)

[239] arXiv:2305.14516 (cross-list from cs.LG) [pdf, other]

Title: Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces

Srinivas Sridharan, Taekyung Heo, Louis Feng, Zhaodong Wang, Matt Bergeron, Wenyin Fu, Shengbao Zheng, Brian Coutinho, Saeed Rashidi, Changhai Man, Tushar Krishna

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[240] arXiv:2305.15092 (cross-list from cs.LG) [pdf, html, other]

Title: FedZero: Leveraging Renewable Excess Energy in Federated Learning

Philipp Wiesner, Ramin Khalili, Dennis Grinwald, Pratik Agrawal, Lauritz Thamsen, Odej Kao

Comments: Accepted for publication at ACM e-Energy '24

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[241] arXiv:2305.15155 (cross-list from cs.LG) [pdf, other]

Title: Momentum Provably Improves Error Feedback!

Ilyas Fatkhullin, Alexander Tyurin, Peter Richtárik

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[242] arXiv:2305.15157 (cross-list from cs.LG) [pdf, other]

Title: Towards More Suitable Personalization in Federated Learning via Decentralized Partial Model Training

Yifan Shi, Yingqi Liu, Yan Sun, Zihao Lin, Li Shen, Xueqian Wang, Dacheng Tao

Comments: 26 pages

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[243] arXiv:2305.15264 (cross-list from math.OC) [pdf, other]

Title: Error Feedback Shines when Features are Rare

Peter Richtárik, Elnur Gasanov, Konstantin Burlachenko

Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Machine Learning (stat.ML)

[244] arXiv:2305.15411 (cross-list from eess.IV) [pdf, other]

Title: Advanced Medical Image Representation for Efficient Processing and Transfer in Multisite Clouds

Elena-Simona Apostol, Ciprian-Octavian Truică

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[245] arXiv:2305.15632 (cross-list from math.PR) [pdf, other]

Title: Discrete Incremental Voting

Colin Cooper, Tomasz Radzik, Takeharu Shiraga

Comments: 27 pages, 2 figures

Subjects: Probability (math.PR); Distributed, Parallel, and Cluster Computing (cs.DC); Discrete Mathematics (cs.DM)

[246] arXiv:2305.15788 (cross-list from cs.SE) [pdf, other]

Title: Service Composition in the ChatGPT Era

Marco Aiello, Ilche Georgievski

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[247] arXiv:2305.15797 (cross-list from cs.MA) [pdf, other]

Title: Distributed Set-membership Filtering Frameworks For Multi-agent Systems With Absolute and Relative Measurements

Yu Ding, Yirui Cong, Xiangke Wang

Comments: 12pages 15figures

Subjects: Multiagent Systems (cs.MA); Distributed, Parallel, and Cluster Computing (cs.DC)

[248] arXiv:2305.16297 (cross-list from cs.LG) [pdf, html, other]

Title: Unbiased Compression Saves Communication in Distributed Optimization: When and How Much?

Yutong He, Xinmeng Huang, Kun Yuan

Comments: Accepted by NeurIPS 2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Optimization and Control (math.OC)

[249] arXiv:2305.16351 (cross-list from cs.LG) [pdf, html, other]

Title: Federated Learning Model Aggregation in Heterogenous Aerial and Space Networks

Fan Dong, Ali Abbasi, Henry Leung, Xin Wang, Jiayu Zhou, Steve Drew

Comments: 6 pages, 7 figures, accepted by IEEE ICC workshop on emerging technologies in aerial and space networks 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)

[250] arXiv:2305.16445 (cross-list from cs.SD) [pdf, other]

Title: SoundSieve: Seconds-Long Audio Event Recognition on Intermittently-Powered Systems

Mahathir Monjur, Yubo Luo, Zhenyu Wang, Shahriar Nirjon

Comments: The 21st ACM International Conference on Mobile Systems, Applications, and Services (Mobisys 2023)

Subjects: Sound (cs.SD); Distributed, Parallel, and Cluster Computing (cs.DC); Audio and Speech Processing (eess.AS)