Machine Learning

Authors and titles for March 2024

[51] arXiv:2403.00745 [pdf, html, other]

Title: AtP*: An efficient and scalable method for localizing LLM behaviour to components

János Kramár, Tom Lieberum, Rohin Shah, Neel Nanda (Google DeepMind)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[52] arXiv:2403.00773 [pdf, html, other]

Title: Misconduct in Post-Selections and Deep Learning

Juyang Weng

Comments: 9 pages, 2 figures, published in peer-viewed conference proceedings, Proc. 2023 the 8th International Conf. on Control, Robotics and Cybernetics (CRC 2023), pp. 1-9, IEEE Press, ISBN: 979-8-3503-3057-1, Changsha, China, Dec. 22-24, 2023

Subjects: Machine Learning (cs.LG)

[53] arXiv:2403.00780 [pdf, other]

Title: Empirical and Experimental Insights into Data Mining Techniques for Crime Prediction: A Comprehensive Survey

Kamal Taha

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[54] arXiv:2403.00853 [pdf, html, other]

Title: Parallel Momentum Methods Under Biased Gradient Estimations

Ali Beikmohammadi, Sarit Khirirat, Sindri Magnússon

Comments: 12 pages

Subjects: Machine Learning (cs.LG)

[55] arXiv:2403.00858 [pdf, html, other]

Title: Direct Alignment of Draft Model for Speculative Decoding with Chat-Fine-Tuned LLMs

Raghavv Goel, Mukul Gagrani, Wonseok Jeon, Junyoung Park, Mingu Lee, Christopher Lott

Comments: 8 pages, 3 figures, Published at the ICLR 2024 Workshop on Understanding of Foundation Models (ME-FoMo)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[56] arXiv:2403.00860 [pdf, html, other]

Title: Parallel Algorithms for Exact Enumeration of Deep Neural Network Activation Regions

Sabrina Drammis, Bowen Zheng, Karthik Srinivasan, Robert C. Berwick, Nancy A. Lynch, Robert Ajemian

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

[57] arXiv:2403.00869 [pdf, html, other]

Title: Enhancing Multivariate Time Series Forecasting with Mutual Information-driven Cross-Variable and Temporal Modeling

Shiyi Qi, Liangjian Wen, Yiduo Li, Yuanhang Yang, Zhe Li, Zhongwen Rao, Lujia Pan, Zenglin Xu

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[58] arXiv:2403.00877 [pdf, html, other]

Title: Disaggregated Multi-Tower: Topology-aware Modeling Technique for Efficient Large-Scale Recommendation

Liang Luo, Buyun Zhang, Michael Tsang, Yinbin Ma, Ching-Hsiang Chu, Yuxin Chen, Shen Li, Yuchen Hao, Yanli Zhao, Guna Lakshminarayanan, Ellie Dingqiao Wen, Jongsoo Park, Dheevatsa Mudigere, Maxim Naumov

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR)

[59] arXiv:2403.00881 [pdf, html, other]

Title: FedRDMA: Communication-Efficient Cross-Silo Federated LLM via Chunked RDMA Transmission

Zeling Zhang, Dongqi Cai, Yiran Zhang, Mengwei Xu, Shangguang Wang, Ao Zhou

Comments: under review

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)

[60] arXiv:2403.00886 [pdf, html, other]

Title: Evaluating and Correcting Performative Effects of Decision Support Systems via Causal Domain Shift

Philip Boeken, Onno Zoeter, Joris M. Mooij

Comments: Accepted at CLeaR 2024

Journal-ref: Proceedings of the Third Conference on Causal Learning and Reasoning, PMLR 236:551-569, 2024

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST)

[61] arXiv:2403.00891 [pdf, html, other]

Title: A Regularization-based Transfer Learning Method for Information Extraction via Instructed Graph Decoder

Kedi Chen, Jie Zhou, Qin Chen, Shunyu Liu, Liang He

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[62] arXiv:2403.00930 [pdf, other]

Title: Scale-free Adversarial Reinforcement Learning

Mingyu Chen, Xuezhou Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[63] arXiv:2403.00932 [pdf, html, other]

Title: Differentially Private Knowledge Distillation via Synthetic Text Generation

James Flemings, Murali Annavaram

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[64] arXiv:2403.00942 [pdf, html, other]

Title: Resilience of Entropy Model in Distributed Neural Networks

Milin Zhang, Mohammad Abdi, Shahriar Rifat, Francesco Restuccia

Comments: accepted at ECCV 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)

[65] arXiv:2403.00946 [pdf, html, other]

Title: Fine-tuning with Very Large Dropout

Jianyu Zhang, Léon Bottou

Comments: Fine-tuning with very large dropout outperforms weight-averaging and ensemble on ResNet and large vision transformer

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[66] arXiv:2403.00963 [pdf, html, other]

Title: Tree-Regularized Tabular Embeddings

Xuan Li, Yun Wang, Bo Li

Comments: Table Representation Learning Workshop at NeurIPS 2023

Subjects: Machine Learning (cs.LG)

[67] arXiv:2403.00974 [pdf, html, other]

Title: Motif distribution and function of sparse deep neural networks

Olivia T. Zahn, Thomas L. Daniel, J. Nathan Kutz

Subjects: Machine Learning (cs.LG)

[68] arXiv:2403.00975 [pdf, html, other]

Title: Equipment Health Assessment: Time Series Analysis for Wind Turbine Performance

Jana Backhus, Aniruddha Rajendra Rao, Chandrasekar Venkatraman, Abhishek Padmanabhan, A.Vinoth Kumar, Chetan Gupta

Comments: 19 Pages, 17 Figures, 3 Tables, Submitted at Applied Sciences (MDPI)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Functional Analysis (math.FA); Applications (stat.AP)

[69] arXiv:2403.00993 [pdf, other]

Title: On the Role of Information Structure in Reinforcement Learning for Partially-Observable Sequential Teams and Games

Awni Altabaa, Zhuoran Yang

Comments: 59 pages, 5 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[70] arXiv:2403.00999 [pdf, html, other]

Title: Distributional Dataset Distillation with Subtask Decomposition

Tian Qin, Zhiwei Deng, David Alvarez-Melis

Subjects: Machine Learning (cs.LG)

[71] arXiv:2403.01014 [pdf, html, other]

Title: A Case for Validation Buffer in Pessimistic Actor-Critic

Michal Nauman, Mateusz Ostaszewski, Marek Cygan

Comments: Preprint

Subjects: Machine Learning (cs.LG)

[72] arXiv:2403.01046 [pdf, other]

Title: A Library of Mirrors: Deep Neural Nets in Low Dimensions are Convex Lasso Models with Reflection Features

Emi Zeger, Yifei Wang, Aaron Mishkin, Tolga Ergen, Emmanuel Candès, Mert Pilanci

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Optimization and Control (math.OC); Machine Learning (stat.ML)

[73] arXiv:2403.01053 [pdf, html, other]

Title: Seeing Unseen: Discover Novel Biomedical Concepts via Geometry-Constrained Probabilistic Modeling

Jianan Fan, Dongnan Liu, Hang Chang, Heng Huang, Mei Chen, Weidong Cai

Comments: CVPR 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[74] arXiv:2403.01059 [pdf, html, other]

Title: Continuous Mean-Zero Disagreement-Regularized Imitation Learning (CMZ-DRIL)

Noah Ford, Ryan W. Gardner, Austin Juhl, Nathan Larson

Subjects: Machine Learning (cs.LG)

[75] arXiv:2403.01071 [pdf, html, other]

Title: GraphRCG: Self-Conditioned Graph Generation

Song Wang, Zhen Tan, Xinyu Zhao, Tianlong Chen, Huan Liu, Jundong Li

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)