Machine Learning

Authors and titles for October 2024

[101] arXiv:2410.01276 [pdf, html, other]

Title: Deep Unlearn: Benchmarking Machine Unlearning

Xavier F. Cadet, Anastasia Borovykh, Mohammad Malekzadeh, Sara Ahmadi-Abhari, Hamed Haddadi

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[102] arXiv:2410.01280 [pdf, html, other]

Title: Sparse Autoencoders Reveal Temporal Difference Learning in Large Language Models

Can Demircan, Tankred Saanum, Akshay K. Jagadish, Marcel Binz, Eric Schulz

Subjects: Machine Learning (cs.LG)

[103] arXiv:2410.01296 [pdf, html, other]

Title: Speculative Coreset Selection for Task-Specific Fine-tuning

Xiaoyu Zhang, Juan Zhai, Shiqing Ma, Chao Shen, Tianlin Li, Weipeng Jiang, Yang Liu

Comments: 20 pages, 4 figures, 14 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[104] arXiv:2410.01308 [pdf, html, other]

Title: Rethinking GNN Expressive Power Research in the Machine Learning Community: Limitations, Issues, and Corrections

Guanyu Cui, Zhewei Wei, Hsin-Hao Su

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[105] arXiv:2410.01312 [pdf, html, other]

Title: Sampling from Energy-based Policies using Diffusion

Vineet Jain, Tara Akhound-Sadegh, Siamak Ravanbakhsh

Subjects: Machine Learning (cs.LG)

[106] arXiv:2410.01322 [pdf, html, other]

Title: Forte : Finding Outliers with Representation Typicality Estimation

Debargha Ganguly, Warren Morningstar, Andrew Yu, Vipin Chaudhary

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

[107] arXiv:2410.01324 [pdf, html, other]

Title: Fair Class-Incremental Learning using Sample Weighting

Jaeyoung Park, Minsu Kim, Steven Euijong Whang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[108] arXiv:2410.01331 [pdf, html, other]

Title: Efficient Learning of POMDPs with Known Observation Model in Average-Reward Setting

Alessio Russo, Alberto Maria Metelli, Marcello Restelli

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[109] arXiv:2410.01337 [pdf, html, other]

Title: PhyMPGN: Physics-encoded Message Passing Graph Network for spatiotemporal PDE systems

Bocheng Zeng, Qi Wang, Mengtao Yan, Yang Liu, Ruizhi Chengze, Yi Zhang, Hongsheng Liu, Zidong Wang, Hao Sun

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE)

[110] arXiv:2410.01359 [pdf, html, other]

Title: FlashMask: Efficient and Rich Mask Extension of FlashAttention

Guoxia Wang, Jinle Zeng, Xiyuan Xiao, Siming Wu, Jiabin Yang, Lujing Zheng, Zeyu Chen, Jiang Bian, Dianhai Yu, Haifeng Wang

Comments: Published as a conference paper at ICLR 2025

Subjects: Machine Learning (cs.LG)

[111] arXiv:2410.01367 [pdf, other]

Title: Towards Dynamic Graph Neural Networks with Provably High-Order Expressive Power

Zhe Wang, Tianjian Zhao, Zhen Zhang, Jiawei Chen, Sheng Zhou, Yan Feng, Chun Chen, Can Wang

Subjects: Machine Learning (cs.LG)

[112] arXiv:2410.01386 [pdf, html, other]

Title: FLAME: Adaptive and Reactive Concept Drift Mitigation for Federated Learning Deployments

Ioannis Mavromatis, Stefano De Feo, Aftab Khan

Comments: Accepted for Publication at ACM EWSN 2024 - EMERGE Workshop

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[113] arXiv:2410.01392 [pdf, other]

Title: Causal Inference Tools for a Better Evaluation of Machine Learning

Michaël Soumm

Subjects: Machine Learning (cs.LG)

[114] arXiv:2410.01394 [pdf, html, other]

Title: Gaussian kernel expansion with basis functions uniformly bounded in $\mathcal{L}_{\infty}$

Mauro Bisiacco, Gianluigi Pillonetto

Subjects: Machine Learning (cs.LG)

[115] arXiv:2410.01405 [pdf, html, other]

Title: On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding

Kevin Xu, Issei Sato

Subjects: Machine Learning (cs.LG)

[116] arXiv:2410.01423 [pdf, html, other]

Title: Fair4Free: Generating High-fidelity Fair Synthetic Samples using Data Free Distillation

Md Fahim Sikder, Daniel de Leng, Fredrik Heintz

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[117] arXiv:2410.01431 [pdf, html, other]

Title: Scalable Reinforcement Learning-based Neural Architecture Search

Amber Cassimon, Siegfried Mercelis, Kevin Mets

Comments: 33 Pages, 19 Figures

Subjects: Machine Learning (cs.LG)

[118] arXiv:2410.01432 [pdf, other]

Title: Adaptive teachers for amortized samplers

Minsu Kim, Sanghyeok Choi, Taeyoung Yun, Emmanuel Bengio, Leo Feng, Jarrid Rector-Brooks, Sungsoo Ahn, Jinkyoo Park, Nikolay Malkin, Yoshua Bengio

Comments: ICLR 2025, 27 pages, 12 figures

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[119] arXiv:2410.01434 [pdf, other]

Title: Circuit Compositions: Exploring Modular Structures in Transformer-Based Language Models

Philipp Mondorf, Sondre Wold, Barbara Plank

Comments: 22 pages, 21 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[120] arXiv:2410.01438 [pdf, html, other]

Title: The Great Contradiction Showdown: How Jailbreak and Stealth Wrestle in Vision-Language Models?

Ching-Chia Kao, Chia-Mu Yu, Chun-Shien Lu, Chu-Song Chen

Subjects: Machine Learning (cs.LG)

[121] arXiv:2410.01452 [pdf, html, other]

Title: Ensembles provably learn equivariance through data augmentation

Oskar Nordenfors, Axel Flinth

Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA)

[122] arXiv:2410.01457 [pdf, html, other]

Title: Verbalized Graph Representation Learning: A Fully Interpretable Graph Model Based on Large Language Models Throughout the Entire Process

Xingyu Ji, Jiale Liu, Lu Li, Maojun Wang, Zeyu Zhang

Comments: under review. corresponding author: Zeyu Zhang

Subjects: Machine Learning (cs.LG)

[123] arXiv:2410.01463 [pdf, html, other]

Title: Selective Aggregation for Low-Rank Adaptation in Federated Learning

Pengxin Guo, Shuang Zeng, Yanran Wang, Huijie Fan, Feifei Wang, Liangqiong Qu

Comments: Accepted at ICLR 2025

Subjects: Machine Learning (cs.LG)

[124] arXiv:2410.01476 [pdf, html, other]

Title: Reducing Variance in Meta-Learning via Laplace Approximation for Regression Tasks

Alfredo Reichlin, Gustaf Tegnér, Miguel Vasco, Hang Yin, Mårten Björkman, Danica Kragic

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[125] arXiv:2410.01483 [pdf, html, other]

Title: Foldable SuperNets: Scalable Merging of Transformers with Different Initializations and Tasks

Edan Kinderman, Itay Hubara, Haggai Maron, Daniel Soudry

Subjects: Machine Learning (cs.LG)