Computation and Language

Authors and titles for May 2024

[1566] arXiv:2405.20541 (cross-list from cs.LG) [pdf, html, other]

Title: Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models

Zachary Ankner, Cody Blakeney, Kartik Sreenivasan, Max Marion, Matthew L. Leavitt, Mansheej Paul

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1567] arXiv:2405.20602 (cross-list from cs.LG) [pdf, html, other]

Title: Masked Language Modeling Becomes Conditional Density Estimation for Tabular Data Synthesis

Seunghwan An, Gyeongdong Woo, Jaesung Lim, ChangHyun Kim, Sungchul Hong, Jong-June Jeon

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1568] arXiv:2405.20611 (cross-list from cs.CR) [pdf, other]

Title: Bi-Directional Transformers vs. word2vec: Discovering Vulnerabilities in Lifted Compiled Code

Gary A. McCully, John D. Hastings, Shengjie Xu, Adam Fortier

Comments: Updated with improvements

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG); Software Engineering (cs.SE)

[1569] arXiv:2405.20628 (cross-list from cs.AI) [pdf, html, other]

Title: ToxVidLM: A Multimodal Framework for Toxicity Detection in Code-Mixed Videos

Krishanu Maity, A.S. Poornash, Sriparna Saha, Pushpak Bhattacharyya

Comments: Accepted as a Long Paper in ACL Findings 2024. For acceptance details, see this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1570] arXiv:2405.20646 (cross-list from cs.IR) [pdf, other]

Title: LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation

Qidong Liu, Xian Wu, Yejing Wang, Zijian Zhang, Feng Tian, Yefeng Zheng, Xiangyu Zhao

Comments: accepted by NeruIPS'24 (Spotlight)

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1571] arXiv:2405.20648 (cross-list from cs.CV) [pdf, html, other]

Title: Shotluck Holmes: A Family of Efficient Small-Scale Large Language Vision Models For Video Captioning and Summarization

Richard Luo, Austin Peng, Adithya Vasudev, Rishabh Jain

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1572] arXiv:2405.20671 (cross-list from cs.LG) [pdf, html, other]

Title: Position Coupling: Improving Length Generalization of Arithmetic Transformers Using Task Structure

Hanseul Cho, Jaeyoung Cha, Pranjal Awasthi, Srinadh Bhojanapalli, Anupam Gupta, Chulhee Yun

Comments: Accepted to NeurIPS 2024. 76 pages. 23 figures. 90 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1573] arXiv:2405.20680 (cross-list from cs.AI) [pdf, other]

Title: Unraveling and Mitigating Retriever Inconsistencies in Retrieval-Augmented Large Language Models

Mingda Li, Xinyu Li, Yifan Chen, Wenfeng Xuan, Weinan Zhang

Comments: ACL 2024 (findings)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1574] arXiv:2405.20684 (cross-list from cs.SE) [pdf, html, other]

Title: Joint Embeddings for Graph Instruction Tuning

Aaron Haag, Vlad Argatu, Oliver Lohse

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1575] arXiv:2405.20775 (cross-list from cs.CR) [pdf, html, other]

Title: Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

Xijie Huang, Xinyuan Wang, Hantao Zhang, Yinghao Zhu, Jiawen Xi, Jingkun An, Hao Wang, Hao Liang, Chengwei Pan

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1576] arXiv:2405.20797 (cross-list from cs.CV) [pdf, html, other]

Title: Ovis: Structural Embedding Alignment for Multimodal Large Language Model

Shiyin Lu, Yang Li, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, Han-Jia Ye

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1577] arXiv:2405.20835 (cross-list from cs.LG) [pdf, html, other]

Title: Outliers and Calibration Sets have Diminishing Effect on Quantization of Modern LLMs

Davide Paglieri, Saurabh Dash, Tim Rocktäschel, Jack Parker-Holder

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1578] arXiv:2405.20906 (cross-list from cs.CV) [pdf, other]

Title: Enhancing Vision Models for Text-Heavy Content Understanding and Interaction

Adithya TG, Adithya SK, Abhinav R Bharadwaj, Abhiram HA, Surabhi Narayan

Comments: 5 pages, 4 figures (including 1 graph)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1579] arXiv:2405.20956 (cross-list from cs.AI) [pdf, html, other]

Title: A Robot Walks into a Bar: Can Language Models Serve as Creativity Support Tools for Comedy? An Evaluation of LLMs' Humour Alignment with Comedians

Piotr Wojciech Mirowski, Juliette Love, Kory W. Mathewson, Shakir Mohamed

Comments: 15 pages, 1 figure, published at ACM FAccT 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1580] arXiv:2405.20962 (cross-list from cs.CY) [pdf, html, other]

Title: Large Language Models are Zero-Shot Next Location Predictors

Ciro Beneduce, Bruno Lepri, Massimiliano Luca

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1581] arXiv:2405.20973 (cross-list from cs.LG) [pdf, html, other]

Title: LCQ: Low-Rank Codebook based Quantization for Large Language Models

Wen-Pu Cai, Wu-Jun Li

Comments: 10 pages, 5 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1582] arXiv:2405.20994 (cross-list from cs.IR) [pdf, html, other]

Title: CWRCzech: 100M Query-Document Czech Click Dataset and Its Application to Web Relevance Ranking

Josef Vonášek, Milan Straka, Rostislav Krč, Lenka Lasoňová, Ekaterina Egorova, Jana Straková, Jakub Náplava

Comments: Accepted to SIGIR 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1583] arXiv:2405.20999 (cross-list from math.DS) [pdf, html, other]

Title: Towards a Fluid computer

Robert Cardona, Eva Miranda, Daniel Peralta-Salas

Comments: 11 pages, 3 figures

Subjects: Dynamical Systems (math.DS); Computation and Language (cs.CL); Analysis of PDEs (math.AP); Symplectic Geometry (math.SG)

[1584] arXiv:2405.21018 (cross-list from cs.LG) [pdf, html, other]

Title: Improved Techniques for Optimization-Based Jailbreaking on Large Language Models

Xiaojun Jia, Tianyu Pang, Chao Du, Yihao Huang, Jindong Gu, Yang Liu, Xiaochun Cao, Min Lin

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1585] arXiv:2405.21046 (cross-list from cs.LG) [pdf, html, other]

Title: Exploratory Preference Optimization: Harnessing Implicit Q*-Approximation for Sample-Efficient RLHF

Tengyang Xie, Dylan J. Foster, Akshay Krishnamurthy, Corby Rosset, Ahmed Awadallah, Alexander Rakhlin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1586] arXiv:2405.21047 (cross-list from cs.AI) [pdf, html, other]

Title: Grammar-Aligned Decoding

Kanghee Park, Jiayu Wang, Taylor Berg-Kirkpatrick, Nadia Polikarpova, Loris D'Antoni

Comments: Accepted to NeurIPS 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1587] arXiv:2405.21070 (cross-list from cs.CV) [pdf, html, other]

Title: What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights

Xin Wen, Bingchen Zhao, Yilun Chen, Jiangmiao Pang, Xiaojuan Qi

Comments: Accepted at NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1588] arXiv:2405.21075 (cross-list from cs.CV) [pdf, html, other]

Title: Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

Chaoyou Fu, Yuhan Dai, Yongdong Luo, Lei Li, Shuhuai Ren, Renrui Zhang, Zihan Wang, Chenyu Zhou, Yunhang Shen, Mengdan Zhang, Peixian Chen, Yanwei Li, Shaohui Lin, Sirui Zhao, Ke Li, Tong Xu, Xiawu Zheng, Enhong Chen, Rongrong Ji, Xing Sun

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)