Computation and Language

Authors and titles for June 2024

[2251] arXiv:2406.14492 (cross-list from cs.CV) [pdf, html, other]

Title: Does Object Grounding Really Reduce Hallucination of Large Vision-Language Models?

Gregor Geigle, Radu Timofte, Goran Glavaš

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2252] arXiv:2406.14496 (cross-list from cs.CV) [pdf, html, other]

Title: African or European Swallow? Benchmarking Large Vision-Language Models for Fine-Grained Object Classification

Gregor Geigle, Radu Timofte, Goran Glavaš

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2253] arXiv:2406.14497 (cross-list from cs.SE) [pdf, html, other]

Title: CodeRAG-Bench: Can Retrieval Augment Code Generation?

Zora Zhiruo Wang, Akari Asai, Xinyan Velocity Yu, Frank F. Xu, Yiqing Xie, Graham Neubig, Daniel Fried

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2254] arXiv:2406.14517 (cross-list from cs.LG) [pdf, html, other]

Title: PostMark: A Robust Blackbox Watermark for Large Language Models

Yapei Chang, Kalpesh Krishna, Amir Houmansadr, John Wieting, Mohit Iyyer

Comments: EMNLP 2024; 19 pages, 5 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[2255] arXiv:2406.14522 (cross-list from physics.soc-ph) [pdf, html, other]

Title: Learning thresholds lead to stable language coexistence

Mikhail V. Tamm, Els Heinsalu, Stefano Scialla, Marco Patriarca

Comments: 15 pages, 6 figures and 1 table

Subjects: Physics and Society (physics.soc-ph); Computation and Language (cs.CL)

[2256] arXiv:2406.14532 (cross-list from cs.LG) [pdf, html, other]

Title: RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold

Amrith Setlur, Saurabh Garg, Xinyang Geng, Naman Garg, Virginia Smith, Aviral Kumar

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2257] arXiv:2406.14544 (cross-list from cs.CV) [pdf, html, other]

Title: Prism: A Framework for Decoupling and Assessing the Capabilities of VLMs

Yuxuan Qiao, Haodong Duan, Xinyu Fang, Junming Yang, Lin Chen, Songyang Zhang, Jiaqi Wang, Dahua Lin, Kai Chen

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2258] arXiv:2406.14643 (cross-list from cs.CV) [pdf, html, other]

Title: Holistic Evaluation for Interleaved Text-and-Image Generation

Minqian Liu, Zhiyang Xu, Zihao Lin, Trevor Ashby, Joy Rimchala, Jiaxin Zhang, Lifu Huang

Comments: EMNLP 2024 Main Conference. 15 pages, 6 figures, 7 tables. Website: this https URL. Dataset: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2259] arXiv:2406.14683 (cross-list from cs.LG) [pdf, other]

Title: TAGLAS: An atlas of text-attributed graph datasets in the era of large graph and language models

Jiarui Feng, Hao Liu, Lecheng Kong, Mingfang Zhu, Yixin Chen, Muhan Zhang

Comments: Preprint

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2260] arXiv:2406.14701 (cross-list from cs.AI) [pdf, html, other]

Title: Speech Prefix-Tuning with RNNT Loss for Improving LLM Predictions

Murali Karthick Baskar, Andrew Rosenberg, Bhuvana Ramabhadran, Neeraj Gaur, Zhong Meng

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[2261] arXiv:2406.14764 (cross-list from cs.IR) [pdf, html, other]

Title: RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation

William Fleshman, Benjamin Van Durme

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2262] arXiv:2406.14765 (cross-list from cs.AI) [pdf, html, other]

Title: ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictor

Steven A. Lehr, Aylin Caliskan, Suneragiri Liyanage, Mahzarin R. Banaji

Comments: Main article is 14 pages, 1 table. Includes SI Appendix: 26 pages, 12 tables, 2 figures. Total: 40 pages, 13 tables, 2 figures. Under revised review at PNAS

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[2263] arXiv:2406.14774 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating Numerical Reasoning in Text-to-Image Models

Ivana Kajić, Olivia Wiles, Isabela Albuquerque, Matthias Bauer, Su Wang, Jordi Pont-Tuset, Aida Nematzadeh

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2264] arXiv:2406.14783 (cross-list from cs.IR) [pdf, html, other]

Title: Evaluating RAG-Fusion with RAGElo: an Automated Elo-based Framework

Zackary Rackauckas, Arthur Câmara, Jakub Zavrel

Comments: Accepted to LLM4Eval @ SIGIR24

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2265] arXiv:2406.14862 (cross-list from cs.LG) [pdf, html, other]

Title: LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multi-modal Foundation Models

Mengdan Zhu, Raasikh Kanjiani, Jiahui Lu, Andrew Choi, Qirui Ye, Liang Zhao

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2266] arXiv:2406.14867 (cross-list from cs.LG) [pdf, other]

Title: Investigating the Transferability of Code Repair for Low-Resource Programming Languages

Kyle Wong, Alfonso Amayuelas, Liangming Pan, William Yang Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2267] arXiv:2406.14898 (cross-list from cs.CR) [pdf, html, other]

Title: Safely Learning with Private Data: A Federated Learning Framework for Large Language Model

JiaYing Zheng, HaiNan Zhang, LingXiang Wang, WangJie Qiu, HongWei Zheng, ZhiMing Zheng

Comments: EMNLP 2024

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[2268] arXiv:2406.14909 (cross-list from cs.LG) [pdf, html, other]

Title: MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression

Tianyu Fu, Haofeng Huang, Xuefei Ning, Genghan Zhang, Boju Chen, Tianqi Wu, Hongyi Wang, Zixiao Huang, Shiyao Li, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2269] arXiv:2406.14917 (cross-list from cs.AI) [pdf, html, other]

Title: LLM2FEA: Discover Novel Designs with Generative Evolutionary Multitasking

Melvin Wong, Jiao Liu, Thiago Rios, Stefan Menzel, Yew Soon Ong

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[2270] arXiv:2406.14928 (cross-list from cs.AI) [pdf, html, other]

Title: Autonomous Agents for Collaborative Task under Information Asymmetry

Wei Liu, Chenxi Wang, Yifei Wang, Zihao Xie, Rennai Qiu, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, Chen Qian

Comments: 32 pages, 12 figures, 6 tables, accepted by NeurIPS 2024, see detail at this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA); Social and Information Networks (cs.SI)

[2271] arXiv:2406.14956 (cross-list from cs.LG) [pdf, html, other]

Title: Unlocking the Global Synergies in Low-Rank Adapters

Zixi Zhang, Cheng Zhang, Xitong Gao, Robert D. Mullins, George A. Constantinides, Yiren Zhao

Comments: Accepted at ICML2024 ES-FoMo-II Workshop

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2272] arXiv:2406.14986 (cross-list from cs.AI) [pdf, html, other]

Title: Do Large Language Models Exhibit Cognitive Dissonance? Studying the Difference Between Revealed Beliefs and Stated Answers

Manuel Mondal, Ljiljana Dolamic, Gérôme Bovet, Philippe Cudré-Mauroux, Julien Audiffren

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2273] arXiv:2406.14993 (cross-list from cs.CV) [pdf, other]

Title: Disability Representations: Finding Biases in Automatic Image Generation

Yannis Tevissen

Comments: Presented at AVA Workshop of CVPR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2274] arXiv:2406.15015 (cross-list from cs.DB) [pdf, html, other]

Title: GraLMatch: Matching Groups of Entities with Graphs and Language Models

Fernando De Meer Pardo, Claude Lehmann, Dennis Gehrig, Andrea Nagy, Stefano Nicoli, Branka Hadji Misheva, Martin Braschler, Kurt Stockinger

Comments: 12 pages, 4 figures, accepted as research paper at EDBT 2025

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2275] arXiv:2406.15038 (cross-list from cs.LG) [pdf, html, other]

Title: Online detection and infographic explanation of spam reviews with data drift adaptation

Francisco de Arriba-Pérez, Silvia García-Méndez, Fátima Leal, Benedita Malheiro, J. C. Burguillo

Journal-ref: Francisco de Arriba-P\'erez, Silvia Garc\'ia-M\'endez, F\'atima Leal, Benedita Malheiro, Juan C. Burguillo, Online Detection and Infographic Explanation of Spam Reviews with Data Drift Adaptation, Informatica(2024), 1-25

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[2276] arXiv:2406.15050 (cross-list from cs.LG) [pdf, html, other]

Title: Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis

Lin Fan, Xun Gong, Cenyang Zheng, Yafei Ou

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2277] arXiv:2406.15111 (cross-list from cs.AI) [pdf, html, other]

Title: Investigating the impact of 2D gesture representation on co-speech gesture generation

Teo Guichoux, Laure Soulier, Nicolas Obin, Catherine Pelachaud

Comments: 8 pages. Paper accepted at WACAI 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2278] arXiv:2406.15264 (cross-list from cs.IR) [pdf, html, other]

Title: Towards Fine-Grained Citation Evaluation in Generated Text: A Comparative Analysis of Faithfulness Metrics

Weijia Zhang, Mohammad Aliannejadi, Yifei Yuan, Jiahuan Pei, Jia-Hong Huang, Evangelos Kanoulas

Comments: Accepted by the 17th International Natural Language Generation Conference (INLG 2024) as an oral presentation

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2279] arXiv:2406.15279 (cross-list from cs.AI) [pdf, other]

Title: Cross-Modality Safety Alignment

Siyin Wang, Xingsong Ye, Qinyuan Cheng, Junwen Duan, Shimin Li, Jinlan Fu, Xipeng Qiu, Xuanjing Huang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2280] arXiv:2406.15306 (cross-list from cs.LG) [pdf, other]

Title: Advanced Multimodal Deep Learning Architecture for Image-Text Matching

Jinyin Wang, Haijing Zhang, Yihao Zhong, Yingbin Liang, Rongwei Ji, Yiru Cang

Comments: arXiv admin note: text overlap with arXiv:2405.17460 by other authors

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2281] arXiv:2406.15313 (cross-list from cs.IR) [pdf, html, other]

Title: STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionals

Weihang Su, Yiran Hu, Anzhe Xie, Qingyao Ai, Zibing Que, Ning Zheng, Yun Liu, Weixing Shen, Yiqun Liu

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2282] arXiv:2406.15330 (cross-list from cs.AI) [pdf, html, other]

Title: Gradient-Mask Tuning Elevates the Upper Limits of LLM Performance

Haoling Li, Xin Zhang, Xiao Liu, Yeyun Gong, Yifan Wang, Yujiu Yang, Qi Chen, Peng Cheng

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2283] arXiv:2406.15334 (cross-list from cs.CV) [pdf, html, other]

Title: Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learning

Brandon Huang, Chancharik Mitra, Assaf Arbelle, Leonid Karlinsky, Trevor Darrell, Roei Herzig

Comments: Published in NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2284] arXiv:2406.15474 (cross-list from cs.AI) [pdf, html, other]

Title: WundtGPT: Shaping Large Language Models To Be An Empathetic, Proactive Psychologist

Chenyu Ren, Yazhou Zhang, Daihai He, Jing Qin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[2285] arXiv:2406.15481 (cross-list from cs.AI) [pdf, other]

Title: Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understanding

Haneul Yoo, Yongjin Yang, Hwaran Lee

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2286] arXiv:2406.15513 (cross-list from cs.AI) [pdf, html, other]

Title: PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference

Jiaming Ji, Donghai Hong, Borong Zhang, Boyuan Chen, Josef Dai, Boren Zheng, Tianyi Qiu, Boxun Li, Yaodong Yang

Comments: a sibling project to SafeRLHF and BeaverTails

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2287] arXiv:2406.15527 (cross-list from cs.LG) [pdf, html, other]

Title: Data Efficient Evaluation of Large Language Models and Text-to-Image Models via Adaptive Sampling

Cong Xu, Gayathri Saranathan, Mahammad Parwez Alam, Arpit Shah, James Lim, Soon Yee Wong, Foltin Martin, Suparna Bhattacharya

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2288] arXiv:2406.15534 (cross-list from cs.LG) [pdf, html, other]

Title: Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research

Tianyu Liu, Yijia Xiao, Xiao Luo, Hua Xu, W. Jim Zheng, Hongyu Zhao

Comments: 8 pages

Journal-ref: EMNLP 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Quantitative Methods (q-bio.QM)

[2289] arXiv:2406.15567 (cross-list from cs.LG) [pdf, html, other]

Title: SAIL: Self-Improving Efficient Online Alignment of Large Language Models

Mucong Ding, Souradip Chakraborty, Vibhu Agrawal, Zora Che, Alec Koppel, Mengdi Wang, Amrit Bedi, Furong Huang

Comments: 24 pages, 6 figures, 3 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2290] arXiv:2406.15736 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads

Anoop Cherian, Kuan-Chuan Peng, Suhas Lohit, Joanna Matthiesen, Kevin Smith, Joshua B. Tenenbaum

Comments: Accepted at NeurIPS 2024 (Datasets and Benchmarks Track)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2291] arXiv:2406.15752 (cross-list from eess.AS) [pdf, html, other]

Title: TacoLM: GaTed Attention Equipped Codec Language Model are Efficient Zero-Shot Text to Speech Synthesizers

Yakun Song, Zhuo Chen, Xiaofei Wang, Ziyang Ma, Guanrou Yang, Xie Chen

Comments: INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2292] arXiv:2406.15754 (cross-list from cs.CV) [pdf, html, other]

Title: Multimodal Segmentation for Vocal Tract Modeling

Rishi Jain, Bohan Yu, Peter Wu, Tejas Prabhune, Gopala Anumanchipalli

Comments: Interspeech 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[2293] arXiv:2406.15765 (cross-list from cs.LG) [pdf, html, other]

Title: Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration

Zhongzhi Yu, Zheng Wang, Yonggan Fu, Huihong Shi, Khalid Shaikh, Yingyan Celine Lin

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2294] arXiv:2406.15786 (cross-list from cs.LG) [pdf, html, other]

Title: What Matters in Transformers? Not All Attention is Needed

Shwai He, Guoheng Sun, Zheyu Shen, Ang Li

Comments: 15 pages, 13 figures, 6 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2295] arXiv:2406.15812 (cross-list from cs.LG) [pdf, html, other]

Title: Intrinsic Dimension Correlation: uncovering nonlinear connections in multimodal representations

Lorenzo Basile, Santiago Acevedo, Luca Bortolussi, Fabio Anselmi, Alex Rodriguez

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2296] arXiv:2406.15877 (cross-list from cs.SE) [pdf, html, other]

Title: BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, Thong Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Zhihan Zhang, Prateek Yadav, Naman Jain, Alex Gu, Zhoujun Cheng, Jiawei Liu, Qian Liu, Zijian Wang, David Lo, Binyuan Hui, Niklas Muennighoff, Daniel Fried, Xiaoning Du, Harm de Vries, Leandro Von Werra

Comments: 44 pages, 14 figures, 7 tables, built with love by the BigCode community :)

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2297] arXiv:2406.15890 (cross-list from cs.LG) [pdf, html, other]

Title: Language Alignment via Nash-learning and Adaptive feedback

Ari Azarafrooz, Farshid Faal

Comments: Accepted at ICML 2024 Workshop on Models of Human Feedback for AI Alignment, Vienna, Austria

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT)

[2298] arXiv:2406.15940 (cross-list from cs.LG) [pdf, html, other]

Title: Beyond Individual Facts: Investigating Categorical Knowledge Locality of Taxonomy and Meronomy Concepts in GPT Models

Christopher Burger, Yifan Hu, Thai Le

Comments: 27 pages, 23 figures, 12 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2299] arXiv:2406.15963 (cross-list from cs.HC) [pdf, html, other]

Title: Effectiveness of ChatGPT in explaining complex medical reports to patients

Mengxuan Sun, Ehud Reiter, Anne E Kiltie, George Ramsay, Lisa Duncan, Peter Murchie, Rosalind Adam

Comments: under review

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Other Quantitative Biology (q-bio.OT)

[2300] arXiv:2406.16020 (cross-list from cs.SD) [pdf, html, other]

Title: AudioBench: A Universal Benchmark for Audio Large Language Models

Bin Wang, Xunlong Zou, Geyu Lin, Shuo Sun, Zhuohan Liu, Wenyu Zhang, Zhengyuan Liu, AiTi Aw, Nancy F. Chen

Comments: v4 - Add acknowledgment and slight update on structure; Code: this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)