Computation and Language

Authors and titles for June 2024

[2251] arXiv:2406.14492 (cross-list from cs.CV) [pdf, html, other]

Title: Does Object Grounding Really Reduce Hallucination of Large Vision-Language Models?

Gregor Geigle, Radu Timofte, Goran Glavaš

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2252] arXiv:2406.14496 (cross-list from cs.CV) [pdf, html, other]

Title: African or European Swallow? Benchmarking Large Vision-Language Models for Fine-Grained Object Classification

Gregor Geigle, Radu Timofte, Goran Glavaš

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2253] arXiv:2406.14497 (cross-list from cs.SE) [pdf, html, other]

Title: CodeRAG-Bench: Can Retrieval Augment Code Generation?

Zora Zhiruo Wang, Akari Asai, Xinyan Velocity Yu, Frank F. Xu, Yiqing Xie, Graham Neubig, Daniel Fried

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2254] arXiv:2406.14517 (cross-list from cs.LG) [pdf, html, other]

Title: PostMark: A Robust Blackbox Watermark for Large Language Models

Yapei Chang, Kalpesh Krishna, Amir Houmansadr, John Wieting, Mohit Iyyer

Comments: EMNLP 2024; 19 pages, 5 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[2255] arXiv:2406.14522 (cross-list from physics.soc-ph) [pdf, html, other]

Title: Learning thresholds lead to stable language coexistence

Mikhail V. Tamm, Els Heinsalu, Stefano Scialla, Marco Patriarca

Comments: 15 pages, 6 figures and 1 table

Subjects: Physics and Society (physics.soc-ph); Computation and Language (cs.CL)

[2256] arXiv:2406.14532 (cross-list from cs.LG) [pdf, html, other]

Title: RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold

Amrith Setlur, Saurabh Garg, Xinyang Geng, Naman Garg, Virginia Smith, Aviral Kumar

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2257] arXiv:2406.14544 (cross-list from cs.CV) [pdf, html, other]

Title: Prism: A Framework for Decoupling and Assessing the Capabilities of VLMs

Yuxuan Qiao, Haodong Duan, Xinyu Fang, Junming Yang, Lin Chen, Songyang Zhang, Jiaqi Wang, Dahua Lin, Kai Chen

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2258] arXiv:2406.14643 (cross-list from cs.CV) [pdf, html, other]

Title: Holistic Evaluation for Interleaved Text-and-Image Generation

Minqian Liu, Zhiyang Xu, Zihao Lin, Trevor Ashby, Joy Rimchala, Jiaxin Zhang, Lifu Huang

Comments: EMNLP 2024 Main Conference. 15 pages, 6 figures, 7 tables. Website: this https URL. Dataset: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2259] arXiv:2406.14683 (cross-list from cs.LG) [pdf, other]

Title: TAGLAS: An atlas of text-attributed graph datasets in the era of large graph and language models

Jiarui Feng, Hao Liu, Lecheng Kong, Mingfang Zhu, Yixin Chen, Muhan Zhang

Comments: Preprint

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2260] arXiv:2406.14701 (cross-list from cs.AI) [pdf, html, other]

Title: Speech Prefix-Tuning with RNNT Loss for Improving LLM Predictions

Murali Karthick Baskar, Andrew Rosenberg, Bhuvana Ramabhadran, Neeraj Gaur, Zhong Meng

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[2261] arXiv:2406.14764 (cross-list from cs.IR) [pdf, html, other]

Title: RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation

William Fleshman, Benjamin Van Durme

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2262] arXiv:2406.14765 (cross-list from cs.AI) [pdf, html, other]

Title: ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictor

Steven A. Lehr, Aylin Caliskan, Suneragiri Liyanage, Mahzarin R. Banaji

Comments: Main article is 14 pages, 1 table. Includes SI Appendix: 26 pages, 12 tables, 2 figures. Total: 40 pages, 13 tables, 2 figures. Under revised review at PNAS

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[2263] arXiv:2406.14774 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating Numerical Reasoning in Text-to-Image Models

Ivana Kajić, Olivia Wiles, Isabela Albuquerque, Matthias Bauer, Su Wang, Jordi Pont-Tuset, Aida Nematzadeh

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2264] arXiv:2406.14783 (cross-list from cs.IR) [pdf, html, other]

Title: Evaluating RAG-Fusion with RAGElo: an Automated Elo-based Framework

Zackary Rackauckas, Arthur Câmara, Jakub Zavrel

Comments: Accepted to LLM4Eval @ SIGIR24

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2265] arXiv:2406.14862 (cross-list from cs.LG) [pdf, html, other]

Title: LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multimodal Large Language Models

Mengdan Zhu, Raasikh Kanjiani, Jiahui Lu, Andrew Choi, Qirui Ye, Liang Zhao

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2266] arXiv:2406.14867 (cross-list from cs.LG) [pdf, other]

Title: Investigating the Transferability of Code Repair for Low-Resource Programming Languages

Kyle Wong, Alfonso Amayuelas, Liangming Pan, William Yang Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2267] arXiv:2406.14898 (cross-list from cs.CR) [pdf, html, other]

Title: Safely Learning with Private Data: A Federated Learning Framework for Large Language Model

JiaYing Zheng, HaiNan Zhang, LingXiang Wang, WangJie Qiu, HongWei Zheng, ZhiMing Zheng

Comments: EMNLP 2024

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[2268] arXiv:2406.14909 (cross-list from cs.LG) [pdf, html, other]

Title: MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression

Tianyu Fu, Haofeng Huang, Xuefei Ning, Genghan Zhang, Boju Chen, Tianqi Wu, Hongyi Wang, Zixiao Huang, Shiyao Li, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2269] arXiv:2406.14917 (cross-list from cs.AI) [pdf, html, other]

Title: LLM2FEA: Discover Novel Designs with Generative Evolutionary Multitasking

Melvin Wong, Jiao Liu, Thiago Rios, Stefan Menzel, Yew Soon Ong

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[2270] arXiv:2406.14928 (cross-list from cs.AI) [pdf, html, other]

Title: Autonomous Agents for Collaborative Task under Information Asymmetry

Wei Liu, Chenxi Wang, Yifei Wang, Zihao Xie, Rennai Qiu, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, Chen Qian

Comments: 32 pages, 12 figures, 6 tables, accepted by NeurIPS 2024, see detail at this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA); Social and Information Networks (cs.SI)

[2271] arXiv:2406.14956 (cross-list from cs.LG) [pdf, html, other]

Title: Unlocking the Global Synergies in Low-Rank Adapters

Zixi Zhang, Cheng Zhang, Xitong Gao, Robert D. Mullins, George A. Constantinides, Yiren Zhao

Comments: Accepted at ICML2024 ES-FoMo-II Workshop

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2272] arXiv:2406.14986 (cross-list from cs.AI) [pdf, html, other]

Title: Do Large Language Models Exhibit Cognitive Dissonance? Studying the Difference Between Revealed Beliefs and Stated Answers

Manuel Mondal, Ljiljana Dolamic, Gérôme Bovet, Philippe Cudré-Mauroux, Julien Audiffren

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2273] arXiv:2406.14993 (cross-list from cs.CV) [pdf, other]

Title: Disability Representations: Finding Biases in Automatic Image Generation

Yannis Tevissen

Comments: Presented at AVA Workshop of CVPR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2274] arXiv:2406.15015 (cross-list from cs.DB) [pdf, html, other]

Title: GraLMatch: Matching Groups of Entities with Graphs and Language Models

Fernando De Meer Pardo, Claude Lehmann, Dennis Gehrig, Andrea Nagy, Stefano Nicoli, Branka Hadji Misheva, Martin Braschler, Kurt Stockinger

Comments: 12 pages, 4 figures, accepted as research paper at EDBT 2025

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2275] arXiv:2406.15038 (cross-list from cs.LG) [pdf, html, other]

Title: Online detection and infographic explanation of spam reviews with data drift adaptation

Francisco de Arriba-Pérez, Silvia García-Méndez, Fátima Leal, Benedita Malheiro, J. C. Burguillo

Journal-ref: Francisco de Arriba-P\'erez, Silvia Garc\'ia-M\'endez, F\'atima Leal, Benedita Malheiro, Juan C. Burguillo, Online Detection and Infographic Explanation of Spam Reviews with Data Drift Adaptation, Informatica(2024), 1-25

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[2276] arXiv:2406.15050 (cross-list from cs.LG) [pdf, html, other]

Title: Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis

Lin Fan, Xun Gong, Cenyang Zheng, Yafei Ou

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2277] arXiv:2406.15111 (cross-list from cs.AI) [pdf, html, other]

Title: Investigating the impact of 2D gesture representation on co-speech gesture generation

Teo Guichoux, Laure Soulier, Nicolas Obin, Catherine Pelachaud

Comments: 8 pages. Paper accepted at WACAI 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2278] arXiv:2406.15264 (cross-list from cs.IR) [pdf, html, other]

Title: Towards Fine-Grained Citation Evaluation in Generated Text: A Comparative Analysis of Faithfulness Metrics

Weijia Zhang, Mohammad Aliannejadi, Yifei Yuan, Jiahuan Pei, Jia-Hong Huang, Evangelos Kanoulas

Comments: Accepted by the 17th International Natural Language Generation Conference (INLG 2024) as an oral presentation

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2279] arXiv:2406.15279 (cross-list from cs.AI) [pdf, other]

Title: Cross-Modality Safety Alignment

Siyin Wang, Xingsong Ye, Qinyuan Cheng, Junwen Duan, Shimin Li, Jinlan Fu, Xipeng Qiu, Xuanjing Huang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2280] arXiv:2406.15306 (cross-list from cs.LG) [pdf, other]

Title: Advanced Multimodal Deep Learning Architecture for Image-Text Matching

Jinyin Wang, Haijing Zhang, Yihao Zhong, Yingbin Liang, Rongwei Ji, Yiru Cang

Comments: arXiv admin note: text overlap with arXiv:2405.17460 by other authors

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2281] arXiv:2406.15313 (cross-list from cs.IR) [pdf, html, other]

Title: STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionals

Weihang Su, Yiran Hu, Anzhe Xie, Qingyao Ai, Zibing Que, Ning Zheng, Yun Liu, Weixing Shen, Yiqun Liu

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2282] arXiv:2406.15330 (cross-list from cs.AI) [pdf, html, other]

Title: Gradient-Mask Tuning Elevates the Upper Limits of LLM Performance

Haoling Li, Xin Zhang, Xiao Liu, Yeyun Gong, Yifan Wang, Yujiu Yang, Qi Chen, Peng Cheng

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2283] arXiv:2406.15334 (cross-list from cs.CV) [pdf, html, other]

Title: Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learning

Brandon Huang, Chancharik Mitra, Assaf Arbelle, Leonid Karlinsky, Trevor Darrell, Roei Herzig

Comments: Published in NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2284] arXiv:2406.15474 (cross-list from cs.AI) [pdf, html, other]

Title: WundtGPT: Shaping Large Language Models To Be An Empathetic, Proactive Psychologist

Chenyu Ren, Yazhou Zhang, Daihai He, Jing Qin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[2285] arXiv:2406.15481 (cross-list from cs.AI) [pdf, other]

Title: Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understanding

Haneul Yoo, Yongjin Yang, Hwaran Lee

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2286] arXiv:2406.15513 (cross-list from cs.AI) [pdf, html, other]

Title: PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference

Jiaming Ji, Donghai Hong, Borong Zhang, Boyuan Chen, Josef Dai, Boren Zheng, Tianyi Qiu, Boxun Li, Yaodong Yang

Comments: a sibling project to SafeRLHF and BeaverTails

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2287] arXiv:2406.15527 (cross-list from cs.LG) [pdf, html, other]

Title: Data Efficient Evaluation of Large Language Models and Text-to-Image Models via Adaptive Sampling

Cong Xu, Gayathri Saranathan, Mahammad Parwez Alam, Arpit Shah, James Lim, Soon Yee Wong, Foltin Martin, Suparna Bhattacharya

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2288] arXiv:2406.15534 (cross-list from cs.LG) [pdf, html, other]

Title: Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research

Tianyu Liu, Yijia Xiao, Xiao Luo, Hua Xu, W. Jim Zheng, Hongyu Zhao

Comments: 8 pages

Journal-ref: EMNLP 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Quantitative Methods (q-bio.QM)

[2289] arXiv:2406.15567 (cross-list from cs.LG) [pdf, html, other]

Title: SAIL: Self-Improving Efficient Online Alignment of Large Language Models

Mucong Ding, Souradip Chakraborty, Vibhu Agrawal, Zora Che, Alec Koppel, Mengdi Wang, Amrit Bedi, Furong Huang

Comments: 24 pages, 6 figures, 3 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2290] arXiv:2406.15736 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads

Anoop Cherian, Kuan-Chuan Peng, Suhas Lohit, Joanna Matthiesen, Kevin Smith, Joshua B. Tenenbaum

Comments: Accepted at NeurIPS 2024 (Datasets and Benchmarks Track)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2291] arXiv:2406.15752 (cross-list from eess.AS) [pdf, html, other]

Title: TacoLM: GaTed Attention Equipped Codec Language Model are Efficient Zero-Shot Text to Speech Synthesizers

Yakun Song, Zhuo Chen, Xiaofei Wang, Ziyang Ma, Guanrou Yang, Xie Chen

Comments: INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2292] arXiv:2406.15754 (cross-list from cs.CV) [pdf, html, other]

Title: Multimodal Segmentation for Vocal Tract Modeling

Rishi Jain, Bohan Yu, Peter Wu, Tejas Prabhune, Gopala Anumanchipalli

Comments: Interspeech 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[2293] arXiv:2406.15765 (cross-list from cs.LG) [pdf, html, other]

Title: Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration

Zhongzhi Yu, Zheng Wang, Yonggan Fu, Huihong Shi, Khalid Shaikh, Yingyan Celine Lin

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2294] arXiv:2406.15786 (cross-list from cs.LG) [pdf, html, other]

Title: What Matters in Transformers? Not All Attention is Needed

Shwai He, Guoheng Sun, Zheyu Shen, Ang Li

Comments: 15 pages, 13 figures, 6 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2295] arXiv:2406.15812 (cross-list from cs.LG) [pdf, html, other]

Title: Intrinsic Dimension Correlation: uncovering nonlinear connections in multimodal representations

Lorenzo Basile, Santiago Acevedo, Luca Bortolussi, Fabio Anselmi, Alex Rodriguez

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2296] arXiv:2406.15877 (cross-list from cs.SE) [pdf, html, other]

Title: BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, Thong Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Zhihan Zhang, Prateek Yadav, Naman Jain, Alex Gu, Zhoujun Cheng, Jiawei Liu, Qian Liu, Zijian Wang, David Lo, Binyuan Hui, Niklas Muennighoff, Daniel Fried, Xiaoning Du, Harm de Vries, Leandro Von Werra

Comments: 44 pages, 14 figures, 7 tables, built with love by the BigCode community :)

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2297] arXiv:2406.15890 (cross-list from cs.LG) [pdf, html, other]

Title: Language Alignment via Nash-learning and Adaptive feedback

Ari Azarafrooz, Farshid Faal

Comments: Accepted at ICML 2024 Workshop on Models of Human Feedback for AI Alignment, Vienna, Austria

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT)

[2298] arXiv:2406.15940 (cross-list from cs.LG) [pdf, html, other]

Title: Beyond Individual Facts: Investigating Categorical Knowledge Locality of Taxonomy and Meronomy Concepts in GPT Models

Christopher Burger, Yifan Hu, Thai Le

Comments: 27 pages, 23 figures, 12 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2299] arXiv:2406.15963 (cross-list from cs.HC) [pdf, html, other]

Title: Effectiveness of ChatGPT in explaining complex medical reports to patients

Mengxuan Sun, Ehud Reiter, Anne E Kiltie, George Ramsay, Lisa Duncan, Peter Murchie, Rosalind Adam

Comments: under review

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Other Quantitative Biology (q-bio.OT)

[2300] arXiv:2406.16020 (cross-list from cs.SD) [pdf, html, other]

Title: AudioBench: A Universal Benchmark for Audio Large Language Models

Bin Wang, Xunlong Zou, Geyu Lin, Shuo Sun, Zhuohan Liu, Wenyu Zhang, Zhengyuan Liu, AiTi Aw, Nancy F. Chen

Comments: v4 - Add acknowledgment and slight update on structure; Code: this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2301] arXiv:2406.16061 (cross-list from cs.LG) [pdf, html, other]

Title: PORT: Preference Optimization on Reasoning Traces

Salem Lahlou, Abdalgader Abubaker, Hakim Hacid

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2302] arXiv:2406.16107 (cross-list from eess.AS) [pdf, html, other]

Title: Decoder-only Architecture for Streaming End-to-end Speech Recognition

Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe

Comments: Accepted for Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2303] arXiv:2406.16120 (cross-list from eess.AS) [pdf, html, other]

Title: Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss

Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe

Comments: Accepted to INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2304] arXiv:2406.16176 (cross-list from cs.AI) [pdf, html, other]

Title: GraphEval2000: Benchmarking and Improving Large Language Models on Graph Datasets

Qiming Wu, Zichen Chen, Will Corcoran, Misha Sra, Ambuj K. Singh

Comments: Submitted to NeurIPs 2024 Dataset and Benchmark track, under review

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2305] arXiv:2406.16201 (cross-list from cs.CR) [pdf, html, other]

Title: Blind Baselines Beat Membership Inference Attacks for Foundation Models

Debeshee Das, Jie Zhang, Florian Tramèr

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2306] arXiv:2406.16254 (cross-list from cs.LG) [pdf, html, other]

Title: Confidence Regulation Neurons in Language Models

Alessandro Stolfo, Ben Wu, Wes Gurnee, Yonatan Belinkov, Xingyi Song, Mrinmaya Sachan, Neel Nanda

Comments: NeurIPS 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2307] arXiv:2406.16308 (cross-list from cs.LG) [pdf, html, other]

Title: Anomaly Detection of Tabular Data Using LLMs

Aodong Li, Yunhan Zhao, Chen Qiu, Marius Kloft, Padhraic Smyth, Maja Rudolph, Stephan Mandt

Comments: accepted at the Anomaly Detection with Foundation Models workshop

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2308] arXiv:2406.16315 (cross-list from eess.AS) [pdf, html, other]

Title: Song Data Cleansing for End-to-End Neural Singer Diarization Using Neural Analysis and Synthesis Framework

Hokuto Munakata, Ryo Terashima, Yusuke Fujita

Comments: INTERSPEECH 2024 accepted

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2309] arXiv:2406.16332 (cross-list from cs.IR) [pdf, html, other]

Title: DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task

Wenhan Liu, Yutao Zhu, Zhicheng Dou

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2310] arXiv:2406.16408 (cross-list from math.CO) [pdf, other]

Title: A Symmetry Property of Christoffel Words

Yan Lanciault (LACIM), Christophe Reutenauer (LACIM)

Comments: In Proceedings GASCom 2024, arXiv:2406.14588

Journal-ref: EPTCS 403, 2024, pp. 123-127

Subjects: Combinatorics (math.CO); Computation and Language (cs.CL)

[2311] arXiv:2406.16477 (cross-list from cs.CV) [pdf, html, other]

Title: DaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-Resolution

Aiwen Jiang, Zhi Wei, Long Peng, Feiqiang Liu, Wenbo Li, Mingwen Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2312] arXiv:2406.16562 (cross-list from cs.CV) [pdf, html, other]

Title: EVALALIGN: Supervised Fine-Tuning Multimodal LLMs with Human-Aligned Data for Evaluating Text-to-Image Models

Zhiyu Tan, Xiaomeng Yang, Luozheng Qin, Mengping Yang, Cheng Zhang, Hao Li

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2313] arXiv:2406.16620 (cross-list from cs.CV) [pdf, html, other]

Title: OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquer

Lu Zhang, Tiancheng Zhao, Heting Ying, Yibo Ma, Kyusong Lee

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2314] arXiv:2406.16635 (cross-list from cs.LG) [pdf, html, other]

Title: ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models

Yash Akhauri, Ahmed F AbouElhamayed, Jordan Dotzel, Zhiru Zhang, Alexander M Rush, Safeen Huda, Mohamed S Abdelfattah

Comments: Accepted to EMNLP 2024 (Main, Long Paper)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2315] arXiv:2406.16746 (cross-list from cs.LG) [pdf, other]

Title: The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources

Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2316] arXiv:2406.16748 (cross-list from cs.LG) [pdf, other]

Title: OCALM: Object-Centric Assessment with Language Models

Timo Kaufmann, Jannis Blüml, Antonia Wüst, Quentin Delfosse, Kristian Kersting, Eyke Hüllermeier

Comments: Accepted at the RLBRew Workshop at RLC 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2317] arXiv:2406.16807 (cross-list from cs.LG) [pdf, html, other]

Title: Beyond Thumbs Up/Down: Untangling Challenges of Fine-Grained Feedback for Text-to-Image Generation

Katherine M. Collins, Najoung Kim, Yonatan Bitton, Verena Rieser, Shayegan Omidshafiei, Yushi Hu, Sherol Chen, Senjuti Dutta, Minsuk Chang, Kimin Lee, Youwei Liang, Georgina Evans, Sahil Singla, Gang Li, Adrian Weller, Junfeng He, Deepak Ramachandran, Krishnamurthy Dj Dvijotham

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2318] arXiv:2406.16810 (cross-list from cs.LG) [pdf, other]

Title: PISTOL: Dataset Compilation Pipeline for Structural Unlearning of LLMs

Xinchi Qiu, William F. Shen, Yihong Chen, Nicola Cancedda, Pontus Stenetorp, Nicholas D. Lane

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2319] arXiv:2406.16828 (cross-list from cs.IR) [pdf, html, other]

Title: Ragnar\"ok: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track

Ronak Pradeep, Nandan Thakur, Sahel Sharifymoghaddam, Eric Zhang, Ryan Nguyen, Daniel Campos, Nick Craswell, Jimmy Lin

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2320] arXiv:2406.16903 (cross-list from cs.HC) [pdf, other]

Title: Towards a copilot in BIM authoring tool using a large language model-based agent for intelligent human-machine interaction

Changyu Du, Stavros Nousias, André Borrmann

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2321] arXiv:2406.16953 (cross-list from eess.SP) [pdf, other]

Title: Validation of a new, minimally-invasive, software smartphone device to predict sleep apnea and its severity: transversal study

Justine Frija, Juliette Millet, Emilie Bequignon, Ala Covali, Guillaume Cathelain, Josselin Houenou, Helene Benzaquen, Pierre Alexis Geoffroy, Emmanuel Bacry, Mathieu Grajoszex, Marie-Pia d Ortho

Comments: 21 pages, 6 figures

Subjects: Signal Processing (eess.SP); Computation and Language (cs.CL)

[2322] arXiv:2406.16962 (cross-list from cs.LG) [pdf, html, other]

Title: MetaGreen: Meta-Learning Inspired Transformer Selection for Green Semantic Communication

Shubhabrata Mukherjee, Cory Beard, Sejun Song

Comments: arXiv admin note: substantial text overlap with arXiv:2310.07592

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2323] arXiv:2406.16985 (cross-list from cs.LG) [pdf, html, other]

Title: Unveiling LLM Mechanisms Through Neural ODEs and Control Theory

Yukun Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2324] arXiv:2406.17135 (cross-list from cs.SI) [pdf, html, other]

Title: Testing network clustering algorithms with Natural Language Processing

Ixandra Achitouv, David Chavalarias, Bruno Gaume

Comments: 10 pages, 8 figures

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY); Physics and Society (physics.soc-ph)

[2325] arXiv:2406.17224 (cross-list from cs.AI) [pdf, html, other]

Title: Large Language Models are Interpretable Learners

Ruochen Wang, Si Si, Felix Yu, Dorothea Wiesmann, Cho-Jui Hsieh, Inderjit Dhillon

Comments: Preliminary Version, Code at [this url](this https URL)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Symbolic Computation (cs.SC)

[2326] arXiv:2406.17233 (cross-list from cs.SE) [pdf, other]

Title: Self-Constructed Context Decompilation with Fined-grained Alignment Enhancement

Yunlong Feng, Dechuan Teng, Yang Xu, Honglin Mu, Xiao Xu, Libo Qin, Qingfu Zhu, Wanxiang Che

Comments: EMNLP 2024 Findings

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2327] arXiv:2406.17245 (cross-list from cs.LG) [pdf, html, other]

Title: Unlocking Continual Learning Abilities in Language Models

Wenyu Du, Shuang Cheng, Tongxu Luo, Zihan Qiu, Zeyu Huang, Ka Chun Cheung, Reynold Cheng, Jie Fu

Comments: EMNLP 2024 Findings

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2328] arXiv:2406.17266 (cross-list from eess.AS) [pdf, html, other]

Title: AG-LSEC: Audio Grounded Lexical Speaker Error Correction

Rohit Paturi, Xiang Li, Sundararajan Srinivasan

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2329] arXiv:2406.17532 (cross-list from cs.AI) [pdf, html, other]

Title: Can Large Language Models Understand DL-Lite Ontologies? An Empirical Study

Keyu Wang, Guilin Qi, Jiaqi Li, Songlin Zhai

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Logic in Computer Science (cs.LO)

[2330] arXiv:2406.17542 (cross-list from cs.LG) [pdf, html, other]

Title: CDQuant: Greedy Coordinate Descent for Accurate LLM Quantization

Pranav Ajit Nair, Arun Sai Suggala

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2331] arXiv:2406.17605 (cross-list from cs.MM) [pdf, other]

Title: NativE: Multi-modal Knowledge Graph Completion in the Wild

Yichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu, Binbin Hu, Ziqi Liu, Wen Zhang, Huajun Chen

Comments: Accepted by SIGIR 2024 as a full paper

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

[2332] arXiv:2406.17618 (cross-list from eess.AS) [pdf, html, other]

Title: Towards Building an End-to-End Multilingual Automatic Lyrics Transcription Model

Jiawen Huang, Emmanouil Benetos

Comments: Accepted at EUSIPCO 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2333] arXiv:2406.17639 (cross-list from cs.CV) [pdf, html, other]

Title: Mitigate the Gap: Investigating Approaches for Improving Cross-Modal Alignment in CLIP

Sedigheh Eslami, Gerard de Melo

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2334] arXiv:2406.17650 (cross-list from cs.AI) [pdf, html, other]

Title: ELIZA Reinterpreted: The world's first chatbot was not intended as a chatbot at all

Jeff Shrager

Comments: In process of journal review

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

[2335] arXiv:2406.17667 (cross-list from cs.SD) [pdf, html, other]

Title: This Paper Had the Smartest Reviewers -- Flattery Detection Utilising an Audio-Textual Transformer-Based Approach

Lukas Christ, Shahin Amiriparian, Friederike Hawighorst, Ann-Kathrin Schill, Angelo Boutalikakis, Lorenz Graf-Vlachy, Andreas König, Björn W. Schuller

Comments: Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2336] arXiv:2406.17706 (cross-list from cs.LG) [pdf, html, other]

Title: FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model

Feijie Wu, Zitao Li, Yaliang Li, Bolin Ding, Jing Gao

Comments: KDD 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[2337] arXiv:2406.17793 (cross-list from cs.LG) [pdf, html, other]

Title: Deep Learning Approaches for Detecting Adversarial Cyberbullying and Hate Speech in Social Networks

Sylvia Worlali Azumah, Nelly Elsayed, Zag ElSayed, Murat Ozer, Amanda La Guardia

Comments: 10 pages, 8 figures, 3 tables, under reviewing

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computers and Society (cs.CY)

[2338] arXiv:2406.17801 (cross-list from cs.SD) [pdf, html, other]

Title: A multi-speaker multi-lingual voice cloning system based on vits2 for limmits 2024 challenge

Xiaopeng Wang, Yi Lu, Xin Qi, Zhiyong Wang, Yuankun Xie, Shuchen Shi, Ruibo Fu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2339] arXiv:2406.17876 (cross-list from cs.CV) [pdf, html, other]

Title: ET tu, CLIP? Addressing Common Object Errors for Unseen Environments

Ye Won Byun, Cathy Jiao, Shahriar Noroozizadeh, Jimin Sun, Rosa Vitiello

Journal-ref: Conference on Computer Vision and Pattern Recognition (CVPR 2022) - Embodied AI Workshop

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Robotics (cs.RO)

[2340] arXiv:2406.17972 (cross-list from cs.LG) [pdf, other]

Title: LABOR-LLM: Language-Based Occupational Representations with Large Language Models

Susan Athey, Herman Brunborg, Tianyu Du, Ayush Kanodia, Keyon Vafa

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Econometrics (econ.EM)

[2341] arXiv:2406.18069 (cross-list from eess.SP) [pdf, html, other]

Title: Large Language Models for Cuffless Blood Pressure Measurement From Wearable Biosignals

Zengding Liu, Chen Chen, Jiannong Cao, Minglei Pan, Jikui Liu, Nan Li, Fen Miao, Ye Li

Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2342] arXiv:2406.18087 (cross-list from cs.SE) [pdf, html, other]

Title: EHR-Based Mobile and Web Platform for Chronic Disease Risk Prediction Using Large Language Multimodal Models

Chun-Chieh Liao, Wei-Ting Kuo, I-Hsuan Hu, Yen-Chen Shih, Jun-En Ding, Feng Liu, Fang-Ming Hung

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2343] arXiv:2406.18118 (cross-list from cs.CR) [pdf, other]

Title: SafeAligner: Safety Alignment against Jailbreak Attacks via Response Disparity Guidance

Caishuang Huang, Wanxu Zhao, Rui Zheng, Huijie Lv, Wenyu Zhan, Shihan Dou, Sixian Li, Xiao Wang, Enyu Zhou, Junjie Ye, Yuming Yang, Tao Gui, Qi Zhang, Xuanjing Huang

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[2344] arXiv:2406.18227 (cross-list from cs.CV) [pdf, html, other]

Title: GUIDE: A Guideline-Guided Dataset for Instructional Video Comprehension

Jiafeng Liang, Shixin Jiang, Zekun Wang, Haojie Pan, Zerui Chen, Zheng Chu, Ming Liu, Ruiji Fu, Zhongyuan Wang, Bing Qin

Comments: IJCAI 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2345] arXiv:2406.18301 (cross-list from eess.AS) [pdf, html, other]

Title: MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Research

Song Li, Yongbin You, Xuezhi Wang, Zhengkun Tian, Ke Ding, Guanglu Wan

Comments: Accepted by InterSpeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2346] arXiv:2406.18313 (cross-list from cs.SD) [pdf, html, other]

Title: Advancing Airport Tower Command Recognition: Integrating Squeeze-and-Excitation and Broadcasted Residual Learning

Yuanxi Lin, Tonglin Zhou, Yang Xiao

Comments: Accepted by IALP 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2347] arXiv:2406.18505 (cross-list from cs.LG) [pdf, html, other]

Title: Mental Modeling of Reinforcement Learning Agents by Language Models

Wenhao Lu, Xufeng Zhao, Josua Spisak, Jae Hee Lee, Stefan Wermter

Comments: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[2348] arXiv:2406.18522 (cross-list from cs.CV) [pdf, html, other]

Title: ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation

Shenghai Yuan, Jinfa Huang, Yongqi Xu, Yaoyang Liu, Shaofeng Zhang, Yujun Shi, Ruijie Zhu, Xinhua Cheng, Jiebo Luo, Li Yuan

Comments: NeurIPS D&B 2024 (Spotlight)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2349] arXiv:2406.18616 (cross-list from cs.SE) [pdf, html, other]

Title: Towards Large Language Model Aided Program Refinement

Yufan Cai, Zhe Hou, Xiaokun Luan, David Miguel Sanan Baena, Yun Lin, Jun Sun, Jin Song Dong

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2350] arXiv:2406.18626 (cross-list from q-bio.QM) [pdf, html, other]

Title: An LLM-based Knowledge Synthesis and Scientific Reasoning Framework for Biomedical Discovery

Oskar Wysocki, Magdalena Wysocka, Danilo Carvalho, Alex Teodor Bogatu, Danilo Miranda Gusicuma, Maxime Delmas, Harriet Unsworth, Andre Freitas

Comments: accepted for ACL 2024 System Demonstration Track

Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2351] arXiv:2406.18629 (cross-list from cs.LG) [pdf, html, other]

Title: Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs

Xin Lai, Zhuotao Tian, Yukang Chen, Senqiao Yang, Xiangru Peng, Jiaya Jia

Comments: Code, data, and models are available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2352] arXiv:2406.18665 (cross-list from cs.LG) [pdf, html, other]

Title: RouteLLM: Learning to Route LLMs with Preference Data

Isaac Ong, Amjad Almahairi, Vincent Wu, Wei-Lin Chiang, Tianhao Wu, Joseph E. Gonzalez, M Waleed Kadous, Ion Stoica

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2353] arXiv:2406.18675 (cross-list from cs.HC) [pdf, html, other]

Title: Human-AI Collaborative Taxonomy Construction: A Case Study in Profession-Specific Writing Assistants

Minhwa Lee, Zae Myung Kim, Vivek Khetan, Dongyeop Kang

Comments: Accepted to CHI 2024 In2Writing Workshop

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2354] arXiv:2406.18678 (cross-list from cs.LG) [pdf, html, other]

Title: Few-shot Personalization of LLMs with Mis-aligned Responses

Jaehyung Kim, Yiming Yang

Comments: preprint, 30 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2355] arXiv:2406.18679 (cross-list from eess.AS) [pdf, html, other]

Title: Speakers Unembedded: Embedding-free Approach to Long-form Neural Diarization

Xiang Li, Vivek Govindan, Rohit Paturi, Sundararajan Srinivasan

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2356] arXiv:2406.18695 (cross-list from cs.LG) [pdf, html, other]

Title: Learning to Correct for QA Reasoning with Black-box LLMs

Jaehyung Kim, Dongyoung Kim, Yiming Yang

Comments: 22 pages; EMNLP 2024 (long, main)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2357] arXiv:2406.18702 (cross-list from cs.HC) [pdf, html, other]

Title: Simulating The U.S. Senate: An LLM-Driven Agent Approach to Modeling Legislative Behavior and Bipartisanship

Zachary R. Baker, Zarif L. Azher

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[2358] arXiv:2406.18708 (cross-list from cs.LG) [pdf, html, other]

Title: Learn it or Leave it: Module Composition and Pruning for Continual Learning

Mingyang Wang, Heike Adel, Lukas Lange, Jannik Strötgen, Hinrich Schütze

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2359] arXiv:2406.18725 (cross-list from cs.LG) [pdf, html, other]

Title: Jailbreaking LLMs with Arabic Transliteration and Arabizi

Mansour Al Ghanim, Saleh Almohaimeed, Mengxin Zheng, Yan Solihin, Qian Lou

Comments: Accepted by EMNLP 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2360] arXiv:2406.18731 (cross-list from eess.AS) [pdf, html, other]

Title: WavRx: a Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model

Yi Zhu, Tiago Falk

Comments: Under review; Model script available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2361] arXiv:2406.18841 (cross-list from cs.CY) [pdf, other]

Title: Navigating LLM Ethics: Advancements, Challenges, and Future Directions

Junfeng Jiao, Saleh Afroogh, Yiming Xu, Connor Phillips

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2362] arXiv:2406.18842 (cross-list from cs.CY) [pdf, other]

Title: The global landscape of academic guidelines for generative AI and Large Language Models

Junfeng Jiao, Saleh Afroogh, Kevin Chen, David Atkinson, Amit Dhurandhar

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2363] arXiv:2406.18871 (cross-list from eess.AS) [pdf, html, other]

Title: DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment

Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, He Huang, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2364] arXiv:2406.18928 (cross-list from cs.SD) [pdf, html, other]

Title: Enhanced ASR Robustness to Packet Loss with a Front-End Adaptation Network

Yehoshua Dissen, Shiry Yonash, Israel Cohen, Joseph Keshet

Comments: Accepted for publication at INTERSPEECH 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[2365] arXiv:2406.18934 (cross-list from cs.FL) [pdf, other]

Title: The single-use restriction for register automata and transducers over infinite alphabets

Rafał Stefański

Comments: PhD Thesis at University of Warsaw. Supervisor: Mikołaj Bojańczyk

Subjects: Formal Languages and Automata Theory (cs.FL); Computation and Language (cs.CL)

[2366] arXiv:2406.18972 (cross-list from eess.AS) [pdf, html, other]

Title: Applying LLMs for Rescoring N-best ASR Hypotheses of Casual Conversations: Effects of Domain Adaptation and Context Carry-over

Atsunori Ogawa, Naoyuki Kamo, Kohei Matsuura, Takanori Ashihara, Takafumi Moriya, Takatomo Kano, Naohiro Tawara, Marc Delcroix

Comments: 5 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2367] arXiv:2406.18977 (cross-list from cs.RO) [pdf, html, other]

Title: RoboUniView: Visual-Language Model with Unified View Representation for Robotic Manipulation

Fanfan Liu, Feng Yan, Liming Zheng, Chengjian Feng, Yiyang Huang, Lin Ma

Subjects: Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2368] arXiv:2406.19146 (cross-list from cs.LG) [pdf, html, other]

Title: Resolving Discrepancies in Compute-Optimal Scaling of Language Models

Tomer Porian, Mitchell Wortsman, Jenia Jitsev, Ludwig Schmidt, Yair Carmon

Comments: Spotlight at NeurIPS 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2369] arXiv:2406.19230 (cross-list from cs.NE) [pdf, html, other]

Title: Spiking Convolutional Neural Networks for Text Classification

Changze Lv, Jianhan Xu, Xiaoqing Zheng

Subjects: Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL)

[2370] arXiv:2406.19255 (cross-list from cs.CV) [pdf, html, other]

Title: Enhancing Video-Language Representations with Structural Spatio-Temporal Alignment

Hao Fei, Shengqiong Wu, Meishan Zhang, Min Zhang, Tat-Seng Chua, Shuicheng Yan

Comments: Accepted by IEEE TPAMI 2024

Journal-ref: [J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2371] arXiv:2406.19280 (cross-list from cs.CV) [pdf, html, other]

Title: HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale

Junying Chen, Chi Gui, Ruyi Ouyang, Anningzhe Gao, Shunian Chen, Guiming Hardy Chen, Xidong Wang, Ruifei Zhang, Zhenyang Cai, Ke Ji, Guangjun Yu, Xiang Wan, Benyou Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2372] arXiv:2406.19292 (cross-list from cs.LG) [pdf, other]

Title: From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data

Zheyang Xiong, Vasilis Papageorgiou, Kangwook Lee, Dimitris Papailiopoulos

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2373] arXiv:2406.19317 (cross-list from cs.LG) [pdf, html, other]

Title: Jump Starting Bandits with LLM-Generated Prior Knowledge

Parand A. Alamdari, Yanshuai Cao, Kevin H. Wilson

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2374] arXiv:2406.19384 (cross-list from cs.LG) [pdf, html, other]

Title: The Remarkable Robustness of LLMs: Stages of Inference?

Vedang Lad, Wes Gurnee, Max Tegmark

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2375] arXiv:2406.19388 (cross-list from cs.SD) [pdf, html, other]

Title: Taming Data and Transformers for Audio Generation

Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin, Guha Balakrishnan, Sergey Tulyakov, Vicente Ordonez

Comments: Project Webpage: this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[2376] arXiv:2406.19413 (cross-list from cs.CR) [pdf, other]

Title: Saliency Attention and Semantic Similarity-Driven Adversarial Perturbation

Hetvi Waghela, Jaydip Sen, Sneha Rakshit

Comments: The paper is 12 pages long. and it contains 5 tables. It is the pre-reviewed version of the paper that has been accepted for oral presentation and publication in the 5th International Conference on Data Science and Applications which will be organized in Jaipur, India from July 17 to 19, 2024. This is not the final version

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2377] arXiv:2406.19500 (cross-list from cs.AI) [pdf, html, other]

Title: Knowledge acquisition for dialogue agents using reinforcement learning on graph representations

Selene Baez Santamaria, Shihan Wang, Piek Vossen

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2378] arXiv:2406.19578 (cross-list from cs.CV) [pdf, html, other]

Title: PathAlign: A vision-language model for whole slide images in histopathology

Faruk Ahmed, Andrew Sellergren, Lin Yang, Shawn Xu, Boris Babenko, Abbi Ward, Niels Olson, Arash Mohtashamian, Yossi Matias, Greg S. Corrado, Quang Duong, Dale R. Webster, Shravya Shetty, Daniel Golden, Yun Liu, David F. Steiner, Ellery Wulczyn

Comments: 9 main pages and 19 pages of supplemental material; 3 main tables, 3 main figures and 11 supplemental tables, 7 supplemental figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2379] arXiv:2406.19648 (cross-list from cs.HC) [pdf, other]

Title: Designing and Evaluating Multi-Chatbot Interface for Human-AI Communication: Preliminary Findings from a Persuasion Task

Sion Yoon, Tae Eun Kim, Yoo Jung Oh

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2380] arXiv:2406.19712 (cross-list from cs.AI) [pdf, other]

Title: Uncertainty Quantification in Large Language Models Through Convex Hull Analysis

Ferhat Ozgur Catak, Murat Kuzlu

Comments: 17 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2381] arXiv:2406.19736 (cross-list from cs.CV) [pdf, html, other]

Title: MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment

Jihao Liu, Xin Huang, Jinliang Zheng, Boxiao Liu, Jia Wang, Osamu Yoshie, Yu Liu, Hongsheng Li

Comments: Dataset and models are available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2382] arXiv:2406.19760 (cross-list from cs.IR) [pdf, html, other]

Title: Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulation

Chenlong Deng, Kelong Mao, Zhicheng Dou

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2383] arXiv:2406.19783 (cross-list from cs.SE) [pdf, html, other]

Title: NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations

Junkai Chen, Zhenhao Li, Xing Hu, Xin Xia

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2384] arXiv:2406.20053 (cross-list from cs.CR) [pdf, html, other]

Title: Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation

Danny Halawi, Alexander Wei, Eric Wallace, Tony T. Wang, Nika Haghtalab, Jacob Steinhardt

Comments: 22 pages

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2385] arXiv:2406.20087 (cross-list from cs.LG) [pdf, html, other]

Title: ProgressGym: Alignment with a Millennium of Moral Progress

Tianyi Qiu, Yang Zhang, Xuchuan Huang, Jasmine Xinze Li, Jiaming Ji, Yaodong Yang

Comments: NeurIPS 2024 Track on Datasets and Benchmarks (Spotlight)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

[2386] arXiv:2406.20095 (cross-list from cs.RO) [pdf, html, other]

Title: LLaRA: Supercharging Robot Learning Data for Vision-Language Policy

Xiang Li, Cristina Mata, Jongwoo Park, Kumara Kahatapitiya, Yoo Sung Jang, Jinghuan Shang, Kanchana Ranasinghe, Ryan Burgert, Mu Cai, Yong Jae Lee, Michael S. Ryoo

Comments: ICLR 2025

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[2387] arXiv:2406.20098 (cross-list from cs.CV) [pdf, html, other]

Title: Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs

Sukmin Yun, Haokun Lin, Rusiru Thushara, Mohammad Qazim Bhat, Yongxin Wang, Zutao Jiang, Mingkai Deng, Jinhong Wang, Tianhua Tao, Junbo Li, Haonan Li, Preslav Nakov, Timothy Baldwin, Zhengzhong Liu, Eric P. Xing, Xiaodan Liang, Zhiqiang Shen

Comments: NeurIPS 2024 Datasets and Benchmarks Camera-ready Version. Website at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)