Computation and Language

Authors and titles for June 2024

[1476] arXiv:2406.16605 [pdf, html, other]

Title: CLEAR: Can Language Models Really Understand Causal Graphs?

Sirui Chen, Mengying Xu, Kun Wang, Xingyu Zeng, Rui Zhao, Shengjie Zhao, Chaochao Lu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Methodology (stat.ME)

[1477] arXiv:2406.16611 [pdf, html, other]

Title: Evaluation of Language Models in the Medical Context Under Resource-Constrained Settings

Andrea Posada, Daniel Rueckert, Felix Meissen, Philip Müller

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1478] arXiv:2406.16655 [pdf, html, other]

Title: Large Language Models Are Cross-Lingual Knowledge-Free Reasoners

Peng Hu, Sizhe Liu, Changjiang Gao, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Shujian Huang

Subjects: Computation and Language (cs.CL)

[1479] arXiv:2406.16672 [pdf, html, other]

Title: CAVE: Controllable Authorship Verification Explanations

Sahana Ramnath, Kartik Pandey, Elizabeth Boschee, Xiang Ren

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1480] arXiv:2406.16674 [pdf, html, other]

Title: Computational Approaches to the Detection of Lesser-Known Rhetorical Figures: A Systematic Survey and Research Challenges

Ramona Kühn, Jelena Mitrović, Michael Granitzer

Comments: Submitted to ACM Computing Surveys. 35 pages

Subjects: Computation and Language (cs.CL)

[1481] arXiv:2406.16678 [pdf, html, other]

Title: Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation

Markus Frohmann, Igor Sterner, Ivan Vulić, Benjamin Minixhofer, Markus Schedl

Comments: Accepted to EMNLP 2024 Main

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1482] arXiv:2406.16690 [pdf, html, other]

Title: Scaling Laws for Linear Complexity Language Models

Xuyang Shen, Dong Li, Ruitao Leng, Zhen Qin, Weigao Sun, Yiran Zhong

Comments: Technical report. Yiran Zhong is the corresponding author

Subjects: Computation and Language (cs.CL)

[1483] arXiv:2406.16694 [pdf, html, other]

Title: Task Oriented In-Domain Data Augmentation

Xiao Liang, Xinyu Hu, Simiao Zuo, Yeyun Gong, Qiang Lou, Yi Liu, Shao-Lun Huang, Jian Jiao

Subjects: Computation and Language (cs.CL)

[1484] arXiv:2406.16714 [pdf, html, other]

Title: AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models

Jiale Cheng, Yida Lu, Xiaotao Gu, Pei Ke, Xiao Liu, Yuxiao Dong, Hongning Wang, Jie Tang, Minlie Huang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1485] arXiv:2406.16722 [pdf, other]

Title: Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba

Yuchen Zou, Yineng Chen, Zuchao Li, Lefei Zhang, Hai Zhao

Subjects: Computation and Language (cs.CL)

[1486] arXiv:2406.16732 [pdf, html, other]

Title: CLIMATELI: Evaluating Entity Linking on Climate Change Data

Shijia Zhou, Siyao Peng, Barbara Plank

Comments: 8 pages, accepted at ClimateNLP 2024 workshop @ ACL 2024

Subjects: Computation and Language (cs.CL)

[1487] arXiv:2406.16743 [pdf, html, other]

Title: Adversarial Contrastive Decoding: Boosting Safety Alignment of Large Language Models via Opposite Prompt Optimization

Zhengyue Zhao, Xiaoyun Zhang, Kaidi Xu, Xing Hu, Rui Zhang, Zidong Du, Qi Guo, Yunji Chen

Subjects: Computation and Language (cs.CL)

[1488] arXiv:2406.16747 [pdf, html, other]

Title: Sparser is Faster and Less is More: Efficient Sparse Attention for Long-Range Transformers

Chao Lou, Zixia Jia, Zilong Zheng, Kewei Tu

Comments: preprint

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1489] arXiv:2406.16751 [pdf, html, other]

Title: Towards Zero-Shot Text-To-Speech for Arabic Dialects

Khai Duy Doan, Abdul Waheed, Muhammad Abdul-Mageed

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1490] arXiv:2406.16758 [pdf, html, other]

Title: Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters

Euiin Yi, Taehyeon Kim, Hongseok Jeung, Du-Seong Chang, Se-Young Yun

Subjects: Computation and Language (cs.CL)

[1491] arXiv:2406.16767 [pdf, html, other]

Title: The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories

Xi Yu Huang, Krishnapriya Vishnubhotla, Frank Rudzicz

Subjects: Computation and Language (cs.CL)

[1492] arXiv:2406.16772 [pdf, html, other]

Title: OlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far?

Zhen Huang, Zengzhi Wang, Shijie Xia, Pengfei Liu

Comments: 10 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1493] arXiv:2406.16777 [pdf, html, other]

Title: Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024

Sai Koneru, Thai-Binh Nguyen, Ngoc-Quan Pham, Danni Liu, Zhaolin Li, Alexander Waibel, Jan Niehues

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1494] arXiv:2406.16778 [pdf, html, other]

Title: Finding Transformer Circuits with Edge Pruning

Adithya Bhaskar, Alexander Wettig, Dan Friedman, Danqi Chen

Comments: We release our code and data publicly at this https URL

Subjects: Computation and Language (cs.CL)

[1495] arXiv:2406.16779 [pdf, html, other]

Title: It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension

Sagi Shaier, Lawrence E Hunter, Katharina von der Wense

Comments: Accepted to ACL Findings

Subjects: Computation and Language (cs.CL)

[1496] arXiv:2406.16783 [pdf, html, other]

Title: M2Lingual: Enhancing Multilingual, Multi-Turn Instruction Alignment in Large Language Models

Rishabh Maheshwary, Vikas Yadav, Hoang Nguyen, Khyati Mahajan, Sathwik Tejaswi Madhusudhan

Comments: 39 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1497] arXiv:2406.16797 [pdf, html, other]

Title: Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs

Ashwinee Panda, Berivan Isik, Xiangyu Qi, Sanmi Koyejo, Tsachy Weissman, Prateek Mittal

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1498] arXiv:2406.16801 [pdf, html, other]

Title: RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale

Beck LaBash, August Rosedale, Alex Reents, Lucas Negritto, Colin Wiel

Subjects: Computation and Language (cs.CL)

[1499] arXiv:2406.16829 [pdf, html, other]

Title: Understanding and Mitigating Tokenization Bias in Language Models

Buu Phan, Marton Havasi, Matthew Muckley, Karen Ullrich

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1500] arXiv:2406.16833 [pdf, html, other]

Title: USDC: A Dataset of $\underline{U}$ser $\underline{S}$tance and $\underline{D}$ogmatism in Long $\underline{C}$onversations

Mounika Marreddy, Subba Reddy Oota, Venkata Charan Chinni, Manish Gupta, Lucie Flek

Comments: 32 pages, 18 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1501] arXiv:2406.16838 [pdf, other]

Title: From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models

Sean Welleck, Amanda Bertsch, Matthew Finlayson, Hailey Schoelkopf, Alex Xie, Graham Neubig, Ilia Kulikov, Zaid Harchaoui

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1502] arXiv:2406.16842 [pdf, html, other]

Title: Exploring Factual Entailment with NLI: A News Media Study

Guy Mor-Lan, Effi Levi

Comments: Presented at *SEM 2024

Subjects: Computation and Language (cs.CL)

[1503] arXiv:2406.16845 [pdf, html, other]

Title: RaTEScore: A Metric for Radiology Report Generation

Weike Zhao, Chaoyi Wu, Xiaoman Zhang, Ya Zhang, Yanfeng Wang, Weidi Xie

Comments: EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1504] arXiv:2406.16851 [pdf, html, other]

Title: Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts

Aditya Sharma, Michael Saxon, William Yang Wang

Comments: Findings of EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1505] arXiv:2406.16858 [pdf, html, other]

Title: EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees

Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang Zhang

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1506] arXiv:2406.16890 [pdf, html, other]

Title: TextAge: A Curated and Diverse Text Dataset for Age Classification

Shravan Cheekati, Mridul Gupta, Vibha Raghu, Pranav Raj

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1507] arXiv:2406.16891 [pdf, other]

Title: Survey on Reasoning Capabilities and Accessibility of Large Language Models Using Biology-related Questions

Michael Ackerman

Comments: 19 pages, 5 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1508] arXiv:2406.16892 [pdf, html, other]

Title: Multilingual Entity Linking Using Dense Retrieval

Dominik Farhan

Comments: Bachelor's thesis, Charles University

Subjects: Computation and Language (cs.CL)

[1509] arXiv:2406.16893 [pdf, html, other]

Title: A Survey on Transformers in NLP with Focus on Efficiency

Wazib Ansar, Saptarsi Goswami, Amlan Chakrabarti

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1510] arXiv:2406.16897 [pdf, html, other]

Title: InstructPatentGPT: Training patent language models to follow instructions with human feedback

Jieh-Sheng Lee

Comments: 41 pages. Artif Intell Law (2024)

Subjects: Computation and Language (cs.CL)

[1511] arXiv:2406.16899 [pdf, html, other]

Title: Prompt-based vs. Fine-tuned LLMs Toward Causal Graph Verification

Yuni Susanti, Nina Holsmoelle

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1512] arXiv:2406.16925 [pdf, html, other]

Title: Analyzing Multi-Head Attention on Trojan BERT Models

Jingwei Wang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1513] arXiv:2406.16937 [pdf, html, other]

Title: A Complete Survey on LLM-based AI Chatbots

Sumit Kumar Dam, Choong Seon Hong, Yu Qiao, Chaoning Zhang

Comments: 23 pages, 10 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1514] arXiv:2406.17038 [pdf, html, other]

Title: modeLing: A Novel Dataset for Testing Linguistic Reasoning in Language Models

Nathan A. Chi, Teodor Malchev, Riley Kong, Ryan A. Chi, Lucas Huang, Ethan A. Chi, R. Thomas McCoy, Dragomir Radev

Subjects: Computation and Language (cs.CL)

[1515] arXiv:2406.17055 [pdf, html, other]

Title: Large Language Models Assume People are More Rational than We Really are

Ryan Liu, Jiayi Geng, Joshua C. Peterson, Ilia Sucholutsky, Thomas L. Griffiths

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1516] arXiv:2406.17095 [pdf, html, other]

Title: Attention Instruction: Amplifying Attention in the Middle via Prompting

Meiru Zhang, Zaiqiao Meng, Nigel Collier

Subjects: Computation and Language (cs.CL)

[1517] arXiv:2406.17104 [pdf, html, other]

Title: Automated Adversarial Discovery for Safety Classifiers

Yash Kumar Lal, Preethi Lahoti, Aradhana Sinha, Yao Qin, Ananth Balashankar

Comments: Published at Fourth Workshop on TrustworthyNLP (TrustNLP) at NAACL 2024

Subjects: Computation and Language (cs.CL)

[1518] arXiv:2406.17158 [pdf, html, other]

Title: DEXTER: A Benchmark for open-domain Complex Question Answering using LLMs

Venktesh V. Deepali Prabhu, Avishek Anand

Comments: under submission, 22 pages

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1519] arXiv:2406.17163 [pdf, html, other]

Title: Paraphrase and Aggregate with Large Language Models for Minimizing Intent Classification Errors

Vikas Yadav, Zheng Tang, Vijay Srinivasan

Comments: Accepted at SIGIR 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1520] arXiv:2406.17169 [pdf, html, other]

Title: Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Models

Nisarg Patel, Mohith Kulkarni, Mihir Parmar, Aashna Budhiraja, Mutsumi Nakamura, Neeraj Varshney, Chitta Baral

Comments: Accepted at EMNLP 2024 Main

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1521] arXiv:2406.17185 [pdf, html, other]

Title: Vaporetto: Efficient Japanese Tokenization Based on Improved Pointwise Linear Classification

Koichi Akabe, Shunsuke Kanda, Yusuke Oda, Shinsuke Mori

Subjects: Computation and Language (cs.CL)

[1522] arXiv:2406.17186 [pdf, html, other]

Title: CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generation

Abe Bohan Hou, Orion Weller, Guanghui Qin, Eugene Yang, Dawn Lawrie, Nils Holzenberger, Andrew Blair-Stanek, Benjamin Van Durme

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY)

[1523] arXiv:2406.17213 [pdf, html, other]

Title: Detecting Frames in News Headlines and Lead Images in U.S. Gun Violence Coverage

Isidora Chara Tourni, Lei Guo, Hengchang Hu, Edward Halim, Prakash Ishwar, Taufiq Daryanto, Mona Jalal, Boqi Chen, Margrit Betke, Fabian Zhafransyah, Sha Lai, Derry Tanti Wijaya

Comments: published at Findings of the Association for Computational Linguistics: EMNLP 2021

Subjects: Computation and Language (cs.CL)

[1524] arXiv:2406.17231 [pdf, html, other]

Title: CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph

Tong Zhou, Yubo Chen, Kang Liu, Jun Zhao

Subjects: Computation and Language (cs.CL)

[1525] arXiv:2406.17232 [pdf, html, other]

Title: Beyond Demographics: Aligning Role-playing LLM-based Agents Using Human Belief Networks

Yun-Shiuan Chuang, Krirk Nirunwiroj, Zach Studdiford, Agam Goyal, Vincent V. Frigo, Sijia Yang, Dhavan Shah, Junjie Hu, Timothy T. Rogers

Journal-ref: Findings of the Association for Computational Linguistics (ACL): EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1526] arXiv:2406.17241 [pdf, html, other]

Title: What Do the Circuits Mean? A Knowledge Edit View

Huaizhi Ge, Frank Rudzicz, Zining Zhu

Subjects: Computation and Language (cs.CL)

[1527] arXiv:2406.17253 [pdf, html, other]

Title: How Well Can Knowledge Edit Methods Edit Perplexing Knowledge?

Huaizhi Ge, Frank Rudzicz, Zining Zhu

Subjects: Computation and Language (cs.CL)

[1528] arXiv:2406.17255 [pdf, html, other]

Title: MPCODER: Multi-user Personalized Code Generator with Explicit and Implicit Style Representation Learning

Zhenlong Dai, Chang Yao, WenKang Han, Ying Yuan, Zhipeng Gao, Jingyuan Chen

Comments: Accepted by ACL 2024, Main Conference

Subjects: Computation and Language (cs.CL)

[1529] arXiv:2406.17257 [pdf, html, other]

Title: Leveraging Parameter-Efficient Transfer Learning for Multi-Lingual Text-to-Speech Adaptation

Yingting Li, Ambuj Mehrish, Bryan Chew, Bo Cheng, Soujanya Poria

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1530] arXiv:2406.17260 [pdf, html, other]

Title: Mitigating Hallucination in Fictional Character Role-Play

Nafis Sadeq, Zhouhang Xie, Byungkyu Kang, Prarit Lamba, Xiang Gao, Julian McAuley

Subjects: Computation and Language (cs.CL)

[1531] arXiv:2406.17261 [pdf, html, other]

Title: TRAWL: Tensor Reduced and Approximated Weights for Large Language Models

Yiran Luo, Het Patel, Yu Fu, Dawon Ahn, Jia Chen, Yue Dong, Evangelos E. Papalexakis

Comments: 8 pages, 5 figures. Submitted to EMNLP 2024 and under review

Subjects: Computation and Language (cs.CL)

[1532] arXiv:2406.17262 [pdf, html, other]

Title: D2LLM: Decomposed and Distilled Large Language Models for Semantic Search

Zihan Liao, Hang Yu, Jianguo Li, Jun Wang, Wei Zhang

Subjects: Computation and Language (cs.CL)

[1533] arXiv:2406.17271 [pdf, html, other]

Title: DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph

Zhehao Zhang, Jiaao Chen, Diyi Yang

Subjects: Computation and Language (cs.CL)

[1534] arXiv:2406.17274 [pdf, html, other]

Title: Can We Trust the Performance Evaluation of Uncertainty Estimation Methods in Text Summarization?

Jianfeng He, Runing Yang, Linlin Yu, Changbin Li, Ruoxi Jia, Feng Chen, Ming Jin, Chang-Tien Lu

Comments: 62 pages, 41 figures, 11 tables

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1535] arXiv:2406.17276 [pdf, html, other]

Title: OPT-Tree: Speculative Decoding with Adaptive Draft Tree Structure

Jikai Wang, Yi Su, Juntao Li, Qingrong Xia, Zi Ye, Xinyu Duan, Zhefeng Wang, Min Zhang

Subjects: Computation and Language (cs.CL)

[1536] arXiv:2406.17282 [pdf, html, other]

Title: SetBERT: Enhancing Retrieval Performance for Boolean Logic and Set Operation Queries

Quan Mai, Susan Gauch, Douglas Adams

Comments: 10 pages, 1 figure

Subjects: Computation and Language (cs.CL)

[1537] arXiv:2406.17283 [pdf, other]

Title: A Recursive Encoding for Cuneiform Signs

Daniel M. Stelzer (University of Illinois at Urbana-Champaign)

Comments: 27 pages, 29 figures, 5 tables

Subjects: Computation and Language (cs.CL)

[1538] arXiv:2406.17287 [pdf, html, other]

Title: Predicting the Big Five Personality Traits in Chinese Counselling Dialogues Using Large Language Models

Yang Yan, Lizhi Ma, Anqi Li, Jingsong Ma, Zhenzhong Lan

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1539] arXiv:2406.17294 [pdf, html, other]

Title: Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models

Wenhao Shi, Zhiqiang Hu, Yi Bin, Junhua Liu, Yang Yang, See-Kiong Ng, Lidong Bing, Roy Ka-Wei Lee

Comments: Accepted at Findings of EMNLP2024

Subjects: Computation and Language (cs.CL)

[1540] arXiv:2406.17300 [pdf, html, other]

Title: CausalScore: An Automatic Reference-Free Metric for Assessing Response Relevance in Open-Domain Dialogue Systems

Tao Feng, Lizhen Qu, Xiaoxi Kang, Gholamreza Haffari

Subjects: Computation and Language (cs.CL)

[1541] arXiv:2406.17304 [pdf, html, other]

Title: Leveraging LLMs for Dialogue Quality Measurement

Jinghan Jia, Abi Komma, Timothy Leffel, Xujun Peng, Ajay Nagesh, Tamer Soliman, Aram Galstyan, Anoop Kumar

Subjects: Computation and Language (cs.CL)

[1542] arXiv:2406.17305 [pdf, html, other]

Title: Retrieval Augmented Instruction Tuning for Open NER with Large Language Models

Tingyu Xie, Jian Zhang, Yan Zhang, Yuanyuan Liang, Qi Li, Hongwei Wang

Subjects: Computation and Language (cs.CL)

[1543] arXiv:2406.17312 [pdf, html, other]

Title: Not All Preference Pairs Are Created Equal: A Recipe for Annotation-Efficient Iterative Preference Learning

Sen Yang, Leyang Cui, Deng Cai, Xinting Huang, Shuming Shi, Wai Lam

Comments: Findings of EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1544] arXiv:2406.17324 [pdf, html, other]

Title: Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomy

Simone Astarita, Sandor Kruk, Jan Reerink, Pablo Gómez

Comments: Accepted at SPAICE 2024

Journal-ref: Proceedings of SPAICE2024 (2024) 241-246

Subjects: Computation and Language (cs.CL); Instrumentation and Methods for Astrophysics (astro-ph.IM); Digital Libraries (cs.DL)

[1545] arXiv:2406.17328 [pdf, html, other]

Title: Dual-Space Knowledge Distillation for Large Language Models

Songming Zhang, Xue Zhang, Zengkui Sun, Yufeng Chen, Jinan Xu

Comments: The camera-ready version for EMNLP 2024 main conference. 17 pages, 11 figures, code available at: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1546] arXiv:2406.17363 [pdf, html, other]

Title: Leveraging Synthetic Audio Data for End-to-End Low-Resource Speech Translation

Yasmin Moslem

Comments: IWSLT 2024

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1547] arXiv:2406.17375 [pdf, html, other]

Title: An Empirical Study on the Characteristics of Bias upon Context Length Variation for Bangla

Jayanta Sadhu, Ayan Antik Khan, Abhik Bhattacharjee, Rifat Shahriyar

Comments: Accepted in Findings of ACL, 2024

Subjects: Computation and Language (cs.CL)

[1548] arXiv:2406.17377 [pdf, html, other]

Title: A Three-Pronged Approach to Cross-Lingual Adaptation with Multilingual LLMs

Vaibhav Singh, Amrith Krishna, Karthika NJ, Ganesh Ramakrishnan

Subjects: Computation and Language (cs.CL)

[1549] arXiv:2406.17378 [pdf, html, other]

Title: A Text is Worth Several Tokens: Text Embedding from LLMs Secretly Aligns Well with The Key Tokens

Zhijie Nie, Richong Zhang, Zhanyu Wu

Comments: Work in Progress

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1550] arXiv:2406.17385 [pdf, html, other]

Title: Native Design Bias: Studying the Impact of English Nativeness on Language Model Performance

Manon Reusens, Philipp Borchert, Jochen De Weerdt, Bart Baesens

Subjects: Computation and Language (cs.CL)

[1551] arXiv:2406.17404 [pdf, html, other]

Title: Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training

Yixuan Wang, Xianzhen Luo, Fuxuan Wei, Yijun Liu, Qingfu Zhu, Xuanyu Zhang, Qing Yang, Dongliang Xu, Wanxiang Che

Comments: EMNLP 2024, camera ready

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1552] arXiv:2406.17415 [pdf, html, other]

Title: Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels

Razvan-Gabriel Dumitru, Vikas Yadav, Rishabh Maheshwary, Paul-Ioan Clotan, Sathwik Tejaswi Madhusudhan, Mihai Surdeanu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1553] arXiv:2406.17419 [pdf, html, other]

Title: Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA

Minzheng Wang, Longze Chen, Cheng Fu, Shengyi Liao, Xinghua Zhang, Bingli Wu, Haiyang Yu, Nan Xu, Lei Zhang, Run Luo, Yunshui Li, Min Yang, Fei Huang, Yongbin Li

Comments: EMNLP 2024 Main. We release our code and data publicly at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1554] arXiv:2406.17430 [pdf, html, other]

Title: Towards Probing Speech-Specific Risks in Large Multimodal Models: A Taxonomy, Benchmark, and Insights

Hao Yang, Lizhen Qu, Ehsan Shareghi, Gholamreza Haffari

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1555] arXiv:2406.17453 [pdf, html, other]

Title: Learning to Ask Informative Questions: Enhancing LLMs with Preference Optimization and Expected Information Gain

Davide Mazzaccara, Alberto Testoni, Raffaella Bernardi

Comments: Accepted to EMNLP 2024 (Findings)

Subjects: Computation and Language (cs.CL)

[1556] arXiv:2406.17456 [pdf, html, other]

Title: Improving Grammatical Error Correction via Contextual Data Augmentation

Yixuan Wang, Baoxin Wang, Yijun Liu, Qingfu Zhu, Dayong Wu, Wanxiang Che

Comments: Accepted as Findings of ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1557] arXiv:2406.17465 [pdf, html, other]

Title: Enhancing Tool Retrieval with Iterative Feedback from Large Language Models

Qiancheng Xu, Yongqi Li, Heming Xia, Wenjie Li

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1558] arXiv:2406.17474 [pdf, html, other]

Title: Transformer-based Named Entity Recognition with Combined Data Representation

Michał Marcińczuk

Comments: 14 pages, 6 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1559] arXiv:2406.17484 [pdf, html, other]

Title: MedCare: Advancing Medical LLMs through Decoupling Clinical Alignment and Knowledge Aggregation

Yusheng Liao, Shuyang Jiang, Zhe Chen, Yanfeng Wang, Yu Wang

Comments: EMNLP2024 Findings

Subjects: Computation and Language (cs.CL)

[1560] arXiv:2406.17513 [pdf, html, other]

Title: Benchmarking Mental State Representations in Language Models

Matteo Bortoletto, Constantin Ruhdorfer, Lei Shi, Andreas Bulling

Comments: ICML 2024 Workshop on Mechanistic Interpretability

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1561] arXiv:2406.17519 [pdf, html, other]

Title: Entropy-Based Decoding for Retrieval-Augmented Large Language Models

Zexuan Qiu, Zijing Ou, Bin Wu, Jingjing Li, Aiwei Liu, Irwin King

Subjects: Computation and Language (cs.CL)

[1562] arXiv:2406.17526 [pdf, html, other]

Title: LumberChunker: Long-Form Narrative Document Segmentation

André V. Duarte, João Marques, Miguel Graça, Miguel Freire, Lei Li, Arlindo L. Oliveira

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1563] arXiv:2406.17534 [pdf, html, other]

Title: Retrieval-style In-Context Learning for Few-shot Hierarchical Text Classification

Huiyao Chen, Yu Zhao, Zulong Chen, Mengjia Wang, Liangyue Li, Meishan Zhang, Min Zhang

Comments: 17 pages

Subjects: Computation and Language (cs.CL)

[1564] arXiv:2406.17535 [pdf, html, other]

Title: Disce aut Deficere: Evaluating LLMs Proficiency on the INVALSI Italian Benchmark

Fabio Mercorio, Mario Mezzanzanica, Daniele Potertì, Antonio Serino, Andrea Seveso

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1565] arXiv:2406.17553 [pdf, html, other]

Title: Retrieval-Augmented Code Generation for Situated Action Generation: A Case Study on Minecraft

Chalamalasetti Kranti, Sherzod Hakimov, David Schlangen

Comments: under review

Subjects: Computation and Language (cs.CL)

[1566] arXiv:2406.17557 [pdf, html, other]

Title: The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Guilherme Penedo, Hynek Kydlíček, Loubna Ben allal, Anton Lozhkov, Margaret Mitchell, Colin Raffel, Leandro Von Werra, Thomas Wolf

Subjects: Computation and Language (cs.CL)

[1567] arXiv:2406.17563 [pdf, html, other]

Title: Multi-property Steering of Large Language Models with Dynamic Activation Composition

Daniel Scalena, Gabriele Sarti, Malvina Nissim

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1568] arXiv:2406.17566 [pdf, html, other]

Title: FrenchToxicityPrompts: a Large Benchmark for Evaluating and Mitigating Toxicity in French Texts

Caroline Brun, Vassilina Nikoulina

Comments: TRAC-2024, Fourth Workshop on Threat, Aggression and Cyberbullying. 20 May 2024

Subjects: Computation and Language (cs.CL)

[1569] arXiv:2406.17574 [pdf, html, other]

Title: Beyond Text-to-SQL for IoT Defense: A Comprehensive Framework for Querying and Classifying IoT Threats

Ryan Pavlich, Nima Ebadi, Richard Tarbell, Billy Linares, Adrian Tan, Rachael Humphreys, Jayanta Kumar Das, Rambod Ghandiparsi, Hannah Haley, Jerris George, Rocky Slavin, Kim-Kwang Raymond Choo, Glenn Dietrich, Anthony Rios

Subjects: Computation and Language (cs.CL)

[1570] arXiv:2406.17588 [pdf, html, other]

Title: LongIns: A Challenging Long-context Instruction-based Exam for LLMs

Shawn Gavin, Tuney Zheng, Jiaheng Liu, Quehry Que, Noah Wang, Jian Yang, Chenchen Zhang, Wenhao Huang, Wenhu Chen, Ge Zhang

Subjects: Computation and Language (cs.CL)

[1571] arXiv:2406.17600 [pdf, html, other]

Title: "Seeing the Big through the Small": Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?

Beiduo Chen, Xinpeng Wang, Siyao Peng, Robert Litschko, Anna Korhonen, Barbara Plank

Comments: Accepted by EMNLP 2024 Findings, 24 pages, 9 figures

Subjects: Computation and Language (cs.CL)

[1572] arXiv:2406.17624 [pdf, html, other]

Title: Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models

Zhiyuan Wen, Yu Yang, Jiannong Cao, Haoming Sun, Ruosong Yang, Shuaiqi Liu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1573] arXiv:2406.17626 [pdf, other]

Title: CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreference

Erxin Yu, Jing Li, Ming Liao, Siqi Wang, Zuchen Gao, Fei Mi, Lanqing Hong

Comments: Submitted to EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1574] arXiv:2406.17633 [pdf, html, other]

Title: Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels

Nicholas Pangakis, Samuel Wolken

Comments: In Proceedings of the Sixth Workshop on Natural Language Processing and Computational Social Science

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1575] arXiv:2406.17642 [pdf, html, other]

Title: Banishing LLM Hallucinations Requires Rethinking Generalization

Johnny Li, Saksham Consul, Eda Zhou, James Wong, Naila Farooqui, Yuxin Ye, Nithyashree Manohar, Zhuxiaona Wei, Tian Wu, Ben Echols, Sharon Zhou, Gregory Diamos

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1576] arXiv:2406.17647 [pdf, html, other]

Title: Variationist: Exploring Multifaceted Variation and Bias in Written Language Data

Alan Ramponi, Camilla Casula, Stefano Menini

Comments: ACL 2024 (System Demonstrations)

Subjects: Computation and Language (cs.CL)

[1577] arXiv:2406.17663 [pdf, html, other]

Title: LLM-ARC: Enhancing LLMs with an Automated Reasoning Critic

Aditya Kalyanpur, Kailash Karthik Saravanakumar, Victor Barres, Jennifer Chu-Carroll, David Melville, David Ferrucci

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Logic in Computer Science (cs.LO)

[1578] arXiv:2406.17675 [pdf, html, other]

Title: Quantifying AI Psychology: A Psychometrics Benchmark for Large Language Models

Yuan Li, Yue Huang, Hongyi Wang, Xiangliang Zhang, James Zou, Lichao Sun

Subjects: Computation and Language (cs.CL)

[1579] arXiv:2406.17681 [pdf, html, other]

Title: VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation

Kun Qian, Shunji Wan, Claudia Tang, Youzhi Wang, Xuanming Zhang, Maximillian Chen, Zhou Yu

Subjects: Computation and Language (cs.CL)

[1580] arXiv:2406.17692 [pdf, other]

Title: From Distributional to Overton Pluralism: Investigating Large Language Model Alignment

Thom Lake, Eunsol Choi, Greg Durrett

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1581] arXiv:2406.17716 [pdf, html, other]

Title: ViANLI: Adversarial Natural Language Inference for Vietnamese

Tin Van Huynh, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen

Subjects: Computation and Language (cs.CL)

[1582] arXiv:2406.17737 [pdf, html, other]

Title: LLM Targeted Underperformance Disproportionately Impacts Vulnerable Users

Elinor Poole-Dayan, Deb Roy, Jad Kabbara

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1583] arXiv:2406.17739 [pdf, html, other]

Title: Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model

Fei Xia, Yixuan Weng, Shizhu He, Kang Liu, Jun Zhao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1584] arXiv:2406.17744 [pdf, html, other]

Title: Following Length Constraints in Instructions

Weizhe Yuan, Ilia Kulikov, Ping Yu, Kyunghyun Cho, Sainbayar Sukhbaatar, Jason Weston, Jing Xu

Comments: 13 pages

Subjects: Computation and Language (cs.CL)

[1585] arXiv:2406.17746 [pdf, html, other]

Title: Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon

USVSN Sai Prashanth, Alvin Deng, Kyle O'Brien, Jyothir S V, Mohammad Aflah Khan, Jaydeep Borkar, Christopher A. Choquette-Choo, Jacob Ray Fuehne, Stella Biderman, Tracy Ke, Katherine Lee, Naomi Saphra

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1586] arXiv:2406.17753 [pdf, other]

Title: Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Language

Amalie Brogaard Pauli, Isabelle Augenstein, Ira Assent

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1587] arXiv:2406.17755 [pdf, html, other]

Title: Accelerating Clinical Evidence Synthesis with Large Language Models

Zifeng Wang, Lang Cao, Benjamin Danek, Qiao Jin, Zhiyong Lu, Jimeng Sun

Subjects: Computation and Language (cs.CL)

[1588] arXiv:2406.17761 [pdf, html, other]

Title: CaLMQA: Exploring culturally specific long-form question answering across 23 languages

Shane Arora, Marzena Karpinska, Hung-Ting Chen, Ipsita Bhattacharjee, Mohit Iyyer, Eunsol Choi

Comments: 39 pages, 17 figures. Code and data available at this https URL. Revised argument in section 4, results unchanged

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1589] arXiv:2406.17764 [pdf, html, other]

Title: BMIKE-53: Investigating Cross-Lingual Knowledge Editing with In-Context Learning

Ercong Nie, Bo Shao, Zifeng Ding, Mingyang Wang, Helmut Schmid, Hinrich Schütze

Comments: 12 pages, 4 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1590] arXiv:2406.17787 [pdf, other]

Title: Role of Dependency Distance in Text Simplification: A Human vs ChatGPT Simplification Comparison

Sumi Lee, Gondy Leroy, David Kauchak, Melissa Just

Subjects: Computation and Language (cs.CL)

[1591] arXiv:2406.17789 [pdf, html, other]

Title: Spanish and LLM Benchmarks: is MMLU Lost in Translation?

Irene Plaza, Nina Melero, Cristina del Pozo, Javier Conde, Pedro Reviriego, Marina Mayor-Rocher, María Grandury

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1592] arXiv:2406.17790 [pdf, html, other]

Title: Mashee at SemEval-2024 Task 8: The Impact of Samples Quality on the Performance of In-Context Learning for Machine Text Classification

Areeg Fahad Rasheed, M. Zarkoosh

Subjects: Computation and Language (cs.CL)

[1593] arXiv:2406.17803 [pdf, html, other]

Title: Understanding the Role of User Profile in the Personalization of Large Language Models

Bin Wu, Zhengyan Shi, Hossein A. Rahmani, Varsha Ramineni, Emine Yilmaz

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[1594] arXiv:2406.17805 [pdf, html, other]

Title: Can LLMs Generate Visualizations with Dataless Prompts?

Darius Coelho, Harshit Barot, Naitik Rathod, Klaus Mueller

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[1595] arXiv:2406.17806 [pdf, html, other]

Title: MOSSBench: Is Your Multimodal Language Model Oversensitive to Safe Queries?

Xirui Li, Hengguang Zhou, Ruochen Wang, Tianyi Zhou, Minhao Cheng, Cho-Jui Hsieh

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1596] arXiv:2406.17807 [pdf, other]

Title: Enhancing Commentary Strategies for Imperfect Information Card Games: A Study of Large Language Models in Guandan Commentary

Meiling Tao, Xuechen Liang, Ziyi Wang, Yiling Tao, Tianyu Shi

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1597] arXiv:2406.17808 [pdf, html, other]

Title: Training-Free Exponential Context Extension via Cascading KV Cache

Jeffrey Willette, Heejun Lee, Youngwan Lee, Myeongjae Jeon, Sung Ju Hwang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1598] arXiv:2406.17825 [pdf, other]

Title: Automatic speech recognition for the Nepali language using CNN, bidirectional LSTM and ResNet

Manish Dhakal, Arman Chhetri, Aman Kumar Gupta, Prabin Lamichhane, Suraj Pandey, Subarna Shakya

Comments: Accepted at 2022 International Conference on Inventive Computation Technologies (ICICT), IEEE

Journal-ref: 2022 International Conference on Inventive Computation Technologies (ICICT), pp. 515-521

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1599] arXiv:2406.17873 [pdf, html, other]

Title: Improving Arithmetic Reasoning Ability of Large Language Models through Relation Tuples, Verification and Dynamic Feedback

Zhongtao Miao, Kaiyan Zhao, Yoshimasa Tsuruoka

Comments: Under review, 25 figures, 8 tables, 29 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1600] arXiv:2406.17875 [pdf, html, other]

Title: Cloaked Classifiers: Pseudonymization Strategies on Sensitive Classification Tasks

Arij Riabi, Menel Mahamdi, Virginie Mouilleron, Djamé Seddah

Comments: Proceedings of the fifth Workshop on Privacy in Natural Language Processing

Subjects: Computation and Language (cs.CL)

[1601] arXiv:2406.17888 [pdf, html, other]

Title: CTBench: A Comprehensive Benchmark for Evaluating Language Model Capabilities in Clinical Trial Design

Nafis Neehal, Bowen Wang, Shayom Debopadhaya, Soham Dan, Keerthiram Murugesan, Vibha Anand, Kristin P. Bennett

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1602] arXiv:2406.17901 [pdf, other]

Title: Script-Agnostic Language Identification

Milind Agarwal, Joshua Otten, Antonios Anastasopoulos

Comments: Under Review in ACL Rolling Review

Subjects: Computation and Language (cs.CL)

[1603] arXiv:2406.17903 [pdf, html, other]

Title: Mapping the Past: Geographically Linking an Early 20th Century Swedish Encyclopedia with Wikidata

Axel Ahlin, Alfred Myrne, Pierre Nugues

Comments: 9 pages, 3 figures

Journal-ref: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024, pp. 11040--11048

Subjects: Computation and Language (cs.CL); Digital Libraries (cs.DL)

[1604] arXiv:2406.17911 [pdf, html, other]

Title: X-ray Made Simple: Radiology Report Generation and Evaluation with Layman's Terms

Kun Zhao, Chenghao Xiao, Chen Tang, Bohao Yang, Kai Ye, Noura Al Moubayed, Liang Zhan, Chenghua Lin

Subjects: Computation and Language (cs.CL)

[1605] arXiv:2406.17923 [pdf, html, other]

Title: PAFT: A Parallel Training Paradigm for Effective LLM Fine-Tuning

Shiva Kumar Pentyala, Zhichao Wang, Bin Bi, Kiran Ramnath, Xiang-Bo Mao, Regunathan Radhakrishnan, Sitaram Asur, Na (Claire)Cheng

Subjects: Computation and Language (cs.CL)

[1606] arXiv:2406.17926 [pdf, html, other]

Title: FASA: a Flexible and Automatic Speech Aligner for Extracting High-quality Aligned Children Speech Data

Dancheng Liu, Jinjun Xiong

Comments: 4 pages, 1 figure

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1607] arXiv:2406.17935 [pdf, html, other]

Title: Sequential Editing for Lifelong Training of Speech Recognition Models

Devang Kulshreshtha, Saket Dingliwal, Brady Houston, Nikolaos Pappas, Srikanth Ronanki

Comments: INTERSPEECH 2024

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1608] arXiv:2406.17947 [pdf, other]

Title: Do they mean 'us'? Interpreting Referring Expressions in Intergroup Bias

Venkata S Govindarajan, Matianyu Zang, Kyle Mahowald, David Beaver, Junyi Jessy Li

Comments: Accepted to Findings@EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1609] arXiv:2406.17961 [pdf, html, other]

Title: NormTab: Improving Symbolic Reasoning in LLMs Through Tabular Data Normalization

Md Mahadi Hasan Nahid, Davood Rafiei

Comments: Work in Progress

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)

[1610] arXiv:2406.17962 [pdf, html, other]

Title: Crafting Customisable Characters with LLMs: Introducing SimsChat, a Persona-Driven Role-Playing Agent Framework

Bohao Yang, Dong Liu, Chen Tang, Chenghao Xiao, Kun Zhao, Chao Li, Lin Yuan, Guang Yang, Lanxiao Huang, Chenghua Lin

Subjects: Computation and Language (cs.CL)

[1611] arXiv:2406.17967 [pdf, html, other]

Title: Unmasking the Imposters: How Censorship and Domain Adaptation Affect the Detection of Machine-Generated Tweets

Bryan E. Tuck, Rakesh M. Verma

Subjects: Computation and Language (cs.CL)

[1612] arXiv:2406.17969 [pdf, html, other]

Title: Encourage or Inhibit Monosemanticity? Revisit Monosemanticity from a Feature Decorrelation Perspective

Hanqi Yan, Yanzheng Xiang, Guangyi Chen, Yifei Wang, Lin Gui, Yulan He

Comments: EMNLP24, Main, Long

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1613] arXiv:2406.17974 [pdf, html, other]

Title: Evaluating Fairness in Large Vision-Language Models Across Diverse Demographic Attributes and Prompts

Xuyang Wu, Yuan Wang, Hsin-Tai Wu, Zhiqiang Tao, Yi Fang

Comments: Under review

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1614] arXiv:2406.17975 [pdf, html, other]

Title: SoK: Membership Inference Attacks on LLMs are Rushing Nowhere (and How to Fix It)

Matthieu Meeus, Igor Shilov, Shubham Jain, Manuel Faysse, Marek Rei, Yves-Alexandre de Montjoye

Subjects: Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[1615] arXiv:2406.17982 [pdf, html, other]

Title: EDEN: Empathetic Dialogues for English learning

Li Siyan, Teresa Shao, Zhou Yu, Julia Hirschberg

Comments: Accepted into EMNLP Findings

Subjects: Computation and Language (cs.CL)

[1616] arXiv:2406.17987 [pdf, html, other]

Title: Multi-step Inference over Unstructured Data

Aditya Kalyanpur, Kailash Karthik Saravanakumar, Victor Barres, CJ McFate, Lori Moon, Nati Seifu, Maksim Eremeev, Jose Barrera, Abraham Bautista-Castillo, Eric Brown, David Ferrucci

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1617] arXiv:2406.17990 [pdf, html, other]

Title: Explicit Diversity Conditions for Effective Question Answer Generation with Large Language Models

Vikas Yadav, Hyuk Joon Kwon, Vijay Srinivasan, Hongxia Jin

Comments: Published at COLING 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1618] arXiv:2406.17992 [pdf, html, other]

Title: Catching Chameleons: Detecting Evolving Disinformation Generated using Large Language Models

Bohan Jiang, Chengshuai Zhao, Zhen Tan, Huan Liu

Comments: 10 pages, 5 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1619] arXiv:2406.18002 [pdf, html, other]

Title: Decoding with Limited Teacher Supervision Requires Understanding When to Trust the Teacher

Hyunjong Ok, Jegwang Ryu, Jaeho Lee

Comments: 17 pages, 7 figures, EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1620] arXiv:2406.18027 [pdf, html, other]

Title: Automated Clinical Data Extraction with Knowledge Conditioned LLMs

Diya Li, Asim Kadav, Aijing Gao, Rui Li, Richard Bourgon

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1621] arXiv:2406.18034 [pdf, html, other]

Title: LLMs for Doctors: Leveraging Medical LLMs to Assist Doctors, Not Replace Them

Wenya Xie, Qingying Xiao, Yu Zheng, Xidong Wang, Junying Chen, Ke Ji, Anningzhe Gao, Xiang Wan, Feng Jiang, Benyou Wang

Subjects: Computation and Language (cs.CL)

[1622] arXiv:2406.18045 [pdf, html, other]

Title: PharmaGPT: Domain-Specific Large Language Models for Bio-Pharmaceutical and Chemistry

Linqing Chen, Weilei Wang, Zilong Bai, Peng Xu, Yan Fang, Jie Fang, Wentao Wu, Lizhi Zhou, Ruiji Zhang, Yubin Xia, Chaobo Xu, Ran Hu, Licong Xu, Qijun Cai, Haoran Hua, Jing Sun, Jin Liu, Tian Qiu, Haowen Liu, Meng Hu, Xiuwen Li, Fei Gao, Yufu Wang, Lin Tie, Chaochao Wang, Jianping Lu, Cheng Sun, Yixin Wang, Shengjie Yang, Yuancheng Li, Lu Jin, Lisha Zhang, Fu Bian, Zhongkai Ye, Lidong Pei, Changyang Tu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1623] arXiv:2406.18049 [pdf, other]

Title: Improving Entity Recognition Using Ensembles of Deep Learning and Fine-tuned Large Language Models: A Case Study on Adverse Event Extraction from Multiple Sources

Yiming Li, Deepthi Viswaroopan, William He, Jianfu Li, Xu Zuo, Hua Xu, Cui Tao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1624] arXiv:2406.18060 [pdf, html, other]

Title: AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning

Yifan Yang, Kai Zhen, Ershad Banijamal, Athanasios Mouchtaris, Zheng Zhang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1625] arXiv:2406.18064 [pdf, html, other]

Title: Evaluating Quality of Answers for Retrieval-Augmented Generation: A Strong LLM Is All You Need

Yang Wang, Alberto Garcia Hernandez, Roman Kyslyi, Nicholas Kersting

Comments: 13 pages, 8 figures, 12 tables

Subjects: Computation and Language (cs.CL)

[1626] arXiv:2406.18067 [pdf, html, other]

Title: Exploring Energy-Based Models for Out-of-Distribution Detection in Dialect Identification

Yaqian Hao, Chenguang Hu, Yingying Gao, Shilei Zhang, Junlan Feng

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1627] arXiv:2406.18078 [pdf, html, other]

Title: Self-Training with Pseudo-Label Scorer for Aspect Sentiment Quad Prediction

Yice Zhang, Jie Zeng, Weiming Hu, Ziyi Wang, Shiwei Chen, Ruifeng Xu

Comments: Accepted to ACL 2024 Main Conference

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1628] arXiv:2406.18082 [pdf, html, other]

Title: Octo-planner: On-device Language Model for Planner-Action Agents

Wei Chen, Zhiyuan Li, Zhen Guo, Yikang Shen

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1629] arXiv:2406.18085 [pdf, html, other]

Title: Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints

Ran Song, Shizhu He, Shengxiang Gao, Li Cai, Kang Liu, Zhengtao Yu, Jun Zhao

Comments: 11 pages, ACL 2023

Subjects: Computation and Language (cs.CL)

[1630] arXiv:2406.18088 [pdf, html, other]

Title: LLM-Driven Multimodal Opinion Expression Identification

Bonian Jia, Huiyao Chen, Yueheng Sun, Meishan Zhang, Min Zhang

Comments: 5 pages, 3 Figures, Accept by Interspeech 2024

Journal-ref: Proceedings of Interspeech 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1631] arXiv:2406.18094 [pdf, html, other]

Title: Shimo Lab at "Discharge Me!": Discharge Summarization by Prompt-Driven Concatenation of Electronic Health Record Sections

Yunzhen He, Hiroaki Yamagiwa, Hidetoshi Shimodaira

Comments: BioNLP @ ACL2024

Subjects: Computation and Language (cs.CL)

[1632] arXiv:2406.18108 [pdf, html, other]

Title: Token-Weighted RNN-T for Learning from Flawed Data

Gil Keren, Wei Zhou, Ozlem Kalinli

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1633] arXiv:2406.18116 [pdf, html, other]

Title: BADGE: BADminton report Generation and Evaluation with LLM

Shang-Hsuan Chiang, Lin-Wei Chao, Kuang-Da Wang, Chih-Chuan Wang, Wen-Chih Peng

Comments: Accepted by IJCAI 2024 Workshop: The 2nd International Workshop on Intelligent Technologies for Precision Sports Science (IT4PSS)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[1634] arXiv:2406.18120 [pdf, html, other]

Title: ArzEn-LLM: Code-Switched Egyptian Arabic-English Translation and Speech Recognition Using LLMs

Ahmed Heakl, Youssef Zaghloul, Mennatullah Ali, Rania Hossam, Walid Gomaa

Comments: 9 pages, 4 figures, 5 tables, 6th International Conference on AI in Computational Linguistics

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1635] arXiv:2406.18122 [pdf, html, other]

Title: Poisoned LangChain: Jailbreak LLMs by LangChain

Ziqiu Wang, Jun Liu, Shengkai Zhang, Yang Yang

Comments: 6 pages,2 figures,This paper is a submission to ACM TURC. It has been accepted by the editor of the organizer

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1636] arXiv:2406.18125 [pdf, html, other]

Title: ResumeAtlas: Revisiting Resume Classification with Large-Scale Datasets and Large Language Models

Ahmed Heakl, Youssef Mohamed, Noran Mohamed, Aly Elsharkawy, Ahmed Zaky

Comments: 8 pages, 6 figures, 1 table, 6th International Conference on AI in Computational Linguistics

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1637] arXiv:2406.18133 [pdf, html, other]

Title: ConvoCache: Smart Re-Use of Chatbot Responses

Conor Atkins, Ian Wood, Mohamed Ali Kaafar, Hassan Asghar, Nardine Basta, Michal Kepkowski

Comments: Accepted to appear at Interspeech 2024

Journal-ref: Proceedings of Interspeech 2024

Subjects: Computation and Language (cs.CL)

[1638] arXiv:2406.18134 [pdf, other]

Title: Assessing "Implicit" Retrieval Robustness of Large Language Models

Xiaoyu Shen, Rexhina Blloshmi, Dawei Zhu, Jiahuan Pei, Wei Zhang

Subjects: Computation and Language (cs.CL)

[1639] arXiv:2406.18135 [pdf, other]

Title: Automatic Speech Recognition for Hindi

Anish Saha, A.G. Ramakrishnan

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1640] arXiv:2406.18139 [pdf, html, other]

Title: LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference

Zhongwei Wan, Ziang Wu, Che Liu, Jinfa Huang, Zhihong Zhu, Peng Jin, Longyue Wang, Li Yuan

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1641] arXiv:2406.18164 [pdf, html, other]

Title: Nebula: A discourse aware Minecraft Builder

Akshay Chaturvedi, Kate Thompson, Nicholas Asher

Comments: EMNLP 2024 Findings

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1642] arXiv:2406.18173 [pdf, html, other]

Title: UIO-LLMs: Unbiased Incremental Optimization for Long-Context LLMs

Wenhao Li, Mingbao Lin, Yunshan Zhong, Shuicheng Yan, Rongrong Ji

Subjects: Computation and Language (cs.CL)

[1643] arXiv:2406.18187 [pdf, html, other]

Title: Selective Prompting Tuning for Personalized Conversations with LLMs

Qiushi Huang, Xubo Liu, Tom Ko, Bo Wu, Wenwu Wang, Yu Zhang, Lilian Tang

Comments: Accepted to ACL 2024 findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1644] arXiv:2406.18192 [pdf, html, other]

Title: Methodology of Adapting Large English Language Models for Specific Cultural Contexts

Wenjing Zhang, Siqi Xiao, Xuejiao Lei, Ning Wang, Huazheng Zhang, Meijuan An, Bikun Yang, Zhaoxiang Liu, Kai Wang, Shiguo Lian

Comments: 11 pages, 2 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1645] arXiv:2406.18200 [pdf, other]

Title: SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding

Zhenglin Wang, Jialong Wu, Yilong Lai, Congzhi Zhang, Deyu Zhou

Subjects: Computation and Language (cs.CL)

[1646] arXiv:2406.18219 [pdf, html, other]

Title: A Closer Look into Mixture-of-Experts in Large Language Models

Ka Man Lo, Zeyu Huang, Zihan Qiu, Zili Wang, Jie Fu

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1647] arXiv:2406.18221 [pdf, other]

Title: Enhancing Data Privacy in Large Language Models through Private Association Editing

Davide Venditti, Elena Sofia Ruzzetti, Giancarlo A. Xompero, Cristina Giannone, Andrea Favalli, Raniero Romagnoli, Fabio Massimo Zanzotto

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1648] arXiv:2406.18239 [pdf, html, other]

Title: Zero-shot prompt-based classification: topic labeling in times of foundation models in German Tweets

Simon Münker, Kai Kugler, Achim Rettinger

Comments: 10 pages, 2 tables, 1 figure

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1649] arXiv:2406.18245 [pdf, html, other]

Title: Weak Reward Model Transforms Generative Models into Robust Causal Event Extraction Systems

Italo Luis da Silva, Hanqi Yan, Lin Gui, Yulan He

Comments: 13 pages, 6 figures, 6 tables

Subjects: Computation and Language (cs.CL)

[1650] arXiv:2406.18256 [pdf, html, other]

Title: Llamipa: An Incremental Discourse Parser

Kate Thompson, Akshay Chaturvedi, Julie Hunter, Nicholas Asher

Comments: EMNLP 2024 Findings

Subjects: Computation and Language (cs.CL)

[1651] arXiv:2406.18259 [pdf, other]

Title: Detecting Machine-Generated Texts: Not Just "AI vs Humans" and Explainability is Complicated

Jiazhou Ji, Ruizhe Li, Shujun Li, Jie Guo, Weidong Qiu, Zheng Huang, Chiyu Chen, Xiaoyu Jiang, Xinru Lu

Comments: 19 pages, 2 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1652] arXiv:2406.18266 [pdf, html, other]

Title: "Vorbe\c{s}ti Rom\^ane\c{s}te?" A Recipe to Train Powerful Romanian LLMs with English Instructions

Mihai Masala, Denis C. Ilie-Ablachim, Alexandru Dima, Dragos Corlatescu, Miruna Zavelca, Ovio Olaru, Simina Terian, Andrei Terian, Marius Leordeanu, Horia Velicu, Marius Popescu, Mihai Dascalu, Traian Rebedea

Comments: Accepted at The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024 Findings). arXiv admin note: text overlap with arXiv:2405.07703

Subjects: Computation and Language (cs.CL)

[1653] arXiv:2406.18276 [pdf, other]

Title: Sanskrit Knowledge-based Systems: Annotation and Computational Tools

Hrishikesh Terdalkar

Comments: PhD Thesis. 204 pages, 6 publications

Subjects: Computation and Language (cs.CL); Software Engineering (cs.SE)

[1654] arXiv:2406.18294 [pdf, html, other]

Title: Hierarchical Context Pruning: Optimizing Real-World Code Completion with Repository-Level Pretrained Code LLMs

Lei Zhang, Yunshui Li, Jiaming Li, Xiaobo Xia, Jiaxi Yang, Run Luo, Minzheng Wang, Longze Chen, Junhao Liu, Min Yang

Subjects: Computation and Language (cs.CL)

[1655] arXiv:2406.18297 [pdf, html, other]

Title: FactFinders at CheckThat! 2024: Refining Check-worthy Statement Detection with LLMs through Data Pruning

Yufeng Li, Rrubaa Panchendrarajan, Arkaitz Zubiaga

Subjects: Computation and Language (cs.CL)

[1656] arXiv:2406.18305 [pdf, html, other]

Title: S3: A Simple Strong Sample-effective Multimodal Dialog System

Elisei Rykov, Egor Malkershin, Alexander Panchenko

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1657] arXiv:2406.18312 [pdf, html, other]

Title: AI-native Memory: A Pathway from LLMs Towards AGI

Jingbo Shang, Zai Zheng, Jiale Wei, Xiang Ying, Felix Tao, Mindverse Team

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1658] arXiv:2406.18321 [pdf, html, other]

Title: MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math Data

Meng Fang, Xiangpeng Wan, Fei Lu, Fei Xing, Kai Zou

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1659] arXiv:2406.18326 [pdf, html, other]

Title: PaCoST: Paired Confidence Significance Testing for Benchmark Contamination Detection in Large Language Models

Huixuan Zhang, Yun Lin, Xiaojun Wan

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1660] arXiv:2406.18340 [pdf, html, other]

Title: Grammar Assistance Using Syntactic Structures (GAUSS)

Olga Zamaraeva, Lorena S. Allegue, Carlos Gómez-Rodríguez, Anastasiia Ogneva, Margarita Alonso-Ramos

Comments: 5 pages, 4 figures, project summary for CEDI-SEPLN Seminar of the Spanish Society for Natural Language Processing at the 7th Spanish Conference on Informatics, June 19-20, 2024, A Coruña, Spain

Subjects: Computation and Language (cs.CL)

[1661] arXiv:2406.18364 [pdf, other]

Title: Research on Information Extraction of LCSTS Dataset Based on an Improved BERTSum-LSTM Model

Yiming Chen, Haobin Chen, Simin Liu, Yunyun Liu, Fanhao Zhou, Bing Wei

Comments: submitted to ICMIII 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1662] arXiv:2406.18365 [pdf, html, other]

Title: Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability

Xinyu Hu, Li Lin, Mingqi Gao, Xunjian Yin, Xiaojun Wan

Comments: Accepted by EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1663] arXiv:2406.18373 [pdf, html, other]

Title: Dynamic Data Pruning for Automatic Speech Recognition

Qiao Xiao, Pingchuan Ma, Adriana Fernandez-Lopez, Boqian Wu, Lu Yin, Stavros Petridis, Mykola Pechenizkiy, Maja Pantic, Decebal Constantin Mocanu, Shiwei Liu

Comments: Accepted to Interspeech 2024

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1664] arXiv:2406.18400 [pdf, html, other]

Title: Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers

Yibo Jiang, Goutham Rajendran, Pradeep Ravikumar, Bryon Aragam

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[1665] arXiv:2406.18403 [pdf, html, other]

Title: LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks

Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, Desmond Elliott, Raquel Fernández, Albert Gatt, Esam Ghaleb, Mario Giulianelli, Michael Hanna, Alexander Koller, André F. T. Martins, Philipp Mondorf, Vera Neplenbroek, Sandro Pezzelle, Barbara Plank, David Schlangen, Alessandro Suglia, Aditya K Surikuchi, Ece Takmaz, Alberto Testoni

Subjects: Computation and Language (cs.CL)

[1666] arXiv:2406.18406 [pdf, html, other]

Title: IRCAN: Mitigating Knowledge Conflicts in LLM Generation via Identifying and Reweighting Context-Aware Neurons

Dan Shi, Renren Jin, Tianhao Shen, Weilong Dong, Xinwei Wu, Deyi Xiong

Comments: 19 pages, 13 figures, 5 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1667] arXiv:2406.18449 [pdf, html, other]

Title: Cascading Large Language Models for Salient Event Graph Generation

Xingwei Tan, Yuxiang Zhou, Gabriele Pergola, Yulan He

Comments: 9 + 12 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1668] arXiv:2406.18460 [pdf, html, other]

Title: Role-Play Zero-Shot Prompting with Large Language Models for Open-Domain Human-Machine Conversation

Ahmed Njifenjou, Virgile Sucal, Bassam Jabaian, Fabrice Lefèvre

Comments: Updated version of a paper originally submitted at SIGDIAL 2023

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[1669] arXiv:2406.18495 [pdf, html, other]

Title: WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs

Seungju Han, Kavel Rao, Allyson Ettinger, Liwei Jiang, Bill Yuchen Lin, Nathan Lambert, Yejin Choi, Nouha Dziri

Comments: First two authors contributed equally. Third and fourth authors contributed equally

Subjects: Computation and Language (cs.CL)

[1670] arXiv:2406.18501 [pdf, html, other]

Title: Is In-Context Learning a Type of Gradient-Based Learning? Evidence from the Inverse Frequency Effect in Structural Priming

Zhenghao Zhou, Robert Frank, R. Thomas McCoy

Subjects: Computation and Language (cs.CL)

[1671] arXiv:2406.18510 [pdf, html, other]

Title: WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Models

Liwei Jiang, Kavel Rao, Seungju Han, Allyson Ettinger, Faeze Brahman, Sachin Kumar, Niloofar Mireshghallah, Ximing Lu, Maarten Sap, Yejin Choi, Nouha Dziri

Subjects: Computation and Language (cs.CL)

[1672] arXiv:2406.18512 [pdf, html, other]

Title: "Is ChatGPT a Better Explainer than My Professor?": Evaluating the Explanation Capabilities of LLMs in Conversation Compared to a Human Baseline

Grace Li, Milad Alshomary, Smaranda Muresan

Comments: 6 figures, 5 pages

Subjects: Computation and Language (cs.CL)

[1673] arXiv:2406.18518 [pdf, other]

Title: APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasets

Zuxin Liu, Thai Hoang, Jianguo Zhang, Ming Zhu, Tian Lan, Shirley Kokane, Juntao Tan, Weiran Yao, Zhiwei Liu, Yihao Feng, Rithesh Murthy, Liangwei Yang, Silvio Savarese, Juan Carlos Niebles, Huan Wang, Shelby Heinecke, Caiming Xiong

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Software Engineering (cs.SE)

[1674] arXiv:2406.18521 [pdf, other]

Title: CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs

Zirui Wang, Mengzhou Xia, Luxi He, Howard Chen, Yitao Liu, Richard Zhu, Kaiqu Liang, Xindi Wu, Haotian Liu, Sadhika Malladi, Alexis Chevalier, Sanjeev Arora, Danqi Chen

Comments: 121 pages, 90 figures

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1675] arXiv:2406.18528 [pdf, html, other]

Title: PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluation

Christoph Leiter, Steffen Eger

Comments: Preprint

Subjects: Computation and Language (cs.CL)

[1676] arXiv:2406.18532 [pdf, html, other]

Title: Symbolic Learning Enables Self-Evolving Agents

Wangchunshu Zhou, Yixin Ou, Shengwei Ding, Long Li, Jialong Wu, Tiannan Wang, Jiamin Chen, Shuai Wang, Xiaohua Xu, Ningyu Zhang, Huajun Chen, Yuchen Eleanor Jiang

Comments: Code available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1677] arXiv:2406.18534 [pdf, html, other]

Title: Towards Compositionality in Concept Learning

Adam Stein, Aaditya Naik, Yinjun Wu, Mayur Naik, Eric Wong

Comments: Accepted at ICML 2024. 26 pages, 10 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1678] arXiv:2406.18664 [pdf, html, other]

Title: Evaluating Copyright Takedown Methods for Language Models

Boyi Wei, Weijia Shi, Yangsibo Huang, Noah A. Smith, Chiyuan Zhang, Luke Zettlemoyer, Kai Li, Peter Henderson

Comments: 31 pages, 9 figures, 14 tables

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1679] arXiv:2406.18676 [pdf, other]

Title: Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation

Guanting Dong, Yutao Zhu, Chenghao Zhang, Zechen Wang, Zhicheng Dou, Ji-Rong Wen

Comments: Work in progress

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1680] arXiv:2406.18682 [pdf, html, other]

Title: The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harm

Aakanksha, Arash Ahmadian, Beyza Ermis, Seraphina Goldfarb-Tarrant, Julia Kreutzer, Marzieh Fadaee, Sara Hooker

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1681] arXiv:2406.18696 [pdf, html, other]

Title: Sequence Graph Network for Online Debate Analysis

Quan Mai, Susan Gauch, Douglas Adams, Miaoqing Huang

Comments: 8 pages, 4 figures

Subjects: Computation and Language (cs.CL)

[1682] arXiv:2406.18740 [pdf, html, other]

Title: Re-Ranking Step by Step: Investigating Pre-Filtering for Re-Ranking with Large Language Models

Baharan Nouriinanloo, Maxime Lamothe

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1683] arXiv:2406.18762 [pdf, html, other]

Title: Categorical Syllogisms Revisited: A Review of the Logical Reasoning Abilities of LLMs for Analyzing Categorical Syllogism

Shi Zong, Jimmy Lin

Subjects: Computation and Language (cs.CL)

[1684] arXiv:2406.18776 [pdf, html, other]

Title: Implicit Discourse Relation Classification For Nigerian Pidgin

Muhammed Saeed, Peter Bourgonje, Vera Demberg

Subjects: Computation and Language (cs.CL)

[1685] arXiv:2406.18783 [pdf, html, other]

Title: Psychological Profiling in Cybersecurity: A Look at LLMs and Psycholinguistic Features

Jean Marie Tshimula, D'Jeff K. Nkashama, Jean Tshibangu Muabila, René Manassé Galekwa, Hugues Kanda, Maximilien V. Dialufuma, Mbuyi Mukendi Didier, Kalonji Kalala, Serge Mundele, Patience Kinshie Lenye, Tighana Wenge Basele, Aristarque Ilunga, Christian N. Mayemba, Nathanaël M. Kasoro, Selain K. Kasereka, Hardy Mikese, Pierre-Martin Tardif, Marc Frappier, Froduald Kabanza, Belkacem Chikhaoui, Shengrui Wang, Ali Mulenda Sumbu, Xavier Ndona, Raoul Kienge-Kienge Intudi

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1686] arXiv:2406.18832 [pdf, html, other]

Title: OutlierTune: Efficient Channel-Wise Quantization for Large Language Models

Jinguang Wang, Yuexi Yin, Haifeng Sun, Qi Qi, Jingyu Wang, Zirui Zhuang, Tingting Yang, Jianxin Liao

Subjects: Computation and Language (cs.CL)

[1687] arXiv:2406.18847 [pdf, html, other]

Title: Learning Retrieval Augmentation for Personalized Dialogue Generation

Qiushi Huang, Shuai Fu, Xubo Liu, Wenwu Wang, Tom Ko, Yu Zhang, Lilian Tang

Comments: Accepted to EMNLP-2023

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1688] arXiv:2406.18856 [pdf, html, other]

Title: FFN: a Fine-grained Chinese-English Financial Domain Parallel Corpus

Yuxin Fu, Shijing Si, Leyi Mai, Xi-ang Li

Comments: a simplified version of this paper is accepted by International Conference on Asian Language Processing 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE)

[1689] arXiv:2406.18859 [pdf, html, other]

Title: Two-Pronged Human Evaluation of ChatGPT Self-Correction in Radiology Report Simplification

Ziyu Yang, Santhosh Cherian, Slobodan Vucetic

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1690] arXiv:2406.18872 [pdf, html, other]

Title: Efficacy of Language Model Self-Play in Non-Zero-Sum Games

Austen Liao, Nicholas Tomlin, Dan Klein

Subjects: Computation and Language (cs.CL)

[1691] arXiv:2406.18880 [pdf, html, other]

Title: SSP: Self-Supervised Prompting for Cross-Lingual Transfer to Low-Resource Languages using Large Language Models

Vipul Rathore, Aniruddha Deb, Ankish Chandresh, Parag Singla, Mausam

Subjects: Computation and Language (cs.CL)

[1692] arXiv:2406.18895 [pdf, html, other]

Title: Can we teach language models to gloss endangered languages?

Michael Ginn, Mans Hulden, Alexis Palmer

Comments: Accepted to EMNLP 2024 Findings

Subjects: Computation and Language (cs.CL)

[1693] arXiv:2406.18906 [pdf, html, other]

Title: Sonnet or Not, Bot? Poetry Evaluation for Large Models and Datasets

Melanie Walsh, Anna Preus, Maria Antoniak

Comments: 2024 EMNLP Findings

Subjects: Computation and Language (cs.CL)

[1694] arXiv:2406.18907 [pdf, html, other]

Title: Historia Magistra Vitae: Dynamic Topic Modeling of Roman Literature using Neural Embeddings

Michael Ginn, Mans Hulden

Comments: 6 pages, 2 figures

Subjects: Computation and Language (cs.CL)

[1695] arXiv:2406.18910 [pdf, html, other]

Title: Factor-Conditioned Speaking-Style Captioning

Atsushi Ando, Takafumi Moriya, Shota Horiguchi, Ryo Masumura

Comments: Accepted to Interspeech 2024

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1696] arXiv:2406.18916 [pdf, html, other]

Title: TrustUQA: A Trustful Framework for Unified Structured Data Question Answering

Wen Zhang, Long Jin, Yushan Zhu, Jiaoyan Chen, Zhiwei Huang, Junjie Wang, Yin Hua, Lei Liang, Huajun Chen

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1697] arXiv:2406.18921 [pdf, html, other]

Title: Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data

Yiting Ran, Xintao Wang, Rui Xu, Xinfeng Yuan, Jiaqing Liang, Deqing Yang, Yanghua Xiao

Comments: 11 pages, 1 figures

Subjects: Computation and Language (cs.CL)

[1698] arXiv:2406.18925 [pdf, html, other]

Title: Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding

Jiwan Chung, Sungjae Lee, Minseo Kim, Seungju Han, Ashkan Yousefpour, Jack Hessel, Youngjae Yu

Comments: 12 pages, 6 figures. Accepted as main paper in EMNLP 2024

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1699] arXiv:2406.18966 [pdf, html, other]

Title: UniGen: A Unified Framework for Textual Dataset Generation Using Large Language Models

Siyuan Wu, Yue Huang, Chujie Gao, Dongping Chen, Qihui Zhang, Yao Wan, Tianyi Zhou, Xiangliang Zhang, Jianfeng Gao, Chaowei Xiao, Lichao Sun

Subjects: Computation and Language (cs.CL)

[1700] arXiv:2406.19032 [pdf, html, other]

Title: Improving Weak-to-Strong Generalization with Reliability-Aware Alignment

Yue Guo, Yi Yang

Subjects: Computation and Language (cs.CL)

[1701] arXiv:2406.19065 [pdf, html, other]

Title: STBench: Assessing the Ability of Large Language Models in Spatio-Temporal Analysis

Wenbin Li, Di Yao, Ruibo Zhao, Wenjie Chen, Zijie Xu, Chengxue Luo, Chang Gong, Quanliang Jing, Haining Tan, Jingping Bi

Subjects: Computation and Language (cs.CL)

[1702] arXiv:2406.19071 [pdf, html, other]

Title: EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimization

Ondrej Sotolar, Vojtech Formanek, Alok Debnath, Allison Lahnala, Charles Welch, Lucie FLek

Comments: v02, 8 pages long paper, EMNLP ACL style

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1703] arXiv:2406.19073 [pdf, other]

Title: AMBROSIA: A Benchmark for Parsing Ambiguous Questions into Database Queries

Irina Saparina, Mirella Lapata

Comments: NeurIPS 2024 D&B Track Spotlight

Subjects: Computation and Language (cs.CL)

[1704] arXiv:2406.19097 [pdf, html, other]

Title: Fairness and Bias in Multimodal AI: A Survey

Tosin Adewumi, Lama Alkhaled, Namrata Gurung, Goya van Boven, Irene Pagliai

Comments: 12 pages

Subjects: Computation and Language (cs.CL)

[1705] arXiv:2406.19102 [pdf, html, other]

Title: Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIs

Lokesh Mishra, Sohayl Dhibi, Yusik Kim, Cesar Berrospi Ramis, Shubham Gupta, Michele Dolfi, Peter Staar

Comments: Accepted at the NLP4Climate workshop in the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024)

Journal-ref: Proceedings of the 1st Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2024), pages 193-214, Bangkok, Thailand. Association for Computational Linguistics

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[1706] arXiv:2406.19116 [pdf, html, other]

Title: CHEW: A Dataset of CHanging Events in Wikipedia

Hsuvas Borkakoty, Luis Espinosa-Anke

Comments: Short Paper

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1707] arXiv:2406.19170 [pdf, html, other]

Title: The Illusion of Competence: Evaluating the Effect of Explanations on Users' Mental Models of Visual Question Answering Systems

Judith Sieker, Simeon Junker, Ronja Utescher, Nazia Attari, Heiko Wersing, Hendrik Buschmeier, Sina Zarrieß

Comments: 17 pages (including Appendix). Accepted at EMNLP 2024 main

Subjects: Computation and Language (cs.CL)

[1708] arXiv:2406.19172 [pdf, html, other]

Title: Annotation Errors and NER: A Study with OntoNotes 5.0

Gabriel Bernier-Colborne, Sowmya Vajjala

Comments: Unpublished report. Originally submitted to LREC 2022

Subjects: Computation and Language (cs.CL)

[1709] arXiv:2406.19215 [pdf, html, other]

Title: SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation

Zijun Yao, Weijian Qi, Liangming Pan, Shulin Cao, Linmei Hu, Weichuan Liu, Lei Hou, Juanzi Li

Subjects: Computation and Language (cs.CL)

[1710] arXiv:2406.19223 [pdf, html, other]

Title: T-FREE: Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddings

Björn Deiseroth, Manuel Brack, Patrick Schramowski, Kristian Kersting, Samuel Weinbach

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1711] arXiv:2406.19226 [pdf, html, other]

Title: Simulating Classroom Education with LLM-Empowered Agents

Zheyuan Zhang, Daniel Zhang-Li, Jifan Yu, Linlu Gong, Jinchang Zhou, Zhiyuan Liu, Lei Hou, Juanzi Li

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1712] arXiv:2406.19227 [pdf, html, other]

Title: Aligning Teacher with Student Preferences for Tailored Training Data Generation

Yantao Liu, Zhao Zhang, Zijun Yao, Shulin Cao, Lei Hou, Juanzi Li

Subjects: Computation and Language (cs.CL)

[1713] arXiv:2406.19228 [pdf, html, other]

Title: Tools Fail: Detecting Silent Errors in Faulty Tools

Jimin Sun, So Yeon Min, Yingshan Chang, Yonatan Bisk

Comments: 18 pages, 12 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1714] arXiv:2406.19232 [pdf, html, other]

Title: RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs

Ekaterina Taktasheva, Maxim Bazhukov, Kirill Koncha, Alena Fenogenova, Ekaterina Artemova, Vladislav Mikhailov

Comments: to appear in EMNLP 2024 (main)

Subjects: Computation and Language (cs.CL)

[1715] arXiv:2406.19237 [pdf, html, other]

Title: FlowVQA: Mapping Multimodal Logic in Visual Question Answering with Flowcharts

Shubhankar Singh, Purvi Chaurasia, Yerram Varun, Pranshu Pandya, Vatsal Gupta, Vivek Gupta, Dan Roth

Comments: Accepted in ACL 2024 (Findings), 21 pages, 7 figures, 9 Tables

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1716] arXiv:2406.19238 [pdf, html, other]

Title: Revealing Fine-Grained Values and Opinions in Large Language Models

Dustin Wright, Arnav Arora, Nadav Borenstein, Srishti Yadav, Serge Belongie, Isabelle Augenstein

Comments: Findings of EMNLP 2024; 28 pages, 20 figures, 7 tables

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1717] arXiv:2406.19251 [pdf, html, other]

Title: AutoRAG-HP: Automatic Online Hyper-Parameter Tuning for Retrieval-Augmented Generation

Jia Fu, Xiaoting Qin, Fangkai Yang, Lu Wang, Jue Zhang, Qingwei Lin, Yubo Chen, Dongmei Zhang, Saravan Rajmohan, Qi Zhang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1718] arXiv:2406.19263 [pdf, html, other]

Title: Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding

Yue Fan, Lei Ding, Ching-Chen Kuo, Shan Jiang, Yang Zhao, Xinze Guan, Jie Yang, Yi Zhang, Xin Eric Wang

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1719] arXiv:2406.19271 [pdf, html, other]

Title: AutoPureData: Automated Filtering of Web Data for LLM Fine-tuning

Praneeth Vadlapati

Comments: Initial version

Journal-ref: Journal of Mathematical & Computer Applications, 3 (2024) E121

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[1720] arXiv:2406.19276 [pdf, html, other]

Title: VERISCORE: Evaluating the factuality of verifiable claims in long-form text generation

Yixiao Song, Yekyung Kim, Mohit Iyyer

Subjects: Computation and Language (cs.CL)

[1721] arXiv:2406.19307 [pdf, other]

Title: The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning

Shaobo Cui, Zhijing Jin, Bernhard Schölkopf, Boi Faltings

Comments: 42 pages

Subjects: Computation and Language (cs.CL)

[1722] arXiv:2406.19314 [pdf, other]

Title: LiveBench: A Challenging, Contamination-Free LLM Benchmark

Colin White, Samuel Dooley, Manley Roberts, Arka Pal, Ben Feuer, Siddhartha Jain, Ravid Shwartz-Ziv, Neel Jain, Khalid Saifullah, Siddartha Naidu, Chinmay Hegde, Yann LeCun, Tom Goldstein, Willie Neiswanger, Micah Goldblum

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1723] arXiv:2406.19349 [pdf, html, other]

Title: IndoToxic2024: A Demographically-Enriched Dataset of Hate Speech and Toxicity Types for Indonesian Language

Lucky Susanto, Musa Izzanardi Wijanarko, Prasetia Anugrah Pratama, Traci Hong, Ika Idris, Alham Fikri Aji, Derry Wijaya

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1724] arXiv:2406.19354 [pdf, html, other]

Title: Fundamental Problems With Model Editing: How Should Rational Belief Revision Work in LLMs?

Peter Hase, Thomas Hofweber, Xiang Zhou, Elias Stengel-Eskin, Mohit Bansal

Comments: 23 pages, 4 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1725] arXiv:2406.19356 [pdf, html, other]

Title: DiVERT: Distractor Generation with Variational Errors Represented as Text for Math Multiple-choice Questions

Nigel Fernandez, Alexander Scarlatos, Wanyong Feng, Simon Woodhead, Andrew Lan

Comments: EMNLP 2024: The 2024 Conference on Empirical Methods in Natural Language Processing

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1726] arXiv:2406.19358 [pdf, html, other]

Title: The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Models

Xiliang Zhu, Shayna Gardiner, Tere Roldán, David Rossouw

Comments: Accepted to WASSA workshop at ACL2024

Subjects: Computation and Language (cs.CL)

[1727] arXiv:2406.19371 [pdf, html, other]

Title: Suri: Multi-constraint Instruction Following for Long-form Text Generation

Chau Minh Pham, Simeng Sun, Mohit Iyyer

Comments: Accepted to EMNLP'24 (Findings)

Subjects: Computation and Language (cs.CL)

[1728] arXiv:2406.19415 [pdf, html, other]

Title: An Analysis of Multilingual FActScore

Kim Trong Vu, Michael Krumdick, Varshini Reddy, Franck Dernoncourt, Viet Dac Lai

Subjects: Computation and Language (cs.CL)

[1729] arXiv:2406.19465 [pdf, html, other]

Title: Can Large Language Models Generate High-quality Patent Claims?

Lekang Jiang, Caiqi Zhang, Pascal A Scherz, Stephan Goetz

Comments: 16 pages, 2 figures, 12 tables

Subjects: Computation and Language (cs.CL)

[1730] arXiv:2406.19470 [pdf, html, other]

Title: Changing Answer Order Can Decrease MMLU Accuracy

Vipul Gupta, David Pantoja, Candace Ross, Adina Williams, Megan Ung

Comments: Short paper, 9 pages

Subjects: Computation and Language (cs.CL)

[1731] arXiv:2406.19478 [pdf, html, other]

Title: Sparse Regression for Machine Translation

Ergun Biçici

Comments: 8 pages, 4 figures, 4 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1732] arXiv:2406.19482 [pdf, html, other]

Title: xTower: A Multilingual LLM for Explaining and Correcting Translation Errors

Marcos Treviso, Nuno M. Guerreiro, Sweta Agrawal, Ricardo Rei, José Pombal, Tania Vaz, Helena Wu, Beatriz Silva, Daan van Stigt, André F. T. Martins

Subjects: Computation and Language (cs.CL)

[1733] arXiv:2406.19486 [pdf, html, other]

Title: LoPT: Low-Rank Prompt Tuning for Parameter Efficient Language Models

Shouchang Guo, Sonam Damani, Keng-hao Chang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET); Machine Learning (cs.LG); Signal Processing (eess.SP)

[1734] arXiv:2406.19493 [pdf, other]

Title: Development and Evaluation of a Retrieval-Augmented Generation Tool for Creating SAPPhIRE Models of Artificial Systems

Anubhab Majumder, Kausik Bhattacharya, Amaresh Chakrabarti

Comments: This paper has been accepted for presentation at the 10th International Conference on Research Into Design, 2025

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1735] arXiv:2406.19497 [pdf, html, other]

Title: Inclusivity in Large Language Models: Personality Traits and Gender Bias in Scientific Abstracts

Naseela Pervez, Alexander J. Titus

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1736] arXiv:2406.19501 [pdf, html, other]

Title: Monitoring Latent World States in Language Models with Propositional Probes

Jiahai Feng, Stuart Russell, Jacob Steinhardt

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1737] arXiv:2406.19502 [pdf, other]

Title: Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Utilization

Miyoung Ko, Sue Hyun Park, Joonsuk Park, Minjoon Seo

Comments: published at EMNLP 2024; code is available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1738] arXiv:2406.19504 [pdf, html, other]

Title: Are Generative Language Models Multicultural? A Study on Hausa Culture and Emotions using ChatGPT

Ibrahim Said Ahmad, Shiran Dudy, Resmi Ramachandranpillai, Kenneth Church

Subjects: Computation and Language (cs.CL)

[1739] arXiv:2406.19512 [pdf, html, other]

Title: Captioning Visualizations with Large Language Models (CVLLM): A Tutorial

Giuseppe Carenini, Jordon Johnson, Ali Salamatian

Comments: 6 pages, 4 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[1740] arXiv:2406.19526 [pdf, html, other]

Title: TocBERT: Medical Document Structure Extraction Using Bidirectional Transformers

Majd Saleh, Sarra Baghdadi, Stéphane Paquelet

Comments: 6 pages, 6 figures

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1741] arXiv:2406.19537 [pdf, html, other]

Title: Handling Ontology Gaps in Semantic Parsing

Andrea Bacciu, Marco Damonte, Marco Basaldella, Emilio Monti

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1742] arXiv:2406.19538 [pdf, html, other]

Title: Context Matters: An Empirical Study of the Impact of Contextual Information in Temporal Question Answering Systems

Dan Schumacher, Fatemeh Haji, Tara Grey, Niharika Bandlamudi, Nupoor Karnik, Gagana Uday Kumar, Jason Cho-Yu Chiang, Paul Rad, Nishant Vishwamitra, Anthony Rios

Subjects: Computation and Language (cs.CL)

[1743] arXiv:2406.19543 [pdf, html, other]

Title: Demarked: A Strategy for Enhanced Abusive Speech Moderation through Counterspeech, Detoxification, and Message Management

Seid Muhie Yimam, Daryna Dementieva, Tim Fischer, Daniil Moskovskiy, Naquee Rizwan, Punyajoy Saha, Sarthak Roy, Martin Semmann, Alexander Panchenko, Chris Biemann, Animesh Mukherjee

Subjects: Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[1744] arXiv:2406.19545 [pdf, html, other]

Title: Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations

Ritam Dutt, Zhen Wu, Kelly Shi, Divyanshu Sheth, Prakhar Gupta, Carolyn Penstein Rose

Comments: To appear at The Proceedings of the Association for Computational Linguistics, 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1745] arXiv:2406.19552 [pdf, other]

Title: Rethinking harmless refusals when fine-tuning foundation models

Florin Pop, Judd Rosenblatt, Diogo Schwerz de Lucena, Michael Vaiana

Comments: ICLR 2024 AGI Workshop Poster

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1746] arXiv:2406.19564 [pdf, html, other]

Title: Voices Unheard: NLP Resources and Models for Yor\`ub\'a Regional Dialects

Orevaoghene Ahia, Anuoluwapo Aremu, Diana Abagyan, Hila Gonen, David Ifeoluwa Adelani, Daud Abolade, Noah A. Smith, Yulia Tsvetkov

Subjects: Computation and Language (cs.CL)

[1747] arXiv:2406.19593 [pdf, other]

Title: SK-VQA: Synthetic Knowledge Generation at Scale for Training Context-Augmented Multimodal LLMs

Xin Su, Man Luo, Kris W Pan, Tien Pei Chou, Vasudev Lal, Phillip Howard

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1748] arXiv:2406.19598 [pdf, html, other]

Title: Mixture of In-Context Experts Enhance LLMs' Long Context Awareness

Hongzhan Lin, Ang Lv, Yuhan Chen, Chen Zhu, Yang Song, Hengshu Zhu, Rui Yan

Comments: Accepted by Neurips2024

Subjects: Computation and Language (cs.CL)

[1749] arXiv:2406.19642 [pdf, html, other]

Title: IDT: Dual-Task Adversarial Attacks for Privacy Protection

Pedro Faustini, Shakila Mahjabin Tonni, Annabelle McIver, Qiongkai Xu, Mark Dras

Comments: 28 pages, 1 figure

Subjects: Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[1750] arXiv:2406.19643 [pdf, html, other]

Title: Debate-to-Write: A Persona-Driven Multi-Agent Framework for Diverse Argument Generation

Zhe Hu, Hou Pong Chan, Jing Li, Yu Yin

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1751] arXiv:2406.19650 [pdf, html, other]

Title: DECOR: Improving Coherence in L2 English Writing with a Novel Benchmark for Incoherence Detection, Reasoning, and Rewriting

Xuanming Zhang, Anthony Diaz, Zixun Chen, Qingyang Wu, Kun Qian, Erik Voss, Zhou Yu

Comments: EMNLP 2024 Main, 23 pages, 5 figures, 20 tables

Subjects: Computation and Language (cs.CL)

[1752] arXiv:2406.19674 [pdf, html, other]

Title: Less is More: Accurate Speech Recognition & Translation without Web-Scale Data

Krishna C. Puvvada, Piotr Żelasko, He Huang, Oleksii Hrinchuk, Nithin Rao Koluguri, Kunal Dhawan, Somshubra Majumdar, Elena Rastorgueva, Zhehuai Chen, Vitaly Lavrukhin, Jagadeesh Balam, Boris Ginsburg

Comments: Accepted at Interspeech-2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1753] arXiv:2406.19729 [pdf, other]

Title: Le sens de la famille : analyse du vocabulaire de la parent{\'e} par les plongements de mots

Ludovic Tanguy (CLLE), Cécile Fabre (CLLE), Nabil Hathout (UT, CNRS, CLLE), Lydia-Mai Ho-Dac (CLLE)

Comments: in French language. JADT 2024 - 17es Journ{é}es internationales d'Analyse statistique des Donn{é}es Textuelles, SeSLa (S{é}minaire des Sciences du Langage de l'UCLouvain -- Site Saint-Louis), 2024, Bruxelles, Belgique

Subjects: Computation and Language (cs.CL)

[1754] arXiv:2406.19731 [pdf, other]

Title: Message du troisi{\`e}me type : irruption d'un tiers dans un dialogue en ligne

Ludovic Tanguy (CLLE), Céline Poudat (BCL), Lydia-Mai Ho-Dac (CLLE)

Comments: in French language. JADT 2024 - 17es Journ{é}es internationales d'Analyse statistique des Donn{é}es Textuelles, SeSLa (S{é}minaire des Sciences du Langage de l'UCLouvain -- Site Saint-Louis); LASLA (Laboratoire d'Analyse statistique des Langues anciennes de l'Universit{é} de Li{è}ge), 2024, Bruxelles, Belgique

Subjects: Computation and Language (cs.CL)

[1755] arXiv:2406.19759 [pdf, html, other]

Title: Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignment

Orgest Xhelili, Yihong Liu, Hinrich Schütze

Comments: EMNLP 2024 Findings

Subjects: Computation and Language (cs.CL)

[1756] arXiv:2406.19764 [pdf, html, other]

Title: Belief Revision: The Adaptability of Large Language Models Reasoning

Bryan Wilie, Samuel Cahyawijaya, Etsuko Ishii, Junxian He, Pascale Fung

Subjects: Computation and Language (cs.CL)

[1757] arXiv:2406.19774 [pdf, html, other]

Title: Direct Preference Knowledge Distillation for Large Language Models

Yixing Li, Yuxian Gu, Li Dong, Dequan Wang, Yu Cheng, Furu Wei

Subjects: Computation and Language (cs.CL)

[1758] arXiv:2406.19803 [pdf, html, other]

Title: Scalable and Domain-General Abstractive Proposition Segmentation

Mohammad Javad Hosseini, Yang Gao, Tim Baumgärtner, Alex Fabrikant, Reinald Kim Amplayo

Subjects: Computation and Language (cs.CL)

[1759] arXiv:2406.19820 [pdf, html, other]

Title: BeamAggR: Beam Aggregation Reasoning over Multi-source Knowledge for Multi-hop Question Answering

Zheng Chu, Jingchang Chen, Qianglong Chen, Haotian Wang, Kun Zhu, Xiyuan Du, Weijiang Yu, Ming Liu, Bing Qin

Comments: Accepted to ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1760] arXiv:2406.19840 [pdf, html, other]

Title: AnomaLLMy -- Detecting anomalous tokens in black-box LLMs through low-confidence single-token predictions

Waligóra Witold

Comments: 6 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1761] arXiv:2406.19853 [pdf, html, other]

Title: YuLan: An Open-source Large Language Model

Yutao Zhu, Kun Zhou, Kelong Mao, Wentong Chen, Yiding Sun, Zhipeng Chen, Qian Cao, Yihan Wu, Yushuo Chen, Feng Wang, Lei Zhang, Junyi Li, Xiaolei Wang, Lei Wang, Beichen Zhang, Zican Dong, Xiaoxue Cheng, Yuhan Chen, Xinyu Tang, Yupeng Hou, Qiangqiang Ren, Xincheng Pang, Shufang Xie, Wayne Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ze-Feng Gao, Yueguo Chen, Weizheng Lu, Ji-Rong Wen

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1762] arXiv:2406.19874 [pdf, html, other]

Title: Detecting Subtle Differences between Human and Model Languages Using Spectrum of Relative Likelihood

Yang Xu, Yu Wang, Hao An, Zhichen Liu, Yongyuan Li

Comments: 14 pages, 12 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1763] arXiv:2406.19884 [pdf, html, other]

Title: Investigating the Timescales of Language Processing with EEG and Language Models

Davide Turco, Conor Houghton

Comments: Accepted at the 2024 Conference on Cognitive Computational Neuroscience (CCN 2024)

Subjects: Computation and Language (cs.CL); Neurons and Cognition (q-bio.NC)

[1764] arXiv:2406.19892 [pdf, html, other]

Title: Untangling the Unrestricted Web: Automatic Identification of Multilingual Registers

Erik Henriksson, Amanda Myntti, Anni Eskelinen, Selcen Erten-Johansson, Saara Hellström, Veronika Laippala

Subjects: Computation and Language (cs.CL)

[1765] arXiv:2406.19898 [pdf, html, other]

Title: Paraphrase Types Elicit Prompt Engineering Capabilities

Jan Philip Wahle, Terry Ruas, Yang Xu, Bela Gipp

Journal-ref: EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1766] arXiv:2406.19928 [pdf, html, other]

Title: Interactive Topic Models with Optimal Transport

Garima Dhanania, Sheshera Mysore, Chau Minh Pham, Mohit Iyyer, Hamed Zamani, Andrew McCallum

Comments: Pre-print; Work in progress

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)

[1767] arXiv:2406.19934 [pdf, html, other]

Title: From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesis

Chuanqi Cheng, Jian Guan, Wei Wu, Rui Yan

Comments: Accepted by EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1768] arXiv:2406.19949 [pdf, other]

Title: Calibrating LLMs with Preference Optimization on Thought Trees for Generating Rationale in Science Question Scoring

Jiazheng Li, Hainiu Xu, Zhaoyue Sun, Yuxiang Zhou, David West, Cesare Aloisi, Yulan He

Comments: Accepted at EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1769] arXiv:2406.19951 [pdf, html, other]

Title: Mining Reasons For And Against Vaccination From Unstructured Data Using Nichesourcing and AI Data Augmentation

Damián Ariel Furman, Juan Junqueras, Z. Burçe Gümüslü, Edgar Altszyler, Joaquin Navajas, Ophelia Deroy, Justin Sulik

Comments: 8 pages + references and appendix

Subjects: Computation and Language (cs.CL)

[1770] arXiv:2406.19954 [pdf, html, other]

Title: BESTOW: Efficient and Streamable Speech Language Model with the Best of Two Worlds in GPT and T5

Zhehuai Chen, He Huang, Oleksii Hrinchuk, Krishna C. Puvvada, Nithin Rao Koluguri, Piotr Żelasko, Jagadeesh Balam, Boris Ginsburg

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1771] arXiv:2406.19966 [pdf, html, other]

Title: Simulating Financial Market via Large Language Model based Agents

Shen Gao, Yuntao Wen, Minghang Zhu, Jianing Wei, Yuhan Cheng, Qunzi Zhang, Shuo Shang

Subjects: Computation and Language (cs.CL)

[1772] arXiv:2406.19967 [pdf, html, other]

Title: Into the Unknown: Generating Geospatial Descriptions for New Environments

Tzuf Paz-Argaman, John Palowitch, Sayali Kulkarni, Reut Tsarfaty, Jason Baldridge

Journal-ref: ACL 2024 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1773] arXiv:2406.19995 [pdf, html, other]

Title: Single Parent Family: A Spectrum of Family Members from a Single Pre-Trained Foundation Model

Habib Hajimolahoseini, Mohammad Hassanpour, Foozhan Ataiefard, Boxing Chen, Yang Liu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1774] arXiv:2406.19999 [pdf, html, other]

Title: The SIFo Benchmark: Investigating the Sequential Instruction Following Ability of Large Language Models

Xinyi Chen, Baohao Liao, Jirui Qi, Panagiotis Eustratiadis, Christof Monz, Arianna Bisazza, Maarten de Rijke

Comments: EMNLP 2024 Findings

Subjects: Computation and Language (cs.CL)

[1775] arXiv:2406.20015 [pdf, html, other]

Title: ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models

Yuxiang Zhang, Jing Chen, Junjie Wang, Yaxin Liu, Cheng Yang, Chufan Shi, Xinyu Zhu, Zihao Lin, Hanwen Wan, Yujiu Yang, Tetsuya Sakai, Tian Feng, Hayato Yamana

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1776] arXiv:2406.20030 [pdf, html, other]

Title: LEMoE: Advanced Mixture of Experts Adaptor for Lifelong Model Editing of Large Language Models

Renzhi Wang, Piji Li

Subjects: Computation and Language (cs.CL)

[1777] arXiv:2406.20038 [pdf, html, other]

Title: BioMNER: A Dataset for Biomedical Method Entity Recognition

Chen Tang, Bohao Yang, Kun Zhao, Bo Lv, Chenghao Xiao, Frank Guerin, Chenghua Lin

Subjects: Computation and Language (cs.CL)

[1778] arXiv:2406.20052 [pdf, html, other]

Title: Understanding and Mitigating Language Confusion in LLMs

Kelly Marchisio, Wei-Yin Ko, Alexandre Bérard, Théo Dehaze, Sebastian Ruder

Comments: EMNLP 2024 Main Conference Camera-ready

Subjects: Computation and Language (cs.CL)

[1779] arXiv:2406.20054 [pdf, html, other]

Title: To Word Senses and Beyond: Inducing Concepts with Contextualized Language Models

Bastien Liétard, Pascal Denis, Mikaella Keller

Subjects: Computation and Language (cs.CL)

[1780] arXiv:2406.20060 [pdf, html, other]

Title: Applying RLAIF for Code Generation with API-usage in Lightweight LLMs

Sujan Dutta, Sayantan Mahinder, Raviteja Anantha, Bortik Bandyopadhyay

Subjects: Computation and Language (cs.CL)

[1781] arXiv:2406.20079 [pdf, html, other]

Title: Molecular Facts: Desiderata for Decontextualization in LLM Fact Verification

Anisha Gunjal, Greg Durrett

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1782] arXiv:2406.20086 [pdf, html, other]

Title: Token Erasure as a Footprint of Implicit Vocabulary Items in LLMs

Sheridan Feucht, David Atkinson, Byron Wallace, David Bau

Comments: 13 pages, 14 figures. Code and data at this https URL

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1783] arXiv:2406.20094 [pdf, html, other]

Title: Scaling Synthetic Data Creation with 1,000,000,000 Personas

Tao Ge, Xin Chan, Xiaoyang Wang, Dian Yu, Haitao Mi, Dong Yu

Comments: Work in progress

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1784] arXiv:2406.00006 (cross-list from cs.RO) [pdf, html, other]

Title: A Prompt-driven Task Planning Method for Multi-drones based on Large Language Model

Yaohua Liu

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1785] arXiv:2406.00007 (cross-list from cs.IR) [pdf, html, other]

Title: PyTorch-IE: Fast and Reproducible Prototyping for Information Extraction

Arne Binder, Leonhard Hennig, Christoph Alt

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1786] arXiv:2406.00008 (cross-list from cs.IR) [pdf, html, other]

Title: KnowledgeHub: An end-to-end Tool for Assisted Scientific Discovery

Shinnosuke Tanaka, James Barry, Vishnudev Kuruvanthodi, Movina Moses, Maxwell J. Giammona, Nathan Herr, Mohab Elkaref, Geeth De Mel

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Digital Libraries (cs.DL)

[1787] arXiv:2406.00010 (cross-list from cs.IR) [pdf, other]

Title: EnterpriseEM: Fine-tuned Embeddings for Enterprise Semantic Search

Kamalkumar Rathinasamy, Jayarama Nettar, Amit Kumar, Vishal Manchanda, Arun Vijayakumar, Ayush Kataria, Venkateshprasanna Manjunath, Chidambaram GS, Jaskirat Singh Sodhi, Shoeb Shaikh, Wasim Akhtar Khan, Prashant Singh, Tanishq Dattatray Ige, Vipin Tiwari, Rajab Ali Mondal, Harshini K, S Reka, Chetana Amancharla, Faiz ur Rahman, Harikrishnan P A, Indraneel Saha, Bhavya Tiwary, Navin Shankar Patel, Pradeep T S, Balaji A J, Priyapravas, Mohammed Rafee Tarafdar

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1788] arXiv:2406.00013 (cross-list from cs.IR) [pdf, other]

Title: Thesis: Document Summarization with applications to Keyword extraction and Image Retrieval

Jayaprakash Sundararaj

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1789] arXiv:2406.00014 (cross-list from cs.DB) [pdf, html, other]

Title: KU-DMIS at EHRSQL 2024:Generating SQL query via question templatization in EHR

Hajung Kim, Chanhwi Kim, Hoonick Lee, Kyochul Jang, Jiwoo Lee, Kyungjae Lee, Gangwoo Kim, Jaewoo Kang

Comments: Published at ClinicalNLP workshop @ NAACL 2024

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1790] arXiv:2406.00061 (cross-list from cs.LG) [pdf, html, other]

Title: STAT: Shrinking Transformers After Training

Megan Flynn, Alexander Wang, Dean Edward Alvarez, Christopher De Sa, Anil Damle

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1791] arXiv:2406.00083 (cross-list from cs.CR) [pdf, html, other]

Title: BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models

Jiaqi Xue, Mengxin Zheng, Yebowen Hu, Fei Liu, Xun Chen, Qian Lou

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1792] arXiv:2406.00131 (cross-list from cs.LG) [pdf, html, other]

Title: How In-Context Learning Emerges from Training on Unstructured Data: On the Role of Co-Occurrence, Positional Information, and Noise Structures

Kevin Christian Wibisono, Yixin Wang

Comments: 33 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1793] arXiv:2406.00199 (cross-list from cs.CR) [pdf, html, other]

Title: Exfiltration of personal information from ChatGPT via prompt injection

Gregory Schwartzman

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Emerging Technologies (cs.ET)

[1794] arXiv:2406.00231 (cross-list from cs.IR) [pdf, html, other]

Title: LLM-RankFusion: Mitigating Intrinsic Inconsistency in LLM-based Ranking

Yifan Zeng, Ojas Tendolkar, Raymond Baartmans, Qingyun Wu, Huazheng Wang, Lizhong Chen

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1795] arXiv:2406.00240 (cross-list from cs.LG) [pdf, html, other]

Title: Exploring Vulnerabilities and Protections in Large Language Models: A Survey

Frank Weizhen Liu, Chenhui Hu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1796] arXiv:2406.00252 (cross-list from cs.AI) [pdf, html, other]

Title: Towards Rationality in Language and Multimodal Agents: A Survey

Bowen Jiang, Yangxinyu Xie, Xiaomeng Wang, Yuan Yuan, Zhuoqun Hao, Xinyi Bai, Weijie J. Su, Camillo J. Taylor, Tanwi Mallick

Comments: We maintain an open repository at this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multiagent Systems (cs.MA)

[1797] arXiv:2406.00318 (cross-list from cs.LG) [pdf, html, other]

Title: KGLink: A column type annotation method that combines knowledge graph and pre-trained language model

Yubo Wang, Hao Xin, Lei Chen

Comments: To be published in ICDE 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1798] arXiv:2406.00456 (cross-list from cs.LG) [pdf, html, other]

Title: Mix-of-Granularity: Optimize the Chunking Granularity for Retrieval-Augmented Generation

Zijie Zhong, Hanwen Liu, Xiaoya Cui, Xiaofan Zhang, Zengchang Qin

Comments: 17 pages, 6 figures and 8 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1799] arXiv:2406.00497 (cross-list from cs.SD) [pdf, html, other]

Title: Recent Advances in End-to-End Simultaneous Speech Translation

Xiaoqian Liu, Guoqiang Hu, Yangfan Du, Erfeng He, Yingfeng Luo, Chen Xu, Tong Xiao, Jingbo Zhu

Comments: Accepted by IJCAI 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1800] arXiv:2406.00548 (cross-list from cs.LG) [pdf, html, other]

Title: LIDAO: Towards Limited Interventions for Debiasing (Large) Language Models

Tianci Liu, Haoyu Wang, Shiyang Wang, Yu Cheng, Jing Gao

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1801] arXiv:2406.00667 (cross-list from eess.IV) [pdf, html, other]

Title: An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging

Sulaiman Khan, Md. Rafiul Biswas, Alina Murad, Hazrat Ali, Zubair Shah

Comments: Accepted in Fifth IEEE Workshop on Artificial Intelligence for HealthCare, IEEE 25th International Conference on Information Reuse and Integration for Data Science

Subjects: Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1802] arXiv:2406.00682 (cross-list from cs.IR) [pdf, other]

Title: A lexicon obtained and validated by a data-driven approach for organic residues valorization in emerging and developing countries

Christiane Rakotomalala, Jean-Marie Paillat, Frédéric Feder, Angel Avadí, Laurent Thuriès, Marie-Liesse Vermeire, Jean-Michel Médoc, Tom Wassenaar, Caroline Hottelart, Lilou Kieffer, Elisa Ndjie, Mathieu Picart, Jorel Tchamgoue, Alvin Tulle, Laurine Valade, Annie Boyer, Marie-Christine Duchamp, Mathieu Roche

Comments: 5 pages, 2 tables

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1803] arXiv:2406.00684 (cross-list from cs.CV) [pdf, html, other]

Title: Deciphering Oracle Bone Language with Diffusion Models

Haisu Guan, Huanxin Yang, Xinyu Wang, Shengwei Han, Yongge Liu, Lianwen Jin, Xiang Bai, Yuliang Liu

Comments: ACL2024 main conference long paper

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1804] arXiv:2406.00765 (cross-list from cs.AI) [pdf, other]

Title: The Embodied World Model Based on LLM with Visual Information and Prediction-Oriented Prompts

Wakana Haijima, Kou Nakakubo, Masahiro Suzuki, Yutaka Matsuo

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1805] arXiv:2406.00799 (cross-list from cs.CR) [pdf, html, other]

Title: Are you still on track!? Catching LLM Task Drift with Activations

Sahar Abdelnabi, Aideen Fay, Giovanni Cherubin, Ahmed Salem, Mario Fritz, Andrew Paverd

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1806] arXiv:2406.00894 (cross-list from cs.LG) [pdf, html, other]

Title: Pretrained Hybrids with MAD Skills

Nicholas Roberts, Samuel Guo, Zhiqi Gao, Satya Sai Srinath Namburi GNVV, Sonia Cromp, Chengjun Wu, Chengyu Duan, Frederic Sala

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1807] arXiv:2406.00898 (cross-list from cs.SD) [pdf, html, other]

Title: Phonetic Error Analysis of Raw Waveform Acoustic Models with Parametric and Non-Parametric CNNs

Erfan Loweimi, Andrea Carmantini, Peter Bell, Steve Renals, Zoran Cvetkovic

Comments: 5 pages, 6 figures, 3 tables

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1808] arXiv:2406.00999 (cross-list from cs.LG) [pdf, html, other]

Title: Seeing the Forest through the Trees: Data Leakage from Partial Transformer Gradients

Weijun Li, Qiongkai Xu, Mark Dras

Comments: accepted to EMNLP2024 (Main)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1809] arXiv:2406.01013 (cross-list from cs.LG) [pdf, html, other]

Title: Scalable Ensembling For Mitigating Reward Overoptimisation

Ahmed M. Ahmed, Rafael Rafailov, Stepan Sharkov, Xuechen Li, Sanmi Koyejo

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1810] arXiv:2406.01124 (cross-list from cs.LG) [pdf, html, other]

Title: Latent Logic Tree Extraction for Event Sequence Explanation from LLMs

Zitao Song, Chao Yang, Chaojie Wang, Bo An, Shuang Li

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1811] arXiv:2406.01197 (cross-list from cs.IR) [pdf, html, other]

Title: A Survey of Generative Information Retrieval

Tzu-Lin Kuo, Tzu-Wei Chiu, Tzung-Sheng Lin, Sheng-Yang Wu, Chao-Wei Huang, Yun-Nung Chen

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1812] arXiv:2406.01233 (cross-list from cs.IR) [pdf, html, other]

Title: Multi-word Term Embeddings Improve Lexical Product Retrieval

Viktor Shcherbakov, Fedor Krasnov

Comments: 10 pages, 4 figures

Journal-ref: In Proceedings of the Seventh Workshop on e-Commerce and NLP, LREC-COLING 2024, pages 115-124, Torino, Italia. ELRA and ICCL

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1813] arXiv:2406.01364 (cross-list from cs.CR) [pdf, html, other]

Title: BELLS: A Framework Towards Future Proof Benchmarks for the Evaluation of LLM Safeguards

Diego Dorn, Alexandre Variengien, Charbel-Raphaël Segerie, Vincent Corruble

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1814] arXiv:2406.01422 (cross-list from cs.SE) [pdf, html, other]

Title: How to Understand Whole Software Repository?

Yingwei Ma, Qingping Yang, Rongyu Cao, Binhua Li, Fei Huang, Yongbin Li

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1815] arXiv:2406.01424 (cross-list from cs.LG) [pdf, html, other]

Title: Universal In-Context Approximation By Prompting Fully Recurrent Models

Aleksandar Petrov, Tom A. Lamb, Alasdair Paren, Philip H.S. Torr, Adel Bibi

Comments: Published at NeurIPS 2024, Code at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1816] arXiv:2406.01457 (cross-list from cs.LG) [pdf, html, other]

Title: Differentially Private Tabular Data Synthesis using Large Language Models

Toan V. Tran, Li Xiong

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1817] arXiv:2406.01462 (cross-list from cs.LG) [pdf, html, other]

Title: The Importance of Online Data: Understanding Preference Fine-tuning via Coverage

Yuda Song, Gokul Swamy, Aarti Singh, J. Andrew Bagnell, Wen Sun

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1818] arXiv:2406.01561 (cross-list from cs.CV) [pdf, html, other]

Title: Long and Short Guidance in Score identity Distillation for One-Step Text-to-Image Generation

Mingyuan Zhou, Zhendong Wang, Huangjie Zheng, Hai Huang

Comments: Code and model checkpoints available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[1819] arXiv:2406.01566 (cross-list from cs.DC) [pdf, html, other]

Title: Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1820] arXiv:2406.01592 (cross-list from cs.CV) [pdf, html, other]

Title: Text-guided Controllable Mesh Refinement for Interactive 3D Modeling

Yun-Chun Chen, Selena Ling, Zhiqin Chen, Vladimir G. Kim, Matheus Gadelha, Alec Jacobson

Comments: SIGGRAPH Asia 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Graphics (cs.GR); Machine Learning (cs.LG)

[1821] arXiv:2406.01606 (cross-list from cs.IR) [pdf, html, other]

Title: SymTax: Symbiotic Relationship and Taxonomy Fusion for Effective Citation Recommendation

Karan Goyal, Mayank Goel, Vikram Goyal, Mukesh Mohania

Comments: Accepted in ACL 2024

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1822] arXiv:2406.01607 (cross-list from cs.IR) [pdf, html, other]

Title: Recent advances in text embedding: A Comprehensive Review of Top-Performing Methods on the MTEB Benchmark

Hongliu Cao

Comments: 21 pages

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1823] arXiv:2406.01608 (cross-list from cs.IR) [pdf, html, other]

Title: Detecting Deceptive Dark Patterns in E-commerce Platforms

Arya Ramteke, Sankalp Tembhurne, Gunesh Sonawane, Ratnmala N. Bhimanpallewar

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1824] arXiv:2406.01609 (cross-list from cs.IR) [pdf, html, other]

Title: Judgement Citation Retrieval using Contextual Similarity

Akshat Mohan Dasula, Hrushitha Tigulla, Preethika Bhukya

Comments: 14 pages, 16 images

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1825] arXiv:2406.01624 (cross-list from eess.AS) [pdf, html, other]

Title: Unveiling Hidden Factors: Explainable AI for Feature Boosting in Speech Emotion Recognition

Alaa Nfissi, Wassim Bouachir, Nizar Bouguila, Brian Mishara

Comments: Published in: Springer Nature International Journal of Applied Intelligence (2024)

Journal-ref: Applied Intelligence (2024), 1-24

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1826] arXiv:2406.01633 (cross-list from cs.IR) [pdf, other]

Title: On Overcoming Miscalibrated Conversational Priors in LLM-based Chatbots

Christine Herlihy, Jennifer Neville, Tobias Schnabel, Adith Swaminathan

Comments: Preprint of UAI'24 conference publication

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1827] arXiv:2406.01638 (cross-list from cs.LG) [pdf, html, other]

Title: TimeCMA: Towards LLM-Empowered Time Series Forecasting via Cross-Modality Alignment

Chenxi Liu, Qianxiong Xu, Hao Miao, Sun Yang, Lingzheng Zhang, Cheng Long, Ziyue Li, Rui Zhao

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1828] arXiv:2406.01789 (cross-list from cs.LG) [pdf, other]

Title: AI-based Classification of Customer Support Tickets: State of the Art and Implementation with AutoML

Mario Truss, Stephan Boehm

Journal-ref: Proceedings of the IWEMB 2021/2022: Fifth and Sixth International Workshop on Entrepreneurship, Electronic and Mobile Business

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1829] arXiv:2406.01876 (cross-list from cs.DB) [pdf, html, other]

Title: GRAM: Generative Retrieval Augmented Matching of Data Schemas in the Context of Data Security

Xuanqing Liu, Luyang Kong, Runhui Wang, Patrick Song, Austin Nevins, Henrik Johnson, Nimish Amlathe, Davor Golac

Comments: KDD 2024 Camera Ready; 11 pages, 8 figures

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1830] arXiv:2406.01895 (cross-list from cs.LG) [pdf, html, other]

Title: Explicitly Encoding Structural Symmetry is Key to Length Generalization in Arithmetic Tasks

Mahdi Sabbaghi, George Pappas, Hamed Hassani, Surbhi Goel

Comments: 32 pages, 16 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1831] arXiv:2406.01914 (cross-list from cs.CV) [pdf, html, other]

Title: HPE-CogVLM: New Head Pose Grounding Task Exploration on Vision Language Model

Yu Tian, Tianqi Shao, Tsukasa Demizu, Xuyang Wu, Hsin-Tai Wu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1832] arXiv:2406.01946 (cross-list from cs.CR) [pdf, html, other]

Title: Bileve: Securing Text Provenance in Large Language Models Against Spoofing with Bi-level Signature

Tong Zhou, Xuandong Zhao, Xiaolin Xu, Shaolei Ren

Comments: NeurIPS 2024 camera-ready

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1833] arXiv:2406.02004 (cross-list from cs.CR) [pdf, html, other]

Title: Efficiently Train ASR Models that Memorize Less and Perform Better with Per-core Clipping

Lun Wang, Om Thakkar, Zhong Meng, Nicole Rafidi, Rohit Prabhavalkar, Arun Narayanan

Comments: Accepted to Interspeech'24

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1834] arXiv:2406.02009 (cross-list from eess.AS) [pdf, html, other]

Title: Phonetic Enhanced Language Modeling for Text-to-Speech Synthesis

Kun Zhou, Shengkui Zhao, Yukun Ma, Chong Zhang, Hao Wang, Dianwen Ng, Chongjia Ni, Nguyen Trung Hieu, Jia Qi Yip, Bin Ma

Comments: Accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1835] arXiv:2406.02061 (cross-list from cs.LG) [pdf, html, other]

Title: Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models

Marianna Nezhurina, Lucia Cipolina-Kun, Mehdi Cherti, Jenia Jitsev

Comments: v2.01. Minor edits. Further experiments on various AIW problem variations. AIW "Alice Female Power Boost", AIW Extension (AIW Ext). Including recent Claude 3.5 Sonnet and Qwen 2 72B Instruct results

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1836] arXiv:2406.02128 (cross-list from cs.LG) [pdf, html, other]

Title: Iteration Head: A Mechanistic Study of Chain-of-Thought

Vivien Cabannes, Charles Arnal, Wassim Bouaziz, Alice Yang, Francois Charton, Julia Kempe

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1837] arXiv:2406.02133 (cross-list from eess.AS) [pdf, html, other]

Title: SimulTron: On-Device Simultaneous Speech to Speech Translation

Alex Agranovich, Eliya Nachmani, Oleg Rybakov, Yifan Ding, Ye Jia, Nadav Bar, Heiga Zen, Michelle Tadmor Ramanovich

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1838] arXiv:2406.02135 (cross-list from cs.IR) [pdf, html, other]

Title: Robust Interaction-Based Relevance Modeling for Online e-Commerce Search

Ben Chen, Huangyu Dai, Xiang Ma, Wen Jiang, Wei Ning

Comments: Accepted by ECML-PKDD'24 as Outstanding Paper. 8 pages, 2 figures, 7 tables

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1839] arXiv:2406.02166 (cross-list from cs.SD) [pdf, html, other]

Title: Whistle: Data-Efficient Multilingual and Crosslingual Speech Recognition via Weakly Phonetic Supervision

Saierdaer Yusuyin, Te Ma, Hao Huang, Wenbo Zhao, Zhijian Ou

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1840] arXiv:2406.02208 (cross-list from cs.CV) [pdf, html, other]

Title: Why Only Text: Empowering Vision-and-Language Navigation with Multi-modal Prompts

Haodong Hong, Sen Wang, Zi Huang, Qi Wu, Jiajun Liu

Comments: IJCAI 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1841] arXiv:2406.02265 (cross-list from cs.CV) [pdf, html, other]

Title: Understanding Retrieval Robustness for Retrieval-Augmented Image Captioning

Wenyan Li, Jiaang Li, Rita Ramos, Raphael Tang, Desmond Elliott

Comments: 9 pages, long paper at ACL 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1842] arXiv:2406.02332 (cross-list from cs.LG) [pdf, html, other]

Title: Extended Mind Transformers

Phoebe Klett, Thomas Ahle

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1843] arXiv:2406.02356 (cross-list from cs.LG) [pdf, html, other]

Title: Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasks

Andrew Gambardella, Yusuke Iwasawa, Yutaka Matsuo

Comments: In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1844] arXiv:2406.02368 (cross-list from cs.IR) [pdf, html, other]

Title: Large Language Models Make Sample-Efficient Recommender Systems

Jianghao Lin, Xinyi Dai, Rong Shan, Bo Chen, Ruiming Tang, Yong Yu, Weinan Zhang

Comments: Accepted by Frontier of Computer Science

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1845] arXiv:2406.02377 (cross-list from cs.IR) [pdf, html, other]

Title: XRec: Large Language Models for Explainable Recommendation

Qiyao Ma, Xubin Ren, Chao Huang

Comments: Accepted to EMNLP 2024 Findings

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1846] arXiv:2406.02469 (cross-list from cs.LG) [pdf, html, other]

Title: Landscape-Aware Growing: The Power of a Little LAG

Stefani Karp, Nikunj Saunshi, Sobhan Miryoosefi, Sashank J. Reddi, Sanjiv Kumar

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1847] arXiv:2406.02488 (cross-list from eess.AS) [pdf, html, other]

Title: Language-Universal Speech Attributes Modeling for Zero-Shot Multilingual Spoken Keyword Recognition

Hao Yen, Pin-Jui Ku, Sabato Marco Siniscalchi, Chin-Hui Lee

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1848] arXiv:2406.02539 (cross-list from cs.CV) [pdf, html, other]

Title: Parrot: Multilingual Visual Instruction Tuning

Hai-Long Sun, Da-Wei Zhou, Yang Li, Shiyin Lu, Chao Yi, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, De-Chuan Zhan, Han-Jia Ye

Comments: Code is available at: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1849] arXiv:2406.02543 (cross-list from cs.LG) [pdf, html, other]

Title: To Believe or Not to Believe Your LLM

Yasin Abbasi Yadkori, Ilja Kuzborskij, András György, Csaba Szepesvári

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1850] arXiv:2406.02554 (cross-list from eess.AS) [pdf, other]

Title: Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition

Shijian Deng, Erin E. Kosloski, Siddhi Patel, Zeke A. Barnett, Yiyang Nan, Alexander Kaplan, Sisira Aarukapalli, William T. Doan, Matthew Wang, Harsh Singh, Pamela R. Rollins, Yapeng Tian

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[1851] arXiv:2406.02555 (cross-list from eess.AS) [pdf, other]

Title: PhoWhisper: Automatic Speech Recognition for Vietnamese

Thanh-Thien Le, Linh The Nguyen, Dat Quoc Nguyen

Comments: Accepted to ICLR 2024 Tiny Papers Track

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1852] arXiv:2406.02560 (cross-list from eess.AS) [pdf, html, other]

Title: Less Peaky and More Accurate CTC Forced Alignment by Label Priors

Ruizhe Huang, Xiaohui Zhang, Zhaoheng Ni, Li Sun, Moto Hira, Jeff Hwang, Vimal Manohar, Vineel Pratap, Matthew Wiesner, Shinji Watanabe, Daniel Povey, Sanjeev Khudanpur

Comments: Accepted by ICASSP 2024. Github repo: this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1853] arXiv:2406.02562 (cross-list from eess.AS) [pdf, other]

Title: Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devices

Gwantae Kim, Bokyeung Lee, Donghyeon Kim, Hanseok Ko

Comments: Table 2 is revised

Journal-ref: ICASSP 2024 Workshop(HSCMA 2024) paper

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1854] arXiv:2406.02563 (cross-list from eess.AS) [pdf, html, other]

Title: A cost minimization approach to fix the vocabulary size in a tokenizer for an End-to-End ASR system

Sunil Kumar Kopparapu, Ashish Panda

Comments: 5 pages, 4 figures

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1855] arXiv:2406.02565 (cross-list from cs.SD) [pdf, html, other]

Title: Sequence-to-sequence models in peer-to-peer learning: A practical application

Robert Šajina, Ivo Ipšić

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Audio and Speech Processing (eess.AS)

[1856] arXiv:2406.02566 (cross-list from eess.AS) [pdf, other]

Title: Combining X-Vectors and Bayesian Batch Active Learning: Two-Stage Active Learning Pipeline for Speech Recognition

Ognjen Kundacina, Vladimir Vincan, Dragisa Miskovic

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1857] arXiv:2406.02592 (cross-list from cs.LG) [pdf, html, other]

Title: LOLAMEME: Logic, Language, Memory, Mechanistic Framework

Jay Desai, Xiaobo Guo, Srinivasan H. Sengamedu

Comments: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1858] arXiv:2406.02791 (cross-list from cs.AI) [pdf, html, other]

Title: Language Models can Infer Action Semantics for Classical Planners from Environment Feedback

Wang Zhu, Ishika Singh, Robin Jia, Jesse Thomason

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1859] arXiv:2406.02795 (cross-list from cs.HC) [pdf, html, other]

Title: ArguMentor: Augmenting User Experiences with Counter-Perspectives

Priya Pitre, Kurt Luther

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1860] arXiv:2406.02798 (cross-list from cs.DL) [pdf, other]

Title: Promotional Language and the Adoption of Innovative Ideas in Science

Hao Peng, Huilian Sophie Qiu, Henrik Barslund Fosse, Brian Uzzi

Subjects: Digital Libraries (cs.DL); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1861] arXiv:2406.02804 (cross-list from cs.AI) [pdf, html, other]

Title: $\texttt{ACCORD}$: Closing the Commonsense Measurability Gap

François Roewer-Després, Jinyue Feng, Zining Zhu, Frank Rudzicz

Comments: For leaderboard and dataset download, see this https URL For source code, see this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1862] arXiv:2406.02844 (cross-list from cs.IR) [pdf, html, other]

Title: Item-Language Model for Conversational Recommendation

Li Yang, Anushya Subbiah, Hardik Patel, Judith Yue Li, Yanwei Song, Reza Mirghaderi, Vikram Aggarwal

Comments: 15 pages, 3 figures

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1863] arXiv:2406.02900 (cross-list from cs.LG) [pdf, html, other]

Title: Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms

Rafael Rafailov, Yaswanth Chittepu, Ryan Park, Harshit Sikchi, Joey Hejna, Bradley Knox, Chelsea Finn, Scott Niekum

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1864] arXiv:2406.02924 (cross-list from cs.LG) [pdf, html, other]

Title: Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models

Peijie Dong, Lujun Li, Zhenheng Tang, Xiang Liu, Xinglin Pan, Qiang Wang, Xiaowen Chu

Comments: Accepted by ICML2024, 29 pages, 4 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)

[1865] arXiv:2406.02925 (cross-list from eess.AS) [pdf, html, other]

Title: Task Arithmetic can Mitigate Synthetic-to-Real Gap in Automatic Speech Recognition

Hsuan Su, Hua Farn, Fan-Yun Sun, Shang-Tse Chen, Hung-yi Lee

Comments: EMNLP 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1866] arXiv:2406.02943 (cross-list from cs.IR) [pdf, other]

Title: The Task-oriented Queries Benchmark (ToQB)

Keun Soo Yim

Comments: Data available on GitHub, this https URL

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Neural and Evolutionary Computing (cs.NE)

[1867] arXiv:2406.02950 (cross-list from eess.AS) [pdf, html, other]

Title: 4D ASR: Joint Beam Search Integrating CTC, Attention, Transducer, and Mask Predict Decoders

Yui Sudo, Muhammad Shakeel, Yosuke Fukumoto, Brian Yan, Jiatong Shi, Yifan Peng, Shinji Watanabe

Comments: submitted to IEEE/ACM Transactions on Audio Speech and Language Processing

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1868] arXiv:2406.02958 (cross-list from cs.LG) [pdf, html, other]

Title: PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs

Charlie Hou, Akshat Shrivastava, Hongyuan Zhan, Rylan Conway, Trang Le, Adithya Sagar, Giulia Fanti, Daniel Lazar

Comments: ICML 2024 (Oral). Latest revision corrects a discussion on concurrent work arXiv:2403.01749. We described their work as reliant on using closed-sourced models when in reality they also evaluate and use open source models. This has been corrected in this version

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[1869] arXiv:2406.02969 (cross-list from cs.LG) [pdf, html, other]

Title: Filtered not Mixed: Stochastic Filtering-Based Online Gating for Mixture of Large Language Models

Raeid Saqur, Anastasis Kratsios, Florian Krach, Yannick Limmer, Jacob-Junqi Tian, John Willes, Blanka Horvath, Frank Rudzicz

Comments: 29 pages, 5 Appendix sections

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computational Finance (q-fin.CP); Mathematical Finance (q-fin.MF)

[1870] arXiv:2406.03008 (cross-list from cs.CV) [pdf, html, other]

Title: DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences

Yidong Huang, Jacob Sansom, Ziqiao Ma, Felix Gervits, Joyce Chai

Comments: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1871] arXiv:2406.03068 (cross-list from cs.LG) [pdf, html, other]

Title: How Truncating Weights Improves Reasoning in Language Models

Lei Chen, Joan Bruna, Alberto Bietti

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1872] arXiv:2406.03248 (cross-list from cs.IR) [pdf, html, other]

Title: Large Language Models as Evaluators for Recommendation Explanations

Xiaoyu Zhang, Yishan Li, Jiayin Wang, Bowen Sun, Weizhi Ma, Peijie Sun, Min Zhang

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1873] arXiv:2406.03280 (cross-list from cs.LG) [pdf, html, other]

Title: FusionBench: A Comprehensive Benchmark of Deep Model Fusion

Anke Tang, Li Shen, Yong Luo, Han Hu, Bo Du, Dacheng Tao

Comments: Project homepage: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1874] arXiv:2406.03287 (cross-list from cs.NE) [pdf, html, other]

Title: SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms

Xingrun Xing, Zheng Zhang, Ziyi Ni, Shitao Xiao, Yiming Ju, Siqi Fan, Yequan Wang, Jiajun Zhang, Guoqi Li

Subjects: Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1875] arXiv:2406.03299 (cross-list from cs.AI) [pdf, html, other]

Title: The Good, the Bad, and the Hulk-like GPT: Analyzing Emotional Decisions of Large Language Models in Cooperation and Bargaining Games

Mikhail Mozikov, Nikita Severin, Valeria Bodishtianu, Maria Glushanina, Mikhail Baklashkin, Andrey V. Savchenko, Ilya Makarov

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1876] arXiv:2406.03445 (cross-list from cs.LG) [pdf, html, other]

Title: Pre-trained Large Language Models Use Fourier Features to Compute Addition

Tianyi Zhou, Deqing Fu, Vatsal Sharan, Robin Jia

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1877] arXiv:2406.03476 (cross-list from cs.LG) [pdf, html, other]

Title: Does your data spark joy? Performance gains from domain upsampling at the end of training

Cody Blakeney, Mansheej Paul, Brett W. Larsen, Sean Owen, Jonathan Frankle

Comments: The first three authors contributed equally

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1878] arXiv:2406.03482 (cross-list from cs.LG) [pdf, other]

Title: QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead

Amir Zandieh, Majid Daliri, Insu Han

Comments: 13 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Performance (cs.PF)

[1879] arXiv:2406.03614 (cross-list from cs.LG) [pdf, other]

Title: Advancing Anomaly Detection: Non-Semantic Financial Data Encoding with LLMs

Alexander Bakumenko (1), Kateřina Hlaváčková-Schindler (2), Claudia Plant (2), Nina C. Hubig (1) ((1) Clemson University, USA, (2) University of Vienna, Austria)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Risk Management (q-fin.RM)

[1880] arXiv:2406.03637 (cross-list from eess.AS) [pdf, html, other]

Title: Style Mixture of Experts for Expressive Text-To-Speech Synthesis

Ahad Jawaid, Shreeram Suresh Chandra, Junchen Lu, Berrak Sisman

Comments: Published in Audio Imagination: NeurIPS 2024 Workshop

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1881] arXiv:2406.03706 (cross-list from cs.SD) [pdf, html, other]

Title: Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model

Jinlong Xue, Yayue Deng, Yicheng Han, Yingming Gao, Ya Li

Comments: Accepted by Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1882] arXiv:2406.03707 (cross-list from cs.LG) [pdf, html, other]

Title: What Should Embeddings Embed? Autoregressive Models Represent Latent Generating Distributions

Liyi Zhang, Michael Y. Li, Thomas L. Griffiths

Comments: 15 pages, 8 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1883] arXiv:2406.03718 (cross-list from cs.CR) [pdf, other]

Title: Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuning

Xiaohu Du, Ming Wen, Jiahao Zhu, Zifan Xie, Bin Ji, Huijun Liu, Xuanhua Shi, Hai Jin

Comments: Accepted to ACL 2024 Findings

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1884] arXiv:2406.03736 (cross-list from cs.LG) [pdf, html, other]

Title: Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data

Jingyang Ou, Shen Nie, Kaiwen Xue, Fengqi Zhu, Jiacheng Sun, Zhenguo Li, Chongxuan Li

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1885] arXiv:2406.03807 (cross-list from cs.AI) [pdf, other]

Title: Tool-Planner: Task Planning with Clusters across Multiple Tools

Yanming Liu, Xinyue Peng, Jiannan Cao, Shi Bo, Yuwei Zhang, Xuhong Zhang, Sheng Cheng, Xun Wang, Jianwei Yin, Tianyu Du

Comments: 48pages second version

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1886] arXiv:2406.03857 (cross-list from cs.LG) [pdf, html, other]

Title: MuJo: Multimodal Joint Feature Space Learning for Human Activity Recognition

Stefan Gerd Fritsch, Cennet Oguz, Vitor Fortes Rey, Lala Ray, Maximilian Kiefer-Emmanouilidis, Paul Lukowicz

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1887] arXiv:2406.04116 (cross-list from cs.AI) [pdf, html, other]

Title: Promoting Fairness and Diversity in Speech Datasets for Mental Health and Neurological Disorders Research

Eleonora Mancini, Ana Tanevska, Andrea Galassi, Alessio Galatolo, Federico Ruggeri, Paolo Torroni

Comments: 34 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1888] arXiv:2406.04151 (cross-list from cs.AI) [pdf, html, other]

Title: AgentGym: Evolving Large Language Model-based Agents across Diverse Environments

Zhiheng Xi, Yiwen Ding, Wenxiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Dingwen Yang, Chenyang Liao, Xin Guo, Wei He, Songyang Gao, Lu Chen, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang

Comments: Project site: this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1889] arXiv:2406.04229 (cross-list from cs.LG) [pdf, html, other]

Title: The CLRS-Text Algorithmic Reasoning Language Benchmark

Larisa Markeeva, Sean McLeish, Borja Ibarz, Wilfried Bounsi, Olga Kozlova, Alex Vitvitskyi, Charles Blundell, Tom Goldstein, Avi Schwarzschild, Petar Veličković

Comments: Preprint, under review. Comments welcome

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[1890] arXiv:2406.04240 (cross-list from cs.LG) [pdf, html, other]

Title: Hypernetworks for Personalizing ASR to Atypical Speech

Max Müller-Eberstein, Dianna Yee, Karren Yang, Gautam Varma Mantena, Colin Lea

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1891] arXiv:2406.04264 (cross-list from cs.CV) [pdf, html, other]

Title: MLVU: A Comprehensive Benchmark for Multi-Task Long Video Understanding

Junjie Zhou, Yan Shu, Bo Zhao, Boya Wu, Shitao Xiao, Xi Yang, Yongping Xiong, Bo Zhang, Tiejun Huang, Zheng Liu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1892] arXiv:2406.04274 (cross-list from cs.LG) [pdf, html, other]

Title: Self-Play with Adversarial Critic: Provable and Scalable Offline Alignment for Language Models

Xiang Ji, Sanjeev Kulkarni, Mengdi Wang, Tengyang Xie

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1893] arXiv:2406.04292 (cross-list from cs.IR) [pdf, html, other]

Title: VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval

Junjie Zhou, Zheng Liu, Shitao Xiao, Bo Zhao, Yongping Xiong

Comments: Accepted to ACL 2024 main conference

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1894] arXiv:2406.04298 (cross-list from cs.IR) [pdf, html, other]

Title: Measuring and Addressing Indexical Bias in Information Retrieval

Caleb Ziems, William Held, Jane Dwivedi-Yu, Diyi Yang

Comments: ACL 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1895] arXiv:2406.04313 (cross-list from cs.LG) [pdf, html, other]

Title: Improving Alignment and Robustness with Circuit Breakers

Andy Zou, Long Phan, Justin Wang, Derek Duenas, Maxwell Lin, Maksym Andriushchenko, Rowan Wang, Zico Kolter, Matt Fredrikson, Dan Hendrycks

Comments: Code and models are available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)

[1896] arXiv:2406.04344 (cross-list from cs.LG) [pdf, html, other]

Title: Verbalized Machine Learning: Revisiting Machine Learning with Language Models

Tim Z. Xiao, Robert Bamler, Bernhard Schölkopf, Weiyang Liu

Comments: Technical Report v2 (100 pages, 27 figures, v2: added a comparison to recent work and more applications)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1897] arXiv:2406.04379 (cross-list from cs.SE) [pdf, html, other]

Title: VHDL-Eval: A Framework for Evaluating Large Language Models in VHDL Code Generation

Prashanth Vijayaraghavan, Luyao Shi, Stefano Ambrogio, Charles Mackin, Apoorva Nitsure, David Beymer, Ehsan Degan

Comments: 6 pages, 3 Figures, LAD'24

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1898] arXiv:2406.04391 (cross-list from cs.LG) [pdf, other]

Title: Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?

Rylan Schaeffer, Hailey Schoelkopf, Brando Miranda, Gabriel Mukobi, Varun Madan, Adam Ibrahim, Herbie Bradley, Stella Biderman, Sanmi Koyejo

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1899] arXiv:2406.04412 (cross-list from cs.LG) [pdf, html, other]

Title: Aligning Large Language Models with Self-generated Preference Data

Dongyoung Kim, Kimin Lee, Jinwoo Shin, Jaehyung Kim

Comments: 18 pages, under review

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1900] arXiv:2406.04432 (cross-list from eess.AS) [pdf, html, other]

Title: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition

Sreyan Ghosh, Sonal Kumar, Ashish Seth, Purva Chiniya, Utkarsh Tyagi, Ramani Duraiswami, Dinesh Manocha

Comments: InterSpeech 2024. Code and Data: this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1901] arXiv:2406.04467 (cross-list from eess.AS) [pdf, html, other]

Title: Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis

Théodor Lemerle, Nicolas Obin, Axel Roebel

Comments: Interspeech

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1902] arXiv:2406.04493 (cross-list from cs.CV) [pdf, html, other]

Title: CORU: Comprehensive Post-OCR Parsing and Receipt Understanding Dataset

Abdelrahman Abdallah, Mahmoud Abdalla, Mahmoud SalahEldin Kasem, Mohamed Mahmoud, Ibrahim Abdelhalim, Mohamed Elkasaby, Yasser ElBendary, Adam Jatowt

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1903] arXiv:2406.04501 (cross-list from cs.LG) [pdf, html, other]

Title: FLUID-LLM: Learning Computational Fluid Dynamics with Spatiotemporal-aware Large Language Models

Max Zhu, Adrián Bazaga, Pietro Liò

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1904] arXiv:2406.04595 (cross-list from cs.SD) [pdf, html, other]

Title: Pitch-Aware RNN-T for Mandarin Chinese Mispronunciation Detection and Diagnosis

Xintong Wang, Mingqian Shi, Ye Wang

Comments: Accepted at Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1905] arXiv:2406.04615 (cross-list from eess.AS) [pdf, html, other]

Title: What do MLLMs hear? Examining reasoning with text and sound components in Multimodal Large Language Models

Enis Berk Çoban, Michael I. Mandel, Johanna Devaney

Comments: 9 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1906] arXiv:2406.04734 (cross-list from cs.AI) [pdf, other]

Title: Generative AI Models: Opportunities and Risks for Industry and Authorities

Tobias Alt, Andrea Ibisch, Clemens Meiser, Anna Wilhelm, Raphael Zimmer, Christian Berghoff, Christoph Droste, Jens Karschau, Friederike Laus, Rainer Plaga, Carola Plesch, Britta Sennewald, Thomas Thaeren, Kristina Unverricht, Steffen Waurick

Comments: 33 pages, 3 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1907] arXiv:2406.04746 (cross-list from cs.CV) [pdf, html, other]

Title: PQPP: A Joint Benchmark for Text-to-Image Prompt and Query Performance Prediction

Eduard Poesina, Adriana Valentina Costache, Adrian-Gabriel Chifu, Josiane Mothe, Radu Tudor Ionescu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1908] arXiv:2406.04800 (cross-list from cs.AI) [pdf, html, other]

Title: Zero, Finite, and Infinite Belief History of Theory of Mind Reasoning in Large Language Models

Weizhi Tang, Vaishak Belle

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1909] arXiv:2406.04851 (cross-list from cs.HC) [pdf, html, other]

Title: Digital assistant in a point of sales

Emilia Lesiak, Grzegorz Wolny, Bartosz Przybył, Michał Szczerbak

Comments: update: cleaned the unnecessary files and updated the metadata

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1910] arXiv:2406.04882 (cross-list from cs.RO) [pdf, html, other]

Title: InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environment

Yuxing Long, Wenzhe Cai, Hongcheng Wang, Guanqi Zhan, Hao Dong

Comments: Submitted to CoRL 2024

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1911] arXiv:2406.04886 (cross-list from cs.CV) [pdf, html, other]

Title: Unveiling the Invisible: Captioning Videos with Metaphors

Abisek Rajakumar Kalarani, Pushpak Bhattacharyya, Sumit Shekhar

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1912] arXiv:2406.04904 (cross-list from eess.AS) [pdf, html, other]

Title: XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model

Edresson Casanova, Kelly Davis, Eren Gölge, Görkem Göknar, Iulian Gulea, Logan Hart, Aya Aljafari, Joshua Meyer, Reuben Morais, Samuel Olayemi, Julian Weber

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1913] arXiv:2406.04927 (cross-list from eess.AS) [pdf, html, other]

Title: LLM-based speaker diarization correction: A generalizable approach

Georgios Efstathiadis, Vijay Yadav, Anzar Abbas

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1914] arXiv:2406.05013 (cross-list from cs.IR) [pdf, html, other]

Title: CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search

Fengran Mo, Abbas Ghaddar, Kelong Mao, Mehdi Rezagholizadeh, Boxing Chen, Qun Liu, Jian-Yun Nie

Comments: Accepted by EMNLP 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1915] arXiv:2406.05039 (cross-list from cs.CV) [pdf, html, other]

Title: Bootstrapping Referring Multi-Object Tracking

Yani Zhang, Dongming Wu, Wencheng Han, Xingping Dong

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1916] arXiv:2406.05080 (cross-list from cs.RO) [pdf, html, other]

Title: I2EDL: Interactive Instruction Error Detection and Localization

Francesco Taioli, Stefano Rosa, Alberto Castellini, Lorenzo Natale, Alessio Del Bue, Alessandro Farinelli, Marco Cristani, Yiming Wang

Comments: Accepted at IEEE RO-MAN 2024

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1917] arXiv:2406.05084 (cross-list from cs.CY) [pdf, other]

Title: On Ambiguity and the Expressive Function of Law: The Role of Pragmatics in Smart Legal Ecosystems

Pompeu Casanovas

Comments: 50 pages, 6 Figures, first presented at the 31st Congress of General Linguistics of the University of Barcelona (UB, CLUB31), October, 2023. To be published in the Catalan Linguistic Series as a chapter of the volume edited by Jordi Fortuny, Pau Francesch and Lluis Payrato (eds.), Ambiguity: an interdisciplinary approach. Barcelona: Edicions de la Universitat de Barcelona, 2025

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[1918] arXiv:2406.05132 (cross-list from cs.CV) [pdf, html, other]

Title: 3D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination

Jianing Yang, Xuweiyi Chen, Nikhil Madaan, Madhavan Iyengar, Shengyi Qian, David F. Fouhey, Joyce Chai

Comments: Project website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Robotics (cs.RO)

[1919] arXiv:2406.05183 (cross-list from cs.LG) [pdf, other]

Title: The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More

Ouail Kitouni, Niklas Nolte, Diane Bouchacourt, Adina Williams, Mike Rabbat, Mark Ibrahim

Comments: 18 pages, 7 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1920] arXiv:2406.05190 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating the Effectiveness of Data Augmentation for Emotion Classification in Low-Resource Settings

Aashish Arora, Elsbeth Turcan

Comments: The first author contributed significantly

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1921] arXiv:2406.05205 (cross-list from cs.CV) [pdf, html, other]

Title: CPLIP: Zero-Shot Learning for Histopathology with Comprehensive Vision-Language Alignment

Sajid Javed, Arif Mahmood, Iyyakutti Iyappan Ganapathi, Fayaz Ali Dharejo, Naoufel Werghi, Mohammed Bennamoun

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[1922] arXiv:2406.05259 (cross-list from eess.AS) [pdf, html, other]

Title: A model of early word acquisition based on realistic-scale audiovisual naming events

Khazar Khorrami, Okko Räsänen

Comments: 22 pages, 4 figures, journal article, submitted for review

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1923] arXiv:2406.05317 (cross-list from cs.LG) [pdf, html, other]

Title: LoCoCo: Dropping In Convolutions for Long Context Compression

Ruisi Cai, Yuandong Tian, Zhangyang Wang, Beidi Chen

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1924] arXiv:2406.05343 (cross-list from cs.AI) [pdf, html, other]

Title: M3GIA: A Cognition Inspired Multilingual and Multimodal General Intelligence Ability Benchmark

Wei Song, Yadong Li, Jianhua Xu, Guowei Wu, Lingfeng Ming, Kexin Yi, Weihua Luo, Houyi Li, Yi Du, Fangda Guo, Kaicheng Yu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1925] arXiv:2406.05410 (cross-list from cs.AI) [pdf, html, other]

Title: MLLM-SR: Conversational Symbolic Regression base Multi-Modal Large Language Models

Yanjie Li, Weijun Li, Lina Yu, Min Wu, Jingyi Liu, Wenqiang Li, Shu Wei, Yusong Deng

Comments: 13 pages,

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1926] arXiv:2406.05510 (cross-list from cs.LG) [pdf, html, other]

Title: Representation Learning with Conditional Information Flow Maximization

Dou Hu, Lingwei Wei, Wei Zhou, Songlin Hu

Comments: 16 pages, accepted to ACL 2024 (main conference), the code is available at this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1927] arXiv:2406.05515 (cross-list from cs.SD) [pdf, html, other]

Title: Mmm whatcha say? Uncovering distal and proximal context effects in first and second-language word perception using psychophysical reverse correlation

Paige Tuttösí, H. Henny Yeung, Yue Wang, Fenqi Wang, Guillaume Denis, Jean-Julien Aucouturier, Angelica Lim

Comments: Accepted to INTERSPEECH 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1928] arXiv:2406.05516 (cross-list from cs.LG) [pdf, html, other]

Title: Verbalized Probabilistic Graphical Modeling with Large Language Models

Hengguan Huang, Xing Shen, Songtao Wang, Dianbo Liu, Hao Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1929] arXiv:2406.05534 (cross-list from cs.AI) [pdf, html, other]

Title: Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing

Biqing Qi, Pengfei Li, Fangyuan Li, Junqi Gao, Kaiyan Zhang, Bowen Zhou

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1930] arXiv:2406.05540 (cross-list from q-bio.QM) [pdf, html, other]

Title: A Fine-tuning Dataset and Benchmark for Large Language Models for Protein Understanding

Yiqing Shen, Zan Chen, Michail Mamalakis, Luhan He, Haiyang Xia, Tianbin Li, Yanzhou Su, Junjun He, Yu Guang Wang

Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1931] arXiv:2406.05547 (cross-list from cs.SD) [pdf, html, other]

Title: Exploring the Benefits of Tokenization of Discrete Acoustic Units

Avihu Dekel, Raul Fernandez

Comments: Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1932] arXiv:2406.05551 (cross-list from eess.AS) [pdf, html, other]

Title: Autoregressive Diffusion Transformer for Text-to-Speech Synthesis

Zhijun Liu, Shuai Wang, Sho Inoue, Qibing Bai, Haizhou Li

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1933] arXiv:2406.05564 (cross-list from cs.LG) [pdf, html, other]

Title: Automata Extraction from Transformers

Yihao Zhang, Zeming Wei, Meng Sun

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Formal Languages and Automata Theory (cs.FL)

[1934] arXiv:2406.05602 (cross-list from cs.CV) [pdf, html, other]

Title: Can Prompt Modifiers Control Bias? A Comparative Analysis of Text-to-Image Generative Models

Philip Wootaek Shin, Jihyun Janice Ahn, Wenpeng Yin, Jack Sampson, Vijaykrishnan Narayanan

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1935] arXiv:2406.05629 (cross-list from cs.CV) [pdf, html, other]

Title: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language

Mark Hamilton, Andrew Zisserman, John R. Hershey, William T. Freeman

Comments: Computer Vision and Pattern Recognition 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1936] arXiv:2406.05651 (cross-list from cs.RO) [pdf, html, other]

Title: A Superalignment Framework in Autonomous Driving with Large Language Models

Xiangrui Kong, Thomas Braunl, Marco Fahmi, Yue Wang

Comments: 6 pages, 5 figures, ieeeiv24

Subjects: Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1937] arXiv:2406.05673 (cross-list from cs.AI) [pdf, html, other]

Title: Flow of Reasoning:Training LLMs for Divergent Problem Solving with Minimal Examples

Fangxu Yu, Lai Jiang, Haoqiang Kang, Shibo Hao, Lianhui Qin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1938] arXiv:2406.05756 (cross-list from cs.AI) [pdf, html, other]

Title: EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models

Mengfei Du, Binhao Wu, Zejun Li, Xuanjing Huang, Zhongyu Wei

Comments: Accepted by ACL 2024 Main

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[1939] arXiv:2406.05766 (cross-list from cs.LG) [pdf, html, other]

Title: Set-CLIP: Exploring Aligned Semantic From Low-Alignment Multimodal Data Through A Distribution View

Zijia Song, Zelin Zang, Yelin Wang, Guozheng Yang, Kaicheng yu, Wanyu Chen, Miaoyu Wang, Stan Z. Li

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1940] arXiv:2406.05797 (cross-list from q-bio.BM) [pdf, html, other]

Title: 3D-MolT5: Towards Unified 3D Molecule-Text Modeling with 3D Molecular Tokenization

Qizhi Pei, Lijun Wu, Kaiyuan Gao, Jinhua Zhu, Rui Yan

Comments: 18 pages

Subjects: Biomolecules (q-bio.BM); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1941] arXiv:2406.05804 (cross-list from cs.AI) [pdf, html, other]

Title: A Review of Prominent Paradigms for LLM-Based Agents: Tool Use (Including RAG), Planning, and Feedback Learning

Xinzhe Li

Comments: Under Review

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

[1942] arXiv:2406.05814 (cross-list from cs.CV) [pdf, html, other]

Title: Unified Text-to-Image Generation and Retrieval

Leigang Qu, Haochuan Li, Tan Wang, Wenjie Wang, Yongqi Li, Liqiang Nie, Tat-Seng Chua

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1943] arXiv:2406.05870 (cross-list from cs.CR) [pdf, html, other]

Title: Machine Against the RAG: Jamming Retrieval-Augmented Generation with Blocker Documents

Avital Shafran, Roei Schuster, Vitaly Shmatikov

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1944] arXiv:2406.05872 (cross-list from cs.LG) [pdf, html, other]

Title: STARLING: Self-supervised Training of Text-based Reinforcement Learning Agent with Large Language Models

Shreyas Basavatia, Keerthiram Murugesan, Shivam Ratnakar

Comments: ACL 2024 (Findings)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1945] arXiv:2406.05881 (cross-list from cs.LG) [pdf, html, other]

Title: LGR2: Language Guided Reward Relabeling for Accelerating Hierarchical Reinforcement Learning

Utsav Singh, Pramit Bhattacharyya, Vinay P. Namboodiri

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Robotics (cs.RO)

[1946] arXiv:2406.05902 (cross-list from cs.LG) [pdf, html, other]

Title: Whose Preferences? Differences in Fairness Preferences and Their Impact on the Fairness of AI Utilizing Human Feedback

Emilia Agis Lerner, Florian E. Dorner, Elliott Ash, Naman Goel

Comments: To appear in the Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, ACL 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1947] arXiv:2406.05955 (cross-list from cs.LG) [pdf, html, other]

Title: Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters

Yixin Song, Haotong Xie, Zhengyan Zhang, Bo Wen, Li Ma, Zeyu Mi, Haibo Chen

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1948] arXiv:2406.05967 (cross-list from cs.CV) [pdf, html, other]

Title: CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark

David Romero, Chenyang Lyu, Haryo Akbarianto Wibowo, Teresa Lynn, Injy Hamed, Aditya Nanda Kishore, Aishik Mandal, Alina Dragonetti, Artem Abzaliev, Atnafu Lambebo Tonja, Bontu Fufa Balcha, Chenxi Whitehouse, Christian Salamea, Dan John Velasco, David Ifeoluwa Adelani, David Le Meur, Emilio Villa-Cueva, Fajri Koto, Fauzan Farooqui, Frederico Belcavello, Ganzorig Batnasan, Gisela Vallejo, Grainne Caulfield, Guido Ivetta, Haiyue Song, Henok Biadglign Ademtew, Hernán Maina, Holy Lovenia, Israel Abebe Azime, Jan Christian Blaise Cruz, Jay Gala, Jiahui Geng, Jesus-German Ortiz-Barajas, Jinheon Baek, Jocelyn Dunstan, Laura Alonso Alemany, Kumaranage Ravindu Yasas Nagasinghe, Luciana Benotti, Luis Fernando D'Haro, Marcelo Viridiano, Marcos Estecha-Garitagoitia, Maria Camila Buitrago Cabrera, Mario Rodríguez-Cantelar, Mélanie Jouitteau, Mihail Mihaylov, Mohamed Fazli Mohamed Imam, Muhammad Farid Adilazuarda, Munkhjargal Gochoo, Munkh-Erdene Otgonbold, Naome Etori, Olivier Niyomugisha, Paula Mónica Silva, Pranjal Chitale, Raj Dabre, Rendi Chevi, Ruochen Zhang, Ryandito Diandaru, Samuel Cahyawijaya, Santiago Góngora, Soyeong Jeong, Sukannya Purkayastha, Tatsuki Kuribayashi, Thanmay Jayakumar, Tiago Timponi Torrent, Toqeer Ehsan, Vladimir Araujo, Yova Kementchedjhieva, Zara Burzo, Zheng Wei Lim, Zheng Xin Yong, Oana Ignat, Joan Nwatu, Rada Mihalcea, Thamar Solorio, Alham Fikri Aji

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1949] arXiv:2406.05968 (cross-list from eess.AS) [pdf, html, other]

Title: Prompting Large Language Models with Audio for General-Purpose Speech Summarization

Wonjune Kang, Deb Roy

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1950] arXiv:2406.05981 (cross-list from cs.LG) [pdf, html, other]

Title: ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization

Haoran You, Yipin Guo, Yichao Fu, Wei Zhou, Huihong Shi, Xiaofan Zhang, Souvik Kundu, Amir Yazdanbakhsh, Yingyan Celine Lin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1951] arXiv:2406.06004 (cross-list from cs.CV) [pdf, html, other]

Title: FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model

Yebin Lee, Imseong Park, Myungjoo Kang

Comments: Accepted at ACL (Main) 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1952] arXiv:2406.06007 (cross-list from cs.LG) [pdf, html, other]

Title: CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models

Peng Xia, Ze Chen, Juanxi Tian, Yangrui Gong, Ruibo Hou, Yue Xu, Zhenbang Wu, Zhiyuan Fan, Yiyang Zhou, Kangyu Zhu, Wenhao Zheng, Zhaoyang Wang, Xiao Wang, Xuchao Zhang, Chetan Bansal, Marc Niethammer, Junzhou Huang, Hongtu Zhu, Yun Li, Jimeng Sun, Zongyuan Ge, Gang Li, James Zou, Huaxiu Yao

Comments: NeurIPS 2024 Datasets and Benchmarks Track

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)

[1953] arXiv:2406.06025 (cross-list from cs.SE) [pdf, html, other]

Title: RepoQA: Evaluating Long Context Code Understanding

Jiawei Liu, Jia Le Tian, Vijay Daita, Yuxiang Wei, Yifeng Ding, Yuhan Katherine Wang, Jun Yang, Lingming Zhang

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1954] arXiv:2406.06097 (cross-list from cs.SD) [pdf, other]

Title: StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection

Sara Papi, Marco Gaido, Matteo Negri, Luisa Bentivogli

Comments: Accepted at ACL 2024 main conference

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1955] arXiv:2406.06139 (cross-list from cs.SD) [pdf, html, other]

Title: Thunder : Unified Regression-Diffusion Speech Enhancement with a Single Reverse Step using Brownian Bridge

Thanapat Trachu, Chawan Piansaddhayanon, Ekapol Chuangsuwanich

Comments: 5 pages, 3 figures, 4 tables, This paper will be submitted in the interspeech conference

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1956] arXiv:2406.06220 (cross-list from eess.AS) [pdf, html, other]

Title: Label-Looping: Highly Efficient Decoding for Transducers

Vladimir Bataev, Hainan Xu, Daniel Galvez, Vitaly Lavrukhin, Boris Ginsburg

Comments: Accepted at IEEE SLT 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1957] arXiv:2406.06251 (cross-list from eess.AS) [pdf, html, other]

Title: Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning

Chung-Ming Chien, Andros Tjandra, Apoorv Vyas, Matt Le, Bowen Shi, Wei-Ning Hsu

Comments: Accepted by InterSpeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1958] arXiv:2406.06382 (cross-list from cs.CV) [pdf, html, other]

Title: Diffusion-RPO: Aligning Diffusion Models through Relative Preference Optimization

Yi Gu, Zhendong Wang, Yueqin Yin, Yujia Xie, Mingyuan Zhou

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1959] arXiv:2406.06385 (cross-list from cs.LG) [pdf, html, other]

Title: Low-Rank Quantization-Aware Training for LLMs

Yelysei Bondarenko, Riccardo Del Chiaro, Markus Nagel

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1960] arXiv:2406.06391 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Lifelong Learning of Large Language Models: A Survey

Junhao Zheng, Shengjie Qiu, Chengming Shi, Qianli Ma

Comments: 37 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1961] arXiv:2406.06393 (cross-list from cs.CV) [pdf, html, other]

Title: STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomics

Jiawen Chen, Muqing Zhou, Wenrong Wu, Jinwei Zhang, Yun Li, Didong Li

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Genomics (q-bio.GN)

[1962] arXiv:2406.06443 (cross-list from cs.LG) [pdf, html, other]

Title: LLM Dataset Inference: Did you train on my dataset?

Pratyush Maini, Hengrui Jia, Nicolas Papernot, Adam Dziedzic

Comments: Code is available at \href{this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1963] arXiv:2406.06455 (cross-list from cs.AI) [pdf, html, other]

Title: A Large Language Model Pipeline for Breast Cancer Oncology

Tristen Pool, Dennis Trujillo

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1964] arXiv:2406.06464 (cross-list from cs.AI) [pdf, other]

Title: Transforming Wearable Data into Health Insights using Large Language Model Agents

Mike A. Merrill, Akshay Paruchuri, Naghmeh Rezaei, Geza Kovacs, Javier Perez, Yun Liu, Erik Schenck, Nova Hammerquist, Jake Sunshine, Shyam Tailor, Kumar Ayush, Hao-Wei Su, Qian He, Cory Y. McLean, Mark Malhotra, Shwetak Patel, Jiening Zhan, Tim Althoff, Daniel McDuff, Xin Liu

Comments: 38 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1965] arXiv:2406.06465 (cross-list from cs.CV) [pdf, html, other]

Title: AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Prediction

Zhen Xing, Qi Dai, Zejia Weng, Zuxuan Wu, Yu-Gang Jiang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1966] arXiv:2406.06469 (cross-list from cs.AI) [pdf, html, other]

Title: Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning

Joongwon Kim, Bhargavi Paranjape, Tushar Khot, Hannaneh Hajishirzi

Comments: 50 pages, 42 figures. Project webpage available [here](this https URL)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1967] arXiv:2406.06474 (cross-list from cs.AI) [pdf, html, other]

Title: Towards a Personal Health Large Language Model

Justin Cosentino, Anastasiya Belyaeva, Xin Liu, Nicholas A. Furlotte, Zhun Yang, Chace Lee, Erik Schenck, Yojan Patel, Jian Cui, Logan Douglas Schneider, Robby Bryant, Ryan G. Gomes, Allen Jiang, Roy Lee, Yun Liu, Javier Perez, Jameson K. Rogers, Cathy Speed, Shyam Tailor, Megan Walker, Jeffrey Yu, Tim Althoff, Conor Heneghan, John Hernandez, Mark Malhotra, Leor Stern, Yossi Matias, Greg S. Corrado, Shwetak Patel, Shravya Shetty, Jiening Zhan, Shruthi Prabhakara, Daniel McDuff, Cory Y. McLean

Comments: 72 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1968] arXiv:2406.06484 (cross-list from cs.LG) [pdf, html, other]

Title: Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Songlin Yang, Bailin Wang, Yu Zhang, Yikang Shen, Yoon Kim

Comments: Preprint

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1969] arXiv:2406.06496 (cross-list from cs.LG) [pdf, html, other]

Title: Direct Preference Optimization for Suppressing Hallucinated Prior Exams in Radiology Report Generation

Oishi Banerjee, Hong-Yu Zhou, Subathra Adithan, Stephen Kwak, Kay Wu, Pranav Rajpurkar

Comments: Added acknowledgemnts

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1970] arXiv:2406.06555 (cross-list from cs.LG) [pdf, html, other]

Title: An Evaluation Benchmark for Autoformalization in Lean4

Aryan Gulati, Devanshu Ladsaria, Shubhra Mishra, Jasdeep Sidhu, Brando Miranda

Comments: To appear at ICLR 2024 as part of the Tiny Papers track

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Programming Languages (cs.PL)

[1971] arXiv:2406.06564 (cross-list from cs.LG) [pdf, html, other]

Title: SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information

Kaiye Zhou, Shucheng Wang, Jun Xu

Comments: SwitchLoRA introduces an innovative parameter-efficient training method that dynamically switches parameters throughout the entire training period, achieving significant memory and communication overhead while preserving accuracy

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1972] arXiv:2406.06567 (cross-list from cs.LG) [pdf, html, other]

Title: DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion

Yilong Chen, Linhao Zhang, Junyuan Shang, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun

Comments: 10 pages, 9 figures, 3 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1973] arXiv:2406.06600 (cross-list from cs.LG) [pdf, other]

Title: HORAE: A Domain-Agnostic Modeling Language for Automating Multimodal Service Regulation

Yutao Sun, Mingshuai Chen, Tiancheng Zhao, Kangjia Zhao, He Li, Jintao Chen, Liqiang Lu, Xinkui Zhao, Shuiguang Deng, Jianwei Yin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1974] arXiv:2406.06619 (cross-list from eess.AS) [pdf, html, other]

Title: LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR

Zheshu Song, Jianheng Zhuo, Yifan Yang, Ziyang Ma, Shixiong Zhang, Xie Chen

Comments: 5 pages, 2 figures, conference

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1975] arXiv:2406.06620 (cross-list from cs.LG) [pdf, html, other]

Title: DualTime: A Dual-Adapter Multimodal Language Model for Time Series Representation

Weiqi Zhang, Jiexia Ye, Ziyue Li, Jia Li, Fugee Tsung

Comments: 15 pages, 12 figure, 5 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1976] arXiv:2406.06663 (cross-list from cs.CR) [pdf, html, other]

Title: SecureNet: A Comparative Study of DeBERTa and Large Language Models for Phishing Detection

Sakshi Mahendru, Tejul Pandit

Comments: Preprint. 10 pages, Accepted in IEEE 7th International Conference on Big Data and Artificial Intelligence (BDAI 2024)

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1977] arXiv:2406.06729 (cross-list from cs.IR) [pdf, html, other]

Title: Synthetic Query Generation using Large Language Models for Virtual Assistants

Sonal Sannigrahi, Thiago Fraga-Silva, Youssef Oualil, Christophe Van Gysel

Comments: SIGIR '24. The 47th International ACM SIGIR Conference on Research & Development in Information Retrieval

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1978] arXiv:2406.06737 (cross-list from cs.CR) [pdf, html, other]

Title: Raccoon: Prompt Extraction Benchmark of LLM-Integrated Applications

Junlin Wang, Tianyi Yang, Roy Xie, Bhuwan Dhingra

Comments: ACL 2024 Findings

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1979] arXiv:2406.06764 (cross-list from cs.SE) [pdf, html, other]

Title: $Classi|Q\rangle$ Towards a Translation Framework To Bridge The Classical-Quantum Programming Gap

Matteo Esposito, Maryam Tavassoli Sabzevari, Boshuai Ye, Davide Falessi, Arif Ali Khan, Davide Taibi

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Emerging Technologies (cs.ET); Programming Languages (cs.PL)

[1980] arXiv:2406.06769 (cross-list from cs.AI) [pdf, html, other]

Title: DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents

Peter Jansen, Marc-Alexandre Côté, Tushar Khot, Erin Bransom, Bhavana Dalvi Mishra, Bodhisattwa Prasad Majumder, Oyvind Tafjord, Peter Clark

Comments: Accepted to NeurIPS 2024 (Benchmark Track, Spotlight)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1981] arXiv:2406.06799 (cross-list from cs.DC) [pdf, html, other]

Title: LLM-dCache: Improving Tool-Augmented LLMs with GPT-Driven Localized Data Caching

Simranjit Singh, Michael Fore, Andreas Karatzas, Chaehong Lee, Yanan Jian, Longfei Shangguan, Fuxun Yu, Iraklis Anagnostopoulos, Dimitrios Stamoulis

Comments: ICECS 2024 Camera-Ready

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL)

[1982] arXiv:2406.06852 (cross-list from cs.CR) [pdf, other]

Title: A Survey of Backdoor Attacks and Defenses on Large Language Models: Implications for Security Measures

Shuai Zhao, Meihuizi Jia, Zhongliang Guo, Leilei Gan, Xiaoyu Xu, Xiaobao Wu, Jie Fu, Yichao Feng, Fengjun Pan, Luu Anh Tuan

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1983] arXiv:2406.06870 (cross-list from cs.AI) [pdf, html, other]

Title: What's in an embedding? Would a rose by any embedding smell as sweet?

Venkat Venkatasubramanian

Comments: 7 pages, 9 images

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1984] arXiv:2406.07012 (cross-list from cs.SD) [pdf, html, other]

Title: Bridging Language Gaps in Audio-Text Retrieval

Zhiyong Yan, Heinrich Dinkel, Yongqing Wang, Jizhong Liu, Junbo Zhang, Yujun Wang, Bin Wang

Comments: interspeech2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1985] arXiv:2406.07017 (cross-list from cs.LG) [pdf, html, other]

Title: MoreauPruner: Robust Pruning of Large Language Models against Weight Perturbations

Zixiao Wang, Jingwei Zhang, Wenqian Zhao, Farzan Farnia, Bei Yu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1986] arXiv:2406.07034 (cross-list from cs.AI) [pdf, html, other]

Title: Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning

Jeonghoon Kim, Heesoo Jung, Hyeju Jang, Hogun Park

Comments: Accepted to ACL 2024 Findings

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1987] arXiv:2406.07096 (cross-list from eess.AS) [pdf, html, other]

Title: Fast Context-Biasing for CTC and Transducer ASR models with CTC-based Word Spotter

Andrei Andrusenko, Aleksandr Laptev, Vladimir Bataev, Vitaly Lavrukhin, Boris Ginsburg

Comments: Accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1988] arXiv:2406.07133 (cross-list from eess.AS) [pdf, html, other]

Title: Translating speech with just images

Dan Oneata, Herman Kamper

Comments: Accepted at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1989] arXiv:2406.07155 (cross-list from cs.AI) [pdf, html, other]

Title: Scaling Large-Language-Model-based Multi-Agent Collaboration

Chen Qian, Zihao Xie, Yifei Wang, Wei Liu, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, Zhiyuan Liu, Maosong Sun

Comments: Work in progress; The code and data will be available at this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Networking and Internet Architecture (cs.NI); Social and Information Networks (cs.SI)

[1990] arXiv:2406.07162 (cross-list from cs.SD) [pdf, html, other]

Title: EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark

Ziyang Ma, Mingjie Chen, Hezhao Zhang, Zhisheng Zheng, Wenxi Chen, Xiquan Li, Jiaxin Ye, Xie Chen, Thomas Hain

Comments: Accepted by INTERSPEECH 2024. GitHub Repository: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[1991] arXiv:2406.07217 (cross-list from cs.LG) [pdf, other]

Title: A Synthetic Dataset for Personal Attribute Inference

Hanna Yukhymenko, Robin Staab, Mark Vero, Martin Vechev

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1992] arXiv:2406.07268 (cross-list from cs.MM) [pdf, html, other]

Title: Advancing Grounded Multimodal Named Entity Recognition via LLM-Based Reformulation and Box-Based Segmentation

Jinyuan Li, Ziyan Li, Han Li, Jianfei Yu, Rui Xia, Di Sun, Gang Pan

Comments: Extension of our Findings of EMNLP 2023 & ACL 2024 paper

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1993] arXiv:2406.07296 (cross-list from cs.RO) [pdf, html, other]

Title: Instruct Large Language Models to Drive like Humans

Ruijun Zhang, Xianda Guo, Wenzhao Zheng, Chenming Zhang, Kurt Keutzer, Long Chen

Comments: project page: this https URL

Subjects: Robotics (cs.RO); Computation and Language (cs.CL)

[1994] arXiv:2406.07310 (cross-list from eess.AS) [pdf, html, other]

Title: MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting

Zhiqi Ai, Zhiyong Chen, Shugong Xu

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1995] arXiv:2406.07327 (cross-list from cs.AI) [pdf, html, other]

Title: 3D-Properties: Identifying Challenges in DPO and Charting a Path Forward

Yuzi Yan, Yibo Miao, Jialian Li, Yipin Zhang, Jian Xie, Zhijie Deng, Dong Yan

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1996] arXiv:2406.07348 (cross-list from cs.LG) [pdf, html, other]

Title: DR-RAG: Applying Dynamic Document Relevance to Retrieval-Augmented Generation for Question-Answering

Zijian Hei, Weiling Liu, Wenjie Ou, Juyi Qiao, Junming Jiao, Guowen Song, Ting Tian, Yi Lin

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1997] arXiv:2406.07358 (cross-list from cs.AI) [pdf, html, other]

Title: AI Sandbagging: Language Models can Strategically Underperform on Evaluations

Teun van der Weij, Felix Hofstätter, Ollie Jaffe, Samuel F. Brown, Francis Rhys Ward

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1998] arXiv:2406.07378 (cross-list from cs.AI) [pdf, html, other]

Title: Large Language Models for Constrained-Based Causal Discovery

Kai-Hendrik Cohrs, Gherardo Varando, Emiliano Diaz, Vasileios Sitokonstantinou, Gustau Camps-Valls

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1999] arXiv:2406.07411 (cross-list from cs.SE) [pdf, html, other]

Title: VersiCode: Towards Version-controllable Code Generation

Tongtong Wu, Weigang Wu, Xingyu Wang, Kang Xu, Suyu Ma, Bo Jiang, Ping Yang, Zhenchang Xing, Yuan-Fang Li, Gholamreza Haffari

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2000] arXiv:2406.07476 (cross-list from cs.CV) [pdf, html, other]

Title: VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

Zesen Cheng, Sicong Leng, Hang Zhang, Yifei Xin, Xin Li, Guanzheng Chen, Yongxin Zhu, Wenqi Zhang, Ziyang Luo, Deli Zhao, Lidong Bing

Comments: ZC, SL, HZ, YX, and XL contributed equally to this project. Code: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2001] arXiv:2406.07502 (cross-list from cs.CV) [pdf, html, other]

Title: Image Textualization: An Automatic Framework for Creating Accurate and Detailed Image Descriptions

Renjie Pi, Jianshu Zhang, Jipeng Zhang, Rui Pan, Zhekai Chen, Tong Zhang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2002] arXiv:2406.07544 (cross-list from cs.CV) [pdf, html, other]

Title: Situational Awareness Matters in 3D Vision Language Reasoning

Yunze Man, Liang-Yan Gui, Yu-Xiong Wang

Comments: CVPR 2024. Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2003] arXiv:2406.07546 (cross-list from cs.CV) [pdf, html, other]

Title: Commonsense-T2I Challenge: Can Text-to-Image Generation Models Understand Commonsense?

Xingyu Fu, Muyu He, Yujie Lu, William Yang Wang, Dan Roth

Comments: COLM 2024, Project Url: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2004] arXiv:2406.07553 (cross-list from cs.DC) [pdf, other]

Title: Inference Acceleration for Large Language Models on CPUs

Ditto PS, Jithin VG, Adarsh MS

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL)

[2005] arXiv:2406.07584 (cross-list from cs.CV) [pdf, html, other]

Title: BrainChat: Decoding Semantic Information from fMRI using Vision-language Pretrained Models

Wanaiu Huang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2006] arXiv:2406.07588 (cross-list from cs.MM) [pdf, html, other]

Title: AIM: Let Any Multi-modal Large Language Models Embrace Efficient In-Context Learning

Jun Gao, Qian Qiao, Ziqiang Cao, Zili Wang, Wenjie Li

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL)

[2007] arXiv:2406.07657 (cross-list from cs.LG) [pdf, html, other]

Title: OPTune: Efficient Online Preference Tuning

Lichang Chen, Jiuhai Chen, Chenxi Liu, John Kirchenbauer, Davit Soselia, Chen Zhu, Tom Goldstein, Tianyi Zhou, Heng Huang

Comments: 16 pages, 7 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2008] arXiv:2406.07693 (cross-list from cs.CY) [pdf, other]

Title: A Labelled Dataset for Sentiment Analysis of Videos on YouTube, TikTok, and Other Sources about the 2024 Outbreak of Measles

Nirmalya Thakur, Vanessa Su, Mingchen Shao, Kesha A. Patel, Hongseok Jeong, Victoria Knieling, Andrew Bian

Comments: 19 pages

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[2009] arXiv:2406.07753 (cross-list from cs.AI) [pdf, html, other]

Title: The MuSe 2024 Multimodal Sentiment Analysis Challenge: Social Perception and Humor Recognition

Shahin Amiriparian, Lukas Christ, Alexander Kathan, Maurice Gerczuk, Niklas Müller, Steffen Klug, Lukas Stappen, Andreas König, Erik Cambria, Björn Schuller, Simone Eulitz

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2010] arXiv:2406.07778 (cross-list from cs.CR) [pdf, html, other]

Title: A Study of Backdoors in Instruction Fine-tuned Language Models

Jayaram Raghuram, George Kesidis, David J. Miller

Comments: Under review

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2011] arXiv:2406.07780 (cross-list from cs.LG) [pdf, html, other]

Title: A Critical Look At Tokenwise Reward-Guided Text Generation

Ahmad Rashid, Ruotian Wu, Julia Grosse, Agustinus Kristiadi, Pascal Poupart

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2012] arXiv:2406.07814 (cross-list from cs.AI) [pdf, html, other]

Title: Collective Constitutional AI: Aligning a Language Model with Public Input

Saffron Huang, Divya Siddarth, Liane Lovitt, Thomas I. Liao, Esin Durmus, Alex Tamkin, Deep Ganguli

Journal-ref: Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency. 1395-1417

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[2013] arXiv:2406.07816 (cross-list from eess.AS) [pdf, html, other]

Title: Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio

Lin Zhang, Xin Wang, Erica Cooper, Mireia Diez, Federico Landini, Nicholas Evans, Junichi Yamagishi

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2014] arXiv:2406.07822 (cross-list from cs.CV) [pdf, html, other]

Title: Tell Me What's Next: Textual Foresight for Generic UI Representations

Andrea Burns, Kate Saenko, Bryan A. Plummer

Comments: Accepted to ACL 2024 Findings. Data and code to be released at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2015] arXiv:2406.07841 (cross-list from cs.CV) [pdf, html, other]

Title: Labeling Comic Mischief Content in Online Videos with a Multimodal Hierarchical-Cross-Attention Model

Elaheh Baharlouei, Mahsa Shafaei, Yigeng Zhang, Hugo Jair Escalante, Thamar Solorio

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2016] arXiv:2406.07842 (cross-list from eess.AS) [pdf, html, other]

Title: Dual-Pipeline with Low-Rank Adaptation for New Language Integration in Multilingual ASR

Yerbolat Khassanov, Zhipeng Chen, Tianfeng Chen, Tze Yuang Chong, Wei Li, Jun Zhang, Lu Lu, Yuxuan Wang

Comments: 5 pages, 2 figures, 4 tables

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2017] arXiv:2406.07887 (cross-list from cs.LG) [pdf, html, other]

Title: An Empirical Study of Mamba-based Language Models

Roger Waleffe, Wonmin Byeon, Duncan Riach, Brandon Norick, Vijay Korthikanti, Tri Dao, Albert Gu, Ali Hatamizadeh, Sudhakar Singh, Deepak Narayanan, Garvit Kulshreshtha, Vartika Singh, Jared Casper, Jan Kautz, Mohammad Shoeybi, Bryan Catanzaro

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2018] arXiv:2406.07890 (cross-list from eess.AS) [pdf, html, other]

Title: Exploring Speech Foundation Models for Speaker Diarization in Child-Adult Dyadic Interactions

Anfeng Xu, Kevin Huang, Tiantian Feng, Lue Shen, Helen Tager-Flusberg, Shrikanth Narayanan

Comments: Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2019] arXiv:2406.07909 (cross-list from eess.AS) [pdf, html, other]

Title: Guiding Frame-Level CTC Alignments Using Self-knowledge Distillation

Eungbeom Kim, Hantae Kim, Kyogu Lee

Comments: Accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD); Machine Learning (stat.ML)

[2020] arXiv:2406.07962 (cross-list from cs.AI) [pdf, html, other]

Title: Toward a Method to Generate Capability Ontologies from Natural Language Descriptions

Luis Miguel Vieira da Silva, Aljosha Köcher, Felix Gehlhoff, Alexander Fay

Comments: \c{opyright} 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2021] arXiv:2406.07964 (cross-list from cs.SI) [pdf, html, other]

Title: Political Leaning Inference through Plurinational Scenarios

Joseba Fernandez de Landa, Rodrigo Agerri

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[2022] arXiv:2406.07969 (cross-list from eess.AS) [pdf, html, other]

Title: LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning

Masaya Kawamura, Ryuichi Yamamoto, Yuma Shirahata, Takuya Hasumi, Kentaro Tachibana

Comments: Accepted to INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[2023] arXiv:2406.07990 (cross-list from cs.LG) [pdf, html, other]

Title: Blowfish: Topological and statistical signatures for quantifying ambiguity in semantic search

Thomas Roland Barillot, Alex De Castro

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2024] arXiv:2406.08074 (cross-list from cs.LG) [pdf, html, other]

Title: A Concept-Based Explainability Framework for Large Multimodal Models

Jayneel Parekh, Pegah Khayatan, Mustafa Shukor, Alasdair Newson, Matthieu Cord

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2025] arXiv:2406.08155 (cross-list from cs.LG) [pdf, html, other]

Title: Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark

Pingzhi Li, Xiaolong Jin, Yu Cheng, Tianlong Chen

Comments: Our code for reproducing all our experiments is provided at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2026] arXiv:2406.08207 (cross-list from eess.AS) [pdf, html, other]

Title: Transformer-based Model for ASR N-Best Rescoring and Rewriting

Iwen E. Kang, Christophe Van Gysel, Man-Hung Siu

Comments: Interspeech '24

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[2027] arXiv:2406.08223 (cross-list from cs.AI) [pdf, html, other]

Title: Research Trends for the Interplay between Large Language Models and Knowledge Graphs

Hanieh Khorashadizadeh, Fatima Zahra Amara, Morteza Ezzabady, Frédéric Ieng, Sanju Tiwari, Nandana Mihindukulasooriya, Jinghua Groppe, Soror Sahri, Farah Benamara, Sven Groppe

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2028] arXiv:2406.08353 (cross-list from eess.AS) [pdf, html, other]

Title: Speech Emotion Recognition with ASR Transcripts: A Comprehensive Study on Word Error Rate and Fusion Techniques

Yuanchao Li, Peter Bell, Catherine Lai

Comments: Accepted to IEEE SLT 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD)

[2029] arXiv:2406.08391 (cross-list from cs.LG) [pdf, html, other]

Title: Large Language Models Must Be Taught to Know What They Don't Know

Sanyam Kapoor, Nate Gruver, Manley Roberts, Katherine Collins, Arka Pal, Umang Bhatt, Adrian Weller, Samuel Dooley, Micah Goldblum, Andrew Gordon Wilson

Comments: Code available at: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2030] arXiv:2406.08402 (cross-list from eess.AS) [pdf, html, other]

Title: Understanding Sounds, Missing the Questions: The Challenge of Object Hallucination in Large Audio-Language Models

Chun-Yi Kuan, Wei-Ping Huang, Hung-yi Lee

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[2031] arXiv:2406.08407 (cross-list from cs.CV) [pdf, html, other]

Title: MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos

Xuehai He, Weixi Feng, Kaizhi Zheng, Yujie Lu, Wanrong Zhu, Jiachen Li, Yue Fan, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Kevin Lin, William Yang Wang, Lijuan Wang, Xin Eric Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2032] arXiv:2406.08447 (cross-list from cs.LG) [pdf, html, other]

Title: The Impact of Initialization on LoRA Finetuning Dynamics

Soufiane Hayou, Nikhil Ghosh, Bin Yu

Comments: TDLR: Different Initializations lead to completely different finetuning dynamics. One initialization (set A random and B zero) is generally better than the natural opposite initialization. arXiv admin note: text overlap with arXiv:2402.12354

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2033] arXiv:2406.08478 (cross-list from cs.CV) [pdf, html, other]

Title: What If We Recaption Billions of Web Images with LLaMA-3?

Xianhang Li, Haoqin Tu, Mude Hui, Zeyu Wang, Bingchen Zhao, Junfei Xiao, Sucheng Ren, Jieru Mei, Qing Liu, Huangjie Zheng, Yuyin Zhou, Cihang Xie

Comments: First five authors contributed equally

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2034] arXiv:2406.08482 (cross-list from cs.CV) [pdf, html, other]

Title: Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation

Raphael Tang, Xinyu Zhang, Lixinyu Xu, Yao Lu, Wenyan Li, Pontus Stenetorp, Jimmy Lin, Ferhan Ture

Comments: 13 pages, 11 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2035] arXiv:2406.08627 (cross-list from cs.LG) [pdf, html, other]

Title: Time-MMD: A New Multi-Domain Multimodal Dataset for Time Series Analysis

Haoxin Liu, Shangqing Xu, Zhiyuan Zhao, Lingkai Kong, Harshavardhan Kamarthi, Aditya B. Sasanur, Megha Sharma, Jiaming Cui, Qingsong Wen, Chao Zhang, B. Aditya Prakash

Comments: Accepted by NeurIPS 2024 Datasets and Benchmarks Track

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2036] arXiv:2406.08641 (cross-list from cs.SD) [pdf, html, other]

Title: ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets

Jiatong Shi, Shih-Heng Wang, William Chen, Martijn Bartelds, Vanya Bannihatti Kumar, Jinchuan Tian, Xuankai Chang, Dan Jurafsky, Karen Livescu, Hung-yi Lee, Shinji Watanabe

Comments: Accepted by Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2037] arXiv:2406.08656 (cross-list from cs.CV) [pdf, html, other]

Title: TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generation

Weixi Feng, Jiachen Li, Michael Saxon, Tsu-jui Fu, Wenhu Chen, William Yang Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2038] arXiv:2406.08702 (cross-list from cs.AI) [pdf, html, other]

Title: VLind-Bench: Measuring Language Priors in Large Vision-Language Models

Kang-il Lee, Minbeom Kim, Seunghyun Yoon, Minsung Kim, Dongryeol Lee, Hyukhun Koh, Kyomin Jung

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2039] arXiv:2406.08772 (cross-list from cs.CV) [pdf, html, other]

Title: MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMs

Xuannan Liu, Zekun Li, Peipei Li, Shuhan Xia, Xing Cui, Linzhi Huang, Huaibo Huang, Weihong Deng, Zhaofeng He

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2040] arXiv:2406.08820 (cross-list from eess.AS) [pdf, html, other]

Title: DisfluencySpeech -- Single-Speaker Conversational Speech Dataset with Paralanguage

Kyra Wang, Dorien Herremans

Comments: 4 pages, 1 figure, submitted to IEEE TENCON 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2041] arXiv:2406.08824 (cross-list from cs.RO) [pdf, html, other]

Title: LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions

Rumaisa Azeem, Andrew Hundt, Masoumeh Mansouri, Martim Brandão

Comments: 40 pages (52 with references), 21 Figures, 6 Tables

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[2042] arXiv:2406.09067 (cross-list from cs.CV) [pdf, html, other]

Title: How structured are the representations in transformer-based vision encoders? An analysis of multi-object representations in vision-language models

Tarun Khajuria, Braian Olmiro Dias, Jaan Aru

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Neurons and Cognition (q-bio.NC)

[2043] arXiv:2406.09105 (cross-list from cs.CV) [pdf, html, other]

Title: INS-MMBench: A Comprehensive Benchmark for Evaluating LVLMs' Performance in Insurance

Chenwei Lin, Hanjia Lyu, Xian Xu, Jiebo Luo

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2044] arXiv:2406.09154 (cross-list from cs.SD) [pdf, html, other]

Title: Diffusion Gaussian Mixture Audio Denoise

Pu Wang, Junhui Li, Jialu Li, Liangdong Guo, Youshan Zhang

Comments: INTERSPEECH 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2045] arXiv:2406.09175 (cross-list from cs.CV) [pdf, html, other]

Title: ReMI: A Dataset for Reasoning with Multiple Images

Mehran Kazemi, Nishanth Dikkala, Ankit Anand, Petar Devic, Ishita Dasgupta, Fangyu Liu, Bahare Fatemi, Pranjal Awasthi, Dee Guo, Sreenivas Gollapudi, Ahmed Qureshi

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2046] arXiv:2406.09264 (cross-list from cs.HC) [pdf, html, other]

Title: Towards Bidirectional Human-AI Alignment: A Systematic Review for Clarifications, Framework, and Future Directions

Hua Shen, Tiffany Knearem, Reshmi Ghosh, Kenan Alkiek, Kundan Krishna, Yachuan Liu, Ziqiao Ma, Savvas Petridis, Yi-Hao Peng, Li Qiwei, Sushrita Rakshit, Chenglei Si, Yutong Xie, Jeffrey P. Bigham, Frank Bentley, Joyce Chai, Zachary Lipton, Qiaozhu Mei, Rada Mihalcea, Michael Terry, Diyi Yang, Meredith Ringel Morris, Paul Resnick, David Jurgens

Comments: proposing "bidirectional human-AI alignment" framework after a systematic review of over 400 alignment papers

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2047] arXiv:2406.09277 (cross-list from eess.AS) [pdf, html, other]

Title: End-to-end Streaming model for Low-Latency Speech Anonymization

Waris Quamer, Ricardo Gutierrez-Osuna

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2048] arXiv:2406.09290 (cross-list from eess.AS) [pdf, html, other]

Title: Exploring Spoken Language Identification Strategies for Automatic Transcription of Multilingual Broadcast and Institutional Speech

Martina Valente, Fabio Brugnara, Giovanni Morrone, Enrico Zovato, Leonardo Badino

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2049] arXiv:2406.09320 (cross-list from cs.IR) [pdf, html, other]

Title: Khmer Semantic Search Engine (KSE): Digital Information Access and Document Retrieval

Nimol Thuon

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2050] arXiv:2406.09321 (cross-list from cs.CR) [pdf, html, other]

Title: JailbreakEval: An Integrated Toolkit for Evaluating Jailbreak Attempts Against Large Language Models

Delong Ran, Jinyuan Liu, Yichen Gong, Jingyi Zheng, Xinlei He, Tianshuo Cong, Anyu Wang

Comments: Our code is available at this https URL

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2051] arXiv:2406.09324 (cross-list from cs.CR) [pdf, other]

Title: Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs

Zhao Xu, Fan Liu, Hao Liu

Comments: Accepted by NeurIPS 2024

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2052] arXiv:2406.09403 (cross-list from cs.CV) [pdf, html, other]

Title: Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models

Yushi Hu, Weijia Shi, Xingyu Fu, Dan Roth, Mari Ostendorf, Luke Zettlemoyer, Noah A Smith, Ranjay Krishna

Comments: Project and codes url: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2053] arXiv:2406.09411 (cross-list from cs.CV) [pdf, html, other]

Title: MuirBench: A Comprehensive Benchmark for Robust Multi-image Understanding

Fei Wang, Xingyu Fu, James Y. Huang, Zekun Li, Qin Liu, Xiaogeng Liu, Mingyu Derek Ma, Nan Xu, Wenxuan Zhou, Kai Zhang, Tianyi Lorena Yan, Wenjie Jacky Mo, Hsiang-Hui Liu, Pan Lu, Chunyuan Li, Chaowei Xiao, Kai-Wei Chang, Dan Roth, Sheng Zhang, Hoifung Poon, Muhao Chen

Comments: typos corrected, references added, Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2054] arXiv:2406.09444 (cross-list from eess.AS) [pdf, html, other]

Title: GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model

Yingying Gao, Shilei Zhang, Chao Deng, Junlan Feng

Comments: arXiv admin note: text overlap with arXiv:2310.13418

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2055] arXiv:2406.09455 (cross-list from cs.CV) [pdf, html, other]

Title: Pandora: Towards General World Model with Natural Language Actions and Video States

Jiannan Xiang, Guangyi Liu, Yi Gu, Qiyue Gao, Yuting Ning, Yuheng Zha, Zeyu Feng, Tianhua Tao, Shibo Hao, Yemin Shi, Zhengzhong Liu, Eric P. Xing, Zhiting Hu

Comments: Website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2056] arXiv:2406.09458 (cross-list from cs.CV) [pdf, html, other]

Title: Updating CLIP to Prefer Descriptions Over Captions

Amir Zur, Elisa Kreiss, Karel D'Oosterlinck, Christopher Potts, Atticus Geiger

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2057] arXiv:2406.09459 (cross-list from cs.GT) [pdf, html, other]

Title: Ad Auctions for LLMs via Retrieval Augmented Generation

MohammadTaghi Hajiaghayi, Sébastien Lahaie, Keivan Rezaei, Suho Shin

Subjects: Computer Science and Game Theory (cs.GT); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2058] arXiv:2406.09520 (cross-list from cs.IR) [pdf, other]

Title: A Systematic Review of Generative AI for Teaching and Learning Practice

Bayode Ogunleye, Kudirat Ibilola Zakariyyah, Oluwaseun Ajao, Olakunle Olayinka, Hemlata Sharma

Comments: 20 pages, 10 figures, article published in Education Sciences

Journal-ref: Educ. Sci. 2024, 14, pp636

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2059] arXiv:2406.09556 (cross-list from cs.LG) [pdf, html, other]

Title: $S^3$ -- Semantic Signal Separation

Márton Kardos, Jan Kostkan, Arnault-Quentin Vermillet, Kristoffer Nielbo, Kenneth Enevoldsen, Roberta Rocca

Comments: 26 pages, 9 figures (main manuscript has 9 pages and 4 figures)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2060] arXiv:2406.09671 (cross-list from cs.AI) [pdf, other]

Title: Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam

Nabor C. Mendonça

Comments: Accepted for publication

Journal-ref: ACM Transactions on Computing Education, June 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2061] arXiv:2406.09676 (cross-list from eess.AS) [pdf, html, other]

Title: Optimizing Byte-level Representation for End-to-end ASR

Roger Hsiao, Liuhui Deng, Erik McDermott, Ruchir Travadi, Xiaodan Zhuang

Comments: 5 pages, 1 figure, IEEE SLT 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2062] arXiv:2406.09765 (cross-list from q-fin.RM) [pdf, other]

Title: Application of Natural Language Processing in Financial Risk Detection

Liyang Wang, Yu Cheng, Ao Xiang, Jingyu Zhang, Haowei Yang

Subjects: Risk Management (q-fin.RM); Computation and Language (cs.CL)

[2063] arXiv:2406.09779 (cross-list from cs.AI) [pdf, html, other]

Title: OSPC: Detecting Harmful Memes with Large Language Model as a Catalyst

Jingtao Cao, Zheng Zhang, Hongru Wang, Bin Liang, Hao Wang, Kam-Fai Wong

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2064] arXiv:2406.09831 (cross-list from cs.LG) [pdf, html, other]

Title: Federated Learning driven Large Language Models for Swarm Intelligence: A Survey

Youyang Qu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)

[2065] arXiv:2406.09864 (cross-list from cs.LG) [pdf, html, other]

Title: LUMA: A Benchmark Dataset for Learning from Uncertain and Multimodal Data

Grigor Bezirganyan, Sana Sellami, Laure Berti-Équille, Sébastien Fournier

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2066] arXiv:2406.09884 (cross-list from cs.MM) [pdf, html, other]

Title: Enhancing Fake News Detection in Social Media via Label Propagation on Cross-modal Tweet Graph

Wanqing Zhao, Yuta Nakashima, Haiyuan Chen, Noboru Babaguchi

Comments: 9 pages

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[2067] arXiv:2406.09950 (cross-list from cs.SD) [pdf, html, other]

Title: An efficient text augmentation approach for contextualized Mandarin speech recognition

Naijun Zheng, Xucheng Wan, Kai Liu, Ziqing Du, Zhou Huan

Comments: accepted to interspeech2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2068] arXiv:2406.09952 (cross-list from cs.CV) [pdf, html, other]

Title: BiVLC: Extending Vision-Language Compositionality Evaluation with Text-to-Image Retrieval

Imanol Miranda, Ander Salaberria, Eneko Agirre, Gorka Azkune

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2069] arXiv:2406.09961 (cross-list from cs.SE) [pdf, html, other]

Title: ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation

Chufan Shi, Cheng Yang, Yaxin Liu, Bo Shui, Junjie Wang, Mohan Jing, Linran Xu, Xinyu Zhu, Siheng Li, Yuxiang Zhang, Gongye Liu, Xiaomei Nie, Deng Cai, Yujiu Yang

Comments: Data and code are available at this https URL

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2070] arXiv:2406.09988 (cross-list from cs.AI) [pdf, html, other]

Title: Details Make a Difference: Object State-Sensitive Neurorobotic Task Planning

Xiaowen Sun, Xufeng Zhao, Jae Hee Lee, Wenhao Lu, Matthias Kerzel, Stefan Wermter

Comments: ICANN24, Switzerland

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[2071] arXiv:2406.10019 (cross-list from cs.LG) [pdf, html, other]

Title: Group and Shuffle: Efficient Structured Orthogonal Parametrization

Mikhail Gorbunov, Nikolay Yudin, Vera Soboleva, Aibek Alanov, Alexey Naumov, Maxim Rakhuba

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Numerical Analysis (math.NA)

[2072] arXiv:2406.10023 (cross-list from cs.LG) [pdf, html, other]

Title: Deep Bayesian Active Learning for Preference Modeling in Large Language Models

Luckeciano C. Melo, Panagiotis Tigas, Alessandro Abate, Yarin Gal

Comments: 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2073] arXiv:2406.10052 (cross-list from cs.SD) [pdf, html, other]

Title: Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection

Haoyu Wang, Guoqiang Hu, Guodong Lin, Wei-Qiang Zhang, Jian Li

Comments: Accepted by INTERSPEECH 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2074] arXiv:2406.10073 (cross-list from eess.AS) [pdf, html, other]

Title: Detecting the terminality of speech-turn boundary for spoken interactions in French TV and Radio content

Rémi Uro, Marie Tahon, David Doukhan, Antoine Laurent, Albert Rilliard

Comments: keywords : Spoken interaction, Media, TV, Radio, Transition-Relevance Places, Turn Taking, Interruption. Accepted to InterSpeech 2024, Kos Island, Greece

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD)

[2075] arXiv:2406.10162 (cross-list from cs.AI) [pdf, html, other]

Title: Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models

Carson Denison, Monte MacDiarmid, Fazl Barez, David Duvenaud, Shauna Kravec, Samuel Marks, Nicholas Schiefer, Ryan Soklaski, Alex Tamkin, Jared Kaplan, Buck Shlegeris, Samuel R. Bowman, Ethan Perez, Evan Hubinger

Comments: Make it easier to find samples from the model, and highlight that our operational definition of reward tampering has false positives where the model attempts to complete the task honestly but edits the reward. Add paragraph to conclusion to this effect, and add sentence to figure 1 to this effect

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2076] arXiv:2406.10177 (cross-list from eess.AS) [pdf, html, other]

Title: Inclusive ASR for Disfluent Speech: Cascaded Large-Scale Self-Supervised Learning with Targeted Fine-Tuning and Data Augmentation

Dena Mujtaba, Nihar R. Mahapatra, Megan Arney, J. Scott Yaruss, Caryn Herring, Jia Bin

Comments: Included in 2024 Proceedings of INTERSPEECH

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2077] arXiv:2406.10221 (cross-list from cs.CV) [pdf, html, other]

Title: Short Film Dataset (SFD): A Benchmark for Story-Level Video Understanding

Ridouane Ghermi, Xi Wang, Vicky Kalogeiton, Ivan Laptev

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2078] arXiv:2406.10228 (cross-list from cs.CV) [pdf, html, other]

Title: VEGA: Learning Interleaved Image-Text Comprehension in Vision-Language Large Models

Chenyu Zhou, Mengdan Zhang, Peixian Chen, Chaoyou Fu, Yunhang Shen, Xiawu Zheng, Xing Sun, Rongrong Ji

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2079] arXiv:2406.10237 (cross-list from cs.IR) [pdf, other]

Title: Towards commands recommender system in BIM authoring tool using transformers

Changyu Du, Zihan Deng, Stavros Nousias, André Borrmann

Subjects: Information Retrieval (cs.IR); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[2080] arXiv:2406.10249 (cross-list from cs.AI) [pdf, html, other]

Title: A Reality check of the benefits of LLM in business

Ming Cheung

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2081] arXiv:2406.10252 (cross-list from cs.IR) [pdf, html, other]

Title: AutoSurvey: Large Language Models Can Automatically Write Surveys

Yidong Wang, Qi Guo, Wenjin Yao, Hongbo Zhang, Xin Zhang, Zhen Wu, Meishan Zhang, Xinyu Dai, Min Zhang, Qingsong Wen, Wei Ye, Shikun Zhang, Yue Zhang

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2082] arXiv:2406.10264 (cross-list from cs.RO) [pdf, other]

Title: Large Language Model-empowered multimodal strain sensory system for shape recognition, monitoring, and human interaction of tensegrity

Zebing Mao, Ryota Kobayashi, Hiroyuki Nabae, Koichi Suzumori

Subjects: Robotics (cs.RO); Computation and Language (cs.CL)

[2083] arXiv:2406.10268 (cross-list from cs.AI) [pdf, html, other]

Title: Autograding Mathematical Induction Proofs with Natural Language Processing

Chenyan Zhao, Mariana Silva, Seth Poulsen

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[2084] arXiv:2406.10274 (cross-list from cs.IR) [pdf, html, other]

Title: Using General Large Language Models to Classify Mathematical Documents

Patrick D.F. Ion, Stephen M. Watt

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Digital Libraries (cs.DL)

[2085] arXiv:2406.10280 (cross-list from cs.CR) [pdf, html, other]

Title: Transferable Embedding Inversion Attack: Uncovering Privacy Risks in Text Embeddings without Model Queries

Yu-Hsiang Huang, Yuche Tsai, Hsiang Hsiao, Hong-Yi Lin, Shou-De Lin

Comments: Accepted at ACL 2024 Main Conference

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2086] arXiv:2406.10281 (cross-list from cs.CR) [pdf, html, other]

Title: Watermarking Language Models with Error Correcting Codes

Patrick Chao, Edgar Dobriban, Hamed Hassani

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2087] arXiv:2406.10291 (cross-list from cs.AI) [pdf, html, other]

Title: ResearchArena: Benchmarking LLMs' Ability to Collect and Organize Information as Research Agents

Hao Kang, Chenyan Xiong

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[2088] arXiv:2406.10292 (cross-list from cs.AI) [pdf, html, other]

Title: Automatically Labeling $200B Life-Saving Datasets: A Large Clinical Trial Outcome Benchmark

Chufan Gao, Jathurshan Pradeepkumar, Trisha Das, Shivashankar Thati, Jimeng Sun

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2089] arXiv:2406.10300 (cross-list from cs.SE) [pdf, html, other]

Title: Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applications

Irene Weber

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2090] arXiv:2406.10328 (cross-list from cs.CV) [pdf, html, other]

Title: From Pixels to Prose: A Large Dataset of Dense Image Captions

Vasu Singla, Kaiyu Yue, Sukriti Paul, Reza Shirkavand, Mayuka Jayawardhana, Alireza Ganjdanesh, Heng Huang, Abhinav Bhatele, Gowthami Somepalli, Tom Goldstein

Comments: pixelprose 16M dataset

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2091] arXiv:2406.10382 (cross-list from cs.AI) [pdf, html, other]

Title: Efficient Prompting for LLM-based Generative Internet of Things

Bin Xiao, Burak Kantarci, Jiawen Kang, Dusit Niyato, Mohsen Guizani

Comments: 14 pages, 11 figures. IEEE Internet of Things Journal, 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2092] arXiv:2406.10450 (cross-list from cs.IR) [pdf, html, other]

Title: TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendation

Haohao Qu, Wenqi Fan, Zihuai Zhao, Qing Li

Comments: Submitted to IEEE TKDE. Our code and dataset will be made available upon acceptance of the paper

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2093] arXiv:2406.10504 (cross-list from cs.AI) [pdf, html, other]

Title: Task Facet Learning: A Structured Approach to Prompt Optimization

Gurusha Juneja, Nagarajan Natarajan, Hua Li, Jian Jiao, Amit Sharma

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2094] arXiv:2406.10507 (cross-list from eess.AS) [pdf, html, other]

Title: Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Models

Ruchao Fan, Natarajan Balaji Shankar, Abeer Alwan

Comments: To appear in Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2095] arXiv:2406.10514 (cross-list from eess.AS) [pdf, html, other]

Title: GTR-Voice: Articulatory Phonetics Informed Controllable Expressive Speech Synthesis

Zehua Kcriss Li, Meiying Melissa Chen, Yi Zhong, Pinxin Liu, Zhiyao Duan

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[2096] arXiv:2406.10515 (cross-list from cs.AI) [pdf, other]

Title: Reactor Mk.1 performances: MMLU, HumanEval and BBH test results

TJ Dunham, Henry Syahputra

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2097] arXiv:2406.10522 (cross-list from cs.LG) [pdf, html, other]

Title: Humor in AI: Massive Scale Crowd-Sourced Preferences and Benchmarks for Cartoon Captioning

Jifan Zhang, Lalit Jain, Yang Guo, Jiayi Chen, Kuan Lok Zhou, Siddharth Suresh, Andrew Wagenmaker, Scott Sievert, Timothy Rogers, Kevin Jamieson, Robert Mankoff, Robert Nowak

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2098] arXiv:2406.10549 (cross-list from eess.AS) [pdf, html, other]

Title: Lightweight Audio Segmentation for Long-form Speech Translation

Jaesong Lee, Soyoon Kim, Hanbyul Kim, Joon Son Chung

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2099] arXiv:2406.10576 (cross-list from cs.LG) [pdf, other]

Title: Bypass Back-propagation: Optimization-based Structural Pruning for Large Language Models via Policy Gradient

Yuan Gao, Zujing Liu, Weizhong Zhang, Bo Du, Gui-Song Xia

Comments: Initially submitted on June 15, 2024, this version mainly changed the title, and added several experiments: such as 1) experiments on LLaMA-3, Mistral, 2) additional baseline methods (i.e., Bosai -- Everybody Prune Now), and 3) post-pruning finetuned performance (i.e., first prune then finetune)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2100] arXiv:2406.10670 (cross-list from cs.LG) [pdf, html, other]

Title: CoLoR-Filter: Conditional Loss Reduction Filtering for Targeted Language Model Pre-training

David Brandfonbrener, Hanlin Zhang, Andreas Kirsch, Jonathan Richard Schwarz, Sham Kakade

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2101] arXiv:2406.10710 (cross-list from cs.AI) [pdf, html, other]

Title: SyntheT2C: Generating Synthetic Data for Fine-Tuning Large Language Models on the Text2Cypher Task

Ziije Zhong, Linqing Zhong, Zhaoze Sun, Qingyun Jin, Zengchang Qin, Xiaofan Zhang

Comments: 19 pages, 15 figures, 8 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2102] arXiv:2406.10735 (cross-list from cs.SD) [pdf, html, other]

Title: How Should We Extract Discrete Audio Tokens from Self-Supervised Models?

Pooneh Mousavi, Jarod Duret, Salah Zaiem, Luca Della Libera, Artem Ploujnikov, Cem Subakan, Mirco Ravanelli

Comments: 4 pages, 2 figures, 2 tables, Accepted at Interspeech 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2103] arXiv:2406.10786 (cross-list from cs.AI) [pdf, html, other]

Title: Exploring the Zero-Shot Capabilities of LLMs Handling Multiple Problems at once

Zhengxiang Wang, Jordan Kodner, Owen Rambow

Comments: 26 pages, 11 figures, 16 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2104] arXiv:2406.10803 (cross-list from cs.AI) [pdf, html, other]

Title: HiddenTables & PyQTax: A Cooperative Game and Dataset For TableQA to Ensure Scale and Data Privacy Across a Myriad of Taxonomies

William Watson, Nicole Cho, Tucker Balch, Manuela Veloso

Comments: In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023)

Journal-ref: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (2023) 7144-7159

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[2105] arXiv:2406.10819 (cross-list from cs.CV) [pdf, html, other]

Title: GUI-WORLD: A Dataset for GUI-oriented Multimodal LLM-based Agents

Dongping Chen, Yue Huang, Siyuan Wu, Jingyu Tang, Liuyi Chen, Yilin Bai, Zhigang He, Chenlong Wang, Huichi Zhou, Yiqiang Li, Tianshuo Zhou, Yue Yu, Chujie Gao, Qihui Zhang, Yi Gui, Zhen Li, Yao Wan, Pan Zhou, Jianfeng Gao, Lichao Sun

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2106] arXiv:2406.10839 (cross-list from cs.CV) [pdf, html, other]

Title: Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags

Daiqing Qi, Handong Zhao, Zijun Wei, Sheng Li

Comments: 18 pages, 11 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2107] arXiv:2406.10847 (cross-list from cs.AI) [pdf, html, other]

Title: TorchOpera: A Compound AI System for LLM Safety

Shanshan Han, Zijian Hu, Alay Dilipbhai Shah, Han Jin, Yuhang Yao, Dimitris Stripelis, Zhaozhuo Xu, Chaoyang He

Subjects: Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[2108] arXiv:2406.10873 (cross-list from cs.SD) [pdf, html, other]

Title: Optimizing Automatic Speech Assessment: W-RankSim Regularization and Hybrid Feature Fusion Strategies

Chung-Wen Wu, Berlin Chen

Comments: Accepted to Interspeech 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2109] arXiv:2406.10878 (cross-list from cs.AI) [pdf, html, other]

Title: Demonstration Notebook: Finding the Most Suited In-Context Learning Example from Interactions

Yiming Tang, Bin Dong

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2110] arXiv:2406.10900 (cross-list from cs.CV) [pdf, html, other]

Title: AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models

Xiyang Wu, Tianrui Guan, Dianqi Li, Shuaiyi Huang, Xiaoyu Liu, Xijun Wang, Ruiqi Xian, Abhinav Shrivastava, Furong Huang, Jordan Lee Boyd-Graber, Tianyi Zhou, Dinesh Manocha

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2111] arXiv:2406.10902 (cross-list from cs.CV) [pdf, html, other]

Title: Light Up the Shadows: Enhance Long-Tailed Entity Grounding with Concept-Guided Vision-Language Models

Yikai Zhang, Qianyu He, Xintao Wang, Siyu Yuan, Jiaqing Liang, Yanghua Xiao

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2112] arXiv:2406.10903 (cross-list from cs.LG) [pdf, html, other]

Title: New Solutions on LLM Acceleration, Optimization, and Application

Yingbing Huang, Lily Jiaxin Wan, Hanchen Ye, Manvi Jha, Jinghua Wang, Yuhong Li, Xiaofan Zhang, Deming Chen

Comments: This is an expanded and more comprehensive study based on our invited DAC-24 paper with the same title and co-authors

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Software Engineering (cs.SE)

[2113] arXiv:2406.10906 (cross-list from cs.LG) [pdf, html, other]

Title: Breaking the Attention Bottleneck

Kalle Hilsenbek

Comments: 6 pages, 4 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2114] arXiv:2406.10918 (cross-list from cs.LG) [pdf, html, other]

Title: Multi-LLM QA with Embodied Exploration

Bhrij Patel, Vishnu Sashank Dorbala, Amrit Singh Bedi, Dinesh Manocha

Comments: 16 pages, 9 Figures, 5 Tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2115] arXiv:2406.10923 (cross-list from cs.CV) [pdf, html, other]

Title: Investigating Video Reasoning Capability of Large Language Models with Tropes in Movies

Hung-Ting Su, Chun-Tong Chao, Ya-Ching Hsu, Xudong Lin, Yulei Niu, Hung-Yi Lee, Winston H. Hsu

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2116] arXiv:2406.10937 (cross-list from cs.AI) [pdf, html, other]

Title: Understanding Understanding: A Pragmatic Framework Motivated by Large Language Models

Kevin Leyton-Brown, Yoav Shoham

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2117] arXiv:2406.10958 (cross-list from math.OC) [pdf, html, other]

Title: City-LEO: Toward Transparent City Management Using LLM with End-to-End Optimization

Zihao Jiao, Mengyi Sha, Haoyu Zhang, Xinyu Jiang, Wei Qi

Comments: 26 pages, 8 figures, 5 tables

Subjects: Optimization and Control (math.OC); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[2118] arXiv:2406.10976 (cross-list from cs.LG) [pdf, html, other]

Title: Promoting Data and Model Privacy in Federated Learning through Quantized LoRA

JianHao Zhu, Changze Lv, Xiaohua Wang, Muling Wu, Wenhao Liu, Tianlong Li, Zixuan Ling, Cenyuan Zhang, Xiaoqing Zheng, Xuanjing Huang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[2119] arXiv:2406.11011 (cross-list from cs.LG) [pdf, html, other]

Title: Data Shapley in One Training Run

Jiachen T. Wang, Prateek Mittal, Dawn Song, Ruoxi Jia

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2120] arXiv:2406.11016 (cross-list from cs.LG) [pdf, html, other]

Title: Optimized Speculative Sampling for GPU Hardware Accelerators

Dominik Wagner, Seanie Lee, Ilja Baumann, Philipp Seeberger, Korbinian Riedhammer, Tobias Bocklet

Comments: Accepted at EMNLP 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2121] arXiv:2406.11025 (cross-list from cs.SD) [pdf, html, other]

Title: Large Language Models for Dysfluency Detection in Stuttered Speech

Dominik Wagner, Sebastian P. Bayerl, Ilja Baumann, Korbinian Riedhammer, Elmar Nöth, Tobias Bocklet

Comments: Accepted at Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2122] arXiv:2406.11069 (cross-list from cs.CV) [pdf, html, other]

Title: WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences

Yujie Lu, Dongfu Jiang, Wenhu Chen, William Yang Wang, Yejin Choi, Bill Yuchen Lin

Comments: link: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2123] arXiv:2406.11087 (cross-list from cs.CR) [pdf, html, other]

Title: DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models

Yanming Liu, Xinyue Peng, Yuwei Zhang, Xiaolan Ke, Songhang Deng, Jiannan Cao, Chen Ma, Mengchen Fu, Xuhong Zhang, Sheng Cheng, Xun Wang, Jianwei Yin, Tianyu Du

Comments: 9 pages second version

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2124] arXiv:2406.11171 (cross-list from cs.CV) [pdf, html, other]

Title: SUGARCREPE++ Dataset: Vision-Language Model Sensitivity to Semantic and Lexical Alterations

Sri Harsha Dumpala, Aman Jaiswal, Chandramouli Sastry, Evangelos Milios, Sageev Oore, Hassan Sajjad

Comments: Added the dataset link to the abstract

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2125] arXiv:2406.11200 (cross-list from cs.LG) [pdf, html, other]

Title: AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning

Shirley Wu, Shiyu Zhao, Qian Huang, Kexin Huang, Michihiro Yasunaga, Kaidi Cao, Vassilis N. Ioannidis, Karthik Subbian, Jure Leskovec, James Zou

Comments: NeurIPS 2024 main conference

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2126] arXiv:2406.11217 (cross-list from cs.AI) [pdf, other]

Title: WeatherQA: Can Multimodal Language Models Reason about Severe Weather?

Chengqian Ma, Zhanxiang Hua, Alexandra Anderson-Frey, Vikram Iyer, Xin Liu, Lianhui Qin

Comments: 26 pages, 9 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Atmospheric and Oceanic Physics (physics.ao-ph)

[2127] arXiv:2406.11230 (cross-list from cs.LG) [pdf, html, other]

Title: Multimodal Needle in a Haystack: Benchmarking Long-Context Capability of Multimodal Large Language Models

Hengyi Wang, Haizhou Shi, Shiwei Tan, Weiyi Qin, Wenyuan Wang, Tunyu Zhang, Akshay Nambi, Tanuja Ganu, Hao Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2128] arXiv:2406.11231 (cross-list from cs.RO) [pdf, html, other]

Title: Enabling robots to follow abstract instructions and complete complex dynamic tasks

Ruaridh Mon-Williams, Gen Li, Ran Long, Wenqian Du, Chris Lucas

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2129] arXiv:2406.11233 (cross-list from cs.LG) [pdf, html, other]

Title: Probing the Decision Boundaries of In-context Learning in Large Language Models

Siyan Zhao, Tung Nguyen, Aditya Grover

Comments: 18 pages, code at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2130] arXiv:2406.11285 (cross-list from cs.CR) [pdf, html, other]

Title: Self and Cross-Model Distillation for LLMs: Effective Methods for Refusal Pattern Alignment

Jie Li, Yi Liu, Chongyang Liu, Xiaoning Ren, Ling Shi, Weisong Sun, Yinxing Xue

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[2131] arXiv:2406.11290 (cross-list from cs.IR) [pdf, html, other]

Title: Iterative Utility Judgment Framework via LLMs Inspired by Relevance in Philosophy

Hengran Zhang, Keping Bi, Jiafeng Guo, Xueqi Cheng

Comments: 22 pages

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2132] arXiv:2406.11301 (cross-list from cs.AI) [pdf, html, other]

Title: Enhancing and Assessing Instruction-Following with Fine-Grained Instruction Variants

Jiuding Yang, Weidong Guo, Kaitong Yang, Xiangyang Li, Yu Xu, Di Niu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2133] arXiv:2406.11303 (cross-list from cs.CV) [pdf, html, other]

Title: VideoVista: A Versatile Benchmark for Video Understanding and Reasoning

Yunxin Li, Xinyu Chen, Baotian Hu, Longyue Wang, Haoyuan Shi, Min Zhang

Comments: 38 pages, 44 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2134] arXiv:2406.11317 (cross-list from cs.AI) [pdf, html, other]

Title: GUICourse: From General Vision Language Models to Versatile GUI Agents

Wentong Chen, Junbo Cui, Jinyi Hu, Yujia Qin, Junjie Fang, Yue Zhao, Chongyi Wang, Jun Liu, Guirong Chen, Yupeng Huo, Yuan Yao, Yankai Lin, Zhiyuan Liu, Maosong Sun

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

[2135] arXiv:2406.11353 (cross-list from cs.LG) [pdf, html, other]

Title: $\texttt{MoE-RBench}$: Towards Building Reliable Language Models with Sparse Mixture-of-Experts

Guanjie Chen, Xinyu Zhao, Tianlong Chen, Yu Cheng

Comments: 9 pages, 8 figures, camera ready on ICML2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2136] arXiv:2406.11403 (cross-list from cs.CV) [pdf, html, other]

Title: Multimodal Structured Generation: CVPR's 2nd MMFM Challenge Technical Report

Franz Louis Cesista

Comments: Conference on Computer Vision and Pattern Recognition's 2nd Multimodal Foundation Models Challenge

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2137] arXiv:2406.11423 (cross-list from cs.SI) [pdf, html, other]

Title: Bridging Social Media and Search Engines: Dredge Words and the Detection of Unreliable Domains

Evan M. Williams, Peter Carragher, Kathleen M. Carley

Subjects: Social and Information Networks (cs.SI); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[2138] arXiv:2406.11424 (cross-list from cs.IR) [pdf, html, other]

Title: Evaluating the Efficacy of Open-Source LLMs in Enterprise-Specific RAG Systems: A Comparative Study of Performance and Scalability

Gautam B, Anupam Purwar

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2139] arXiv:2406.11427 (cross-list from eess.AS) [pdf, html, other]

Title: DiTTo-TTS: Efficient and Scalable Zero-Shot Text-to-Speech with Diffusion Transformer

Keon Lee, Dong Won Kim, Jaehyeon Kim, Jaewoong Cho

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[2140] arXiv:2406.11503 (cross-list from cs.CV) [pdf, html, other]

Title: GeoGPT4V: Towards Geometric Multi-modal Large Language Models with Geometric Image Generation

Shihao Cai, Keqin Bao, Hangyu Guo, Jizhi Zhang, Jun Song, Bo Zheng

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2141] arXiv:2406.11546 (cross-list from eess.AS) [pdf, html, other]

Title: GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement

Yifan Yang, Zheshu Song, Jianheng Zhuo, Mingyu Cui, Jinpeng Li, Bo Yang, Yexing Du, Ziyang Ma, Xunying Liu, Ziyuan Wang, Ke Li, Shuai Fan, Kai Yu, Wei-Qiang Zhang, Guoguo Chen, Xie Chen

Comments: Under review

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2142] arXiv:2406.11547 (cross-list from cs.LG) [pdf, html, other]

Title: GECOBench: A Gender-Controlled Text Dataset and Benchmark for Quantifying Biases in Explanations

Rick Wilming, Artur Dox, Hjalmar Schulz, Marta Oliveira, Benedict Clark, Stefan Haufe

Comments: Under review

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[2143] arXiv:2406.11624 (cross-list from cs.LG) [pdf, other]

Title: Words in Motion: Extracting Interpretable Control Vectors for Motion Transformers

Omer Sahin Tas, Royden Wagner

Comments: NeurIPS'24 workshop camera-ready

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2144] arXiv:2406.11675 (cross-list from cs.LG) [pdf, html, other]

Title: BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models

Yibin Wang, Haizhou Shi, Ligong Han, Dimitris Metaxas, Hao Wang

Comments: Accepted at NeurIPS 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2145] arXiv:2406.11678 (cross-list from cs.IR) [pdf, html, other]

Title: TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategy

Yiqun Chen, Qi Liu, Yi Zhang, Weiwei Sun, Daiting Shi, Jiaxin Mao, Dawei Yin

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2146] arXiv:2406.11706 (cross-list from cs.IR) [pdf, html, other]

Title: Prompts as Auto-Optimized Training Hyperparameters: Training Best-in-Class IR Models from Scratch with 10 Gold Labels

Jasper Xian, Saron Samuel, Faraz Khoubsirat, Ronak Pradeep, Md Arafat Sultan, Radu Florian, Salim Roukos, Avirup Sil, Christopher Potts, Omar Khattab

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2147] arXiv:2406.11715 (cross-list from cs.LG) [pdf, html, other]

Title: Measuring memorization in RLHF for code completion

Aneesh Pappu, Billy Porter, Ilia Shumailov, Jamie Hayes

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Software Engineering (cs.SE)

[2148] arXiv:2406.11717 (cross-list from cs.LG) [pdf, other]

Title: Refusal in Language Models Is Mediated by a Single Direction

Andy Arditi, Oscar Obeso, Aaquib Syed, Daniel Paleka, Nina Panickssery, Wes Gurnee, Neel Nanda

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2149] arXiv:2406.11727 (cross-list from eess.AS) [pdf, html, other]

Title: 1000 African Voices: Advancing inclusive multi-speaker multi-accent speech synthesis

Sewade Ogun, Abraham T. Owodunni, Tobi Olatunji, Eniola Alese, Babatunde Oladimeji, Tejumade Afonja, Kayode Olaleye, Naome A. Etori, Tosin Adewumi

Comments: Accepted at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2150] arXiv:2406.11745 (cross-list from cs.IR) [pdf, html, other]

Title: Multi-Layer Ranking with Large Language Models for News Source Recommendation

Wenjia Zhang, Lin Gui, Rob Procter, Yulan He

Comments: Accepted by the SIGIR 2024. arXiv admin note: text overlap with arXiv:2305.04825

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2151] arXiv:2406.11757 (cross-list from cs.AI) [pdf, html, other]

Title: STAR: SocioTechnical Approach to Red Teaming Language Models

Laura Weidinger, John Mellor, Bernat Guillen Pegueroles, Nahema Marchal, Ravin Kumar, Kristian Lum, Canfer Akbulut, Mark Diaz, Stevie Bergman, Mikel Rodriguez, Verena Rieser, William Isaac

Comments: 8 pages, 5 figures, 5 pages appendix. * denotes equal contribution

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

[2152] arXiv:2406.11768 (cross-list from cs.SD) [pdf, html, other]

Title: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities

Sreyan Ghosh, Sonal Kumar, Ashish Seth, Chandra Kiran Reddy Evuru, Utkarsh Tyagi, S Sakshi, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha

Comments: Project Website: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2153] arXiv:2406.11780 (cross-list from cs.LG) [pdf, html, other]

Title: Split, Unlearn, Merge: Leveraging Data Attributes for More Effective Unlearning in LLMs

Swanand Ravindra Kadhe, Farhan Ahmed, Dennis Wei, Nathalie Baracaldo, Inkit Padhi

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2154] arXiv:2406.11794 (cross-list from cs.LG) [pdf, html, other]

Title: DataComp-LM: In search of the next generation of training sets for language models

Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Gadre, Hritik Bansal, Etash Guha, Sedrick Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton, Marianna Nezhurina, Amro Abbas, Cheng-Yu Hsieh, Dhruba Ghosh, Josh Gardner, Maciej Kilian, Hanlin Zhang, Rulin Shao, Sarah Pratt, Sunny Sanyal, Gabriel Ilharco, Giannis Daras, Kalyani Marathe, Aaron Gokaslan, Jieyu Zhang, Khyathi Chandu, Thao Nguyen, Igor Vasiljevic, Sham Kakade, Shuran Song, Sujay Sanghavi, Fartash Faghri, Sewoong Oh, Luke Zettlemoyer, Kyle Lo, Alaaeldin El-Nouby, Hadi Pouransari, Alexander Toshev, Stephanie Wang, Dirk Groeneveld, Luca Soldaini, Pang Wei Koh, Jenia Jitsev, Thomas Kollar, Alexandros G. Dimakis, Yair Carmon, Achal Dave, Ludwig Schmidt, Vaishaal Shankar

Comments: Project page: this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2155] arXiv:2406.11823 (cross-list from cs.CV) [pdf, html, other]

Title: On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning

Geewook Kim, Minjoon Seo

Comments: EMNLP 2024 Main

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2156] arXiv:2406.11839 (cross-list from cs.CV) [pdf, html, other]

Title: mDPO: Conditional Preference Optimization for Multimodal Large Language Models

Fei Wang, Wenxuan Zhou, James Y. Huang, Nan Xu, Sheng Zhang, Hoifung Poon, Muhao Chen

Comments: Accepted to EMNLP 2024 Main Conference. Project website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2157] arXiv:2406.11848 (cross-list from cs.CY) [pdf, other]

Title: Model Of Information System Towards Harmonized Industry And Computer Science

Edafetanure-Ibeh Faith, Evah Patrick Tamarauefiye, Mark Uwuoruya Uyi

Comments: Bachelor's thesis

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[2158] arXiv:2406.11852 (cross-list from cs.CY) [pdf, other]

Title: Risks from Language Models for Automated Mental Healthcare: Ethics and Structure for Implementation

Declan Grabb, Max Lamparth, Nina Vasan

Comments: Updated with fine-tuned model results to match CoLM accepted camera-ready version

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2159] arXiv:2406.11854 (cross-list from cs.CY) [pdf, other]

Title: Attributions toward Artificial Agents in a modified Moral Turing Test

Eyal Aharoni, Sharlene Fernandes, Daniel J. Brady, Caelan Alexander, Michael Criner, Kara Queen, Javier Rando, Eddy Nahmias, Victor Crespo

Comments: 23 pages, 0 figures, in press

Journal-ref: Scientific Reports (2024)

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2160] arXiv:2406.11890 (cross-list from cs.LG) [pdf, other]

Title: Unraveling the Mechanics of Learning-Based Demonstration Selection for In-Context Learning

Hui Liu, Wenya Wang, Hao Sun, Chris Xing Tian, Chenqi Kong, Xin Dong, Haoliang Li

Comments: 17 pages, 7 figures and 9 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2161] arXiv:2406.11911 (cross-list from cs.AI) [pdf, html, other]

Title: A Notion of Complexity for Theory of Mind via Discrete World Models

X. Angelo Huang, Emanuele La Malfa, Samuele Marro, Andrea Asperti, Anthony Cohn, Michael Wooldridge

Comments: Accepted EMNLP 2024, Website this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2162] arXiv:2406.11924 (cross-list from cs.SI) [pdf, html, other]

Title: Explainable assessment of financial experts' credibility by classifying social media forecasts and checking the predictions with actual market data

Silvia García-Méndez, Francisco de Arriba-Pérez, Jaime González-Gonzáleza, Francisco J. González-Castaño

Journal-ref: Expert Systems with Applications. 124515 (2024)

Subjects: Social and Information Networks (cs.SI); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2163] arXiv:2406.11925 (cross-list from cs.SE) [pdf, html, other]

Title: DocCGen: Document-based Controlled Code Generation

Sameer Pimparkhede, Mehant Kammakomati, Srikanth Tamilselvam, Prince Kumar, Ashok Pon Kumar, Pushpak Bhattacharyya

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2164] arXiv:2406.11930 (cross-list from cs.SE) [pdf, html, other]

Title: A Critical Study of What Code-LLMs (Do Not) Learn

Abhinav Anand, Shweta Verma, Krishna Narasimhan, Mira Mezini

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2165] arXiv:2406.11939 (cross-list from cs.LG) [pdf, html, other]

Title: From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline

Tianle Li, Wei-Lin Chiang, Evan Frick, Lisa Dunlap, Tianhao Wu, Banghua Zhu, Joseph E. Gonzalez, Ion Stoica

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2166] arXiv:2406.11944 (cross-list from cs.LG) [pdf, html, other]

Title: Transcoders Find Interpretable LLM Feature Circuits

Jacob Dunefsky, Philippe Chlenski, Neel Nanda

Comments: 28 pages, 6 figures, 3 tables, 2 algorithms. Under review

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2167] arXiv:2406.12016 (cross-list from cs.LG) [pdf, html, other]

Title: Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization

Seungwoo Son, Wonpyo Park, Woohyun Han, Kyuyeun Kim, Jaeho Lee

Comments: EMNLP 2024 Main (Long)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2168] arXiv:2406.12030 (cross-list from cs.CV) [pdf, html, other]

Title: SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Model

Yongting Zhang, Lu Chen, Guodong Zheng, Yifeng Gao, Rui Zheng, Jinlan Fu, Zhenfei Yin, Senjie Jin, Yu Qiao, Xuanjing Huang, Feng Zhao, Tao Gui, Jing Shao

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2169] arXiv:2406.12031 (cross-list from cs.LG) [pdf, html, other]

Title: Large Scale Transfer Learning for Tabular Data via Language Modeling

Josh Gardner, Juan C. Perdomo, Ludwig Schmidt

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2170] arXiv:2406.12045 (cross-list from cs.AI) [pdf, other]

Title: $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

Shunyu Yao, Noah Shinn, Pedram Razavi, Karthik Narasimhan

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2171] arXiv:2406.12058 (cross-list from cs.AI) [pdf, html, other]

Title: WellDunn: On the Robustness and Explainability of Language Models and Large Language Models in Identifying Wellness Dimensions

Seyedali Mohammadi, Edward Raff, Jinendra Malekar, Vedant Palit, Francis Ferraro, Manas Gaur

Comments: Accepted in BlackboxNLP @ EMNLP 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2172] arXiv:2406.12091 (cross-list from cs.LG) [pdf, html, other]

Title: Is poisoning a real threat to LLM alignment? Maybe more so than you think

Pankayaraj Pathmanathan, Souradip Chakraborty, Xiangyu Liu, Yongyuan Liang, Furong Huang

Journal-ref: ICML 2024 Workshop MHFAIA

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[2173] arXiv:2406.12125 (cross-list from cs.LG) [pdf, html, other]

Title: Efficient Sequential Decision Making with Large Language Models

Dingyang Chen, Qi Zhang, Yinglun Zhu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2174] arXiv:2406.12138 (cross-list from cs.AI) [pdf, html, other]

Title: Bias in Text Embedding Models

Vasyl Rakivnenko, Nestor Maslej, Jessica Cervi, Volodymyr Zhukov

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2175] arXiv:2406.12168 (cross-list from cs.LG) [pdf, html, other]

Title: BPO: Staying Close to the Behavior LLM Creates Better Online LLM Alignment

Wenda Xu, Jiachen Li, William Yang Wang, Lei Li

Comments: Wenda Xu and Jiachen Li contributed equally. Accepted by EMNLP 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2176] arXiv:2406.12209 (cross-list from cs.SD) [pdf, html, other]

Title: Interface Design for Self-Supervised Speech Models

Yi-Jen Shih, David Harwath

Comments: Accepted to Interspeech2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2177] arXiv:2406.12232 (cross-list from cs.AI) [pdf, html, other]

Title: "You Gotta be a Doctor, Lin": An Investigation of Name-Based Bias of Large Language Models in Employment Recommendations

Huy Nghiem, John Prindle, Jieyu Zhao, Hal Daumé III

Comments: EMNLP 2024, 20 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2178] arXiv:2406.12233 (cross-list from cs.AI) [pdf, html, other]

Title: SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization

Young Jin Ahn, Jungwoo Park, Sangha Park, Jonghyun Choi, Kee-Eung Kim

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2179] arXiv:2406.12246 (cross-list from cs.LG) [pdf, html, other]

Title: TroL: Traversal of Layers for Large Language and Vision Models

Byung-Kwan Lee, Sangyun Chung, Chae Won Kim, Beomchan Park, Yong Man Ro

Comments: EMNLP 2024. Code is available in this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2180] arXiv:2406.12260 (cross-list from cs.LG) [pdf, html, other]

Title: Self-Supervised Time-Series Anomaly Detection Using Learnable Data Augmentation

Kukjin Choi, Jihun Yi, Jisoo Mok, Sungroh Yoon

Comments: 11 pages, 4 figures, IEEE Transactions on Emerging Topics in Computational Intelligence

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2181] arXiv:2406.12276 (cross-list from cs.AI) [pdf, html, other]

Title: CodeNav: Beyond tool-use to using real-world codebases with LLM agents

Tanmay Gupta, Luca Weihs, Aniruddha Kembhavi

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

[2182] arXiv:2406.12321 (cross-list from cs.AI) [pdf, other]

Title: Automatic benchmarking of large multimodal models via iterative experiment programming

Alessandro Conti, Enrico Fini, Paolo Rota, Yiming Wang, Massimiliano Mancini, Elisa Ricci

Comments: 31 pages, 6 figures, code is available at this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2183] arXiv:2406.12387 (cross-list from eess.AS) [pdf, html, other]

Title: Performant ASR Models for Medical Entities in Accented Speech

Tejumade Afonja, Tobi Olatunji, Sewade Ogun, Naome A. Etori, Abraham Owodunni, Moshood Yekini

Comments: Accepted at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2184] arXiv:2406.12593 (cross-list from cs.IR) [pdf, html, other]

Title: PromptDSI: Prompt-based Rehearsal-free Instance-wise Incremental Learning for Document Retrieval

Tuan-Luc Huynh, Thuy-Trang Vu, Weiqing Wang, Yinwei Wei, Trung Le, Dragan Gasevic, Yuan-Fang Li, Thanh-Toan Do

Comments: 20 pages

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2185] arXiv:2406.12611 (cross-list from cs.SD) [pdf, html, other]

Title: Rapid Language Adaptation for Multilingual E2E Speech Recognition Using Encoder Prompting

Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe

Comments: Accepted by INTERSPEECH 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2186] arXiv:2406.12651 (cross-list from cs.RO) [pdf, html, other]

Title: Transforming Surgical Interventions with Embodied Intelligence for Ultrasound Robotics

Huan Xu, Jinlin Wu, Guanglin Cao, Zhen Chen, Zhen Lei, Hongbin Liu

Comments: This work has been accepted by MICCAI 2024

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[2187] arXiv:2406.12718 (cross-list from cs.CV) [pdf, html, other]

Title: AGLA: Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention

Wenbin An, Feng Tian, Sicong Leng, Jiahao Nie, Haonan Lin, QianYing Wang, Guang Dai, Ping Chen, Shijian Lu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2188] arXiv:2406.12742 (cross-list from cs.CV) [pdf, html, other]

Title: Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning

Bingchen Zhao, Yongshuo Zong, Letian Zhang, Timothy Hospedales

Comments: First three authors contributed equally. Dataset: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2189] arXiv:2406.12770 (cross-list from cs.AI) [pdf, html, other]

Title: Informatics & dairy industry coalition: AI trends and present challenges

Silvia García-Méndez, Francisco de Arriba-Pérez, María del Carmen Somoza-López

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2190] arXiv:2406.12814 (cross-list from cs.LG) [pdf, html, other]

Title: Adversarial Attacks on Multimodal Agents

Chen Henry Wu, Jing Yu Koh, Ruslan Salakhutdinov, Daniel Fried, Aditi Raghunathan

Comments: 19 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

[2191] arXiv:2406.12845 (cross-list from cs.LG) [pdf, html, other]

Title: Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Experts

Haoxiang Wang, Wei Xiong, Tengyang Xie, Han Zhao, Tong Zhang

Comments: Technical report v1. Code and model are released at this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2192] arXiv:2406.12881 (cross-list from physics.acc-ph) [pdf, html, other]

Title: Towards Unlocking Insights from Logbooks Using AI

Antonin Sulc, Alex Bien, Annika Eichler, Daniel Ratner, Florian Rehm, Frank Mayet, Gregor Hartmann, Hayden Hoschouer, Henrik Tuennermann, Jan Kaiser, Jason St. John, Jennefer Maldonado, Kyle Hazelwood, Raimund Kammering, Thorsten Hellert, Tim Wilksen, Verena Kain, Wan-Lin Hu

Comments: 5 pages, 1 figure, 15th International Particle Accelerator Conference

Subjects: Accelerator Physics (physics.acc-ph); Computation and Language (cs.CL)

[2193] arXiv:2406.12907 (cross-list from cs.LG) [pdf, html, other]

Title: Reconciling Kaplan and Chinchilla Scaling Laws

Tim Pearce, Jinyeop Song

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2194] arXiv:2406.12925 (cross-list from cs.LG) [pdf, html, other]

Title: GLiNER multi-task: Generalist Lightweight Model for Various Information Extraction Tasks

Ihor Stepanov, Mykhailo Shtopko

Comments: 11 pages, 1 figure, 6 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[2195] arXiv:2406.12928 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating the Generalization Ability of Quantized LLMs: Benchmark, Analysis, and Toolbox

Yijun Liu, Yuan Meng, Fang Wu, Shenhao Peng, Hang Yao, Chaoyu Guan, Chen Tang, Xinzhu Ma, Zhi Wang, Wenwu Zhu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2196] arXiv:2406.12931 (cross-list from eess.AS) [pdf, html, other]

Title: Automatic Speech Recognition for Biomedical Data in Bengali Language

Shariar Kabir, Nazmun Nahar, Shyamasree Saha, Mamunur Rashid

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2197] arXiv:2406.12937 (cross-list from eess.AS) [pdf, html, other]

Title: Self-Train Before You Transcribe

Robert Flynn, Anton Ragni

Comments: Accepted at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[2198] arXiv:2406.12946 (cross-list from eess.AS) [pdf, other]

Title: Instruction Data Generation and Unsupervised Adaptation for Speech Language Models

Vahid Noroozi, Zhehuai Chen, Somshubra Majumdar, Steve Huang, Jagadeesh Balam, Boris Ginsburg

Comments: Accepted for Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2199] arXiv:2406.12950 (cross-list from q-bio.QM) [pdf, html, other]

Title: MolecularGPT: Open Large Language Model (LLM) for Few-Shot Molecular Property Prediction

Yuyan Liu, Sirui Ding, Sheng Zhou, Wenqi Fan, Qiaoyu Tan

Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2200] arXiv:2406.12998 (cross-list from eess.AS) [pdf, html, other]

Title: Coding Speech through Vocal Tract Kinematics

Cheol Jun Cho, Peter Wu, Tejas S. Prabhune, Dhruv Agarwal, Gopala K. Anumanchipalli

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[2201] arXiv:2406.13106 (cross-list from cs.AI) [pdf, html, other]

Title: Accelerating Complex Disease Treatment through Network Medicine and GenAI: A Case Study on Drug Repurposing for Breast Cancer

Ahmed Abdeen Hamed, Tamer E. Fandy

Comments: 9 pages double columns, 5 figures, 3 algorithms, 3 tables, and 1 listing, Submitted to IEEE MedAI'24 Conference, to be held November 15-17, Chongqing, China

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[2202] arXiv:2406.13161 (cross-list from cs.AI) [pdf, other]

Title: APPL: A Prompt Programming Language for Harmonious Integration of Programs and Large Language Model Prompts

Honghua Dong, Qidong Su, Yubo Gao, Zhaoyu Li, Yangjun Ruan, Gennady Pekhimenko, Chris J. Maddison, Xujie Si

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Programming Languages (cs.PL)

[2203] arXiv:2406.13163 (cross-list from cond-mat.mtrl-sci) [pdf, html, other]

Title: LLMatDesign: Autonomous Materials Discovery with Large Language Models

Shuyi Jia, Chao Zhang, Victor Fung

Subjects: Materials Science (cond-mat.mtrl-sci); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2204] arXiv:2406.13170 (cross-list from cs.AI) [pdf, html, other]

Title: Amphista: Bi-directional Multi-head Decoding for Accelerating LLM Inference

Zeping Li, Xinlong Yang, Ziheng Gao, Ji Liu, Guanchen Li, Zhuang Liu, Dong Li, Jinzhang Peng, Lu Tian, Emad Barsoum

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2205] arXiv:2406.13173 (cross-list from cs.CV) [pdf, html, other]

Title: Biomedical Visual Instruction Tuning with Clinician Preference Alignment

Hejie Cui, Lingjun Mao, Xin Liang, Jieyu Zhang, Hui Ren, Quanzheng Li, Xiang Li, Carl Yang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2206] arXiv:2406.13193 (cross-list from cs.LG) [pdf, html, other]

Title: PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes

He Cao, Yanjun Shao, Zhiyuan Liu, Zijing Liu, Xiangru Tang, Yuan Yao, Yu Li

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Chemical Physics (physics.chem-ph)

[2207] arXiv:2406.13219 (cross-list from cs.CV) [pdf, html, other]

Title: MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency

Junzhe Zhang, Huixuan Zhang, Xunjian Yin, Baizhou Huang, Xu Zhang, Xinyu Hu, Xiaojun Wan

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2208] arXiv:2406.13250 (cross-list from cs.AI) [pdf, html, other]

Title: LangTopo: Aligning Language Descriptions of Graphs with Tokenized Topological Modeling

Zhong Guan, Hongke Zhao, Likang Wu, Ming He, Jianpin Fan

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2209] arXiv:2406.13269 (cross-list from cs.AI) [pdf, other]

Title: Investigating Low-Cost LLM Annotation for~Spoken Dialogue Understanding Datasets

Lucas Druart (LIA), Valentin Vielzeuf, Yannick Estève (LIA)

Journal-ref: 27th International Conference on Text, Speech and Dialogue, Sep 2024, Brno (R{\'e}p. Tch{\`e}que), Czech Republic

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Signal Processing (eess.SP)

[2210] arXiv:2406.13275 (cross-list from cs.SD) [pdf, html, other]

Title: Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding

Jizhong Liu, Gang Li, Junbo Zhang, Heinrich Dinkel, Yongqing Wang, Zhiyong Yan, Yujun Wang, Bin Wang

Comments: Accepted by Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2211] arXiv:2406.13337 (cross-list from eess.AS) [pdf, html, other]

Title: Medical Spoken Named Entity Recognition

Khai Le-Duc, David Thulke, Hung-Phong Tran, Long Vo-Dang, Khai-Nguyen Nguyen, Truong-Son Hy, Ralf Schlüter

Comments: Preprint, 41 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[2212] arXiv:2406.13348 (cross-list from cs.CR) [pdf, html, other]

Title: Textual Unlearning Gives a False Sense of Unlearning

Jiacheng Du, Zhibo Wang, Kui Ren

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2213] arXiv:2406.13362 (cross-list from cs.CV) [pdf, html, other]

Title: VisualRWKV: Exploring Recurrent Neural Networks for Visual Language Models

Haowen Hou, Peigen Zeng, Fei Ma, Fei Richard Yu

Comments: 18 pages,14 tables,6 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2214] arXiv:2406.13714 (cross-list from cs.AI) [pdf, html, other]

Title: BEACON: Balancing Convenience and Nutrition in Meals With Long-Term Group Recommendations and Reasoning on Multimodal Recipes

Vansh Nagpal, Siva Likitha Valluru, Kausik Lakkaraju, Biplav Srivastava

Comments: 6 pages (including references), 1 figure, 2 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2215] arXiv:2406.13743 (cross-list from cs.CV) [pdf, other]

Title: GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation

Baiqi Li, Zhiqiu Lin, Deepak Pathak, Jiayao Li, Yixin Fei, Kewen Wu, Tiffany Ling, Xide Xia, Pengchuan Zhang, Graham Neubig, Deva Ramanan

Comments: We open-source our dataset, model, and code at: this https URL ; Project page: this https URL ; GenAI-Bench was first introduced in arXiv:2404.01291. This article extends it with an additional GenAI-Rank benchmark.

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[2216] arXiv:2406.13762 (cross-list from cs.LG) [pdf, html, other]

Title: Unveiling the Hidden Structure of Self-Attention via Kernel Principal Component Analysis

Rachel S.Y. Teo, Tan M. Nguyen

Comments: 10 pages in the main text. Published at NeurIPS 2024. The code is available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[2217] arXiv:2406.13770 (cross-list from cs.LG) [pdf, html, other]

Title: Elliptical Attention

Stefan K. Nielsen, Laziz U. Abdullaev, Rachel Teo, Tan M. Nguyen

Comments: 38 pages, 7 figures, 12 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[2218] arXiv:2406.13777 (cross-list from cs.LG) [pdf, html, other]

Title: Game of LLMs: Discovering Structural Constructs in Activities using Large Language Models

Shruthi K. Hiremath, Thomas Ploetz

Comments: 6 pages, 2 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2219] arXiv:2406.13781 (cross-list from cs.LG) [pdf, html, other]

Title: A Primal-Dual Framework for Transformers and Neural Networks

Tan M. Nguyen, Tam Nguyen, Nhat Ho, Andrea L. Bertozzi, Richard G. Baraniuk, Stanley J. Osher

Comments: Accepted to ICLR 2023, 26 pages, 4 figures, 14 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[2220] arXiv:2406.13791 (cross-list from cs.AI) [pdf, html, other]

Title: IoT-Based Preventive Mental Health Using Knowledge Graphs and Standards for Better Well-Being

Amelie Gyrard, Seyedali Mohammadi, Manas Gaur, Antonio Kung

Comments: 20 pages, Book chapter, Smart Technologies for Achieving Good Health and Well-Being: Towards Sustainable Development Goal, Taylor & Francis

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[2221] arXiv:2406.13807 (cross-list from cs.CV) [pdf, html, other]

Title: AlanaVLM: A Multimodal Embodied AI Foundation Model for Egocentric Video Understanding

Alessandro Suglia, Claudio Greco, Katie Baker, Jose L. Part, Ioannis Papaioannou, Arash Eshghi, Ioannis Konstas, Oliver Lemon

Comments: Code available this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2222] arXiv:2406.13840 (cross-list from cs.AI) [pdf, html, other]

Title: StackRAG Agent: Improving Developer Answers with Retrieval-Augmented Generation

Davit Abrahamyan, Fatemeh H. Fard

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2223] arXiv:2406.13898 (cross-list from cs.CV) [pdf, other]

Title: The Use of Multimodal Large Language Models to Detect Objects from Thermal Images: Transportation Applications

Huthaifa I. Ashqar, Taqwa I. Alhadidi, Mohammed Elhenawy, Nour O. Khanfar

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Computers and Society (cs.CY)

[2224] arXiv:2406.13923 (cross-list from cs.AI) [pdf, html, other]

Title: PIN: A Knowledge-Intensive Dataset for Paired and Interleaved Multimodal Documents

Junjie Wang, Yin Zhang, Yatai Ji, Yuxiang Zhang, Chunyang Jiang, Yubo Wang, Kang Zhu, Zekun Wang, Tiezhen Wang, Wenhao Huang, Jie Fu, Bei Chen, Qunshu Lin, Minghao Liu, Ge Zhang, Wenhu Chen

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[2225] arXiv:2406.13945 (cross-list from cs.AI) [pdf, html, other]

Title: CityBench: Evaluating the Capabilities of Large Language Model as World Model

Jie Feng, Jun Zhang, Junbo Yan, Xin Zhang, Tianjian Ouyang, Tianhui Liu, Yuwei Du, Siqi Guo, Yong Li

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2226] arXiv:2406.13947 (cross-list from cs.AI) [pdf, html, other]

Title: AspirinSum: an Aspect-based utility-preserved de-identification Summarization framework

Ya-Lun Li

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2227] arXiv:2406.13948 (cross-list from cs.AI) [pdf, other]

Title: CityGPT: Empowering Urban Spatial Cognition of Large Language Models

Jie Feng, Yuwei Du, Tianhui Liu, Siqi Guo, Yuming Lin, Yong Li

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2228] arXiv:2406.14022 (cross-list from cs.LG) [pdf, html, other]

Title: Investigating the Pre-Training Dynamics of In-Context Learning: Task Recognition vs. Task Learning

Xiaolei Wang, Xinyu Tang, Wayne Xin Zhao, Ji-Rong Wen

Comments: work in progress

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2229] arXiv:2406.14026 (cross-list from cs.LG) [pdf, html, other]

Title: Demystifying Language Model Forgetting with Low-rank Example Associations

Xisen Jin, Xiang Ren

Comments: 9 pages; preprint

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2230] arXiv:2406.14036 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Infinite-Long Prefix in Transformer

Yingyu Liang, Zhenmei Shi, Zhao Song, Chiwun Yang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2231] arXiv:2406.14039 (cross-list from cs.AI) [pdf, other]

Title: CryptoGPT: a 7B model rivaling GPT-4 in the task of analyzing and classifying real-time financial news

Ying Zhang, Matthieu Petit Guillaume (BH), Aurélien Krauth (ON), Manel Labidi

Comments: Journ{é}e Nationale sur la Fouille de Textes, Pascal CUXAC; Adrien GUILLE; C{é}dric LOPEZ, Jun 2024, Lyon (Universit{é} Lumi{è}re Lyon 2), France

Subjects: Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)

[2232] arXiv:2406.14043 (cross-list from cs.IR) [pdf, html, other]

Title: Taxonomy-Guided Zero-Shot Recommendations with LLMs

Yueqing Liang, Liangwei Yang, Chen Wang, Xiongxiao Xu, Philip S. Yu, Kai Shu

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2233] arXiv:2406.14088 (cross-list from cs.DC) [pdf, html, other]

Title: ReaLHF: Optimized RLHF Training for Large Language Models through Parameter Reallocation

Zhiyu Mei, Wei Fu, Kaiwei Li, Guangju Wang, Huanchen Zhang, Yi Wu

Comments: 13 pages (15 pages with references), 13 figures

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2234] arXiv:2406.14106 (cross-list from cs.AI) [pdf, html, other]

Title: EasyECR: A Library for Easy Implementation and Evaluation of Event Coreference Resolution Models

Yuncong Li, Tianhua Xu, Sheng-hua Zhong, Haiqin Yang

Comments: 14 pages, 4 figures, 12 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2235] arXiv:2406.14117 (cross-list from cs.IR) [pdf, html, other]

Title: An Investigation of Prompt Variations for Zero-shot LLM-based Rankers

Shuoqi Sun, Shengyao Zhuang, Shuai Wang, Guido Zuccon

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2236] arXiv:2406.14129 (cross-list from cs.CV) [pdf, html, other]

Title: Towards Event-oriented Long Video Understanding

Yifan Du, Kun Zhou, Yuqi Huo, Yifan Li, Wayne Xin Zhao, Haoyu Lu, Zijia Zhao, Bingning Wang, Weipeng Chen, Ji-Rong Wen

Comments: Work on progress

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[2237] arXiv:2406.14154 (cross-list from cs.CY) [pdf, html, other]

Title: Watching the Watchers: A Comparative Fairness Audit of Cloud-based Content Moderation Services

David Hartmann, Amin Oueslati, Dimitri Staufer

Comments: Accepted at European Workshop on Algorithmic Fairness (EWAF'24)

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[2238] arXiv:2406.14162 (cross-list from cs.IR) [pdf, other]

Title: DIRAS: Efficient LLM Annotation of Document Relevance in Retrieval Augmented Generation

Jingwei Ni, Tobias Schimanski, Meihong Lin, Mrinmaya Sachan, Elliott Ash, Markus Leippold

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2239] arXiv:2406.14164 (cross-list from cs.AI) [pdf, html, other]

Title: A Data-Driven Guided Decoding Mechanism for Diagnostic Captioning

Panagiotis Kaliosis, John Pavlopoulos, Foivos Charalampakos, Georgios Moschovis, Ion Androutsopoulos

Comments: [Pre-print] ACL Findings 2024, 17 pages, 7 figures, 7 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2240] arXiv:2406.14171 (cross-list from cs.AI) [pdf, html, other]

Title: Ranking LLMs by compression

Peijia Guo, Ziguang Li, Haibo Hu, Chao Huang, Ming Li, Rui Zhang

Comments: 7 pages, 4 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2241] arXiv:2406.14307 (cross-list from q-bio.GN) [pdf, html, other]

Title: QuST-LLM: Integrating Large Language Models for Comprehensive Spatial Transcriptomics Analysis

Chao Hui Huang

Comments: 12 pages, 7 figures

Subjects: Genomics (q-bio.GN); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2242] arXiv:2406.14318 (cross-list from cs.CR) [pdf, html, other]

Title: The Fire Thief Is Also the Keeper: Balancing Usability and Privacy in Prompts

Zhili Shen, Zihang Xi, Ying He, Wei Tong, Jingyu Hua, Sheng Zhong

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2243] arXiv:2406.14319 (cross-list from cs.AI) [pdf, html, other]

Title: LiveMind: Low-latency Large Language Models with Simultaneous Inference

Chuangtao Chen, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo, Ulf Schlichtmann, Bing Li

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2244] arXiv:2406.14358 (cross-list from q-bio.NC) [pdf, other]

Title: The neural correlates of logical-mathematical symbol systems processing resemble that of spatial cognition more than natural language processing

Yuannan Li, Shan Xu, Jia Liu

Subjects: Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2245] arXiv:2406.14373 (cross-list from cs.AI) [pdf, html, other]

Title: Artificial Leviathan: Exploring Social Evolution of LLM Agents Through the Lens of Hobbesian Social Contract Theory

Gordon Dai, Weijia Zhang, Jinhan Li, Siqi Yang, Chidera Onochie lbe, Srihas Rao, Arthur Caetano, Misha Sra

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA)

[2246] arXiv:2406.14393 (cross-list from cs.LG) [pdf, html, other]

Title: Jailbreaking as a Reward Misspecification Problem

Zhihui Xie, Jiahui Gao, Lei Li, Zhenguo Li, Qi Liu, Lingpeng Kong

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2247] arXiv:2406.14408 (cross-list from cs.AI) [pdf, html, other]

Title: FVEL: Interactive Formal Verification Environment with Large Language Models via Theorem Proving

Xiaohan Lin, Qingxing Cao, Yinya Huang, Haiming Wang, Jianqiao Lu, Zhengying Liu, Linqi Song, Xiaodan Liang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2248] arXiv:2406.14464 (cross-list from cs.SD) [pdf, html, other]

Title: A Review of Common Online Speaker Diarization Methods

Roman Aperdannier, Sigurd Schacht, Alexander Piazza

Comments: 6 pages

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2249] arXiv:2406.14473 (cross-list from cs.LG) [pdf, html, other]

Title: Data-Centric AI in the Age of Large Language Models

Xinyi Xu, Zhaoxuan Wu, Rui Qiao, Arun Verma, Yao Shu, Jingtan Wang, Xinyuan Niu, Zhenfeng He, Jiangwei Chen, Zijian Zhou, Gregory Kang Ruey Lau, Hieu Dao, Lucas Agussurja, Rachael Hwee Ling Sim, Xiaoqiang Lin, Wenyang Hu, Zhongxiang Dai, Pang Wei Koh, Bryan Kian Hsiang Low

Comments: Preprint

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2250] arXiv:2406.14479 (cross-list from cs.AI) [pdf, html, other]

Title: On Layer-wise Representation Similarity: Application for Multi-Exit Models with a Single Classifier

Jiachen Jiang, Jinxin Zhou, Zhihui Zhu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[2251] arXiv:2406.14492 (cross-list from cs.CV) [pdf, html, other]

Title: Does Object Grounding Really Reduce Hallucination of Large Vision-Language Models?

Gregor Geigle, Radu Timofte, Goran Glavaš

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2252] arXiv:2406.14496 (cross-list from cs.CV) [pdf, html, other]

Title: African or European Swallow? Benchmarking Large Vision-Language Models for Fine-Grained Object Classification

Gregor Geigle, Radu Timofte, Goran Glavaš

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2253] arXiv:2406.14497 (cross-list from cs.SE) [pdf, html, other]

Title: CodeRAG-Bench: Can Retrieval Augment Code Generation?

Zora Zhiruo Wang, Akari Asai, Xinyan Velocity Yu, Frank F. Xu, Yiqing Xie, Graham Neubig, Daniel Fried

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2254] arXiv:2406.14517 (cross-list from cs.LG) [pdf, html, other]

Title: PostMark: A Robust Blackbox Watermark for Large Language Models

Yapei Chang, Kalpesh Krishna, Amir Houmansadr, John Wieting, Mohit Iyyer

Comments: EMNLP 2024; 19 pages, 5 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[2255] arXiv:2406.14522 (cross-list from physics.soc-ph) [pdf, html, other]

Title: Learning thresholds lead to stable language coexistence

Mikhail V. Tamm, Els Heinsalu, Stefano Scialla, Marco Patriarca

Comments: 5 pages, 3 figures

Subjects: Physics and Society (physics.soc-ph); Computation and Language (cs.CL)

[2256] arXiv:2406.14532 (cross-list from cs.LG) [pdf, html, other]

Title: RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold

Amrith Setlur, Saurabh Garg, Xinyang Geng, Naman Garg, Virginia Smith, Aviral Kumar

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2257] arXiv:2406.14544 (cross-list from cs.CV) [pdf, html, other]

Title: Prism: A Framework for Decoupling and Assessing the Capabilities of VLMs

Yuxuan Qiao, Haodong Duan, Xinyu Fang, Junming Yang, Lin Chen, Songyang Zhang, Jiaqi Wang, Dahua Lin, Kai Chen

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2258] arXiv:2406.14643 (cross-list from cs.CV) [pdf, html, other]

Title: Holistic Evaluation for Interleaved Text-and-Image Generation

Minqian Liu, Zhiyang Xu, Zihao Lin, Trevor Ashby, Joy Rimchala, Jiaxin Zhang, Lifu Huang

Comments: EMNLP 2024 Main Conference. 15 pages, 6 figures, 7 tables. Website: this https URL. Dataset: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2259] arXiv:2406.14683 (cross-list from cs.LG) [pdf, other]

Title: TAGLAS: An atlas of text-attributed graph datasets in the era of large graph and language models

Jiarui Feng, Hao Liu, Lecheng Kong, Mingfang Zhu, Yixin Chen, Muhan Zhang

Comments: Preprint

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2260] arXiv:2406.14701 (cross-list from cs.AI) [pdf, html, other]

Title: Speech Prefix-Tuning with RNNT Loss for Improving LLM Predictions

Murali Karthick Baskar, Andrew Rosenberg, Bhuvana Ramabhadran, Neeraj Gaur, Zhong Meng

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[2261] arXiv:2406.14764 (cross-list from cs.IR) [pdf, html, other]

Title: RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation

William Fleshman, Benjamin Van Durme

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2262] arXiv:2406.14765 (cross-list from cs.AI) [pdf, html, other]

Title: ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictor

Steven A. Lehr, Aylin Caliskan, Suneragiri Liyanage, Mahzarin R. Banaji

Comments: Main article is 14 pages, 1 table. Includes SI Appendix: 26 pages, 12 tables, 2 figures. Total: 40 pages, 13 tables, 2 figures. Under revised review at PNAS

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[2263] arXiv:2406.14774 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating Numerical Reasoning in Text-to-Image Models

Ivana Kajić, Olivia Wiles, Isabela Albuquerque, Matthias Bauer, Su Wang, Jordi Pont-Tuset, Aida Nematzadeh

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2264] arXiv:2406.14783 (cross-list from cs.IR) [pdf, html, other]

Title: Evaluating RAG-Fusion with RAGElo: an Automated Elo-based Framework

Zackary Rackauckas, Arthur Câmara, Jakub Zavrel

Comments: Accepted to LLM4Eval @ SIGIR24

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2265] arXiv:2406.14862 (cross-list from cs.LG) [pdf, html, other]

Title: LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multi-modal Foundation Models

Mengdan Zhu, Raasikh Kanjiani, Jiahui Lu, Andrew Choi, Qirui Ye, Liang Zhao

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2266] arXiv:2406.14867 (cross-list from cs.LG) [pdf, other]

Title: Investigating the Transferability of Code Repair for Low-Resource Programming Languages

Kyle Wong, Alfonso Amayuelas, Liangming Pan, William Yang Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2267] arXiv:2406.14898 (cross-list from cs.CR) [pdf, html, other]

Title: Safely Learning with Private Data: A Federated Learning Framework for Large Language Model

JiaYing Zheng, HaiNan Zhang, LingXiang Wang, WangJie Qiu, HongWei Zheng, ZhiMing Zheng

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[2268] arXiv:2406.14909 (cross-list from cs.LG) [pdf, html, other]

Title: MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression

Tianyu Fu, Haofeng Huang, Xuefei Ning, Genghan Zhang, Boju Chen, Tianqi Wu, Hongyi Wang, Zixiao Huang, Shiyao Li, Shengen Yan, Guohao Dai, Huazhong Yang, Yu Wang

Comments: 10 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2269] arXiv:2406.14917 (cross-list from cs.AI) [pdf, html, other]

Title: LLM2FEA: Discover Novel Designs with Generative Evolutionary Multitasking

Melvin Wong, Jiao Liu, Thiago Rios, Stefan Menzel, Yew Soon Ong

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[2270] arXiv:2406.14928 (cross-list from cs.AI) [pdf, html, other]

Title: Autonomous Agents for Collaborative Task under Information Asymmetry

Wei Liu, Chenxi Wang, Yifei Wang, Zihao Xie, Rennai Qiu, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, Chen Qian

Comments: 32 pages, 12 figures, 6 tables, accepted by NeurIPS 2024, see detail at this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA); Social and Information Networks (cs.SI)

[2271] arXiv:2406.14956 (cross-list from cs.LG) [pdf, html, other]

Title: Unlocking the Global Synergies in Low-Rank Adapters

Zixi Zhang, Cheng Zhang, Xitong Gao, Robert D. Mullins, George A. Constantinides, Yiren Zhao

Comments: Accepted at ICML2024 ES-FoMo-II Workshop

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2272] arXiv:2406.14986 (cross-list from cs.AI) [pdf, html, other]

Title: Do Large Language Models Exhibit Cognitive Dissonance? Studying the Difference Between Revealed Beliefs and Stated Answers

Manuel Mondal, Ljiljana Dolamic, Gérôme Bovet, Philippe Cudré-Mauroux, Julien Audiffren

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2273] arXiv:2406.14993 (cross-list from cs.CV) [pdf, other]

Title: Disability Representations: Finding Biases in Automatic Image Generation

Yannis Tevissen

Comments: Presented at AVA Workshop of CVPR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2274] arXiv:2406.15015 (cross-list from cs.DB) [pdf, html, other]

Title: GraLMatch: Matching Groups of Entities with Graphs and Language Models

Fernando De Meer Pardo, Claude Lehmann, Dennis Gehrig, Andrea Nagy, Stefano Nicoli, Branka Hadji Misheva, Martin Braschler, Kurt Stockinger

Comments: 12 pages, 4 figures, accepted as research paper at EDBT 2025

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2275] arXiv:2406.15038 (cross-list from cs.LG) [pdf, html, other]

Title: Online detection and infographic explanation of spam reviews with data drift adaptation

Francisco de Arriba-Pérez, Silvia García-Méndez, Fátima Leal, Benedita Malheiro, J. C. Burguillo

Journal-ref: Francisco de Arriba-P\'erez, Silvia Garc\'ia-M\'endez, F\'atima Leal, Benedita Malheiro, Juan C. Burguillo, Online Detection and Infographic Explanation of Spam Reviews with Data Drift Adaptation, Informatica(2024), 1-25

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[2276] arXiv:2406.15050 (cross-list from cs.LG) [pdf, html, other]

Title: Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis

Lin Fan, Xun Gong, Cenyang Zheng, Yafei Ou

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2277] arXiv:2406.15111 (cross-list from cs.AI) [pdf, html, other]

Title: Investigating the impact of 2D gesture representation on co-speech gesture generation

Teo Guichoux, Laure Soulier, Nicolas Obin, Catherine Pelachaud

Comments: 8 pages. Paper accepted at WACAI 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2278] arXiv:2406.15264 (cross-list from cs.IR) [pdf, html, other]

Title: Towards Fine-Grained Citation Evaluation in Generated Text: A Comparative Analysis of Faithfulness Metrics

Weijia Zhang, Mohammad Aliannejadi, Yifei Yuan, Jiahuan Pei, Jia-Hong Huang, Evangelos Kanoulas

Comments: Accepted by the 17th International Natural Language Generation Conference (INLG 2024) as an oral presentation

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2279] arXiv:2406.15279 (cross-list from cs.AI) [pdf, other]

Title: Cross-Modality Safety Alignment

Siyin Wang, Xingsong Ye, Qinyuan Cheng, Junwen Duan, Shimin Li, Jinlan Fu, Xipeng Qiu, Xuanjing Huang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2280] arXiv:2406.15306 (cross-list from cs.LG) [pdf, other]

Title: Advanced Multimodal Deep Learning Architecture for Image-Text Matching

Jinyin Wang, Haijing Zhang, Yihao Zhong, Yingbin Liang, Rongwei Ji, Yiru Cang

Comments: arXiv admin note: text overlap with arXiv:2405.17460 by other authors

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2281] arXiv:2406.15313 (cross-list from cs.IR) [pdf, html, other]

Title: STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionals

Weihang Su, Yiran Hu, Anzhe Xie, Qingyao Ai, Zibing Que, Ning Zheng, Yun Liu, Weixing Shen, Yiqun Liu

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2282] arXiv:2406.15330 (cross-list from cs.AI) [pdf, html, other]

Title: Gradient-Mask Tuning Elevates the Upper Limits of LLM Performance

Haoling Li, Xin Zhang, Xiao Liu, Yeyun Gong, Yifan Wang, Yujiu Yang, Qi Chen, Peng Cheng

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2283] arXiv:2406.15334 (cross-list from cs.CV) [pdf, html, other]

Title: Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learning

Brandon Huang, Chancharik Mitra, Assaf Arbelle, Leonid Karlinsky, Trevor Darrell, Roei Herzig

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2284] arXiv:2406.15474 (cross-list from cs.AI) [pdf, html, other]

Title: WundtGPT: Shaping Large Language Models To Be An Empathetic, Proactive Psychologist

Chenyu Ren, Yazhou Zhang, Daihai He, Jing Qin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[2285] arXiv:2406.15481 (cross-list from cs.AI) [pdf, other]

Title: CSRT: Evaluation and Analysis of LLMs using Code-Switching Red-Teaming Dataset

Haneul Yoo, Yongjin Yang, Hwaran Lee

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2286] arXiv:2406.15513 (cross-list from cs.AI) [pdf, html, other]

Title: PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference

Jiaming Ji, Donghai Hong, Borong Zhang, Boyuan Chen, Josef Dai, Boren Zheng, Tianyi Qiu, Boxun Li, Yaodong Yang

Comments: a sibling project to SafeRLHF and BeaverTails

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2287] arXiv:2406.15527 (cross-list from cs.LG) [pdf, html, other]

Title: Data Efficient Evaluation of Large Language Models and Text-to-Image Models via Adaptive Sampling

Cong Xu, Gayathri Saranathan, Mahammad Parwez Alam, Arpit Shah, James Lim, Soon Yee Wong, Foltin Martin, Suparna Bhattacharya

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2288] arXiv:2406.15534 (cross-list from cs.LG) [pdf, html, other]

Title: Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Research

Tianyu Liu, Yijia Xiao, Xiao Luo, Hua Xu, W. Jim Zheng, Hongyu Zhao

Comments: 8 pages

Journal-ref: EMNLP 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Quantitative Methods (q-bio.QM)

[2289] arXiv:2406.15567 (cross-list from cs.LG) [pdf, html, other]

Title: SAIL: Self-Improving Efficient Online Alignment of Large Language Models

Mucong Ding, Souradip Chakraborty, Vibhu Agrawal, Zora Che, Alec Koppel, Mengdi Wang, Amrit Bedi, Furong Huang

Comments: 24 pages, 6 figures, 3 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2290] arXiv:2406.15736 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads

Anoop Cherian, Kuan-Chuan Peng, Suhas Lohit, Joanna Matthiesen, Kevin Smith, Joshua B. Tenenbaum

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2291] arXiv:2406.15752 (cross-list from eess.AS) [pdf, html, other]

Title: TacoLM: GaTed Attention Equipped Codec Language Model are Efficient Zero-Shot Text to Speech Synthesizers

Yakun Song, Zhuo Chen, Xiaofei Wang, Ziyang Ma, Guanrou Yang, Xie Chen

Comments: INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2292] arXiv:2406.15754 (cross-list from cs.CV) [pdf, html, other]

Title: Multimodal Segmentation for Vocal Tract Modeling

Rishi Jain, Bohan Yu, Peter Wu, Tejas Prabhune, Gopala Anumanchipalli

Comments: Interspeech 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[2293] arXiv:2406.15765 (cross-list from cs.LG) [pdf, html, other]

Title: Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration

Zhongzhi Yu, Zheng Wang, Yonggan Fu, Huihong Shi, Khalid Shaikh, Yingyan Celine Lin

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2294] arXiv:2406.15786 (cross-list from cs.LG) [pdf, html, other]

Title: What Matters in Transformers? Not All Attention is Needed

Shwai He, Guoheng Sun, Zheyu Shen, Ang Li

Comments: 15 pages, 13 figures, 6 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2295] arXiv:2406.15812 (cross-list from cs.LG) [pdf, html, other]

Title: Intrinsic Dimension Correlation: uncovering nonlinear connections in multimodal representations

Lorenzo Basile, Santiago Acevedo, Luca Bortolussi, Fabio Anselmi, Alex Rodriguez

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2296] arXiv:2406.15877 (cross-list from cs.SE) [pdf, html, other]

Title: BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, Thong Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Zhihan Zhang, Prateek Yadav, Naman Jain, Alex Gu, Zhoujun Cheng, Jiawei Liu, Qian Liu, Zijian Wang, David Lo, Binyuan Hui, Niklas Muennighoff, Daniel Fried, Xiaoning Du, Harm de Vries, Leandro Von Werra

Comments: 44 pages, 14 figures, 7 tables, built with love by the BigCode community :)

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2297] arXiv:2406.15890 (cross-list from cs.LG) [pdf, html, other]

Title: Language Alignment via Nash-learning and Adaptive feedback

Ari Azarafrooz, Farshid Faal

Comments: Accepted at ICML 2024 Workshop on Models of Human Feedback for AI Alignment, Vienna, Austria

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT)

[2298] arXiv:2406.15940 (cross-list from cs.LG) [pdf, html, other]

Title: Beyond Individual Facts: Investigating Categorical Knowledge Locality of Taxonomy and Meronomy Concepts in GPT Models

Christopher Burger, Yifan Hu, Thai Le

Comments: 27 pages, 23 figures, 12 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2299] arXiv:2406.15963 (cross-list from cs.HC) [pdf, html, other]

Title: Effectiveness of ChatGPT in explaining complex medical reports to patients

Mengxuan Sun, Ehud Reiter, Anne E Kiltie, George Ramsay, Lisa Duncan, Peter Murchie, Rosalind Adam

Comments: under review

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Other Quantitative Biology (q-bio.OT)

[2300] arXiv:2406.16020 (cross-list from cs.SD) [pdf, html, other]

Title: AudioBench: A Universal Benchmark for Audio Large Language Models

Bin Wang, Xunlong Zou, Geyu Lin, Shuo Sun, Zhuohan Liu, Wenyu Zhang, Zhengyuan Liu, AiTi Aw, Nancy F. Chen

Comments: v3 - Abundent update on models and evaluation details; Code: this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2301] arXiv:2406.16061 (cross-list from cs.LG) [pdf, html, other]

Title: PORT: Preference Optimization on Reasoning Traces

Salem Lahlou, Abdalgader Abubaker, Hakim Hacid

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2302] arXiv:2406.16107 (cross-list from eess.AS) [pdf, html, other]

Title: Decoder-only Architecture for Streaming End-to-end Speech Recognition

Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe

Comments: Accepted for Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2303] arXiv:2406.16120 (cross-list from eess.AS) [pdf, html, other]

Title: Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss

Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe

Comments: Accepted to INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2304] arXiv:2406.16176 (cross-list from cs.AI) [pdf, html, other]

Title: GraphEval2000: Benchmarking and Improving Large Language Models on Graph Datasets

Qiming Wu, Zichen Chen, Will Corcoran, Misha Sra, Ambuj K. Singh

Comments: Submitted to NeurIPs 2024 Dataset and Benchmark track, under review

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2305] arXiv:2406.16201 (cross-list from cs.CR) [pdf, html, other]

Title: Blind Baselines Beat Membership Inference Attacks for Foundation Models

Debeshee Das, Jie Zhang, Florian Tramèr

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2306] arXiv:2406.16254 (cross-list from cs.LG) [pdf, html, other]

Title: Confidence Regulation Neurons in Language Models

Alessandro Stolfo, Ben Wu, Wes Gurnee, Yonatan Belinkov, Xingyi Song, Mrinmaya Sachan, Neel Nanda

Comments: 25 pages, 14 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2307] arXiv:2406.16308 (cross-list from cs.LG) [pdf, html, other]

Title: Anomaly Detection of Tabular Data Using LLMs

Aodong Li, Yunhan Zhao, Chen Qiu, Marius Kloft, Padhraic Smyth, Maja Rudolph, Stephan Mandt

Comments: accepted at the Anomaly Detection with Foundation Models workshop

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2308] arXiv:2406.16315 (cross-list from eess.AS) [pdf, html, other]

Title: Song Data Cleansing for End-to-End Neural Singer Diarization Using Neural Analysis and Synthesis Framework

Hokuto Munakata, Ryo Terashima, Yusuke Fujita

Comments: INTERSPEECH 2024 accepted

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2309] arXiv:2406.16332 (cross-list from cs.IR) [pdf, html, other]

Title: DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task

Wenhan Liu, Yutao Zhu, Zhicheng Dou

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2310] arXiv:2406.16408 (cross-list from math.CO) [pdf, other]

Title: A Symmetry Property of Christoffel Words

Yan Lanciault (LACIM), Christophe Reutenauer (LACIM)

Comments: In Proceedings GASCom 2024, arXiv:2406.14588

Journal-ref: EPTCS 403, 2024, pp. 123-127

Subjects: Combinatorics (math.CO); Computation and Language (cs.CL)

[2311] arXiv:2406.16477 (cross-list from cs.CV) [pdf, html, other]

Title: DaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-Resolution

Aiwen Jiang, Zhi Wei, Long Peng, Feiqiang Liu, Wenbo Li, Mingwen Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2312] arXiv:2406.16562 (cross-list from cs.CV) [pdf, html, other]

Title: EVALALIGN: Supervised Fine-Tuning Multimodal LLMs with Human-Aligned Data for Evaluating Text-to-Image Models

Zhiyu Tan, Xiaomeng Yang, Luozheng Qin, Mengping Yang, Cheng Zhang, Hao Li

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2313] arXiv:2406.16620 (cross-list from cs.CV) [pdf, html, other]

Title: OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquer

Lu Zhang, Tiancheng Zhao, Heting Ying, Yibo Ma, Kyusong Lee

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2314] arXiv:2406.16635 (cross-list from cs.LG) [pdf, html, other]

Title: ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models

Yash Akhauri, Ahmed F AbouElhamayed, Jordan Dotzel, Zhiru Zhang, Alexander M Rush, Safeen Huda, Mohamed S Abdelfattah

Comments: Accepted to EMNLP 2024 (Main, Long Paper)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2315] arXiv:2406.16746 (cross-list from cs.LG) [pdf, other]

Title: The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources

Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2316] arXiv:2406.16748 (cross-list from cs.LG) [pdf, other]

Title: OCALM: Object-Centric Assessment with Language Models

Timo Kaufmann, Jannis Blüml, Antonia Wüst, Quentin Delfosse, Kristian Kersting, Eyke Hüllermeier

Comments: Accepted at the RLBRew Workshop at RLC 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2317] arXiv:2406.16807 (cross-list from cs.LG) [pdf, html, other]

Title: Beyond Thumbs Up/Down: Untangling Challenges of Fine-Grained Feedback for Text-to-Image Generation

Katherine M. Collins, Najoung Kim, Yonatan Bitton, Verena Rieser, Shayegan Omidshafiei, Yushi Hu, Sherol Chen, Senjuti Dutta, Minsuk Chang, Kimin Lee, Youwei Liang, Georgina Evans, Sahil Singla, Gang Li, Adrian Weller, Junfeng He, Deepak Ramachandran, Krishnamurthy Dj Dvijotham

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2318] arXiv:2406.16810 (cross-list from cs.LG) [pdf, other]

Title: PISTOL: Dataset Compilation Pipeline for Structural Unlearning of LLMs

Xinchi Qiu, William F. Shen, Yihong Chen, Nicola Cancedda, Pontus Stenetorp, Nicholas D. Lane

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2319] arXiv:2406.16828 (cross-list from cs.IR) [pdf, html, other]

Title: Ragnar\"ok: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track

Ronak Pradeep, Nandan Thakur, Sahel Sharifymoghaddam, Eric Zhang, Ryan Nguyen, Daniel Campos, Nick Craswell, Jimmy Lin

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2320] arXiv:2406.16903 (cross-list from cs.HC) [pdf, other]

Title: Towards a copilot in BIM authoring tool using a large language model-based agent for intelligent human-machine interaction

Changyu Du, Stavros Nousias, André Borrmann

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2321] arXiv:2406.16953 (cross-list from eess.SP) [pdf, other]

Title: Validation of a new, minimally-invasive, software smartphone device to predict sleep apnea and its severity: transversal study

Justine Frija, Juliette Millet, Emilie Bequignon, Ala Covali, Guillaume Cathelain, Josselin Houenou, Helene Benzaquen, Pierre Alexis Geoffroy, Emmanuel Bacry, Mathieu Grajoszex, Marie-Pia d Ortho

Comments: 21 pages, 6 figures

Subjects: Signal Processing (eess.SP); Computation and Language (cs.CL)

[2322] arXiv:2406.16962 (cross-list from cs.LG) [pdf, html, other]

Title: MetaGreen: Meta-Learning Inspired Transformer Selection for Green Semantic Communication

Shubhabrata Mukherjee, Cory Beard, Sejun Song

Comments: arXiv admin note: substantial text overlap with arXiv:2310.07592

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2323] arXiv:2406.16985 (cross-list from cs.LG) [pdf, html, other]

Title: Unveiling LLM Mechanisms Through Neural ODEs and Control Theory

Yukun Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2324] arXiv:2406.17135 (cross-list from cs.SI) [pdf, html, other]

Title: Testing network clustering algorithms with Natural Language Processing

Ixandra Achitouv, David Chavalarias, Bruno Gaume

Comments: 10 pages, 8 figures

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY); Physics and Society (physics.soc-ph)

[2325] arXiv:2406.17224 (cross-list from cs.AI) [pdf, html, other]

Title: Large Language Models are Interpretable Learners

Ruochen Wang, Si Si, Felix Yu, Dorothea Wiesmann, Cho-Jui Hsieh, Inderjit Dhillon

Comments: Preliminary Version, Code at [this url](this https URL)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Symbolic Computation (cs.SC)

[2326] arXiv:2406.17233 (cross-list from cs.SE) [pdf, other]

Title: Self-Constructed Context Decompilation with Fined-grained Alignment Enhancement

Yunlong Feng, Dechuan Teng, Yang Xu, Honglin Mu, Xiao Xu, Libo Qin, Qingfu Zhu, Wanxiang Che

Comments: EMNLP 2024 Findings

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2327] arXiv:2406.17245 (cross-list from cs.LG) [pdf, html, other]

Title: Unlocking Continual Learning Abilities in Language Models

Wenyu Du, Shuang Cheng, Tongxu Luo, Zihan Qiu, Zeyu Huang, Ka Chun Cheung, Reynold Cheng, Jie Fu

Comments: EMNLP 2024 Findings

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2328] arXiv:2406.17266 (cross-list from eess.AS) [pdf, html, other]

Title: AG-LSEC: Audio Grounded Lexical Speaker Error Correction

Rohit Paturi, Xiang Li, Sundararajan Srinivasan

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2329] arXiv:2406.17532 (cross-list from cs.AI) [pdf, html, other]

Title: Can Large Language Models Understand DL-Lite Ontologies? An Empirical Study

Keyu Wang, Guilin Qi, Jiaqi Li, Songlin Zhai

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Logic in Computer Science (cs.LO)

[2330] arXiv:2406.17542 (cross-list from cs.LG) [pdf, html, other]

Title: CDQuant: Greedy Coordinate Descent for Accurate LLM Quantization

Pranav Ajit Nair, Arun Sai Suggala

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2331] arXiv:2406.17605 (cross-list from cs.MM) [pdf, other]

Title: NativE: Multi-modal Knowledge Graph Completion in the Wild

Yichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu, Binbin Hu, Ziqi Liu, Wen Zhang, Huajun Chen

Comments: Accepted by SIGIR 2024 as a full paper

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

[2332] arXiv:2406.17618 (cross-list from eess.AS) [pdf, html, other]

Title: Towards Building an End-to-End Multilingual Automatic Lyrics Transcription Model

Jiawen Huang, Emmanouil Benetos

Comments: Accepted at EUSIPCO 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2333] arXiv:2406.17639 (cross-list from cs.CV) [pdf, html, other]

Title: Mitigate the Gap: Investigating Approaches for Improving Cross-Modal Alignment in CLIP

Sedigheh Eslami, Gerard de Melo

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2334] arXiv:2406.17650 (cross-list from cs.AI) [pdf, html, other]

Title: ELIZA Reinterpreted: The world's first chatbot was not intended as a chatbot at all

Jeff Shrager

Comments: In process of journal review

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

[2335] arXiv:2406.17667 (cross-list from cs.SD) [pdf, html, other]

Title: This Paper Had the Smartest Reviewers -- Flattery Detection Utilising an Audio-Textual Transformer-Based Approach

Lukas Christ, Shahin Amiriparian, Friederike Hawighorst, Ann-Kathrin Schill, Angelo Boutalikakis, Lorenz Graf-Vlachy, Andreas König, Björn W. Schuller

Comments: Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2336] arXiv:2406.17706 (cross-list from cs.LG) [pdf, html, other]

Title: FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model

Feijie Wu, Zitao Li, Yaliang Li, Bolin Ding, Jing Gao

Comments: KDD 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[2337] arXiv:2406.17793 (cross-list from cs.LG) [pdf, html, other]

Title: Deep Learning Approaches for Detecting Adversarial Cyberbullying and Hate Speech in Social Networks

Sylvia Worlali Azumah, Nelly Elsayed, Zag ElSayed, Murat Ozer, Amanda La Guardia

Comments: 10 pages, 8 figures, 3 tables, under reviewing

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computers and Society (cs.CY)

[2338] arXiv:2406.17801 (cross-list from cs.SD) [pdf, html, other]

Title: A multi-speaker multi-lingual voice cloning system based on vits2 for limmits 2024 challenge

Xiaopeng Wang, Yi Lu, Xin Qi, Zhiyong Wang, Yuankun Xie, Shuchen Shi, Ruibo Fu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2339] arXiv:2406.17876 (cross-list from cs.CV) [pdf, html, other]

Title: ET tu, CLIP? Addressing Common Object Errors for Unseen Environments

Ye Won Byun, Cathy Jiao, Shahriar Noroozizadeh, Jimin Sun, Rosa Vitiello

Journal-ref: Conference on Computer Vision and Pattern Recognition (CVPR 2022) - Embodied AI Workshop

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Robotics (cs.RO)

[2340] arXiv:2406.17972 (cross-list from cs.LG) [pdf, html, other]

Title: LABOR-LLM: Language-Based Occupational Representations with Large Language Models

Tianyu Du, Ayush Kanodia, Herman Brunborg, Keyon Vafa, Susan Athey

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Econometrics (econ.EM)

[2341] arXiv:2406.18069 (cross-list from eess.SP) [pdf, html, other]

Title: Large Language Models for Cuffless Blood Pressure Measurement From Wearable Biosignals

Zengding Liu, Chen Chen, Jiannong Cao, Minglei Pan, Jikui Liu, Nan Li, Fen Miao, Ye Li

Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2342] arXiv:2406.18087 (cross-list from cs.SE) [pdf, html, other]

Title: EHR-Based Mobile and Web Platform for Chronic Disease Risk Prediction Using Large Language Multimodal Models

Chun-Chieh Liao, Wei-Ting Kuo, I-Hsuan Hu, Yen-Chen Shih, Jun-En Ding, Feng Liu, Fang-Ming Hung

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2343] arXiv:2406.18118 (cross-list from cs.CR) [pdf, other]

Title: SafeAligner: Safety Alignment against Jailbreak Attacks via Response Disparity Guidance

Caishuang Huang, Wanxu Zhao, Rui Zheng, Huijie Lv, Shihan Dou, Sixian Li, Xiao Wang, Enyu Zhou, Junjie Ye, Yuming Yang, Tao Gui, Qi Zhang, Xuanjing Huang

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[2344] arXiv:2406.18227 (cross-list from cs.CV) [pdf, html, other]

Title: GUIDE: A Guideline-Guided Dataset for Instructional Video Comprehension

Jiafeng Liang, Shixin Jiang, Zekun Wang, Haojie Pan, Zerui Chen, Zheng Chu, Ming Liu, Ruiji Fu, Zhongyuan Wang, Bing Qin

Comments: IJCAI 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2345] arXiv:2406.18301 (cross-list from eess.AS) [pdf, html, other]

Title: MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Research

Song Li, Yongbin You, Xuezhi Wang, Zhengkun Tian, Ke Ding, Guanglu Wan

Comments: Accepted by InterSpeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2346] arXiv:2406.18313 (cross-list from cs.SD) [pdf, html, other]

Title: Advancing Airport Tower Command Recognition: Integrating Squeeze-and-Excitation and Broadcasted Residual Learning

Yuanxi Lin, Tonglin Zhou, Yang Xiao

Comments: Accepted by IALP 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2347] arXiv:2406.18505 (cross-list from cs.LG) [pdf, html, other]

Title: Mental Modeling of Reinforcement Learning Agents by Language Models

Wenhao Lu, Xufeng Zhao, Josua Spisak, Jae Hee Lee, Stefan Wermter

Comments: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[2348] arXiv:2406.18522 (cross-list from cs.CV) [pdf, html, other]

Title: ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation

Shenghai Yuan, Jinfa Huang, Yongqi Xu, Yaoyang Liu, Shaofeng Zhang, Yujun Shi, Ruijie Zhu, Xinhua Cheng, Jiebo Luo, Li Yuan

Comments: NeurIPS D&B 2024 (Spotlight)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2349] arXiv:2406.18616 (cross-list from cs.SE) [pdf, html, other]

Title: Towards Large Language Model Aided Program Refinement

Yufan Cai, Zhe Hou, Xiaokun Luan, David Miguel Sanan Baena, Yun Lin, Jun Sun, Jin Song Dong

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2350] arXiv:2406.18626 (cross-list from q-bio.QM) [pdf, html, other]

Title: An LLM-based Knowledge Synthesis and Scientific Reasoning Framework for Biomedical Discovery

Oskar Wysocki, Magdalena Wysocka, Danilo Carvalho, Alex Teodor Bogatu, Danilo Miranda Gusicuma, Maxime Delmas, Harriet Unsworth, Andre Freitas

Comments: accepted for ACL 2024 System Demonstration Track

Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2351] arXiv:2406.18629 (cross-list from cs.LG) [pdf, html, other]

Title: Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs

Xin Lai, Zhuotao Tian, Yukang Chen, Senqiao Yang, Xiangru Peng, Jiaya Jia

Comments: Code, data, and models are available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2352] arXiv:2406.18665 (cross-list from cs.LG) [pdf, html, other]

Title: RouteLLM: Learning to Route LLMs with Preference Data

Isaac Ong, Amjad Almahairi, Vincent Wu, Wei-Lin Chiang, Tianhao Wu, Joseph E. Gonzalez, M Waleed Kadous, Ion Stoica

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2353] arXiv:2406.18675 (cross-list from cs.HC) [pdf, html, other]

Title: Human-AI Collaborative Taxonomy Construction: A Case Study in Profession-Specific Writing Assistants

Minhwa Lee, Zae Myung Kim, Vivek Khetan, Dongyeop Kang

Comments: Accepted to CHI 2024 In2Writing Workshop

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2354] arXiv:2406.18678 (cross-list from cs.LG) [pdf, html, other]

Title: Few-shot Personalization of LLMs with Mis-aligned Responses

Jaehyung Kim, Yiming Yang

Comments: preprint, 30 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2355] arXiv:2406.18679 (cross-list from eess.AS) [pdf, html, other]

Title: Speakers Unembedded: Embedding-free Approach to Long-form Neural Diarization

Xiang Li, Vivek Govindan, Rohit Paturi, Sundararajan Srinivasan

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2356] arXiv:2406.18695 (cross-list from cs.LG) [pdf, html, other]

Title: Learning to Correct for QA Reasoning with Black-box LLMs

Jaehyung Kim, Dongyoung Kim, Yiming Yang

Comments: 22 pages; EMNLP 2024 (long, main)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2357] arXiv:2406.18702 (cross-list from cs.HC) [pdf, html, other]

Title: Simulating The U.S. Senate: An LLM-Driven Agent Approach to Modeling Legislative Behavior and Bipartisanship

Zachary R. Baker, Zarif L. Azher

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[2358] arXiv:2406.18708 (cross-list from cs.LG) [pdf, html, other]

Title: Learn it or Leave it: Module Composition and Pruning for Continual Learning

Mingyang Wang, Heike Adel, Lukas Lange, Jannik Strötgen, Hinrich Schütze

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2359] arXiv:2406.18725 (cross-list from cs.LG) [pdf, html, other]

Title: Jailbreaking LLMs with Arabic Transliteration and Arabizi

Mansour Al Ghanim, Saleh Almohaimeed, Mengxin Zheng, Yan Solihin, Qian Lou

Comments: Accepted by EMNLP 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2360] arXiv:2406.18731 (cross-list from eess.AS) [pdf, html, other]

Title: WavRx: a Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model

Yi Zhu, Tiago Falk

Comments: Under review; Model script available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2361] arXiv:2406.18841 (cross-list from cs.CY) [pdf, other]

Title: Navigating LLM Ethics: Advancements, Challenges, and Future Directions

Junfeng Jiao, Saleh Afroogh, Yiming Xu, Connor Phillips

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2362] arXiv:2406.18842 (cross-list from cs.CY) [pdf, other]

Title: The global landscape of academic guidelines for generative AI and Large Language Models

Junfeng Jiao, Saleh Afroogh, Kevin Chen, David Atkinson, Amit Dhurandhar

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2363] arXiv:2406.18871 (cross-list from eess.AS) [pdf, html, other]

Title: DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment

Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, He Huang, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2364] arXiv:2406.18928 (cross-list from cs.SD) [pdf, html, other]

Title: Enhanced ASR Robustness to Packet Loss with a Front-End Adaptation Network

Yehoshua Dissen, Shiry Yonash, Israel Cohen, Joseph Keshet

Comments: Accepted for publication at INTERSPEECH 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[2365] arXiv:2406.18934 (cross-list from cs.FL) [pdf, other]

Title: The single-use restriction for register automata and transducers over infinite alphabets

Rafał Stefański

Comments: PhD Thesis at University of Warsaw. Supervisor: Mikołaj Bojańczyk

Subjects: Formal Languages and Automata Theory (cs.FL); Computation and Language (cs.CL)

[2366] arXiv:2406.18972 (cross-list from eess.AS) [pdf, html, other]

Title: Applying LLMs for Rescoring N-best ASR Hypotheses of Casual Conversations: Effects of Domain Adaptation and Context Carry-over

Atsunori Ogawa, Naoyuki Kamo, Kohei Matsuura, Takanori Ashihara, Takafumi Moriya, Takatomo Kano, Naohiro Tawara, Marc Delcroix

Comments: 5 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2367] arXiv:2406.18977 (cross-list from cs.RO) [pdf, html, other]

Title: RoboUniView: Visual-Language Model with Unified View Representation for Robotic Manipulation

Fanfan Liu, Feng Yan, Liming Zheng, Chengjian Feng, Yiyang Huang, Lin Ma

Subjects: Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2368] arXiv:2406.19146 (cross-list from cs.LG) [pdf, html, other]

Title: Resolving Discrepancies in Compute-Optimal Scaling of Language Models

Tomer Porian, Mitchell Wortsman, Jenia Jitsev, Ludwig Schmidt, Yair Carmon

Comments: NeurIPS 2024 revisions

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2369] arXiv:2406.19230 (cross-list from cs.NE) [pdf, html, other]

Title: Spiking Convolutional Neural Networks for Text Classification

Changze Lv, Jianhan Xu, Xiaoqing Zheng

Subjects: Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL)

[2370] arXiv:2406.19255 (cross-list from cs.CV) [pdf, html, other]

Title: Enhancing Video-Language Representations with Structural Spatio-Temporal Alignment

Hao Fei, Shengqiong Wu, Meishan Zhang, Min Zhang, Tat-Seng Chua, Shuicheng Yan

Comments: Accepted by IEEE TPAMI 2024

Journal-ref: [J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2371] arXiv:2406.19280 (cross-list from cs.CV) [pdf, html, other]

Title: HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale

Junying Chen, Chi Gui, Ruyi Ouyang, Anningzhe Gao, Shunian Chen, Guiming Hardy Chen, Xidong Wang, Ruifei Zhang, Zhenyang Cai, Ke Ji, Guangjun Yu, Xiang Wan, Benyou Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2372] arXiv:2406.19292 (cross-list from cs.LG) [pdf, other]

Title: From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data

Zheyang Xiong, Vasilis Papageorgiou, Kangwook Lee, Dimitris Papailiopoulos

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2373] arXiv:2406.19317 (cross-list from cs.LG) [pdf, html, other]

Title: Jump Starting Bandits with LLM-Generated Prior Knowledge

Parand A. Alamdari, Yanshuai Cao, Kevin H. Wilson

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2374] arXiv:2406.19384 (cross-list from cs.LG) [pdf, html, other]

Title: The Remarkable Robustness of LLMs: Stages of Inference?

Vedang Lad, Wes Gurnee, Max Tegmark

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2375] arXiv:2406.19388 (cross-list from cs.SD) [pdf, html, other]

Title: Taming Data and Transformers for Audio Generation

Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin, Guha Balakrishnan, Sergey Tulyakov, Vicente Ordonez

Comments: Project Webpage: this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[2376] arXiv:2406.19413 (cross-list from cs.CR) [pdf, other]

Title: Saliency Attention and Semantic Similarity-Driven Adversarial Perturbation

Hetvi Waghela, Jaydip Sen, Sneha Rakshit

Comments: The paper is 12 pages long. and it contains 5 tables. It is the pre-reviewed version of the paper that has been accepted for oral presentation and publication in the 5th International Conference on Data Science and Applications which will be organized in Jaipur, India from July 17 to 19, 2024. This is not the final version

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2377] arXiv:2406.19500 (cross-list from cs.AI) [pdf, html, other]

Title: Knowledge acquisition for dialogue agents using reinforcement learning on graph representations

Selene Baez Santamaria, Shihan Wang, Piek Vossen

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2378] arXiv:2406.19578 (cross-list from cs.CV) [pdf, html, other]

Title: PathAlign: A vision-language model for whole slide images in histopathology

Faruk Ahmed, Andrew Sellergren, Lin Yang, Shawn Xu, Boris Babenko, Abbi Ward, Niels Olson, Arash Mohtashamian, Yossi Matias, Greg S. Corrado, Quang Duong, Dale R. Webster, Shravya Shetty, Daniel Golden, Yun Liu, David F. Steiner, Ellery Wulczyn

Comments: 9 main pages and 19 pages of supplemental material; 3 main tables, 3 main figures and 11 supplemental tables, 7 supplemental figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2379] arXiv:2406.19648 (cross-list from cs.HC) [pdf, other]

Title: Designing and Evaluating Multi-Chatbot Interface for Human-AI Communication: Preliminary Findings from a Persuasion Task

Sion Yoon, Tae Eun Kim, Yoo Jung Oh

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2380] arXiv:2406.19712 (cross-list from cs.AI) [pdf, other]

Title: Uncertainty Quantification in Large Language Models Through Convex Hull Analysis

Ferhat Ozgur Catak, Murat Kuzlu

Comments: 17 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2381] arXiv:2406.19736 (cross-list from cs.CV) [pdf, html, other]

Title: MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment

Jihao Liu, Xin Huang, Jinliang Zheng, Boxiao Liu, Jia Wang, Osamu Yoshie, Yu Liu, Hongsheng Li

Comments: Dataset and models are available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2382] arXiv:2406.19760 (cross-list from cs.IR) [pdf, html, other]

Title: Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulation

Chenlong Deng, Kelong Mao, Zhicheng Dou

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2383] arXiv:2406.19783 (cross-list from cs.SE) [pdf, html, other]

Title: NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations

Junkai Chen, Zhenhao Li, Xing Hu, Xin Xia

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2384] arXiv:2406.20053 (cross-list from cs.CR) [pdf, html, other]

Title: Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation

Danny Halawi, Alexander Wei, Eric Wallace, Tony T. Wang, Nika Haghtalab, Jacob Steinhardt

Comments: 22 pages

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2385] arXiv:2406.20087 (cross-list from cs.LG) [pdf, html, other]

Title: ProgressGym: Alignment with a Millennium of Moral Progress

Tianyi Qiu, Yang Zhang, Xuchuan Huang, Jasmine Xinze Li, Jiaming Ji, Yaodong Yang

Comments: NeurIPS 2024 Track on Datasets and Benchmarks (Spotlight)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

[2386] arXiv:2406.20095 (cross-list from cs.RO) [pdf, html, other]

Title: LLaRA: Supercharging Robot Learning Data for Vision-Language Policy

Xiang Li, Cristina Mata, Jongwoo Park, Kumara Kahatapitiya, Yoo Sung Jang, Jinghuan Shang, Kanchana Ranasinghe, Ryan Burgert, Mu Cai, Yong Jae Lee, Michael S. Ryoo

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[2387] arXiv:2406.20098 (cross-list from cs.CV) [pdf, html, other]

Title: Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs

Sukmin Yun, Haokun Lin, Rusiru Thushara, Mohammad Qazim Bhat, Yongxin Wang, Zutao Jiang, Mingkai Deng, Jinhong Wang, Tianhua Tao, Junbo Li, Haonan Li, Preslav Nakov, Timothy Baldwin, Zhengzhong Liu, Eric P. Xing, Xiaodan Liang, Zhiqiang Shen

Comments: Website at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)