Computation and Language

Authors and titles for June 2024

[301] arXiv:2406.04146 [pdf, html, other]

Title: Towards Understanding Task-agnostic Debiasing Through the Lenses of Intrinsic Bias and Forgetfulness

Guangliang Liu, Milad Afshari, Xitong Zhang, Zhiyu Xue, Avrajit Ghosh, Bidhan Bashyal, Rongrong Wang, Kristen Johnson

Subjects: Computation and Language (cs.CL)

[302] arXiv:2406.04156 [pdf, html, other]

Title: Pointer-Guided Pre-Training: Infusing Large Language Models with Paragraph-Level Contextual Awareness

Lars Hillebrand, Prabhupad Pradhan, Christian Bauckhage, Rafet Sifa

Comments: 17 pages, 3 figures, 5 tables, accepted at ECML-PKDD 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[303] arXiv:2406.04175 [pdf, html, other]

Title: Confabulation: The Surprising Value of Large Language Model Hallucinations

Peiqi Sui, Eamon Duede, Sophie Wu, Richard Jean So

Comments: Forthcoming at ACL2024 main conference. 1 figure

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[304] arXiv:2406.04197 [pdf, html, other]

Title: DICE: Detecting In-distribution Contamination in LLM's Fine-tuning Phase for Math Reasoning

Shangqing Tu, Kejian Zhu, Yushi Bai, Zijun Yao, Lei Hou, Juanzi Li

Comments: 13 pages, 7 figures

Subjects: Computation and Language (cs.CL)

[305] arXiv:2406.04202 [pdf, other]

Title: Legal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model

Chun-Hsien Lin, Pu-Jen Cheng

Comments: 12th International Conference on Software Engineering & Trends (SE 2024), April 27 ~ 28, 2024, Copenhagen, Denmark Volume Editors : David C. Wyld, Dhinaharan Nagamalai (Eds) ISBN : 978-1-923107-24-3

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[306] arXiv:2406.04214 [pdf, html, other]

Title: ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models

Yuanyi Ren, Haoran Ye, Hanjun Fang, Xin Zhang, Guojie Song

Comments: Accepted at ACL 2024

Subjects: Computation and Language (cs.CL)

[307] arXiv:2406.04215 [pdf, html, other]

Title: mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans

Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe

Comments: Accepted at Findings of ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[308] arXiv:2406.04216 [pdf, html, other]

Title: What Do Language Models Learn in Context? The Structured Task Hypothesis

Jiaoda Li, Yifan Hou, Mrinmaya Sachan, Ryan Cotterell

Comments: This work is published in ACL 2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[309] arXiv:2406.04218 [pdf, html, other]

Title: Linguistic Steganalysis via LLMs: Two Modes for Efficient Detection of Strongly Concealed Stego

Yifan Tang, Yihao Wang, Ru Zhang, Jianyi Liu

Subjects: Computation and Language (cs.CL)

[310] arXiv:2406.04220 [pdf, html, other]

Title: BEADs: Bias Evaluation Across Domains

Shaina Raza, Mizanur Rahman, Michael R. Zhang

Comments: under review

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[311] arXiv:2406.04233 [pdf, html, other]

Title: FairytaleQA Translated: Enabling Educational Question and Answer Generation in Less-Resourced Languages

Bernardo Leite, Tomás Freitas Osório, Henrique Lopes Cardoso

Comments: Preprint - Accepted for publication at ECTEL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[312] arXiv:2406.04244 [pdf, html, other]

Title: Benchmark Data Contamination of Large Language Models: A Survey

Cheng Xu, Shuhao Guan, Derek Greene, M-Tahar Kechadi

Comments: 31 pages, 7 figures, 3 tables

Subjects: Computation and Language (cs.CL)

[313] arXiv:2406.04267 [pdf, html, other]

Title: Transformers need glasses! Information over-squashing in language tasks

Federico Barbero, Andrea Banino, Steven Kapturowski, Dharshan Kumaran, João G.M. Araújo, Alex Vitvitskyi, Razvan Pascanu, Petar Veličković

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[314] arXiv:2406.04271 [pdf, other]

Title: Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models

Ling Yang, Zhaochen Yu, Tianjun Zhang, Shiyi Cao, Minkai Xu, Wentao Zhang, Joseph E. Gonzalez, Bin Cui

Comments: NeurIPS 2024 Spotlight. Project: this https URL

Subjects: Computation and Language (cs.CL)

[315] arXiv:2406.04278 [pdf, html, other]

Title: Characterizing Similarities and Divergences in Conversational Tones in Humans and LLMs by Sampling with People

Dun-Ming Huang, Pol Van Rijn, Ilia Sucholutsky, Raja Marjieh, Nori Jacoby

Comments: Accepted to Main Conference at ACL 2024

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[316] arXiv:2406.04286 [pdf, html, other]

Title: ABEX: Data Augmentation for Low-Resource NLU via Expanding Abstract Descriptions

Sreyan Ghosh, Utkarsh Tyagi, Sonal Kumar, C. K. Evuru, S Ramaneswaran, S Sakshi, Dinesh Manocha

Comments: ACL 2024 Main Conference. Code and data: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[317] arXiv:2406.04289 [pdf, html, other]

Title: What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages

Nadav Borenstein, Anej Svete, Robin Chan, Josef Valvoda, Franz Nowak, Isabelle Augenstein, Eleanor Chodroff, Ryan Cotterell

Comments: Accepted to ACL 2024

Subjects: Computation and Language (cs.CL)

[318] arXiv:2406.04331 [pdf, html, other]

Title: PaCE: Parsimonious Concept Engineering for Large Language Models

Jinqi Luo, Tianjiao Ding, Kwan Ho Ryan Chan, Darshan Thaker, Aditya Chattopadhyay, Chris Callison-Burch, René Vidal

Comments: Accepted in NeurIPS 2024. GitHub repository at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[319] arXiv:2406.04368 [pdf, html, other]

Title: SocialNLP Fake-EmoReact 2021 Challenge Overview: Predicting Fake Tweets from Their Replies and GIFs

Chien-Kun Huang, Yi-Ting Chang, Lun-Wei Ku, Cheng-Te Li, Hong-Han Shuai

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[320] arXiv:2406.04370 [pdf, html, other]

Title: Large Language Model Confidence Estimation via Black-Box Access

Tejaswini Pedapati, Amit Dhurandhar, Soumya Ghosh, Soham Dan, Prasanna Sattigeri

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[321] arXiv:2406.04371 [pdf, html, other]

Title: Phased Instruction Fine-Tuning for Large Language Models

Wei Pang, Chuan Zhou, Xiao-Hua Zhou, Xiaojie Wang

Comments: The final version, to be appear at ACL 2024 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[322] arXiv:2406.04383 [pdf, html, other]

Title: Exploring the Latest LLMs for Leaderboard Extraction

Salomon Kabongo, Jennifer D'Souza, Sören Auer

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[323] arXiv:2406.04428 [pdf, html, other]

Title: MoralBench: Moral Evaluation of LLMs

Jianchao Ji, Yutong Chen, Mingyu Jin, Wujiang Xu, Wenyue Hua, Yongfeng Zhang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[324] arXiv:2406.04438 [pdf, html, other]

Title: TexIm FAST: Text-to-Image Representation for Semantic Similarity Evaluation using Transformers

Wazib Ansar, Saptarsi Goswami, Amlan Chakrabarti

Comments: 19 pages, 33 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[325] arXiv:2406.04449 [pdf, other]

Title: MAIRA-2: Grounded Radiology Report Generation

Shruthi Bannur, Kenza Bouzid, Daniel C. Castro, Anton Schwaighofer, Anja Thieme, Sam Bond-Taylor, Maximilian Ilse, Fernando Pérez-García, Valentina Salvatelli, Harshita Sharma, Felix Meissen, Mercy Ranjit, Shaury Srivastav, Julia Gong, Noel C. F. Codella, Fabian Falck, Ozan Oktay, Matthew P. Lungren, Maria Teodora Wetscherek, Javier Alvarez-Valle, Stephanie L. Hyland

Comments: 72 pages, 21 figures. v2 updates the model and adds results on the PadChest-GR dataset

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[326] arXiv:2406.04460 [pdf, html, other]

Title: Evaluating the Smooth Control of Attribute Intensity in Text Generation with LLMs

Shang Zhou, Feng Yao, Chengyu Dong, Zihan Wang, Jingbo Shang

Comments: Accepted to ACL 2024 Findings

Subjects: Computation and Language (cs.CL)

[327] arXiv:2406.04461 [pdf, html, other]

Title: Multi-Label Classification for Implicit Discourse Relation Recognition

Wanqiu Long, N. Siddharth, Bonnie Webber

Comments: ACL2024 Finding

Subjects: Computation and Language (cs.CL)

[328] arXiv:2406.04478 [pdf, html, other]

Title: PromptFix: Few-shot Backdoor Removal via Adversarial Prompt Tuning

Tianrong Zhang, Zhaohan Xi, Ting Wang, Prasenjit Mitra, Jinghui Chen

Comments: NAACL 2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[329] arXiv:2406.04482 [pdf, html, other]

Title: Automatic Bug Detection in LLM-Powered Text-Based Games Using LLMs

Claire Jin, Sudha Rao, Xiangyu Peng, Portia Botchway, Jessica Quaye, Chris Brockett, Bill Dolan

Comments: Accepted for publication in Findings of the Association for Computational Linguistics: ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Software Engineering (cs.SE)

[330] arXiv:2406.04496 [pdf, html, other]

Title: Time Sensitive Knowledge Editing through Efficient Finetuning

Xiou Ge, Ali Mousavi, Edouard Grave, Armand Joulin, Kun Qian, Benjamin Han, Mostafa Arefiyan, Yunyao Li

Comments: ACL 2024 main

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[331] arXiv:2406.04512 [pdf, html, other]

Title: To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation

Abdul Waheed, Karima Kadaoui, Muhammad Abdul-Mageed

Comments: Accepted at ACL'24 main

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[332] arXiv:2406.04520 [pdf, html, other]

Title: NATURAL PLAN: Benchmarking LLMs on Natural Language Planning

Huaixiu Steven Zheng, Swaroop Mishra, Hugh Zhang, Xinyun Chen, Minmin Chen, Azade Nova, Le Hou, Heng-Tze Cheng, Quoc V. Le, Ed H. Chi, Denny Zhou

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[333] arXiv:2406.04523 [pdf, html, other]

Title: Proofread: Fixes All Errors with One Tap

Renjie Liu, Yanxiang Zhang, Yun Zhu, Haicheng Sun, Yuanbo Zhang, Michael Xuelin Huang, Shanqing Cai, Lei Meng, Shumin Zhai

Comments: 8 pages, 3 figures, 2 tables

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[334] arXiv:2406.04528 [pdf, html, other]

Title: llmNER: (Zero|Few)-Shot Named Entity Recognition, Exploiting the Power of Large Language Models

Fabián Villena, Luis Miranda, Claudio Aracena

Subjects: Computation and Language (cs.CL)

[335] arXiv:2406.04541 [pdf, html, other]

Title: Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translation

Keqi Deng, Philip C. Woodland

Comments: Accepted by ACL 2024 Main Conference

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[336] arXiv:2406.04555 [pdf, html, other]

Title: Creating an AI Observer: Generative Semantic Workspaces

Pavan Holur, Shreyas Rajesh, David Chong, Vwani Roychowdhury

Comments: 37 pages with appendix, 28 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[337] arXiv:2406.04566 [pdf, html, other]

Title: SpaRC and SpaRP: Spatial Reasoning Characterization and Path Generation for Understanding Spatial Reasoning Capability of Large Language Models

Md Imbesat Hassan Rizvi, Xiaodan Zhu, Iryna Gurevych

Comments: Accepted at ACL 2024 (Main)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[338] arXiv:2406.04578 [pdf, html, other]

Title: SC2: Towards Enhancing Content Preservation and Style Consistency in Long Text Style Transfer

Jie Zhao, Ziyu Guan, Cai Xu, Wei Zhao, Yue Jiang

Subjects: Computation and Language (cs.CL)

[339] arXiv:2406.04583 [pdf, html, other]

Title: Extroversion or Introversion? Controlling The Personality of Your Large Language Models

Yanquan Chen, Zhen Wu, Junjie Guo, Shujian Huang, Xinyu Dai

Subjects: Computation and Language (cs.CL)

[340] arXiv:2406.04604 [pdf, html, other]

Title: Learning Task Decomposition to Assist Humans in Competitive Programming

Jiaxin Wen, Ruiqi Zhong, Pei Ke, Zhihong Shao, Hongning Wang, Minlie Huang

Comments: ACL 2024 Main Conference

Subjects: Computation and Language (cs.CL); Programming Languages (cs.PL)

[341] arXiv:2406.04614 [pdf, html, other]

Title: LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Model

Zhi Zhou, Jiang-Xin Shi, Peng-Xiao Song, Xiao-Wen Yang, Yi-Xuan Jin, Lan-Zhe Guo, Yu-Feng Li

Comments: Technical Report

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[342] arXiv:2406.04625 [pdf, html, other]

Title: Key-Element-Informed sLLM Tuning for Document Summarization

Sangwon Ryu, Heejin Do, Yunsu Kim, Gary Geunbae Lee, Jungseul Ok

Comments: Interspeech 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[343] arXiv:2406.04630 [pdf, html, other]

Title: Low-Resource Cross-Lingual Summarization through Few-Shot Learning with Large Language Models

Gyutae Park, Seojin Hwang, Hwanhee Lee

Comments: 7 pages,3 figures

Subjects: Computation and Language (cs.CL)

[344] arXiv:2406.04638 [pdf, html, other]

Title: Large Language Model-guided Document Selection

Xiang Kong, Tom Gunter, Ruoming Pang

Comments: 9 pages

Subjects: Computation and Language (cs.CL)

[345] arXiv:2406.04643 [pdf, html, other]

Title: More Victories, Less Cooperation: Assessing Cicero's Diplomacy Play

Wichayaporn Wongkamjan, Feng Gu, Yanze Wang, Ulf Hermjakob, Jonathan May, Brandon M. Stewart, Jonathan K. Kummerfeld, Denis Peskoff, Jordan Lee Boyd-Graber

Subjects: Computation and Language (cs.CL)

[346] arXiv:2406.04669 [pdf, html, other]

Title: DiNeR: a Large Realistic Dataset for Evaluating Compositional Generalization

Chengang Hu, Xiao Liu, Yansong Feng

Comments: EMNLP 2023 long paper

Subjects: Computation and Language (cs.CL)

[347] arXiv:2406.04670 [pdf, html, other]

Title: MATTER: Memory-Augmented Transformer Using Heterogeneous Knowledge Sources

Dongkyu Lee, Chandana Satya Prakash, Jack FitzGerald, Jens Lehmann

Comments: ACL2024-Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[348] arXiv:2406.04692 [pdf, html, other]

Title: Mixture-of-Agents Enhances Large Language Model Capabilities

Junlin Wang, Jue Wang, Ben Athiwaratkun, Ce Zhang, James Zou

Subjects: Computation and Language (cs.CL)

[349] arXiv:2406.04712 [pdf, html, other]

Title: AICoderEval: Improving AI Domain Code Generation of Large Language Models

Yinghui Xia, Yuyan Chen, Tianyu Shi, Jun Wang, Jinsong Yang

Subjects: Computation and Language (cs.CL)

[350] arXiv:2406.04744 [pdf, html, other]

Title: CRAG -- Comprehensive RAG Benchmark

Xiao Yang, Kai Sun, Hao Xin, Yushi Sun, Nikita Bhalla, Xiangsen Chen, Sajal Choudhary, Rongze Daniel Gui, Ziran Will Jiang, Ziyu Jiang, Lingkun Kong, Brian Moran, Jiaqi Wang, Yifan Ethan Xu, An Yan, Chenyu Yang, Eting Yuan, Hanwen Zha, Nan Tang, Lei Chen, Nicolas Scheffer, Yue Liu, Nirav Shah, Rakesh Wanga, Anuj Kumar, Wen-tau Yih, Xin Luna Dong

Comments: NeurIPS 2024 Datasets and Benchmarks Track

Subjects: Computation and Language (cs.CL)