Computation and Language

Authors and titles for June 2024

[301] arXiv:2406.04146 [pdf, html, other]

Title: Towards Understanding Task-agnostic Debiasing Through the Lenses of Intrinsic Bias and Forgetfulness

Guangliang Liu, Milad Afshari, Xitong Zhang, Zhiyu Xue, Avrajit Ghosh, Bidhan Bashyal, Rongrong Wang, Kristen Johnson

Subjects: Computation and Language (cs.CL)

[302] arXiv:2406.04156 [pdf, html, other]

Title: Pointer-Guided Pre-Training: Infusing Large Language Models with Paragraph-Level Contextual Awareness

Lars Hillebrand, Prabhupad Pradhan, Christian Bauckhage, Rafet Sifa

Comments: 17 pages, 3 figures, 5 tables, accepted at ECML-PKDD 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[303] arXiv:2406.04175 [pdf, html, other]

Title: Confabulation: The Surprising Value of Large Language Model Hallucinations

Peiqi Sui, Eamon Duede, Sophie Wu, Richard Jean So

Comments: Forthcoming at ACL2024 main conference. 1 figure

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[304] arXiv:2406.04197 [pdf, html, other]

Title: DICE: Detecting In-distribution Contamination in LLM's Fine-tuning Phase for Math Reasoning

Shangqing Tu, Kejian Zhu, Yushi Bai, Zijun Yao, Lei Hou, Juanzi Li

Comments: 13 pages, 7 figures

Subjects: Computation and Language (cs.CL)

[305] arXiv:2406.04202 [pdf, other]

Title: Legal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model

Chun-Hsien Lin, Pu-Jen Cheng

Comments: 12th International Conference on Software Engineering & Trends (SE 2024), April 27 ~ 28, 2024, Copenhagen, Denmark Volume Editors : David C. Wyld, Dhinaharan Nagamalai (Eds) ISBN : 978-1-923107-24-3

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[306] arXiv:2406.04214 [pdf, html, other]

Title: ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models

Yuanyi Ren, Haoran Ye, Hanjun Fang, Xin Zhang, Guojie Song

Comments: Accepted at ACL 2024

Subjects: Computation and Language (cs.CL)

[307] arXiv:2406.04215 [pdf, html, other]

Title: mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans

Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe

Comments: Accepted at Findings of ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[308] arXiv:2406.04216 [pdf, html, other]

Title: What Do Language Models Learn in Context? The Structured Task Hypothesis

Jiaoda Li, Yifan Hou, Mrinmaya Sachan, Ryan Cotterell

Comments: This work is published in ACL 2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[309] arXiv:2406.04218 [pdf, html, other]

Title: Linguistic Steganalysis via LLMs: Two Modes for Efficient Detection of Strongly Concealed Stego

Yifan Tang, Yihao Wang, Ru Zhang, Jianyi Liu

Subjects: Computation and Language (cs.CL)

[310] arXiv:2406.04220 [pdf, html, other]

Title: BEADs: Bias Evaluation Across Domains

Shaina Raza, Mizanur Rahman, Michael R. Zhang

Comments: under review

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[311] arXiv:2406.04233 [pdf, html, other]

Title: FairytaleQA Translated: Enabling Educational Question and Answer Generation in Less-Resourced Languages

Bernardo Leite, Tomás Freitas Osório, Henrique Lopes Cardoso

Comments: Preprint - Accepted for publication at ECTEL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[312] arXiv:2406.04244 [pdf, html, other]

Title: Benchmark Data Contamination of Large Language Models: A Survey

Cheng Xu, Shuhao Guan, Derek Greene, M-Tahar Kechadi

Comments: 31 pages, 7 figures, 3 tables

Subjects: Computation and Language (cs.CL)

[313] arXiv:2406.04267 [pdf, html, other]

Title: Transformers need glasses! Information over-squashing in language tasks

Federico Barbero, Andrea Banino, Steven Kapturowski, Dharshan Kumaran, João G.M. Araújo, Alex Vitvitskyi, Razvan Pascanu, Petar Veličković

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[314] arXiv:2406.04271 [pdf, other]

Title: Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models

Ling Yang, Zhaochen Yu, Tianjun Zhang, Shiyi Cao, Minkai Xu, Wentao Zhang, Joseph E. Gonzalez, Bin Cui

Comments: NeurIPS 2024 Spotlight. Project: this https URL

Subjects: Computation and Language (cs.CL)

[315] arXiv:2406.04278 [pdf, html, other]

Title: Characterizing Similarities and Divergences in Conversational Tones in Humans and LLMs by Sampling with People

Dun-Ming Huang, Pol Van Rijn, Ilia Sucholutsky, Raja Marjieh, Nori Jacoby

Comments: Accepted to Main Conference at ACL 2024

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[316] arXiv:2406.04286 [pdf, html, other]

Title: ABEX: Data Augmentation for Low-Resource NLU via Expanding Abstract Descriptions

Sreyan Ghosh, Utkarsh Tyagi, Sonal Kumar, C. K. Evuru, S Ramaneswaran, S Sakshi, Dinesh Manocha

Comments: ACL 2024 Main Conference. Code and data: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[317] arXiv:2406.04289 [pdf, html, other]

Title: What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages

Nadav Borenstein, Anej Svete, Robin Chan, Josef Valvoda, Franz Nowak, Isabelle Augenstein, Eleanor Chodroff, Ryan Cotterell

Comments: Accepted to ACL 2024

Subjects: Computation and Language (cs.CL)

[318] arXiv:2406.04331 [pdf, html, other]

Title: PaCE: Parsimonious Concept Engineering for Large Language Models

Jinqi Luo, Tianjiao Ding, Kwan Ho Ryan Chan, Darshan Thaker, Aditya Chattopadhyay, Chris Callison-Burch, René Vidal

Comments: Accepted in NeurIPS 2024. GitHub repository at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[319] arXiv:2406.04368 [pdf, html, other]

Title: SocialNLP Fake-EmoReact 2021 Challenge Overview: Predicting Fake Tweets from Their Replies and GIFs

Chien-Kun Huang, Yi-Ting Chang, Lun-Wei Ku, Cheng-Te Li, Hong-Han Shuai

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[320] arXiv:2406.04370 [pdf, html, other]

Title: Large Language Model Confidence Estimation via Black-Box Access

Tejaswini Pedapati, Amit Dhurandhar, Soumya Ghosh, Soham Dan, Prasanna Sattigeri

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[321] arXiv:2406.04371 [pdf, html, other]

Title: Phased Instruction Fine-Tuning for Large Language Models

Wei Pang, Chuan Zhou, Xiao-Hua Zhou, Xiaojie Wang

Comments: The final version, to be appear at ACL 2024 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[322] arXiv:2406.04383 [pdf, html, other]

Title: Exploring the Latest LLMs for Leaderboard Extraction

Salomon Kabongo, Jennifer D'Souza, Sören Auer

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[323] arXiv:2406.04428 [pdf, html, other]

Title: MoralBench: Moral Evaluation of LLMs

Jianchao Ji, Yutong Chen, Mingyu Jin, Wujiang Xu, Wenyue Hua, Yongfeng Zhang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[324] arXiv:2406.04438 [pdf, html, other]

Title: TexIm FAST: Text-to-Image Representation for Semantic Similarity Evaluation using Transformers

Wazib Ansar, Saptarsi Goswami, Amlan Chakrabarti

Comments: 19 pages, 33 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[325] arXiv:2406.04449 [pdf, other]

Title: MAIRA-2: Grounded Radiology Report Generation

Shruthi Bannur, Kenza Bouzid, Daniel C. Castro, Anton Schwaighofer, Anja Thieme, Sam Bond-Taylor, Maximilian Ilse, Fernando Pérez-García, Valentina Salvatelli, Harshita Sharma, Felix Meissen, Mercy Ranjit, Shaury Srivastav, Julia Gong, Noel C. F. Codella, Fabian Falck, Ozan Oktay, Matthew P. Lungren, Maria Teodora Wetscherek, Javier Alvarez-Valle, Stephanie L. Hyland

Comments: 72 pages, 21 figures. v2 updates the model and adds results on the PadChest-GR dataset

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)