Computation and Language

Authors and titles for June 2024

[301] arXiv:2406.04146 [pdf, html, other]

Title: Towards Understanding Task-agnostic Debiasing Through the Lenses of Intrinsic Bias and Forgetfulness

Guangliang Liu, Milad Afshari, Xitong Zhang, Zhiyu Xue, Avrajit Ghosh, Bidhan Bashyal, Rongrong Wang, Kristen Johnson

Subjects: Computation and Language (cs.CL)

[302] arXiv:2406.04156 [pdf, html, other]

Title: Pointer-Guided Pre-Training: Infusing Large Language Models with Paragraph-Level Contextual Awareness

Lars Hillebrand, Prabhupad Pradhan, Christian Bauckhage, Rafet Sifa

Comments: 17 pages, 3 figures, 5 tables, accepted at ECML-PKDD 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[303] arXiv:2406.04175 [pdf, html, other]

Title: Confabulation: The Surprising Value of Large Language Model Hallucinations

Peiqi Sui, Eamon Duede, Sophie Wu, Richard Jean So

Comments: Forthcoming at ACL2024 main conference. 1 figure

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[304] arXiv:2406.04197 [pdf, html, other]

Title: DICE: Detecting In-distribution Contamination in LLM's Fine-tuning Phase for Math Reasoning

Shangqing Tu, Kejian Zhu, Yushi Bai, Zijun Yao, Lei Hou, Juanzi Li

Comments: 13 pages, 7 figures

Subjects: Computation and Language (cs.CL)

[305] arXiv:2406.04202 [pdf, other]

Title: Legal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model

Chun-Hsien Lin, Pu-Jen Cheng

Comments: 12th International Conference on Software Engineering & Trends (SE 2024), April 27 ~ 28, 2024, Copenhagen, Denmark Volume Editors : David C. Wyld, Dhinaharan Nagamalai (Eds) ISBN : 978-1-923107-24-3

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[306] arXiv:2406.04214 [pdf, html, other]

Title: ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models

Yuanyi Ren, Haoran Ye, Hanjun Fang, Xin Zhang, Guojie Song

Comments: Accepted at ACL 2024

Subjects: Computation and Language (cs.CL)

[307] arXiv:2406.04215 [pdf, html, other]

Title: mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans

Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe

Comments: Accepted at Findings of ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[308] arXiv:2406.04216 [pdf, html, other]

Title: What Do Language Models Learn in Context? The Structured Task Hypothesis

Jiaoda Li, Yifan Hou, Mrinmaya Sachan, Ryan Cotterell

Comments: This work is published in ACL 2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[309] arXiv:2406.04218 [pdf, html, other]

Title: Linguistic Steganalysis via LLMs: Two Modes for Efficient Detection of Strongly Concealed Stego

Yifan Tang, Yihao Wang, Ru Zhang, Jianyi Liu

Subjects: Computation and Language (cs.CL)

[310] arXiv:2406.04220 [pdf, html, other]

Title: BEADs: Bias Evaluation Across Domains

Shaina Raza, Mizanur Rahman, Michael R. Zhang

Comments: under review

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[311] arXiv:2406.04233 [pdf, html, other]

Title: FairytaleQA Translated: Enabling Educational Question and Answer Generation in Less-Resourced Languages

Bernardo Leite, Tomás Freitas Osório, Henrique Lopes Cardoso

Comments: Preprint - Accepted for publication at ECTEL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[312] arXiv:2406.04244 [pdf, html, other]

Title: Benchmark Data Contamination of Large Language Models: A Survey

Cheng Xu, Shuhao Guan, Derek Greene, M-Tahar Kechadi

Comments: 31 pages, 7 figures, 3 tables

Subjects: Computation and Language (cs.CL)

[313] arXiv:2406.04267 [pdf, html, other]

Title: Transformers need glasses! Information over-squashing in language tasks

Federico Barbero, Andrea Banino, Steven Kapturowski, Dharshan Kumaran, João G.M. Araújo, Alex Vitvitskyi, Razvan Pascanu, Petar Veličković

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[314] arXiv:2406.04271 [pdf, other]

Title: Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models

Ling Yang, Zhaochen Yu, Tianjun Zhang, Shiyi Cao, Minkai Xu, Wentao Zhang, Joseph E. Gonzalez, Bin Cui

Comments: NeurIPS 2024 Spotlight. Project: this https URL

Subjects: Computation and Language (cs.CL)

[315] arXiv:2406.04278 [pdf, html, other]

Title: Characterizing Similarities and Divergences in Conversational Tones in Humans and LLMs by Sampling with People

Dun-Ming Huang, Pol Van Rijn, Ilia Sucholutsky, Raja Marjieh, Nori Jacoby

Comments: Accepted to Main Conference at ACL 2024

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[316] arXiv:2406.04286 [pdf, html, other]

Title: ABEX: Data Augmentation for Low-Resource NLU via Expanding Abstract Descriptions

Sreyan Ghosh, Utkarsh Tyagi, Sonal Kumar, C. K. Evuru, S Ramaneswaran, S Sakshi, Dinesh Manocha

Comments: ACL 2024 Main Conference. Code and data: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[317] arXiv:2406.04289 [pdf, html, other]

Title: What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages

Nadav Borenstein, Anej Svete, Robin Chan, Josef Valvoda, Franz Nowak, Isabelle Augenstein, Eleanor Chodroff, Ryan Cotterell

Comments: Accepted to ACL 2024

Subjects: Computation and Language (cs.CL)

[318] arXiv:2406.04331 [pdf, html, other]

Title: PaCE: Parsimonious Concept Engineering for Large Language Models

Jinqi Luo, Tianjiao Ding, Kwan Ho Ryan Chan, Darshan Thaker, Aditya Chattopadhyay, Chris Callison-Burch, René Vidal

Comments: 26 pages, 17 figures, 5 tables, dataset and code at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[319] arXiv:2406.04368 [pdf, html, other]

Title: SocialNLP Fake-EmoReact 2021 Challenge Overview: Predicting Fake Tweets from Their Replies and GIFs

Chien-Kun Huang, Yi-Ting Chang, Lun-Wei Ku, Cheng-Te Li, Hong-Han Shuai

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[320] arXiv:2406.04370 [pdf, html, other]

Title: Large Language Model Confidence Estimation via Black-Box Access

Tejaswini Pedapati, Amit Dhurandhar, Soumya Ghosh, Soham Dan, Prasanna Sattigeri

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[321] arXiv:2406.04371 [pdf, html, other]

Title: Phased Instruction Fine-Tuning for Large Language Models

Wei Pang, Chuan Zhou, Xiao-Hua Zhou, Xiaojie Wang

Comments: The final version, to be appear at ACL 2024 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[322] arXiv:2406.04383 [pdf, html, other]

Title: Exploring the Latest LLMs for Leaderboard Extraction

Salomon Kabongo, Jennifer D'Souza, Sören Auer

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[323] arXiv:2406.04428 [pdf, html, other]

Title: MoralBench: Moral Evaluation of LLMs

Jianchao Ji, Yutong Chen, Mingyu Jin, Wujiang Xu, Wenyue Hua, Yongfeng Zhang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[324] arXiv:2406.04438 [pdf, html, other]

Title: TexIm FAST: Text-to-Image Representation for Semantic Similarity Evaluation using Transformers

Wazib Ansar, Saptarsi Goswami, Amlan Chakrabarti

Comments: 19 pages, 33 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[325] arXiv:2406.04449 [pdf, other]

Title: MAIRA-2: Grounded Radiology Report Generation

Shruthi Bannur, Kenza Bouzid, Daniel C. Castro, Anton Schwaighofer, Anja Thieme, Sam Bond-Taylor, Maximilian Ilse, Fernando Pérez-García, Valentina Salvatelli, Harshita Sharma, Felix Meissen, Mercy Ranjit, Shaury Srivastav, Julia Gong, Noel C. F. Codella, Fabian Falck, Ozan Oktay, Matthew P. Lungren, Maria Teodora Wetscherek, Javier Alvarez-Valle, Stephanie L. Hyland

Comments: 72 pages, 21 figures. v2 updates the model and adds results on the PadChest-GR dataset

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[326] arXiv:2406.04460 [pdf, html, other]

Title: Evaluating the Smooth Control of Attribute Intensity in Text Generation with LLMs

Shang Zhou, Feng Yao, Chengyu Dong, Zihan Wang, Jingbo Shang

Comments: Accepted to ACL 2024 Findings

Subjects: Computation and Language (cs.CL)

[327] arXiv:2406.04461 [pdf, html, other]

Title: Multi-Label Classification for Implicit Discourse Relation Recognition

Wanqiu Long, N. Siddharth, Bonnie Webber

Comments: ACL2024 Finding

Subjects: Computation and Language (cs.CL)

[328] arXiv:2406.04478 [pdf, html, other]

Title: PromptFix: Few-shot Backdoor Removal via Adversarial Prompt Tuning

Tianrong Zhang, Zhaohan Xi, Ting Wang, Prasenjit Mitra, Jinghui Chen

Comments: NAACL 2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[329] arXiv:2406.04482 [pdf, html, other]

Title: Automatic Bug Detection in LLM-Powered Text-Based Games Using LLMs

Claire Jin, Sudha Rao, Xiangyu Peng, Portia Botchway, Jessica Quaye, Chris Brockett, Bill Dolan

Comments: Accepted for publication in Findings of the Association for Computational Linguistics: ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Software Engineering (cs.SE)

[330] arXiv:2406.04496 [pdf, html, other]

Title: Time Sensitive Knowledge Editing through Efficient Finetuning

Xiou Ge, Ali Mousavi, Edouard Grave, Armand Joulin, Kun Qian, Benjamin Han, Mostafa Arefiyan, Yunyao Li

Comments: ACL 2024 main

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[331] arXiv:2406.04512 [pdf, html, other]

Title: To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation

Abdul Waheed, Karima Kadaoui, Muhammad Abdul-Mageed

Comments: Accepted at ACL'24 main

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[332] arXiv:2406.04520 [pdf, html, other]

Title: NATURAL PLAN: Benchmarking LLMs on Natural Language Planning

Huaixiu Steven Zheng, Swaroop Mishra, Hugh Zhang, Xinyun Chen, Minmin Chen, Azade Nova, Le Hou, Heng-Tze Cheng, Quoc V. Le, Ed H. Chi, Denny Zhou

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[333] arXiv:2406.04523 [pdf, html, other]

Title: Proofread: Fixes All Errors with One Tap

Renjie Liu, Yanxiang Zhang, Yun Zhu, Haicheng Sun, Yuanbo Zhang, Michael Xuelin Huang, Shanqing Cai, Lei Meng, Shumin Zhai

Comments: 8 pages, 3 figures, 2 tables

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[334] arXiv:2406.04528 [pdf, html, other]

Title: llmNER: (Zero|Few)-Shot Named Entity Recognition, Exploiting the Power of Large Language Models

Fabián Villena, Luis Miranda, Claudio Aracena

Subjects: Computation and Language (cs.CL)

[335] arXiv:2406.04541 [pdf, html, other]

Title: Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translation

Keqi Deng, Philip C. Woodland

Comments: Accepted by ACL 2024 Main Conference

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[336] arXiv:2406.04555 [pdf, html, other]

Title: Creating an AI Observer: Generative Semantic Workspaces

Pavan Holur, Shreyas Rajesh, David Chong, Vwani Roychowdhury

Comments: 37 pages with appendix, 28 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[337] arXiv:2406.04566 [pdf, html, other]

Title: SpaRC and SpaRP: Spatial Reasoning Characterization and Path Generation for Understanding Spatial Reasoning Capability of Large Language Models

Md Imbesat Hassan Rizvi, Xiaodan Zhu, Iryna Gurevych

Comments: Accepted at ACL 2024 (Main)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[338] arXiv:2406.04578 [pdf, html, other]

Title: SC2: Towards Enhancing Content Preservation and Style Consistency in Long Text Style Transfer

Jie Zhao, Ziyu Guan, Cai Xu, Wei Zhao, Yue Jiang

Subjects: Computation and Language (cs.CL)

[339] arXiv:2406.04583 [pdf, html, other]

Title: Extroversion or Introversion? Controlling The Personality of Your Large Language Models

Yanquan Chen, Zhen Wu, Junjie Guo, Shujian Huang, Xinyu Dai

Subjects: Computation and Language (cs.CL)

[340] arXiv:2406.04604 [pdf, html, other]

Title: Learning Task Decomposition to Assist Humans in Competitive Programming

Jiaxin Wen, Ruiqi Zhong, Pei Ke, Zhihong Shao, Hongning Wang, Minlie Huang

Comments: ACL 2024 Main Conference

Subjects: Computation and Language (cs.CL); Programming Languages (cs.PL)

[341] arXiv:2406.04614 [pdf, html, other]

Title: LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Model

Zhi Zhou, Jiang-Xin Shi, Peng-Xiao Song, Xiao-Wen Yang, Yi-Xuan Jin, Lan-Zhe Guo, Yu-Feng Li

Comments: Technical Report

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[342] arXiv:2406.04625 [pdf, html, other]

Title: Key-Element-Informed sLLM Tuning for Document Summarization

Sangwon Ryu, Heejin Do, Yunsu Kim, Gary Geunbae Lee, Jungseul Ok

Comments: Interspeech 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[343] arXiv:2406.04630 [pdf, html, other]

Title: Low-Resource Cross-Lingual Summarization through Few-Shot Learning with Large Language Models

Gyutae Park, Seojin Hwang, Hwanhee Lee

Comments: 7 pages,3 figures

Subjects: Computation and Language (cs.CL)

[344] arXiv:2406.04638 [pdf, html, other]

Title: Large Language Model-guided Document Selection

Xiang Kong, Tom Gunter, Ruoming Pang

Comments: 9 pages

Subjects: Computation and Language (cs.CL)

[345] arXiv:2406.04643 [pdf, html, other]

Title: More Victories, Less Cooperation: Assessing Cicero's Diplomacy Play

Wichayaporn Wongkamjan, Feng Gu, Yanze Wang, Ulf Hermjakob, Jonathan May, Brandon M. Stewart, Jonathan K. Kummerfeld, Denis Peskoff, Jordan Lee Boyd-Graber

Subjects: Computation and Language (cs.CL)

[346] arXiv:2406.04669 [pdf, html, other]

Title: DiNeR: a Large Realistic Dataset for Evaluating Compositional Generalization

Chengang Hu, Xiao Liu, Yansong Feng

Comments: EMNLP 2023 long paper

Subjects: Computation and Language (cs.CL)

[347] arXiv:2406.04670 [pdf, html, other]

Title: MATTER: Memory-Augmented Transformer Using Heterogeneous Knowledge Sources

Dongkyu Lee, Chandana Satya Prakash, Jack FitzGerald, Jens Lehmann

Comments: ACL2024-Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[348] arXiv:2406.04692 [pdf, html, other]

Title: Mixture-of-Agents Enhances Large Language Model Capabilities

Junlin Wang, Jue Wang, Ben Athiwaratkun, Ce Zhang, James Zou

Subjects: Computation and Language (cs.CL)

[349] arXiv:2406.04712 [pdf, html, other]

Title: AICoderEval: Improving AI Domain Code Generation of Large Language Models

Yinghui Xia, Yuyan Chen, Tianyu Shi, Jun Wang, Jinsong Yang

Subjects: Computation and Language (cs.CL)

[350] arXiv:2406.04744 [pdf, html, other]

Title: CRAG -- Comprehensive RAG Benchmark

Xiao Yang, Kai Sun, Hao Xin, Yushi Sun, Nikita Bhalla, Xiangsen Chen, Sajal Choudhary, Rongze Daniel Gui, Ziran Will Jiang, Ziyu Jiang, Lingkun Kong, Brian Moran, Jiaqi Wang, Yifan Ethan Xu, An Yan, Chenyu Yang, Eting Yuan, Hanwen Zha, Nan Tang, Lei Chen, Nicolas Scheffer, Yue Liu, Nirav Shah, Rakesh Wanga, Anuj Kumar, Wen-tau Yih, Xin Luna Dong

Subjects: Computation and Language (cs.CL)

[351] arXiv:2406.04752 [pdf, html, other]

Title: CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language Models

Ling Shi, Deyi Xiong

Comments: 28 pages, 5 figures

Subjects: Computation and Language (cs.CL)

[352] arXiv:2406.04758 [pdf, html, other]

Title: Think out Loud: Emotion Deducing Explanation in Dialogues

Jiangnan Li, Zheng Lin, Lanrui Wang, Qingyi Si, Yanan Cao, Mo Yu, Peng Fu, Weiping Wang, Jie Zhou

Subjects: Computation and Language (cs.CL)

[353] arXiv:2406.04770 [pdf, html, other]

Title: WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild

Bill Yuchen Lin, Yuntian Deng, Khyathi Chandu, Faeze Brahman, Abhilasha Ravichander, Valentina Pyatkin, Nouha Dziri, Ronan Le Bras, Yejin Choi

Comments: Link: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[354] arXiv:2406.04784 [pdf, other]

Title: SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals

Ruihan Yang, Jiangjie Chen, Yikai Zhang, Siyu Yuan, Aili Chen, Kyle Richardson, Yanghua Xiao, Deqing Yang

Comments: Preprint

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[355] arXiv:2406.04823 [pdf, html, other]

Title: BERTs are Generative In-Context Learners

David Samuel

Comments: 26 pages, NeurIPS 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[356] arXiv:2406.04834 [pdf, html, other]

Title: Annotating FrameNet via Structure-Conditioned Language Generation

Xinyue Cui, Swabha Swayamdipta

Comments: This paper has been accepted to ACL 2024

Subjects: Computation and Language (cs.CL)

[357] arXiv:2406.04836 [pdf, html, other]

Title: Revisiting Catastrophic Forgetting in Large Language Model Tuning

Hongyu Li, Liang Ding, Meng Fang, Dacheng Tao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[358] arXiv:2406.04845 [pdf, html, other]

Title: FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models

Rui Ye, Rui Ge, Xinyu Zhu, Jingyi Chai, Yaxin Du, Yang Liu, Yanfeng Wang, Siheng Chen

Comments: 22 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Multiagent Systems (cs.MA)

[359] arXiv:2406.04847 [pdf, html, other]

Title: Do Language Models Exhibit Human-like Structural Priming Effects?

Jaap Jumelet, Willem Zuidema, Arabella Sinclair

Comments: ACL Findings 2024

Subjects: Computation and Language (cs.CL)

[360] arXiv:2406.04854 [pdf, html, other]

Title: Uncertainty Aware Learning for Language Model Alignment

Yikun Wang, Rui Zheng, Liang Ding, Qi Zhang, Dahua Lin, Dacheng Tao

Comments: ACL 2024

Subjects: Computation and Language (cs.CL)

[361] arXiv:2406.04855 [pdf, html, other]

Title: The Russian Legislative Corpus

Denis Saveliev, Ruslan Kuchakov

Comments: 6 pages, 2 figures, 2 tables

Subjects: Computation and Language (cs.CL)

[362] arXiv:2406.04866 [pdf, html, other]

Title: ComplexTempQA: A Large-Scale Dataset for Complex Temporal Question Answering

Raphael Gruber, Abdelrahman Abdallah, Michael Färber, Adam Jatowt

Subjects: Computation and Language (cs.CL)

[363] arXiv:2406.04876 [pdf, html, other]

Title: HateDebias: On the Diversity and Variability of Hate Speech Debiasing

Nankai Lin, Hongyan Wu, Zhengming Chen, Zijian Li, Lianxi Wang, Shengyi Jiang, Dong Zhou, Aimin Yang

Subjects: Computation and Language (cs.CL)

[364] arXiv:2406.04879 [pdf, html, other]

Title: A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques

Megh Thakkar, Quentin Fournier, Matthew D Riemer, Pin-Yu Chen, Amal Zouaq, Payel Das, Sarath Chandar

Comments: Accepted to ACL (Main) 2024

Subjects: Computation and Language (cs.CL)

[365] arXiv:2406.04892 [pdf, html, other]

Title: Sexism Detection on a Data Diet

Rabiraj Bandyopadhyay, Dennis Assenmacher, Jose M.Alonso Moral, Claudia Wagner

Comments: Accepted at ACM WebSci 2024 Workshop in DHOW: Diffusion of Harmful Content on Online Web Workshop

Subjects: Computation and Language (cs.CL)

[366] arXiv:2406.04926 [pdf, html, other]

Title: Through the Thicket: A Study of Number-Oriented LLMs derived from Random Forest Models

Michał Romaszewski, Przemysław Sekuła, Przemysław Głomb, Michał Cholewa, Katarzyna Kołodziej

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[367] arXiv:2406.04941 [pdf, html, other]

Title: TCMD: A Traditional Chinese Medicine QA Dataset for Evaluating Large Language Models

Ping Yu, Kaitao Song, Fengchen He, Ming Chen, Jianfeng Lu

Subjects: Computation and Language (cs.CL)

[368] arXiv:2406.04947 [pdf, html, other]

Title: BAMO at SemEval-2024 Task 9: BRAINTEASER: A Novel Task Defying Common Sense

Baktash Ansari, Mohammadmostafa Rostamkhani, Sauleh Eetemadi

Comments: 9 pages, 8 tables, 5 figures

Subjects: Computation and Language (cs.CL)

[369] arXiv:2406.04952 [pdf, html, other]

Title: Quantifying Geospatial in the Common Crawl Corpus

Ilya Ilyankou, Meihui Wang, Stefano Cavazzi, James Haworth

Comments: Accepted as a poster to ACM SIGSPATIAL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[370] arXiv:2406.04984 [pdf, html, other]

Title: MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter

Jitai Hao, WeiWei Sun, Xin Xin, Qi Meng, Zhumin Chen, Pengjie Ren, Zhaochun Ren

Comments: ACL 24

Subjects: Computation and Language (cs.CL)

[371] arXiv:2406.04988 [pdf, html, other]

Title: Language models emulate certain cognitive profiles: An investigation of how predictability measures interact with individual differences

Patrick Haller, Lena S. Bolliger, Lena A. Jäger

Comments: ACL 2024 Findings

Subjects: Computation and Language (cs.CL)

[372] arXiv:2406.04989 [pdf, html, other]

Title: Compositional Generalization with Grounded Language Models

Sondre Wold, Étienne Simon, Lucas Georges Gabriel Charpentier, Egor V. Kostylev, Erik Velldal, Lilja Øvrelid

Comments: ACL 2024, Findings

Subjects: Computation and Language (cs.CL)

[373] arXiv:2406.05035 [pdf, html, other]

Title: Scenarios and Approaches for Situated Natural Language Explanations

Pengshuo Qiu, Frank Rudzicz, Zining Zhu

Comments: 8 pages, 4 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[374] arXiv:2406.05063 [pdf, html, other]

Title: Are Large Language Models More Empathetic than Humans?

Anuradha Welivita, Pearl Pu

Comments: 9 pages, 3 figures. arXiv admin note: text overlap with arXiv:2403.05572

Subjects: Computation and Language (cs.CL)

[375] arXiv:2406.05079 [pdf, html, other]

Title: SUMIE: A Synthetic Benchmark for Incremental Entity Summarization

Eunjeong Hwang, Yichao Zhou, Beliz Gunel, James Bradley Wendt, Sandeep Tata

Comments: 24 figures, 4 tables

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[376] arXiv:2406.05085 [pdf, html, other]

Title: Multi-Head RAG: Solving Multi-Aspect Problems with LLMs

Maciej Besta, Ales Kubicek, Roman Niggli, Robert Gerstenberger, Lucas Weitzendorf, Mingyuan Chi, Patrick Iff, Joanna Gajda, Piotr Nyczyk, Jürgen Müller, Hubert Niewiadomski, Marcin Chrapek, Michał Podstawski, Torsten Hoefler

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[377] arXiv:2406.05130 [pdf, html, other]

Title: An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models

Xiongtao Zhou, Jie He, Yuhua Ke, Guangyao Zhu, Víctor Gutiérrez-Basulto, Jeff Z. Pan

Comments: ACL finding 2024

Subjects: Computation and Language (cs.CL)

[378] arXiv:2406.05186 [pdf, html, other]

Title: Correlation Does Not Imply Compensation: Complexity and Irregularity in the Lexicon

Amanda Doucette, Ryan Cotterell, Morgan Sonderegger, Timothy J. O'Donnell

Comments: To appear in Proceedings of the Society for Computation in Linguistics 2024

Subjects: Computation and Language (cs.CL)

[379] arXiv:2406.05194 [pdf, html, other]

Title: LLMs Are Not Intelligent Thinkers: Introducing Mathematical Topic Tree Benchmark for Comprehensive Evaluation of LLMs

Arash Gholami Davoodi, Seyed Pouyan Mousavi Davoudi, Pouya Pezeshkpour

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[380] arXiv:2406.05213 [pdf, html, other]

Title: On Subjective Uncertainty Quantification and Calibration in Natural Language Generation

Ziyu Wang, Chris Holmes

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[381] arXiv:2406.05232 [pdf, html, other]

Title: DALD: Improving Logits-based Detector without Logits from Black-box LLMs

Cong Zeng, Shengkun Tang, Xianjun Yang, Yuanzhou Chen, Yiyou Sun, zhiqiang xu, Yao Li, Haifeng Chen, Wei Cheng, Dongkuan Xu

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[382] arXiv:2406.05255 [pdf, html, other]

Title: Generative Explore-Exploit: Training-free Optimization of Generative Recommender Systems using LLM Optimizers

Lütfi Kerem Senel, Besnik Fetahu, Davis Yoshida, Zhiyu Chen, Giuseppe Castellucci, Nikhita Vedula, Jason Choi, Shervin Malmasi

Comments: Accepted at ACL 2024 Main Proceedings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[383] arXiv:2406.05265 [pdf, html, other]

Title: TLEX: An Efficient Method for Extracting Exact Timelines from TimeML Temporal Graphs

Mustafa Ocal, Ning Xie, Mark Finlayson

Comments: 25 pages, 9 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[384] arXiv:2406.05274 [pdf, html, other]

Title: Behavior Structformer: Learning Players Representations with Structured Tokenization

Oleg Smirnov, Labinot Polisi

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[385] arXiv:2406.05279 [pdf, html, other]

Title: SuperPos-Prompt: Enhancing Soft Prompt Tuning of Language Models with Superposition of Multi Token Embeddings

MohammadAli SadraeiJavaeri, Ehsaneddin Asgari, Alice Carolyn McHardy, Hamid Reza Rabiee

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[386] arXiv:2406.05307 [pdf, html, other]

Title: DeviceBERT: Applied Transfer Learning With Targeted Annotations and Vocabulary Enrichment to Identify Medical Device and Component Terminology in FDA Recall Summaries

Miriam Farrington

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[387] arXiv:2406.05315 [pdf, html, other]

Title: Concept Formation and Alignment in Language Models: Bridging Statistical Patterns in Latent Space to Concept Taxonomy

Mehrdad Khatir, Chandan K. Reddy

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[388] arXiv:2406.05322 [pdf, html, other]

Title: Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios

Yuhang Zhou, Wei Ai

Comments: Accepted by ACL 2024 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[389] arXiv:2406.05326 [pdf, html, other]

Title: Advancing Semantic Textual Similarity Modeling: A Regression Framework with Translated ReLU and Smooth K2 Loss

Bowen Zhang, Chunping Li

Comments: Accepted by EMNLP 2024 (Main)

Subjects: Computation and Language (cs.CL)

[390] arXiv:2406.05328 [pdf, html, other]

Title: FacLens: Transferable Probe for Foreseeing Non-Factuality in Large Language Models

Yanling Wang, Haoyang Li, Hao Zou, Jing Zhang, Xinlei He, Qi Li, Ke Xu

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[391] arXiv:2406.05344 [pdf, html, other]

Title: MemeGuard: An LLM and VLM-based Framework for Advancing Content Moderation via Meme Intervention

Prince Jha, Raghav Jain, Konika Mandal, Aman Chadha, Sriparna Saha, Pushpak Bhattacharyya

Subjects: Computation and Language (cs.CL)

[392] arXiv:2406.05348 [pdf, html, other]

Title: Toward Reliable Ad-hoc Scientific Information Extraction: A Case Study on Two Materials Datasets

Satanu Ghosh, Neal R. Brodnik, Carolina Frey, Collin Holgate, Tresa M. Pollock, Samantha Daly, Samuel Carton

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[393] arXiv:2406.05360 [pdf, html, other]

Title: Flexible and Adaptable Summarization via Expertise Separation

Xiuying Chen, Mingzhe Li, Shen Gao, Xin Cheng, Qingqing Zhu, Rui Yan, Xin Gao, Xiangliang Zhang

Comments: 10 pages, 7 figures, published in SIGIR 2024

Subjects: Computation and Language (cs.CL)

[394] arXiv:2406.05361 [pdf, html, other]

Title: Write Summary Step-by-Step: A Pilot Study of Stepwise Summarization

Xiuying Chen, Shen Gao, Mingzhe Li, Qingqing Zhu, Xin Gao, Xiangliang Zhang

Comments: 10 pages, 4 figures, published in TASLP

Subjects: Computation and Language (cs.CL)

[395] arXiv:2406.05365 [pdf, html, other]

Title: CaLM: Contrasting Large and Small Language Models to Verify Grounded Generation

I-Hung Hsu, Zifeng Wang, Long T. Le, Lesly Miculicich, Nanyun Peng, Chen-Yu Lee, Tomas Pfister

Comments: ACL 2024 Camera Ready Version

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[396] arXiv:2406.05369 [pdf, html, other]

Title: Venn Diagram Prompting : Accelerating Comprehension with Scaffolding Effect

Sakshi Mahendru, Tejul Pandit

Comments: Preprint. 10 pages, Accepted in 2024 the 6th World Symposium on Artificial Intelligence (WSAI 2024)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[397] arXiv:2406.05370 [pdf, html, other]

Title: VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers

Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei

Comments: Demo posted

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[398] arXiv:2406.05374 [pdf, html, other]

Title: Planning Like Human: A Dual-process Framework for Dialogue Planning

Tao He, Lizi Liao, Yixin Cao, Yuanxing Liu, Ming Liu, Zerui Chen, Bing Qin

Comments: 24 pages, 5 figures, ACL 2024 main conference

Subjects: Computation and Language (cs.CL)

[399] arXiv:2406.05392 [pdf, html, other]

Title: Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey

Chengyuan Deng, Yiqun Duan, Xin Jin, Heng Chang, Yijun Tian, Han Liu, Yichen Wang, Kuofeng Gao, Henry Peng Zou, Yiqiao Jin, Yijia Xiao, Shenghao Wu, Zongxing Xie, Weimin Lyu, Sihong He, Lu Cheng, Haohan Wang, Jun Zhuang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)

[400] arXiv:2406.05424 [pdf, html, other]

Title: Recent advancements in computational morphology : A comprehensive survey

Jatayu Baxi, Brijesh Bhatt

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)