Computation and Language

Authors and titles for March 2024

[1171] arXiv:2403.19754 [pdf, html, other]

Title: GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation

Mohsen Gholami, Mohammad Akbari, Cindy Hu, Vaden Masrani, Z. Jane Wang, Yong Zhang

Subjects: Computation and Language (cs.CL)

[1172] arXiv:2403.19802 [pdf, html, other]

Title: Developing Healthcare Language Model Embedding Spaces

Niall Taylor, Dan Schofield, Andrey Kormilitzin, Dan W Joyce, Alejo Nevado-Holgado

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1173] arXiv:2403.19822 [pdf, html, other]

Title: Multi-Stage Multi-Modal Pre-Training for Automatic Speech Recognition

Yash Jain, David Chan, Pranav Dheram, Aparna Khare, Olabanji Shonibare, Venkatesh Ravichandran, Shalini Ghosh

Comments: Accepted in LREC-COLING 2024 - The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1174] arXiv:2403.19827 [pdf, html, other]

Title: Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs

Kanishka Misra, Kyle Mahowald

Comments: Updated version

Subjects: Computation and Language (cs.CL)

[1175] arXiv:2403.19836 [pdf, html, other]

Title: Target Span Detection for Implicit Harmful Content

Nazanin Jafari, James Allan, Sheikh Muhammad Sarwar

Subjects: Computation and Language (cs.CL)

[1176] arXiv:2403.19851 [pdf, html, other]

Title: Localizing Paragraph Memorization in Language Models

Niklas Stoehr, Mitchell Gordon, Chiyuan Zhang, Owen Lewis

Subjects: Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[1177] arXiv:2403.19887 [pdf, html, other]

Title: Jamba: A Hybrid Transformer-Mamba Language Model

Opher Lieber, Barak Lenz, Hofit Bata, Gal Cohen, Jhonathan Osin, Itay Dalmedigos, Erez Safahi, Shaked Meirom, Yonatan Belinkov, Shai Shalev-Shwartz, Omri Abend, Raz Alon, Tomer Asida, Amir Bergman, Roman Glozman, Michael Gokhman, Avashalom Manevich, Nir Ratner, Noam Rozen, Erez Shwartz, Mor Zusman, Yoav Shoham

Comments: Webpage: this https URL

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1178] arXiv:2403.19889 [pdf, html, other]

Title: Towards a Robust Retrieval-Based Summarization System

Shengjie Liu, Jing Wu, Jingyuan Bao, Wenyi Wang, Naira Hovakimyan, Christopher G Healey

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1179] arXiv:2403.19913 [pdf, html, other]

Title: MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of Large Language Models

Peng Ding, Jiading Fang, Peng Li, Kangrui Wang, Xiaochen Zhou, Mo Yu, Jing Li, Matthew R. Walter, Hongyuan Mei

Comments: COLM 2024 camera-ready

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO)

[1180] arXiv:2403.19928 [pdf, html, other]

Title: DiJiang: Efficient Large Language Models through Compact Kernelization

Hanting Chen, Zhicheng Liu, Xutao Wang, Yuchuan Tian, Yunhe Wang

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1181] arXiv:2403.19930 [pdf, html, other]

Title: Are LLMs Effective Backbones for Fine-tuning? An Experimental Investigation of Supervised LLMs on Chinese Short Text Matching

Shulin Liu, Chengcheng Xu, Hao Liu, Tinghao Yu, Tao Yang

Subjects: Computation and Language (cs.CL)

[1182] arXiv:2403.19936 [pdf, html, other]

Title: SLFNet: Generating Semantic Logic Forms from Natural Language Using Semantic Probability Graphs

Hao Wu, Fan Xu

Subjects: Computation and Language (cs.CL)

[1183] arXiv:2403.19962 [pdf, html, other]

Title: Enhancing the General Agent Capabilities of Low-Parameter LLMs through Tuning and Multi-Branch Reasoning

Qinhao Zhou, Zihan Zhang, Xiang Xiang, Ke Wang, Yuchuan Wu, Yongbin Li

Comments: To appear at NAACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1184] arXiv:2403.20005 [pdf, html, other]

Title: Large Language Model based Situational Dialogues for Second Language Learning

Shuyao Xu, Long Qin, Tianyang Chen, Zhenzhou Zha, Bingxue Qiu, Weizhi Wang

Comments: 14 pages, 6 figures

Subjects: Computation and Language (cs.CL)

[1185] arXiv:2403.20009 [pdf, html, other]

Title: On Large Language Models' Hallucination with Regard to Known Facts

Che Jiang, Biqing Qi, Xiangyu Hong, Dayuan Fu, Yang Cheng, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou

Comments: Accepted by NAACL 2024 MainConference

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1186] arXiv:2403.20015 [pdf, html, other]

Title: Adverb Is the Key: Simple Text Data Augmentation with Adverb Deletion

Juhwan Choi, YoungBin Kim

Comments: ICLR 2024 Tiny Papers

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1187] arXiv:2403.20041 [pdf, other]

Title: Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs

Luchang Li, Sheng Qian, Jie Lu, Lunxi Yuan, Rui Wang, Qin Xie

Comments: 21 pages, 6 figures, fix "E0M4" spell mistake, fix FLOPS to TFLOPS

Subjects: Computation and Language (cs.CL)

[1188] arXiv:2403.20046 [pdf, html, other]

Title: Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for Reasoning

Yongqi Tong, Dawei Li, Sizhe Wang, Yujia Wang, Fei Teng, Jingbo Shang

Comments: The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) - Main Conference

Subjects: Computation and Language (cs.CL)

[1189] arXiv:2403.20056 [pdf, html, other]

Title: Cross-Lingual Transfer Robustness to Lower-Resource Languages on Adversarial Datasets

Shadi Manafi, Nikhil Krishnaswamy

Comments: accepted in LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[1190] arXiv:2403.20084 [pdf, other]

Title: IPA Transcription of Bengali Texts

Kanij Fatema, Fazle Dawood Haider, Nirzona Ferdousi Turpa, Tanveer Azmal, Sourav Ahmed, Navid Hasan, Mohammad Akhlaqur Rahman, Biplab Kumar Sarkar, Afrar Jahin, Md. Rezuwan Hassan, Md Foriduzzaman Zihad, Rubayet Sabbir Faruque, Asif Sushmit, Mashrur Imtiaz, Farig Sadeque, Syed Shahrier Rahman

Subjects: Computation and Language (cs.CL)

[1191] arXiv:2403.20088 [pdf, html, other]

Title: An Efficient Approach for Studying Cross-Lingual Transfer in Multilingual Language Models

Fahim Faisal, Antonios Anastasopoulos

Subjects: Computation and Language (cs.CL)

[1192] arXiv:2403.20101 [pdf, html, other]

Title: RealKIE: Five Novel Datasets for Enterprise Key Information Extraction

Benjamin Townsend, Madison May, Christopher Wells

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1193] arXiv:2403.20103 [pdf, html, other]

Title: NLP for Counterspeech against Hate: A Survey and How-To Guide

Helena Bonaldi, Yi-Ling Chung, Gavin Abercrombie, Marco Guerini

Comments: To appear in Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics (findings)

Subjects: Computation and Language (cs.CL)

[1194] arXiv:2403.20134 [pdf, html, other]

Title: User Modeling Challenges in Interactive AI Assistant Systems

Megan Su, Yuwei Bao

Subjects: Computation and Language (cs.CL)

[1195] arXiv:2403.20145 [pdf, html, other]

Title: Fine-tuning Large Language Models for Automated Diagnostic Screening Summaries

Manjeet Yadav, Nilesh Kumar Sahu, Mudita Chaturvedi, Snehil Gupta, Haroon R Lone

Subjects: Computation and Language (cs.CL)

[1196] arXiv:2403.20147 [pdf, html, other]

Title: IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Context

Nihar Ranjan Sahoo, Pranamya Prashant Kulkarni, Narjis Asad, Arif Ahmad, Tanu Goyal, Aparna Garimella, Pushpak Bhattacharyya

Subjects: Computation and Language (cs.CL)

[1197] arXiv:2403.20157 [pdf, html, other]

Title: A Systematic Analysis of Subwords and Cross-Lingual Transfer in Multilingual Translation

Francois Meyer, Jan Buys

Subjects: Computation and Language (cs.CL)

[1198] arXiv:2403.20158 [pdf, other]

Title: ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Models

Zehao Wen, Rabih Younes

Comments: 9 pages, 1 figure, published on Applied and Computational Engineering

Journal-ref: ACE (2023) Vol. 21: 249-257.

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1199] arXiv:2403.20180 [pdf, html, other]

Title: Measuring Taiwanese Mandarin Language Understanding

Po-Heng Chen, Sijia Cheng, Wei-Lin Chen, Yen-Ting Lin, Yun-Nung Chen

Comments: Preprint. Under review

Subjects: Computation and Language (cs.CL)

[1200] arXiv:2403.20196 [pdf, html, other]

Title: Automatic Alignment of Discourse Relations of Different Discourse Annotation Frameworks

Yingxue Fu

Subjects: Computation and Language (cs.CL)

[1201] arXiv:2403.20215 [pdf, html, other]

Title: Advancing the Arabic WordNet: Elevating Content Quality

Abed Alhakim Freihat, Hadi Khalilia, Gábor Bella, Fausto Giunchiglia

Subjects: Computation and Language (cs.CL)

[1202] arXiv:2403.20252 [pdf, html, other]

Title: Using LLMs to Model the Beliefs and Preferences of Targeted Populations

Keiichi Namikoshi, Alex Filipowicz, David A. Shamma, Rumen Iliev, Candice L. Hogan, Nikos Arechiga

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1203] arXiv:2403.20262 [pdf, html, other]

Title: ELITR-Bench: A Meeting Assistant Benchmark for Long-Context Language Models

Thibaut Thonet, Jos Rozen, Laurent Besacier

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1204] arXiv:2403.20266 [pdf, other]

Title: Latxa: An Open Language Model and Evaluation Suite for Basque

Julen Etxaniz, Oscar Sainz, Naiara Perez, Itziar Aldabe, German Rigau, Eneko Agirre, Aitor Ormazabal, Mikel Artetxe, Aitor Soroa

Comments: ACL 2024

Journal-ref: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14952--14972. 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1205] arXiv:2403.20279 [pdf, html, other]

Title: LUQ: Long-text Uncertainty Quantification for LLMs

Caiqi Zhang, Fangyu Liu, Marco Basaldella, Nigel Collier

Comments: EMNLP 2024 Main

Subjects: Computation and Language (cs.CL)

[1206] arXiv:2403.20284 [pdf, html, other]

Title: LayerNorm: A key component in parameter-efficient fine-tuning

Taha ValizadehAslani, Hualou Liang

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1207] arXiv:2403.20288 [pdf, html, other]

Title: Can LLMs Correct Physicians, Yet? Investigating Effective Interaction Methods in the Medical Domain

Burcu Sayin, Pasquale Minervini, Jacopo Staiano, Andrea Passerini

Comments: Accepted for oral presentation at NAACL 2024, The 6th Clinical Natural Language Processing Workshop

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1208] arXiv:2403.20289 [pdf, html, other]

Title: Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation

Fangxu Yu, Junjie Guo, Zhen Wu, Xinyu Dai

Comments: Accepted by Findings of NAACL 2024

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1209] arXiv:2403.20308 [pdf, html, other]

Title: ChainNet: Structured Metaphor and Metonymy in WordNet

Rowan Hall Maudslay, Simone Teufel, Francis Bond, James Pustejovsky

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1210] arXiv:2403.20322 [pdf, html, other]

Title: Towards a Framework for Evaluating Explanations in Automated Fact Verification

Neema Kotonya, Francesca Toni

Comments: Accepted at LREC-COLING 2024; Updated Author Affiliation

Subjects: Computation and Language (cs.CL)

[1211] arXiv:2403.20327 [pdf, html, other]

Title: Gecko: Versatile Text Embeddings Distilled from Large Language Models

Jinhyuk Lee, Zhuyun Dai, Xiaoqi Ren, Blair Chen, Daniel Cer, Jeremy R. Cole, Kai Hui, Michael Boratko, Rajvi Kapadia, Wen Ding, Yi Luan, Sai Meher Karthik Duddu, Gustavo Hernandez Abrego, Weiqiang Shi, Nithi Gupta, Aditya Kusupati, Prateek Jain, Siddhartha Reddy Jonnalagadda, Ming-Wei Chang, Iftekhar Naim

Comments: 18 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1212] arXiv:2403.20329 [pdf, html, other]

Title: ReALM: Reference Resolution As Language Modeling

Joel Ruben Antony Moniz, Soundarya Krishnan, Melis Ozyildirim, Prathamesh Saraf, Halim Cagri Ates, Yuan Zhang, Hong Yu

Comments: Accepted at SIGDIAL 2024 (Oral presentation)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1213] arXiv:2403.00037 (cross-list from cs.SI) [pdf, html, other]

Title: Evolving to the Future: Unseen Event Adaptive Fake News Detection on Social Media

Jiajun Zhang, Zhixun Li, Qiang Liu, Shu Wu, Liang Wang

Subjects: Social and Information Networks (cs.SI); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1214] arXiv:2403.00046 (cross-list from cs.SE) [pdf, html, other]

Title: SEED: Customize Large Language Models with Sample-Efficient Adaptation for Code Generation

Xue Jiang, Yihong Dong, Zhi Jin, Ge Li

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1215] arXiv:2403.00108 (cross-list from cs.CR) [pdf, html, other]

Title: LoRA-as-an-Attack! Piercing LLM Safety Under The Share-and-Play Scenario

Hongyi Liu, Zirui Liu, Ruixiang Tang, Jiayi Yuan, Shaochen Zhong, Yu-Neng Chuang, Li Li, Rui Chen, Xia Hu

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1216] arXiv:2403.00231 (cross-list from cs.CV) [pdf, html, other]

Title: Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Models

Lei Li, Yuqi Wang, Runxin Xu, Peiyi Wang, Xiachong Feng, Lingpeng Kong, Qi Liu

Comments: Project page: this https URL, Camera Ready Version of ACL 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1217] arXiv:2403.00393 (cross-list from cs.CR) [pdf, html, other]

Title: TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs

Tanmay Rajore, Nishanth Chandran, Sunayana Sitaram, Divya Gupta, Rahul Sharma, Kashish Mittal, Manohar Swaminathan

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1218] arXiv:2403.00409 (cross-list from cs.LG) [pdf, html, other]

Title: Provably Robust DPO: Aligning Language Models with Noisy Feedback

Sayak Ray Chowdhury, Anush Kini, Nagarajan Natarajan

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1219] arXiv:2403.00632 (cross-list from cs.HC) [pdf, html, other]

Title: Metamorpheus: Interactive, Affective, and Creative Dream Narration Through Metaphorical Visual Storytelling

Qian Wan, Xin Feng, Yining Bei, Zhiqi Gao, Zhicong Lu

Comments: Accepted by CHI 2024

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1220] arXiv:2403.00745 (cross-list from cs.LG) [pdf, html, other]

Title: AtP*: An efficient and scalable method for localizing LLM behaviour to components

János Kramár, Tom Lieberum, Rohin Shah, Neel Nanda (Google DeepMind)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)