Computation and Language

Authors and titles for June 2024

[1451] arXiv:2406.16356 [pdf, html, other]

Title: Evaluation of Instruction-Following Ability for Large Language Models on Story-Ending Generation

Rem Hida, Junki Ohmura, Toshiyuki Sekiya

Subjects: Computation and Language (cs.CL)

[1452] arXiv:2406.16372 [pdf, html, other]

Title: UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding

Dongyang Li, Taolin Zhang, Jiali Deng, Longtao Huang, Chengyu Wang, Xiaofeng He, Hui Xue

Subjects: Computation and Language (cs.CL)

[1453] arXiv:2406.16374 [pdf, html, other]

Title: KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning

Dongyang Li, Taolin Zhang, Longtao Huang, Chengyu Wang, Xiaofeng He, Hui Xue

Subjects: Computation and Language (cs.CL)

[1454] arXiv:2406.16377 [pdf, html, other]

Title: On the Transformations across Reward Model, Parameter Update, and In-Context Prompt

Deng Cai, Huayang Li, Tingchen Fu, Siheng Li, Weiwen Xu, Shuaiyi Li, Bowen Cao, Zhisong Zhang, Xinting Huang, Leyang Cui, Yan Wang, Lemao Liu, Taro Watanabe, Shuming Shi

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1455] arXiv:2406.16382 [pdf, html, other]

Title: UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models

Zhanyue Qin, Haochuan Wang, Deyuan Liu, Ziyang Song, Cunhang Fan, Zhao Lv, Jinlin Wu, Zhen Lei, Zhiying Tu, Dianhui Chu, Xiaoyan Yu, Dianbo Sui

Subjects: Computation and Language (cs.CL)

[1456] arXiv:2406.16416 [pdf, html, other]

Title: Multilingual Knowledge Editing with Language-Agnostic Factual Neurons

Xue Zhang, Yunlong Liang, Fandong Meng, Songming Zhang, Yufeng Chen, Jinan Xu, Jie Zhou

Comments: COLING 2025 (14 pages, 3 figures, 12 tables)

Subjects: Computation and Language (cs.CL)

[1457] arXiv:2406.16441 [pdf, html, other]

Title: UniCoder: Scaling Code Large Language Model via Universal Code

Tao Sun, Linzheng Chai, Jian Yang, Yuwei Yin, Hongcheng Guo, Jiaheng Liu, Bing Wang, Liqun Yang, Zhoujun Li

Comments: Accepted by ACL 2024 (Main)

Subjects: Computation and Language (cs.CL)

[1458] arXiv:2406.16450 [pdf, html, other]

Title: Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers

Xiuying Wei, Skander Moalla, Razvan Pascanu, Caglar Gulcehre

Comments: Accepted by NeurIPS2024

Subjects: Computation and Language (cs.CL)

[1459] arXiv:2406.16464 [pdf, html, other]

Title: InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detection

Junjie Chen, Hang Yu, Subin Huang, Sanmin Liu, Linfeng Zhang

Comments: 15 pages, 7 figures, 11 tables; Code and data are available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1460] arXiv:2406.16469 [pdf, html, other]

Title: Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration

Yujin Baek, ChaeHun Park, Jaeseok Kim, Yu-Jung Heo, Du-Seong Chang, Jaegul Choo

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1461] arXiv:2406.16478 [pdf, html, other]

Title: EMMI -- Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations

Lucie Galland, Catherine Pelachaud, Florian Pecune

Comments: 9 pages

Subjects: Computation and Language (cs.CL)

[1462] arXiv:2406.16489 [pdf, html, other]

Title: Deepfake tweets automatic detection

Adam Frej, Adrian Kaminski, Piotr Marciniak, Szymon Szmajdzinski, Soveatin Kuntur, Anna Wroblewska

Subjects: Computation and Language (cs.CL)

[1463] arXiv:2406.16490 [pdf, html, other]

Title: eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure

Hoorieh Sabzevari, Mohammadmostafa Rostamkhani, Sauleh Eetemadi

Subjects: Computation and Language (cs.CL)

[1464] arXiv:2406.16495 [pdf, html, other]

Title: OTCE: Hybrid SSM and Attention with Cross Domain Mixture of Experts to construct Observer-Thinker-Conceiver-Expresser

Jingze Shi, Ting Xie, Bingheng Wu, Chunjun Zheng, Kai Wang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1465] arXiv:2406.16508 [pdf, html, other]

Title: Large Vocabulary Size Improves Large Language Models

Sho Takase, Ryokan Ri, Shun Kiyono, Takuya Kato

Comments: Work in progress

Subjects: Computation and Language (cs.CL)

[1466] arXiv:2406.16521 [pdf, html, other]

Title: Carrot and Stick: Inducing Self-Motivation with Positive & Negative Feedback

Jimin Sohn, Jeihee Cho, Junyong Lee, Songmu Heo, Ji-Eun Han, David R. Mortensen

Comments: 10 pages, 8 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1467] arXiv:2406.16524 [pdf, html, other]

Title: The Privileged Students: On the Value of Initialization in Multilingual Knowledge Distillation

Haryo Akbarianto Wibowo, Thamar Solorio, Alham Fikri Aji

Comments: 8 pages

Subjects: Computation and Language (cs.CL)

[1468] arXiv:2406.16527 [pdf, other]

Title: SyROCCo: Enhancing Systematic Reviews using Machine Learning

Zheng Fang, Miguel Arana-Catania, Felix-Anselm van Lier, Juliana Outes Velarde, Harry Bregazzi, Mara Airoldi, Eleanor Carter, Rob Procter

Comments: 28 pages, 5 figures. To appear in Data & Policy journal

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY); Digital Libraries (cs.DL); Machine Learning (cs.LG)

[1469] arXiv:2406.16528 [pdf, html, other]

Title: Evaluating the Ability of Large Language Models to Reason about Cardinal Directions

Anthony G Cohn, Robert E Blackwell

Comments: 9 pages, 3 figures, 1 table. Short paper accepted by COSIT 24, The 16th Conference on Spatial Information Theory

Subjects: Computation and Language (cs.CL)

[1470] arXiv:2406.16529 [pdf, html, other]

Title: Towards Better Graph-based Cross-document Relation Extraction via Non-bridge Entity Enhancement and Prediction Debiasing

Hao Yue, Shaopeng Lai, Chengyi Yang, Liang Zhang, Junfeng Yao, Jinsong Su

Comments: Accepted to ACL 2024 Findings

Subjects: Computation and Language (cs.CL)

[1471] arXiv:2406.16535 [pdf, other]

Title: Token-based Decision Criteria Are Suboptimal in In-context Learning

Hakaze Cho, Yoshihiro Sakai, Mariko Kato, Kenshiro Tanaka, Akira Ishii, Naoya Inoue

Comments: 24 pages, 15 figures, 13 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1472] arXiv:2406.16536 [pdf, html, other]

Title: C-LLM: Learn to Check Chinese Spelling Errors Character by Character

Kunting Li, Yong Hu, Liang He, Fandong Meng, Jie Zhou

Comments: Accepted to EMNLP 2024 Main

Subjects: Computation and Language (cs.CL)

[1473] arXiv:2406.16554 [pdf, html, other]

Title: LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

Tong Zhu, Xiaoye Qu, Daize Dong, Jiacheng Ruan, Jingqi Tong, Conghui He, Yu Cheng

Subjects: Computation and Language (cs.CL)

[1474] arXiv:2406.16563 [pdf, html, other]

Title: Are there identifiable structural parts in the sentence embedding whole?

Vivi Nastase, Paola Merlo

Comments: 17 pages, 14 figures, 5 tables

Subjects: Computation and Language (cs.CL)

[1475] arXiv:2406.16567 [pdf, html, other]

Title: Data Augmentation of Multi-turn Psychological Dialogue via Knowledge-driven Progressive Thought Prompting

Jiyue Jiang, Liheng Chen, Sheng Wang, Lingpeng Kong, Yu Li, Chuan Wu

Subjects: Computation and Language (cs.CL)

[1476] arXiv:2406.16605 [pdf, html, other]

Title: CLEAR: Can Language Models Really Understand Causal Graphs?

Sirui Chen, Mengying Xu, Kun Wang, Xingyu Zeng, Rui Zhao, Shengjie Zhao, Chaochao Lu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Methodology (stat.ME)

[1477] arXiv:2406.16611 [pdf, html, other]

Title: Evaluation of Language Models in the Medical Context Under Resource-Constrained Settings

Andrea Posada, Daniel Rueckert, Felix Meissen, Philip Müller

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1478] arXiv:2406.16655 [pdf, html, other]

Title: Large Language Models Are Cross-Lingual Knowledge-Free Reasoners

Peng Hu, Sizhe Liu, Changjiang Gao, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Shujian Huang

Subjects: Computation and Language (cs.CL)

[1479] arXiv:2406.16672 [pdf, html, other]

Title: CAVE: Controllable Authorship Verification Explanations

Sahana Ramnath, Kartik Pandey, Elizabeth Boschee, Xiang Ren

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1480] arXiv:2406.16674 [pdf, html, other]

Title: Computational Approaches to the Detection of Lesser-Known Rhetorical Figures: A Systematic Survey and Research Challenges

Ramona Kühn, Jelena Mitrović, Michael Granitzer

Comments: Submitted to ACM Computing Surveys. 35 pages

Subjects: Computation and Language (cs.CL)

[1481] arXiv:2406.16678 [pdf, html, other]

Title: Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation

Markus Frohmann, Igor Sterner, Ivan Vulić, Benjamin Minixhofer, Markus Schedl

Comments: Accepted to EMNLP 2024 Main

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1482] arXiv:2406.16690 [pdf, html, other]

Title: Scaling Laws for Linear Complexity Language Models

Xuyang Shen, Dong Li, Ruitao Leng, Zhen Qin, Weigao Sun, Yiran Zhong

Comments: Technical report. Yiran Zhong is the corresponding author

Subjects: Computation and Language (cs.CL)

[1483] arXiv:2406.16694 [pdf, html, other]

Title: Task Oriented In-Domain Data Augmentation

Xiao Liang, Xinyu Hu, Simiao Zuo, Yeyun Gong, Qiang Lou, Yi Liu, Shao-Lun Huang, Jian Jiao

Subjects: Computation and Language (cs.CL)

[1484] arXiv:2406.16714 [pdf, html, other]

Title: AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models

Jiale Cheng, Yida Lu, Xiaotao Gu, Pei Ke, Xiao Liu, Yuxiao Dong, Hongning Wang, Jie Tang, Minlie Huang

Comments: EMNLP 2024 findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1485] arXiv:2406.16722 [pdf, other]

Title: Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba

Yuchen Zou, Yineng Chen, Zuchao Li, Lefei Zhang, Hai Zhao

Subjects: Computation and Language (cs.CL)

[1486] arXiv:2406.16732 [pdf, html, other]

Title: CLIMATELI: Evaluating Entity Linking on Climate Change Data

Shijia Zhou, Siyao Peng, Barbara Plank

Comments: 8 pages, accepted at ClimateNLP 2024 workshop @ ACL 2024

Subjects: Computation and Language (cs.CL)

[1487] arXiv:2406.16743 [pdf, html, other]

Title: Adversarial Contrastive Decoding: Boosting Safety Alignment of Large Language Models via Opposite Prompt Optimization

Zhengyue Zhao, Xiaoyun Zhang, Kaidi Xu, Xing Hu, Rui Zhang, Zidong Du, Qi Guo, Yunji Chen

Subjects: Computation and Language (cs.CL)

[1488] arXiv:2406.16747 [pdf, html, other]

Title: Sparser is Faster and Less is More: Efficient Sparse Attention for Long-Range Transformers

Chao Lou, Zixia Jia, Zilong Zheng, Kewei Tu

Comments: preprint

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1489] arXiv:2406.16751 [pdf, html, other]

Title: Towards Zero-Shot Text-To-Speech for Arabic Dialects

Khai Duy Doan, Abdul Waheed, Muhammad Abdul-Mageed

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1490] arXiv:2406.16758 [pdf, html, other]

Title: Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters

Euiin Yi, Taehyeon Kim, Hongseok Jeung, Du-Seong Chang, Se-Young Yun

Subjects: Computation and Language (cs.CL)

[1491] arXiv:2406.16767 [pdf, html, other]

Title: The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories

Xi Yu Huang, Krishnapriya Vishnubhotla, Frank Rudzicz

Comments: 9 pages plus appendices; published at the 6th Workshop on Narrative Understanding, EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1492] arXiv:2406.16772 [pdf, html, other]

Title: OlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far?

Zhen Huang, Zengzhi Wang, Shijie Xia, Pengfei Liu

Comments: 10 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1493] arXiv:2406.16777 [pdf, html, other]

Title: Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024

Sai Koneru, Thai-Binh Nguyen, Ngoc-Quan Pham, Danni Liu, Zhaolin Li, Alexander Waibel, Jan Niehues

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1494] arXiv:2406.16778 [pdf, html, other]

Title: Finding Transformer Circuits with Edge Pruning

Adithya Bhaskar, Alexander Wettig, Dan Friedman, Danqi Chen

Comments: NeurIPS 2024 (Spotlight)

Subjects: Computation and Language (cs.CL)

[1495] arXiv:2406.16779 [pdf, html, other]

Title: It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension

Sagi Shaier, Lawrence E Hunter, Katharina von der Wense

Comments: Accepted to ACL Findings

Subjects: Computation and Language (cs.CL)

[1496] arXiv:2406.16783 [pdf, html, other]

Title: M2Lingual: Enhancing Multilingual, Multi-Turn Instruction Alignment in Large Language Models

Rishabh Maheshwary, Vikas Yadav, Hoang Nguyen, Khyati Mahajan, Sathwik Tejaswi Madhusudhan

Comments: 39 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1497] arXiv:2406.16797 [pdf, html, other]

Title: Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs

Ashwinee Panda, Berivan Isik, Xiangyu Qi, Sanmi Koyejo, Tsachy Weissman, Prateek Mittal

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1498] arXiv:2406.16801 [pdf, html, other]

Title: RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale

Beck LaBash, August Rosedale, Alex Reents, Lucas Negritto, Colin Wiel

Subjects: Computation and Language (cs.CL)

[1499] arXiv:2406.16829 [pdf, html, other]

Title: Understanding and Mitigating Tokenization Bias in Language Models

Buu Phan, Marton Havasi, Matthew Muckley, Karen Ullrich

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1500] arXiv:2406.16833 [pdf, html, other]

Title: USDC: A Dataset of $\underline{U}$ser $\underline{S}$tance and $\underline{D}$ogmatism in Long $\underline{C}$onversations

Mounika Marreddy, Subba Reddy Oota, Venkata Charan Chinni, Manish Gupta, Lucie Flek

Comments: 32 pages, 18 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)