Computation and Language

Authors and titles for June 2024

[1401] arXiv:2406.15846 [pdf, html, other]

Title: Revisiting Interpolation Augmentation for Speech-to-Text Generation

Chen Xu, Jie Wang, Xiaoqian Liu, Qianqian Dong, Chunliang Zhang, Tong Xiao, Jingbo Zhu, Dapeng Man, Wu Yang

Comments: ACL 2024 Findings

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1402] arXiv:2406.15862 [pdf, html, other]

Title: Speech Analysis of Language Varieties in Italy

Moreno La Quatra, Alkis Koudounas, Elena Baralis, Sabato Marco Siniscalchi

Comments: Accepted to LREC-COLING 2024 - this https URL

Subjects: Computation and Language (cs.CL)

[1403] arXiv:2406.15869 [pdf, html, other]

Title: A multitask learning framework for leveraging subjectivity of annotators to identify misogyny

Jason Angel, Segun Taofeek Aroyehun, Grigori Sidorov, Alexander Gelbukh

Subjects: Computation and Language (cs.CL)

[1404] arXiv:2406.15871 [pdf, html, other]

Title: Uncovering Hidden Intentions: Exploring Prompt Recovery for Deeper Insights into Generated Texts

Louis Give, Timo Zaoral, Maria Antonietta Bruno

Comments: Accepted at WNNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1405] arXiv:2406.15883 [pdf, html, other]

Title: SimSMoE: Solving Representational Collapse via Similarity Measure

Giang Do, Hung Le, Truyen Tran

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1406] arXiv:2406.15888 [pdf, html, other]

Title: Real-time Speech Summarization for Medical Conversations

Khai Le-Duc, Khai-Nguyen Nguyen, Long Vo-Dang, Truong-Son Hy

Comments: Interspeech 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1407] arXiv:2406.15891 [pdf, html, other]

Title: The Unlikely Duel: Evaluating Creative Writing in LLMs through a Unique Scenario

Carlos Gómez-Rodríguez, Paul Williams

Comments: Published in the XIX Conference of the Spanish Association for Artificial Intelligence (CAEPIA), 2024. Summary of our paper "A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writing", published in Findings of EMNLP

Journal-ref: XX Conferencia de la Asociaci\'on Espa\~nola para la Inteligencia Artificial (CAEPIA 2024), pages 225-226. ISBN 978-84-09-62724-0

Subjects: Computation and Language (cs.CL)

[1408] arXiv:2406.15927 [pdf, html, other]

Title: Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMs

Jannik Kossen, Jiatong Han, Muhammed Razzak, Lisa Schut, Shreshth Malik, Yarin Gal

Comments: First three authors contributed equally

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1409] arXiv:2406.15938 [pdf, html, other]

Title: RuleR: Improving LLM Controllability by Rule-based Data Recycling

Ming Li, Han Chen, Chenguang Wang, Dang Nguyen, Dianqi Li, Tianyi Zhou

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1410] arXiv:2406.15948 [pdf, html, other]

Title: Teaching LLMs to Abstain across Languages via Multilingual Feedback

Shangbin Feng, Weijia Shi, Yike Wang, Wenxuan Ding, Orevaoghene Ahia, Shuyue Stella Li, Vidhisha Balachandran, Sunayana Sitaram, Yulia Tsvetkov

Comments: EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1411] arXiv:2406.15951 [pdf, html, other]

Title: Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaboration

Shangbin Feng, Taylor Sorensen, Yuhan Liu, Jillian Fisher, Chan Young Park, Yejin Choi, Yulia Tsvetkov

Comments: EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1412] arXiv:2406.15966 [pdf, html, other]

Title: Evaluating the Effectiveness of the Foundational Models for Q&A Classification in Mental Health care

Hassan Alhuzali, Ashwag Alasmari

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1413] arXiv:2406.15968 [pdf, html, other]

Title: ReCaLL: Membership Inference via Relative Conditional Log-Likelihoods

Roy Xie, Junlin Wang, Ruomin Huang, Minxing Zhang, Rong Ge, Jian Pei, Neil Zhenqiang Gong, Bhuwan Dhingra

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1414] arXiv:2406.15981 [pdf, html, other]

Title: Serial Position Effects of Large Language Models

Xiaobo Guo, Soroush Vosoughi

Subjects: Computation and Language (cs.CL)

[1415] arXiv:2406.15990 [pdf, html, other]

Title: Enhancing Cross-Document Event Coreference Resolution by Discourse Structure and Semantic Information

Qiang Gao, Bobo Li, Zixiang Meng, Yunlong Li, Jun Zhou, Fei Li, Chong Teng, Donghong Ji

Journal-ref: LREC|COLING,Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation,2024,5907-5921

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1416] arXiv:2406.15992 [pdf, html, other]

Title: Can LLM Graph Reasoning Generalize beyond Pattern Memorization?

Yizhuo Zhang, Heng Wang, Shangbin Feng, Zhaoxuan Tan, Xiaochuang Han, Tianxing He, Yulia Tsvetkov

Comments: 17 pages, 6 figures. EMNLP 2024 Findings. Code and data is publicly available at this https URL

Subjects: Computation and Language (cs.CL)

[1417] arXiv:2406.15996 [pdf, html, other]

Title: Memorizing Documents with Guidance in Large Language Models

Bumjin Park, Jaesik Choi

Comments: IJCAI 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1418] arXiv:2406.16007 [pdf, html, other]

Title: Distributed Rule Vectors is A Key Mechanism in Large Language Models' In-Context Learning

Bowen Zheng, Ming Ma, Zhongqiao Lin, Tianming Yang

Subjects: Computation and Language (cs.CL)

[1419] arXiv:2406.16008 [pdf, html, other]

Title: Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization

Cheng-Yu Hsieh, Yung-Sung Chuang, Chun-Liang Li, Zifeng Wang, Long T. Le, Abhishek Kumar, James Glass, Alexander Ratner, Chen-Yu Lee, Ranjay Krishna, Tomas Pfister

Comments: ACL Findings 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1420] arXiv:2406.16013 [pdf, other]

Title: Database-Augmented Query Representation for Information Retrieval

Soyeong Jeong, Jinheon Baek, Sukmin Cho, Sung Ju Hwang, Jong C. Park

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[1421] arXiv:2406.16021 [pdf, html, other]

Title: Harvesting Events from Multiple Sources: Towards a Cross-Document Event Extraction Paradigm

Qiang Gao, Zixiang Meng, Bobo Li, Jun Zhou, Fei Li, Chong Teng, Donghong Ji

Comments: ACL2024(Findings)

Journal-ref: https://aclanthology.org/2024.findings-acl.114

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1422] arXiv:2406.16030 [pdf, html, other]

Title: Zero-Shot Cross-Lingual NER Using Phonemic Representations for Low-Resource Languages

Jimin Sohn, Haeji Jung, Alex Cheng, Jooeon Kang, Yilin Du, David R. Mortensen

Comments: Accepted to EMNLP 2024 Main Conference

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1423] arXiv:2406.16033 [pdf, html, other]

Title: Unlocking the Future: Exploring Look-Ahead Planning Mechanistic Interpretability in Large Language Models

Tianyi Men, Pengfei Cao, Zhuoran Jin, Yubo Chen, Kang Liu, Jun Zhao

Subjects: Computation and Language (cs.CL)

[1424] arXiv:2406.16069 [pdf, html, other]

Title: FastMem: Fast Memorization of Prompt Improves Context Awareness of Large Language Models

Junyi Zhu, Shuochen Liu, Yu Yu, Bo Tang, Yibo Yan, Zhiyu Li, Feiyu Xiong, Tong Xu, Matthew B. Blaschko

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1425] arXiv:2406.16071 [pdf, html, other]

Title: Dancing in the syntax forest: fast, accurate and explainable sentiment analysis with SALSA

Carlos Gómez-Rodríguez, Muhammad Imran, David Vilares, Elena Solera, Olga Kellert

Comments: Accepted for publication at SEPLN-CEDI2024: Seminar of the Spanish Society for Natural Language Processing at the 7th Spanish Conference on Informatics

Subjects: Computation and Language (cs.CL)

[1426] arXiv:2406.16078 [pdf, html, other]

Title: First Heuristic Then Rational: Dynamic Use of Heuristics in Language Model Reasoning

Yoichi Aoki, Keito Kudo, Tatsuki Kuribayashi, Shusaku Sone, Masaya Taniguchi, Keisuke Sakaguchi, Kentaro Inui

Comments: This paper is accepted at EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1427] arXiv:2406.16079 [pdf, html, other]

Title: EERPD: Leveraging Emotion and Emotion Regulation for Improving Personality Detection

Zheng Li, Dawei Zhu, Qilong Ma, Weimin Xiong, Sujian Li

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1428] arXiv:2406.16086 [pdf, html, other]

Title: SEAM: A Stochastic Benchmark for Multi-Document Tasks

Gili Lior, Avi Caciularu, Arie Cattan, Shahar Levy, Ori Shapira, Gabriel Stanovsky

Subjects: Computation and Language (cs.CL)

[1429] arXiv:2406.16135 [pdf, html, other]

Title: Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models

Lynn Chua, Badih Ghazi, Yangsibo Huang, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Amer Sinha, Chulin Xie, Chiyuan Zhang

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1430] arXiv:2406.16144 [pdf, html, other]

Title: Chain-of-Probe: Examing the Necessity and Accuracy of CoT Step-by-Step

Zezhong Wang, Xingshan Zeng, Weiwen Liu, Yufei Wang, Liangyou Li, Yasheng Wang, Lifeng Shang, Xin Jiang, Qun Liu, Kam-Fai Wong

Subjects: Computation and Language (cs.CL)

[1431] arXiv:2406.16152 [pdf, html, other]

Title: Towards Region-aware Bias Evaluation Metrics

Angana Borah, Aparna Garimella, Rada Mihalcea

Subjects: Computation and Language (cs.CL)

[1432] arXiv:2406.16167 [pdf, html, other]

Title: FS-RAG: A Frame Semantics Based Approach for Improved Factual Accuracy in Large Language Models

Harish Tayyar Madabushi

Comments: program code and prompts available at this https URL

Subjects: Computation and Language (cs.CL)

[1433] arXiv:2406.16203 [pdf, html, other]

Title: LLMs' Classification Performance is Overclaimed

Hanzi Xu, Renze Lou, Jiangshu Du, Vahid Mahzoon, Elmira Talebianaraki, Zhuoan Zhou, Elizabeth Garrison, Slobodan Vucetic, Wenpeng Yin

Subjects: Computation and Language (cs.CL)

[1434] arXiv:2406.16223 [pdf, html, other]

Title: Continuous Output Personality Detection Models via Mixed Strategy Training

Rong Wang, Kun Sun

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1435] arXiv:2406.16229 [pdf, html, other]

Title: Multi-Objective Linguistic Control of Large Language Models

Dang Nguyen, Jiuhai Chen, Tianyi Zhou

Subjects: Computation and Language (cs.CL)

[1436] arXiv:2406.16235 [pdf, html, other]

Title: Preference Tuning For Toxicity Mitigation Generalizes Across Languages

Xiaochen Li, Zheng-Xin Yong, Stephen H. Bach

Comments: Findings of EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[1437] arXiv:2406.16253 [pdf, html, other]

Title: LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing

Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Peng Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Ranran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Jiayang Cheng, Zhaowei Wang, Ying Su, Raj Sanjay Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip S. Yu, Wenpeng Yin

Comments: Accepted by EMNLP 2024 main conference

Subjects: Computation and Language (cs.CL)

[1438] arXiv:2406.16264 [pdf, html, other]

Title: One Thousand and One Pairs: A "novel" challenge for long-context language models

Marzena Karpinska, Katherine Thai, Kyle Lo, Tanya Goyal, Mohit Iyyer

Comments: EMNLP 2024, camera ready

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1439] arXiv:2406.16275 [pdf, html, other]

Title: Investigating the Influence of Prompt-Specific Shortcuts in AI Generated Text Detection

Choonghyun Park, Hyuhng Joon Kim, Junyeob Kim, Youna Kim, Taeuk Kim, Hyunsoo Cho, Hwiyeol Jo, Sang-goo Lee, Kang Min Yoo

Comments: 19 pages, 3 figures, 13 tables, under review

Subjects: Computation and Language (cs.CL)

[1440] arXiv:2406.16288 [pdf, html, other]

Title: PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection

Jooyoung Lee, Toshini Agrawal, Adaku Uchendu, Thai Le, Jinghui Chen, Dongwon Lee

Comments: 9 pages

Subjects: Computation and Language (cs.CL)

[1441] arXiv:2406.16293 [pdf, html, other]

Title: Combining Supervised Learning and Reinforcement Learning for Multi-Label Classification Tasks with Partial Labels

Zixia Jia, Junpeng Li, Shichuan Zhang, Anji Liu, Zilong Zheng

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1442] arXiv:2406.16294 [pdf, html, other]

Title: LangSuitE: Planning, Controlling and Interacting with Large Language Models in Embodied Text Environments

Zixia Jia, Mengmeng Wang, Baichen Tong, Song-Chun Zhu, Zilong Zheng

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1443] arXiv:2406.16299 [pdf, html, other]

Title: Compensate Quantization Errors: Make Weights Hierarchical to Compensate Each Other

Yifei Gao, Jie Ou, Lei Wang, Yuting Xiao, Zhiyuan Xiang, Ruiting Dai, Jun Cheng

Comments: Efficient quantization method

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1444] arXiv:2406.16306 [pdf, html, other]

Title: Cascade Reward Sampling for Efficient Decoding-Time Alignment

Bolian Li, Yifan Wang, Ananth Grama, Ruqi Zhang

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[1445] arXiv:2406.16316 [pdf, html, other]

Title: Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?

Yuu Jinnai

Comments: The 2nd Workshop on Cross-Cultural Considerations in NLP (C3NLP) at ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1446] arXiv:2406.16319 [pdf, html, other]

Title: Modelled Multivariate Overlap: A method for measuring vowel merger

Irene Smith, Morgan Sonderegger, The Spade Consortium

Comments: Accepted to Interspeech 2024

Subjects: Computation and Language (cs.CL)

[1447] arXiv:2406.16320 [pdf, html, other]

Title: What Do VLMs NOTICE? A Mechanistic Interpretability Pipeline for Gaussian-Noise-free Text-Image Corruption and Evaluation

Michal Golovanevsky, William Rudman, Vedant Palit, Ritambhara Singh, Carsten Eickhoff

Subjects: Computation and Language (cs.CL)

[1448] arXiv:2406.16330 [pdf, html, other]

Title: Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging

Deyuan Liu, Zhanyue Qin, Hairu Wang, Zhao Yang, Zecheng Wang, Fangying Rong, Qingbin Liu, Yanchao Hao, Xi Chen, Cunhang Fan, Zhao Lv, Zhiying Tu, Dianhui Chu, Bo Li, Dianbo Sui

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1449] arXiv:2406.16341 [pdf, html, other]

Title: EHRCon: Dataset for Checking Consistency between Unstructured Notes and Structured Tables in Electronic Health Records

Yeonsu Kwon, Jiho Kim, Gyubok Lee, Seongsu Bae, Daeun Kyung, Wonchul Cha, Tom Pollard, Alistair Johnson, Edward Choi

Subjects: Computation and Language (cs.CL)

[1450] arXiv:2406.16342 [pdf, html, other]

Title: Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness

Yoo Yeon Sung, Maharshi Gor, Eve Fleisig, Ishani Mondal, Jordan Lee Boyd-Graber

Comments: arXiv admin note: text overlap with arXiv:2401.11185

Subjects: Computation and Language (cs.CL)

[1451] arXiv:2406.16356 [pdf, html, other]

Title: Evaluation of Instruction-Following Ability for Large Language Models on Story-Ending Generation

Rem Hida, Junki Ohmura, Toshiyuki Sekiya

Subjects: Computation and Language (cs.CL)

[1452] arXiv:2406.16372 [pdf, html, other]

Title: UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding

Dongyang Li, Taolin Zhang, Jiali Deng, Longtao Huang, Chengyu Wang, Xiaofeng He, Hui Xue

Subjects: Computation and Language (cs.CL)

[1453] arXiv:2406.16374 [pdf, html, other]

Title: KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning

Dongyang Li, Taolin Zhang, Longtao Huang, Chengyu Wang, Xiaofeng He, Hui Xue

Subjects: Computation and Language (cs.CL)

[1454] arXiv:2406.16377 [pdf, html, other]

Title: On the Transformations across Reward Model, Parameter Update, and In-Context Prompt

Deng Cai, Huayang Li, Tingchen Fu, Siheng Li, Weiwen Xu, Shuaiyi Li, Bowen Cao, Zhisong Zhang, Xinting Huang, Leyang Cui, Yan Wang, Lemao Liu, Taro Watanabe, Shuming Shi

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1455] arXiv:2406.16382 [pdf, html, other]

Title: UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models

Zhanyue Qin, Haochuan Wang, Deyuan Liu, Ziyang Song, Cunhang Fan, Zhao Lv, Jinlin Wu, Zhen Lei, Zhiying Tu, Dianhui Chu, Xiaoyan Yu, Dianbo Sui

Subjects: Computation and Language (cs.CL)

[1456] arXiv:2406.16416 [pdf, html, other]

Title: Multilingual Knowledge Editing with Language-Agnostic Factual Neurons

Xue Zhang, Yunlong Liang, Fandong Meng, Songming Zhang, Yufeng Chen, Jinan Xu, Jie Zhou

Comments: COLING 2025 (14 pages, 3 figures, 12 tables)

Subjects: Computation and Language (cs.CL)

[1457] arXiv:2406.16441 [pdf, html, other]

Title: UniCoder: Scaling Code Large Language Model via Universal Code

Tao Sun, Linzheng Chai, Jian Yang, Yuwei Yin, Hongcheng Guo, Jiaheng Liu, Bing Wang, Liqun Yang, Zhoujun Li

Comments: Accepted by ACL 2024 (Main)

Subjects: Computation and Language (cs.CL)

[1458] arXiv:2406.16450 [pdf, html, other]

Title: Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers

Xiuying Wei, Skander Moalla, Razvan Pascanu, Caglar Gulcehre

Comments: Accepted by NeurIPS2024

Subjects: Computation and Language (cs.CL)

[1459] arXiv:2406.16464 [pdf, html, other]

Title: InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detection

Junjie Chen, Hang Yu, Subin Huang, Sanmin Liu, Linfeng Zhang

Comments: 15 pages, 7 figures, 11 tables; Code and data are available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1460] arXiv:2406.16469 [pdf, html, other]

Title: Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration

Yujin Baek, ChaeHun Park, Jaeseok Kim, Yu-Jung Heo, Du-Seong Chang, Jaegul Choo

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1461] arXiv:2406.16478 [pdf, html, other]

Title: EMMI -- Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations

Lucie Galland, Catherine Pelachaud, Florian Pecune

Comments: 9 pages

Subjects: Computation and Language (cs.CL)

[1462] arXiv:2406.16489 [pdf, html, other]

Title: Deepfake tweets automatic detection

Adam Frej, Adrian Kaminski, Piotr Marciniak, Szymon Szmajdzinski, Soveatin Kuntur, Anna Wroblewska

Subjects: Computation and Language (cs.CL)

[1463] arXiv:2406.16490 [pdf, html, other]

Title: eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure

Hoorieh Sabzevari, Mohammadmostafa Rostamkhani, Sauleh Eetemadi

Subjects: Computation and Language (cs.CL)

[1464] arXiv:2406.16495 [pdf, html, other]

Title: OTCE: Hybrid SSM and Attention with Cross Domain Mixture of Experts to construct Observer-Thinker-Conceiver-Expresser

Jingze Shi, Ting Xie, Bingheng Wu, Chunjun Zheng, Kai Wang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1465] arXiv:2406.16508 [pdf, html, other]

Title: Large Vocabulary Size Improves Large Language Models

Sho Takase, Ryokan Ri, Shun Kiyono, Takuya Kato

Comments: Work in progress

Subjects: Computation and Language (cs.CL)

[1466] arXiv:2406.16521 [pdf, html, other]

Title: Carrot and Stick: Inducing Self-Motivation with Positive & Negative Feedback

Jimin Sohn, Jeihee Cho, Junyong Lee, Songmu Heo, Ji-Eun Han, David R. Mortensen

Comments: 10 pages, 8 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1467] arXiv:2406.16524 [pdf, html, other]

Title: The Privileged Students: On the Value of Initialization in Multilingual Knowledge Distillation

Haryo Akbarianto Wibowo, Thamar Solorio, Alham Fikri Aji

Comments: 8 pages

Subjects: Computation and Language (cs.CL)

[1468] arXiv:2406.16527 [pdf, other]

Title: SyROCCo: Enhancing Systematic Reviews using Machine Learning

Zheng Fang, Miguel Arana-Catania, Felix-Anselm van Lier, Juliana Outes Velarde, Harry Bregazzi, Mara Airoldi, Eleanor Carter, Rob Procter

Comments: 28 pages, 5 figures. To appear in Data & Policy journal

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY); Digital Libraries (cs.DL); Machine Learning (cs.LG)

[1469] arXiv:2406.16528 [pdf, html, other]

Title: Evaluating the Ability of Large Language Models to Reason about Cardinal Directions

Anthony G Cohn, Robert E Blackwell

Comments: 9 pages, 3 figures, 1 table. Short paper accepted by COSIT 24, The 16th Conference on Spatial Information Theory

Subjects: Computation and Language (cs.CL)

[1470] arXiv:2406.16529 [pdf, html, other]

Title: Towards Better Graph-based Cross-document Relation Extraction via Non-bridge Entity Enhancement and Prediction Debiasing

Hao Yue, Shaopeng Lai, Chengyi Yang, Liang Zhang, Junfeng Yao, Jinsong Su

Comments: Accepted to ACL 2024 Findings

Subjects: Computation and Language (cs.CL)

[1471] arXiv:2406.16535 [pdf, other]

Title: Token-based Decision Criteria Are Suboptimal in In-context Learning

Hakaze Cho, Yoshihiro Sakai, Mariko Kato, Kenshiro Tanaka, Akira Ishii, Naoya Inoue

Comments: 24 pages, 15 figures, 13 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1472] arXiv:2406.16536 [pdf, html, other]

Title: C-LLM: Learn to Check Chinese Spelling Errors Character by Character

Kunting Li, Yong Hu, Liang He, Fandong Meng, Jie Zhou

Comments: Accepted to EMNLP 2024 Main

Subjects: Computation and Language (cs.CL)

[1473] arXiv:2406.16554 [pdf, html, other]

Title: LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

Tong Zhu, Xiaoye Qu, Daize Dong, Jiacheng Ruan, Jingqi Tong, Conghui He, Yu Cheng

Subjects: Computation and Language (cs.CL)

[1474] arXiv:2406.16563 [pdf, html, other]

Title: Are there identifiable structural parts in the sentence embedding whole?

Vivi Nastase, Paola Merlo

Comments: 17 pages, 14 figures, 5 tables

Subjects: Computation and Language (cs.CL)

[1475] arXiv:2406.16567 [pdf, html, other]

Title: Data Augmentation of Multi-turn Psychological Dialogue via Knowledge-driven Progressive Thought Prompting

Jiyue Jiang, Liheng Chen, Sheng Wang, Lingpeng Kong, Yu Li, Chuan Wu

Subjects: Computation and Language (cs.CL)

[1476] arXiv:2406.16605 [pdf, html, other]

Title: CLEAR: Can Language Models Really Understand Causal Graphs?

Sirui Chen, Mengying Xu, Kun Wang, Xingyu Zeng, Rui Zhao, Shengjie Zhao, Chaochao Lu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Methodology (stat.ME)

[1477] arXiv:2406.16611 [pdf, html, other]

Title: Evaluation of Language Models in the Medical Context Under Resource-Constrained Settings

Andrea Posada, Daniel Rueckert, Felix Meissen, Philip Müller

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1478] arXiv:2406.16655 [pdf, html, other]

Title: Large Language Models Are Cross-Lingual Knowledge-Free Reasoners

Peng Hu, Sizhe Liu, Changjiang Gao, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Shujian Huang

Subjects: Computation and Language (cs.CL)

[1479] arXiv:2406.16672 [pdf, html, other]

Title: CAVE: Controllable Authorship Verification Explanations

Sahana Ramnath, Kartik Pandey, Elizabeth Boschee, Xiang Ren

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1480] arXiv:2406.16674 [pdf, html, other]

Title: Computational Approaches to the Detection of Lesser-Known Rhetorical Figures: A Systematic Survey and Research Challenges

Ramona Kühn, Jelena Mitrović, Michael Granitzer

Comments: Submitted to ACM Computing Surveys. 35 pages

Subjects: Computation and Language (cs.CL)

[1481] arXiv:2406.16678 [pdf, html, other]

Title: Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation

Markus Frohmann, Igor Sterner, Ivan Vulić, Benjamin Minixhofer, Markus Schedl

Comments: Accepted to EMNLP 2024 Main

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1482] arXiv:2406.16690 [pdf, html, other]

Title: Scaling Laws for Linear Complexity Language Models

Xuyang Shen, Dong Li, Ruitao Leng, Zhen Qin, Weigao Sun, Yiran Zhong

Comments: Technical report. Yiran Zhong is the corresponding author

Subjects: Computation and Language (cs.CL)

[1483] arXiv:2406.16694 [pdf, html, other]

Title: Task Oriented In-Domain Data Augmentation

Xiao Liang, Xinyu Hu, Simiao Zuo, Yeyun Gong, Qiang Lou, Yi Liu, Shao-Lun Huang, Jian Jiao

Subjects: Computation and Language (cs.CL)

[1484] arXiv:2406.16714 [pdf, html, other]

Title: AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models

Jiale Cheng, Yida Lu, Xiaotao Gu, Pei Ke, Xiao Liu, Yuxiao Dong, Hongning Wang, Jie Tang, Minlie Huang

Comments: EMNLP 2024 findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1485] arXiv:2406.16722 [pdf, other]

Title: Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba

Yuchen Zou, Yineng Chen, Zuchao Li, Lefei Zhang, Hai Zhao

Subjects: Computation and Language (cs.CL)

[1486] arXiv:2406.16732 [pdf, html, other]

Title: CLIMATELI: Evaluating Entity Linking on Climate Change Data

Shijia Zhou, Siyao Peng, Barbara Plank

Comments: 8 pages, accepted at ClimateNLP 2024 workshop @ ACL 2024

Subjects: Computation and Language (cs.CL)

[1487] arXiv:2406.16743 [pdf, html, other]

Title: Adversarial Contrastive Decoding: Boosting Safety Alignment of Large Language Models via Opposite Prompt Optimization

Zhengyue Zhao, Xiaoyun Zhang, Kaidi Xu, Xing Hu, Rui Zhang, Zidong Du, Qi Guo, Yunji Chen

Subjects: Computation and Language (cs.CL)

[1488] arXiv:2406.16747 [pdf, html, other]

Title: Sparser is Faster and Less is More: Efficient Sparse Attention for Long-Range Transformers

Chao Lou, Zixia Jia, Zilong Zheng, Kewei Tu

Comments: preprint

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1489] arXiv:2406.16751 [pdf, html, other]

Title: Towards Zero-Shot Text-To-Speech for Arabic Dialects

Khai Duy Doan, Abdul Waheed, Muhammad Abdul-Mageed

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1490] arXiv:2406.16758 [pdf, html, other]

Title: Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters

Euiin Yi, Taehyeon Kim, Hongseok Jeung, Du-Seong Chang, Se-Young Yun

Subjects: Computation and Language (cs.CL)

[1491] arXiv:2406.16767 [pdf, html, other]

Title: The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories

Xi Yu Huang, Krishnapriya Vishnubhotla, Frank Rudzicz

Comments: 9 pages plus appendices; published at the 6th Workshop on Narrative Understanding, EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1492] arXiv:2406.16772 [pdf, html, other]

Title: OlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far?

Zhen Huang, Zengzhi Wang, Shijie Xia, Pengfei Liu

Comments: 10 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1493] arXiv:2406.16777 [pdf, html, other]

Title: Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024

Sai Koneru, Thai-Binh Nguyen, Ngoc-Quan Pham, Danni Liu, Zhaolin Li, Alexander Waibel, Jan Niehues

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1494] arXiv:2406.16778 [pdf, html, other]

Title: Finding Transformer Circuits with Edge Pruning

Adithya Bhaskar, Alexander Wettig, Dan Friedman, Danqi Chen

Comments: NeurIPS 2024 (Spotlight)

Subjects: Computation and Language (cs.CL)

[1495] arXiv:2406.16779 [pdf, html, other]

Title: It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension

Sagi Shaier, Lawrence E Hunter, Katharina von der Wense

Comments: Accepted to ACL Findings

Subjects: Computation and Language (cs.CL)

[1496] arXiv:2406.16783 [pdf, html, other]

Title: M2Lingual: Enhancing Multilingual, Multi-Turn Instruction Alignment in Large Language Models

Rishabh Maheshwary, Vikas Yadav, Hoang Nguyen, Khyati Mahajan, Sathwik Tejaswi Madhusudhan

Comments: 39 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1497] arXiv:2406.16797 [pdf, html, other]

Title: Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs

Ashwinee Panda, Berivan Isik, Xiangyu Qi, Sanmi Koyejo, Tsachy Weissman, Prateek Mittal

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1498] arXiv:2406.16801 [pdf, html, other]

Title: RES-Q: Evaluating Code-Editing Large Language Model Systems at the Repository Scale

Beck LaBash, August Rosedale, Alex Reents, Lucas Negritto, Colin Wiel

Subjects: Computation and Language (cs.CL)

[1499] arXiv:2406.16829 [pdf, html, other]

Title: Understanding and Mitigating Tokenization Bias in Language Models

Buu Phan, Marton Havasi, Matthew Muckley, Karen Ullrich

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1500] arXiv:2406.16833 [pdf, html, other]

Title: USDC: A Dataset of $\underline{U}$ser $\underline{S}$tance and $\underline{D}$ogmatism in Long $\underline{C}$onversations

Mounika Marreddy, Subba Reddy Oota, Venkata Charan Chinni, Manish Gupta, Lucie Flek

Comments: 32 pages, 18 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)