Computation and Language

Authors and titles for June 2024

[1551] arXiv:2406.17404 [pdf, html, other]

Title: Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training

Yixuan Wang, Xianzhen Luo, Fuxuan Wei, Yijun Liu, Qingfu Zhu, Xuanyu Zhang, Qing Yang, Dongliang Xu, Wanxiang Che

Comments: EMNLP 2024, camera ready

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1552] arXiv:2406.17415 [pdf, html, other]

Title: Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels

Razvan-Gabriel Dumitru, Vikas Yadav, Rishabh Maheshwary, Paul-Ioan Clotan, Sathwik Tejaswi Madhusudhan, Mihai Surdeanu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1553] arXiv:2406.17419 [pdf, html, other]

Title: Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA

Minzheng Wang, Longze Chen, Cheng Fu, Shengyi Liao, Xinghua Zhang, Bingli Wu, Haiyang Yu, Nan Xu, Lei Zhang, Run Luo, Yunshui Li, Min Yang, Fei Huang, Yongbin Li

Comments: EMNLP 2024 Main. We release our code and data publicly at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1554] arXiv:2406.17430 [pdf, html, other]

Title: Towards Probing Speech-Specific Risks in Large Multimodal Models: A Taxonomy, Benchmark, and Insights

Hao Yang, Lizhen Qu, Ehsan Shareghi, Gholamreza Haffari

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1555] arXiv:2406.17453 [pdf, html, other]

Title: Learning to Ask Informative Questions: Enhancing LLMs with Preference Optimization and Expected Information Gain

Davide Mazzaccara, Alberto Testoni, Raffaella Bernardi

Comments: Accepted to EMNLP 2024 (Findings)

Subjects: Computation and Language (cs.CL)

[1556] arXiv:2406.17456 [pdf, html, other]

Title: Improving Grammatical Error Correction via Contextual Data Augmentation

Yixuan Wang, Baoxin Wang, Yijun Liu, Qingfu Zhu, Dayong Wu, Wanxiang Che

Comments: Accepted as Findings of ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1557] arXiv:2406.17465 [pdf, html, other]

Title: Enhancing Tool Retrieval with Iterative Feedback from Large Language Models

Qiancheng Xu, Yongqi Li, Heming Xia, Wenjie Li

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1558] arXiv:2406.17474 [pdf, html, other]

Title: Transformer-based Named Entity Recognition with Combined Data Representation

Michał Marcińczuk

Comments: 14 pages, 6 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1559] arXiv:2406.17484 [pdf, html, other]

Title: MedCare: Advancing Medical LLMs through Decoupling Clinical Alignment and Knowledge Aggregation

Yusheng Liao, Shuyang Jiang, Zhe Chen, Yanfeng Wang, Yu Wang

Comments: EMNLP2024 Findings

Subjects: Computation and Language (cs.CL)

[1560] arXiv:2406.17513 [pdf, html, other]

Title: Benchmarking Mental State Representations in Language Models

Matteo Bortoletto, Constantin Ruhdorfer, Lei Shi, Andreas Bulling

Comments: ICML 2024 Workshop on Mechanistic Interpretability

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1561] arXiv:2406.17519 [pdf, html, other]

Title: Entropy-Based Decoding for Retrieval-Augmented Large Language Models

Zexuan Qiu, Zijing Ou, Bin Wu, Jingjing Li, Aiwei Liu, Irwin King

Subjects: Computation and Language (cs.CL)

[1562] arXiv:2406.17526 [pdf, html, other]

Title: LumberChunker: Long-Form Narrative Document Segmentation

André V. Duarte, João Marques, Miguel Graça, Miguel Freire, Lei Li, Arlindo L. Oliveira

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1563] arXiv:2406.17534 [pdf, html, other]

Title: Retrieval-style In-Context Learning for Few-shot Hierarchical Text Classification

Huiyao Chen, Yu Zhao, Zulong Chen, Mengjia Wang, Liangyue Li, Meishan Zhang, Min Zhang

Comments: 17 pages

Subjects: Computation and Language (cs.CL)

[1564] arXiv:2406.17535 [pdf, html, other]

Title: Disce aut Deficere: Evaluating LLMs Proficiency on the INVALSI Italian Benchmark

Fabio Mercorio, Mario Mezzanzanica, Daniele Potertì, Antonio Serino, Andrea Seveso

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1565] arXiv:2406.17553 [pdf, html, other]

Title: Retrieval-Augmented Code Generation for Situated Action Generation: A Case Study on Minecraft

Chalamalasetti Kranti, Sherzod Hakimov, David Schlangen

Comments: under review

Subjects: Computation and Language (cs.CL)

[1566] arXiv:2406.17557 [pdf, html, other]

Title: The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Guilherme Penedo, Hynek Kydlíček, Loubna Ben allal, Anton Lozhkov, Margaret Mitchell, Colin Raffel, Leandro Von Werra, Thomas Wolf

Subjects: Computation and Language (cs.CL)

[1567] arXiv:2406.17563 [pdf, html, other]

Title: Multi-property Steering of Large Language Models with Dynamic Activation Composition

Daniel Scalena, Gabriele Sarti, Malvina Nissim

Journal-ref: Proceedings of BlackBoxNLP (2024) 577-603

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1568] arXiv:2406.17566 [pdf, html, other]

Title: FrenchToxicityPrompts: a Large Benchmark for Evaluating and Mitigating Toxicity in French Texts

Caroline Brun, Vassilina Nikoulina

Comments: TRAC-2024, Fourth Workshop on Threat, Aggression and Cyberbullying. 20 May 2024

Subjects: Computation and Language (cs.CL)

[1569] arXiv:2406.17574 [pdf, html, other]

Title: Beyond Text-to-SQL for IoT Defense: A Comprehensive Framework for Querying and Classifying IoT Threats

Ryan Pavlich, Nima Ebadi, Richard Tarbell, Billy Linares, Adrian Tan, Rachael Humphreys, Jayanta Kumar Das, Rambod Ghandiparsi, Hannah Haley, Jerris George, Rocky Slavin, Kim-Kwang Raymond Choo, Glenn Dietrich, Anthony Rios

Subjects: Computation and Language (cs.CL)

[1570] arXiv:2406.17588 [pdf, html, other]

Title: LongIns: A Challenging Long-context Instruction-based Exam for LLMs

Shawn Gavin, Tuney Zheng, Jiaheng Liu, Quehry Que, Noah Wang, Jian Yang, Chenchen Zhang, Wenhao Huang, Wenhu Chen, Ge Zhang

Subjects: Computation and Language (cs.CL)

[1571] arXiv:2406.17600 [pdf, html, other]

Title: "Seeing the Big through the Small": Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?

Beiduo Chen, Xinpeng Wang, Siyao Peng, Robert Litschko, Anna Korhonen, Barbara Plank

Comments: Accepted by EMNLP 2024 Findings, 24 pages, 9 figures

Subjects: Computation and Language (cs.CL)

[1572] arXiv:2406.17624 [pdf, html, other]

Title: Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models

Zhiyuan Wen, Yu Yang, Jiannong Cao, Haoming Sun, Ruosong Yang, Shuaiqi Liu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1573] arXiv:2406.17626 [pdf, other]

Title: CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreference

Erxin Yu, Jing Li, Ming Liao, Siqi Wang, Zuchen Gao, Fei Mi, Lanqing Hong

Comments: Submitted to EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1574] arXiv:2406.17633 [pdf, html, other]

Title: Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels

Nicholas Pangakis, Samuel Wolken

Comments: In Proceedings of the Sixth Workshop on Natural Language Processing and Computational Social Science

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1575] arXiv:2406.17642 [pdf, html, other]

Title: Banishing LLM Hallucinations Requires Rethinking Generalization

Johnny Li, Saksham Consul, Eda Zhou, James Wong, Naila Farooqui, Yuxin Ye, Nithyashree Manohar, Zhuxiaona Wei, Tian Wu, Ben Echols, Sharon Zhou, Gregory Diamos

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1576] arXiv:2406.17647 [pdf, html, other]

Title: Variationist: Exploring Multifaceted Variation and Bias in Written Language Data

Alan Ramponi, Camilla Casula, Stefano Menini

Comments: ACL 2024 (System Demonstrations)

Subjects: Computation and Language (cs.CL)

[1577] arXiv:2406.17663 [pdf, html, other]

Title: LLM-ARC: Enhancing LLMs with an Automated Reasoning Critic

Aditya Kalyanpur, Kailash Karthik Saravanakumar, Victor Barres, Jennifer Chu-Carroll, David Melville, David Ferrucci

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Logic in Computer Science (cs.LO)

[1578] arXiv:2406.17675 [pdf, html, other]

Title: Quantifying AI Psychology: A Psychometrics Benchmark for Large Language Models

Yuan Li, Yue Huang, Hongyi Wang, Xiangliang Zhang, James Zou, Lichao Sun

Subjects: Computation and Language (cs.CL)

[1579] arXiv:2406.17681 [pdf, html, other]

Title: VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation

Kun Qian, Shunji Wan, Claudia Tang, Youzhi Wang, Xuanming Zhang, Maximillian Chen, Zhou Yu

Subjects: Computation and Language (cs.CL)

[1580] arXiv:2406.17692 [pdf, other]

Title: From Distributional to Overton Pluralism: Investigating Large Language Model Alignment

Thom Lake, Eunsol Choi, Greg Durrett

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1581] arXiv:2406.17716 [pdf, html, other]

Title: ViANLI: Adversarial Natural Language Inference for Vietnamese

Tin Van Huynh, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen

Subjects: Computation and Language (cs.CL)

[1582] arXiv:2406.17737 [pdf, html, other]

Title: LLM Targeted Underperformance Disproportionately Impacts Vulnerable Users

Elinor Poole-Dayan, Deb Roy, Jad Kabbara

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1583] arXiv:2406.17739 [pdf, html, other]

Title: Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model

Fei Xia, Yixuan Weng, Shizhu He, Kang Liu, Jun Zhao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1584] arXiv:2406.17744 [pdf, html, other]

Title: Following Length Constraints in Instructions

Weizhe Yuan, Ilia Kulikov, Ping Yu, Kyunghyun Cho, Sainbayar Sukhbaatar, Jason Weston, Jing Xu

Comments: 13 pages

Subjects: Computation and Language (cs.CL)

[1585] arXiv:2406.17746 [pdf, html, other]

Title: Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon

USVSN Sai Prashanth, Alvin Deng, Kyle O'Brien, Jyothir S V, Mohammad Aflah Khan, Jaydeep Borkar, Christopher A. Choquette-Choo, Jacob Ray Fuehne, Stella Biderman, Tracy Ke, Katherine Lee, Naomi Saphra

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1586] arXiv:2406.17753 [pdf, other]

Title: Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Language

Amalie Brogaard Pauli, Isabelle Augenstein, Ira Assent

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1587] arXiv:2406.17755 [pdf, html, other]

Title: Accelerating Clinical Evidence Synthesis with Large Language Models

Zifeng Wang, Lang Cao, Benjamin Danek, Qiao Jin, Zhiyong Lu, Jimeng Sun

Subjects: Computation and Language (cs.CL)

[1588] arXiv:2406.17761 [pdf, html, other]

Title: CaLMQA: Exploring culturally specific long-form question answering across 23 languages

Shane Arora, Marzena Karpinska, Hung-Ting Chen, Ipsita Bhattacharjee, Mohit Iyyer, Eunsol Choi

Comments: 39 pages, 17 figures. Code and data available at this https URL. Revised argument in section 4, results unchanged

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1589] arXiv:2406.17764 [pdf, html, other]

Title: BMIKE-53: Investigating Cross-Lingual Knowledge Editing with In-Context Learning

Ercong Nie, Bo Shao, Zifeng Ding, Mingyang Wang, Helmut Schmid, Hinrich Schütze

Comments: 12 pages, 4 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1590] arXiv:2406.17787 [pdf, other]

Title: Role of Dependency Distance in Text Simplification: A Human vs ChatGPT Simplification Comparison

Sumi Lee, Gondy Leroy, David Kauchak, Melissa Just

Subjects: Computation and Language (cs.CL)

[1591] arXiv:2406.17789 [pdf, html, other]

Title: Spanish and LLM Benchmarks: is MMLU Lost in Translation?

Irene Plaza, Nina Melero, Cristina del Pozo, Javier Conde, Pedro Reviriego, Marina Mayor-Rocher, María Grandury

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1592] arXiv:2406.17790 [pdf, html, other]

Title: Mashee at SemEval-2024 Task 8: The Impact of Samples Quality on the Performance of In-Context Learning for Machine Text Classification

Areeg Fahad Rasheed, M. Zarkoosh

Subjects: Computation and Language (cs.CL)

[1593] arXiv:2406.17803 [pdf, html, other]

Title: Understanding the Role of User Profile in the Personalization of Large Language Models

Bin Wu, Zhengyan Shi, Hossein A. Rahmani, Varsha Ramineni, Emine Yilmaz

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[1594] arXiv:2406.17805 [pdf, html, other]

Title: Can LLMs Generate Visualizations with Dataless Prompts?

Darius Coelho, Harshit Barot, Naitik Rathod, Klaus Mueller

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[1595] arXiv:2406.17806 [pdf, html, other]

Title: MOSSBench: Is Your Multimodal Language Model Oversensitive to Safe Queries?

Xirui Li, Hengguang Zhou, Ruochen Wang, Tianyi Zhou, Minhao Cheng, Cho-Jui Hsieh

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1596] arXiv:2406.17807 [pdf, other]

Title: Enhancing Commentary Strategies for Imperfect Information Card Games: A Study of Large Language Models in Guandan Commentary

Meiling Tao, Xuechen Liang, Ziyi Wang, Yiling Tao, Tianyu Shi

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1597] arXiv:2406.17808 [pdf, html, other]

Title: Training-Free Exponential Context Extension via Cascading KV Cache

Jeffrey Willette, Heejun Lee, Youngwan Lee, Myeongjae Jeon, Sung Ju Hwang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1598] arXiv:2406.17825 [pdf, other]

Title: Automatic speech recognition for the Nepali language using CNN, bidirectional LSTM and ResNet

Manish Dhakal, Arman Chhetri, Aman Kumar Gupta, Prabin Lamichhane, Suraj Pandey, Subarna Shakya

Comments: Accepted at 2022 International Conference on Inventive Computation Technologies (ICICT), IEEE

Journal-ref: 2022 International Conference on Inventive Computation Technologies (ICICT), pp. 515-521

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1599] arXiv:2406.17873 [pdf, html, other]

Title: Improving Arithmetic Reasoning Ability of Large Language Models through Relation Tuples, Verification and Dynamic Feedback

Zhongtao Miao, Kaiyan Zhao, Yoshimasa Tsuruoka

Comments: Under review, 25 figures, 8 tables, 29 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1600] arXiv:2406.17875 [pdf, html, other]

Title: Cloaked Classifiers: Pseudonymization Strategies on Sensitive Classification Tasks

Arij Riabi, Menel Mahamdi, Virginie Mouilleron, Djamé Seddah

Comments: Proceedings of the fifth Workshop on Privacy in Natural Language Processing

Subjects: Computation and Language (cs.CL)