Computation and Language

Authors and titles for June 2024

[1551] arXiv:2406.17404 [pdf, html, other]

Title: Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training

Yixuan Wang, Xianzhen Luo, Fuxuan Wei, Yijun Liu, Qingfu Zhu, Xuanyu Zhang, Qing Yang, Dongliang Xu, Wanxiang Che

Comments: EMNLP 2024, camera ready

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1552] arXiv:2406.17415 [pdf, html, other]

Title: Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels

Razvan-Gabriel Dumitru, Vikas Yadav, Rishabh Maheshwary, Paul-Ioan Clotan, Sathwik Tejaswi Madhusudhan, Mihai Surdeanu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1553] arXiv:2406.17419 [pdf, html, other]

Title: Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA

Minzheng Wang, Longze Chen, Cheng Fu, Shengyi Liao, Xinghua Zhang, Bingli Wu, Haiyang Yu, Nan Xu, Lei Zhang, Run Luo, Yunshui Li, Min Yang, Fei Huang, Yongbin Li

Comments: EMNLP 2024 Main. We release our code and data publicly at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1554] arXiv:2406.17430 [pdf, html, other]

Title: Towards Probing Speech-Specific Risks in Large Multimodal Models: A Taxonomy, Benchmark, and Insights

Hao Yang, Lizhen Qu, Ehsan Shareghi, Gholamreza Haffari

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1555] arXiv:2406.17453 [pdf, html, other]

Title: Learning to Ask Informative Questions: Enhancing LLMs with Preference Optimization and Expected Information Gain

Davide Mazzaccara, Alberto Testoni, Raffaella Bernardi

Comments: Accepted to EMNLP 2024 (Findings)

Subjects: Computation and Language (cs.CL)

[1556] arXiv:2406.17456 [pdf, html, other]

Title: Improving Grammatical Error Correction via Contextual Data Augmentation

Yixuan Wang, Baoxin Wang, Yijun Liu, Qingfu Zhu, Dayong Wu, Wanxiang Che

Comments: Accepted as Findings of ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1557] arXiv:2406.17465 [pdf, html, other]

Title: Enhancing Tool Retrieval with Iterative Feedback from Large Language Models

Qiancheng Xu, Yongqi Li, Heming Xia, Wenjie Li

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1558] arXiv:2406.17474 [pdf, html, other]

Title: Transformer-based Named Entity Recognition with Combined Data Representation

Michał Marcińczuk

Comments: 14 pages, 6 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1559] arXiv:2406.17484 [pdf, html, other]

Title: MedCare: Advancing Medical LLMs through Decoupling Clinical Alignment and Knowledge Aggregation

Yusheng Liao, Shuyang Jiang, Zhe Chen, Yanfeng Wang, Yu Wang

Comments: EMNLP2024 Findings

Subjects: Computation and Language (cs.CL)

[1560] arXiv:2406.17513 [pdf, html, other]

Title: Benchmarking Mental State Representations in Language Models

Matteo Bortoletto, Constantin Ruhdorfer, Lei Shi, Andreas Bulling

Comments: ICML 2024 Workshop on Mechanistic Interpretability

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1561] arXiv:2406.17519 [pdf, html, other]

Title: Entropy-Based Decoding for Retrieval-Augmented Large Language Models

Zexuan Qiu, Zijing Ou, Bin Wu, Jingjing Li, Aiwei Liu, Irwin King

Subjects: Computation and Language (cs.CL)

[1562] arXiv:2406.17526 [pdf, html, other]

Title: LumberChunker: Long-Form Narrative Document Segmentation

André V. Duarte, João Marques, Miguel Graça, Miguel Freire, Lei Li, Arlindo L. Oliveira

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1563] arXiv:2406.17534 [pdf, html, other]

Title: Retrieval-style In-Context Learning for Few-shot Hierarchical Text Classification

Huiyao Chen, Yu Zhao, Zulong Chen, Mengjia Wang, Liangyue Li, Meishan Zhang, Min Zhang

Comments: 17 pages

Subjects: Computation and Language (cs.CL)

[1564] arXiv:2406.17535 [pdf, html, other]

Title: Disce aut Deficere: Evaluating LLMs Proficiency on the INVALSI Italian Benchmark

Fabio Mercorio, Mario Mezzanzanica, Daniele Potertì, Antonio Serino, Andrea Seveso

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1565] arXiv:2406.17553 [pdf, html, other]

Title: Retrieval-Augmented Code Generation for Situated Action Generation: A Case Study on Minecraft

Chalamalasetti Kranti, Sherzod Hakimov, David Schlangen

Comments: under review

Subjects: Computation and Language (cs.CL)

[1566] arXiv:2406.17557 [pdf, html, other]

Title: The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Guilherme Penedo, Hynek Kydlíček, Loubna Ben allal, Anton Lozhkov, Margaret Mitchell, Colin Raffel, Leandro Von Werra, Thomas Wolf

Subjects: Computation and Language (cs.CL)

[1567] arXiv:2406.17563 [pdf, html, other]

Title: Multi-property Steering of Large Language Models with Dynamic Activation Composition

Daniel Scalena, Gabriele Sarti, Malvina Nissim

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1568] arXiv:2406.17566 [pdf, html, other]

Title: FrenchToxicityPrompts: a Large Benchmark for Evaluating and Mitigating Toxicity in French Texts

Caroline Brun, Vassilina Nikoulina

Comments: TRAC-2024, Fourth Workshop on Threat, Aggression and Cyberbullying. 20 May 2024

Subjects: Computation and Language (cs.CL)

[1569] arXiv:2406.17574 [pdf, html, other]

Title: Beyond Text-to-SQL for IoT Defense: A Comprehensive Framework for Querying and Classifying IoT Threats

Ryan Pavlich, Nima Ebadi, Richard Tarbell, Billy Linares, Adrian Tan, Rachael Humphreys, Jayanta Kumar Das, Rambod Ghandiparsi, Hannah Haley, Jerris George, Rocky Slavin, Kim-Kwang Raymond Choo, Glenn Dietrich, Anthony Rios

Subjects: Computation and Language (cs.CL)

[1570] arXiv:2406.17588 [pdf, html, other]

Title: LongIns: A Challenging Long-context Instruction-based Exam for LLMs

Shawn Gavin, Tuney Zheng, Jiaheng Liu, Quehry Que, Noah Wang, Jian Yang, Chenchen Zhang, Wenhao Huang, Wenhu Chen, Ge Zhang

Subjects: Computation and Language (cs.CL)

[1571] arXiv:2406.17600 [pdf, html, other]

Title: "Seeing the Big through the Small": Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?

Beiduo Chen, Xinpeng Wang, Siyao Peng, Robert Litschko, Anna Korhonen, Barbara Plank

Comments: Accepted by EMNLP 2024 Findings, 24 pages, 9 figures

Subjects: Computation and Language (cs.CL)

[1572] arXiv:2406.17624 [pdf, html, other]

Title: Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models

Zhiyuan Wen, Yu Yang, Jiannong Cao, Haoming Sun, Ruosong Yang, Shuaiqi Liu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1573] arXiv:2406.17626 [pdf, other]

Title: CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreference

Erxin Yu, Jing Li, Ming Liao, Siqi Wang, Zuchen Gao, Fei Mi, Lanqing Hong

Comments: Submitted to EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1574] arXiv:2406.17633 [pdf, html, other]

Title: Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training Labels

Nicholas Pangakis, Samuel Wolken

Comments: In Proceedings of the Sixth Workshop on Natural Language Processing and Computational Social Science

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1575] arXiv:2406.17642 [pdf, html, other]

Title: Banishing LLM Hallucinations Requires Rethinking Generalization

Johnny Li, Saksham Consul, Eda Zhou, James Wong, Naila Farooqui, Yuxin Ye, Nithyashree Manohar, Zhuxiaona Wei, Tian Wu, Ben Echols, Sharon Zhou, Gregory Diamos

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)