Computation and Language

Authors and titles for June 2024

[451] arXiv:2406.06140 [pdf, html, other]

Title: Can I understand what I create? Self-Knowledge Evaluation of Large Language Models

Zhiquan Tan, Lai Wei, Jindong Wang, Xing Xie, Weiran Huang

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[452] arXiv:2406.06144 [pdf, html, other]

Title: Language Models Resist Alignment: Evidence From Data Compression

Jiaming Ji, Kaile Wang, Tianyi Qiu, Boyuan Chen, Jiayi Zhou, Changye Li, Hantao Lou, Josef Dai, Yunhuai Liu, Yaodong Yang

Comments: The five-page version has been accepted by NeurIPS 2024 Workshop SoLaR. In the current version, we have conducted an in-depth expansion of both the theoretical and experimental aspects

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[453] arXiv:2406.06196 [pdf, html, other]

Title: LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages

Andrew M. Bean, Simi Hellsten, Harry Mayne, Jabez Magomere, Ethan A. Chi, Ryan Chi, Scott A. Hale, Hannah Rose Kirk

Comments: Oral presentation at NeurIPS 2024 Datasets and Benchmarks Track. 10 pages, 5 figures, 22 pages supplemental materials

Subjects: Computation and Language (cs.CL)

[454] arXiv:2406.06257 [pdf, html, other]

Title: Combining Embeddings and Domain Knowledge for Job Posting Duplicate Detection

Matthias Engelbach, Dennis Klau, Maximilien Kintz, Alexander Ulrich

Comments: To be published at 9th International Symposium on Language & Knowledge Engineering LKE 2024

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[455] arXiv:2406.06263 [pdf, html, other]

Title: MaskLID: Code-Switching Language Identification through Iterative Masking

Amir Hossein Kargaran, François Yvon, Hinrich Schütze

Comments: ACL 2024

Subjects: Computation and Language (cs.CL)

[456] arXiv:2406.06279 [pdf, html, other]

Title: Multi-Prompting Decoder Helps Better Language Understanding

Zifeng Cheng, Zhaoling Chen, Zhiwei Jiang, Yafeng Yin, Shiping Ge, Yuliang Liu, Qing Gu

Subjects: Computation and Language (cs.CL)

[457] arXiv:2406.06316 [pdf, html, other]

Title: Tx-LLM: A Large Language Model for Therapeutics

Juan Manuel Zambrano Chaves, Eric Wang, Tao Tu, Eeshit Dhaval Vaishnav, Byron Lee, S. Sara Mahdavi, Christopher Semturs, David Fleet, Vivek Natarajan, Shekoofeh Azizi

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG)

[458] arXiv:2406.06326 [pdf, html, other]

Title: Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching

Xiaoying Zhang, Baolin Peng, Ye Tian, Jingyan Zhou, Yipeng Zhang, Haitao Mi, Helen Meng

Comments: 30 pages

Subjects: Computation and Language (cs.CL)

[459] arXiv:2406.06329 [pdf, html, other]

Title: A Parameter-efficient Language Extension Framework for Multilingual ASR

Wei Liu, Jingyong Hou, Dong Yang, Muyong Cao, Tan Lee

Comments: Accepted by Interspeech 2024

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[460] arXiv:2406.06331 [pdf, html, other]

Title: MedExQA: Medical Question Answering Benchmark with Multiple Explanations

Yunsoo Kim, Jinge Wu, Yusuf Abdulle, Honghan Wu

Comments: Accepted to ACL2024 BioNLP Workshop

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[461] arXiv:2406.06355 [pdf, html, other]

Title: Sustained Vowels for Pre- vs Post-Treatment COPD Classification

Andreas Triantafyllopoulos, Anton Batliner, Wolfgang Mayr, Markus Fendler, Florian Pokorny, Maurice Gerczuk, Shahin Amiriparian, Thomas Berghaus, Björn Schuller

Comments: Accepted to INTERSPEECH 2024

Subjects: Computation and Language (cs.CL)

[462] arXiv:2406.06357 [pdf, html, other]

Title: MASSW: A New Dataset and Benchmark Tasks for AI-Assisted Scientific Workflows

Xingjian Zhang, Yutong Xie, Jin Huang, Jinge Ma, Zhaoying Pan, Qijia Liu, Ziyang Xiong, Tolga Ergen, Dongsub Shim, Honglak Lee, Qiaozhu Mei

Comments: arXiv admin note: text overlap with arXiv:1706.03762 by other authors

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[463] arXiv:2406.06366 [pdf, html, other]

Title: Symmetric Dot-Product Attention for Efficient Training of BERT Language Models

Martin Courtois, Malte Ostendorff, Leonhard Hennig, Georg Rehm

Comments: to be published in Findings of the Association for Computational Linguistics: ACL 2024

Subjects: Computation and Language (cs.CL)

[464] arXiv:2406.06369 [pdf, html, other]

Title: Annotation alignment: Comparing LLM and human annotations of conversational safety

Rajiv Movva, Pang Wei Koh, Emma Pierson

Comments: EMNLP 2024 (Main). Main text contains 6 pages, 2 figures

Subjects: Computation and Language (cs.CL)

[465] arXiv:2406.06371 [pdf, html, other]

Title: mHuBERT-147: A Compact Multilingual HuBERT Model

Marcely Zanon Boito, Vivek Iyer, Nikolaos Lagos, Laurent Besacier, Ioan Calapodescu

Comments: Extended version of the Interspeech 2024 paper of same name

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[466] arXiv:2406.06399 [pdf, html, other]

Title: Should We Fine-Tune or RAG? Evaluating Different Techniques to Adapt LLMs for Dialogue

Simone Alghisi, Massimo Rizzoli, Gabriel Roccabruna, Seyed Mahed Mousavi, Giuseppe Riccardi

Comments: Accepted at INLG 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[467] arXiv:2406.06401 [pdf, html, other]

Title: INTERSPEECH 2009 Emotion Challenge Revisited: Benchmarking 15 Years of Progress in Speech Emotion Recognition

Andreas Triantafyllopoulos, Anton Batliner, Simon Rampp, Manuel Milling, Björn Schuller

Comments: Accepted to INTERSPEECH 2024

Subjects: Computation and Language (cs.CL)

[468] arXiv:2406.06403 [pdf, html, other]

Title: Meta Learning Text-to-Speech Synthesis in over 7000 Languages

Florian Lux, Sarina Meyer, Lyonel Behringer, Frank Zalkow, Phat Do, Matt Coler, Emanuël A. P. Habets, Ngoc Thang Vu

Comments: accepted at Interspeech 2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[469] arXiv:2406.06406 [pdf, html, other]

Title: Controlling Emotion in Text-to-Speech with Natural Language Prompts

Thomas Bott, Florian Lux, Ngoc Thang Vu

Comments: accepted at Interspeech 2024

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[470] arXiv:2406.06435 [pdf, html, other]

Title: Language Models are Alignable Decision-Makers: Dataset and Application to the Medical Triage Domain

Brian Hu, Bill Ray, Alice Leung, Amy Summerville, David Joy, Christopher Funk, Arslan Basharat

Comments: 15 pages total (including appendix), NAACL 2024 Industry Track

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[471] arXiv:2406.06438 [pdf, html, other]

Title: Multimodal Contextualized Semantic Parsing from Speech

Jordan Voas, Raymond Mooney, David Harwath

Comments: 10 Pages, 3 figures, ACL 2024 Main

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[472] arXiv:2406.06441 [pdf, html, other]

Title: Interpretability of Language Models via Task Spaces

Lucas Weber, Jaap Jumelet, Elia Bruni, Dieuwke Hupkes

Comments: To be published at ACL 2024 (main)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[473] arXiv:2406.06458 [pdf, html, other]

Title: Evaluating the Retrieval Component in LLM-Based Question Answering Systems

Ashkan Alinejad, Krtin Kumar, Ali Vahdat

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[474] arXiv:2406.06461 [pdf, html, other]

Title: Reasoning in Token Economies: Budget-Aware Evaluation of LLM Reasoning Strategies

Junlin Wang, Siddhartha Jain, Dejiao Zhang, Baishakhi Ray, Varun Kumar, Ben Athiwaratkun

Subjects: Computation and Language (cs.CL)

[475] arXiv:2406.06485 [pdf, html, other]

Title: Can Language Models Serve as Text-Based World Simulators?

Ruoyao Wang, Graham Todd, Ziang Xiao, Xingdi Yuan, Marc-Alexandre Côté, Peter Clark, Peter Jansen

Comments: ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[476] arXiv:2406.06556 [pdf, html, other]

Title: Enhancing Presentation Slide Generation by LLMs with a Multi-Staged End-to-End Approach

Sambaran Bandyopadhyay, Himanshu Maheshwari, Anandhavelu Natarajan, Apoorv Saxena

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[477] arXiv:2406.06558 [pdf, html, other]

Title: Enhancing Text Authenticity: A Novel Hybrid Approach for AI-Generated Text Detection

Ye Zhang, Qian Leng, Mengran Zhu, Rui Ding, Yue Wu, Jintong Song, Yulu Gong

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[478] arXiv:2406.06559 [pdf, html, other]

Title: Harnessing Business and Media Insights with Large Language Models

Yujia Bao, Ankit Parag Shah, Neeru Narang, Jonathan Rivers, Rajeev Maksey, Lan Guan, Louise N. Barrere, Shelley Evenson, Rahul Basole, Connie Miao, Ankit Mehta, Fabien Boulay, Su Min Park, Natalie E. Pearson, Eldhose Joy, Tiger He, Sumiran Thakur, Koustav Ghosal, Josh On, Phoebe Morrison, Tim Major, Eva Siqi Wang, Gina Escobar, Jiaheng Wei, Tharindu Cyril Weerasooriya, Queena Song, Daria Lashkevich, Clare Chen, Gyuhak Kim, Dengpan Yin, Don Hejna, Mo Nomeli, Wei Wei

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[479] arXiv:2406.06560 [pdf, html, other]

Title: Inverse Constitutional AI: Compressing Preferences into Principles

Arduin Findeis, Timo Kaufmann, Eyke Hüllermeier, Samuel Albanie, Robert Mullins

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[480] arXiv:2406.06561 [pdf, html, other]

Title: Brainstorming Brings Power to Large Language Models of Knowledge Reasoning

Zining Qin, Chenhao Wang, Huiling Qin, Weijia Jia

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[481] arXiv:2406.06562 [pdf, html, other]

Title: Achieving Sparse Activation in Small Language Models

Jifeng Song, Kai Huang, Xiangyu Yin, Boyuan Yang, Wei Gao

Comments: 15 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[482] arXiv:2406.06563 [pdf, html, other]

Title: Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models

Tianwen Wei, Bo Zhu, Liang Zhao, Cheng Cheng, Biye Li, Weiwei Lü, Peng Cheng, Jianhao Zhang, Xiaoyu Zhang, Liang Zeng, Xiaokun Wang, Yutuan Ma, Rui Hu, Shuicheng Yan, Han Fang, Yahui Zhou

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[483] arXiv:2406.06565 [pdf, other]

Title: MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures

Jinjie Ni, Fuzhao Xue, Xiang Yue, Yuntian Deng, Mahir Shah, Kabir Jain, Graham Neubig, Yang You

Comments: Accepted to NeurIPS 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[484] arXiv:2406.06566 [pdf, html, other]

Title: Natural Language Interaction with a Household Electricity Knowledge-based Digital Twin

Carolina Fortuna, Vid Hanžel, Blaž Bertalanič

Comments: Accepted at IEEE SmartGridComm'24

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[485] arXiv:2406.06569 [pdf, other]

Title: Enhancing Clinical Documentation with Synthetic Data: Leveraging Generative Models for Improved Accuracy

Anjanava Biswas, Wrick Talukdar

Journal-ref: International Journal of Innovative Science and Research Technology: Vol. 9 (2024): No. 5, 1553-1566

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[486] arXiv:2406.06570 [pdf, html, other]

Title: Review of Computational Epigraphy

Vishal Kumar

Subjects: Computation and Language (cs.CL)

[487] arXiv:2406.06571 [pdf, html, other]

Title: SUBLLM: A Novel Efficient Architecture with Token Sequence Subsampling for LLM

Quandong Wang, Yuxuan Yuan, Xiaoyu Yang, Ruike Zhang, Kang Zhao, Wei Liu, Jian Luan, Daniel Povey, Bin Wang

Comments: 10 pages, 5 figures, accepted by ECAI 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[488] arXiv:2406.06572 [pdf, html, other]

Title: Graph Neural Network Enhanced Retrieval for Question Answering of LLMs

Zijian Li, Qingyan Guo, Jiawei Shao, Lei Song, Jiang Bian, Jun Zhang, Rui Wang

Comments: Under review

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[489] arXiv:2406.06573 [pdf, html, other]

Title: MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering

Robert Osazuwa Ness, Katie Matton, Hayden Helm, Sheng Zhang, Junaid Bajwa, Carey E. Priebe, Eric Horvitz

Comments: 9 pages, 3 figures, 2 algorithms, appendix

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[490] arXiv:2406.06574 [pdf, html, other]

Title: Towards Transparency: Exploring LLM Trainings Datasets through Visual Topic Modeling and Semantic Frame

Charles de Dampierre, Andrei Mogoutov, Nicolas Baumard

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[491] arXiv:2406.06575 [pdf, html, other]

Title: Ask-EDA: A Design Assistant Empowered by LLM, Hybrid RAG and Abbreviation De-hallucination

Luyao Shi, Michael Kazda, Bradley Sears, Nick Shropshire, Ruchir Puri

Comments: Accepted paper at The First IEEE International Workshop on LLM-Aided Design, 2024 (LAD 24)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[492] arXiv:2406.06576 [pdf, html, other]

Title: OccamLLM: Fast and Exact Language Model Arithmetic in a Single Step

Owen Dugan, Donato Manuel Jimenez Beneto, Charlotte Loh, Zhuo Chen, Rumen Dangovski, Marin Soljačić

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[493] arXiv:2406.06577 [pdf, html, other]

Title: RAG-based Crowdsourcing Task Decomposition via Masked Contrastive Learning with Prompts

Jing Yang, Xiao Wang, Yu Zhao, Yuhang Liu, Fei-Yue Wang

Comments: 13 pages, 9 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[494] arXiv:2406.06578 [pdf, other]

Title: SMS Spam Detection and Classification to Combat Abuse in Telephone Networks Using Natural Language Processing

Dare Azeez Oyeyemi, Adebola K. Ojo

Comments: 13 pages, 8 figures, 3 tables

Journal-ref: Volume 38, Issue 10, Page 144-156, 2023; Article no.JAMCS.108409 ISSN: 2456-9968

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[495] arXiv:2406.06579 [pdf, html, other]

Title: From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning Tasks

Xiaofeng Zhang, Yihao Quan, Chen Shen, Xiaosong Yuan, Shaotian Yan, Liang Xie, Wenxiao Wang, Chaochen Gu, Hao Tang, Jieping Ye

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[496] arXiv:2406.06580 [pdf, html, other]

Title: Break the Chain: Large Language Models Can be Shortcut Reasoners

Mengru Ding, Hanmeng Liu, Zhizhang Fu, Jian Song, Wenbo Xie, Yue Zhang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[497] arXiv:2406.06581 [pdf, html, other]

Title: Order-Independence Without Fine Tuning

Reid McIlroy-Young, Katrina Brown, Conlan Olson, Linjun Zhang, Cynthia Dwork

Comments: 29 pages, 27 figures, Published in NeurIPS 2024 code this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[498] arXiv:2406.06582 [pdf, html, other]

Title: Discrete Multimodal Transformers with a Pretrained Large Language Model for Mixed-Supervision Speech Processing

Viet Anh Trinh, Rosy Southwell, Yiwen Guan, Xinlu He, Zhiyong Wang, Jacob Whitehill

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[499] arXiv:2406.06584 [pdf, other]

Title: Evaluating the Efficacy of Large Language Models in Detecting Fake News: A Comparative Analysis

Sahas Koka, Anthony Vuong, Anish Kataria

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[500] arXiv:2406.06586 [pdf, other]

Title: Bi-Chainer: Automated Large Language Models Reasoning with Bidirectional Chaining

Shuqi Liu, Bowei He, Linqi Song

Comments: Accepted by ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)