Computation and Language

Authors and titles for November 2024

[51] arXiv:2411.00816 [pdf, other]

Title: CycleResearcher: Improving Automated Research via Automated Review

Yixuan Weng, Minjun Zhu, Guangsheng Bao, Hongbo Zhang, Jindong Wang, Yue Zhang, Linyi Yang

Comments: Accept in ICLR 2025

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)

[52] arXiv:2411.00860 [pdf, html, other]

Title: Survey of Cultural Awareness in Language Models: Text and Beyond

Siddhesh Pawar, Junyeong Park, Jiho Jin, Arnav Arora, Junho Myung, Srishti Yadav, Faiz Ghifari Haznitrama, Inhwa Song, Alice Oh, Isabelle Augenstein

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[53] arXiv:2411.00863 [pdf, html, other]

Title: Next-Token Prediction Task Assumes Optimal Data Ordering for LLM Training in Proof Generation

Chenyang An, Shima Imani, Feng Yao, Chengyu Dong, Ali Abbasi, Harsh Shrivastava, Samuel Buss, Jingbo Shang, Gayathri Mahalingam, Pramod Sharma, Maurice Diesendruck

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[54] arXiv:2411.00878 [pdf, html, other]

Title: Exploring the Knowledge Mismatch Hypothesis: Hallucination Propensity in Small Models Fine-tuned on Data from Larger Models

Phil Wee, Riyadh Baghdadi

Comments: 6 pages, 3 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[55] arXiv:2411.00890 [pdf, html, other]

Title: Rethinking Scale: The Efficacy of Fine-Tuned Open-Source LLMs in Large-Scale Reproducible Social Science Research

Marcello Carammia, Stefano Maria Iacus, Giuseppe Porro

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[56] arXiv:2411.00897 [pdf, html, other]

Title: Enhancing the Traditional Chinese Medicine Capabilities of Large Language Model through Reinforcement Learning from AI Feedback

Song Yu, Xiaofei Xu, Fangfei Xu, Li Li

Comments: 9 pages, 2 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[57] arXiv:2411.00918 [pdf, html, other]

Title: LIBMoE: A Library for comprehensive benchmarking Mixture of Experts in Large Language Models

Nam V. Nguyen, Thong T. Doan, Luong Tran, Van Nguyen, Quang Pham

Comments: 15 pages, 9 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[58] arXiv:2411.00927 [pdf, html, other]

Title: ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agents

Vardhan Dongre, Xiaocheng Yang, Emre Can Acikgoz, Suvodip Dey, Gokhan Tur, Dilek Hakkani-Tür

Comments: 30 pages, 9 Figures, 22 Tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[59] arXiv:2411.00964 [pdf, html, other]

Title: Generic Embedding-Based Lexicons for Transparent and Reproducible Text Scoring

Catherine Moez

Comments: Preprint

Subjects: Computation and Language (cs.CL)

[60] arXiv:2411.00980 [pdf, html, other]

Title: Enhancing AAC Software for Dysarthric Speakers in e-Health Settings: An Evaluation Using TORGO

Macarious Hui, Jinda Zhang, Aanchan Mohan

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[61] arXiv:2411.00985 [pdf, html, other]

Title: FedDTPT: Federated Discrete and Transferable Prompt Tuning for Black-Box Large Language Models

Jiaqi Wu, Simin Chen, Yuzhe Yang, Yijiang Li, Shiyue Hou, Rui Jing, Zehua Wang, Wei Chen, Zijian Tian

Subjects: Computation and Language (cs.CL)

[62] arXiv:2411.01022 [pdf, html, other]

Title: Provenance: A Light-weight Fact-checker for Retrieval Augmented LLM Generation Output

Hithesh Sankararaman, Mohammed Nasheed Yasin, Tanner Sorensen, Alessandro Di Bari, Andreas Stolcke

Comments: To appear in Proceedings of EMNLP 2024 Industry Track

Journal-ref: Proc. 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track, pp. 1305-1313

Subjects: Computation and Language (cs.CL)

[63] arXiv:2411.01030 [pdf, html, other]

Title: Birdie: Advancing State Space Models with Reward-Driven Objectives and Curricula

Sam Blouir, Jimmy T.H. Smith, Antonios Anastasopoulos, Amarda Shehu

Comments: Accepted to EMNLP 2024 (Main Conference)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[64] arXiv:2411.01076 [pdf, html, other]

Title: Privacy Risks of Speculative Decoding in Large Language Models

Jiankun Wei, Abdulrahman Abdulrazzag, Tianchen Zhang, Adel Muursepp, Gururaj Saileshwar

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[65] arXiv:2411.01077 [pdf, html, other]

Title: Emoji Attack: Enhancing Jailbreak Attacks Against Judge LLM Detection

Zhipeng Wei, Yuqi Liu, N. Benjamin Erichson

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[66] arXiv:2411.01084 [pdf, html, other]

Title: Plentiful Jailbreaks with String Compositions

Brian R.Y. Huang

Comments: NeurIPS SoLaR Workshop 2024

Subjects: Computation and Language (cs.CL)

[67] arXiv:2411.01093 [pdf, html, other]

Title: TabVer: Tabular Fact Verification with Natural Logic

Rami Aly, Andreas Vlachos

Comments: Accepted to TACL. This is a slightly extended version

Subjects: Computation and Language (cs.CL)

[68] arXiv:2411.01101 [pdf, other]

Title: Self-Consistency Falls Short! The Adverse Effects of Positional Bias on Long-Context Problems

Adam Byerly, Daniel Khashabi

Comments: 20 pages, 5 figures, 3 tables

Subjects: Computation and Language (cs.CL)

[69] arXiv:2411.01136 [pdf, html, other]

Title: Do LLMs Know to Respect Copyright Notice?

Jialiang Xu, Shenglan Li, Zhaozhuo Xu, Denghui Zhang

Comments: EMNLP 2024 main

Subjects: Computation and Language (cs.CL)

[70] arXiv:2411.01141 [pdf, html, other]

Title: Dictionary Insertion Prompting for Multilingual Reasoning on Multilingual Large Language Models

Hongyuan Lu, Zixuan Li, Wai Lam

Subjects: Computation and Language (cs.CL)

[71] arXiv:2411.01176 [pdf, html, other]

Title: CmdCaliper: A Semantic-Aware Command-Line Embedding Model and Dataset for Security Research

Sian-Yao Huang, Cheng-Lin Yang, Che-Yu Lin, Chun-Ying Huang

Subjects: Computation and Language (cs.CL)

[72] arXiv:2411.01192 [pdf, html, other]

Title: Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarks

Gagan Bhatia, El Moatez Billah Nagoudi, Abdellah El Mekki, Fakhraddin Alwajih, Muhammad Abdul-Mageed

Subjects: Computation and Language (cs.CL)

[73] arXiv:2411.01195 [pdf, html, other]

Title: Transfer Learning for Finetuning Large Language Models

Tobias Strangmann, Lennart Purucker, Jörg K.H. Franke, Ivo Rapant, Fabio Ferreira, Frank Hutter

Comments: Accepted at NeurIPS 2024 Workshop on Adaptive Foundation Models

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[74] arXiv:2411.01205 [pdf, html, other]

Title: PRIMO: Progressive Induction for Multi-hop Open Rule Generation

Jianyu Liu, Sheng Bi, Guilin Qi

Comments: COLING 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[75] arXiv:2411.01213 [pdf, html, other]

Title: One Arrow, Many Targets: Probing LLMs for Multi-Attribute Controllable Text Summarization

Tathagato Roy, Rahul Mishra

Subjects: Computation and Language (cs.CL)

[76] arXiv:2411.01222 [pdf, html, other]

Title: $B^4$: A Black-Box Scrubbing Attack on LLM Watermarks

Baizhou Huang, Xiao Pu, Xiaojun Wan

Subjects: Computation and Language (cs.CL)

[77] arXiv:2411.01245 [pdf, html, other]

Title: PMoL: Parameter Efficient MoE for Preference Mixing of LLM Alignment

Dongxu Liu, Bing Xu, Yinzhuo Chen, Bufan Xu, Wenpeng Lu, Muyun Yang, Tiejun Zhao

Subjects: Computation and Language (cs.CL)

[78] arXiv:2411.01259 [pdf, html, other]

Title: Diversidade linguística e inclusão digital: desafios para uma ia brasileira

Raquel Meister Ko Freitag

Comments: in Portuguese language. paper aceepted to LAAI-Ethics 2024

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY)

[79] arXiv:2411.01264 [pdf, html, other]

Title: An Innovative CGL-MHA Model for Sarcasm Sentiment Recognition Using the MindSpore Framework

Zhenkai Qin, Qining Luo, Xunyi Nong

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[80] arXiv:2411.01280 [pdf, html, other]

Title: NLP and Education: using semantic similarity to evaluate filled gaps in a large-scale Cloze test in the classroom

Túlio Sousa de Gois, Flávia Oliveira Freitas, Julian Tejada, Raquel Meister Ko. Freitag

Subjects: Computation and Language (cs.CL)

[81] arXiv:2411.01281 [pdf, html, other]

Title: Varco Arena: A Tournament Approach to Reference-Free Benchmarking Large Language Models

Seonil Son, Ju-Min Oh, Heegon Jin, Cheolhun Jang, Jeongbeom Jeong, Kuntae Kim

Comments: 8 pages for main body, 17 pages in total

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[82] arXiv:2411.01307 [pdf, html, other]

Title: Can Multimodal Large Language Model Think Analogically?

Diandian Guo, Cong Cao, Fangfang Yuan, Dakui Wang, Wei Ma, Yanbing Liu, Jianhui Fu

Subjects: Computation and Language (cs.CL)

[83] arXiv:2411.01343 [pdf, html, other]

Title: AMREx: AMR for Explainable Fact Verification

Chathuri Jayaweera, Sangpil Youm, Bonnie Dorr

Comments: This study implements, evaluates, and analyzes an Abstract Meaning Representation (AMR) based partially explainable system for fact verification/ veracity classification. Accepted by EMNLP Workshop on Fact Extraction and VERification (FEVER) 2024, 11 pages, 7 figures,

Subjects: Computation and Language (cs.CL)

[84] arXiv:2411.01369 [pdf, other]

Title: Artificial Intelligence Driven Course Generation: A Case Study Using ChatGPT

Djaber Rouabhia

Comments: 16 pages

Journal-ref: ATRAS, Vol. 5 No. 3 (2024): Artificial Intelligence and Education and Online Learning

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY)

[85] arXiv:2411.01474 [pdf, html, other]

Title: MoCE: Adaptive Mixture of Contextualization Experts for Byte-based Neural Machine Translation

Langlin Huang, Mengyu Bu, Yang Feng

Comments: Accepted by NAACL 2025 main conference. Camera-ready version

Subjects: Computation and Language (cs.CL)

[86] arXiv:2411.01483 [pdf, html, other]

Title: Teaching Models to Improve on Tape

Liat Bezalel, Eyal Orgad, Amir Globerson

Subjects: Computation and Language (cs.CL)

[87] arXiv:2411.01485 [pdf, html, other]

Title: Domain-specific Guided Summarization for Mental Health Posts

Lu Qian, Yuqi Wang, Zimu Wang, Haiyang Zhang, Wei Wang, Ting Yu, Anh Nguyen

Comments: Accepted at PACLIC 2024. Camera-ready version

Subjects: Computation and Language (cs.CL)

[88] arXiv:2411.01523 [pdf, html, other]

Title: SinaTools: Open Source Toolkit for Arabic Natural Language Processing

Tymaa Hammouda, Mustafa Jarrar, Mohammed Khalilia

Comments: 10 pages, 3 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[89] arXiv:2411.01531 [pdf, html, other]

Title: DAG: Dictionary-Augmented Generation for Disambiguation of Sentences in Endangered Uralic Languages using ChatGPT

Mika Hämäläinen

Comments: IWCLUL 2024

Subjects: Computation and Language (cs.CL)

[90] arXiv:2411.01533 [pdf, html, other]

Title: Enhancing LLM Evaluations: The Garbling Trick

William F. Bradley

Comments: 13 pages, 3 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[91] arXiv:2411.01539 [pdf, html, other]

Title: LLMs and the Madness of Crowds

William F. Bradley

Comments: 11 pages, 6 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[92] arXiv:2411.01562 [pdf, html, other]

Title: Are LLMs good pragmatic speakers?

Mingyue Jian, N. Siddharth

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[93] arXiv:2411.01610 [pdf, html, other]

Title: Explaining and Improving Contrastive Decoding by Extrapolating the Probabilities of a Huge and Hypothetical LM

Haw-Shiuan Chang, Nanyun Peng, Mohit Bansal, Anil Ramakrishna, Tagyoung Chung

Comments: EMNLP 2024 Oral

Subjects: Computation and Language (cs.CL)

[94] arXiv:2411.01703 [pdf, html, other]

Title: UniGuard: Towards Universal Safety Guardrails for Jailbreak Attacks on Multimodal Large Language Models

Sejoon Oh, Yiqiao Jin, Megha Sharma, Donghyun Kim, Eric Ma, Gaurav Verma, Srijan Kumar

Comments: 14 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[95] arXiv:2411.01706 [pdf, html, other]

Title: Investigating Large Language Models for Complex Word Identification in Multilingual and Multidomain Setups

Răzvan-Alexandru Smădu, David-Gabriel Ion, Dumitru-Clementin Cercel, Florin Pop, Mihaela-Claudia Cercel

Comments: 37 pages, 16 figures, Accepted by EMNLP 2024

Subjects: Computation and Language (cs.CL)

[96] arXiv:2411.01710 [pdf, html, other]

Title: SPES: Spectrogram Perturbation for Explainable Speech-to-Text Generation

Dennis Fucci, Marco Gaido, Beatrice Savoldi, Matteo Negri, Mauro Cettolo, Luisa Bentivogli

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[97] arXiv:2411.01747 [pdf, html, other]

Title: DynaSaur: Large Language Agents Beyond Predefined Actions

Dang Nguyen, Viet Dac Lai, Seunghyun Yoon, Ryan A. Rossi, Handong Zhao, Ruiyi Zhang, Puneet Mathur, Nedim Lipka, Yu Wang, Trung Bui, Franck Dernoncourt, Tianyi Zhou

Comments: 15 pages, 8 figures

Subjects: Computation and Language (cs.CL)

[98] arXiv:2411.01751 [pdf, html, other]

Title: RAGViz: Diagnose and Visualize Retrieval-Augmented Generation

Tevin Wang, Jingyuan He, Chenyan Xiong

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[99] arXiv:2411.01765 [pdf, html, other]

Title: Towards Pedagogical LLMs with Supervised Fine Tuning for Computing Education

Alexandra Vassar, Jake Renzella, Emily Ross, Andrew Taylor

Comments: 3 pages, 1 table, conference

Subjects: Computation and Language (cs.CL)

[100] arXiv:2411.01834 [pdf, html, other]

Title: Align-SLM: Textless Spoken Language Models with Reinforcement Learning from AI Feedback

Guan-Ting Lin, Prashanth Gurunath Shivakumar, Aditya Gourav, Yile Gu, Ankur Gandhe, Hung-yi Lee, Ivan Bulyko

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)