Computation and Language

Authors and titles for November 2024

[226] arXiv:2411.04448 [pdf, html, other]

Title: Gradient Localization Improves Lifelong Pretraining of Language Models

Jared Fernandez, Yonatan Bisk, Emma Strubell

Comments: EMNLP Findings 2024

Subjects: Computation and Language (cs.CL)

[227] arXiv:2411.04473 [pdf, html, other]

Title: ML-Promise: A Multilingual Dataset for Corporate Promise Verification

Yohei Seki, Hakusen Shu, Anaïs Lhuissier, Hanwool Lee, Juyeon Kang, Min-Yuh Day, Chung-Chi Chen

Comments: 6 pages

Subjects: Computation and Language (cs.CL)

[228] arXiv:2411.04496 [pdf, other]

Title: Thanos: Enhancing Conversational Agents with Skill-of-Mind-Infused Large Language Model

Young-Jun Lee, Dokyong Lee, Junyoung Youn, Kyeongjin Oh, Ho-Jin Choi

Comments: Code: this https URL

Subjects: Computation and Language (cs.CL)

[229] arXiv:2411.04530 [pdf, other]

Title: Tomato, Tomahto, Tomate: Measuring the Role of Shared Semantics among Subwords in Multilingual Language Models

Xinyu Zhang, Jing Lu, Vinh Q. Tran, Tal Schuster, Donald Metzler, Jimmy Lin

Comments: 8 pages, 9 figures

Subjects: Computation and Language (cs.CL)

[230] arXiv:2411.04535 [pdf, html, other]

Title: Meta-Reasoning Improves Tool Use in Large Language Models

Lisa Alazraki, Marek Rei

Comments: NAACL 2025 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[231] arXiv:2411.04557 [pdf, html, other]

Title: Pruning Literals for Highly Efficient Explainability at Word Level

Rohan Kumar Yadav, Bimal Bhattarai, Abhik Jana, Lei Jiao, Seid Muhie Yimam

Comments: 8 pages, 3 figures

Journal-ref: 2024 International Symposium on the Tsetlin Machine (ISTM)

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[232] arXiv:2411.04573 [pdf, html, other]

Title: Multistage Fine-tuning Strategies for Automatic Speech Recognition in Low-resource Languages

Leena G Pillai, Kavya Manohar, Basil K Raju, Elizabeth Sherly

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[233] arXiv:2411.04585 [pdf, html, other]

Title: The State and Fate of Summarization Datasets: A Survey

Noam Dahan, Gabriel Stanovsky

Comments: Accepted to NAACL 2025

Subjects: Computation and Language (cs.CL)

[234] arXiv:2411.04588 [pdf, html, other]

Title: Tibyan Corpus: Balanced and Comprehensive Error Coverage Corpus Using ChatGPT for Arabic Grammatical Error Correction

Ahlam Alrehili, Areej Alhothali

Comments: 17 pages, 11 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[235] arXiv:2411.04604 [pdf, html, other]

Title: FASSILA: A Corpus for Algerian Dialect Fake News Detection and Sentiment Analysis

Amin Abdedaiem, Abdelhalim Hafedh Dahou, Mohamed Amine Cheragui, Brigitte Mathiak

Comments: 16 pages, 6 Figuers

Journal-ref: Procedia Computer Science, 244, 397-407 (2024)

Subjects: Computation and Language (cs.CL)

[236] arXiv:2411.04637 [pdf, html, other]

Title: Hands-On Tutorial: Labeling with LLM and Human-in-the-Loop

Ekaterina Artemova, Akim Tsvigun, Dominik Schlechtweg, Natalia Fedorova, Konstantin Chernyshev, Sergei Tilga, Boris Obmoroshev

Comments: To be presented at COLING 2025

Subjects: Computation and Language (cs.CL)

[237] arXiv:2411.04699 [pdf, html, other]

Title: BhasaAnuvaad: A Speech Translation Dataset for 13 Indian Languages

Sparsh Jain, Ashwin Sankar, Devilal Choudhary, Dhairya Suman, Nikhil Narasimhan, Mohammed Safi Ur Rahman Khan, Anoop Kunchukuttan, Mitesh M Khapra, Raj Dabre

Comments: Work in Progress

Subjects: Computation and Language (cs.CL)

[238] arXiv:2411.04752 [pdf, html, other]

Title: RetrieveGPT: Merging Prompts and Mathematical Models for Enhanced Code-Mixed Information Retrieval

Aniket Deroy, Subhankar Maity

Comments: Final and Updated version

Subjects: Computation and Language (cs.CL)

[239] arXiv:2411.04756 [pdf, html, other]

Title: A study of Vietnamese readability assessing through semantic and statistical features

Hung Tuan Le, Long Truong To, Manh Trong Nguyen, Quyen Nguyen, Trong-Hop Do

Subjects: Computation and Language (cs.CL)

[240] arXiv:2411.04794 [pdf, html, other]

Title: KnowCoder-X: Boosting Multilingual Information Extraction via Code

Yuxin Zuo, Wenxuan Jiang, Wenxuan Liu, Zixuan Li, Long Bai, Hanbin Wang, Yutao Zeng, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng

Comments: 26 pages, 3 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[241] arXiv:2411.04799 [pdf, html, other]

Title: Kwai-STaR: Transform LLMs into State-Transition Reasoners

Xingyu Lu, Yuhang Hu, Changyi Liu, Tianke Zhang, Zhenyu Yang, Zhixiang Ding, Shengsheng Qian, Meng Du, Ruiwen Kang, Kaiyu Tang, Fan Yang, Tingting Gao, Di Zhang, Hai-Tao Zheng, Bin Wen

Comments: 6 pages, 2 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[242] arXiv:2411.04813 [pdf, html, other]

Title: LuxBank: The First Universal Dependency Treebank for Luxembourgish

Alistair Plum, Caroline Döhmer, Emilia Milano, Anne-Marie Lutgen, Christoph Purschke

Comments: Accepted at 22nd Workshop on Treebanks and Linguistic Theories (TLT 2024)

Subjects: Computation and Language (cs.CL)

[243] arXiv:2411.04822 [pdf, other]

Title: When Does Classical Chinese Help? Quantifying Cross-Lingual Transfer in Hanja and Kanbun

Seyoung Song, Haneul Yoo, Jiho Jin, Kyunghyun Cho, Alice Oh

Subjects: Computation and Language (cs.CL)

[244] arXiv:2411.04825 [pdf, html, other]

Title: VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models

Ming Cheng, Jiaying Gong, Chenhan Yuan, William A. Ingram, Edward Fox, Hoda Eldardiry

Comments: 21 pages, 3 figures, accepted for publication in NAACL 2025 Main Conference

Subjects: Computation and Language (cs.CL); Digital Libraries (cs.DL); Machine Learning (cs.LG)

[245] arXiv:2411.04847 [pdf, html, other]

Title: Prompt-Guided Internal States for Hallucination Detection of Large Language Models

Fujie Zhang, Peiqi Yu, Biao Yi, Baolei Zhang, Tong Li, Zheli Liu

Subjects: Computation and Language (cs.CL)

[246] arXiv:2411.04862 [pdf, other]

Title: Sentiment Analysis of Spanish Political Party Tweets Using Pre-trained Language Models

Chuqiao Song, Shunzhang Chen, Xinyi Cai, Hao Chen

Comments: 21 pages, 6 figures

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY)

[247] arXiv:2411.04905 [pdf, html, other]

Title: OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Siming Huang, Tianhao Cheng, J.K. Liu, Jiaran Hao, Liuyihan Song, Yang Xu, J. Yang, Jiaheng Liu, Chenchen Zhang, Linzheng Chai, Ruifeng Yuan, Zhaoxiang Zhang, Jie Fu, Qian Liu, Ge Zhang, Zili Wang, Yuan Qi, Yinghui Xu, Wei Chu

Subjects: Computation and Language (cs.CL); Programming Languages (cs.PL)

[248] arXiv:2411.04914 [pdf, html, other]

Title: GASE: Generatively Augmented Sentence Encoding

Manuel Frank, Haithem Afli

Comments: 12 pages, 3 figures

Subjects: Computation and Language (cs.CL)

[249] arXiv:2411.04920 [pdf, html, other]

Title: GPTKB: Comprehensively Materializing Factual LLM Knowledge

Yujia Hu, Tuan-Phong Nguyen, Shrestha Ghosh, Simon Razniewski

Comments: 13 pages, 4 tables, 10 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB)

[250] arXiv:2411.04950 [pdf, html, other]

Title: Estimating the Influence of Sequentially Correlated Literary Properties in Textual Classification: A Data-Centric Hypothesis-Testing Approach

Gideon Yoffe, Nachum Dershowitz, Ariel Vishne, Barak Sober

Subjects: Computation and Language (cs.CL)

[251] arXiv:2411.04965 [pdf, html, other]

Title: BitNet a4.8: 4-bit Activations for 1-bit LLMs

Hongyu Wang, Shuming Ma, Furu Wei

Comments: Work in progress

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[252] arXiv:2411.04975 [pdf, html, other]

Title: SuffixDecoding: A Model-Free Approach to Speeding Up Large Language Model Inference

Gabriele Oliaro, Zhihao Jia, Daniel Campos, Aurick Qiao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[253] arXiv:2411.04986 [pdf, html, other]

Title: The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities

Zhaofeng Wu, Xinyan Velocity Yu, Dani Yogatama, Jiasen Lu, Yoon Kim

Comments: ICLR 2025

Subjects: Computation and Language (cs.CL)

[254] arXiv:2411.04996 [pdf, other]

Title: Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models

Weixin Liang, Lili Yu, Liang Luo, Srinivasan Iyer, Ning Dong, Chunting Zhou, Gargi Ghosh, Mike Lewis, Wen-tau Yih, Luke Zettlemoyer, Xi Victoria Lin

Subjects: Computation and Language (cs.CL)

[255] arXiv:2411.05000 [pdf, html, other]

Title: Needle Threading: Can LLMs Follow Threads through Near-Million-Scale Haystacks?

Jonathan Roberts, Kai Han, Samuel Albanie

Subjects: Computation and Language (cs.CL)

[256] arXiv:2411.05023 [pdf, html, other]

Title: Multimodal Quantum Natural Language Processing: A Novel Framework for using Quantum Methods to Analyse Real Data

Hala Hawashin

Comments: This thesis, awarded a distinction by the Department of Computer Science at University College London, was successfully defended by the author in September 2024 in partial fulfillment of the requirements for an MSc in Emerging Digital Technologies

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Quantum Physics (quant-ph)

[257] arXiv:2411.05025 [pdf, html, other]

Title: LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions

Zhehui Liao, Maria Antoniak, Inyoung Cheong, Evie Yu-Yen Cheng, Ai-Heng Lee, Kyle Lo, Joseph Chee Chang, Amy X. Zhang

Comments: 30 pages, 5 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Digital Libraries (cs.DL); Human-Computer Interaction (cs.HC)

[258] arXiv:2411.05026 [pdf, html, other]

Title: Deep Learning and Machine Learning -- Natural Language Processing: From Theory to Application

Keyu Chen, Cheng Fei, Ziqian Bi, Junyu Liu, Benji Peng, Sen Zhang, Xuanhe Pan, Jiawei Xu, Jinlang Wang, Caitlyn Heqi Yin, Yichao Zhang, Pohsun Feng, Yizhu Wen, Tianyang Wang, Ming Li, Jintao Ren, Qian Niu, Silin Chen, Weiche Hsieh, Lawrence K.Q. Yan, Chia Xin Liang, Han Xu, Hong-Ming Tseng, Xinyuan Song, Ming Liu

Comments: 252 pages

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[259] arXiv:2411.05031 [pdf, html, other]

Title: On-Device Emoji Classifier Trained with GPT-based Data Augmentation for a Mobile Keyboard

Hossam Amer, Joe Osborne, Michael Zaki, Mohamed Afify

Comments: 8 pages

Subjects: Computation and Language (cs.CL)

[260] arXiv:2411.05036 [pdf, html, other]

Title: From Word Vectors to Multimodal Embeddings: Techniques, Applications, and Future Directions For Large Language Models

Charles Zhang, Benji Peng, Xintian Sun, Qian Niu, Junyu Liu, Keyu Chen, Ming Li, Pohsun Feng, Ziqian Bi, Ming Liu, Yichao Zhang, Cheng Fei, Caitlyn Heqi Yin, Lawrence KQ Yan, Tianyang Wang

Comments: 21 pages

Subjects: Computation and Language (cs.CL)

[261] arXiv:2411.05037 [pdf, html, other]

Title: Towards Interpreting Language Models: A Case Study in Multi-Hop Reasoning

Mansi Sakarvadia

Comments: University of Chicago, Computer Science, Master of Science Dissertation

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[262] arXiv:2411.05039 [pdf, html, other]

Title: YouTube Comments Decoded: Leveraging LLMs for Low Resource Language Classification

Aniket Deroy, Subhankar Maity

Comments: Updated and Final Version

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[263] arXiv:2411.05040 [pdf, html, other]

Title: Bottom-Up and Top-Down Analysis of Values, Agendas, and Observations in Corpora and LLMs

Scott E. Friedman, Noam Benkler, Drisana Mosaphir, Jeffrey Rye, Sonja M. Schmer-Galunder, Micah Goldwater, Matthew McLure, Ruta Wheelock, Jeremy Gottlieb, Robert P. Goldman, Christopher Miller

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[264] arXiv:2411.05042 [pdf, other]

Title: Improving Radiology Report Conciseness and Structure via Local Large Language Models

Iryna Hartsock, Cyrillo Araujo, Les Folio, Ghulam Rasool

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[265] arXiv:2411.05045 [pdf, html, other]

Title: Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale

Flavio Di Palo, Prateek Singhi, Bilal Fadlallah

Comments: Published in EMNLP 2024

Subjects: Computation and Language (cs.CL)

[266] arXiv:2411.05046 [pdf, html, other]

Title: PhoneLM:an Efficient and Capable Small Language Model Family through Principled Pre-training

Rongjie Yi, Xiang Li, Weikai Xie, Zhenyan Lu, Chenghua Wang, Ao Zhou, Shangguang Wang, Xiwen Zhang, Mengwei Xu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[267] arXiv:2411.05048 [pdf, html, other]

Title: Leveraging LLMs to Enable Natural Language Search on Go-to-market Platforms

Jesse Yao, Saurav Acharya, Priyaranjan Parida, Srinivas Attipalli, Ali Dasdan

Comments: 11 pages, 5 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[268] arXiv:2411.05049 [pdf, other]

Title: ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding

Israel Abebe Azime, Atnafu Lambebo Tonja, Tadesse Destaw Belay, Yonas Chanie, Bontu Fufa Balcha, Negasi Haile Abadi, Henok Biadglign Ademtew, Mulubrhan Abebe Nerea, Debela Desalegn Yadeta, Derartu Dagne Geremew, Assefa Atsbiha tesfau, Philipp Slusallek, Thamar Solorio, Dietrich Klakow

Subjects: Computation and Language (cs.CL)

[269] arXiv:2411.05050 [pdf, html, other]

Title: Selecting Between BERT and GPT for Text Classification in Political Science Research

Yu Wang, Wen Qu, Xin Ye

Comments: 28 pages, 5 figures, 7 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[270] arXiv:2411.05054 [pdf, html, other]

Title: FMEA Builder: Expert Guided Text Generation for Equipment Maintenance

Karol Lynch, Fabio Lorenzi, John Sheehan, Duygu Kabakci-Zorlu, Bradley Eck

Comments: 4 pages, 2 figures. AI for Critical Infrastructure Workshop @ IJCAI 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[271] arXiv:2411.05057 [pdf, html, other]

Title: A Brief History of Named Entity Recognition

Monica Munnangi

Comments: Survey done in 2020

Subjects: Computation and Language (cs.CL)

[272] arXiv:2411.05059 [pdf, html, other]

Title: FineTuneBench: How well do commercial fine-tuning APIs infuse knowledge into LLMs?

Eric Wu, Kevin Wu, James Zou

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[273] arXiv:2411.05088 [pdf, html, other]

Title: Findings of the IWSLT 2024 Evaluation Campaign

Ibrahim Said Ahmad, Antonios Anastasopoulos, Ondřej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, William Chen, Qianqian Dong, Marcello Federico, Barry Haddow, Dávid Javorský, Mateusz Krubiński, Tsz Kin Lam, Xutai Ma, Prashant Mathur, Evgeny Matusov, Chandresh Maurya, John McCrae, Kenton Murray, Satoshi Nakamura, Matteo Negri, Jan Niehues, Xing Niu, Atul Kr. Ojha, John Ortega, Sara Papi, Peter Polák, Adam Pospíšil, Pavel Pecina, Elizabeth Salesky, Nivedita Sethiya, Balaram Sarkar, Jiatong Shi, Claytone Sikasote, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Brian Thompson, Marco Turchi, Alex Waibel, Shinji Watanabe, Patrick Wilken, Petr Zemánek, Rodolfo Zevallos

Comments: IWSLT 2024; 59 pages

Subjects: Computation and Language (cs.CL)

[274] arXiv:2411.05172 [pdf, html, other]

Title: ImpScore: A Learnable Metric For Quantifying The Implicitness Level of Sentence

Yuxin Wang, Xiaomeng Zhu, Weimin Lyu, Saeed Hassanpour, Soroush Vosoughi

Comments: Accepted to ICLR 2025

Subjects: Computation and Language (cs.CL)

[275] arXiv:2411.05192 [pdf, html, other]

Title: Explaining Mixtures of Sources in News Articles

Alexander Spangher, James Youn, Matt DeButts, Nanyun Peng, Emilio Ferrara, Jonathan May

Comments: 9 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)