Computation and Language

Authors and titles for November 2024

[251] arXiv:2411.04965 [pdf, html, other]

Title: BitNet a4.8: 4-bit Activations for 1-bit LLMs

Hongyu Wang, Shuming Ma, Furu Wei

Comments: Work in progress

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[252] arXiv:2411.04975 [pdf, html, other]

Title: SuffixDecoding: A Model-Free Approach to Speeding Up Large Language Model Inference

Gabriele Oliaro, Zhihao Jia, Daniel Campos, Aurick Qiao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[253] arXiv:2411.04986 [pdf, html, other]

Title: The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities

Zhaofeng Wu, Xinyan Velocity Yu, Dani Yogatama, Jiasen Lu, Yoon Kim

Comments: ICLR 2025

Subjects: Computation and Language (cs.CL)

[254] arXiv:2411.04996 [pdf, other]

Title: Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models

Weixin Liang, Lili Yu, Liang Luo, Srinivasan Iyer, Ning Dong, Chunting Zhou, Gargi Ghosh, Mike Lewis, Wen-tau Yih, Luke Zettlemoyer, Xi Victoria Lin

Subjects: Computation and Language (cs.CL)

[255] arXiv:2411.05000 [pdf, html, other]

Title: Needle Threading: Can LLMs Follow Threads through Near-Million-Scale Haystacks?

Jonathan Roberts, Kai Han, Samuel Albanie

Subjects: Computation and Language (cs.CL)

[256] arXiv:2411.05023 [pdf, html, other]

Title: Multimodal Quantum Natural Language Processing: A Novel Framework for using Quantum Methods to Analyse Real Data

Hala Hawashin

Comments: This thesis, awarded a distinction by the Department of Computer Science at University College London, was successfully defended by the author in September 2024 in partial fulfillment of the requirements for an MSc in Emerging Digital Technologies

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Quantum Physics (quant-ph)

[257] arXiv:2411.05025 [pdf, html, other]

Title: LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions

Zhehui Liao, Maria Antoniak, Inyoung Cheong, Evie Yu-Yen Cheng, Ai-Heng Lee, Kyle Lo, Joseph Chee Chang, Amy X. Zhang

Comments: 30 pages, 5 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Digital Libraries (cs.DL); Human-Computer Interaction (cs.HC)

[258] arXiv:2411.05026 [pdf, html, other]

Title: Deep Learning and Machine Learning -- Natural Language Processing: From Theory to Application

Keyu Chen, Cheng Fei, Ziqian Bi, Junyu Liu, Benji Peng, Sen Zhang, Xuanhe Pan, Jiawei Xu, Jinlang Wang, Caitlyn Heqi Yin, Yichao Zhang, Pohsun Feng, Yizhu Wen, Tianyang Wang, Ming Li, Jintao Ren, Qian Niu, Silin Chen, Weiche Hsieh, Lawrence K.Q. Yan, Chia Xin Liang, Han Xu, Hong-Ming Tseng, Xinyuan Song, Ming Liu

Comments: 252 pages

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[259] arXiv:2411.05031 [pdf, html, other]

Title: On-Device Emoji Classifier Trained with GPT-based Data Augmentation for a Mobile Keyboard

Hossam Amer, Joe Osborne, Michael Zaki, Mohamed Afify

Comments: 8 pages

Subjects: Computation and Language (cs.CL)

[260] arXiv:2411.05036 [pdf, html, other]

Title: From Word Vectors to Multimodal Embeddings: Techniques, Applications, and Future Directions For Large Language Models

Charles Zhang, Benji Peng, Xintian Sun, Qian Niu, Junyu Liu, Keyu Chen, Ming Li, Pohsun Feng, Ziqian Bi, Ming Liu, Yichao Zhang, Cheng Fei, Caitlyn Heqi Yin, Lawrence KQ Yan, Tianyang Wang

Comments: 21 pages

Subjects: Computation and Language (cs.CL)

[261] arXiv:2411.05037 [pdf, html, other]

Title: Towards Interpreting Language Models: A Case Study in Multi-Hop Reasoning

Mansi Sakarvadia

Comments: University of Chicago, Computer Science, Master of Science Dissertation

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[262] arXiv:2411.05039 [pdf, html, other]

Title: YouTube Comments Decoded: Leveraging LLMs for Low Resource Language Classification

Aniket Deroy, Subhankar Maity

Comments: Updated and Final Version

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[263] arXiv:2411.05040 [pdf, html, other]

Title: Bottom-Up and Top-Down Analysis of Values, Agendas, and Observations in Corpora and LLMs

Scott E. Friedman, Noam Benkler, Drisana Mosaphir, Jeffrey Rye, Sonja M. Schmer-Galunder, Micah Goldwater, Matthew McLure, Ruta Wheelock, Jeremy Gottlieb, Robert P. Goldman, Christopher Miller

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[264] arXiv:2411.05042 [pdf, other]

Title: Improving Radiology Report Conciseness and Structure via Local Large Language Models

Iryna Hartsock, Cyrillo Araujo, Les Folio, Ghulam Rasool

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[265] arXiv:2411.05045 [pdf, html, other]

Title: Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale

Flavio Di Palo, Prateek Singhi, Bilal Fadlallah

Comments: Published in EMNLP 2024

Subjects: Computation and Language (cs.CL)

[266] arXiv:2411.05046 [pdf, html, other]

Title: PhoneLM:an Efficient and Capable Small Language Model Family through Principled Pre-training

Rongjie Yi, Xiang Li, Weikai Xie, Zhenyan Lu, Chenghua Wang, Ao Zhou, Shangguang Wang, Xiwen Zhang, Mengwei Xu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[267] arXiv:2411.05048 [pdf, html, other]

Title: Leveraging LLMs to Enable Natural Language Search on Go-to-market Platforms

Jesse Yao, Saurav Acharya, Priyaranjan Parida, Srinivas Attipalli, Ali Dasdan

Comments: 11 pages, 5 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[268] arXiv:2411.05049 [pdf, other]

Title: ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding

Israel Abebe Azime, Atnafu Lambebo Tonja, Tadesse Destaw Belay, Yonas Chanie, Bontu Fufa Balcha, Negasi Haile Abadi, Henok Biadglign Ademtew, Mulubrhan Abebe Nerea, Debela Desalegn Yadeta, Derartu Dagne Geremew, Assefa Atsbiha tesfau, Philipp Slusallek, Thamar Solorio, Dietrich Klakow

Subjects: Computation and Language (cs.CL)

[269] arXiv:2411.05050 [pdf, html, other]

Title: Selecting Between BERT and GPT for Text Classification in Political Science Research

Yu Wang, Wen Qu, Xin Ye

Comments: 28 pages, 5 figures, 7 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[270] arXiv:2411.05054 [pdf, html, other]

Title: FMEA Builder: Expert Guided Text Generation for Equipment Maintenance

Karol Lynch, Fabio Lorenzi, John Sheehan, Duygu Kabakci-Zorlu, Bradley Eck

Comments: 4 pages, 2 figures. AI for Critical Infrastructure Workshop @ IJCAI 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[271] arXiv:2411.05057 [pdf, html, other]

Title: A Brief History of Named Entity Recognition

Monica Munnangi

Comments: Survey done in 2020

Subjects: Computation and Language (cs.CL)

[272] arXiv:2411.05059 [pdf, html, other]

Title: FineTuneBench: How well do commercial fine-tuning APIs infuse knowledge into LLMs?

Eric Wu, Kevin Wu, James Zou

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[273] arXiv:2411.05088 [pdf, html, other]

Title: Findings of the IWSLT 2024 Evaluation Campaign

Ibrahim Said Ahmad, Antonios Anastasopoulos, Ondřej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, William Chen, Qianqian Dong, Marcello Federico, Barry Haddow, Dávid Javorský, Mateusz Krubiński, Tsz Kin Lam, Xutai Ma, Prashant Mathur, Evgeny Matusov, Chandresh Maurya, John McCrae, Kenton Murray, Satoshi Nakamura, Matteo Negri, Jan Niehues, Xing Niu, Atul Kr. Ojha, John Ortega, Sara Papi, Peter Polák, Adam Pospíšil, Pavel Pecina, Elizabeth Salesky, Nivedita Sethiya, Balaram Sarkar, Jiatong Shi, Claytone Sikasote, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Brian Thompson, Marco Turchi, Alex Waibel, Shinji Watanabe, Patrick Wilken, Petr Zemánek, Rodolfo Zevallos

Comments: IWSLT 2024; 59 pages

Subjects: Computation and Language (cs.CL)

[274] arXiv:2411.05172 [pdf, html, other]

Title: ImpScore: A Learnable Metric For Quantifying The Implicitness Level of Sentence

Yuxin Wang, Xiaomeng Zhu, Weimin Lyu, Saeed Hassanpour, Soroush Vosoughi

Comments: Accepted to ICLR 2025

Subjects: Computation and Language (cs.CL)

[275] arXiv:2411.05192 [pdf, html, other]

Title: Explaining Mixtures of Sources in News Articles

Alexander Spangher, James Youn, Matt DeButts, Nanyun Peng, Emilio Ferrara, Jonathan May

Comments: 9 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)