Computation and Language

Authors and titles for June 2024

[701] arXiv:2406.09265 [pdf, html, other]

Title: Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs

Weixuan Wang, Barry Haddow, Minghao Wu, Wei Peng, Alexandra Birch

Subjects: Computation and Language (cs.CL)

[702] arXiv:2406.09279 [pdf, html, other]

Title: Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback

Hamish Ivison, Yizhong Wang, Jiacheng Liu, Zeqiu Wu, Valentina Pyatkin, Nathan Lambert, Noah A. Smith, Yejin Choi, Hannaneh Hajishirzi

Comments: Neurips 2024 camera-ready

Subjects: Computation and Language (cs.CL)

[703] arXiv:2406.09282 [pdf, html, other]

Title: On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models

Jinchuan Tian, Yifan Peng, William Chen, Kwanghee Choi, Karen Livescu, Shinji Watanabe

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[704] arXiv:2406.09289 [pdf, html, other]

Title: Understanding Jailbreak Success: A Study of Latent Space Dynamics in Large Language Models

Sarah Ball, Frauke Kreuter, Nina Panickssery

Comments: 37 pages, added analyses for 3 more models

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[705] arXiv:2406.09295 [pdf, html, other]

Title: AlignMMBench: Evaluating Chinese Multimodal Alignment in Large Vision-Language Models

Yuhang Wu, Wenmeng Yu, Yean Cheng, Yan Wang, Xiaohan Zhang, Jiazheng Xu, Ming Ding, Yuxiao Dong

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[706] arXiv:2406.09308 [pdf, html, other]

Title: Transformers meet Neural Algorithmic Reasoners

Wilfried Bounsi, Borja Ibarz, Andrew Dudzik, Jessica B. Hamrick, Larisa Markeeva, Alex Vitvitskyi, Razvan Pascanu, Petar Veličković

Comments: To appear at CVPR 2024 Multimodal Algorithmic Reasoning (MAR) Workshop. 10 pages, 5 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[707] arXiv:2406.09325 [pdf, html, other]

Title: REVS: Unlearning Sensitive Information in Language Models via Rank Editing in the Vocabulary Space

Tomer Ashuach, Martin Tutek, Yonatan Belinkov

Comments: 18 pages, 3 figures

Subjects: Computation and Language (cs.CL)

[708] arXiv:2406.09330 [pdf, html, other]

Title: Learning from Natural Language Explanations for Generalizable Entity Matching

Somin Wadhwa, Adit Krishnan, Runhui Wang, Byron C. Wallace, Chris Kong

Comments: Accepted to EMNLP 2024

Subjects: Computation and Language (cs.CL)

[709] arXiv:2406.09334 [pdf, html, other]

Title: ProxyLM: Predicting Language Model Performance on Multilingual Tasks via Proxy Models

David Anugraha, Genta Indra Winata, Chenyue Li, Patrick Amadeus Irawan, En-Shiun Annie Lee

Comments: Preprint

Subjects: Computation and Language (cs.CL)

[710] arXiv:2406.09345 [pdf, html, other]

Title: DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding

Suwon Shon, Kwangyoun Kim, Yi-Te Hsu, Prashant Sridhar, Shinji Watanabe, Karen Livescu

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[711] arXiv:2406.09393 [pdf, html, other]

Title: Improving Autoregressive Training with Dynamic Oracles

Jianing Yang, Harshine Visvanathan, Yilin Wang, Xinyi Hu, Matthew Gormley

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[712] arXiv:2406.09438 [pdf, other]

Title: Exploring Traffic Crash Narratives in Jordan Using Text Mining Analytics

Shadi Jaradat, Taqwa I. Alhadidi, Huthaifa I. Ashqar, Ahmed Hossain, Mohammed Elhenawy

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[713] arXiv:2406.09454 [pdf, html, other]

Title: Advancing High Resolution Vision-Language Models in Biomedicine

Zekai Chen, Arda Pekis, Kevin Brown

Comments: 15 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)

[714] arXiv:2406.09490 [pdf, html, other]

Title: Newswire: A Large-Scale Structured Database of a Century of Historical News

Emily Silcock, Abhishek Arora, Luca D'Amico-Wong, Melissa Dell

Comments: arXiv admin note: text overlap with arXiv:2306.17810, arXiv:2308.12477

Subjects: Computation and Language (cs.CL); General Economics (econ.GN)

[715] arXiv:2406.09519 [pdf, html, other]

Title: Talking Heads: Understanding Inter-layer Communication in Transformer Language Models

Jack Merullo, Carsten Eickhoff, Ellie Pavlick

Comments: Neurips 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[716] arXiv:2406.09549 [pdf, other]

Title: Urdu Dependency Parsing and Treebank Development: A Syntactic and Morphological Perspective

Nudrat Habib

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[717] arXiv:2406.09559 [pdf, html, other]

Title: Decoding the Diversity: A Review of the Indic AI Research Landscape

Sankalp KJ, Vinija Jain, Sreyoshi Bhaduri, Tamoghna Roy, Aman Chadha

Comments: 27 pages, 1 figure

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[718] arXiv:2406.09569 [pdf, html, other]

Title: Speech ReaLLM -- Real-time Streaming Speech Recognition with Multimodal LLMs by Teaching the Flow of Time

Frank Seide, Morrie Doulaty, Yangyang Shi, Yashesh Gaur, Junteng Jia, Chunyang Wu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[719] arXiv:2406.09573 [pdf, html, other]

Title: Analyzing Gender Polarity in Short Social Media Texts with BERT: The Role of Emojis and Emoticons

Saba Yousefian Jazi, Amir Mirzaeinia, Sina Yousefian Jazi

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[720] arXiv:2406.09617 [pdf, html, other]

Title: Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection

Shruti Palaskar, Oggi Rudovic, Sameer Dharur, Florian Pesce, Gautam Krishna, Aswin Sivaraman, Jack Berkowitz, Ahmed Hussen Abdelaziz, Saurabh Adya, Ahmed Tewfik

Comments: Accepted at Interspeech 2024

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[721] arXiv:2406.09618 [pdf, html, other]

Title: Multi-Modal Retrieval For Large Language Model Based Speech Recognition

Jari Kolehmainen, Aditya Gourav, Prashanth Gurunath Shivakumar, Yile Gu, Ankur Gandhe, Ariya Rastrow, Grant Strimel, Ivan Bulyko

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[722] arXiv:2406.09662 [pdf, html, other]

Title: Learning Language Structures through Grounding

Freda Shi

Comments: Ph.D. Thesis

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[723] arXiv:2406.09688 [pdf, html, other]

Title: FreeCtrl: Constructing Control Centers with Feedforward Layers for Learning-Free Controllable Text Generation

Zijian Feng, Hanzhang Zhou, Zixiao Zhu, Kezhi Mao

Comments: ACL 2024

Subjects: Computation and Language (cs.CL)

[724] arXiv:2406.09702 [pdf, html, other]

Title: Detecting Response Generation Not Requiring Factual Judgment

Ryohei Kamei, Daiki Shiono, Reina Akama, Jun Suzuki

Subjects: Computation and Language (cs.CL)

[725] arXiv:2406.09717 [pdf, other]

Title: UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for Low-Resource Languages

Trinh Pham, Khoi M. Le, Luu Anh Tuan

Comments: First two authors contribute equally. Accepted at ACL 2024

Subjects: Computation and Language (cs.CL)