Computation and Language

Authors and titles for June 2024

[1901] arXiv:2406.04467 (cross-list from eess.AS) [pdf, html, other]

Title: Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis

Théodor Lemerle, Nicolas Obin, Axel Roebel

Comments: Interspeech

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1902] arXiv:2406.04493 (cross-list from cs.CV) [pdf, html, other]

Title: CORU: Comprehensive Post-OCR Parsing and Receipt Understanding Dataset

Abdelrahman Abdallah, Mahmoud Abdalla, Mahmoud SalahEldin Kasem, Mohamed Mahmoud, Ibrahim Abdelhalim, Mohamed Elkasaby, Yasser ElBendary, Adam Jatowt

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1903] arXiv:2406.04501 (cross-list from cs.LG) [pdf, html, other]

Title: FLUID-LLM: Learning Computational Fluid Dynamics with Spatiotemporal-aware Large Language Models

Max Zhu, Adrián Bazaga, Pietro Liò

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1904] arXiv:2406.04595 (cross-list from cs.SD) [pdf, html, other]

Title: Pitch-Aware RNN-T for Mandarin Chinese Mispronunciation Detection and Diagnosis

Xintong Wang, Mingqian Shi, Ye Wang

Comments: Accepted at Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1905] arXiv:2406.04615 (cross-list from eess.AS) [pdf, html, other]

Title: What do MLLMs hear? Examining reasoning with text and sound components in Multimodal Large Language Models

Enis Berk Çoban, Michael I. Mandel, Johanna Devaney

Comments: 9 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1906] arXiv:2406.04734 (cross-list from cs.AI) [pdf, other]

Title: Generative AI Models: Opportunities and Risks for Industry and Authorities

Tobias Alt, Andrea Ibisch, Clemens Meiser, Anna Wilhelm, Raphael Zimmer, Christian Berghoff, Christoph Droste, Jens Karschau, Friederike Laus, Rainer Plaga, Carola Plesch, Britta Sennewald, Thomas Thaeren, Kristina Unverricht, Steffen Waurick

Comments: 33 pages, 3 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1907] arXiv:2406.04746 (cross-list from cs.CV) [pdf, html, other]

Title: PQPP: A Joint Benchmark for Text-to-Image Prompt and Query Performance Prediction

Eduard Poesina, Adriana Valentina Costache, Adrian-Gabriel Chifu, Josiane Mothe, Radu Tudor Ionescu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1908] arXiv:2406.04800 (cross-list from cs.AI) [pdf, html, other]

Title: Zero, Finite, and Infinite Belief History of Theory of Mind Reasoning in Large Language Models

Weizhi Tang, Vaishak Belle

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1909] arXiv:2406.04851 (cross-list from cs.HC) [pdf, html, other]

Title: Digital assistant in a point of sales

Emilia Lesiak, Grzegorz Wolny, Bartosz Przybył, Michał Szczerbak

Comments: update: cleaned the unnecessary files and updated the metadata

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1910] arXiv:2406.04882 (cross-list from cs.RO) [pdf, html, other]

Title: InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environment

Yuxing Long, Wenzhe Cai, Hongcheng Wang, Guanqi Zhan, Hao Dong

Comments: Submitted to CoRL 2024

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1911] arXiv:2406.04886 (cross-list from cs.CV) [pdf, html, other]

Title: Unveiling the Invisible: Captioning Videos with Metaphors

Abisek Rajakumar Kalarani, Pushpak Bhattacharyya, Sumit Shekhar

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1912] arXiv:2406.04904 (cross-list from eess.AS) [pdf, html, other]

Title: XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model

Edresson Casanova, Kelly Davis, Eren Gölge, Görkem Göknar, Iulian Gulea, Logan Hart, Aya Aljafari, Joshua Meyer, Reuben Morais, Samuel Olayemi, Julian Weber

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1913] arXiv:2406.04927 (cross-list from eess.AS) [pdf, html, other]

Title: LLM-based speaker diarization correction: A generalizable approach

Georgios Efstathiadis, Vijay Yadav, Anzar Abbas

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1914] arXiv:2406.05013 (cross-list from cs.IR) [pdf, html, other]

Title: CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search

Fengran Mo, Abbas Ghaddar, Kelong Mao, Mehdi Rezagholizadeh, Boxing Chen, Qun Liu, Jian-Yun Nie

Comments: Accepted by EMNLP 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1915] arXiv:2406.05039 (cross-list from cs.CV) [pdf, html, other]

Title: Bootstrapping Referring Multi-Object Tracking

Yani Zhang, Dongming Wu, Wencheng Han, Xingping Dong

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1916] arXiv:2406.05080 (cross-list from cs.RO) [pdf, html, other]

Title: I2EDL: Interactive Instruction Error Detection and Localization

Francesco Taioli, Stefano Rosa, Alberto Castellini, Lorenzo Natale, Alessio Del Bue, Alessandro Farinelli, Marco Cristani, Yiming Wang

Comments: Accepted at IEEE RO-MAN 2024

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1917] arXiv:2406.05084 (cross-list from cs.CY) [pdf, other]

Title: On Ambiguity and the Expressive Function of Law: The Role of Pragmatics in Smart Legal Ecosystems

Pompeu Casanovas

Comments: 50 pages, 6 Figures, first presented at the 31st Congress of General Linguistics of the University of Barcelona (UB, CLUB31), October, 2023. To be published in the Catalan Linguistic Series as a chapter of the volume edited by Jordi Fortuny, Pau Francesch and Lluis Payrato (eds.), Ambiguity: an interdisciplinary approach. Barcelona: Edicions de la Universitat de Barcelona, 2025

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[1918] arXiv:2406.05132 (cross-list from cs.CV) [pdf, html, other]

Title: 3D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination

Jianing Yang, Xuweiyi Chen, Nikhil Madaan, Madhavan Iyengar, Shengyi Qian, David F. Fouhey, Joyce Chai

Comments: Project website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Robotics (cs.RO)

[1919] arXiv:2406.05183 (cross-list from cs.LG) [pdf, other]

Title: The Factorization Curse: Which Tokens You Predict Underlie the Reversal Curse and More

Ouail Kitouni, Niklas Nolte, Diane Bouchacourt, Adina Williams, Mike Rabbat, Mark Ibrahim

Comments: 18 pages, 7 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1920] arXiv:2406.05190 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating the Effectiveness of Data Augmentation for Emotion Classification in Low-Resource Settings

Aashish Arora, Elsbeth Turcan

Comments: The first author contributed significantly

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1921] arXiv:2406.05205 (cross-list from cs.CV) [pdf, html, other]

Title: CPLIP: Zero-Shot Learning for Histopathology with Comprehensive Vision-Language Alignment

Sajid Javed, Arif Mahmood, Iyyakutti Iyappan Ganapathi, Fayaz Ali Dharejo, Naoufel Werghi, Mohammed Bennamoun

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[1922] arXiv:2406.05259 (cross-list from eess.AS) [pdf, html, other]

Title: A model of early word acquisition based on realistic-scale audiovisual naming events

Khazar Khorrami, Okko Räsänen

Comments: 22 pages, 4 figures, journal article, submitted for review

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1923] arXiv:2406.05317 (cross-list from cs.LG) [pdf, html, other]

Title: LoCoCo: Dropping In Convolutions for Long Context Compression

Ruisi Cai, Yuandong Tian, Zhangyang Wang, Beidi Chen

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1924] arXiv:2406.05343 (cross-list from cs.AI) [pdf, html, other]

Title: M3GIA: A Cognition Inspired Multilingual and Multimodal General Intelligence Ability Benchmark

Wei Song, Yadong Li, Jianhua Xu, Guowei Wu, Lingfeng Ming, Kexin Yi, Weihua Luo, Houyi Li, Yi Du, Fangda Guo, Kaicheng Yu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1925] arXiv:2406.05410 (cross-list from cs.AI) [pdf, html, other]

Title: MLLM-SR: Conversational Symbolic Regression base Multi-Modal Large Language Models

Yanjie Li, Weijun Li, Lina Yu, Min Wu, Jingyi Liu, Wenqiang Li, Shu Wei, Yusong Deng

Comments: 13 pages,

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1926] arXiv:2406.05510 (cross-list from cs.LG) [pdf, html, other]

Title: Representation Learning with Conditional Information Flow Maximization

Dou Hu, Lingwei Wei, Wei Zhou, Songlin Hu

Comments: 16 pages, accepted to ACL 2024 (main conference), the code is available at this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1927] arXiv:2406.05515 (cross-list from cs.SD) [pdf, html, other]

Title: Mmm whatcha say? Uncovering distal and proximal context effects in first and second-language word perception using psychophysical reverse correlation

Paige Tuttösí, H. Henny Yeung, Yue Wang, Fenqi Wang, Guillaume Denis, Jean-Julien Aucouturier, Angelica Lim

Comments: Accepted to INTERSPEECH 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1928] arXiv:2406.05516 (cross-list from cs.LG) [pdf, html, other]

Title: Verbalized Probabilistic Graphical Modeling with Large Language Models

Hengguan Huang, Xing Shen, Songtao Wang, Dianbo Liu, Hao Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1929] arXiv:2406.05534 (cross-list from cs.AI) [pdf, html, other]

Title: Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing

Biqing Qi, Pengfei Li, Fangyuan Li, Junqi Gao, Kaiyan Zhang, Bowen Zhou

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1930] arXiv:2406.05540 (cross-list from q-bio.QM) [pdf, html, other]

Title: A Fine-tuning Dataset and Benchmark for Large Language Models for Protein Understanding

Yiqing Shen, Zan Chen, Michail Mamalakis, Luhan He, Haiyang Xia, Tianbin Li, Yanzhou Su, Junjun He, Yu Guang Wang

Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1931] arXiv:2406.05547 (cross-list from cs.SD) [pdf, html, other]

Title: Exploring the Benefits of Tokenization of Discrete Acoustic Units

Avihu Dekel, Raul Fernandez

Comments: Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1932] arXiv:2406.05551 (cross-list from eess.AS) [pdf, html, other]

Title: Autoregressive Diffusion Transformer for Text-to-Speech Synthesis

Zhijun Liu, Shuai Wang, Sho Inoue, Qibing Bai, Haizhou Li

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1933] arXiv:2406.05564 (cross-list from cs.LG) [pdf, html, other]

Title: Automata Extraction from Transformers

Yihao Zhang, Zeming Wei, Meng Sun

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Formal Languages and Automata Theory (cs.FL)

[1934] arXiv:2406.05602 (cross-list from cs.CV) [pdf, html, other]

Title: Can Prompt Modifiers Control Bias? A Comparative Analysis of Text-to-Image Generative Models

Philip Wootaek Shin, Jihyun Janice Ahn, Wenpeng Yin, Jack Sampson, Vijaykrishnan Narayanan

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1935] arXiv:2406.05629 (cross-list from cs.CV) [pdf, html, other]

Title: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language

Mark Hamilton, Andrew Zisserman, John R. Hershey, William T. Freeman

Comments: Computer Vision and Pattern Recognition 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1936] arXiv:2406.05651 (cross-list from cs.RO) [pdf, html, other]

Title: A Superalignment Framework in Autonomous Driving with Large Language Models

Xiangrui Kong, Thomas Braunl, Marco Fahmi, Yue Wang

Comments: 6 pages, 5 figures, ieeeiv24

Subjects: Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1937] arXiv:2406.05673 (cross-list from cs.AI) [pdf, html, other]

Title: Flow of Reasoning:Training LLMs for Divergent Problem Solving with Minimal Examples

Fangxu Yu, Lai Jiang, Haoqiang Kang, Shibo Hao, Lianhui Qin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1938] arXiv:2406.05756 (cross-list from cs.AI) [pdf, html, other]

Title: EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models

Mengfei Du, Binhao Wu, Zejun Li, Xuanjing Huang, Zhongyu Wei

Comments: Accepted by ACL 2024 Main

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[1939] arXiv:2406.05766 (cross-list from cs.LG) [pdf, html, other]

Title: Set-CLIP: Exploring Aligned Semantic From Low-Alignment Multimodal Data Through A Distribution View

Zijia Song, Zelin Zang, Yelin Wang, Guozheng Yang, Kaicheng yu, Wanyu Chen, Miaoyu Wang, Stan Z. Li

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1940] arXiv:2406.05797 (cross-list from q-bio.BM) [pdf, html, other]

Title: 3D-MolT5: Towards Unified 3D Molecule-Text Modeling with 3D Molecular Tokenization

Qizhi Pei, Lijun Wu, Kaiyuan Gao, Jinhua Zhu, Rui Yan

Comments: 18 pages

Subjects: Biomolecules (q-bio.BM); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1941] arXiv:2406.05804 (cross-list from cs.AI) [pdf, html, other]

Title: A Review of Prominent Paradigms for LLM-Based Agents: Tool Use (Including RAG), Planning, and Feedback Learning

Xinzhe Li

Comments: CoLing 2025 Camera Ready (extended to 9 pages)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

[1942] arXiv:2406.05814 (cross-list from cs.CV) [pdf, html, other]

Title: Unified Text-to-Image Generation and Retrieval

Leigang Qu, Haochuan Li, Tan Wang, Wenjie Wang, Yongqi Li, Liqiang Nie, Tat-Seng Chua

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1943] arXiv:2406.05870 (cross-list from cs.CR) [pdf, html, other]

Title: Machine Against the RAG: Jamming Retrieval-Augmented Generation with Blocker Documents

Avital Shafran, Roei Schuster, Vitaly Shmatikov

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1944] arXiv:2406.05872 (cross-list from cs.LG) [pdf, html, other]

Title: STARLING: Self-supervised Training of Text-based Reinforcement Learning Agent with Large Language Models

Shreyas Basavatia, Keerthiram Murugesan, Shivam Ratnakar

Comments: ACL 2024 (Findings)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1945] arXiv:2406.05881 (cross-list from cs.LG) [pdf, html, other]

Title: LGR2: Language Guided Reward Relabeling for Accelerating Hierarchical Reinforcement Learning

Utsav Singh, Pramit Bhattacharyya, Vinay P. Namboodiri

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Robotics (cs.RO)

[1946] arXiv:2406.05902 (cross-list from cs.LG) [pdf, html, other]

Title: Whose Preferences? Differences in Fairness Preferences and Their Impact on the Fairness of AI Utilizing Human Feedback

Emilia Agis Lerner, Florian E. Dorner, Elliott Ash, Naman Goel

Comments: To appear in the Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, ACL 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1947] arXiv:2406.05955 (cross-list from cs.LG) [pdf, html, other]

Title: Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters

Yixin Song, Haotong Xie, Zhengyan Zhang, Bo Wen, Li Ma, Zeyu Mi, Haibo Chen

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1948] arXiv:2406.05967 (cross-list from cs.CV) [pdf, html, other]

Title: CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark

David Romero, Chenyang Lyu, Haryo Akbarianto Wibowo, Teresa Lynn, Injy Hamed, Aditya Nanda Kishore, Aishik Mandal, Alina Dragonetti, Artem Abzaliev, Atnafu Lambebo Tonja, Bontu Fufa Balcha, Chenxi Whitehouse, Christian Salamea, Dan John Velasco, David Ifeoluwa Adelani, David Le Meur, Emilio Villa-Cueva, Fajri Koto, Fauzan Farooqui, Frederico Belcavello, Ganzorig Batnasan, Gisela Vallejo, Grainne Caulfield, Guido Ivetta, Haiyue Song, Henok Biadglign Ademtew, Hernán Maina, Holy Lovenia, Israel Abebe Azime, Jan Christian Blaise Cruz, Jay Gala, Jiahui Geng, Jesus-German Ortiz-Barajas, Jinheon Baek, Jocelyn Dunstan, Laura Alonso Alemany, Kumaranage Ravindu Yasas Nagasinghe, Luciana Benotti, Luis Fernando D'Haro, Marcelo Viridiano, Marcos Estecha-Garitagoitia, Maria Camila Buitrago Cabrera, Mario Rodríguez-Cantelar, Mélanie Jouitteau, Mihail Mihaylov, Mohamed Fazli Mohamed Imam, Muhammad Farid Adilazuarda, Munkhjargal Gochoo, Munkh-Erdene Otgonbold, Naome Etori, Olivier Niyomugisha, Paula Mónica Silva, Pranjal Chitale, Raj Dabre, Rendi Chevi, Ruochen Zhang, Ryandito Diandaru, Samuel Cahyawijaya, Santiago Góngora, Soyeong Jeong, Sukannya Purkayastha, Tatsuki Kuribayashi, Teresa Clifford, Thanmay Jayakumar, Tiago Timponi Torrent, Toqeer Ehsan, Vladimir Araujo, Yova Kementchedjhieva, Zara Burzo, Zheng Wei Lim, Zheng Xin Yong, Oana Ignat, Joan Nwatu, Rada Mihalcea, Thamar Solorio, Alham Fikri Aji

Comments: 38th Conference on Neural Information Processing Systems (NeurIPS 2024) Track on Datasets and Benchmarks

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1949] arXiv:2406.05968 (cross-list from eess.AS) [pdf, html, other]

Title: Prompting Large Language Models with Audio for General-Purpose Speech Summarization

Wonjune Kang, Deb Roy

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1950] arXiv:2406.05981 (cross-list from cs.LG) [pdf, html, other]

Title: ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization

Haoran You, Yipin Guo, Yichao Fu, Wei Zhou, Huihong Shi, Xiaofan Zhang, Souvik Kundu, Amir Yazdanbakhsh, Yingyan Celine Lin

Comments: Accepted by NeurIPS 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1951] arXiv:2406.06004 (cross-list from cs.CV) [pdf, html, other]

Title: FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model

Yebin Lee, Imseong Park, Myungjoo Kang

Comments: Accepted at ACL (Main) 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1952] arXiv:2406.06007 (cross-list from cs.LG) [pdf, html, other]

Title: CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models

Peng Xia, Ze Chen, Juanxi Tian, Yangrui Gong, Ruibo Hou, Yue Xu, Zhenbang Wu, Zhiyuan Fan, Yiyang Zhou, Kangyu Zhu, Wenhao Zheng, Zhaoyang Wang, Xiao Wang, Xuchao Zhang, Chetan Bansal, Marc Niethammer, Junzhou Huang, Hongtu Zhu, Yun Li, Jimeng Sun, Zongyuan Ge, Gang Li, James Zou, Huaxiu Yao

Comments: NeurIPS 2024 Datasets and Benchmarks Track

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)

[1953] arXiv:2406.06025 (cross-list from cs.SE) [pdf, html, other]

Title: RepoQA: Evaluating Long Context Code Understanding

Jiawei Liu, Jia Le Tian, Vijay Daita, Yuxiang Wei, Yifeng Ding, Yuhan Katherine Wang, Jun Yang, Lingming Zhang

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1954] arXiv:2406.06097 (cross-list from cs.SD) [pdf, other]

Title: StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection

Sara Papi, Marco Gaido, Matteo Negri, Luisa Bentivogli

Comments: Accepted at ACL 2024 main conference

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1955] arXiv:2406.06139 (cross-list from cs.SD) [pdf, html, other]

Title: Thunder : Unified Regression-Diffusion Speech Enhancement with a Single Reverse Step using Brownian Bridge

Thanapat Trachu, Chawan Piansaddhayanon, Ekapol Chuangsuwanich

Comments: 5 pages, 3 figures, 4 tables, This paper will be submitted in the interspeech conference

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1956] arXiv:2406.06220 (cross-list from eess.AS) [pdf, html, other]

Title: Label-Looping: Highly Efficient Decoding for Transducers

Vladimir Bataev, Hainan Xu, Daniel Galvez, Vitaly Lavrukhin, Boris Ginsburg

Comments: Accepted at IEEE SLT 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1957] arXiv:2406.06251 (cross-list from eess.AS) [pdf, html, other]

Title: Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning

Chung-Ming Chien, Andros Tjandra, Apoorv Vyas, Matt Le, Bowen Shi, Wei-Ning Hsu

Comments: Accepted by InterSpeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1958] arXiv:2406.06382 (cross-list from cs.CV) [pdf, html, other]

Title: Diffusion-RPO: Aligning Diffusion Models through Relative Preference Optimization

Yi Gu, Zhendong Wang, Yueqin Yin, Yujia Xie, Mingyuan Zhou

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1959] arXiv:2406.06385 (cross-list from cs.LG) [pdf, html, other]

Title: Low-Rank Quantization-Aware Training for LLMs

Yelysei Bondarenko, Riccardo Del Chiaro, Markus Nagel

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1960] arXiv:2406.06391 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Lifelong Learning of Large Language Models: A Survey

Junhao Zheng, Shengjie Qiu, Chengming Shi, Qianli Ma

Comments: 37 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1961] arXiv:2406.06393 (cross-list from cs.CV) [pdf, html, other]

Title: STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomics

Jiawen Chen, Muqing Zhou, Wenrong Wu, Jinwei Zhang, Yun Li, Didong Li

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Genomics (q-bio.GN)

[1962] arXiv:2406.06443 (cross-list from cs.LG) [pdf, html, other]

Title: LLM Dataset Inference: Did you train on my dataset?

Pratyush Maini, Hengrui Jia, Nicolas Papernot, Adam Dziedzic

Comments: Code is available at \href{this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1963] arXiv:2406.06455 (cross-list from cs.AI) [pdf, html, other]

Title: A Large Language Model Pipeline for Breast Cancer Oncology

Tristen Pool, Dennis Trujillo

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1964] arXiv:2406.06464 (cross-list from cs.AI) [pdf, other]

Title: Transforming Wearable Data into Health Insights using Large Language Model Agents

Mike A. Merrill, Akshay Paruchuri, Naghmeh Rezaei, Geza Kovacs, Javier Perez, Yun Liu, Erik Schenck, Nova Hammerquist, Jake Sunshine, Shyam Tailor, Kumar Ayush, Hao-Wei Su, Qian He, Cory Y. McLean, Mark Malhotra, Shwetak Patel, Jiening Zhan, Tim Althoff, Daniel McDuff, Xin Liu

Comments: 38 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1965] arXiv:2406.06465 (cross-list from cs.CV) [pdf, html, other]

Title: AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Prediction

Zhen Xing, Qi Dai, Zejia Weng, Zuxuan Wu, Yu-Gang Jiang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1966] arXiv:2406.06469 (cross-list from cs.AI) [pdf, html, other]

Title: Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning

Joongwon Kim, Bhargavi Paranjape, Tushar Khot, Hannaneh Hajishirzi

Comments: 50 pages, 42 figures. Project webpage available [here](this https URL)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1967] arXiv:2406.06474 (cross-list from cs.AI) [pdf, html, other]

Title: Towards a Personal Health Large Language Model

Justin Cosentino, Anastasiya Belyaeva, Xin Liu, Nicholas A. Furlotte, Zhun Yang, Chace Lee, Erik Schenck, Yojan Patel, Jian Cui, Logan Douglas Schneider, Robby Bryant, Ryan G. Gomes, Allen Jiang, Roy Lee, Yun Liu, Javier Perez, Jameson K. Rogers, Cathy Speed, Shyam Tailor, Megan Walker, Jeffrey Yu, Tim Althoff, Conor Heneghan, John Hernandez, Mark Malhotra, Leor Stern, Yossi Matias, Greg S. Corrado, Shwetak Patel, Shravya Shetty, Jiening Zhan, Shruthi Prabhakara, Daniel McDuff, Cory Y. McLean

Comments: 72 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1968] arXiv:2406.06484 (cross-list from cs.LG) [pdf, html, other]

Title: Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Songlin Yang, Bailin Wang, Yu Zhang, Yikang Shen, Yoon Kim

Comments: Minor update

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1969] arXiv:2406.06496 (cross-list from cs.LG) [pdf, html, other]

Title: Direct Preference Optimization for Suppressing Hallucinated Prior Exams in Radiology Report Generation

Oishi Banerjee, Hong-Yu Zhou, Subathra Adithan, Stephen Kwak, Kay Wu, Pranav Rajpurkar

Comments: Added acknowledgemnts

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1970] arXiv:2406.06555 (cross-list from cs.LG) [pdf, html, other]

Title: An Evaluation Benchmark for Autoformalization in Lean4

Aryan Gulati, Devanshu Ladsaria, Shubhra Mishra, Jasdeep Sidhu, Brando Miranda

Comments: To appear at ICLR 2024 as part of the Tiny Papers track

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Programming Languages (cs.PL)

[1971] arXiv:2406.06564 (cross-list from cs.LG) [pdf, html, other]

Title: SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information

Kaiye Zhou, Shucheng Wang, Jun Xu

Comments: SwitchLoRA introduces an innovative parameter-efficient training method that dynamically switches parameters throughout the entire training period, achieving significant memory and communication overhead while preserving accuracy

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1972] arXiv:2406.06567 (cross-list from cs.LG) [pdf, html, other]

Title: DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion

Yilong Chen, Linhao Zhang, Junyuan Shang, Zhenyu Zhang, Tingwen Liu, Shuohuan Wang, Yu Sun

Comments: Accepted at NeurIPS 2024 10 pages, 9 figures, 3 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1973] arXiv:2406.06600 (cross-list from cs.LG) [pdf, other]

Title: HORAE: A Domain-Agnostic Modeling Language for Automating Multimodal Service Regulation

Yutao Sun, Mingshuai Chen, Tiancheng Zhao, Kangjia Zhao, He Li, Jintao Chen, Liqiang Lu, Xinkui Zhao, Shuiguang Deng, Jianwei Yin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1974] arXiv:2406.06619 (cross-list from eess.AS) [pdf, html, other]

Title: LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR

Zheshu Song, Jianheng Zhuo, Yifan Yang, Ziyang Ma, Shixiong Zhang, Xie Chen

Comments: 5 pages, 2 figures, conference

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1975] arXiv:2406.06620 (cross-list from cs.LG) [pdf, html, other]

Title: DualTime: A Dual-Adapter Multimodal Language Model for Time Series Representation

Weiqi Zhang, Jiexia Ye, Ziyue Li, Jia Li, Fugee Tsung

Comments: 15 pages, 12 figure, 5 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1976] arXiv:2406.06663 (cross-list from cs.CR) [pdf, html, other]

Title: SecureNet: A Comparative Study of DeBERTa and Large Language Models for Phishing Detection

Sakshi Mahendru, Tejul Pandit

Comments: Preprint. 10 pages, Accepted in IEEE 7th International Conference on Big Data and Artificial Intelligence (BDAI 2024)

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1977] arXiv:2406.06729 (cross-list from cs.IR) [pdf, html, other]

Title: Synthetic Query Generation using Large Language Models for Virtual Assistants

Sonal Sannigrahi, Thiago Fraga-Silva, Youssef Oualil, Christophe Van Gysel

Comments: SIGIR '24. The 47th International ACM SIGIR Conference on Research & Development in Information Retrieval

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1978] arXiv:2406.06737 (cross-list from cs.CR) [pdf, html, other]

Title: Raccoon: Prompt Extraction Benchmark of LLM-Integrated Applications

Junlin Wang, Tianyi Yang, Roy Xie, Bhuwan Dhingra

Comments: ACL 2024 Findings

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1979] arXiv:2406.06764 (cross-list from cs.SE) [pdf, html, other]

Title: $Classi|Q\rangle$ Towards a Translation Framework To Bridge The Classical-Quantum Programming Gap

Matteo Esposito, Maryam Tavassoli Sabzevari, Boshuai Ye, Davide Falessi, Arif Ali Khan, Davide Taibi

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Emerging Technologies (cs.ET); Programming Languages (cs.PL)

[1980] arXiv:2406.06769 (cross-list from cs.AI) [pdf, html, other]

Title: DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents

Peter Jansen, Marc-Alexandre Côté, Tushar Khot, Erin Bransom, Bhavana Dalvi Mishra, Bodhisattwa Prasad Majumder, Oyvind Tafjord, Peter Clark

Comments: Accepted to NeurIPS 2024 (Benchmark Track, Spotlight)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1981] arXiv:2406.06799 (cross-list from cs.DC) [pdf, html, other]

Title: LLM-dCache: Improving Tool-Augmented LLMs with GPT-Driven Localized Data Caching

Simranjit Singh, Michael Fore, Andreas Karatzas, Chaehong Lee, Yanan Jian, Longfei Shangguan, Fuxun Yu, Iraklis Anagnostopoulos, Dimitrios Stamoulis

Comments: ICECS 2024 Camera-Ready

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL)

[1982] arXiv:2406.06852 (cross-list from cs.CR) [pdf, html, other]

Title: A Survey of Recent Backdoor Attacks and Defenses in Large Language Models

Shuai Zhao, Meihuizi Jia, Zhongliang Guo, Leilei Gan, Xiaoyu Xu, Xiaobao Wu, Jie Fu, Yichao Feng, Fengjun Pan, Luu Anh Tuan

Comments: Accepted in TMLR

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1983] arXiv:2406.06870 (cross-list from cs.AI) [pdf, html, other]

Title: What's in an embedding? Would a rose by any embedding smell as sweet?

Venkat Venkatasubramanian

Comments: 7 pages, 9 images

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1984] arXiv:2406.07012 (cross-list from cs.SD) [pdf, html, other]

Title: Bridging Language Gaps in Audio-Text Retrieval

Zhiyong Yan, Heinrich Dinkel, Yongqing Wang, Jizhong Liu, Junbo Zhang, Yujun Wang, Bin Wang

Comments: interspeech2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1985] arXiv:2406.07017 (cross-list from cs.LG) [pdf, html, other]

Title: MoreauPruner: Robust Pruning of Large Language Models against Weight Perturbations

Zixiao Wang, Jingwei Zhang, Wenqian Zhao, Farzan Farnia, Bei Yu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1986] arXiv:2406.07034 (cross-list from cs.AI) [pdf, html, other]

Title: Improving Multi-hop Logical Reasoning in Knowledge Graphs with Context-Aware Query Representation Learning

Jeonghoon Kim, Heesoo Jung, Hyeju Jang, Hogun Park

Comments: Accepted to ACL 2024 Findings

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1987] arXiv:2406.07096 (cross-list from eess.AS) [pdf, html, other]

Title: Fast Context-Biasing for CTC and Transducer ASR models with CTC-based Word Spotter

Andrei Andrusenko, Aleksandr Laptev, Vladimir Bataev, Vitaly Lavrukhin, Boris Ginsburg

Comments: Accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1988] arXiv:2406.07133 (cross-list from eess.AS) [pdf, html, other]

Title: Translating speech with just images

Dan Oneata, Herman Kamper

Comments: Accepted at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1989] arXiv:2406.07155 (cross-list from cs.AI) [pdf, html, other]

Title: Scaling Large-Language-Model-based Multi-Agent Collaboration

Chen Qian, Zihao Xie, Yifei Wang, Wei Liu, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, Zhiyuan Liu, Maosong Sun

Comments: Work in progress; The code and data will be available at this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Networking and Internet Architecture (cs.NI); Social and Information Networks (cs.SI)

[1990] arXiv:2406.07162 (cross-list from cs.SD) [pdf, html, other]

Title: EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark

Ziyang Ma, Mingjie Chen, Hezhao Zhang, Zhisheng Zheng, Wenxi Chen, Xiquan Li, Jiaxin Ye, Xie Chen, Thomas Hain

Comments: Accepted by INTERSPEECH 2024. GitHub Repository: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[1991] arXiv:2406.07217 (cross-list from cs.LG) [pdf, other]

Title: A Synthetic Dataset for Personal Attribute Inference

Hanna Yukhymenko, Robin Staab, Mark Vero, Martin Vechev

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1992] arXiv:2406.07268 (cross-list from cs.MM) [pdf, html, other]

Title: Advancing Grounded Multimodal Named Entity Recognition via LLM-Based Reformulation and Box-Based Segmentation

Jinyuan Li, Ziyan Li, Han Li, Jianfei Yu, Rui Xia, Di Sun, Gang Pan

Comments: Extension of our Findings of EMNLP 2023 & ACL 2024 paper

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1993] arXiv:2406.07296 (cross-list from cs.RO) [pdf, html, other]

Title: Instruct Large Language Models to Drive like Humans

Ruijun Zhang, Xianda Guo, Wenzhao Zheng, Chenming Zhang, Kurt Keutzer, Long Chen

Comments: project page: this https URL

Subjects: Robotics (cs.RO); Computation and Language (cs.CL)

[1994] arXiv:2406.07310 (cross-list from eess.AS) [pdf, html, other]

Title: MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting

Zhiqi Ai, Zhiyong Chen, Shugong Xu

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1995] arXiv:2406.07327 (cross-list from cs.AI) [pdf, html, other]

Title: 3D-Properties: Identifying Challenges in DPO and Charting a Path Forward

Yuzi Yan, Yibo Miao, Jialian Li, Yipin Zhang, Jian Xie, Zhijie Deng, Dong Yan

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1996] arXiv:2406.07348 (cross-list from cs.LG) [pdf, html, other]

Title: DR-RAG: Applying Dynamic Document Relevance to Retrieval-Augmented Generation for Question-Answering

Zijian Hei, Weiling Liu, Wenjie Ou, Juyi Qiao, Junming Jiao, Guowen Song, Ting Tian, Yi Lin

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1997] arXiv:2406.07358 (cross-list from cs.AI) [pdf, html, other]

Title: AI Sandbagging: Language Models can Strategically Underperform on Evaluations

Teun van der Weij, Felix Hofstätter, Ollie Jaffe, Samuel F. Brown, Francis Rhys Ward

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1998] arXiv:2406.07378 (cross-list from cs.AI) [pdf, html, other]

Title: Large Language Models for Constrained-Based Causal Discovery

Kai-Hendrik Cohrs, Gherardo Varando, Emiliano Diaz, Vasileios Sitokonstantinou, Gustau Camps-Valls

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1999] arXiv:2406.07411 (cross-list from cs.SE) [pdf, html, other]

Title: VersiCode: Towards Version-controllable Code Generation

Tongtong Wu, Weigang Wu, Xingyu Wang, Kang Xu, Suyu Ma, Bo Jiang, Ping Yang, Zhenchang Xing, Yuan-Fang Li, Gholamreza Haffari

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2000] arXiv:2406.07476 (cross-list from cs.CV) [pdf, html, other]

Title: VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs

Zesen Cheng, Sicong Leng, Hang Zhang, Yifei Xin, Xin Li, Guanzheng Chen, Yongxin Zhu, Wenqi Zhang, Ziyang Luo, Deli Zhao, Lidong Bing

Comments: ZC, SL, HZ, YX, and XL contributed equally to this project. Code: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)