Computation and Language

Authors and titles for June 2024

[1801] arXiv:2406.00667 (cross-list from eess.IV) [pdf, html, other]

Title: An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging

Sulaiman Khan, Md. Rafiul Biswas, Alina Murad, Hazrat Ali, Zubair Shah

Comments: Accepted in Fifth IEEE Workshop on Artificial Intelligence for HealthCare, IEEE 25th International Conference on Information Reuse and Integration for Data Science

Subjects: Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1802] arXiv:2406.00682 (cross-list from cs.IR) [pdf, other]

Title: A lexicon obtained and validated by a data-driven approach for organic residues valorization in emerging and developing countries

Christiane Rakotomalala, Jean-Marie Paillat, Frédéric Feder, Angel Avadí, Laurent Thuriès, Marie-Liesse Vermeire, Jean-Michel Médoc, Tom Wassenaar, Caroline Hottelart, Lilou Kieffer, Elisa Ndjie, Mathieu Picart, Jorel Tchamgoue, Alvin Tulle, Laurine Valade, Annie Boyer, Marie-Christine Duchamp, Mathieu Roche

Comments: 5 pages, 2 tables

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1803] arXiv:2406.00684 (cross-list from cs.CV) [pdf, html, other]

Title: Deciphering Oracle Bone Language with Diffusion Models

Haisu Guan, Huanxin Yang, Xinyu Wang, Shengwei Han, Yongge Liu, Lianwen Jin, Xiang Bai, Yuliang Liu

Comments: ACL2024 main conference long paper

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1804] arXiv:2406.00765 (cross-list from cs.AI) [pdf, other]

Title: The Embodied World Model Based on LLM with Visual Information and Prediction-Oriented Prompts

Wakana Haijima, Kou Nakakubo, Masahiro Suzuki, Yutaka Matsuo

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1805] arXiv:2406.00799 (cross-list from cs.CR) [pdf, html, other]

Title: Are you still on track!? Catching LLM Task Drift with Activations

Sahar Abdelnabi, Aideen Fay, Giovanni Cherubin, Ahmed Salem, Mario Fritz, Andrew Paverd

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1806] arXiv:2406.00894 (cross-list from cs.LG) [pdf, html, other]

Title: Pretrained Hybrids with MAD Skills

Nicholas Roberts, Samuel Guo, Zhiqi Gao, Satya Sai Srinath Namburi GNVV, Sonia Cromp, Chengjun Wu, Chengyu Duan, Frederic Sala

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1807] arXiv:2406.00898 (cross-list from cs.SD) [pdf, html, other]

Title: Phonetic Error Analysis of Raw Waveform Acoustic Models with Parametric and Non-Parametric CNNs

Erfan Loweimi, Andrea Carmantini, Peter Bell, Steve Renals, Zoran Cvetkovic

Comments: 5 pages, 6 figures, 3 tables

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1808] arXiv:2406.00999 (cross-list from cs.LG) [pdf, html, other]

Title: Seeing the Forest through the Trees: Data Leakage from Partial Transformer Gradients

Weijun Li, Qiongkai Xu, Mark Dras

Comments: accepted to EMNLP2024 (Main)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1809] arXiv:2406.01013 (cross-list from cs.LG) [pdf, html, other]

Title: Scalable Ensembling For Mitigating Reward Overoptimisation

Ahmed M. Ahmed, Rafael Rafailov, Stepan Sharkov, Xuechen Li, Sanmi Koyejo

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1810] arXiv:2406.01124 (cross-list from cs.LG) [pdf, html, other]

Title: Latent Logic Tree Extraction for Event Sequence Explanation from LLMs

Zitao Song, Chao Yang, Chaojie Wang, Bo An, Shuang Li

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1811] arXiv:2406.01197 (cross-list from cs.IR) [pdf, html, other]

Title: A Survey of Generative Information Retrieval

Tzu-Lin Kuo, Tzu-Wei Chiu, Tzung-Sheng Lin, Sheng-Yang Wu, Chao-Wei Huang, Yun-Nung Chen

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1812] arXiv:2406.01233 (cross-list from cs.IR) [pdf, html, other]

Title: Multi-word Term Embeddings Improve Lexical Product Retrieval

Viktor Shcherbakov, Fedor Krasnov

Comments: 10 pages, 4 figures

Journal-ref: In Proceedings of the Seventh Workshop on e-Commerce and NLP, LREC-COLING 2024, pages 115-124, Torino, Italia. ELRA and ICCL

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1813] arXiv:2406.01364 (cross-list from cs.CR) [pdf, html, other]

Title: BELLS: A Framework Towards Future Proof Benchmarks for the Evaluation of LLM Safeguards

Diego Dorn, Alexandre Variengien, Charbel-Raphaël Segerie, Vincent Corruble

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1814] arXiv:2406.01422 (cross-list from cs.SE) [pdf, html, other]

Title: How to Understand Whole Software Repository?

Yingwei Ma, Qingping Yang, Rongyu Cao, Binhua Li, Fei Huang, Yongbin Li

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1815] arXiv:2406.01424 (cross-list from cs.LG) [pdf, html, other]

Title: Universal In-Context Approximation By Prompting Fully Recurrent Models

Aleksandar Petrov, Tom A. Lamb, Alasdair Paren, Philip H.S. Torr, Adel Bibi

Comments: Published at NeurIPS 2024, Code at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1816] arXiv:2406.01457 (cross-list from cs.LG) [pdf, html, other]

Title: Differentially Private Tabular Data Synthesis using Large Language Models

Toan V. Tran, Li Xiong

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1817] arXiv:2406.01462 (cross-list from cs.LG) [pdf, html, other]

Title: The Importance of Online Data: Understanding Preference Fine-tuning via Coverage

Yuda Song, Gokul Swamy, Aarti Singh, J. Andrew Bagnell, Wen Sun

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1818] arXiv:2406.01561 (cross-list from cs.CV) [pdf, html, other]

Title: Long and Short Guidance in Score identity Distillation for One-Step Text-to-Image Generation

Mingyuan Zhou, Zhendong Wang, Huangjie Zheng, Hai Huang

Comments: Code and model checkpoints available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[1819] arXiv:2406.01566 (cross-list from cs.DC) [pdf, html, other]

Title: Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1820] arXiv:2406.01592 (cross-list from cs.CV) [pdf, html, other]

Title: Text-guided Controllable Mesh Refinement for Interactive 3D Modeling

Yun-Chun Chen, Selena Ling, Zhiqin Chen, Vladimir G. Kim, Matheus Gadelha, Alec Jacobson

Comments: SIGGRAPH Asia 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Graphics (cs.GR); Machine Learning (cs.LG)

[1821] arXiv:2406.01606 (cross-list from cs.IR) [pdf, html, other]

Title: SymTax: Symbiotic Relationship and Taxonomy Fusion for Effective Citation Recommendation

Karan Goyal, Mayank Goel, Vikram Goyal, Mukesh Mohania

Comments: Accepted in ACL 2024

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1822] arXiv:2406.01607 (cross-list from cs.IR) [pdf, html, other]

Title: Recent advances in text embedding: A Comprehensive Review of Top-Performing Methods on the MTEB Benchmark

Hongliu Cao

Comments: 21 pages

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1823] arXiv:2406.01608 (cross-list from cs.IR) [pdf, html, other]

Title: Detecting Deceptive Dark Patterns in E-commerce Platforms

Arya Ramteke, Sankalp Tembhurne, Gunesh Sonawane, Ratnmala N. Bhimanpallewar

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1824] arXiv:2406.01609 (cross-list from cs.IR) [pdf, html, other]

Title: Judgement Citation Retrieval using Contextual Similarity

Akshat Mohan Dasula, Hrushitha Tigulla, Preethika Bhukya

Comments: 14 pages, 16 images

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1825] arXiv:2406.01624 (cross-list from eess.AS) [pdf, html, other]

Title: Unveiling Hidden Factors: Explainable AI for Feature Boosting in Speech Emotion Recognition

Alaa Nfissi, Wassim Bouachir, Nizar Bouguila, Brian Mishara

Comments: Published in: Springer Nature International Journal of Applied Intelligence (2024)

Journal-ref: Applied Intelligence (2024), 1-24

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1826] arXiv:2406.01633 (cross-list from cs.IR) [pdf, other]

Title: On Overcoming Miscalibrated Conversational Priors in LLM-based Chatbots

Christine Herlihy, Jennifer Neville, Tobias Schnabel, Adith Swaminathan

Comments: Preprint of UAI'24 conference publication

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1827] arXiv:2406.01638 (cross-list from cs.LG) [pdf, html, other]

Title: TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignment

Chenxi Liu, Qianxiong Xu, Hao Miao, Sun Yang, Lingzheng Zhang, Cheng Long, Ziyue Li, Rui Zhao

Comments: Accepted by AAAI 2025 (Main Technical Track)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1828] arXiv:2406.01789 (cross-list from cs.LG) [pdf, other]

Title: AI-based Classification of Customer Support Tickets: State of the Art and Implementation with AutoML

Mario Truss, Stephan Boehm

Journal-ref: Proceedings of the IWEMB 2021/2022: Fifth and Sixth International Workshop on Entrepreneurship, Electronic and Mobile Business

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1829] arXiv:2406.01876 (cross-list from cs.DB) [pdf, html, other]

Title: GRAM: Generative Retrieval Augmented Matching of Data Schemas in the Context of Data Security

Xuanqing Liu, Luyang Kong, Runhui Wang, Patrick Song, Austin Nevins, Henrik Johnson, Nimish Amlathe, Davor Golac

Comments: KDD 2024 Camera Ready; 11 pages, 8 figures

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1830] arXiv:2406.01895 (cross-list from cs.LG) [pdf, html, other]

Title: Explicitly Encoding Structural Symmetry is Key to Length Generalization in Arithmetic Tasks

Mahdi Sabbaghi, George Pappas, Hamed Hassani, Surbhi Goel

Comments: 32 pages, 16 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1831] arXiv:2406.01914 (cross-list from cs.CV) [pdf, html, other]

Title: HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Task

Yu Tian, Tianqi Shao, Tsukasa Demizu, Xuyang Wu, Hsin-Tai Wu

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1832] arXiv:2406.01946 (cross-list from cs.CR) [pdf, html, other]

Title: Bileve: Securing Text Provenance in Large Language Models Against Spoofing with Bi-level Signature

Tong Zhou, Xuandong Zhao, Xiaolin Xu, Shaolei Ren

Comments: NeurIPS 2024 camera-ready

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1833] arXiv:2406.02004 (cross-list from cs.CR) [pdf, html, other]

Title: Efficiently Train ASR Models that Memorize Less and Perform Better with Per-core Clipping

Lun Wang, Om Thakkar, Zhong Meng, Nicole Rafidi, Rohit Prabhavalkar, Arun Narayanan

Comments: Accepted to Interspeech'24

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1834] arXiv:2406.02009 (cross-list from eess.AS) [pdf, html, other]

Title: Phonetic Enhanced Language Modeling for Text-to-Speech Synthesis

Kun Zhou, Shengkui Zhao, Yukun Ma, Chong Zhang, Hao Wang, Dianwen Ng, Chongjia Ni, Nguyen Trung Hieu, Jia Qi Yip, Bin Ma

Comments: Accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1835] arXiv:2406.02061 (cross-list from cs.LG) [pdf, html, other]

Title: Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Models

Marianna Nezhurina, Lucia Cipolina-Kun, Mehdi Cherti, Jenia Jitsev

Comments: v2.01. Minor edits. Further experiments on various AIW problem variations. AIW "Alice Female Power Boost", AIW Extension (AIW Ext). Including recent Claude 3.5 Sonnet and Qwen 2 72B Instruct results

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1836] arXiv:2406.02128 (cross-list from cs.LG) [pdf, html, other]

Title: Iteration Head: A Mechanistic Study of Chain-of-Thought

Vivien Cabannes, Charles Arnal, Wassim Bouaziz, Alice Yang, Francois Charton, Julia Kempe

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1837] arXiv:2406.02133 (cross-list from eess.AS) [pdf, html, other]

Title: SimulTron: On-Device Simultaneous Speech to Speech Translation

Alex Agranovich, Eliya Nachmani, Oleg Rybakov, Yifan Ding, Ye Jia, Nadav Bar, Heiga Zen, Michelle Tadmor Ramanovich

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1838] arXiv:2406.02135 (cross-list from cs.IR) [pdf, html, other]

Title: Robust Interaction-Based Relevance Modeling for Online e-Commerce Search

Ben Chen, Huangyu Dai, Xiang Ma, Wen Jiang, Wei Ning

Comments: Accepted by ECML-PKDD'24 as Outstanding Paper. 8 pages, 2 figures, 7 tables

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1839] arXiv:2406.02166 (cross-list from cs.SD) [pdf, html, other]

Title: Whistle: Data-Efficient Multilingual and Crosslingual Speech Recognition via Weakly Phonetic Supervision

Saierdaer Yusuyin, Te Ma, Hao Huang, Wenbo Zhao, Zhijian Ou

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1840] arXiv:2406.02208 (cross-list from cs.CV) [pdf, html, other]

Title: Why Only Text: Empowering Vision-and-Language Navigation with Multi-modal Prompts

Haodong Hong, Sen Wang, Zi Huang, Qi Wu, Jiajun Liu

Comments: IJCAI 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1841] arXiv:2406.02265 (cross-list from cs.CV) [pdf, html, other]

Title: Understanding Retrieval Robustness for Retrieval-Augmented Image Captioning

Wenyan Li, Jiaang Li, Rita Ramos, Raphael Tang, Desmond Elliott

Comments: 9 pages, long paper at ACL 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1842] arXiv:2406.02332 (cross-list from cs.LG) [pdf, html, other]

Title: Extended Mind Transformers

Phoebe Klett, Thomas Ahle

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1843] arXiv:2406.02356 (cross-list from cs.LG) [pdf, html, other]

Title: Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasks

Andrew Gambardella, Yusuke Iwasawa, Yutaka Matsuo

Comments: In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1844] arXiv:2406.02368 (cross-list from cs.IR) [pdf, html, other]

Title: Large Language Models Make Sample-Efficient Recommender Systems

Jianghao Lin, Xinyi Dai, Rong Shan, Bo Chen, Ruiming Tang, Yong Yu, Weinan Zhang

Comments: Accepted by Frontier of Computer Science

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1845] arXiv:2406.02377 (cross-list from cs.IR) [pdf, html, other]

Title: XRec: Large Language Models for Explainable Recommendation

Qiyao Ma, Xubin Ren, Chao Huang

Comments: Accepted to EMNLP 2024 Findings

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1846] arXiv:2406.02469 (cross-list from cs.LG) [pdf, html, other]

Title: Landscape-Aware Growing: The Power of a Little LAG

Stefani Karp, Nikunj Saunshi, Sobhan Miryoosefi, Sashank J. Reddi, Sanjiv Kumar

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1847] arXiv:2406.02488 (cross-list from eess.AS) [pdf, html, other]

Title: Language-Universal Speech Attributes Modeling for Zero-Shot Multilingual Spoken Keyword Recognition

Hao Yen, Pin-Jui Ku, Sabato Marco Siniscalchi, Chin-Hui Lee

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1848] arXiv:2406.02539 (cross-list from cs.CV) [pdf, html, other]

Title: Parrot: Multilingual Visual Instruction Tuning

Hai-Long Sun, Da-Wei Zhou, Yang Li, Shiyin Lu, Chao Yi, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, De-Chuan Zhan, Han-Jia Ye

Comments: Code is available at: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1849] arXiv:2406.02543 (cross-list from cs.LG) [pdf, html, other]

Title: To Believe or Not to Believe Your LLM

Yasin Abbasi Yadkori, Ilja Kuzborskij, András György, Csaba Szepesvári

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1850] arXiv:2406.02554 (cross-list from eess.AS) [pdf, other]

Title: Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition

Shijian Deng, Erin E. Kosloski, Siddhi Patel, Zeke A. Barnett, Yiyang Nan, Alexander Kaplan, Sisira Aarukapalli, William T. Doan, Matthew Wang, Harsh Singh, Pamela R. Rollins, Yapeng Tian

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[1851] arXiv:2406.02555 (cross-list from eess.AS) [pdf, other]

Title: PhoWhisper: Automatic Speech Recognition for Vietnamese

Thanh-Thien Le, Linh The Nguyen, Dat Quoc Nguyen

Comments: Accepted to ICLR 2024 Tiny Papers Track

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1852] arXiv:2406.02560 (cross-list from eess.AS) [pdf, html, other]

Title: Less Peaky and More Accurate CTC Forced Alignment by Label Priors

Ruizhe Huang, Xiaohui Zhang, Zhaoheng Ni, Li Sun, Moto Hira, Jeff Hwang, Vimal Manohar, Vineel Pratap, Matthew Wiesner, Shinji Watanabe, Daniel Povey, Sanjeev Khudanpur

Comments: Accepted by ICASSP 2024. Github repo: this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1853] arXiv:2406.02562 (cross-list from eess.AS) [pdf, other]

Title: Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devices

Gwantae Kim, Bokyeung Lee, Donghyeon Kim, Hanseok Ko

Comments: Table 2 is revised

Journal-ref: ICASSP 2024 Workshop(HSCMA 2024) paper

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1854] arXiv:2406.02563 (cross-list from eess.AS) [pdf, html, other]

Title: A cost minimization approach to fix the vocabulary size in a tokenizer for an End-to-End ASR system

Sunil Kumar Kopparapu, Ashish Panda

Comments: 5 pages, 4 figures

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1855] arXiv:2406.02565 (cross-list from cs.SD) [pdf, html, other]

Title: Sequence-to-sequence models in peer-to-peer learning: A practical application

Robert Šajina, Ivo Ipšić

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Audio and Speech Processing (eess.AS)

[1856] arXiv:2406.02566 (cross-list from eess.AS) [pdf, other]

Title: Combining X-Vectors and Bayesian Batch Active Learning: Two-Stage Active Learning Pipeline for Speech Recognition

Ognjen Kundacina, Vladimir Vincan, Dragisa Miskovic

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1857] arXiv:2406.02592 (cross-list from cs.LG) [pdf, html, other]

Title: LOLAMEME: Logic, Language, Memory, Mechanistic Framework

Jay Desai, Xiaobo Guo, Srinivasan H. Sengamedu

Comments: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1858] arXiv:2406.02791 (cross-list from cs.AI) [pdf, html, other]

Title: Language Models can Infer Action Semantics for Symbolic Planners from Environment Feedback

Wang Zhu, Ishika Singh, Robin Jia, Jesse Thomason

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1859] arXiv:2406.02795 (cross-list from cs.HC) [pdf, html, other]

Title: ArguMentor: Augmenting User Experiences with Counter-Perspectives

Priya Pitre, Kurt Luther

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1860] arXiv:2406.02798 (cross-list from cs.DL) [pdf, other]

Title: Promotional Language and the Adoption of Innovative Ideas in Science

Hao Peng, Huilian Sophie Qiu, Henrik Barslund Fosse, Brian Uzzi

Subjects: Digital Libraries (cs.DL); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1861] arXiv:2406.02804 (cross-list from cs.AI) [pdf, html, other]

Title: $\texttt{ACCORD}$: Closing the Commonsense Measurability Gap

François Roewer-Després, Jinyue Feng, Zining Zhu, Frank Rudzicz

Comments: For leaderboard and dataset download, see this https URL For source code, see this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1862] arXiv:2406.02844 (cross-list from cs.IR) [pdf, html, other]

Title: Item-Language Model for Conversational Recommendation

Li Yang, Anushya Subbiah, Hardik Patel, Judith Yue Li, Yanwei Song, Reza Mirghaderi, Vikram Aggarwal

Comments: 15 pages, 3 figures

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1863] arXiv:2406.02900 (cross-list from cs.LG) [pdf, html, other]

Title: Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms

Rafael Rafailov, Yaswanth Chittepu, Ryan Park, Harshit Sikchi, Joey Hejna, Bradley Knox, Chelsea Finn, Scott Niekum

Comments: 30 pages, 38th Conference on Neural Information Processing Systems (NeurIPS 2024)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1864] arXiv:2406.02924 (cross-list from cs.LG) [pdf, html, other]

Title: Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models

Peijie Dong, Lujun Li, Zhenheng Tang, Xiang Liu, Xinglin Pan, Qiang Wang, Xiaowen Chu

Comments: Accepted by ICML2024, 29 pages, 4 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)

[1865] arXiv:2406.02925 (cross-list from eess.AS) [pdf, html, other]

Title: Task Arithmetic can Mitigate Synthetic-to-Real Gap in Automatic Speech Recognition

Hsuan Su, Hua Farn, Fan-Yun Sun, Shang-Tse Chen, Hung-yi Lee

Comments: EMNLP 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1866] arXiv:2406.02943 (cross-list from cs.IR) [pdf, other]

Title: The Task-oriented Queries Benchmark (ToQB)

Keun Soo Yim

Comments: Data available on GitHub, this https URL

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Neural and Evolutionary Computing (cs.NE)

[1867] arXiv:2406.02950 (cross-list from eess.AS) [pdf, html, other]

Title: 4D ASR: Joint Beam Search Integrating CTC, Attention, Transducer, and Mask Predict Decoders

Yui Sudo, Muhammad Shakeel, Yosuke Fukumoto, Brian Yan, Jiatong Shi, Yifan Peng, Shinji Watanabe

Comments: submitted to IEEE/ACM Transactions on Audio Speech and Language Processing

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1868] arXiv:2406.02958 (cross-list from cs.LG) [pdf, html, other]

Title: PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs

Charlie Hou, Akshat Shrivastava, Hongyuan Zhan, Rylan Conway, Trang Le, Adithya Sagar, Giulia Fanti, Daniel Lazar

Comments: ICML 2024 (Oral). Latest revision corrects a discussion on concurrent work arXiv:2403.01749. We described their work as reliant on using closed-sourced models when in reality they also evaluate and use open source models. This has been corrected in this version

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[1869] arXiv:2406.02969 (cross-list from cs.LG) [pdf, html, other]

Title: Filtered not Mixed: Stochastic Filtering-Based Online Gating for Mixture of Large Language Models

Raeid Saqur, Anastasis Kratsios, Florian Krach, Yannick Limmer, Jacob-Junqi Tian, John Willes, Blanka Horvath, Frank Rudzicz

Comments: 29 pages, 5 Appendix sections

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computational Finance (q-fin.CP); Mathematical Finance (q-fin.MF)

[1870] arXiv:2406.03008 (cross-list from cs.CV) [pdf, html, other]

Title: DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences

Yidong Huang, Jacob Sansom, Ziqiao Ma, Felix Gervits, Joyce Chai

Comments: 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1871] arXiv:2406.03068 (cross-list from cs.LG) [pdf, html, other]

Title: How Truncating Weights Improves Reasoning in Language Models

Lei Chen, Joan Bruna, Alberto Bietti

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1872] arXiv:2406.03248 (cross-list from cs.IR) [pdf, html, other]

Title: Large Language Models as Evaluators for Recommendation Explanations

Xiaoyu Zhang, Yishan Li, Jiayin Wang, Bowen Sun, Weizhi Ma, Peijie Sun, Min Zhang

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1873] arXiv:2406.03280 (cross-list from cs.LG) [pdf, html, other]

Title: FusionBench: A Comprehensive Benchmark of Deep Model Fusion

Anke Tang, Li Shen, Yong Luo, Han Hu, Bo Du, Dacheng Tao

Comments: Project homepage: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1874] arXiv:2406.03287 (cross-list from cs.NE) [pdf, html, other]

Title: SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms

Xingrun Xing, Zheng Zhang, Ziyi Ni, Shitao Xiao, Yiming Ju, Siqi Fan, Yequan Wang, Jiajun Zhang, Guoqi Li

Subjects: Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1875] arXiv:2406.03299 (cross-list from cs.AI) [pdf, html, other]

Title: The Good, the Bad, and the Hulk-like GPT: Analyzing Emotional Decisions of Large Language Models in Cooperation and Bargaining Games

Mikhail Mozikov, Nikita Severin, Valeria Bodishtianu, Maria Glushanina, Mikhail Baklashkin, Andrey V. Savchenko, Ilya Makarov

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1876] arXiv:2406.03445 (cross-list from cs.LG) [pdf, html, other]

Title: Pre-trained Large Language Models Use Fourier Features to Compute Addition

Tianyi Zhou, Deqing Fu, Vatsal Sharan, Robin Jia

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1877] arXiv:2406.03476 (cross-list from cs.LG) [pdf, html, other]

Title: Does your data spark joy? Performance gains from domain upsampling at the end of training

Cody Blakeney, Mansheej Paul, Brett W. Larsen, Sean Owen, Jonathan Frankle

Comments: The first three authors contributed equally

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1878] arXiv:2406.03482 (cross-list from cs.LG) [pdf, other]

Title: QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead

Amir Zandieh, Majid Daliri, Insu Han

Comments: 13 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Performance (cs.PF)

[1879] arXiv:2406.03614 (cross-list from cs.LG) [pdf, other]

Title: Advancing Anomaly Detection: Non-Semantic Financial Data Encoding with LLMs

Alexander Bakumenko (1), Kateřina Hlaváčková-Schindler (2), Claudia Plant (2), Nina C. Hubig (1) ((1) Clemson University, USA, (2) University of Vienna, Austria)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Risk Management (q-fin.RM)

[1880] arXiv:2406.03637 (cross-list from eess.AS) [pdf, html, other]

Title: Style Mixture of Experts for Expressive Text-To-Speech Synthesis

Ahad Jawaid, Shreeram Suresh Chandra, Junchen Lu, Berrak Sisman

Comments: Published in Audio Imagination: NeurIPS 2024 Workshop

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1881] arXiv:2406.03706 (cross-list from cs.SD) [pdf, html, other]

Title: Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model

Jinlong Xue, Yayue Deng, Yicheng Han, Yingming Gao, Ya Li

Comments: Accepted by Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1882] arXiv:2406.03707 (cross-list from cs.LG) [pdf, html, other]

Title: What Should Embeddings Embed? Autoregressive Models Represent Latent Generating Distributions

Liyi Zhang, Michael Y. Li, Thomas L. Griffiths

Comments: 15 pages, 8 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1883] arXiv:2406.03718 (cross-list from cs.CR) [pdf, other]

Title: Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuning

Xiaohu Du, Ming Wen, Jiahao Zhu, Zifan Xie, Bin Ji, Huijun Liu, Xuanhua Shi, Hai Jin

Comments: Accepted to ACL 2024 Findings

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1884] arXiv:2406.03736 (cross-list from cs.LG) [pdf, html, other]

Title: Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data

Jingyang Ou, Shen Nie, Kaiwen Xue, Fengqi Zhu, Jiacheng Sun, Zhenguo Li, Chongxuan Li

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1885] arXiv:2406.03807 (cross-list from cs.AI) [pdf, other]

Title: Tool-Planner: Task Planning with Clusters across Multiple Tools

Yanming Liu, Xinyue Peng, Jiannan Cao, Shi Bo, Yuwei Zhang, Xuhong Zhang, Sheng Cheng, Xun Wang, Jianwei Yin, Tianyu Du

Comments: 48pages second version

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1886] arXiv:2406.03857 (cross-list from cs.LG) [pdf, html, other]

Title: MuJo: Multimodal Joint Feature Space Learning for Human Activity Recognition

Stefan Gerd Fritsch, Cennet Oguz, Vitor Fortes Rey, Lala Ray, Maximilian Kiefer-Emmanouilidis, Paul Lukowicz

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1887] arXiv:2406.04116 (cross-list from cs.AI) [pdf, html, other]

Title: Promoting Fairness and Diversity in Speech Datasets for Mental Health and Neurological Disorders Research

Eleonora Mancini, Ana Tanevska, Andrea Galassi, Alessio Galatolo, Federico Ruggeri, Paolo Torroni

Comments: 34 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1888] arXiv:2406.04151 (cross-list from cs.AI) [pdf, html, other]

Title: AgentGym: Evolving Large Language Model-based Agents across Diverse Environments

Zhiheng Xi, Yiwen Ding, Wenxiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Dingwen Yang, Chenyang Liao, Xin Guo, Wei He, Songyang Gao, Lu Chen, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang

Comments: Project site: this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1889] arXiv:2406.04229 (cross-list from cs.LG) [pdf, html, other]

Title: The CLRS-Text Algorithmic Reasoning Language Benchmark

Larisa Markeeva, Sean McLeish, Borja Ibarz, Wilfried Bounsi, Olga Kozlova, Alex Vitvitskyi, Charles Blundell, Tom Goldstein, Avi Schwarzschild, Petar Veličković

Comments: Preprint, under review. Comments welcome

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Data Structures and Algorithms (cs.DS); Machine Learning (stat.ML)

[1890] arXiv:2406.04240 (cross-list from cs.LG) [pdf, html, other]

Title: Hypernetworks for Personalizing ASR to Atypical Speech

Max Müller-Eberstein, Dianna Yee, Karren Yang, Gautam Varma Mantena, Colin Lea

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1891] arXiv:2406.04264 (cross-list from cs.CV) [pdf, html, other]

Title: MLVU: Benchmarking Multi-task Long Video Understanding

Junjie Zhou, Yan Shu, Bo Zhao, Boya Wu, Zhengyang Liang, Shitao Xiao, Minghao Qin, Xi Yang, Yongping Xiong, Bo Zhang, Tiejun Huang, Zheng Liu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1892] arXiv:2406.04274 (cross-list from cs.LG) [pdf, html, other]

Title: Self-Play with Adversarial Critic: Provable and Scalable Offline Alignment for Language Models

Xiang Ji, Sanjeev Kulkarni, Mengdi Wang, Tengyang Xie

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1893] arXiv:2406.04292 (cross-list from cs.IR) [pdf, html, other]

Title: VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval

Junjie Zhou, Zheng Liu, Shitao Xiao, Bo Zhao, Yongping Xiong

Comments: Accepted to ACL 2024 main conference

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1894] arXiv:2406.04298 (cross-list from cs.IR) [pdf, html, other]

Title: Measuring and Addressing Indexical Bias in Information Retrieval

Caleb Ziems, William Held, Jane Dwivedi-Yu, Diyi Yang

Comments: ACL 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1895] arXiv:2406.04313 (cross-list from cs.LG) [pdf, html, other]

Title: Improving Alignment and Robustness with Circuit Breakers

Andy Zou, Long Phan, Justin Wang, Derek Duenas, Maxwell Lin, Maksym Andriushchenko, Rowan Wang, Zico Kolter, Matt Fredrikson, Dan Hendrycks

Comments: Code and models are available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)

[1896] arXiv:2406.04344 (cross-list from cs.LG) [pdf, html, other]

Title: Verbalized Machine Learning: Revisiting Machine Learning with Language Models

Tim Z. Xiao, Robert Bamler, Bernhard Schölkopf, Weiyang Liu

Comments: Technical Report v2 (100 pages, 27 figures, v2: added a comparison to recent work and more applications)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1897] arXiv:2406.04379 (cross-list from cs.SE) [pdf, html, other]

Title: VHDL-Eval: A Framework for Evaluating Large Language Models in VHDL Code Generation

Prashanth Vijayaraghavan, Luyao Shi, Stefano Ambrogio, Charles Mackin, Apoorva Nitsure, David Beymer, Ehsan Degan

Comments: 6 pages, 3 Figures, LAD'24

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1898] arXiv:2406.04391 (cross-list from cs.LG) [pdf, other]

Title: Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?

Rylan Schaeffer, Hailey Schoelkopf, Brando Miranda, Gabriel Mukobi, Varun Madan, Adam Ibrahim, Herbie Bradley, Stella Biderman, Sanmi Koyejo

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1899] arXiv:2406.04412 (cross-list from cs.LG) [pdf, html, other]

Title: Aligning Large Language Models with Self-generated Preference Data

Dongyoung Kim, Kimin Lee, Jinwoo Shin, Jaehyung Kim

Comments: 18 pages, under review

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1900] arXiv:2406.04432 (cross-list from eess.AS) [pdf, html, other]

Title: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition

Sreyan Ghosh, Sonal Kumar, Ashish Seth, Purva Chiniya, Utkarsh Tyagi, Ramani Duraiswami, Dinesh Manocha

Comments: InterSpeech 2024. Code and Data: this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)