Computation and Language

Authors and titles for June 2024

[2301] arXiv:2406.16061 (cross-list from cs.LG) [pdf, html, other]

Title: PORT: Preference Optimization on Reasoning Traces

Salem Lahlou, Abdalgader Abubaker, Hakim Hacid

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2302] arXiv:2406.16107 (cross-list from eess.AS) [pdf, html, other]

Title: Decoder-only Architecture for Streaming End-to-end Speech Recognition

Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe

Comments: Accepted for Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2303] arXiv:2406.16120 (cross-list from eess.AS) [pdf, html, other]

Title: Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss

Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe

Comments: Accepted to INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2304] arXiv:2406.16176 (cross-list from cs.AI) [pdf, html, other]

Title: GraphEval2000: Benchmarking and Improving Large Language Models on Graph Datasets

Qiming Wu, Zichen Chen, Will Corcoran, Misha Sra, Ambuj K. Singh

Comments: Submitted to NeurIPs 2024 Dataset and Benchmark track, under review

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2305] arXiv:2406.16201 (cross-list from cs.CR) [pdf, html, other]

Title: Blind Baselines Beat Membership Inference Attacks for Foundation Models

Debeshee Das, Jie Zhang, Florian Tramèr

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2306] arXiv:2406.16254 (cross-list from cs.LG) [pdf, html, other]

Title: Confidence Regulation Neurons in Language Models

Alessandro Stolfo, Ben Wu, Wes Gurnee, Yonatan Belinkov, Xingyi Song, Mrinmaya Sachan, Neel Nanda

Comments: NeurIPS 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2307] arXiv:2406.16308 (cross-list from cs.LG) [pdf, html, other]

Title: Anomaly Detection of Tabular Data Using LLMs

Aodong Li, Yunhan Zhao, Chen Qiu, Marius Kloft, Padhraic Smyth, Maja Rudolph, Stephan Mandt

Comments: accepted at the Anomaly Detection with Foundation Models workshop

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2308] arXiv:2406.16315 (cross-list from eess.AS) [pdf, html, other]

Title: Song Data Cleansing for End-to-End Neural Singer Diarization Using Neural Analysis and Synthesis Framework

Hokuto Munakata, Ryo Terashima, Yusuke Fujita

Comments: INTERSPEECH 2024 accepted

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2309] arXiv:2406.16332 (cross-list from cs.IR) [pdf, html, other]

Title: DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task

Wenhan Liu, Yutao Zhu, Zhicheng Dou

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2310] arXiv:2406.16408 (cross-list from math.CO) [pdf, other]

Title: A Symmetry Property of Christoffel Words

Yan Lanciault (LACIM), Christophe Reutenauer (LACIM)

Comments: In Proceedings GASCom 2024, arXiv:2406.14588

Journal-ref: EPTCS 403, 2024, pp. 123-127

Subjects: Combinatorics (math.CO); Computation and Language (cs.CL)

[2311] arXiv:2406.16477 (cross-list from cs.CV) [pdf, html, other]

Title: DaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-Resolution

Aiwen Jiang, Zhi Wei, Long Peng, Feiqiang Liu, Wenbo Li, Mingwen Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2312] arXiv:2406.16562 (cross-list from cs.CV) [pdf, html, other]

Title: EVALALIGN: Supervised Fine-Tuning Multimodal LLMs with Human-Aligned Data for Evaluating Text-to-Image Models

Zhiyu Tan, Xiaomeng Yang, Luozheng Qin, Mengping Yang, Cheng Zhang, Hao Li

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2313] arXiv:2406.16620 (cross-list from cs.CV) [pdf, html, other]

Title: OmAgent: A Multi-modal Agent Framework for Complex Video Understanding with Task Divide-and-Conquer

Lu Zhang, Tiancheng Zhao, Heting Ying, Yibo Ma, Kyusong Lee

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2314] arXiv:2406.16635 (cross-list from cs.LG) [pdf, html, other]

Title: ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models

Yash Akhauri, Ahmed F AbouElhamayed, Jordan Dotzel, Zhiru Zhang, Alexander M Rush, Safeen Huda, Mohamed S Abdelfattah

Comments: Accepted to EMNLP 2024 (Main, Long Paper)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2315] arXiv:2406.16746 (cross-list from cs.LG) [pdf, other]

Title: The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources

Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2316] arXiv:2406.16748 (cross-list from cs.LG) [pdf, other]

Title: OCALM: Object-Centric Assessment with Language Models

Timo Kaufmann, Jannis Blüml, Antonia Wüst, Quentin Delfosse, Kristian Kersting, Eyke Hüllermeier

Comments: Accepted at the RLBRew Workshop at RLC 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2317] arXiv:2406.16807 (cross-list from cs.LG) [pdf, html, other]

Title: Beyond Thumbs Up/Down: Untangling Challenges of Fine-Grained Feedback for Text-to-Image Generation

Katherine M. Collins, Najoung Kim, Yonatan Bitton, Verena Rieser, Shayegan Omidshafiei, Yushi Hu, Sherol Chen, Senjuti Dutta, Minsuk Chang, Kimin Lee, Youwei Liang, Georgina Evans, Sahil Singla, Gang Li, Adrian Weller, Junfeng He, Deepak Ramachandran, Krishnamurthy Dj Dvijotham

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2318] arXiv:2406.16810 (cross-list from cs.LG) [pdf, other]

Title: PISTOL: Dataset Compilation Pipeline for Structural Unlearning of LLMs

Xinchi Qiu, William F. Shen, Yihong Chen, Nicola Cancedda, Pontus Stenetorp, Nicholas D. Lane

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2319] arXiv:2406.16828 (cross-list from cs.IR) [pdf, html, other]

Title: Ragnar\"ok: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track

Ronak Pradeep, Nandan Thakur, Sahel Sharifymoghaddam, Eric Zhang, Ryan Nguyen, Daniel Campos, Nick Craswell, Jimmy Lin

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2320] arXiv:2406.16903 (cross-list from cs.HC) [pdf, other]

Title: Towards a copilot in BIM authoring tool using a large language model-based agent for intelligent human-machine interaction

Changyu Du, Stavros Nousias, André Borrmann

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2321] arXiv:2406.16953 (cross-list from eess.SP) [pdf, other]

Title: Validation of a new, minimally-invasive, software smartphone device to predict sleep apnea and its severity: transversal study

Justine Frija, Juliette Millet, Emilie Bequignon, Ala Covali, Guillaume Cathelain, Josselin Houenou, Helene Benzaquen, Pierre Alexis Geoffroy, Emmanuel Bacry, Mathieu Grajoszex, Marie-Pia d Ortho

Comments: 21 pages, 6 figures

Subjects: Signal Processing (eess.SP); Computation and Language (cs.CL)

[2322] arXiv:2406.16962 (cross-list from cs.LG) [pdf, html, other]

Title: MetaGreen: Meta-Learning Inspired Transformer Selection for Green Semantic Communication

Shubhabrata Mukherjee, Cory Beard, Sejun Song

Comments: arXiv admin note: substantial text overlap with arXiv:2310.07592

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2323] arXiv:2406.16985 (cross-list from cs.LG) [pdf, html, other]

Title: Unveiling LLM Mechanisms Through Neural ODEs and Control Theory

Yukun Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2324] arXiv:2406.17135 (cross-list from cs.SI) [pdf, html, other]

Title: Testing network clustering algorithms with Natural Language Processing

Ixandra Achitouv, David Chavalarias, Bruno Gaume

Comments: 10 pages, 8 figures

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY); Physics and Society (physics.soc-ph)

[2325] arXiv:2406.17224 (cross-list from cs.AI) [pdf, html, other]

Title: Large Language Models are Interpretable Learners

Ruochen Wang, Si Si, Felix Yu, Dorothea Wiesmann, Cho-Jui Hsieh, Inderjit Dhillon

Comments: Preliminary Version, Code at [this url](this https URL)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Symbolic Computation (cs.SC)

[2326] arXiv:2406.17233 (cross-list from cs.SE) [pdf, other]

Title: Self-Constructed Context Decompilation with Fined-grained Alignment Enhancement

Yunlong Feng, Dechuan Teng, Yang Xu, Honglin Mu, Xiao Xu, Libo Qin, Qingfu Zhu, Wanxiang Che

Comments: EMNLP 2024 Findings

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2327] arXiv:2406.17245 (cross-list from cs.LG) [pdf, html, other]

Title: Unlocking Continual Learning Abilities in Language Models

Wenyu Du, Shuang Cheng, Tongxu Luo, Zihan Qiu, Zeyu Huang, Ka Chun Cheung, Reynold Cheng, Jie Fu

Comments: EMNLP 2024 Findings

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2328] arXiv:2406.17266 (cross-list from eess.AS) [pdf, html, other]

Title: AG-LSEC: Audio Grounded Lexical Speaker Error Correction

Rohit Paturi, Xiang Li, Sundararajan Srinivasan

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2329] arXiv:2406.17532 (cross-list from cs.AI) [pdf, html, other]

Title: Can Large Language Models Understand DL-Lite Ontologies? An Empirical Study

Keyu Wang, Guilin Qi, Jiaqi Li, Songlin Zhai

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Logic in Computer Science (cs.LO)

[2330] arXiv:2406.17542 (cross-list from cs.LG) [pdf, html, other]

Title: CDQuant: Greedy Coordinate Descent for Accurate LLM Quantization

Pranav Ajit Nair, Arun Sai Suggala

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2331] arXiv:2406.17605 (cross-list from cs.MM) [pdf, other]

Title: NativE: Multi-modal Knowledge Graph Completion in the Wild

Yichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu, Binbin Hu, Ziqi Liu, Wen Zhang, Huajun Chen

Comments: Accepted by SIGIR 2024 as a full paper

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

[2332] arXiv:2406.17618 (cross-list from eess.AS) [pdf, html, other]

Title: Towards Building an End-to-End Multilingual Automatic Lyrics Transcription Model

Jiawen Huang, Emmanouil Benetos

Comments: Accepted at EUSIPCO 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2333] arXiv:2406.17639 (cross-list from cs.CV) [pdf, html, other]

Title: Mitigate the Gap: Investigating Approaches for Improving Cross-Modal Alignment in CLIP

Sedigheh Eslami, Gerard de Melo

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2334] arXiv:2406.17650 (cross-list from cs.AI) [pdf, html, other]

Title: ELIZA Reinterpreted: The world's first chatbot was not intended as a chatbot at all

Jeff Shrager

Comments: In process of journal review

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

[2335] arXiv:2406.17667 (cross-list from cs.SD) [pdf, html, other]

Title: This Paper Had the Smartest Reviewers -- Flattery Detection Utilising an Audio-Textual Transformer-Based Approach

Lukas Christ, Shahin Amiriparian, Friederike Hawighorst, Ann-Kathrin Schill, Angelo Boutalikakis, Lorenz Graf-Vlachy, Andreas König, Björn W. Schuller

Comments: Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2336] arXiv:2406.17706 (cross-list from cs.LG) [pdf, html, other]

Title: FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model

Feijie Wu, Zitao Li, Yaliang Li, Bolin Ding, Jing Gao

Comments: KDD 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[2337] arXiv:2406.17793 (cross-list from cs.LG) [pdf, html, other]

Title: Deep Learning Approaches for Detecting Adversarial Cyberbullying and Hate Speech in Social Networks

Sylvia Worlali Azumah, Nelly Elsayed, Zag ElSayed, Murat Ozer, Amanda La Guardia

Comments: 10 pages, 8 figures, 3 tables, under reviewing

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computers and Society (cs.CY)

[2338] arXiv:2406.17801 (cross-list from cs.SD) [pdf, html, other]

Title: A multi-speaker multi-lingual voice cloning system based on vits2 for limmits 2024 challenge

Xiaopeng Wang, Yi Lu, Xin Qi, Zhiyong Wang, Yuankun Xie, Shuchen Shi, Ruibo Fu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2339] arXiv:2406.17876 (cross-list from cs.CV) [pdf, html, other]

Title: ET tu, CLIP? Addressing Common Object Errors for Unseen Environments

Ye Won Byun, Cathy Jiao, Shahriar Noroozizadeh, Jimin Sun, Rosa Vitiello

Journal-ref: Conference on Computer Vision and Pattern Recognition (CVPR 2022) - Embodied AI Workshop

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Robotics (cs.RO)

[2340] arXiv:2406.17972 (cross-list from cs.LG) [pdf, other]

Title: LABOR-LLM: Language-Based Occupational Representations with Large Language Models

Susan Athey, Herman Brunborg, Tianyu Du, Ayush Kanodia, Keyon Vafa

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Econometrics (econ.EM)

[2341] arXiv:2406.18069 (cross-list from eess.SP) [pdf, html, other]

Title: Large Language Models for Cuffless Blood Pressure Measurement From Wearable Biosignals

Zengding Liu, Chen Chen, Jiannong Cao, Minglei Pan, Jikui Liu, Nan Li, Fen Miao, Ye Li

Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2342] arXiv:2406.18087 (cross-list from cs.SE) [pdf, html, other]

Title: EHR-Based Mobile and Web Platform for Chronic Disease Risk Prediction Using Large Language Multimodal Models

Chun-Chieh Liao, Wei-Ting Kuo, I-Hsuan Hu, Yen-Chen Shih, Jun-En Ding, Feng Liu, Fang-Ming Hung

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2343] arXiv:2406.18118 (cross-list from cs.CR) [pdf, other]

Title: SafeAligner: Safety Alignment against Jailbreak Attacks via Response Disparity Guidance

Caishuang Huang, Wanxu Zhao, Rui Zheng, Huijie Lv, Wenyu Zhan, Shihan Dou, Sixian Li, Xiao Wang, Enyu Zhou, Junjie Ye, Yuming Yang, Tao Gui, Qi Zhang, Xuanjing Huang

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[2344] arXiv:2406.18227 (cross-list from cs.CV) [pdf, html, other]

Title: GUIDE: A Guideline-Guided Dataset for Instructional Video Comprehension

Jiafeng Liang, Shixin Jiang, Zekun Wang, Haojie Pan, Zerui Chen, Zheng Chu, Ming Liu, Ruiji Fu, Zhongyuan Wang, Bing Qin

Comments: IJCAI 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2345] arXiv:2406.18301 (cross-list from eess.AS) [pdf, html, other]

Title: MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Research

Song Li, Yongbin You, Xuezhi Wang, Zhengkun Tian, Ke Ding, Guanglu Wan

Comments: Accepted by InterSpeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2346] arXiv:2406.18313 (cross-list from cs.SD) [pdf, html, other]

Title: Advancing Airport Tower Command Recognition: Integrating Squeeze-and-Excitation and Broadcasted Residual Learning

Yuanxi Lin, Tonglin Zhou, Yang Xiao

Comments: Accepted by IALP 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2347] arXiv:2406.18505 (cross-list from cs.LG) [pdf, html, other]

Title: Mental Modeling of Reinforcement Learning Agents by Language Models

Wenhao Lu, Xufeng Zhao, Josua Spisak, Jae Hee Lee, Stefan Wermter

Comments: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[2348] arXiv:2406.18522 (cross-list from cs.CV) [pdf, html, other]

Title: ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation

Shenghai Yuan, Jinfa Huang, Yongqi Xu, Yaoyang Liu, Shaofeng Zhang, Yujun Shi, Ruijie Zhu, Xinhua Cheng, Jiebo Luo, Li Yuan

Comments: NeurIPS D&B 2024 (Spotlight)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2349] arXiv:2406.18616 (cross-list from cs.SE) [pdf, html, other]

Title: Towards Large Language Model Aided Program Refinement

Yufan Cai, Zhe Hou, Xiaokun Luan, David Miguel Sanan Baena, Yun Lin, Jun Sun, Jin Song Dong

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2350] arXiv:2406.18626 (cross-list from q-bio.QM) [pdf, html, other]

Title: An LLM-based Knowledge Synthesis and Scientific Reasoning Framework for Biomedical Discovery

Oskar Wysocki, Magdalena Wysocka, Danilo Carvalho, Alex Teodor Bogatu, Danilo Miranda Gusicuma, Maxime Delmas, Harriet Unsworth, Andre Freitas

Comments: accepted for ACL 2024 System Demonstration Track

Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2351] arXiv:2406.18629 (cross-list from cs.LG) [pdf, html, other]

Title: Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs

Xin Lai, Zhuotao Tian, Yukang Chen, Senqiao Yang, Xiangru Peng, Jiaya Jia

Comments: Code, data, and models are available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2352] arXiv:2406.18665 (cross-list from cs.LG) [pdf, html, other]

Title: RouteLLM: Learning to Route LLMs with Preference Data

Isaac Ong, Amjad Almahairi, Vincent Wu, Wei-Lin Chiang, Tianhao Wu, Joseph E. Gonzalez, M Waleed Kadous, Ion Stoica

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2353] arXiv:2406.18675 (cross-list from cs.HC) [pdf, html, other]

Title: Human-AI Collaborative Taxonomy Construction: A Case Study in Profession-Specific Writing Assistants

Minhwa Lee, Zae Myung Kim, Vivek Khetan, Dongyeop Kang

Comments: Accepted to CHI 2024 In2Writing Workshop

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2354] arXiv:2406.18678 (cross-list from cs.LG) [pdf, html, other]

Title: Few-shot Personalization of LLMs with Mis-aligned Responses

Jaehyung Kim, Yiming Yang

Comments: preprint, 30 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2355] arXiv:2406.18679 (cross-list from eess.AS) [pdf, html, other]

Title: Speakers Unembedded: Embedding-free Approach to Long-form Neural Diarization

Xiang Li, Vivek Govindan, Rohit Paturi, Sundararajan Srinivasan

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2356] arXiv:2406.18695 (cross-list from cs.LG) [pdf, html, other]

Title: Learning to Correct for QA Reasoning with Black-box LLMs

Jaehyung Kim, Dongyoung Kim, Yiming Yang

Comments: 22 pages; EMNLP 2024 (long, main)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2357] arXiv:2406.18702 (cross-list from cs.HC) [pdf, html, other]

Title: Simulating The U.S. Senate: An LLM-Driven Agent Approach to Modeling Legislative Behavior and Bipartisanship

Zachary R. Baker, Zarif L. Azher

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[2358] arXiv:2406.18708 (cross-list from cs.LG) [pdf, html, other]

Title: Learn it or Leave it: Module Composition and Pruning for Continual Learning

Mingyang Wang, Heike Adel, Lukas Lange, Jannik Strötgen, Hinrich Schütze

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2359] arXiv:2406.18725 (cross-list from cs.LG) [pdf, html, other]

Title: Jailbreaking LLMs with Arabic Transliteration and Arabizi

Mansour Al Ghanim, Saleh Almohaimeed, Mengxin Zheng, Yan Solihin, Qian Lou

Comments: Accepted by EMNLP 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2360] arXiv:2406.18731 (cross-list from eess.AS) [pdf, html, other]

Title: WavRx: a Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model

Yi Zhu, Tiago Falk

Comments: Under review; Model script available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2361] arXiv:2406.18841 (cross-list from cs.CY) [pdf, other]

Title: Navigating LLM Ethics: Advancements, Challenges, and Future Directions

Junfeng Jiao, Saleh Afroogh, Yiming Xu, Connor Phillips

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2362] arXiv:2406.18842 (cross-list from cs.CY) [pdf, other]

Title: The global landscape of academic guidelines for generative AI and Large Language Models

Junfeng Jiao, Saleh Afroogh, Kevin Chen, David Atkinson, Amit Dhurandhar

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2363] arXiv:2406.18871 (cross-list from eess.AS) [pdf, html, other]

Title: DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment

Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, He Huang, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2364] arXiv:2406.18928 (cross-list from cs.SD) [pdf, html, other]

Title: Enhanced ASR Robustness to Packet Loss with a Front-End Adaptation Network

Yehoshua Dissen, Shiry Yonash, Israel Cohen, Joseph Keshet

Comments: Accepted for publication at INTERSPEECH 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[2365] arXiv:2406.18934 (cross-list from cs.FL) [pdf, other]

Title: The single-use restriction for register automata and transducers over infinite alphabets

Rafał Stefański

Comments: PhD Thesis at University of Warsaw. Supervisor: Mikołaj Bojańczyk

Subjects: Formal Languages and Automata Theory (cs.FL); Computation and Language (cs.CL)

[2366] arXiv:2406.18972 (cross-list from eess.AS) [pdf, html, other]

Title: Applying LLMs for Rescoring N-best ASR Hypotheses of Casual Conversations: Effects of Domain Adaptation and Context Carry-over

Atsunori Ogawa, Naoyuki Kamo, Kohei Matsuura, Takanori Ashihara, Takafumi Moriya, Takatomo Kano, Naohiro Tawara, Marc Delcroix

Comments: 5 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2367] arXiv:2406.18977 (cross-list from cs.RO) [pdf, html, other]

Title: RoboUniView: Visual-Language Model with Unified View Representation for Robotic Manipulation

Fanfan Liu, Feng Yan, Liming Zheng, Chengjian Feng, Yiyang Huang, Lin Ma

Subjects: Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2368] arXiv:2406.19146 (cross-list from cs.LG) [pdf, html, other]

Title: Resolving Discrepancies in Compute-Optimal Scaling of Language Models

Tomer Porian, Mitchell Wortsman, Jenia Jitsev, Ludwig Schmidt, Yair Carmon

Comments: NeurIPS 2024 revisions

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2369] arXiv:2406.19230 (cross-list from cs.NE) [pdf, html, other]

Title: Spiking Convolutional Neural Networks for Text Classification

Changze Lv, Jianhan Xu, Xiaoqing Zheng

Subjects: Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL)

[2370] arXiv:2406.19255 (cross-list from cs.CV) [pdf, html, other]

Title: Enhancing Video-Language Representations with Structural Spatio-Temporal Alignment

Hao Fei, Shengqiong Wu, Meishan Zhang, Min Zhang, Tat-Seng Chua, Shuicheng Yan

Comments: Accepted by IEEE TPAMI 2024

Journal-ref: [J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2371] arXiv:2406.19280 (cross-list from cs.CV) [pdf, html, other]

Title: HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale

Junying Chen, Chi Gui, Ruyi Ouyang, Anningzhe Gao, Shunian Chen, Guiming Hardy Chen, Xidong Wang, Ruifei Zhang, Zhenyang Cai, Ke Ji, Guangjun Yu, Xiang Wan, Benyou Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2372] arXiv:2406.19292 (cross-list from cs.LG) [pdf, other]

Title: From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data

Zheyang Xiong, Vasilis Papageorgiou, Kangwook Lee, Dimitris Papailiopoulos

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2373] arXiv:2406.19317 (cross-list from cs.LG) [pdf, html, other]

Title: Jump Starting Bandits with LLM-Generated Prior Knowledge

Parand A. Alamdari, Yanshuai Cao, Kevin H. Wilson

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2374] arXiv:2406.19384 (cross-list from cs.LG) [pdf, html, other]

Title: The Remarkable Robustness of LLMs: Stages of Inference?

Vedang Lad, Wes Gurnee, Max Tegmark

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2375] arXiv:2406.19388 (cross-list from cs.SD) [pdf, html, other]

Title: Taming Data and Transformers for Audio Generation

Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin, Guha Balakrishnan, Sergey Tulyakov, Vicente Ordonez

Comments: Project Webpage: this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[2376] arXiv:2406.19413 (cross-list from cs.CR) [pdf, other]

Title: Saliency Attention and Semantic Similarity-Driven Adversarial Perturbation

Hetvi Waghela, Jaydip Sen, Sneha Rakshit

Comments: The paper is 12 pages long. and it contains 5 tables. It is the pre-reviewed version of the paper that has been accepted for oral presentation and publication in the 5th International Conference on Data Science and Applications which will be organized in Jaipur, India from July 17 to 19, 2024. This is not the final version

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2377] arXiv:2406.19500 (cross-list from cs.AI) [pdf, html, other]

Title: Knowledge acquisition for dialogue agents using reinforcement learning on graph representations

Selene Baez Santamaria, Shihan Wang, Piek Vossen

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2378] arXiv:2406.19578 (cross-list from cs.CV) [pdf, html, other]

Title: PathAlign: A vision-language model for whole slide images in histopathology

Faruk Ahmed, Andrew Sellergren, Lin Yang, Shawn Xu, Boris Babenko, Abbi Ward, Niels Olson, Arash Mohtashamian, Yossi Matias, Greg S. Corrado, Quang Duong, Dale R. Webster, Shravya Shetty, Daniel Golden, Yun Liu, David F. Steiner, Ellery Wulczyn

Comments: 9 main pages and 19 pages of supplemental material; 3 main tables, 3 main figures and 11 supplemental tables, 7 supplemental figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2379] arXiv:2406.19648 (cross-list from cs.HC) [pdf, other]

Title: Designing and Evaluating Multi-Chatbot Interface for Human-AI Communication: Preliminary Findings from a Persuasion Task

Sion Yoon, Tae Eun Kim, Yoo Jung Oh

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2380] arXiv:2406.19712 (cross-list from cs.AI) [pdf, other]

Title: Uncertainty Quantification in Large Language Models Through Convex Hull Analysis

Ferhat Ozgur Catak, Murat Kuzlu

Comments: 17 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2381] arXiv:2406.19736 (cross-list from cs.CV) [pdf, html, other]

Title: MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment

Jihao Liu, Xin Huang, Jinliang Zheng, Boxiao Liu, Jia Wang, Osamu Yoshie, Yu Liu, Hongsheng Li

Comments: Dataset and models are available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2382] arXiv:2406.19760 (cross-list from cs.IR) [pdf, html, other]

Title: Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulation

Chenlong Deng, Kelong Mao, Zhicheng Dou

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2383] arXiv:2406.19783 (cross-list from cs.SE) [pdf, html, other]

Title: NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations

Junkai Chen, Zhenhao Li, Xing Hu, Xin Xia

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2384] arXiv:2406.20053 (cross-list from cs.CR) [pdf, html, other]

Title: Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation

Danny Halawi, Alexander Wei, Eric Wallace, Tony T. Wang, Nika Haghtalab, Jacob Steinhardt

Comments: 22 pages

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2385] arXiv:2406.20087 (cross-list from cs.LG) [pdf, html, other]

Title: ProgressGym: Alignment with a Millennium of Moral Progress

Tianyi Qiu, Yang Zhang, Xuchuan Huang, Jasmine Xinze Li, Jiaming Ji, Yaodong Yang

Comments: NeurIPS 2024 Track on Datasets and Benchmarks (Spotlight)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

[2386] arXiv:2406.20095 (cross-list from cs.RO) [pdf, html, other]

Title: LLaRA: Supercharging Robot Learning Data for Vision-Language Policy

Xiang Li, Cristina Mata, Jongwoo Park, Kumara Kahatapitiya, Yoo Sung Jang, Jinghuan Shang, Kanchana Ranasinghe, Ryan Burgert, Mu Cai, Yong Jae Lee, Michael S. Ryoo

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[2387] arXiv:2406.20098 (cross-list from cs.CV) [pdf, html, other]

Title: Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs

Sukmin Yun, Haokun Lin, Rusiru Thushara, Mohammad Qazim Bhat, Yongxin Wang, Zutao Jiang, Mingkai Deng, Jinhong Wang, Tianhua Tao, Junbo Li, Haonan Li, Preslav Nakov, Timothy Baldwin, Zhengzhong Liu, Eric P. Xing, Xiaodan Liang, Zhiqiang Shen

Comments: NeurIPS 2024 Datasets and Benchmarks Camera-ready Version. Website at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)