Computation and Language

Authors and titles for March 2024

[1251] arXiv:2403.01273 (cross-list from cs.LG) [pdf, html, other]

Title: NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention

Tianyi Zhang, Jonah Wonkyu Yi, Bowen Yao, Zhaozhuo Xu, Anshumali Shrivastava

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1252] arXiv:2403.01359 (cross-list from cs.SE) [pdf, html, other]

Title: ModelWriter: Text & Model-Synchronized Document Engineering Platform

Ferhat Erata, Claire Gardent, Bikash Gyawali, Anastasia Shimorina, Yvan Lussaud, Bedir Tekinerdogan, Geylani Kardas, Anne Monceaux

Comments: Published in: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE)

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1253] arXiv:2403.01384 (cross-list from cs.LG) [pdf, html, other]

Title: On the Compressibility of Quantized Large Language Models

Yu Mao, Weilan Wang, Hongchao Du, Nan Guan, Chun Jason Xue

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1254] arXiv:2403.01457 (cross-list from cs.IR) [pdf, html, other]

Title: Logic Rules as Explanations for Legal Case Retrieval

Zhongxiang Sun, Kepu Zhang, Weijie Yu, Haoyu Wang, Jun Xu

Comments: accepted by lrec-coling 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1255] arXiv:2403.01472 (cross-list from cs.CR) [pdf, html, other]

Title: WARDEN: Multi-Directional Backdoor Watermarks for Embedding-as-a-Service Copyright Protection

Anudeex Shetty, Yue Teng, Ke He, Qiongkai Xu

Comments: Accepted to ACL2024 (Main Proceedings)

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1256] arXiv:2403.01599 (cross-list from cs.CV) [pdf, html, other]

Title: SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos

Yulei Niu, Wenliang Guo, Long Chen, Xudong Lin, Shih-Fu Chang

Comments: Accepted by ICLR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1257] arXiv:2403.01643 (cross-list from cs.LG) [pdf, html, other]

Title: You Need to Pay Better Attention: Rethinking the Mathematics of Attention Mechanism

Mehran Hosseini, Peyman Hosseini

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1258] arXiv:2403.01747 (cross-list from cs.IR) [pdf, html, other]

Title: Towards Self-Contained Answers: Entity-Based Answer Rewriting in Conversational Search

Ivan Sekulić, Krisztian Balog, Fabio Crestani

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1259] arXiv:2403.01757 (cross-list from cs.AI) [pdf, html, other]

Title: How Multimodal Integration Boost the Performance of LLM for Optimization: Case Study on Capacitated Vehicle Routing Problems

Yuxiao Huang, Wenjie Zhang, Liang Feng, Xingyu Wu, Kay Chen Tan

Comments: 8pages,3 figures, 2 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Optimization and Control (math.OC)

[1260] arXiv:2403.01832 (cross-list from cs.AI) [pdf, html, other]

Title: Model-Based Data-Centric AI: Bridging the Divide Between Academic Ideals and Industrial Pragmatism

Chanjun Park, Minsoo Khang, Dahyun Kim

Comments: Accepted for Data-centric Machine Learning Research (DMLR) Workshop at ICLR 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1261] arXiv:2403.02090 (cross-list from cs.CV) [pdf, html, other]

Title: Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations

Sangmin Lee, Bolin Lai, Fiona Ryan, Bikram Boote, James M. Rehg

Comments: CVPR 2024 Oral

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1262] arXiv:2403.02127 (cross-list from cs.CV) [pdf, html, other]

Title: LOCR: Location-Guided Transformer for Optical Character Recognition

Yu Sun, Dongzhan Zhou, Chen Lin, Conghui He, Wanli Ouyang, Han-Sen Zhong

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1263] arXiv:2403.02167 (cross-list from eess.AS) [pdf, html, other]

Title: EMOVOME Database: Advancing Emotion Recognition in Speech Beyond Staged Scenarios

Lucía Gómez-Zaragozá, Rocío del Amor, María José Castro-Bleda, Valery Naranjo, Mariano Alcañiz Raya, Javier Marín-Morales

Comments: This article is a merged version of the description of the EMOVOME database in arXiv:2402.17496v1 and the speech emotion recognition models in arXiv:2403.02167v1. This work has been submitted to the IEEE for possible publication

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[1264] arXiv:2403.02185 (cross-list from cs.LG) [pdf, html, other]

Title: Distilled ChatGPT Topic & Sentiment Modeling with Applications in Finance

Olivier Gandouet, Mouloud Belbahri, Armelle Jezequel, Yuriy Bodjov

Comments: Edge Intelligence Workshop at AAAI24

Subjects: Machine Learning (cs.LG); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL)

[1265] arXiv:2403.02253 (cross-list from cs.CR) [pdf, html, other]

Title: KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detection

Yuexin Li, Chengyu Huang, Shumin Deng, Mei Lin Lock, Tri Cao, Nay Oo, Hoon Wei Lim, Bryan Hooi

Comments: Accepted by USENIX Security 2024

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1266] arXiv:2403.02325 (cross-list from cs.CV) [pdf, html, other]

Title: Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training

David Wan, Jaemin Cho, Elias Stengel-Eskin, Mohit Bansal

Comments: Project website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1267] arXiv:2403.02371 (cross-list from eess.AS) [pdf, html, other]

Title: NeuroVoz: a Castillian Spanish corpus of parkinsonian speech

Janaína Mendes-Laureano, Jorge A. Gómez-García, Alejandro Guerrero-López, Elisa Luque-Buzo, Julián D. Arias-Londoño, Francisco J. Grandas-Pérez, Juan I. Godino-Llorente

Comments: Preprint version

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[1268] arXiv:2403.02419 (cross-list from cs.LG) [pdf, html, other]

Title: Are More LLM Calls All You Need? Towards Scaling Laws of Compound Inference Systems

Lingjiao Chen, Jared Quincy Davis, Boris Hanin, Peter Bailis, Ion Stoica, Matei Zaharia, James Zou

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Systems and Control (eess.SY)

[1269] arXiv:2403.02475 (cross-list from cs.LG) [pdf, html, other]

Title: Enhancing LLM Safety via Constrained Direct Preference Optimization

Zixuan Liu, Xiaolin Sun, Zizhan Zheng

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1270] arXiv:2403.02563 (cross-list from cs.CV) [pdf, html, other]

Title: Systemic Biases in Sign Language AI Research: A Deaf-Led Call to Reevaluate Research Agendas

Aashaka Desai, Maartje De Meulder, Julie A. Hochgesang, Annemarie Kocab, Alex X. Lu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1271] arXiv:2403.02574 (cross-list from cs.IR) [pdf, html, other]

Title: ChatCite: LLM Agent with Human Workflow Guidance for Comparative Literature Summary

Yutong Li, Lu Chen, Aiwei Liu, Kai Yu, Lijie Wen

Comments: 18 pages, 5 figures

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1272] arXiv:2403.02677 (cross-list from cs.CV) [pdf, html, other]

Title: Finetuned Multimodal Language Models Are High-Quality Image-Text Data Filters

Weizhi Wang, Khalil Mrini, Linjie Yang, Sateesh Kumar, Yu Tian, Xifeng Yan, Heng Wang

Comments: Project Website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1273] arXiv:2403.02694 (cross-list from cs.LG) [pdf, html, other]

Title: MeanCache: User-Centric Semantic Cache for Large Language Model Based Web Services

Waris Gill (1), Mohamed Elidrisi (2), Pallavi Kalapatapu (2), Ammar Ahmed (3), Ali Anwar (3), Muhammad Ali Gulzar (1) ((1) Virginia Tech, USA, (2) Cisco, USA (3) University of Minnesota, Minneapolis, USA)

Comments: This study presents the first privacy aware semantic cache for LLMs based on Federated Learning. MeanCache is the first cache that can handle contextual queries efficiently. Total pages 14

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

[1274] arXiv:2403.02745 (cross-list from cs.AI) [pdf, html, other]

Title: CURATRON: Complete and Robust Preference Data for Rigorous Alignment of Large Language Models

Son The Nguyen, Niranjan Uma Naresh, Theja Tulabandhula

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1275] arXiv:2403.02795 (cross-list from cs.AI) [pdf, html, other]

Title: Evaluating and Optimizing Educational Content with Large Language Model Judgments

Joy He-Yueya, Noah D. Goodman, Emma Brunskill

Comments: 11 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1276] arXiv:2403.02875 (cross-list from cs.CV) [pdf, html, other]

Title: Enhancing Conceptual Understanding in Multimodal Contrastive Learning through Hard Negative Samples

Philipp J. Rösch, Norbert Oswald, Michaela Geierhos, Jindřich Libovický

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1277] arXiv:2403.02939 (cross-list from cs.DL) [pdf, html, other]

Title: PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected Papers

Yoonjoo Lee, Hyeonsu B. Kang, Matt Latzke, Juho Kim, Jonathan Bragg, Joseph Chee Chang, Pao Siangliulue

Comments: Accepted to CHI 2024

Subjects: Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1278] arXiv:2403.03028 (cross-list from cs.AI) [pdf, html, other]

Title: Word Importance Explains How Prompts Affect Language Model Outputs

Stefan Hackmann, Haniyeh Mahmoudian, Mark Steadman, Michael Schmidt

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1279] arXiv:2403.03100 (cross-list from eess.AS) [pdf, html, other]

Title: NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models

Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao

Comments: Achieving human-level quality and naturalness on multi-speaker datasets (e.g., LibriSpeech) in a zero-shot way

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1280] arXiv:2403.03170 (cross-list from cs.MM) [pdf, html, other]

Title: SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detection

Peng Qi, Zehong Yan, Wynne Hsu, Mong Li Lee

Comments: To appear in CVPR 2024

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)

[1281] arXiv:2403.03218 (cross-list from cs.LG) [pdf, html, other]

Title: The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning

Nathaniel Li, Alexander Pan, Anjali Gopal, Summer Yue, Daniel Berrios, Alice Gatti, Justin D. Li, Ann-Kathrin Dombrowski, Shashwat Goel, Long Phan, Gabriel Mukobi, Nathan Helm-Burger, Rassin Lababidi, Lennart Justen, Andrew B. Liu, Michael Chen, Isabelle Barrass, Oliver Zhang, Xiaoyuan Zhu, Rishub Tamirisa, Bhrugu Bharathi, Adam Khoja, Zhenqi Zhao, Ariel Herbert-Voss, Cort B. Breuer, Samuel Marks, Oam Patel, Andy Zou, Mantas Mazeika, Zifan Wang, Palash Oswal, Weiran Lin, Adam A. Hunt, Justin Tienken-Harder, Kevin Y. Shih, Kemper Talley, John Guan, Russell Kaplan, Ian Steneker, David Campbell, Brad Jokubaitis, Alex Levinson, Jean Wang, William Qian, Kallol Krishna Karmakar, Steven Basart, Stephen Fitz, Mindy Levine, Ponnurangam Kumaraguru, Uday Tupakula, Vijay Varadharajan, Ruoyu Wang, Yan Shoshitaishvili, Jimmy Ba, Kevin M. Esvelt, Alexandr Wang, Dan Hendrycks

Comments: See the project page at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1282] arXiv:2403.03407 (cross-list from cs.CY) [pdf, html, other]

Title: Human vs. Machine: Behavioral Differences Between Expert Humans and Language Models in Wargame Simulations

Max Lamparth, Anthony Corso, Jacob Ganz, Oriana Skylar Mastro, Jacquelyn Schneider, Harold Trinkunas

Comments: Updated with new human participant results and added new LLM to results; fixed error in Table 1; all claims unaffected

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1283] arXiv:2403.03522 (cross-list from cs.SD) [pdf, html, other]

Title: Non-verbal information in spontaneous speech -- towards a new framework of analysis

Tirza Biron, Moshe Barboy, Eran Ben-Artzy, Alona Golubchik, Yanir Marmor, Smadar Szekely, Yaron Winter, David Harel

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1284] arXiv:2403.03538 (cross-list from cs.SD) [pdf, html, other]

Title: RADIA -- Radio Advertisement Detection with Intelligent Analytics

Jorge Álvarez, Juan Carlos Armenteros, Camilo Torrón, Miguel Ortega-Martín, Alfonso Ardoiz, Óscar García, Ignacio Arranz, Íñigo Galdeano, Ignacio Garrido, Adrián Alonso, Fernando Bayón, Oleg Vorontsov

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1285] arXiv:2403.03544 (cross-list from cs.AI) [pdf, html, other]

Title: Prompt Mining for Language-based Human Mobility Forecasting

Hao Xue, Tianye Tang, Ali Payani, Flora D. Salim

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1286] arXiv:2403.03737 (cross-list from cs.LG) [pdf, html, other]

Title: Probabilistic Topic Modelling with Transformer Representations

Arik Reuter, Anton Thielmann, Christoph Weisser, Benjamin Säfken, Thomas Kneib

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1287] arXiv:2403.03894 (cross-list from cs.AI) [pdf, html, other]

Title: IRCoder: Intermediate Representations Make Language Models Robust Multilingual Code Generators

Indraneil Paul, Goran Glavaš, Iryna Gurevych

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Programming Languages (cs.PL)

[1288] arXiv:2403.03920 (cross-list from cs.AI) [pdf, html, other]

Title: Enhancing Instructional Quality: Leveraging Computer-Assisted Textual Analysis to Generate In-Depth Insights from Educational Artifacts

Zewei Tian, Min Sun, Alex Liu, Shawon Sarkar, Jing Liu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1289] arXiv:2403.03956 (cross-list from cs.IR) [pdf, html, other]

Title: Backtracing: Retrieving the Cause of the Query

Rose E. Wang, Pawan Wirawarn, Omar Khattab, Noah Goodman, Dorottya Demszky

Comments: Code: this https URL EACL 2024 Findings, Long Paper

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1290] arXiv:2403.04009 (cross-list from cs.SI) [pdf, html, other]

Title: Media Bias Matters: Understanding the Impact of Politically Biased News on Vaccine Attitudes in Social Media

Bohan Jiang, Lu Cheng, Zhen Tan, Ruocheng Guo, Huan Liu

Comments: 9 pages, 6 figures, 3 tables

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Computers and Society (cs.CY); Physics and Society (physics.soc-ph)

[1291] arXiv:2403.04121 (cross-list from cs.AI) [pdf, html, other]

Title: Can Large Language Models Reason and Plan?

Subbarao Kambhampati

Comments: arXiv admin note: text overlap with arXiv:2402.01817 (v2 add creative commons attribution to Figure 2 graphic)

Journal-ref: Annals of The New York Academy of Sciences; March 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1292] arXiv:2403.04123 (cross-list from cs.SE) [pdf, html, other]

Title: Exploring LLM-based Agents for Root Cause Analysis

Devjeet Roy, Xuchao Zhang, Rashi Bhave, Chetan Bansal, Pedro Las-Casas, Rodrigo Fonseca, Saravan Rajmohan

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1293] arXiv:2403.04132 (cross-list from cs.AI) [pdf, html, other]

Title: Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Hao Zhang, Banghua Zhu, Michael Jordan, Joseph E. Gonzalez, Ion Stoica

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1294] arXiv:2403.04190 (cross-list from cs.LG) [pdf, html, other]

Title: Generative AI for Synthetic Data Generation: Methods, Challenges and the Future

Xu Guo, Yiqiang Chen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1295] arXiv:2403.04204 (cross-list from cs.AI) [pdf, html, other]

Title: On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models

Xinpeng Wang, Shitong Duan, Xiaoyuan Yi, Jing Yao, Shanlin Zhou, Zhihua Wei, Peng Zhang, Dongkuan Xu, Maosong Sun, Xing Xie

Comments: 23 pages, 7 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1296] arXiv:2403.04260 (cross-list from cs.IR) [pdf, html, other]

Title: Can Small Language Models be Good Reasoners for Sequential Recommendation?

Yuling Wang, Changxin Tian, Binbin Hu, Yanhua Yu, Ziqi Liu, Zhiqiang Zhang, Jun Zhou, Liang Pang, Xiao Wang

Comments: Accepted by TheWebConf (WWW) 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1297] arXiv:2403.04261 (cross-list from cs.AI) [pdf, other]

Title: Advancing Chinese biomedical text mining with community challenges

Hui Zong, Rongrong Wu, Jiaxue Cha, Weizhe Feng, Erman Wu, Jiakun Li, Aibin Shao, Liang Tao, Zuofeng Li, Buzhou Tang, Bairong Shen

Journal-ref: Journal of Biomedical Informatics. 2024;157:104716.

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1298] arXiv:2403.04280 (cross-list from cs.AI) [pdf, html, other]

Title: A New Benchmark for Evaluating Automatic Speech Recognition in the Arabic Call Domain

Qusai Abo Obaidah, Muhy Eddin Za'ter, Adnan Jaljuli, Ali Mahboub, Asma Hakouz, Bashar Al-Rfooh, Yazan Estaitia

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1299] arXiv:2403.04311 (cross-list from cs.AI) [pdf, html, other]

Title: ALTO: An Efficient Network Orchestrator for Compound AI Systems

Keshav Santhanam, Deepti Raghavan, Muhammad Shahir Rahman, Thejas Venkatesh, Neha Kunjal, Pratiksha Thaker, Philip Levis, Matei Zaharia

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR)

[1300] arXiv:2403.04317 (cross-list from cs.LG) [pdf, html, other]

Title: Online Adaptation of Language Models with a Memory of Amortized Contexts

Jihoon Tack, Jaehyung Kim, Eric Mitchell, Jinwoo Shin, Yee Whye Teh, Jonathan Richard Schwarz

Comments: Published as a conference proceeding for NeurIPS 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1301] arXiv:2403.04321 (cross-list from cs.CV) [pdf, html, other]

Title: Discriminative Probing and Tuning for Text-to-Image Generation

Leigang Qu, Wenjie Wang, Yongqi Li, Hanwang Zhang, Liqiang Nie, Tat-Seng Chua

Comments: CVPR 2024; project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1302] arXiv:2403.04327 (cross-list from cs.DB) [pdf, html, other]

Title: ProMoAI: Process Modeling with Generative AI

Humam Kourani, Alessandro Berti, Daniel Schuster, Wil M. P. van der Aalst

Subjects: Databases (cs.DB); Computation and Language (cs.CL)

[1303] arXiv:2403.04369 (cross-list from cs.AI) [pdf, html, other]

Title: From Graph to Word Bag: Introducing Domain Knowledge to Confusing Charge Prediction

Ang Li, Qiangchao Chen, Yiquan Wu, Ming Cai, Xiang Zhou, Fei Wu, Kun Kuang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1304] arXiv:2403.04395 (cross-list from q-bio.BM) [pdf, html, other]

Title: SGNet: Folding Symmetrical Protein Complex with Deep Learning

Zhaoqun Li, Jingcheng Yu, Qiwei Ye

Subjects: Biomolecules (q-bio.BM); Computation and Language (cs.CL)

[1305] arXiv:2403.04451 (cross-list from cs.CR) [pdf, html, other]

Title: Membership Inference Attacks and Privacy in Topic Modeling

Nico Manzonelli, Wanrong Zhang, Salil Vadhan

Comments: 13 pages + appendices and references. 9 figures

Journal-ref: Transactions on Machine Learning Research (2024)

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1306] arXiv:2403.04483 (cross-list from cs.AI) [pdf, html, other]

Title: GraphInstruct: Empowering Large Language Models with Graph Understanding and Reasoning Capability

Zihan Luo, Xiran Song, Hong Huang, Jianxun Lian, Chenhao Zhang, Jinqi Jiang, Xing Xie

Comments: 9 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1307] arXiv:2403.04577 (cross-list from cs.AI) [pdf, html, other]

Title: Wiki-TabNER:Advancing Table Interpretation Through Named Entity Recognition

Aneta Koleva, Martin Ringsquandl, Ahmed Hatem, Thomas Runkler, Volker Tresp

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1308] arXiv:2403.04618 (cross-list from cs.PL) [pdf, html, other]

Title: Strong Priority and Determinacy in Timed CCS

Luigi Liquori, Michael Mendler

Subjects: Programming Languages (cs.PL); Computation and Language (cs.CL)

[1309] arXiv:2403.04626 (cross-list from eess.IV) [pdf, html, other]

Title: MedFLIP: Medical Vision-and-Language Self-supervised Fast Pre-Training with Masked Autoencoder

Lei Li, Tianfang Zhang, Xinglin Zhang, Jiaqi Liu, Bingqi Ma, Yan Luo, Tao Chen

Subjects: Image and Video Processing (eess.IV); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1310] arXiv:2403.04732 (cross-list from cs.AI) [pdf, html, other]

Title: How Far Are We from Intelligent Visual Deductive Reasoning?

Yizhe Zhang, He Bai, Ruixiang Zhang, Jiatao Gu, Shuangfei Zhai, Josh Susskind, Navdeep Jaitly

Comments: COLM 2024. this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1311] arXiv:2403.04769 (cross-list from cs.CR) [pdf, html, other]

Title: Using Hallucinations to Bypass GPT4's Filter

Benjamin Lemkin

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1312] arXiv:2403.04783 (cross-list from cs.LG) [pdf, html, other]

Title: AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks

Yifan Zeng, Yiran Wu, Xiao Zhang, Huazheng Wang, Qingyun Wu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1313] arXiv:2403.04786 (cross-list from cs.CR) [pdf, html, other]

Title: Breaking Down the Defenses: A Comparative Survey of Attacks on Large Language Models

Arijit Ghosh Chowdhury, Md Mofijul Islam, Vaibhav Kumar, Faysal Hossain Shezan, Vaibhav Kumar, Vinija Jain, Aman Chadha

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1314] arXiv:2403.04804 (cross-list from eess.AS) [pdf, html, other]

Title: AttentionStitch: How Attention Solves the Speech Editing Problem

Antonios Alexos, Pierre Baldi

Comments: Accepted in Machine Learning for Audio workship in NeurIPS 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1315] arXiv:2403.04808 (cross-list from cs.CR) [pdf, html, other]

Title: WaterMax: breaking the LLM watermark detectability-robustness-quality trade-off

Eva Giboulot, Teddy Furon

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1316] arXiv:2403.04811 (cross-list from cs.SE) [pdf, html, other]

Title: Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models

Martin Riddell, Ansong Ni, Arman Cohan

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1317] arXiv:2403.04931 (cross-list from cs.AI) [pdf, html, other]

Title: A Survey on Human-AI Teaming with Large Pre-Trained Models

Vanshika Vats, Marzia Binta Nizam, Minghao Liu, Ziyuan Wang, Richard Ho, Mohnish Sai Prasad, Vincent Titterton, Sai Venkat Malreddy, Riya Aggarwal, Yanwen Xu, Lei Ding, Jay Mehta, Nathan Grinnell, Li Liu, Sijia Zhong, Devanathan Nallur Gandamani, Xinyi Tang, Rohan Ghosalkar, Celeste Shen, Rachel Shen, Nafisa Hussain, Kesav Ravichandran, James Davis

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1318] arXiv:2403.04960 (cross-list from cs.CR) [pdf, other]

Title: SecGPT: An Execution Isolation Architecture for LLM-Based Systems

Yuhao Wu, Franziska Roesner, Tadayoshi Kohno, Ning Zhang, Umar Iqbal

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1319] arXiv:2403.04964 (cross-list from cs.AI) [pdf, other]

Title: Tell me the truth: A system to measure the trustworthiness of Large Language Models

Carlo Lipizzi

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1320] arXiv:2403.05286 (cross-list from cs.PL) [pdf, html, other]

Title: LLM4Decompile: Decompiling Binary Code with Large Language Models

Hanzhuo Tan, Qi Luo, Jing Li, Yuqun Zhang

Subjects: Programming Languages (cs.PL); Computation and Language (cs.CL)

[1321] arXiv:2403.05297 (cross-list from cs.CV) [pdf, html, other]

Title: PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneck

Thang M. Pham, Peijie Chen, Tin Nguyen, Seunghyun Yoon, Trung Bui, Anh Totti Nguyen

Comments: Findings of NAACL 2024 (long paper)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1322] arXiv:2403.05396 (cross-list from cs.CV) [pdf, html, other]

Title: HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interaction

Zhengrui Guo, Jiabo Ma, Yingxue Xu, Yihui Wang, Liansheng Wang, Hao Chen

Comments: Accepted by MICCAI2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1323] arXiv:2403.05527 (cross-list from cs.LG) [pdf, html, other]

Title: GEAR: An Efficient KV Cache Compression Recipe for Near-Lossless Generative Inference of LLM

Hao Kang, Qingru Zhang, Souvik Kundu, Geonhwa Jeong, Zaoxing Liu, Tushar Krishna, Tuo Zhao

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1324] arXiv:2403.05535 (cross-list from cs.CV) [pdf, html, other]

Title: Tell, Don't Show!: Language Guidance Eases Transfer Across Domains in Images and Videos

Tarun Kalluri, Bodhisattwa Prasad Majumder, Manmohan Chandraker

Comments: ICML 2024 Camera-Ready. Project Page and Code: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1325] arXiv:2403.05548 (cross-list from cs.CY) [pdf, html, other]

Title: Monitoring the evolution of antisemitic discourse on extremist social media using BERT

Raza Ul Mustafa, Nathalie Japkowicz

Comments: 11 pages; 4 figures; 4 pages

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[1326] arXiv:2403.05553 (cross-list from cs.CY) [pdf, html, other]

Title: Understanding the Progression of Educational Topics via Semantic Matching

Tamador Alkhidir (1), Edmond Awad (2), Aamena Alshamsi (3) ((1) Curriculum Department, Ministry of Education, United Arab Emirates, (2) Department of Economics and Institute for Data Science and AI, University of Exeter, United Kingdom,(3) Heuristic World, Dubai, United Arab Emirates)

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1327] arXiv:2403.05561 (cross-list from cs.CY) [pdf, html, other]

Title: Detecting a Proxy for Potential Comorbid ADHD in People Reporting Anxiety Symptoms from Social Media Data

Claire S. Lee, Noelle Lim, Michael Guerzhoy

Comments: Forthcoming in Proc. of the Workshop on Computational Linguistics and Clinical Psychology (CLPsych) at EACL 2024

Journal-ref: Proceedings of the 9th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2024)

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[1328] arXiv:2403.05572 (cross-list from cs.HC) [pdf, html, other]

Title: Is ChatGPT More Empathetic than Humans?

Anuradha Welivita, Pearl Pu

Comments: 21 pages, 16 figures

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1329] arXiv:2403.05574 (cross-list from cs.HC) [pdf, html, other]

Title: HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapy

Mengxi Xiao, Qianqian Xie, Ziyan Kuang, Zhicheng Liu, Kailai Yang, Min Peng, Weiguang Han, Jimin Huang

Comments: 19 pages, 4 figures

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1330] arXiv:2403.05602 (cross-list from q-bio.BM) [pdf, html, other]

Title: Extracting Protein-Protein Interactions (PPIs) from Biomedical Literature using Attention-based Relational Context Information

Gilchan Park, Sean McCorkle, Carlos Soto, Ian Blaby, Shinjae Yoo

Comments: 10 pages, 3 figures, 7 tables, 2022 IEEE International Conference on Big Data (Big Data)

Journal-ref: In 2022 IEEE Big Data, pp. 2052-2061 (2022)

Subjects: Biomolecules (q-bio.BM); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1331] arXiv:2403.05606 (cross-list from cs.LG) [pdf, html, other]

Title: A Concept-based Interpretable Model for the Diagnosis of Choroid Neoplasias using Multimodal Data

Yifan Wu, Yang Liu, Yue Yang, Michael S. Yao, Wenli Yang, Xuehui Shi, Lihong Yang, Dongjun Li, Yueming Liu, James C. Gee, Xuan Yang, Wenbin Wei, Shi Gu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1332] arXiv:2403.05612 (cross-list from cs.LG) [pdf, html, other]

Title: Unfamiliar Finetuning Examples Control How Language Models Hallucinate

Katie Kang, Eric Wallace, Claire Tomlin, Aviral Kumar, Sergey Levine

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1333] arXiv:2403.05636 (cross-list from cs.AI) [pdf, html, other]

Title: Tuning-Free Accountable Intervention for LLM Deployment -- A Metacognitive Approach

Zhen Tan, Jie Peng, Tianlong Chen, Huan Liu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1334] arXiv:2403.05680 (cross-list from cs.AI) [pdf, html, other]

Title: How Well Do Multi-modal LLMs Interpret CT Scans? An Auto-Evaluation Framework for Analyses

Qingqing Zhu, Benjamin Hou, Tejas S. Mathai, Pritam Mukherjee, Qiao Jin, Xiuying Chen, Zhizheng Wang, Ruida Cheng, Ronald M. Summers, Zhiyong Lu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1335] arXiv:2403.05767 (cross-list from cs.LG) [pdf, html, other]

Title: Extending Activation Steering to Broad Skills and Multiple Behaviours

Teun van der Weij, Massimo Poesio, Nandi Schoots

Comments: Code is available at: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1336] arXiv:2403.05820 (cross-list from cs.SD) [pdf, html, other]

Title: An Audio-textual Diffusion Model For Converting Speech Signals Into Ultrasound Tongue Imaging Data

Yudong Yang, Rongfeng Su, Xiaokang Liu, Nan Yan, Lan Wang

Comments: ICASSP2024 Accept

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1337] arXiv:2403.05846 (cross-list from cs.CV) [pdf, html, other]

Title: Diffusion Lens: Interpreting Text Encoders in Text-to-Image Pipelines

Michael Toker, Hadas Orgad, Mor Ventura, Dana Arad, Yonatan Belinkov

Comments: Published in: ACL 2024 Project webpage: this http URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1338] arXiv:2403.06016 (cross-list from cs.DB) [pdf, html, other]

Title: End-to-end solution for linked open data query logs analytics

Dihia Lanasri

Subjects: Databases (cs.DB); Computation and Language (cs.CL)

[1339] arXiv:2403.06064 (cross-list from cs.LG) [pdf, html, other]

Title: L^2GC:Lorentzian Linear Graph Convolutional Networks for Node Classification

Qiuyu Liang, Weihua Wang, Feilong Bao, Guanglai Gao

Comments: Accepted by LREC-COLING 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1340] arXiv:2403.06082 (cross-list from cs.LG) [pdf, html, other]

Title: FrameQuant: Flexible Low-Bit Quantization for Transformers

Harshavardhan Adepu, Zhanpeng Zeng, Li Zhang, Vikas Singh

Comments: 25 pages, 15 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1341] arXiv:2403.06098 (cross-list from cs.CV) [pdf, html, other]

Title: VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models

Wenhao Wang, Yi Yang

Comments: Accepted by NeurIPS 2024 (Datasets and Benchmarks Track)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1342] arXiv:2403.06100 (cross-list from cs.HC) [pdf, html, other]

Title: Automatic design optimization of preference-based subjective evaluation with online learning in crowdsourcing environment

Yusuke Yasuda, Tomoki Toda

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[1343] arXiv:2403.06199 (cross-list from cs.CV) [pdf, html, other]

Title: Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Models

Minjie Zhu, Yichen Zhu, Xin Liu, Ning Liu, Zhiyuan Xu, Chaomin Shen, Yaxin Peng, Zhicai Ou, Feifei Feng, Jian Tang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1344] arXiv:2403.06221 (cross-list from cs.AI) [pdf, html, other]

Title: TRAD: Enhancing LLM Agents with Step-Wise Thought Retrieval and Aligned Decision

Ruiwen Zhou, Yingxuan Yang, Muning Wen, Ying Wen, Wenhao Wang, Chunling Xi, Guoqiang Xu, Yong Yu, Weinan Zhang

Comments: Codes available at: this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1345] arXiv:2403.06249 (cross-list from cs.CE) [pdf, html, other]

Title: No Language is an Island: Unifying Chinese and English in Financial Large Language Models, Instruction Data, and Benchmarks

Gang Hu, Ke Qin, Chenhan Yuan, Min Peng, Alejandro Lopez-Lira, Benyou Wang, Sophia Ananiadou, Jimin Huang, Qianqian Xie

Comments: 19 pages, 3 figures, 12 tables, including Appendix

Subjects: Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL)

[1346] arXiv:2403.06292 (cross-list from cs.CV) [pdf, html, other]

Title: Transformer based Multitask Learning for Image Captioning and Object Detection

Debolena Basak, P.K. Srijith, Maunendra Sankar Desarkar

Comments: Accepted at PAKDD 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1347] arXiv:2403.06485 (cross-list from cs.SE) [pdf, html, other]

Title: Knowledge-aware Alert Aggregation in Large-scale Cloud Systems: a Hybrid Approach

Jinxi Kuang, Jinyang Liu, Junjie Huang, Renyi Zhong, Jiazhen Gu, Lan Yu, Rui Tan, Zengyin Yang, Michael R. Lyu

Comments: Accepted by Proceedings of the 46th International Conference on Software Engineering: Software Engineering in Practice (ICSE SEIP 2024)

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1348] arXiv:2403.06503 (cross-list from cs.PL) [pdf, html, other]

Title: Automatic Generation of Python Programs Using Context-Free Grammars

Kamel Yamani, Marwa Naïr, Riyadh Baghdadi

Comments: This work was presented at the 2nd Languages, Architectures, and Tools for Heterogeneous Computing (LATHC) Workshop 2024, organized in conjunction with the IEEE/ACM International Symposium on Code Generation and Optimization (CGO)

Subjects: Programming Languages (cs.PL); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1349] arXiv:2403.06563 (cross-list from cs.LG) [pdf, html, other]

Title: Unraveling the Mystery of Scaling Laws: Part I

Hui Su, Zhi Tian, Xiaoyu Shen, Xunliang Cai

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1350] arXiv:2403.06586 (cross-list from cs.LG) [pdf, html, other]

Title: ContextGPT: Infusing LLMs Knowledge into Neuro-Symbolic Activity Recognition Models

Luca Arrotta, Claudio Bettini, Gabriele Civitarese, Michele Fiori

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1351] arXiv:2403.06642 (cross-list from cs.IR) [pdf, html, other]

Title: TRAWL: External Knowledge-Enhanced Recommendation with LLM Assistance

Weiqing Luo, Chonggang Song, Lingling Yi, Gong Cheng

Comments: 8 pages, 3 figures

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1352] arXiv:2403.06644 (cross-list from cs.LG) [pdf, html, other]

Title: Elephants Never Forget: Testing Language Models for Memorization of Tabular Data

Sebastian Bordt, Harsha Nori, Rich Caruana

Comments: Table Representation Learning Workshop at NeurIPS 2023

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1353] arXiv:2403.06725 (cross-list from cs.CY) [pdf, html, other]

Title: Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuning

Hengyuan Zhang, Zitao Liu, Shuyan Huang, Chenming Shang, Bojun Zhan, Yong Jiang

Comments: 29 pages, 4 figures

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1354] arXiv:2403.06734 (cross-list from cs.AI) [pdf, html, other]

Title: Real-Time Multimodal Cognitive Assistant for Emergency Medical Services

Keshara Weerasinghe, Saahith Janapati, Xueren Ge, Sion Kim, Sneha Iyer, John A. Stankovic, Homa Alemzadeh

Comments: This work has been submitted to the IEEE for possible publication

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1355] arXiv:2403.06764 (cross-list from cs.CV) [pdf, html, other]

Title: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models

Liang Chen, Haozhe Zhao, Tianyu Liu, Shuai Bai, Junyang Lin, Chang Zhou, Baobao Chang

Comments: Accepted to ECCV 2024 (Oral), code is released at this https URL,

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1356] arXiv:2403.06789 (cross-list from cs.IR) [pdf, html, other]

Title: SPLADE-v3: New baselines for SPLADE

Carlos Lassance, Hervé Déjean, Thibault Formal, Stéphane Clinchant

Comments: Technical report

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1357] arXiv:2403.06833 (cross-list from cs.LG) [pdf, html, other]

Title: Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?

Egor Zverev, Sahar Abdelnabi, Soroush Tabesh, Mario Fritz, Christoph H. Lampert

Comments: GitHub: this https URL. 10 pages main text, 30 pages in total

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1358] arXiv:2403.06835 (cross-list from cs.CV) [pdf, html, other]

Title: Medical Image Synthesis via Fine-Grained Image-Text Alignment and Anatomy-Pathology Prompting

Wenting Chen, Pengyu Wang, Hui Ren, Lichao Sun, Quanzheng Li, Yixuan Yuan, Xiang Li

Comments: 5 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1359] arXiv:2403.06869 (cross-list from cs.LG) [pdf, html, other]

Title: Learning with Noisy Foundation Models

Hao Chen, Jindong Wang, Zihan Wang, Ran Tao, Hongxin Wei, Xing Xie, Masashi Sugiyama, Bhiksha Raj

Comments: 18 pages, 10 figures, 6 tables, preprint. arXiv admin note: substantial text overlap with arXiv:2309.17002

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1360] arXiv:2403.06892 (cross-list from cs.CV) [pdf, html, other]

Title: Real-time Transformer-based Open-Vocabulary Detection with Efficient Fusion Head

Tiancheng Zhao, Peng Liu, Xuan He, Lu Zhang, Kyusong Lee

Comments: Preprint

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1361] arXiv:2403.06925 (cross-list from cs.LG) [pdf, html, other]

Title: Simplicity Bias of Transformers to Learn Low Sensitivity Functions

Bhavya Vasudeva, Deqing Fu, Tianyi Zhou, Elliott Kau, Youqi Huang, Vatsal Sharan

Comments: 24 pages, 19 figures, 3 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1362] arXiv:2403.06936 (cross-list from cs.LG) [pdf, html, other]

Title: Counterfactual Reasoning with Knowledge Graph Embeddings

Lena Zellinger, Andreas Stephan, Benjamin Roth

Comments: Accepted to EACL 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1363] arXiv:2403.06949 (cross-list from cond-mat.mtrl-sci) [pdf, other]

Title: Materials science in the era of large language models: a perspective

Ge Lei, Ronan Docherty, Samuel J. Cooper

Journal-ref: Digital Discovery, 2024,3, 1257-1272

Subjects: Materials Science (cond-mat.mtrl-sci); Computation and Language (cs.CL)

[1364] arXiv:2403.06952 (cross-list from cs.CV) [pdf, html, other]

Title: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data

Jialu Li, Jaemin Cho, Yi-Lin Sung, Jaehong Yoon, Mohit Bansal

Comments: First two authors contributed equally; Project website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1365] arXiv:2403.06988 (cross-list from cs.LG) [pdf, html, other]

Title: Guiding LLMs The Right Way: Fast, Non-Invasive Constrained Generation

Luca Beurer-Kellner, Marc Fischer, Martin Vechev

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1366] arXiv:2403.07008 (cross-list from cs.LG) [pdf, html, other]

Title: AutoEval Done Right: Using Synthetic Data for Model Evaluation

Pierre Boyeau, Anastasios N. Angelopoulos, Nir Yosef, Jitendra Malik, Michael I. Jordan

Comments: New experiments, fix fig 1

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Methodology (stat.ME)

[1367] arXiv:2403.07039 (cross-list from cs.AR) [pdf, other]

Title: From English to ASIC: Hardware Implementation with Large Language Model

Emil Goh, Maoyang Xiang, I-Chyn Wey, T. Hui Teo

Comments: 15 pages, 1 figure

Subjects: Hardware Architecture (cs.AR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1368] arXiv:2403.07142 (cross-list from cs.CV) [pdf, html, other]

Title: One Category One Prompt: Dataset Distillation using Diffusion Models

Ali Abbasi, Ashkan Shahbazi, Hamed Pirsiavash, Soheil Kolouri

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1369] arXiv:2403.07179 (cross-list from cs.LG) [pdf, html, other]

Title: 3M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generation

Huaisheng Zhu, Teng Xiao, Vasant G Honavar

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Biomolecules (q-bio.BM)

[1370] arXiv:2403.07191 (cross-list from cs.LG) [pdf, html, other]

Title: $\mathbf{(N,K)}$-Puzzle: A Cost-Efficient Testbed for Benchmarking Reinforcement Learning Algorithms in Generative Language Model

Yufeng Zhang, Liyu Chen, Boyi Liu, Yingxiang Yang, Qiwen Cui, Yunzhe Tao, Hongxia Yang

Comments: 8 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1371] arXiv:2403.07283 (cross-list from cs.CR) [pdf, html, other]

Title: A Framework for Cost-Effective and Self-Adaptive LLM Shaking and Recovery Mechanism

Zhiyu Chen, Yu Li, Suochao Zhang, Jingbo Zhou, Jiwen Zhou, Chenfu Bao, Dianhai Yu

Comments: 9 pages

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1372] arXiv:2403.07300 (cross-list from cs.LG) [pdf, html, other]

Title: CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuning

Peiyuan Liu, Hang Guo, Tao Dai, Naiqi Li, Jigang Bao, Xudong Ren, Yong Jiang, Shu-Tao Xia

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1373] arXiv:2403.07339 (cross-list from cs.LG) [pdf, html, other]

Title: IM-Unpack: Training and Inference with Arbitrarily Low Precision Integers

Zhanpeng Zeng, Karthikeyan Sankaralingam, Vikas Singh

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1374] arXiv:2403.07376 (cross-list from cs.CV) [pdf, html, other]

Title: NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoning

Bingqian Lin, Yunshuang Nie, Ziming Wei, Jiaqi Chen, Shikui Ma, Jianhua Han, Hang Xu, Xiaojun Chang, Xiaodan Liang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1375] arXiv:2403.07379 (cross-list from cs.LG) [pdf, html, other]

Title: Hallmarks of Optimization Trajectories in Neural Networks: Directional Exploration and Redundancy

Sidak Pal Singh, Bobby He, Thomas Hofmann, Bernhard Schölkopf

Comments: Preprint, 57 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1376] arXiv:2403.07652 (cross-list from cs.LG) [pdf, html, other]

Title: Harder Tasks Need More Experts: Dynamic Routing in MoE Models

Quzhe Huang, Zhenwei An, Nan Zhuang, Mingxu Tao, Chen Zhang, Yang Jin, Kun Xu, Kun Xu, Liwei Chen, Songfang Huang, Yansong Feng

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1377] arXiv:2403.07687 (cross-list from cs.CV) [pdf, html, other]

Title: Annotations on a Budget: Leveraging Geo-Data Similarity to Balance Model Performance and Annotation Cost

Oana Ignat, Longju Bai, Joan Nwatu, Rada Mihalcea

Comments: accepted at COLING 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1378] arXiv:2403.07690 (cross-list from cs.SE) [pdf, html, other]

Title: SATDAUG -- A Balanced and Augmented Dataset for Detecting Self-Admitted Technical Debt

Edi Sutoyo, Andrea Capiluppi

Comments: Accepted to be published at the 21st IEEE/ACM International Conference on Mining Software Repositories (MSR 2024)

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1379] arXiv:2403.07769 (cross-list from cs.AI) [pdf, other]

Title: Transforming Competition into Collaboration: The Revolutionary Role of Multi-Agent Systems and Language Models in Modern Organizations

Carlos Jose Xavier Cruz

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Multiagent Systems (cs.MA)

[1380] arXiv:2403.07809 (cross-list from cs.LG) [pdf, html, other]

Title: pyvene: A Library for Understanding and Improving PyTorch Models via Interventions

Zhengxuan Wu, Atticus Geiger, Aryaman Arora, Jing Huang, Zheng Wang, Noah D. Goodman, Christopher D. Manning, Christopher Potts

Comments: 8 pages, 3 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1381] arXiv:2403.07910 (cross-list from cs.CY) [pdf, html, other]

Title: MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of Expressions

Tomáš Horych, Martin Wessel, Jan Philip Wahle, Terry Ruas, Jerome Waßmuth, André Greiner-Petter, Akiko Aizawa, Bela Gipp, Timo Spinde

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[1382] arXiv:2403.07920 (cross-list from q-bio.BM) [pdf, html, other]

Title: ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training

Le Zhuo, Zewen Chi, Minghao Xu, Heyan Huang, Heqi Zheng, Conghui He, Xian-Ling Mao, Wentao Zhang

Comments: this https URL

Subjects: Biomolecules (q-bio.BM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1383] arXiv:2403.07921 (cross-list from cs.LG) [pdf, html, other]

Title: Merino: Entropy-driven Design for Generative Language Models on IoT Devices

Youpeng Zhao, Ming Lin, Huadong Tang, Qiang Wu, Jun Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1384] arXiv:2403.07937 (cross-list from eess.AS) [pdf, html, other]

Title: Speech Robust Bench: A Robustness Benchmark For Speech Recognition

Muhammad A. Shah, David Solans Noguero, Mikko A. Heikkila, Bhiksha Raj, Nicolas Kourtellis

Comments: submitted to NeurIPS datasets and benchmark track 2025

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1385] arXiv:2403.07947 (cross-list from eess.AS) [pdf, other]

Title: The evaluation of a code-switched Sepedi-English automatic speech recognition system

Amanda Phaladi, Thipe Modipa

Comments: 13 pages,2 figures,2nd International Conference on NLP & AI (NLPAI 2024)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1386] arXiv:2403.07974 (cross-list from cs.SE) [pdf, html, other]

Title: LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar-Lezama, Koushik Sen, Ion Stoica

Comments: Website - this https URL

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1387] arXiv:2403.08058 (cross-list from cs.LG) [pdf, html, other]

Title: CHAI: Clustered Head Attention for Efficient LLM Inference

Saurabh Agarwal, Bilge Acun, Basil Hosmer, Mostafa Elhoushi, Yejin Lee, Shivaram Venkataraman, Dimitris Papailiopoulos, Carole-Jean Wu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1388] arXiv:2403.08059 (cross-list from cs.CV) [pdf, html, other]

Title: FluoroSAM: A Language-aligned Foundation Model for X-ray Image Segmentation

Benjamin D. Killeen, Liam J. Wang, Han Zhang, Mehran Armand, Russell H. Taylor, Dave Dreizin, Greg Osgood, Mathias Unberath

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1389] arXiv:2403.08081 (cross-list from cs.LG) [pdf, html, other]

Title: Mechanics of Next Token Prediction with Self-Attention

Yingcong Li, Yixiao Huang, M. Emrullah Ildiz, Ankit Singh Rawat, Samet Oymak

Comments: Accepted to AISTATS 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Optimization and Control (math.OC)

[1390] arXiv:2403.08111 (cross-list from cs.HC) [pdf, html, other]

Title: AI-Assisted Causal Pathway Diagram for Human-Centered Design

Ruican Zhong, Donghoon Shin, Rosemary Meza, Predrag Klasnja, Lucas Colusso, Gary Hsieh

Journal-ref: In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11-16, 2024, Honolulu, HI, USA

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1391] arXiv:2403.08115 (cross-list from cs.CY) [pdf, html, other]

Title: Legally Binding but Unfair? Towards Assessing Fairness of Privacy Policies

Vincent Freiberger, Erik Buchmann

Comments: Accepted at IWSPA 2024

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1392] arXiv:2403.08137 (cross-list from cs.HC) [pdf, html, other]

Title: From Paper to Card: Transforming Design Implications with Generative AI

Donghoon Shin, Lucy Lu Wang, Gary Hsieh

Journal-ref: In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11-16, 2024, Honolulu, HI, USA. ACM, New York, NY, USA

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1393] arXiv:2403.08167 (cross-list from cs.LG) [pdf, html, other]

Title: MolBind: Multimodal Alignment of Language, Molecules, and Proteins

Teng Xiao, Chao Cui, Huaisheng Zhu, Vasant G. Honavar

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Quantitative Methods (q-bio.QM)

[1394] arXiv:2403.08358 (cross-list from cs.SE) [pdf, html, other]

Title: Log Summarisation for Defect Evolution Analysis

Rares Dolga, Ran Zmigrod, Rui Silva, Salwa Alamir, Sameena Shah

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1395] arXiv:2403.08375 (cross-list from cs.DB) [pdf, html, other]

Title: Translating between SQL Dialects for Cloud Migration

Ran Zmigrod, Salwa Alamir, Xiaomo Liu

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

[1396] arXiv:2403.08424 (cross-list from cs.CR) [pdf, other]

Title: Distract Large Language Models for Automatic Jailbreak Attack

Zeguan Xiao, Yan Yang, Guanhua Chen, Yun Chen

Comments: EMNLP 2024

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1397] arXiv:2403.08737 (cross-list from cs.IR) [pdf, html, other]

Title: ILCiteR: Evidence-grounded Interpretable Local Citation Recommendation

Sayar Ghosh Roy, Jiawei Han

Comments: LREC-COLING 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1398] arXiv:2403.08755 (cross-list from cs.CV) [pdf, html, other]

Title: DAM: Dynamic Adapter Merging for Continual Video QA Learning

Feng Cheng, Ziyang Wang, Yi-Lin Sung, Yan-Bo Lin, Mohit Bansal, Gedas Bertasius

Comments: The first two authors contribute equally

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1399] arXiv:2403.08763 (cross-list from cs.LG) [pdf, other]

Title: Simple and Scalable Strategies to Continually Pre-train Large Language Models

Adam Ibrahim, Benjamin Thérien, Kshitij Gupta, Mats L. Richter, Quentin Anthony, Timothée Lesort, Eugene Belilovsky, Irina Rish

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1400] arXiv:2403.08773 (cross-list from cs.CV) [pdf, other]

Title: Veagle: Advancements in Multimodal Representation Learning

Rajat Chawla, Arkajit Datta, Tushar Verma, Adarsh Jha, Anmol Gautam, Ayush Vatsal, Sukrit Chaterjee, Mukunda NS, Ishaan Bhola

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1401] arXiv:2403.08783 (cross-list from cs.CV) [pdf, html, other]

Title: Image-Text Out-Of-Context Detection Using Synthetic Multimodal Misinformation

Fatma Shalabi, Huy H. Nguyen, Hichem Felouat, Ching-Chun Chang, Isao Echizen

Comments: 8 pages, 2 figures, conference

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1402] arXiv:2403.08795 (cross-list from cs.HC) [pdf, other]

Title: Ontologia para monitorar a defici\^encia mental em seus d\'eficts no processamento da informa\c{c}\~ao por decl\'inio cognitivo e evitar agress\~oes psicol\'ogicas e f\'isicas em ambientes educacionais com ajuda da I.A*

Bruna Araújo de Castro Oliveira

Comments: in Portuguese language. Minha vez de falar sobre a realidade

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1403] arXiv:2403.08818 (cross-list from cs.LG) [pdf, html, other]

Title: Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM

Hejie Cui, Xinyu Fang, Ran Xu, Xuan Kan, Joyce C. Ho, Carl Yang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1404] arXiv:2403.08819 (cross-list from cs.LG) [pdf, html, other]

Title: Thermometer: Towards Universal Calibration for Large Language Models

Maohao Shen, Subhro Das, Kristjan Greenewald, Prasanna Sattigeri, Gregory Wornell, Soumya Ghosh

Comments: Camera ready version for ICML 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1405] arXiv:2403.08822 (cross-list from cs.LG) [pdf, other]

Title: LoRA-SP: Streamlined Partial Parameter Adaptation for Resource-Efficient Fine-Tuning of Large Language Models

Yichao Wu, Yafei Xiang, Shuning Huo, Yulu Gong, Penghao Liang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1406] arXiv:2403.08851 (cross-list from astro-ph.IM) [pdf, html, other]

Title: PAPERCLIP: Associating Astronomical Observations and Natural Language with Multi-Modal Models

Siddharth Mishra-Sharma, Yiding Song, Jesse Thaler

Comments: 17+6 pages, 3+1 figures, 5+2 tables

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1407] arXiv:2403.08946 (cross-list from cs.LG) [pdf, html, other]

Title: Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era

Xuansheng Wu, Haiyan Zhao, Yaochen Zhu, Yucheng Shi, Fan Yang, Tianming Liu, Xiaoming Zhai, Wenlin Yao, Jundong Li, Mengnan Du, Ninghao Liu

Comments: 38 pages, 4 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1408] arXiv:2403.09032 (cross-list from cs.SE) [pdf, html, other]

Title: CodeUltraFeedback: An LLM-as-a-Judge Dataset for Aligning Large Language Models to Coding Preferences

Martin Weyssow, Aton Kamanda, Houari Sahraoui

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1409] arXiv:2403.09037 (cross-list from cs.CV) [pdf, html, other]

Title: The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?

Qinyu Zhao, Ming Xu, Kartik Gupta, Akshay Asthana, Liang Zheng, Stephen Gould

Comments: ECCV 2024. Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1410] arXiv:2403.09054 (cross-list from cs.LG) [pdf, html, other]

Title: Keyformer: KV Cache Reduction through Key Tokens Selection for Efficient Generative Inference

Muhammad Adnan, Akhil Arunkumar, Gaurav Jain, Prashant J. Nair, Ilya Soloveychik, Purushotham Kamath

Journal-ref: Proceedings of the 7th Annual Conference on Machine Learning and Systems (MLSys), 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Hardware Architecture (cs.AR); Computation and Language (cs.CL)

[1411] arXiv:2403.09072 (cross-list from cs.CV) [pdf, html, other]

Title: UniCode: Learning a Unified Codebook for Multimodal Large Language Models

Sipeng Zheng, Bohan Zhou, Yicheng Feng, Ye Wang, Zongqing Lu

Comments: 14 pages, 2 figures, 11 tables

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1412] arXiv:2403.09294 (cross-list from cs.CV) [pdf, html, other]

Title: Anatomical Structure-Guided Medical Vision-Language Pre-training

Qingqiu Li, Xiaohan Yan, Jilan Xu, Runtian Yuan, Yuejie Zhang, Rui Feng, Quanli Shen, Xiaobo Zhang, Shujun Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1413] arXiv:2403.09298 (cross-list from cs.SD) [pdf, html, other]

Title: More than words: Advancements and challenges in speech recognition for singing

Anna Kruspe

Comments: Conference on Electronic Speech Signal Processing (ESSV) 2024, Keynote

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1414] arXiv:2403.09409 (cross-list from cs.HC) [pdf, html, other]

Title: "Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students using Large Language Models

Seth Bernstein, Paul Denny, Juho Leinonen, Lauren Kan, Arto Hellas, Matt Littlefield, Sami Sarsa, Stephen MacNeil

Comments: 7 pages, 2 figures, ITiCSE 2024 preprint

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1415] arXiv:2403.09472 (cross-list from cs.LG) [pdf, other]

Title: Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision

Zhiqing Sun, Longhui Yu, Yikang Shen, Weiyang Liu, Yiming Yang, Sean Welleck, Chuang Gan

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1416] arXiv:2403.09479 (cross-list from cs.LG) [pdf, other]

Title: Laying the Foundation First? Investigating the Generalization from Atomic Skills to Complex Reasoning Tasks

Yuncheng Huang, Qianyu He, Yipei Xu, Jiaqing Liang, Yanghua Xiao

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1417] arXiv:2403.09498 (cross-list from cs.SI) [pdf, html, other]

Title: From Skepticism to Acceptance: Simulating the Attitude Dynamics Toward Fake News

Yuhan Liu, Xiuying Chen, Xiaoqing Zhang, Xing Gao, Ji Zhang, Rui Yan

Subjects: Social and Information Networks (cs.SI); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1418] arXiv:2403.09530 (cross-list from cs.CV) [pdf, html, other]

Title: VisionGPT-3D: A Generalized Multimodal Agent for Enhanced 3D Vision Understanding

Chris Kelly, Luhui Hu, Jiayin Hu, Yu Tian, Deshun Yang, Bang Yang, Cindy Yang, Zihao Li, Zaoshan Huang, Yuexian Zou

Comments: 12 pages, 7 figures, pending conference

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Graphics (cs.GR)

[1419] arXiv:2403.09611 (cross-list from cs.CV) [pdf, html, other]

Title: MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Floris Weers, Anton Belyi, Haotian Zhang, Karanjeet Singh, Doug Kang, Ankur Jain, Hongyu Hè, Max Schwarzer, Tom Gunter, Xiang Kong, Aonan Zhang, Jianyu Wang, Chong Wang, Nan Du, Tao Lei, Sam Wiseman, Guoli Yin, Mark Lee, Zirui Wang, Ruoming Pang, Peter Grasch, Alexander Toshev, Yinfei Yang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1420] arXiv:2403.09613 (cross-list from cs.LG) [pdf, html, other]

Title: Reawakening knowledge: Anticipatory recovery from catastrophic interference via structured training

Yanlai Yang, Matt Jones, Michael C. Mozer, Mengye Ren

Comments: 19 pages, 18 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1421] arXiv:2403.09631 (cross-list from cs.CV) [pdf, html, other]

Title: 3D-VLA: A 3D Vision-Language-Action Generative World Model

Haoyu Zhen, Xiaowen Qiu, Peihao Chen, Jincheng Yang, Xin Yan, Yilun Du, Yining Hong, Chuang Gan

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1422] arXiv:2403.09713 (cross-list from cs.AI) [pdf, html, other]

Title: A Hybrid Intelligence Method for Argument Mining

Michiel van der Meer, Enrico Liscio, Catholijn M. Jonker, Aske Plaat, Piek Vossen, Pradeep K. Murukannaiah

Comments: Published in JAIR

Journal-ref: Journal of Artificial Intelligence Research (JAIR), 80:1187-1222, 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1423] arXiv:2403.09715 (cross-list from cs.SE) [pdf, html, other]

Title: Textual analysis of End User License Agreement for red-flagging potentially malicious software

Behraj Khan, Tahir Syed, Zeshan Khan, Muhammad Rafi

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[1424] arXiv:2403.09717 (cross-list from cs.HC) [pdf, html, other]

Title: Enhancing Depression-Diagnosis-Oriented Chat with Psychological State Tracking

Yiyang Gu, Yougen Zhou, Qin Chen, Ningning Zhou, Jie Zhou, Aimin Zhou, Liang He

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1425] arXiv:2403.09751 (cross-list from cs.CR) [pdf, other]

Title: What Was Your Prompt? A Remote Keylogging Attack on AI Assistants

Roy Weiss, Daniel Ayzenshteyn, Guy Amit, Yisroel Mirsky

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1426] arXiv:2403.09792 (cross-list from cs.CV) [pdf, html, other]

Title: Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking Multimodal Large Language Models

Yifan Li, Hangyu Guo, Kun Zhou, Wayne Xin Zhao, Ji-Rong Wen

Comments: Work in progress

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1427] arXiv:2403.09795 (cross-list from cs.CR) [pdf, other]

Title: Helpful or Harmful? Exploring the Efficacy of Large Language Models for Online Grooming Prevention

Ellie Prosser, Matthew Edwards

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1428] arXiv:2403.09974 (cross-list from cs.CV) [pdf, html, other]

Title: Unlocking the Multi-modal Potential of CLIP for Generalized Category Discovery

Enguang Wang, Zhimao Peng, Zhengyuan Xie, Fei Yang, Xialei Liu, Ming-Ming Cheng

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1429] arXiv:2403.10059 (cross-list from cs.SE) [pdf, html, other]

Title: Repoformer: Selective Retrieval for Repository-Level Code Completion

Di Wu, Wasi Uddin Ahmad, Dejiao Zhang, Murali Krishna Ramanathan, Xiaofei Ma

Comments: ICML 2024

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1430] arXiv:2403.10135 (cross-list from cs.IR) [pdf, html, other]

Title: The Whole is Better than the Sum: Using Aggregated Demonstrations in In-Context Learning for Sequential Recommendation

Lei Wang, Ee-Peng Lim

Comments: NAACL 2024 (Findings)

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1431] arXiv:2403.10228 (cross-list from cs.CV) [pdf, html, other]

Title: HawkEye: Training Video-Text LLMs for Grounding Text in Videos

Yueqian Wang, Xiaojun Meng, Jianxin Liang, Yuxuan Wang, Qun Liu, Dongyan Zhao

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1432] arXiv:2403.10444 (cross-list from cs.LG) [pdf, html, other]

Title: Block Verification Accelerates Speculative Decoding

Ziteng Sun, Uri Mendlovic, Yaniv Leviathan, Asaf Aharoni, Ahmad Beirami, Jae Hun Ro, Ananda Theertha Suresh

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Data Structures and Algorithms (cs.DS); Information Theory (cs.IT)

[1433] arXiv:2403.10499 (cross-list from cs.LG) [pdf, html, other]

Title: Benchmarking Zero-Shot Robustness of Multimodal Foundation Models: A Pilot Study

Chenguang Wang, Ruoxi Jia, Xin Liu, Dawn Song

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1434] arXiv:2403.10517 (cross-list from cs.CV) [pdf, html, other]

Title: VideoAgent: Long-form Video Understanding with Large Language Model as Agent

Xiaohan Wang, Yuhui Zhang, Orr Zohar, Serena Yeung-Levy

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1435] arXiv:2403.10557 (cross-list from cs.LG) [pdf, html, other]

Title: Second-Order Information Matters: Revisiting Machine Unlearning for Large Language Models

Kang Gu, Md Rafi Ur Rashid, Najrin Sultana, Shagufta Mehnaz

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1436] arXiv:2403.10568 (cross-list from cs.LG) [pdf, html, other]

Title: MoPE: Parameter-Efficient and Scalable Multimodal Fusion via Mixture of Prompt Experts

Ruixiang Jiang, Lingbo Liu, Changwen Chen

Comments: Under Review, Extended version of arXiv:2312.03734

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1437] arXiv:2403.10575 (cross-list from cs.SE) [pdf, html, other]

Title: Exploring Language Model's Code Generation Ability with Auxiliary Functions

Seonghyeon Lee, Sanghwan Jang, Seongbo Jang, Dongha Lee, Hwanjo Yu

Comments: NAACL2024 Findings

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1438] arXiv:2403.10576 (cross-list from cs.CR) [pdf, html, other]

Title: Ignore Me But Don't Replace Me: Utilizing Non-Linguistic Elements for Pretraining on the Cybersecurity Domain

Eugene Jang, Jian Cui, Dayeon Yim, Youngjin Jin, Jin-Woo Chung, Seungwon Shin, Yongjae Lee

Comments: To appear in NAACL Findings 2024

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1439] arXiv:2403.10581 (cross-list from q-bio.QM) [pdf, html, other]

Title: Large Language Model-informed ECG Dual Attention Network for Heart Failure Risk Prediction

Chen Chen, Lei Li, Marcel Beetz, Abhirup Banerjee, Ramneek Gupta, Vicente Grau

Comments: Under journal revision

Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Signal Processing (eess.SP)

[1440] arXiv:2403.10616 (cross-list from cs.LG) [pdf, html, other]

Title: DiPaCo: Distributed Path Composition

Arthur Douillard, Qixuan Feng, Andrei A. Rusu, Adhiguna Kuncoro, Yani Donchev, Rachita Chhaparia, Ionel Gog, Marc'Aurelio Ranzato, Jiajun Shen, Arthur Szlam

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1441] arXiv:2403.10667 (cross-list from cs.IR) [pdf, html, other]

Title: Towards Unified Multi-Modal Personalization: Large Vision-Language Models for Generative Recommendation and Beyond

Tianxin Wei, Bowen Jin, Ruirui Li, Hansi Zeng, Zhengyang Wang, Jianhui Sun, Qingyu Yin, Hanqing Lu, Suhang Wang, Jingrui He, Xianfeng Tang

Comments: ICLR 2024

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1442] arXiv:2403.10700 (cross-list from cs.RO) [pdf, html, other]

Title: Mind the Error! Detection and Localization of Instruction Errors in Vision-and-Language Navigation

Francesco Taioli, Stefano Rosa, Alberto Castellini, Lorenzo Natale, Alessio Del Bue, Alessandro Farinelli, Marco Cristani, Yiming Wang

Comments: 3 figures, 8 pages

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1443] arXiv:2403.10704 (cross-list from cs.LG) [pdf, html, other]

Title: Parameter Efficient Reinforcement Learning from Human Feedback

Hakim Sidahmed, Samrat Phatale, Alex Hutcheson, Zhuonan Lin, Zhang Chen, Zac Yu, Jarvis Jin, Simral Chaudhary, Roman Komarytsia, Christiane Ahlheim, Yonghao Zhu, Bowen Li, Saravanan Ganesh, Bill Byrne, Jessica Hoffmann, Hassan Mansoor, Wei Li, Abhinav Rastogi, Lucas Dixon

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1444] arXiv:2403.10937 (cross-list from eess.AS) [pdf, html, other]

Title: Initial Decoding with Minimally Augmented Language Model for Improved Lattice Rescoring in Low Resource ASR

Savitha Murthy, Dinkar Sitaram

Comments: 14 pages, 7 figures, Accepted in Sadhana Journal

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1445] arXiv:2403.10943 (cross-list from cs.MM) [pdf, html, other]

Title: MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversations

Hanlei Zhang, Xin Wang, Hua Xu, Qianrui Zhou, Kai Gao, Jianhua Su, jinyue Zhao, Wenrui Li, Yanting Chen

Comments: Accepted by ICLR 2024, Long Paper; The abstract is slightly modified due to the length limitation

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL)

[1446] arXiv:2403.10961 (cross-list from cs.LG) [pdf, html, other]

Title: Energy-Based Models with Applications to Speech and Language Processing

Zhijian Ou

Comments: The version before publisher editing

Journal-ref: Foundations and Trends in Signal Processing: Vol. 18: No. 1-2, pp 1-199

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1447] arXiv:2403.11083 (cross-list from cs.CV) [pdf, html, other]

Title: Customizing Visual-Language Foundation Models for Multi-modal Anomaly Detection and Reasoning

Xiaohao Xu, Yunkang Cao, Yongqi Chen, Weiming Shen, Xiaonan Huang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1448] arXiv:2403.11085 (cross-list from cs.CV) [pdf, html, other]

Title: m&m's: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Tasks

Zixian Ma, Weikai Huang, Jieyu Zhang, Tanmay Gupta, Ranjay Krishna

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1449] arXiv:2403.11176 (cross-list from cs.CV) [pdf, html, other]

Title: Quality-Aware Image-Text Alignment for Real-World Image Quality Assessment

Lorenzo Agnolucci, Leonardo Galteri, Marco Bertini

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1450] arXiv:2403.11265 (cross-list from cs.LG) [pdf, html, other]

Title: Forging the Forger: An Attempt to Improve Authorship Verification via Data Augmentation

Silvia Corbara, Alejandro Moreo

Journal-ref: IEEE Access (2024)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1451] arXiv:2403.11299 (cross-list from cs.CV) [pdf, html, other]

Title: SQ-LLaVA: Self-Questioning for Large Vision-Language Assistant

Guohao Sun, Can Qin, Jiamian Wang, Zeyuan Chen, Ran Xu, Zhiqiang Tao

Comments: ECCV 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1452] arXiv:2403.11314 (cross-list from cs.LG) [pdf, html, other]

Title: Reasoning in Transformers -- Mitigating Spurious Correlations and Reasoning Shortcuts

Daniel Enström, Viktor Kjellberg, Moa Johansson

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1453] arXiv:2403.11335 (cross-list from cs.IR) [pdf, html, other]

Title: ConvSDG: Session Data Generation for Conversational Search

Fengran Mo, Bole Yi, Kelong Mao, Chen Qu, Kaiyu Huang, Jian-Yun Nie

Comments: Accepted by WWW 2024 Workshop

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1454] arXiv:2403.11366 (cross-list from cs.LG) [pdf, html, other]

Title: JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning

Anique Tahir, Lu Cheng, Huan Liu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[1455] arXiv:2403.11381 (cross-list from cs.AI) [pdf, html, other]

Title: Can LLM-Augmented autonomous agents cooperate?, An evaluation of their cooperative capabilities through Melting Pot

Manuel Mosquera, Juan Sebastian Pinzon, Manuel Rios, Yesid Fonseca, Luis Felipe Giraldo, Nicanor Quijano, Ruben Manrique

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1456] arXiv:2403.11425 (cross-list from cs.LG) [pdf, other]

Title: Narrative Feature or Structured Feature? A Study of Large Language Models to Identify Cancer Patients at Risk of Heart Failure

Ziyi Chen, Mengyuan Zhang, Mustafa Mohammed Ahmed, Yi Guo, Thomas J. George, Jiang Bian, Yonghui Wu

Comments: 10 pages, 4 figures, 5 tables

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1457] arXiv:2403.11585 (cross-list from cs.LG) [pdf, other]

Title: Linguacodus: A Synergistic Framework for Transformative Code Generation in Machine Learning Pipelines

Ekaterina Trofimova, Emil Sataev, Andrey E. Ustyuzhanin

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Programming Languages (cs.PL); Software Engineering (cs.SE)

[1458] arXiv:2403.11771 (cross-list from cs.CV) [pdf, html, other]

Title: Modality-Agnostic fMRI Decoding of Vision and Language

Mitja Nikolaus, Milad Mozafari, Nicholas Asher, Leila Reddy, Rufin VanRullen

Comments: To appear at ICLR 2024 workshop on Representational Alignment (Re-Align)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1459] arXiv:2403.11807 (cross-list from cs.AI) [pdf, html, other]

Title: How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environments

Jen-tse Huang, Eric John Li, Man Ho Lam, Tian Liang, Wenxuan Wang, Youliang Yuan, Wenxiang Jiao, Xing Wang, Zhaopeng Tu, Michael R. Lyu

Comments: 11 pages of main text; 19 pages of appendices. Included models: GPT-3.5-{0613, 1106, 0125}, GPT-4-0125, Gemini-{1.0, 1.5)-Pro, LLaMA-3.1-{7, 70, 405}B, Mixtral-8x{7, 22}B, Qwen-2-72B

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1460] arXiv:2403.11905 (cross-list from cs.AI) [pdf, html, other]

Title: Tur[k]ingBench: A Challenge Benchmark for Web Agents

Kevin Xu, Yeganeh Kordi, Tanay Nayak, Ado Asija, Yizhong Wang, Kate Sanders, Adam Byerly, Jingyu Zhang, Benjamin Van Durme, Daniel Khashabi

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

[1461] arXiv:2403.11996 (cross-list from cs.LG) [pdf, other]

Title: Accelerating Scientific Discovery with Generative Knowledge Extraction, Graph-Based Representation, and Multimodal Intelligent Graph Reasoning

Markus J. Buehler

Subjects: Machine Learning (cs.LG); Mesoscale and Nanoscale Physics (cond-mat.mes-hall); Materials Science (cond-mat.mtrl-sci); Soft Condensed Matter (cond-mat.soft); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1462] arXiv:2403.12017 (cross-list from cs.LG) [pdf, html, other]

Title: Supervised Fine-Tuning as Inverse Reinforcement Learning

Hao Sun

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1463] arXiv:2403.12025 (cross-list from cs.CY) [pdf, html, other]

Title: A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Models

Stephen R. Pfohl, Heather Cole-Lewis, Rory Sayres, Darlene Neal, Mercy Asiedu, Awa Dieng, Nenad Tomasev, Qazi Mamunur Rashid, Shekoofeh Azizi, Negar Rostamzadeh, Liam G. McCoy, Leo Anthony Celi, Yun Liu, Mike Schaekermann, Alanna Walton, Alicia Parrish, Chirag Nagpal, Preeti Singh, Akeiylah Dewitt, Philip Mansfield, Sushant Prakash, Katherine Heller, Alan Karthikesalingam, Christopher Semturs, Joelle Barral, Greg Corrado, Yossi Matias, Jamila Smith-Loud, Ivor Horn, Karan Singhal

Journal-ref: Nature Medicine (2024)

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1464] arXiv:2403.12026 (cross-list from cs.CV) [pdf, html, other]

Title: FlexCap: Generating Rich, Localized, and Flexible Captions in Images

Debidatta Dwibedi, Vidhi Jain, Jonathan Tompson, Andrew Zisserman, Yusuf Aytar

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1465] arXiv:2403.12083 (cross-list from cs.IR) [pdf, html, other]

Title: Presenting Terrorizer: an algorithm for consolidating company names in patent assignees

Grazia Sveva Ascione, Valerio Sterzi

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1466] arXiv:2403.12092 (cross-list from cs.IR) [pdf, html, other]

Title: Methods for Matching English Language Addresses

Keshav Ramani, Daniel Borrajo

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1467] arXiv:2403.12094 (cross-list from cs.AI) [pdf, html, other]

Title: Are LLMs Good Cryptic Crossword Solvers?

Abdelrahman "Boda" Sadallah, Daria Kotova, Ekaterina Kochmar

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1468] arXiv:2403.12151 (cross-list from cs.AI) [pdf, html, other]

Title: Fusing Domain-Specific Content from Large Language Models into Knowledge Graphs for Enhanced Zero Shot Object State Classification

Filippos Gouidis, Katerina Papantoniou, Konstantinos Papoutsakis Theodore Patkos, Antonis Argyros, Dimitris Plexousakis

Comments: Accepted at the AAAI-MAKE 24

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1469] arXiv:2403.12328 (cross-list from cs.LG) [pdf, html, other]

Title: Methods for Generating Drift in Text Streams

Cristiano Mesquita Garcia, Alessandro Lameiras Koerich, Alceu de Souza Britto Jr, Jean Paul Barddal

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1470] arXiv:2403.12416 (cross-list from cs.CV) [pdf, html, other]

Title: Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning

Chong Ma, Hanqi Jiang, Wenting Chen, Yiwei Li, Zihao Wu, Xiaowei Yu, Zhengliang Liu, Lei Guo, Dajiang Zhu, Tuo Zhang, Dinggang Shen, Tianming Liu, Xiang Li

Comments: 12 pages, 6 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1471] arXiv:2403.12482 (cross-list from cs.AI) [pdf, html, other]

Title: Embodied LLM Agents Learn to Cooperate in Organized Teams

Xudong Guo, Kaixuan Huang, Jiale Liu, Wenhui Fan, Natalia Vélez, Qingyun Wu, Huazheng Wang, Thomas L. Griffiths, Mengdi Wang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Multiagent Systems (cs.MA)

[1472] arXiv:2403.12805 (cross-list from cs.AI) [pdf, html, other]

Title: Contextual Moral Value Alignment Through Context-Based Aggregation

Pierre Dognin, Jesus Rios, Ronny Luss, Inkit Padhi, Matthew D Riemer, Miao Liu, Prasanna Sattigeri, Manish Nagireddy, Kush R. Varshney, Djallel Bouneffouf

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1473] arXiv:2403.12900 (cross-list from cs.DC) [pdf, html, other]

Title: Toward Sustainable GenAI using Generation Directives for Carbon-Friendly Large Language Model Inference

Baolin Li, Yankai Jiang, Vijay Gadepally, Devesh Tiwari

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1474] arXiv:2403.12964 (cross-list from cs.CV) [pdf, html, other]

Title: Negative Yields Positive: Unified Dual-Path Adapter for Vision-Language Models

Ce Zhang, Simon Stepputtis, Katia Sycara, Yaqi Xie

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1475] arXiv:2403.12973 (cross-list from cs.PL) [pdf, html, other]

Title: C Analyzer : A Static Program Analysis Tool for C Programs

Rajendra Kumar Solanki

Subjects: Programming Languages (cs.PL); Computation and Language (cs.CL)

[1476] arXiv:2403.12984 (cross-list from q-bio.BM) [pdf, html, other]

Title: When SMILES have Language: Drug Classification using Text Classification Methods on Drug SMILES Strings

Azmine Toushik Wasi, Šerbetar Karlo, Raima Islam, Taki Hasan Rafi, Dong-Kyu Chae

Comments: 7 pages, 2 figures, 5 tables, Accepted (invited to present) to the The Second Tiny Papers Track at ICLR 2024 (this https URL)

Journal-ref: The Second Tiny Papers Track at {ICLR} 2024, Tiny Papers @ {ICLR} 2024, Vienna Austria, May 11, 2024

Subjects: Biomolecules (q-bio.BM); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG); Machine Learning (stat.ML)

[1477] arXiv:2403.12999 (cross-list from cs.RO) [pdf, other]

Title: Prompt Selection and Augmentation for Few Examples Code Generation in Large Language Model and its Application in Robotics Control

On Tai Wu, Frodo Kin Sun Chan, Zunhao Zhang, Yan Nei Law, Benny Drescher, Edmond Shiao Bun Lai

Comments: 17 pages, 4 figures

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1478] arXiv:2403.13000 (cross-list from cs.LG) [pdf, other]

Title: Duwak: Dual Watermarks in Large Language Models

Chaoyi Zhu, Jeroen Galjaard, Pin-Yu Chen, Lydia Y. Chen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1479] arXiv:2403.13002 (cross-list from cs.HC) [pdf, other]

Title: AutoTRIZ: Artificial Ideation with TRIZ and Large Language Models

Shuo Jiang, Jianxi Luo

Comments: Proceedings of the ASME 2024 International Design Engineering Technical Conferences and Computers and Information in Engineering Conferences

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1480] arXiv:2403.13031 (cross-list from cs.CR) [pdf, html, other]

Title: RigorLLM: Resilient Guardrails for Large Language Models against Undesired Content

Zhuowen Yuan, Zidi Xiong, Yi Zeng, Ning Yu, Ruoxi Jia, Dawn Song, Bo Li

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1481] arXiv:2403.13037 (cross-list from cs.LG) [pdf, html, other]

Title: BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient Low-Rank Adaptation of Large Pre-trained Models

Rushi Qiang, Ruiyi Zhang, Pengtao Xie

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1482] arXiv:2403.13106 (cross-list from cs.LG) [pdf, html, other]

Title: Knowing Your Nonlinearities: Shapley Interactions Reveal the Underlying Structure of Data

Divyansh Singhvi, Andrej Erkelens, Raghav Jain, Diganta Misra, Naomi Saphra

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1483] arXiv:2403.13213 (cross-list from cs.LG) [pdf, html, other]

Title: From Representational Harms to Quality-of-Service Harms: A Case Study on Llama 2 Safety Safeguards

Khaoula Chehbouni, Megha Roshan, Emmanuel Ma, Futian Andrew Wei, Afaf Taik, Jackie CK Cheung, Golnoosh Farnadi

Comments: 9 pages, 4 figures. Accepted to Findings of the Association for Computational Linguistics: ACL 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1484] arXiv:2403.13272 (cross-list from cs.CY) [pdf, html, other]

Title: Community Needs and Assets: A Computational Analysis of Community Conversations

Md Towhidul Absar Chowdhury, Naveen Sharma, Ashiqur R. KhudaBukhsh

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[1485] arXiv:2403.13301 (cross-list from cs.HC) [pdf, other]

Title: Reading Users' Minds from What They Say: An Investigation into LLM-based Empathic Mental Inference

Qihao Zhu, Leah Chong, Maria Yang, Jianxi Luo

Comments: Submitted to IDETC-CIE2024

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1486] arXiv:2403.13313 (cross-list from cs.AI) [pdf, html, other]

Title: Polaris: A Safety-focused LLM Constellation Architecture for Healthcare

Subhabrata Mukherjee, Paul Gamble, Markel Sanz Ausin, Neel Kant, Kriti Aggarwal, Neha Manjunath, Debajyoti Datta, Zhengliang Liu, Jiayuan Ding, Sophia Busacca, Cezanne Bianco, Swapnil Sharma, Rae Lasko, Michelle Voisard, Sanchay Harneja, Darya Filippova, Gerry Meixiong, Kevin Cha, Amir Youssefi, Meyhaa Buvanesh, Howard Weingram, Sebastian Bierman-Lytle, Harpreet Singh Mangat, Kim Parikh, Saad Godil, Alex Miller

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1487] arXiv:2403.13344 (cross-list from cs.SI) [pdf, html, other]

Title: USE: Dynamic User Modeling with Stateful Sequence Models

Zhihan Zhou, Qixiang Fang, Leonardo Neves, Francesco Barbieri, Yozen Liu, Han Liu, Maarten W. Bos, Ron Dotsch

Subjects: Social and Information Networks (cs.SI); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1488] arXiv:2403.13362 (cross-list from cs.SI) [pdf, html, other]

Title: Incentivizing News Consumption on Social Media Platforms Using Large Language Models and Realistic Bot Accounts

Hadi Askari, Anshuman Chhabra, Bernhard Clemm von Hohenberg, Michael Heseltine, Magdalena Wojcieszak

Subjects: Social and Information Networks (cs.SI); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1489] arXiv:2403.13433 (cross-list from cs.AI) [pdf, html, other]

Title: AgentGroupChat: An Interactive Group Chat Simulacra For Better Eliciting Emergent Behavior

Zhouhong Gu, Xiaoxuan Zhu, Haoran Guo, Lin Zhang, Yin Cai, Hao Shen, Jiangjie Chen, Zheyu Ye, Yifei Dai, Yan Gao, Yao Hu, Hongwei Feng, Yanghua Xiao

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1490] arXiv:2403.13447 (cross-list from cs.AI) [pdf, html, other]

Title: HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models

Wenqiao Zhang, Tianwei Lin, Jiang Liu, Fangxun Shu, Haoyuan Li, Lei Zhang, He Wanggui, Hao Zhou, Zheqi Lv, Hao Jiang, Juncheng Li, Siliang Tang, Yueting Zhuang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1491] arXiv:2403.13513 (cross-list from cs.CV) [pdf, html, other]

Title: What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models

Junho Kim, Yeon Ju Kim, Yong Man Ro

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1492] arXiv:2403.13518 (cross-list from cs.AI) [pdf, html, other]

Title: Motion Generation from Fine-grained Textual Descriptions

Kunhang Li, Yansong Feng

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

[1493] arXiv:2403.13583 (cross-list from cs.SE) [pdf, html, other]

Title: CoCoST: Automatic Complex Code Generation with Online Searching and Correctness Testing

Xinyi He, Jiaru Zou, Yun Lin, Mengyu Zhou, Shi Han, Zejian Yuan, Dongmei Zhang

Comments: Accepted by EMNLP 2024 main conference, long paper

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1494] arXiv:2403.13588 (cross-list from cs.SE) [pdf, html, other]

Title: Genetic Auto-prompt Learning for Pre-trained Code Intelligence Language Models

Chengzhe Feng, Yanan Sun, Ke Li, Pan Zhou, Jiancheng Lv, Aojun Lu

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1495] arXiv:2403.13801 (cross-list from cs.RO) [pdf, html, other]

Title: Natural Language as Policies: Reasoning for Coordinate-Level Embodied Control with LLMs

Yusuke Mikami, Andrew Melnik, Jun Miura, Ville Hautamäki

Comments: 8 pages, 2 figures

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1496] arXiv:2403.13802 (cross-list from cs.CV) [pdf, html, other]

Title: ZigMa: A DiT-style Zigzag Mamba Diffusion Model

Vincent Tao Hu, Stefan Andreas Baumann, Ming Gui, Olga Grebenkova, Pingchuan Ma, Johannes Fischer, Björn Ommer

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1497] arXiv:2403.13804 (cross-list from cs.CV) [pdf, html, other]

Title: Learning from Models and Data for Visual Grounding

Ruozhen He, Paola Cascante-Bonilla, Ziyan Yang, Alexander C. Berg, Vicente Ordonez

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1498] arXiv:2403.13812 (cross-list from cs.DL) [pdf, other]

Title: Quantitative Analysis of AI-Generated Texts in Academic Research: A Study of AI Presence in Arxiv Submissions using AI Detection Tool

Arslan Akram

Comments: 8 pages, 6 figures, 1 table

Subjects: Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG); Other Statistics (stat.OT)

[1499] arXiv:2403.13826 (cross-list from cs.CV) [pdf, html, other]

Title: Measuring Diversity in Co-creative Image Generation

Francisco Ibarrola, Kazjon Grace

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1500] arXiv:2403.13830 (cross-list from q-bio.BM) [pdf, html, other]

Title: Bridging Text and Molecule: A Survey on Multimodal Frameworks for Molecule

Yi Xiao, Xiangxin Zhou, Qiang Liu, Liang Wang

Subjects: Biomolecules (q-bio.BM); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1501] arXiv:2403.13835 (cross-list from cs.LG) [pdf, other]

Title: SMART: Automatically Scaling Down Language Models with Accuracy Guarantees for Reduced Processing Fees

Saehan Jo, Immanuel Trummer

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)

[1502] arXiv:2403.14003 (cross-list from cs.CV) [pdf, html, other]

Title: Multi-Modal Hallucination Control by Visual Information Grounding

Alessandro Favero, Luca Zancato, Matthew Trager, Siddharth Choudhary, Pramuditha Perera, Alessandro Achille, Ashwin Swaminathan, Stefano Soatto

Journal-ref: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1503] arXiv:2403.14048 (cross-list from cs.SD) [pdf, html, other]

Title: The NeurIPS 2023 Machine Learning for Audio Workshop: Affective Audio Benchmarks and Novel Data

Alice Baird, Rachel Manzelli, Panagiotis Tzirakis, Chris Gagne, Haoqi Li, Sadie Allen, Sander Dieleman, Brian Kulis, Shrikanth S. Narayanan, Alan Cowen

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1504] arXiv:2403.14074 (cross-list from cs.IR) [pdf, html, other]

Title: M3: A Multi-Task Mixed-Objective Learning Framework for Open-Domain Multi-Hop Dense Sentence Retrieval

Yang Bai, Anthony Colas, Christan Grant, Daisy Zhe Wang

Comments: Accepted by LREC-COLING 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1505] arXiv:2403.14101 (cross-list from cs.CV) [pdf, html, other]

Title: Text-Enhanced Data-free Approach for Federated Class-Incremental Learning

Minh-Tuan Tran, Trung Le, Xuan-May Le, Mehrtash Harandi, Dinh Phung

Comments: Accepted at CVPR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1506] arXiv:2403.14117 (cross-list from cs.HC) [pdf, html, other]

Title: A Design Space for Intelligent and Interactive Writing Assistants

Mina Lee, Katy Ilonka Gero, John Joon Young Chung, Simon Buckingham Shum, Vipul Raheja, Hua Shen, Subhashini Venugopalan, Thiemo Wambsganss, David Zhou, Emad A. Alghamdi, Tal August, Avinash Bhat, Madiha Zahrah Choksi, Senjuti Dutta, Jin L.C. Guo, Md Naimul Hoque, Yewon Kim, Simon Knight, Seyed Parsa Neshaei, Agnia Sergeyuk, Antonette Shibani, Disha Shrivastava, Lila Shroff, Jessi Stark, Sarah Sterman, Sitong Wang, Antoine Bosselut, Daniel Buschek, Joseph Chee Chang, Sherol Chen, Max Kreminski, Joonsuk Park, Roy Pea, Eugenia H. Rho, Shannon Zejiang Shen, Pao Siangliulue

Comments: Published as a conference paper at CHI 2024

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1507] arXiv:2403.14119 (cross-list from cs.CV) [pdf, html, other]

Title: C-TPT: Calibrated Test-Time Prompt Tuning for Vision-Language Models via Text Feature Dispersion

Hee Suk Yoon, Eunseop Yoon, Joshua Tian Jin Tee, Mark Hasegawa-Johnson, Yingzhen Li, Chang D. Yoo

Comments: ICLR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1508] arXiv:2403.14236 (cross-list from cs.LG) [pdf, html, other]

Title: A Unified Framework for Model Editing

Akshat Gupta, Dev Sajnani, Gopala Anumanchipalli

Comments: EMNLP 2024 Findings

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1509] arXiv:2403.14270 (cross-list from cs.CV) [pdf, html, other]

Title: Scene-Graph ViT: End-to-End Open-Vocabulary Visual Relationship Detection

Tim Salzmann, Markus Ryll, Alex Bewley, Matthias Minderer

Comments: ECCV camera-ready; changed to graph-constrained results

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Robotics (cs.RO)

[1510] arXiv:2403.14339 (cross-list from cs.LG) [pdf, html, other]

Title: $\nabla \tau$: Gradient-based and Task-Agnostic machine Unlearning

Daniel Trippa, Cesare Campagnano, Maria Sofia Bucarelli, Gabriele Tolomei, Fabrizio Silvestri

Comments: 14 pages, 2 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1511] arXiv:2403.14402 (cross-list from cs.SD) [pdf, html, other]

Title: XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception

HyoJung Han, Mohamed Anwar, Juan Pino, Wei-Ning Hsu, Marine Carpuat, Bowen Shi, Changhan Wang

Comments: ACL2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1512] arXiv:2403.14443 (cross-list from cs.AI) [pdf, html, other]

Title: Language Models Can Reduce Asymmetry in Information Markets

Nasim Rahaman, Martin Weiss, Manuel Wüthrich, Yoshua Bengio, Li Erran Li, Chris Pal, Bernhard Schölkopf

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Social and Information Networks (cs.SI)

[1513] arXiv:2403.14460 (cross-list from cs.SE) [pdf, html, other]

Title: Towards Single-System Illusion in Software-Defined Vehicles -- Automated, AI-Powered Workflow

Krzysztof Lebioda, Viktor Vorobev, Nenad Petrovic, Fengjunjie Pan, Vahid Zolfaghari, Alois Knoll

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1514] arXiv:2403.14467 (cross-list from cs.HC) [pdf, html, other]

Title: Recourse for reclamation: Chatting with generative language models

Jennifer Chien, Kevin R. McKee, Jackie Kay, William Isaac

Comments: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA 2024)

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1515] arXiv:2403.14589 (cross-list from cs.AI) [pdf, html, other]

Title: ReAct Meets ActRe: When Language Agents Enjoy Training Data Autonomy

Zonghan Yang, Peng Li, Ming Yan, Ji Zhang, Fei Huang, Yang Liu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1516] arXiv:2403.14613 (cross-list from cs.CV) [pdf, html, other]

Title: DreamReward: Text-to-3D Generation with Human Preference

Junliang Ye, Fangfu Liu, Qixiu Li, Zhengyi Wang, Yikai Wang, Xinzhou Wang, Yueqi Duan, Jun Zhu

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1517] arXiv:2403.14624 (cross-list from cs.CV) [pdf, html, other]

Title: MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?

Renrui Zhang, Dongzhi Jiang, Yichi Zhang, Haokun Lin, Ziyu Guo, Pengshuo Qiu, Aojun Zhou, Pan Lu, Kai-Wei Chang, Peng Gao, Hongsheng Li

Comments: Accepted by ECCV 2024, 46 Pages, Benchmark Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1518] arXiv:2403.14633 (cross-list from cs.CY) [pdf, html, other]

Title: Born With a Silver Spoon? Investigating Socioeconomic Bias in Large Language Models

Smriti Singh, Shuvam Keshari, Vinija Jain, Aman Chadha

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1519] arXiv:2403.14643 (cross-list from cs.CY) [pdf, other]

Title: Exploring ChatGPT and its Impact on Society

Md. Asraful Haque, Shuai Li

Comments: 13 Pages

Journal-ref: AI and Ethics (2024)

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1520] arXiv:2403.14651 (cross-list from cs.CY) [pdf, html, other]

Title: DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures

Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[1521] arXiv:2403.14652 (cross-list from cs.CY) [pdf, html, other]

Title: MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation

Han Wang, Roy Ka-Wei Lee

Comments: 8 pages, 7 figures, ACM MM 2024

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1522] arXiv:2403.14657 (cross-list from cs.CY) [pdf, other]

Title: A Synergistic Approach to Wildfire Prevention and Management Using AI, ML, and 5G Technology in the United States

Stanley Chinedu Okoro, Alexander Lopez, Austine Unuriode

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[1523] arXiv:2403.14659 (cross-list from cs.CY) [pdf, html, other]

Title: Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future

Minzhi Li, Weiyan Shi, Caleb Ziems, Diyi Yang

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1524] arXiv:2403.14661 (cross-list from cs.CY) [pdf, html, other]

Title: Towards Modeling Learner Performance with Large Language Models

Seyed Parsa Neshaei, Richard Lee Davis, Adam Hazimeh, Bojan Lazarevski, Pierre Dillenbourg, Tanja Käser

Comments: 12 pages, 4 figures

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1525] arXiv:2403.14666 (cross-list from cs.CY) [pdf, html, other]

Title: SyllabusQA: A Course Logistics Question Answering Dataset

Nigel Fernandez, Alexander Scarlatos, Andrew Lan

Comments: ACL 2024: The 62nd Annual Meeting of the Association for Computational Linguistics

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1526] arXiv:2403.14668 (cross-list from cs.CY) [pdf, html, other]

Title: Predicting Learning Performance with Large Language Models: A Study in Adult Literacy

Liang Zhang, Jionghao Lin, Conrad Borchers, John Sabatini, John Hollander, Meng Cao, Xiangen Hu

Comments: 26TH International Conference on Human-Computer Interaction

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1527] arXiv:2403.14683 (cross-list from cs.CY) [pdf, html, other]

Title: A Moral Imperative: The Need for Continual Superalignment of Large Language Models

Gokul Puthumanaillam, Manav Vora, Pranay Thangeda, Melkior Ornik

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1528] arXiv:2403.14690 (cross-list from cs.CY) [pdf, other]

Title: Incorporating Graph Attention Mechanism into Geometric Problem Solving Based on Deep Reinforcement Learning

Xiuqin Zhong, Shengyuan Yan, Gongqi Lin, Hongguang Fu, Liang Xu, Siwen Jiang, Lei Huang, Wei Fang

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1529] arXiv:2403.14694 (cross-list from cs.CY) [pdf, other]

Title: Application of GPT Language Models for Innovation in Activities in University Teaching

Manuel de Buenaga, Francisco Javier Bueno

Comments: 15 pages, in spanish language, 4 tables, 5 figures

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1530] arXiv:2403.14705 (cross-list from cs.AI) [pdf, html, other]

Title: Concept-Best-Matching: Evaluating Compositionality in Emergent Communication

Boaz Carmeli, Yonatan Belinkov, Ron Meir

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1531] arXiv:2403.14720 (cross-list from cs.CR) [pdf, html, other]

Title: Defending Against Indirect Prompt Injection Attacks With Spotlighting

Keegan Hines, Gary Lopez, Matthew Hall, Federico Zarfati, Yonatan Zunger, Emre Kiciman

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1532] arXiv:2403.14725 (cross-list from cs.CR) [pdf, html, other]

Title: Testing the Limits of Jailbreaking Defenses with the Purple Problem

Taeyoun Kim, Suhas Kotha, Aditi Raghunathan

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1533] arXiv:2403.14727 (cross-list from cs.CY) [pdf, html, other]

Title: Protected group bias and stereotypes in Large Language Models

Hadas Kotek, David Q. Sun, Zidi Xiu, Margit Bowler, Christopher Klein

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1534] arXiv:2403.14731 (cross-list from cs.CR) [pdf, html, other]

Title: Reversible Jump Attack to Textual Classifiers with Modification Reduction

Mingze Ni, Zhensu Sun, Wei Liu

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1535] arXiv:2403.14733 (cross-list from cs.AI) [pdf, other]

Title: Open Knowledge Base Canonicalization with Multi-task Learning

Bingchen Liu, Huang Peng, Weixin Zeng, Xiang Zhao, Shijun Liu, Li Pan

Comments: arXiv admin note: substantial text overlap with arXiv:2310.16419

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1536] arXiv:2403.14734 (cross-list from cs.SE) [pdf, html, other]

Title: A Survey of Neural Code Intelligence: Paradigms, Advances and Beyond

Qiushi Sun, Zhirui Chen, Fangzhi Xu, Kanzhi Cheng, Chang Ma, Zhangyue Yin, Jianing Wang, Chengcheng Han, Renyu Zhu, Shuai Yuan, Qipeng Guo, Xipeng Qiu, Pengcheng Yin, Xiaoli Li, Fei Yuan, Lingpeng Kong, Xiang Li, Zhiyong Wu

Comments: 65 pages, 6 figures, 10 tables, 701 references

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Programming Languages (cs.PL)

[1537] arXiv:2403.14773 (cross-list from cs.CV) [pdf, other]

Title: StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text

Roberto Henschel, Levon Khachatryan, Daniil Hayrapetyan, Hayk Poghosyan, Vahram Tadevosyan, Zhangyang Wang, Shant Navasardyan, Humphrey Shi

Comments: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[1538] arXiv:2403.14774 (cross-list from cs.CV) [pdf, html, other]

Title: Few-Shot Adversarial Prompt Learning on Vision-Language Models

Yiwei Zhou, Xiaobo Xia, Zhiwei Lin, Bo Han, Tongliang Liu

Comments: NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[1539] arXiv:2403.14783 (cross-list from cs.CV) [pdf, html, other]

Title: Multi-Agent VQA: Exploring Multi-Agent Foundation Models in Zero-Shot Visual Question Answering

Bowen Jiang, Zhijun Zhuang, Shreyas S. Shivakumar, Dan Roth, Camillo J. Taylor

Comments: A full version of the paper will be released soon. The codes are available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)

[1540] arXiv:2403.14870 (cross-list from cs.CV) [pdf, html, other]

Title: VidLA: Video-Language Alignment at Scale

Mamshad Nayeem Rizve, Fan Fei, Jayakrishnan Unnikrishnan, Son Tran, Benjamin Z. Yao, Belinda Zeng, Mubarak Shah, Trishul Chilimbi

Comments: Accepted to CVPR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1541] arXiv:2403.14958 (cross-list from cs.LG) [pdf, html, other]

Title: Adapprox: Adaptive Approximation in Adam Optimization via Randomized Low-Rank Matrices

Pengxiang Zhao, Ping Li, Yingjie Gu, Yi Zheng, Stephan Ludger Kölker, Zhefeng Wang, Xiaoming Yuan

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Optimization and Control (math.OC)

[1542] arXiv:2403.14972 (cross-list from cs.AI) [pdf, html, other]

Title: A Picture Is Worth a Graph: A Blueprint Debate Paradigm for Multimodal Reasoning

Changmeng Zheng, Dayong Liang, Wengyu Zhang, Xiao-Yong Wei, Tat-Seng Chua, Qing Li

Comments: Accepted by ACM Multimedia 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Multimedia (cs.MM)

[1543] arXiv:2403.15062 (cross-list from q-fin.CP) [pdf, other]

Title: Construction of a Japanese Financial Benchmark for Large Language Models

Masanori Hirano

Comments: 9 pages, Joint Workshop of the 7th Financial Technology and Natural Language Processing (FinNLP), the 5th Knowledge Discovery from Unstructured Data in Financial Services (KDF), and The 4th Workshop on Economics and Natural Language Processing (ECONLP) In conjunction with LREC-COLING-2024

Subjects: Computational Finance (q-fin.CP); Computation and Language (cs.CL)

[1544] arXiv:2403.15137 (cross-list from cs.AI) [pdf, html, other]

Title: CACA Agent: Capability Collaboration based AI Agent

Peng Xu, Haoran Wang, Chuang Wang, Xu Liu

Comments: 4 pages,5 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[1545] arXiv:2403.15214 (cross-list from cs.CY) [pdf, html, other]

Title: InstaSynth: Opportunities and Challenges in Generating Synthetic Instagram Data with ChatGPT for Sponsored Content Detection

Thales Bertaglia, Lily Heisig, Rishabh Kaushal, Adriana Iamnitchi

Comments: To appear at the 18th International AAAI Conference on Web and Social Media (ICWSM 2024) -- please cite accordingly

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[1546] arXiv:2403.15226 (cross-list from cs.MM) [pdf, html, other]

Title: Not All Attention is Needed: Parameter and Computation Efficient Transfer Learning for Multi-modal Large Language Models

Qiong Wu, Weihao Ye, Yiyi Zhou, Xiaoshuai Sun, Rongrong Ji

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL)

[1547] arXiv:2403.15246 (cross-list from cs.IR) [pdf, html, other]

Title: FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions

Orion Weller, Benjamin Chang, Sean MacAvaney, Kyle Lo, Arman Cohan, Benjamin Van Durme, Dawn Lawrie, Luca Soldaini

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1548] arXiv:2403.15309 (cross-list from cs.CV) [pdf, html, other]

Title: Controlled Training Data Generation with Diffusion Models

Teresa Yeo, Andrei Atanov, Harold Benoit, Aleksandr Alekseev, Ruchira Ray, Pooya Esmaeil Akhoondi, Amir Zamir

Comments: Project page at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1549] arXiv:2403.15365 (cross-list from cs.CR) [pdf, html, other]

Title: A Transfer Attack to Image Watermarks

Yuepeng Hu, Zhengyuan Jiang, Moyang Guo, Neil Gong

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1550] arXiv:2403.15371 (cross-list from cs.LG) [pdf, html, other]

Title: Can large language models explore in-context?

Akshay Krishnamurthy, Keegan Harris, Dylan J. Foster, Cyril Zhang, Aleksandrs Slivkins

Comments: Accepted to NeurIPS 2024. This version: added references to related and concurrent work

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1551] arXiv:2403.15388 (cross-list from cs.CV) [pdf, html, other]

Title: LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models

Yuzhang Shang, Mu Cai, Bingxin Xu, Yong Jae Lee, Yan Yan

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1552] arXiv:2403.15397 (cross-list from cs.CY) [pdf, other]

Title: Regulating Large Language Models: A Roundtable Report

Gabriel Nicholas, Paul Friedl

Comments: 24 pages

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1553] arXiv:2403.15399 (cross-list from cs.CY) [pdf, html, other]

Title: ChatGPT in Linear Algebra: Strides Forward, Steps to Go

Eli Bagno, Thierry Dana-Picard, Shulamit Reches

Comments: arXiv admin note: text overlap with arXiv:2306.16282

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1554] arXiv:2403.15401 (cross-list from cs.CY) [pdf, other]

Title: Large Language Model for Mental Health: A Systematic Review

Zhijun Guo, Alvina Lai, Johan Hilge Thygesen, Joseph Farrington, Thomas Keen, Kezhi Li

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1555] arXiv:2403.15412 (cross-list from cs.CY) [pdf, html, other]

Title: Towards Measuring and Modeling "Culture" in LLMs: A Survey

Muhammad Farid Adilazuarda, Sagnik Mukherjee, Pradhyumna Lavania, Siddhant Singh, Alham Fikri Aji, Jacki O'Neill, Ashutosh Modi, Monojit Choudhury

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1556] arXiv:2403.15426 (cross-list from cs.LG) [pdf, html, other]

Title: A Three-Phases SFT Hybrid Model Integrated Strong Prior Module and Data Overlap Estimation in the Eduation Context

Zhangquan Chen, Chunjiang Liu, Haobin Duan

Comments: 9 pages, 2 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1557] arXiv:2403.15456 (cross-list from cs.AI) [pdf, html, other]

Title: WoLF: Wide-scope Large Language Model Framework for CXR Understanding

Seil Kang, Donghyun Kim, Junhyeok Kim, Hyo Kyung Lee, Seong Jae Hwang

Comments: 11 pages main paper, 2 pages supplementary

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1558] arXiv:2403.15465 (cross-list from cs.LG) [pdf, html, other]

Title: Most Likely Sequence Generation for $n$-Grams, Transformers, HMMs, and Markov Chains, by Using Rollout Algorithms

Yuchao Li, Dimitri Bertsekas

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Systems and Control (eess.SY)

[1559] arXiv:2403.15498 (cross-list from cs.LG) [pdf, html, other]

Title: Emergent World Models and Latent Variable Estimation in Chess-Playing Language Models

Adam Karvonen

Comments: Accepted to the 2024 Conference on Language Modeling

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1560] arXiv:2403.15638 (cross-list from cs.CR) [pdf, html, other]

Title: Differentially Private Next-Token Prediction of Large Language Models

James Flemings, Meisam Razaviyayn, Murali Annavaram

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1561] arXiv:2403.15676 (cross-list from cs.SE) [pdf, html, other]

Title: AC4: Algebraic Computation Checker for Circuit Constraints in ZKPs

Hao Chen, Guoqiang Li, Minyu Chen, Ruibang Liu, Sinka Gao

Comments: 24 pages, 5 figures

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1562] arXiv:2403.15696 (cross-list from cs.AI) [pdf, html, other]

Title: MixRED: A Mix-lingual Relation Extraction Dataset

Lingxing Kong, Yougang Chu, Zheng Ma, Jianbing Zhang, Liang He, Jiajun Chen

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1563] arXiv:2403.15744 (cross-list from cs.LG) [pdf, html, other]

Title: On the Fragility of Active Learners for Text Classification

Abhishek Ghose, Emma Thuong Nguyen

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1564] arXiv:2403.15756 (cross-list from cs.SE) [pdf, other]

Title: Leveraging Large Language Models for Preliminary Security Risk Analysis: A Mission-Critical Case Study

Matteo Esposito, Francesco Palagiano

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Computers and Society (cs.CY)

[1565] arXiv:2403.15757 (cross-list from cs.IR) [pdf, html, other]

Title: User-Side Realization

Ryoma Sato

Comments: Doctoral Thesis

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[1566] arXiv:2403.15837 (cross-list from cs.CV) [pdf, html, other]

Title: Centered Masking for Language-Image Pre-Training

Mingliang Liang, Martha Larson

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1567] arXiv:2403.15875 (cross-list from cs.AI) [pdf, html, other]

Title: LAMPER: LanguAge Model and Prompt EngineeRing for zero-shot time series classification

Zhicheng Du, Zhaotian Xie, Yan Tong, Peiwu Qin

Comments: Accepted as tiny paper in ICLR 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1568] arXiv:2403.15952 (cross-list from cs.CV) [pdf, html, other]

Title: IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models

Haz Sameen Shahgir, Khondker Salman Sayeed, Abhik Bhattacharjee, Wasi Uddin Ahmad, Yue Dong, Rifat Shahriyar

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1569] arXiv:2403.15992 (cross-list from cs.CV) [pdf, html, other]

Title: BIMCV-R: A Landmark Dataset for 3D CT Text-Image Retrieval

Yinda Chen, Che Liu, Xiaoyu Liu, Rossella Arcucci, Zhiwei Xiong

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1570] arXiv:2403.16033 (cross-list from cs.LG) [pdf, html, other]

Title: Node Classification via Semantic-Structural Attention-Enhanced Graph Convolutional Networks

Hongyin Zhu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[1571] arXiv:2403.16087 (cross-list from cs.SE) [pdf, html, other]

Title: LLMs as Compiler for Arabic Programming Language

Serry Sibaee, Omar Najar, Lahouri Ghouti, Anis Koubaa

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1572] arXiv:2403.16167 (cross-list from cs.CV) [pdf, html, other]

Title: ESREAL: Exploiting Semantic Reconstruction to Mitigate Hallucinations in Vision-Language Models

Minchan Kim, Minyeong Kim, Junik Bae, Suhwan Choi, Sungkyung Kim, Buru Chang

Comments: ECCV 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1573] arXiv:2403.16176 (cross-list from cs.LG) [pdf, html, other]

Title: Subspace Defense: Discarding Adversarial Perturbations by Learning a Subspace for Clean Signals

Rui Zheng, Yuhao Zhou, Zhiheng Xi, Tao Gui, Qi Zhang, Xuanjing Huang

Comments: Accepted by COLING 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1574] arXiv:2403.16303 (cross-list from cs.DL) [pdf, other]

Title: Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysis

Huizi Yu, Lizhou Fan, Lingyao Li, Jiayan Zhou, Zihui Ma, Lu Xian, Wenyue Hua, Sijia He, Mingyu Jin, Yongfeng Zhang, Ashvin Gandhi, Xin Ma

Comments: 62 pages, 9 figures, 5 tables

Subjects: Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[1575] arXiv:2403.16385 (cross-list from cs.CV) [pdf, html, other]

Title: Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQA

Zhuowan Li, Bhavan Jasani, Peng Tang, Shabnam Ghadar

Comments: Accepted to CVPR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1576] arXiv:2403.16393 (cross-list from cs.AI) [pdf, html, other]

Title: Concurrent Linguistic Error Detection (CLED) for Large Language Models

Jinhua Zhu, Javier Conde, Zhen Gao, Pedro Reviriego, Shanshan Liu, Fabrizio Lombardi

Comments: 11 pages, 6 figures, 30 references

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1577] arXiv:2403.16437 (cross-list from cs.SE) [pdf, html, other]

Title: Reasoning Runtime Behavior of a Program with LLM: How Far Are We?

Junkai Chen, Zhiyuan Pan, Xing Hu, Zhenhao Li, Ge Li, Xin Xia

Comments: Accepted by 47th IEEE/ACM International Conference on Software Engineering (ICSE 2025). Our REval leaderboard is available at this https URL

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1578] arXiv:2403.16527 (cross-list from cs.AI) [pdf, html, other]

Title: Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Art

Neeloy Chakraborty, Melkior Ornik, Katherine Driggs-Campbell

Comments: 31 pages, 2 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1579] arXiv:2403.16851 (cross-list from cs.DL) [pdf, other]

Title: Can ChatGPT predict article retraction based on Twitter mentions?

Er-Te Zheng, Hui-Zhen Fu, Zhichao Fang

Subjects: Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1580] arXiv:2403.16899 (cross-list from eess.SY) [pdf, html, other]

Title: State Space Models as Foundation Models: A Control Theoretic Overview

Carmen Amo Alonso, Jerome Sieber, Melanie N. Zeilinger

Subjects: Systems and Control (eess.SY); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1581] arXiv:2403.16909 (cross-list from cs.AI) [pdf, html, other]

Title: Towards Algorithmic Fidelity: Mental Health Representation across Demographics in Synthetic vs. Human-generated Data

Shinka Mori, Oana Ignat, Andrew Lee, Rada Mihalcea

Comments: 14 pages, 16 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1582] arXiv:2403.16915 (cross-list from cs.IR) [pdf, html, other]

Title: Coarse-Tuning for Ad-hoc Document Retrieval Using Pre-trained Language Models

Atsushi Keyaki, Ribeka Keyaki

Comments: Accepted at LREC-COLING 2024

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1583] arXiv:2403.16971 (cross-list from cs.OS) [pdf, html, other]

Title: AIOS: LLM Agent Operating System

Kai Mei, Zelong Li, Shuyuan Xu, Ruosong Ye, Yingqiang Ge, Yongfeng Zhang

Comments: 14 pages, 5 figures, 5 tables; comments and suggestions are appreciated

Subjects: Operating Systems (cs.OS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1584] arXiv:2403.16973 (cross-list from eess.AS) [pdf, html, other]

Title: VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild

Puyuan Peng, Po-Yao Huang, Shang-Wen Li, Abdelrahman Mohamed, David Harwath

Comments: ACL 2024. Data, code, and model weights are available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1585] arXiv:2403.16984 (cross-list from cs.AI) [pdf, html, other]

Title: Modelling Commonsense Commonalities with Multi-Facet Concept Embeddings

Hanane Kteich, Na Li, Usashi Chatterjee, Zied Bouraoui, Steven Schockaert

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1586] arXiv:2403.17124 (cross-list from cs.RO) [pdf, html, other]

Title: Grounding Language Plans in Demonstrations Through Counterfactual Perturbations

Yanwei Wang, Tsun-Hsuan Wang, Jiayuan Mao, Michael Hagenow, Julie Shah

Comments: ICLR 2024 Spotlight

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1587] arXiv:2403.17246 (cross-list from cs.AI) [pdf, html, other]

Title: TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Models

Ishika Singh, David Traum, Jesse Thomason

Comments: 12 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Robotics (cs.RO)

[1588] arXiv:2403.17336 (cross-list from cs.CR) [pdf, html, other]

Title: Don't Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Models

Zhiyuan Yu, Xiaogeng Liu, Shunning Liang, Zach Cameron, Chaowei Xiao, Ning Zhang

Comments: Accepted by USENIX Security 2024

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1589] arXiv:2403.17343 (cross-list from cs.CV) [pdf, html, other]

Title: Residual-based Language Models are Free Boosters for Biomedical Imaging

Zhixin Lai, Jing Wu, Suiyao Chen, Yucheng Zhou, Naira Hovakimyan

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1590] arXiv:2403.17344 (cross-list from cs.DB) [pdf, html, other]

Title: Disambiguate Entity Matching using Large Language Models through Relation Discovery

Zezhou Huang

Subjects: Databases (cs.DB); Computation and Language (cs.CL)

[1591] arXiv:2403.17428 (cross-list from cs.AI) [pdf, html, other]

Title: Aligning Large Language Models for Enhancing Psychiatric Interviews through Symptom Delineation and Summarization

Jae-hee So, Joonhwan Chang, Eunji Kim, Junho Na, JiYeon Choi, Jy-yong Sohn, Byung-Hoon Kim, Sang Hui Chu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1592] arXiv:2403.17445 (cross-list from cs.LG) [pdf, html, other]

Title: Incorporating Exponential Smoothing into MLP: A Simple but Effective Sequence Model

Jiqun Chu, Zuoquan Lin

Comments: 12 pages, 5 tables, 3 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1593] arXiv:2403.17524 (cross-list from cs.CR) [pdf, html, other]

Title: Provably Secure Disambiguating Neural Linguistic Steganography

Yuang Qi, Kejiang Chen, Kai Zeng, Weiming Zhang, Nenghai Yu

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1594] arXiv:2403.17599 (cross-list from cs.HC) [pdf, other]

Title: Coimagining the Future of Voice Assistants with Cultural Sensitivity

Katie Seaborn, Yuto Sawa, Mizuki Watanabe

Comments: 21 pages

Journal-ref: Human Behavior and Emerging Technologies, vol. 2024, Article ID 3238737, 21 pages, 2024

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1595] arXiv:2403.17691 (cross-list from cs.CV) [pdf, html, other]

Title: Not All Similarities Are Created Equal: Leveraging Data-Driven Biases to Inform GenAI Copyright Disputes

Uri Hacohen, Adi Haviv, Shahar Sarfaty, Bruria Friedman, Niva Elkin-Koren, Roi Livni, Amit H Bermano

Comments: Presented at ACM CSLAW 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1596] arXiv:2403.17727 (cross-list from cs.CV) [pdf, html, other]

Title: FastPerson: Enhancing Video Learning through Effective Video Summarization that Preserves Linguistic and Visual Contexts

Kazuki Kawamura, Jun Rekimoto

Journal-ref: AHs '24: Proceedings of the Augmented Humans International Conference 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[1597] arXiv:2403.17804 (cross-list from cs.CV) [pdf, html, other]

Title: Improving Text-to-Image Consistency via Automatic Prompt Optimization

Oscar Mañas, Pietro Astolfi, Melissa Hall, Candace Ross, Jack Urbanek, Adina Williams, Aishwarya Agrawal, Adriana Romero-Soriano, Michal Drozdzal

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1598] arXiv:2403.17806 (cross-list from cs.LG) [pdf, html, other]

Title: Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanisms

Michael Hanna, Sandro Pezzelle, Yonatan Belinkov

Comments: COLM 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1599] arXiv:2403.17811 (cross-list from cs.LG) [pdf, html, other]

Title: Are Compressed Language Models Less Subgroup Robust?

Leonidas Gee, Andrea Zugarini, Novi Quadrianto

Comments: The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023)

Journal-ref: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Main Track

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1600] arXiv:2403.17846 (cross-list from cs.RO) [pdf, html, other]

Title: Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigation

Abdelrhman Werby, Chenguang Huang, Martin Büchner, Abhinav Valada, Wolfram Burgard

Comments: Code and video are available at this http URL

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1601] arXiv:2403.17919 (cross-list from cs.LG) [pdf, html, other]

Title: LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning

Rui Pan, Xiang Liu, Shizhe Diao, Renjie Pi, Jipeng Zhang, Chi Han, Tong Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Optimization and Control (math.OC)

[1602] arXiv:2403.18063 (cross-list from cs.CV) [pdf, html, other]

Title: Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis

Badri N. Patro, Suhas Ranganath, Vinay P. Namboodiri, Vijay S. Agneeswaran

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1603] arXiv:2403.18120 (cross-list from cs.AI) [pdf, html, other]

Title: Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization

Jin Peng Zhou, Charles Staats, Wenda Li, Christian Szegedy, Kilian Q. Weinberger, Yuhuai Wu

Comments: ICLR 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1604] arXiv:2403.18159 (cross-list from cs.LG) [pdf, html, other]

Title: Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models

Kartikeya Bhardwaj, Nilesh Prasad Pandey, Sweta Priyadarshi, Kyunggeun Lee, Jun Ma, Harris Teague

Comments: Accepted at Practical ML for Low Resource Settings Workshop at ICLR 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1605] arXiv:2403.18252 (cross-list from cs.CV) [pdf, html, other]

Title: Beyond Embeddings: The Promise of Visual Table in Visual Reasoning

Yiwu Zhong, Zi-Yuan Hu, Michael R. Lyu, Liwei Wang

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1606] arXiv:2403.18260 (cross-list from cs.CV) [pdf, html, other]

Title: Toward Interactive Regional Understanding in Vision-Large Language Models

Jungbeom Lee, Sanghyuk Chun, Sangdoo Yun

Comments: NAACL 2024 Main Conference

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1607] arXiv:2403.18276 (cross-list from cs.IR) [pdf, html, other]

Title: RankMamba: Benchmarking Mamba's Document Ranking Performance in the Era of Transformers

Zhichao Xu

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1608] arXiv:2403.18406 (cross-list from cs.CV) [pdf, html, other]

Title: An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM

Wonkyun Kim, Changin Choi, Wonseok Lee, Wonjong Rhee

Comments: Our code is available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1609] arXiv:2403.18435 (cross-list from cs.IR) [pdf, html, other]

Title: DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment

Haitao Li, Qingyao Ai, Xinyan Han, Jia Chen, Qian Dong, Yiqun Liu, Chong Chen, Qi Tian

Comments: 11 pages

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1610] arXiv:2403.18525 (cross-list from cs.CV) [pdf, html, other]

Title: Language Plays a Pivotal Role in the Object-Attribute Compositional Generalization of CLIP

Reza Abbasi, Mohammad Samiei, Mohammad Hossein Rohban, Mahdieh Soleymani Baghshah

Comments: Oral accepted at OODCV 2023(this http URL)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1611] arXiv:2403.18537 (cross-list from cs.AI) [pdf, other]

Title: A Path Towards Legal Autonomy: An interoperable and explainable approach to extracting, transforming, loading and computing legal information using large language models, expert systems and Bayesian networks

Axel Constant, Hannes Westermann, Bryan Wilson, Alex Kiefer, Ines Hipolito, Sylvain Pronovost, Steven Swanson, Mahault Albarracin, Maxwell J.D. Ramstead

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Logic in Computer Science (cs.LO)

[1612] arXiv:2403.18591 (cross-list from cs.LO) [pdf, html, other]

Title: Safety Verification of Wait-Only Non-Blocking Broadcast Protocols

Lucie Guillou, Arnaud Sangnier, Nathalie Sznajder

Comments: Long version of a paper accepted to PetriNets 2024

Subjects: Logic in Computer Science (cs.LO); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[1613] arXiv:2403.18609 (cross-list from cs.NE) [pdf, html, other]

Title: A survey on learning models of spiking neural membrane systems and spiking neural networks

Prithwineel Paul, Petr Sosik, Lucie Ciencialova

Subjects: Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL)

[1614] arXiv:2403.18624 (cross-list from cs.SE) [pdf, html, other]

Title: Vulnerability Detection with Code Language Models: How Far Are We?

Yangruibo Ding, Yanjun Fu, Omniyyah Ibrahim, Chawin Sitawarin, Xinyun Chen, Basel Alomair, David Wagner, Baishakhi Ray, Yizheng Chen

Comments: Accepted for the 47th IEEE/ACM International Conference on Software Engineering (ICSE 2025); Camera-ready Work in Progress

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1615] arXiv:2403.18667 (cross-list from cs.IR) [pdf, html, other]

Title: Improving Content Recommendation: Knowledge Graph-Based Semantic Contrastive Learning for Diversity and Cold-Start Users

Yejin Kim, Scott Rome, Kevin Foley, Mayur Nankani, Rimon Melamed, Javier Morales, Abhay Yadav, Maria Peifer, Sardar Hamidian, H. Howie Huang

Comments: Accepted at LREC-COLING 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1616] arXiv:2403.18684 (cross-list from cs.IR) [pdf, html, other]

Title: Scaling Laws For Dense Retrieval

Yan Fang, Jingtao Zhan, Qingyao Ai, Jiaxin Mao, Weihang Su, Jia Chen, Yiqun Liu

Comments: Accepted at SIGIR 2024. V2 fixes a bug in the experiments

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1617] arXiv:2403.18715 (cross-list from cs.CV) [pdf, html, other]

Title: Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding

Xintong Wang, Jingheng Pan, Liang Ding, Chris Biemann

Comments: Accepted to Findings of ACL 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1618] arXiv:2403.18746 (cross-list from cs.SE) [pdf, html, other]

Title: CYCLE: Learning to Self-Refine the Code Generation

Yangruibo Ding, Marcus J. Min, Gail Kaiser, Baishakhi Ray

Comments: Camera-ready for OOPSLA'24

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1619] arXiv:2403.18814 (cross-list from cs.CV) [pdf, html, other]

Title: Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models

Yanwei Li, Yuechen Zhang, Chengyao Wang, Zhisheng Zhong, Yixin Chen, Ruihang Chu, Shaoteng Liu, Jiaya Jia

Comments: Code and models are available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1620] arXiv:2403.18843 (cross-list from cs.CV) [pdf, html, other]

Title: JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition

Chang Sun, Hong Yang, Bo Qin

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1621] arXiv:2403.18872 (cross-list from cs.LG) [pdf, html, other]

Title: Targeted Visualization of the Backbone of Encoder LLMs

Isaac Roberts, Alexander Schulz, Luca Hermes, Barbara Hammer

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1622] arXiv:2403.18926 (cross-list from cs.LG) [pdf, html, other]

Title: XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection

Yuanhang Yang, Shiyi Qi, Wenchao Gu, Chaozheng Wang, Cuiyun Gao, Zenglin Xu

Comments: ACL2024 Findings

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1623] arXiv:2403.18957 (cross-list from cs.CY) [pdf, other]

Title: Moderating Illicit Online Image Promotion for Unsafe User-Generated Content Games Using Large Vision-Language Models

Keyan Guo, Ayush Utkarsh, Wenbo Ding, Isabelle Ondracek, Ziming Zhao, Guo Freeman, Nishant Vishwamitra, Hongxin Hu

Comments: To Appear in the 33rd USENIX Security Symposium, August 14-16, 2024

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[1624] arXiv:2403.19021 (cross-list from cs.IR) [pdf, html, other]

Title: IDGenRec: LLM-RecSys Alignment with Textual ID Learning

Juntao Tan, Shuyuan Xu, Wenyue Hua, Yingqiang Ge, Zelong Li, Yongfeng Zhang

Comments: Accepted in SIGIR 2024

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1625] arXiv:2403.19103 (cross-list from cs.CV) [pdf, html, other]

Title: Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation

Yutong He, Alexander Robey, Naoki Murata, Yiding Jiang, Joshua Williams, George J. Pappas, Hamed Hassani, Yuki Mitsufuji, Ruslan Salakhutdinov, J. Zico Kolter

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1626] arXiv:2403.19114 (cross-list from cs.SE) [pdf, html, other]

Title: Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM

Chunqiu Steven Xia, Yinlin Deng, Lingming Zhang

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG); Programming Languages (cs.PL)

[1627] arXiv:2403.19181 (cross-list from cs.IR) [pdf, other]

Title: Make Large Language Model a Better Ranker

Wen-Shuo Chao, Zhi Zheng, Hengshu Zhu, Hao Liu

Comments: 12 pages, 5 figures

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1628] arXiv:2403.19201 (cross-list from cs.DL) [pdf, other]

Title: Understanding Archives: Towards New Research Interfaces Relying on the Semantic Annotation of Documents

Nicolas Gutehrlé (CRIT), Iana Atanassova (CRIT, STIH, TESNIERE, LaLIC)

Comments: in French language. CiDE.23: Document et archivage: pratiques formelles et informelles, Oct 2023, Grenoble, France

Subjects: Digital Libraries (cs.DL); Computation and Language (cs.CL)

[1629] arXiv:2403.19211 (cross-list from cs.LG) [pdf, html, other]

Title: Dual-Personalizing Adapter for Federated Foundation Models

Yiyuan Yang, Guodong Long, Tao Shen, Jing Jiang, Michael Blumenstein

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1630] arXiv:2403.19322 (cross-list from cs.CV) [pdf, html, other]

Title: Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models

Jiaxing Chen, Yuxuan Liu, Dehu Li, Xiang An, Weimo Deng, Ziyong Feng, Yongle Zhao, Yin Xie

Comments: 15 pages, 8 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1631] arXiv:2403.19423 (cross-list from cs.SI) [pdf, html, other]

Title: Echo-chambers and Idea Labs: Communication Styles on Twitter

Aleksandra Sorokovikova, Michael Becker, Ivan P. Yamshchikov

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL)

[1632] arXiv:2403.19634 (cross-list from cs.SD) [pdf, html, other]

Title: Asymmetric and trial-dependent modeling: the contribution of LIA to SdSV Challenge Task 2

Pierre-Michel Bousquet, Mickael Rouvier

Comments: LIA system description for the Short Duration Speaker Verification (SdSv) challenge 2020 Task 2

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1633] arXiv:2403.19647 (cross-list from cs.LG) [pdf, html, other]

Title: Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models

Samuel Marks, Can Rager, Eric J. Michaud, Yonatan Belinkov, David Bau, Aaron Mueller

Comments: Code and data at this https URL. Demonstration at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1634] arXiv:2403.19651 (cross-list from cs.CV) [pdf, html, other]

Title: MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions

Kai Zhang, Yi Luan, Hexiang Hu, Kenton Lee, Siyuan Qiao, Wenhu Chen, Yu Su, Ming-Wei Chang

Comments: ICML 2024 (Oral); Project Website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Multimedia (cs.MM)

[1635] arXiv:2403.19669 (cross-list from cs.LG) [pdf, html, other]

Title: Analyzing the Roles of Language and Vision in Learning from Limited Data

Allison Chen, Ilia Sucholutsky, Olga Russakovsky, Thomas L. Griffiths

Comments: 8 pages, 4 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1636] arXiv:2403.19709 (cross-list from eess.AS) [pdf, html, other]

Title: Hierarchical Recurrent Adapters for Efficient Multi-Task Adaptation of Large Speech Models

Tsendsuren Munkhdalai, Youzheng Chen, Khe Chai Sim, Fadi Biadsy, Tara Sainath, Pedro Moreno Mengibar

Comments: 5 pages, 3 figures, 5 tables

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[1637] arXiv:2403.19758 (cross-list from quant-ph) [pdf, html, other]

Title: Quantum Natural Language Processing

Dominic Widdows, Willie Aboumrad, Dohun Kim, Sayonee Ray, Jonathan Mei

Subjects: Quantum Physics (quant-ph); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1638] arXiv:2403.19837 (cross-list from cs.LG) [pdf, html, other]

Title: Concept-based Analysis of Neural Networks via Vision-Language Models

Ravi Mangal, Nina Narodytska, Divya Gopinath, Boyue Caroline Hu, Anirban Roy, Susmit Jha, Corina Pasareanu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Logic in Computer Science (cs.LO)

[1639] arXiv:2403.19839 (cross-list from cs.LG) [pdf, html, other]

Title: The New Agronomists: Language Models are Experts in Crop Management

Jing Wu, Zhixin Lai, Suiyao Chen, Ran Tao, Pan Zhao, Naira Hovakimyan

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1640] arXiv:2403.19995 (cross-list from cs.AI) [pdf, html, other]

Title: Development of Compositionality and Generalization through Interactive Learning of Language and Action of Robots

Prasanna Vijayaraghavan, Jeffrey Frederic Queisser, Sergio Verduzco Flores, Jun Tani

Comments: 64 pages, 6 figures, 10 supplementary figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1641] arXiv:2403.20014 (cross-list from cs.DB) [pdf, html, other]

Title: PURPLE: Making a Large Language Model a Better SQL Writer

Tonghui Ren, Yuankai Fan, Zhenying He, Ren Huang, Jiaqi Dai, Can Huang, Yinan Jing, Kai Zhang, Yifan Yang, X.Sean Wang

Comments: 12 pages, accepted by ICDE 2024 (40th IEEE International Conference on Data Engineering)

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1642] arXiv:2403.20026 (cross-list from cs.CV) [pdf, html, other]

Title: FSMR: A Feature Swapping Multi-modal Reasoning Approach with Joint Textual and Visual Clues

Shuang Li, Jiahua Wang, Lijie Wen

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1643] arXiv:2403.20184 (cross-list from eess.AS) [pdf, html, other]

Title: Exploring Pathological Speech Quality Assessment with ASR-Powered Wav2Vec2 in Data-Scarce Context

Tuan Nguyen, Corinne Fredouille, Alain Ghio, Mathieu Balaguer, Virginie Woisard

Comments: Accepted at LREC-COLING 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1644] arXiv:2403.20222 (cross-list from cs.IR) [pdf, html, other]

Title: Shallow Cross-Encoders for Low-Latency Retrieval

Aleksandr V. Petrov, Sean MacAvaney, Craig Macdonald

Comments: Accepted by ECIR2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1645] arXiv:2403.20331 (cross-list from cs.CV) [pdf, html, other]

Title: Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models

Atsuyuki Miyai, Jingkang Yang, Jingyang Zhang, Yifei Ming, Qing Yu, Go Irie, Yixuan Li, Hai Li, Ziwei Liu, Kiyoharu Aizawa

Comments: Code: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)