Computation and Language

Authors and titles for March 2024

[1601] arXiv:2403.17919 (cross-list from cs.LG) [pdf, html, other]

Title: LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning

Rui Pan, Xiang Liu, Shizhe Diao, Renjie Pi, Jipeng Zhang, Chi Han, Tong Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Optimization and Control (math.OC)

[1602] arXiv:2403.18063 (cross-list from cs.CV) [pdf, html, other]

Title: Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis

Badri N. Patro, Suhas Ranganath, Vinay P. Namboodiri, Vijay S. Agneeswaran

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1603] arXiv:2403.18120 (cross-list from cs.AI) [pdf, html, other]

Title: Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization

Jin Peng Zhou, Charles Staats, Wenda Li, Christian Szegedy, Kilian Q. Weinberger, Yuhuai Wu

Comments: ICLR 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1604] arXiv:2403.18159 (cross-list from cs.LG) [pdf, html, other]

Title: Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models

Kartikeya Bhardwaj, Nilesh Prasad Pandey, Sweta Priyadarshi, Kyunggeun Lee, Jun Ma, Harris Teague

Comments: Accepted at Practical ML for Low Resource Settings Workshop at ICLR 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1605] arXiv:2403.18252 (cross-list from cs.CV) [pdf, html, other]

Title: Beyond Embeddings: The Promise of Visual Table in Visual Reasoning

Yiwu Zhong, Zi-Yuan Hu, Michael R. Lyu, Liwei Wang

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1606] arXiv:2403.18260 (cross-list from cs.CV) [pdf, html, other]

Title: Toward Interactive Regional Understanding in Vision-Large Language Models

Jungbeom Lee, Sanghyuk Chun, Sangdoo Yun

Comments: NAACL 2024 Main Conference

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1607] arXiv:2403.18276 (cross-list from cs.IR) [pdf, html, other]

Title: RankMamba: Benchmarking Mamba's Document Ranking Performance in the Era of Transformers

Zhichao Xu

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1608] arXiv:2403.18406 (cross-list from cs.CV) [pdf, html, other]

Title: An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM

Wonkyun Kim, Changin Choi, Wonseok Lee, Wonjong Rhee

Comments: Our code is available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1609] arXiv:2403.18435 (cross-list from cs.IR) [pdf, html, other]

Title: DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment

Haitao Li, Qingyao Ai, Xinyan Han, Jia Chen, Qian Dong, Yiqun Liu, Chong Chen, Qi Tian

Comments: 11 pages

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1610] arXiv:2403.18525 (cross-list from cs.CV) [pdf, html, other]

Title: Language Plays a Pivotal Role in the Object-Attribute Compositional Generalization of CLIP

Reza Abbasi, Mohammad Samiei, Mohammad Hossein Rohban, Mahdieh Soleymani Baghshah

Comments: Oral accepted at OODCV 2023(this http URL)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1611] arXiv:2403.18537 (cross-list from cs.AI) [pdf, other]

Title: A Path Towards Legal Autonomy: An interoperable and explainable approach to extracting, transforming, loading and computing legal information using large language models, expert systems and Bayesian networks

Axel Constant, Hannes Westermann, Bryan Wilson, Alex Kiefer, Ines Hipolito, Sylvain Pronovost, Steven Swanson, Mahault Albarracin, Maxwell J.D. Ramstead

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Logic in Computer Science (cs.LO)

[1612] arXiv:2403.18591 (cross-list from cs.LO) [pdf, html, other]

Title: Safety Verification of Wait-Only Non-Blocking Broadcast Protocols

Lucie Guillou, Arnaud Sangnier, Nathalie Sznajder

Comments: Long version of a paper accepted to PetriNets 2024

Subjects: Logic in Computer Science (cs.LO); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[1613] arXiv:2403.18609 (cross-list from cs.NE) [pdf, html, other]

Title: A survey on learning models of spiking neural membrane systems and spiking neural networks

Prithwineel Paul, Petr Sosik, Lucie Ciencialova

Subjects: Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL)

[1614] arXiv:2403.18624 (cross-list from cs.SE) [pdf, html, other]

Title: Vulnerability Detection with Code Language Models: How Far Are We?

Yangruibo Ding, Yanjun Fu, Omniyyah Ibrahim, Chawin Sitawarin, Xinyun Chen, Basel Alomair, David Wagner, Baishakhi Ray, Yizheng Chen

Comments: Accepted for the 47th IEEE/ACM International Conference on Software Engineering (ICSE 2025); Camera-ready Work in Progress

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1615] arXiv:2403.18667 (cross-list from cs.IR) [pdf, html, other]

Title: Improving Content Recommendation: Knowledge Graph-Based Semantic Contrastive Learning for Diversity and Cold-Start Users

Yejin Kim, Scott Rome, Kevin Foley, Mayur Nankani, Rimon Melamed, Javier Morales, Abhay Yadav, Maria Peifer, Sardar Hamidian, H. Howie Huang

Comments: Accepted at LREC-COLING 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1616] arXiv:2403.18684 (cross-list from cs.IR) [pdf, html, other]

Title: Scaling Laws For Dense Retrieval

Yan Fang, Jingtao Zhan, Qingyao Ai, Jiaxin Mao, Weihang Su, Jia Chen, Yiqun Liu

Comments: Accepted at SIGIR 2024. V2 fixes a bug in the experiments

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1617] arXiv:2403.18715 (cross-list from cs.CV) [pdf, html, other]

Title: Mitigating Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding

Xintong Wang, Jingheng Pan, Liang Ding, Chris Biemann

Comments: Accepted to Findings of ACL 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1618] arXiv:2403.18746 (cross-list from cs.SE) [pdf, html, other]

Title: CYCLE: Learning to Self-Refine the Code Generation

Yangruibo Ding, Marcus J. Min, Gail Kaiser, Baishakhi Ray

Comments: Camera-ready for OOPSLA'24

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1619] arXiv:2403.18814 (cross-list from cs.CV) [pdf, html, other]

Title: Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models

Yanwei Li, Yuechen Zhang, Chengyao Wang, Zhisheng Zhong, Yixin Chen, Ruihang Chu, Shaoteng Liu, Jiaya Jia

Comments: Code and models are available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1620] arXiv:2403.18843 (cross-list from cs.CV) [pdf, html, other]

Title: JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition

Chang Sun, Hong Yang, Bo Qin

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1621] arXiv:2403.18872 (cross-list from cs.LG) [pdf, html, other]

Title: Targeted Visualization of the Backbone of Encoder LLMs

Isaac Roberts, Alexander Schulz, Luca Hermes, Barbara Hammer

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1622] arXiv:2403.18926 (cross-list from cs.LG) [pdf, html, other]

Title: XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection

Yuanhang Yang, Shiyi Qi, Wenchao Gu, Chaozheng Wang, Cuiyun Gao, Zenglin Xu

Comments: ACL2024 Findings

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1623] arXiv:2403.18957 (cross-list from cs.CY) [pdf, other]

Title: Moderating Illicit Online Image Promotion for Unsafe User-Generated Content Games Using Large Vision-Language Models

Keyan Guo, Ayush Utkarsh, Wenbo Ding, Isabelle Ondracek, Ziming Zhao, Guo Freeman, Nishant Vishwamitra, Hongxin Hu

Comments: To Appear in the 33rd USENIX Security Symposium, August 14-16, 2024

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[1624] arXiv:2403.19021 (cross-list from cs.IR) [pdf, html, other]

Title: IDGenRec: LLM-RecSys Alignment with Textual ID Learning

Juntao Tan, Shuyuan Xu, Wenyue Hua, Yingqiang Ge, Zelong Li, Yongfeng Zhang

Comments: Accepted in SIGIR 2024

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1625] arXiv:2403.19103 (cross-list from cs.CV) [pdf, html, other]

Title: Automated Black-box Prompt Engineering for Personalized Text-to-Image Generation

Yutong He, Alexander Robey, Naoki Murata, Yiding Jiang, Joshua Williams, George J. Pappas, Hamed Hassani, Yuki Mitsufuji, Ruslan Salakhutdinov, J. Zico Kolter

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1626] arXiv:2403.19114 (cross-list from cs.SE) [pdf, html, other]

Title: Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM

Chunqiu Steven Xia, Yinlin Deng, Lingming Zhang

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG); Programming Languages (cs.PL)

[1627] arXiv:2403.19181 (cross-list from cs.IR) [pdf, other]

Title: Make Large Language Model a Better Ranker

Wen-Shuo Chao, Zhi Zheng, Hengshu Zhu, Hao Liu

Comments: 12 pages, 5 figures

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1628] arXiv:2403.19201 (cross-list from cs.DL) [pdf, other]

Title: Understanding Archives: Towards New Research Interfaces Relying on the Semantic Annotation of Documents

Nicolas Gutehrlé (CRIT), Iana Atanassova (CRIT, STIH, TESNIERE, LaLIC)

Comments: in French language. CiDE.23: Document et archivage: pratiques formelles et informelles, Oct 2023, Grenoble, France

Subjects: Digital Libraries (cs.DL); Computation and Language (cs.CL)

[1629] arXiv:2403.19211 (cross-list from cs.LG) [pdf, html, other]

Title: Dual-Personalizing Adapter for Federated Foundation Models

Yiyuan Yang, Guodong Long, Tao Shen, Jing Jiang, Michael Blumenstein

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1630] arXiv:2403.19322 (cross-list from cs.CV) [pdf, html, other]

Title: Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models

Jiaxing Chen, Yuxuan Liu, Dehu Li, Xiang An, Weimo Deng, Ziyong Feng, Yongle Zhao, Yin Xie

Comments: 15 pages, 8 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1631] arXiv:2403.19423 (cross-list from cs.SI) [pdf, html, other]

Title: Echo-chambers and Idea Labs: Communication Styles on Twitter

Aleksandra Sorokovikova, Michael Becker, Ivan P. Yamshchikov

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL)

[1632] arXiv:2403.19634 (cross-list from cs.SD) [pdf, html, other]

Title: Asymmetric and trial-dependent modeling: the contribution of LIA to SdSV Challenge Task 2

Pierre-Michel Bousquet, Mickael Rouvier

Comments: LIA system description for the Short Duration Speaker Verification (SdSv) challenge 2020 Task 2

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1633] arXiv:2403.19647 (cross-list from cs.LG) [pdf, html, other]

Title: Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models

Samuel Marks, Can Rager, Eric J. Michaud, Yonatan Belinkov, David Bau, Aaron Mueller

Comments: Code and data at this https URL. Demonstration at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1634] arXiv:2403.19651 (cross-list from cs.CV) [pdf, html, other]

Title: MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions

Kai Zhang, Yi Luan, Hexiang Hu, Kenton Lee, Siyuan Qiao, Wenhu Chen, Yu Su, Ming-Wei Chang

Comments: ICML 2024 (Oral); Project Website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Multimedia (cs.MM)

[1635] arXiv:2403.19669 (cross-list from cs.LG) [pdf, html, other]

Title: Analyzing the Roles of Language and Vision in Learning from Limited Data

Allison Chen, Ilia Sucholutsky, Olga Russakovsky, Thomas L. Griffiths

Comments: 8 pages, 4 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1636] arXiv:2403.19709 (cross-list from eess.AS) [pdf, html, other]

Title: Hierarchical Recurrent Adapters for Efficient Multi-Task Adaptation of Large Speech Models

Tsendsuren Munkhdalai, Youzheng Chen, Khe Chai Sim, Fadi Biadsy, Tara Sainath, Pedro Moreno Mengibar

Comments: 5 pages, 3 figures, 5 tables

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

[1637] arXiv:2403.19758 (cross-list from quant-ph) [pdf, html, other]

Title: Quantum Natural Language Processing

Dominic Widdows, Willie Aboumrad, Dohun Kim, Sayonee Ray, Jonathan Mei

Subjects: Quantum Physics (quant-ph); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1638] arXiv:2403.19837 (cross-list from cs.LG) [pdf, html, other]

Title: Concept-based Analysis of Neural Networks via Vision-Language Models

Ravi Mangal, Nina Narodytska, Divya Gopinath, Boyue Caroline Hu, Anirban Roy, Susmit Jha, Corina Pasareanu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Logic in Computer Science (cs.LO)

[1639] arXiv:2403.19839 (cross-list from cs.LG) [pdf, html, other]

Title: The New Agronomists: Language Models are Experts in Crop Management

Jing Wu, Zhixin Lai, Suiyao Chen, Ran Tao, Pan Zhao, Naira Hovakimyan

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1640] arXiv:2403.19995 (cross-list from cs.AI) [pdf, html, other]

Title: Development of Compositionality and Generalization through Interactive Learning of Language and Action of Robots

Prasanna Vijayaraghavan, Jeffrey Frederic Queisser, Sergio Verduzco Flores, Jun Tani

Comments: 64 pages, 6 figures, 10 supplementary figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1641] arXiv:2403.20014 (cross-list from cs.DB) [pdf, html, other]

Title: PURPLE: Making a Large Language Model a Better SQL Writer

Tonghui Ren, Yuankai Fan, Zhenying He, Ren Huang, Jiaqi Dai, Can Huang, Yinan Jing, Kai Zhang, Yifan Yang, X.Sean Wang

Comments: 12 pages, accepted by ICDE 2024 (40th IEEE International Conference on Data Engineering)

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1642] arXiv:2403.20026 (cross-list from cs.CV) [pdf, html, other]

Title: FSMR: A Feature Swapping Multi-modal Reasoning Approach with Joint Textual and Visual Clues

Shuang Li, Jiahua Wang, Lijie Wen

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1643] arXiv:2403.20184 (cross-list from eess.AS) [pdf, html, other]

Title: Exploring Pathological Speech Quality Assessment with ASR-Powered Wav2Vec2 in Data-Scarce Context

Tuan Nguyen, Corinne Fredouille, Alain Ghio, Mathieu Balaguer, Virginie Woisard

Comments: Accepted at LREC-COLING 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1644] arXiv:2403.20222 (cross-list from cs.IR) [pdf, html, other]

Title: Shallow Cross-Encoders for Low-Latency Retrieval

Aleksandr V. Petrov, Sean MacAvaney, Craig Macdonald

Comments: Accepted by ECIR2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1645] arXiv:2403.20331 (cross-list from cs.CV) [pdf, html, other]

Title: Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models

Atsuyuki Miyai, Jingkang Yang, Jingyang Zhang, Yifei Ming, Qing Yu, Go Irie, Yixuan Li, Hai Li, Ziwei Liu, Kiyoharu Aizawa

Comments: Code: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)