Computation and Language

Authors and titles for May 2024

[1401] arXiv:2405.14905 (cross-list from eess.IV) [pdf, other]

Title: Structural Entities Extraction and Patient Indications Incorporation for Chest X-ray Report Generation

Kang Liu, Zhuoqi Ma, Xiaolu Kang, Zhusi Zhong, Zhicheng Jiao, Grayson Baird, Harrison Bai, Qiguang Miao

Comments: The code is available at this https URL or this https URL

Subjects: Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1402] arXiv:2405.14908 (cross-list from cs.LG) [pdf, html, other]

Title: BiMix: A Bivariate Data Mixing Law for Language Model Pretraining

Ce Ge, Zhijian Ma, Daoyuan Chen, Yaliang Li, Bolin Ding

Comments: Clarify details

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1403] arXiv:2405.14917 (cross-list from cs.LG) [pdf, html, other]

Title: SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models

Wei Huang, Haotong Qin, Yangdong Liu, Yawei Li, Xianglong Liu, Luca Benini, Michele Magno, Xiaojuan Qi

Comments: 22 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1404] arXiv:2405.14974 (cross-list from cs.CV) [pdf, html, other]

Title: LOVA3: Learning to Visual Question Answering, Asking and Assessment

Henry Hengyuan Zhao, Pan Zhou, Difei Gao, Zechen Bai, Mike Zheng Shou

Comments: NeurIPS 2024. The code is available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1405] arXiv:2405.14982 (cross-list from cs.LG) [pdf, html, other]

Title: In-context Time Series Predictor

Jiecheng Lu, Yan Sun, Shihao Yang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1406] arXiv:2405.15025 (cross-list from cs.LG) [pdf, html, other]

Title: OAC: Output-adaptive Calibration for Accurate Post-training Quantization

Ali Edalati (1), Alireza Ghaffari (1 and 2), Masoud Asgharian (2), Lu Hou (1), Boxing Chen (1), Vahid Partovi Nia (1) ((1) Huawei Noah's Ark Lab, (2) Department of Mathematics and Statistics, McGill University)

Comments: 20 pages, 4 figures

Journal-ref: Proceedings of the AAAI Conference on Artificial Intelligence 2025

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1407] arXiv:2405.15092 (cross-list from cs.AI) [pdf, html, other]

Title: Dissociation of Faithful and Unfaithful Reasoning in LLMs

Evelyn Yee, Alice Li, Chenyu Tang, Yeon Ho Jung, Ramamohan Paturi, Leon Bergen

Comments: code published at this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1408] arXiv:2405.15115 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Better Understanding of In-Context Learning Ability from In-Context Uncertainty Quantification

Shang Liu, Zhongze Cai, Guanting Chen, Xiaocheng Li

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1409] arXiv:2405.15130 (cross-list from cs.SE) [pdf, html, other]

Title: OptLLM: Optimal Assignment of Queries to Large Language Models

Yueyue Liu, Hongyu Zhang, Yuantian Miao, Van-Hoang Le, Zhiqiang Li

Comments: This paper is accepted by ICWS 2024

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1410] arXiv:2405.15143 (cross-list from cs.LG) [pdf, other]

Title: Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models

Cong Lu, Shengran Hu, Jeff Clune

Comments: Published as a conference paper at ICLR 2025

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1411] arXiv:2405.15145 (cross-list from cs.AI) [pdf, html, other]

Title: CulturePark: Boosting Cross-cultural Understanding in Large Language Models

Cheng Li, Damien Teney, Linyi Yang, Qingsong Wen, Xing Xie, Jindong Wang

Comments: NeurIPS 2024; Code is released at this https URL. arXiv admin note: substantial text overlap with arXiv:2402.10946

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[1412] arXiv:2405.15189 (cross-list from cs.SE) [pdf, other]

Title: EffiLearner: Enhancing Efficiency of Generated Code via Self-Optimization

Dong Huang, Jianbo Dai, Han Weng, Puzhen Wu, Yuhao Qing, Heming Cui, Zhijiang Guo, Jie M.Zhang

Comments: Accepted by NeurIPS 2024

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1413] arXiv:2405.15216 (cross-list from cs.LG) [pdf, html, other]

Title: Denoising LM: Pushing the Limits of Error Correction Models for Speech Recognition

Zijin Gu, Tatiana Likhomanenko, He Bai, Erik McDermott, Ronan Collobert, Navdeep Jaitly

Comments: under review

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1414] arXiv:2405.15232 (cross-list from cs.CV) [pdf, html, other]

Title: DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perception

Run Luo, Yunshui Li, Longze Chen, Wanwei He, Ting-En Lin, Ziqiang Liu, Lei Zhang, Zikai Song, Xiaobo Xia, Tongliang Liu, Min Yang, Binyuan Hui

Comments: 25 pages. arXiv admin note: text overlap with arXiv:2401.10208 by other authors

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1415] arXiv:2405.15302 (cross-list from cs.AI) [pdf, html, other]

Title: The Buffer Mechanism for Multi-Step Information Reasoning in Language Models

Zhiwei Wang, Yunji Wang, Zhongwang Zhang, Zhangchen Zhou, Hui Jin, Tianyang Hu, Jiacheng Sun, Zhenguo Li, Yaoyu Zhang, Zhi-Qin John Xu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1416] arXiv:2405.15362 (cross-list from cs.LG) [pdf, html, other]

Title: Pipeline Parallelism with Controllable Memory

Penghui Qi, Xinyi Wan, Nyamdavaa Amar, Min Lin

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

[1417] arXiv:2405.15374 (cross-list from cs.IR) [pdf, html, other]

Title: Leveraging Large Language Models for Semantic Query Processing in a Scholarly Knowledge Graph

Runsong Jia, Bowen Zhang, Sergio J. Rodríguez Méndez, Pouya G. Omran

Comments: for the associated repository, see this http URL

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1418] arXiv:2405.15485 (cross-list from cs.AI) [pdf, html, other]

Title: Learning Beyond Pattern Matching? Assaying Mathematical Understanding in LLMs

Siyuan Guo, Aniket Didolkar, Nan Rosemary Ke, Anirudh Goyal, Ferenc Huszár, Bernhard Schölkopf

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1419] arXiv:2405.15556 (cross-list from cs.LG) [pdf, html, other]

Title: Certifiably Robust RAG against Retrieval Corruption

Chong Xiang, Tong Wu, Zexuan Zhong, David Wagner, Danqi Chen, Prateek Mittal

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1420] arXiv:2405.15638 (cross-list from cs.CV) [pdf, html, other]

Title: M4U: Evaluating Multilingual Understanding and Reasoning for Large Multimodal Models

Hongyu Wang, Jiayu Xu, Senwei Xie, Ruiping Wang, Jialin Li, Zhaojie Xie, Bin Zhang, Chuyan Xiong, Xilin Chen

Comments: Work in progress

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1421] arXiv:2405.15683 (cross-list from cs.CV) [pdf, html, other]

Title: Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs

Sreyan Ghosh, Chandra Kiran Reddy Evuru, Sonal Kumar, Utkarsh Tyagi, Oriol Nieto, Zeyu Jin, Dinesh Manocha

Comments: Accepted to ICLR 2025. Project: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1422] arXiv:2405.15729 (cross-list from cs.SE) [pdf, html, other]

Title: Optimizing Large Language Models for OpenAPI Code Completion

Bohdan Petryshyn, Mantas Lukoševičius

Comments: Update: a better quality and readability of figures, better explanation of code infilling and document splitting in training, some text polishing, making it more compact

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1423] arXiv:2405.15766 (cross-list from cs.AI) [pdf, html, other]

Title: Enhancing Adverse Drug Event Detection with Multimodal Dataset: Corpus Creation and Model Development

Pranab Sahoo, Ayush Kumar Singh, Sriparna Saha, Aman Chadha, Samrat Mondal

Comments: ACL Findings 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1424] arXiv:2405.15784 (cross-list from cs.IR) [pdf, html, other]

Title: CLARINET: Augmenting Language Models to Ask Clarification Questions for Retrieval

Yizhou Chi, Jessy Lin, Kevin Lin, Dan Klein

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1425] arXiv:2405.15787 (cross-list from cs.IR) [pdf, other]

Title: Extracting chemical food safety hazards from the scientific literature automatically using large language models

Neris Özen, Wenjuan Mu, Esther D. van Asselt, Leonieke M. van den Bulk

Comments: 31 pages, 5 figures

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1426] arXiv:2405.15793 (cross-list from cs.SE) [pdf, other]

Title: SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering

John Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, Ofir Press

Comments: Code, data, and demo available at this https URL

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[1427] arXiv:2405.15877 (cross-list from cs.LG) [pdf, html, other]

Title: Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications

Yang Li, Changsheng Zhao, Hyungtak Lee, Ernie Chang, Yangyang Shi, Vikas Chandra

Subjects: Machine Learning (cs.LG); Hardware Architecture (cs.AR); Computation and Language (cs.CL)

[1428] arXiv:2405.15902 (cross-list from cs.CR) [pdf, html, other]

Title: Hacc-Man: An Arcade Game for Jailbreaking LLMs

Matheus Valentim, Jeanette Falk, Nanna Inie

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1429] arXiv:2405.15943 (cross-list from cs.LG) [pdf, html, other]

Title: Transformers represent belief state geometry in their residual stream

Adam S. Shai, Sarah E. Marzen, Lucas Teixeira, Alexander Gietelink Oldenziel, Paul M. Riechers

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1430] arXiv:2405.15973 (cross-list from cs.CV) [pdf, html, other]

Title: Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-Improvement

Xiyao Wang, Jiuhai Chen, Zhaoyang Wang, Yuhang Zhou, Yiyang Zhou, Huaxiu Yao, Tianyi Zhou, Tom Goldstein, Parminder Bhatia, Furong Huang, Cao Xiao

Comments: NAACL 2025 Findings

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1431] arXiv:2405.16043 (cross-list from cs.LG) [pdf, html, other]

Title: Theoretical Analysis of Weak-to-Strong Generalization

Hunter Lang, David Sontag, Aravindan Vijayaraghavan

Comments: 36 pages, 3 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1432] arXiv:2405.16122 (cross-list from cs.AI) [pdf, html, other]

Title: Prompt Optimization with EASE? Efficient Ordering-aware Automated Selection of Exemplars

Zhaoxuan Wu, Xiaoqiang Lin, Zhongxiang Dai, Wenyang Hu, Yao Shu, See-Kiong Ng, Patrick Jaillet, Bryan Kian Hsiang Low

Comments: 28 pages, 1 figure, 35 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)

[1433] arXiv:2405.16128 (cross-list from cs.AI) [pdf, html, other]

Title: How Well Do Deep Learning Models Capture Human Concepts? The Case of the Typicality Effect

Siddhartha K. Vemuri, Raj Sanjay Shah, Sashank Varma

Comments: To appear at CogSci 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1434] arXiv:2405.16136 (cross-list from cs.AI) [pdf, html, other]

Title: C3LLM: Conditional Multimodal Content Generation Using Large Language Models

Zixuan Wang, Qinkai Duan, Yu-Wing Tai, Chi-Keung Tang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1435] arXiv:2405.16205 (cross-list from cs.AI) [pdf, other]

Title: GeneAgent: Self-verification Language Agent for Gene Set Knowledge Discovery using Domain Databases

Zhizheng Wang, Qiao Jin, Chih-Hsuan Wei, Shubo Tian, Po-Ting Lai, Qingqing Zhu, Chi-Ping Day, Christina Ross, Zhiyong Lu

Comments: 30 pages with 10 figures and/or tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1436] arXiv:2405.16247 (cross-list from cs.AI) [pdf, html, other]

Title: AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learning

Minghao Chen, Yihang Li, Yanting Yang, Shiyu Yu, Binbin Lin, Xiaofei He

Comments: Accepted at NeurIPS 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1437] arXiv:2405.16406 (cross-list from cs.LG) [pdf, other]

Title: SpinQuant: LLM quantization with learned rotations

Zechun Liu, Changsheng Zhao, Igor Fedorov, Bilge Soran, Dhruv Choudhary, Raghuraman Krishnamoorthi, Vikas Chandra, Yuandong Tian, Tijmen Blankevoort

Comments: ICLR 2025

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1438] arXiv:2405.16411 (cross-list from cs.LG) [pdf, html, other]

Title: Tensor Attention Training: Provably Efficient Learning of Higher-order Transformers

Yingyu Liang, Zhenmei Shi, Zhao Song, Yufa Zhou

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1439] arXiv:2405.16413 (cross-list from cs.AI) [pdf, html, other]

Title: Augmented Risk Prediction for the Onset of Alzheimer's Disease from Electronic Health Records with Large Language Models

Jiankun Wang, Sumyeong Ahn, Taykhoom Dalal, Xiaodan Zhang, Weishen Pan, Qiannan Zhang, Bin Chen, Hiroko H. Dodge, Fei Wang, Jiayu Zhou

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Applications (stat.AP)

[1440] arXiv:2405.16434 (cross-list from cs.AI) [pdf, html, other]

Title: The Importance of Directional Feedback for LLM-based Optimizers

Allen Nie, Ching-An Cheng, Andrey Kolobov, Adith Swaminathan

Comments: Accepted and Presented at Foundation Models for Decision Making at NeurIPS 2023 (December 15, 2023). Work completed from June 2023 to September 2023

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)

[1441] arXiv:2405.16442 (cross-list from cs.CY) [pdf, other]

Title: Development of an open education resources (OER) system: a comparative analysis and implementation approach

Nimol Thuon, Wangrui Zhang

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL)

[1442] arXiv:2405.16473 (cross-list from cs.CV) [pdf, html, other]

Title: M$^3$CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought

Qiguang Chen, Libo Qin, Jin Zhang, Zhi Chen, Xiao Xu, Wanxiang Che

Comments: Accepted at ACL2024 Main Conference

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1443] arXiv:2405.16510 (cross-list from cs.AI) [pdf, html, other]

Title: Planning with Multi-Constraints via Collaborative Language Agents

Cong Zhang, Derrick Goh Xin Deik, Dexun Li, Hao Zhang, Yong Liu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1444] arXiv:2405.16528 (cross-list from cs.LG) [pdf, html, other]

Title: LoQT: Low-Rank Adapters for Quantized Pretraining

Sebastian Loeschcke, Mads Toftrup, Michael J. Kastoryano, Serge Belongie, Vésteinn Snæbjarnarson

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1445] arXiv:2405.16546 (cross-list from cs.IR) [pdf, html, other]

Title: Cocktail: A Comprehensive Information Retrieval Benchmark with LLM-Generated Documents Integration

Sunhao Dai, Weihao Liu, Yuqi Zhou, Liang Pang, Rongju Ruan, Gang Wang, Zhenhua Dong, Jun Xu, Ji-Rong Wen

Comments: Accepted by Findings of ACL 2024; Datasets Link: this https URL

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1446] arXiv:2405.16640 (cross-list from cs.AI) [pdf, html, other]

Title: A Survey of Multimodal Large Language Model from A Data-centric Perspective

Tianyi Bai, Hao Liang, Binwang Wan, Yanran Xu, Xi Li, Shiyu Li, Ling Yang, Bozhou Li, Yifan Wang, Bin Cui, Ping Huang, Jiulong Shan, Conghui He, Binhang Yuan, Wentao Zhang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[1447] arXiv:2405.16662 (cross-list from cs.LO) [pdf, html, other]

Title: Conjunctive categorial grammars and Lambek grammars with additives

Stepan L. Kuznetsov, Alexander Okhotin

Comments: This article is an extended version of the conference presentation "Conjunctive categorial grammars" at the Mathematics of Language 2017 meeting (London, UK, July 13-14, 2017; proceedings published in ACL Anthology, W17-3414)

Subjects: Logic in Computer Science (cs.LO); Computation and Language (cs.CL); Logic (math.LO)

[1448] arXiv:2405.16669 (cross-list from cs.HC) [pdf, html, other]

Title: Low-resourced Languages and Online Knowledge Repositories: A Need-Finding Study

Hellina Hailu Nigatu, John Canny, Sarah E. Chasins

Comments: In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI 2024)

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1449] arXiv:2405.16677 (cross-list from eess.AS) [pdf, html, other]

Title: Crossmodal ASR Error Correction with Discrete Speech Units

Yuanchao Li, Pinzhen Chen, Peter Bell, Catherine Lai

Comments: Accepted to IEEE SLT 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1450] arXiv:2405.16682 (cross-list from cs.LG) [pdf, html, other]

Title: A Systematic Review of Federated Generative Models

Ashkan Vedadi Gargary, Emiliano De Cristofaro

Comments: 24 Pages, 3 Figures, 5 Tables

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1451] arXiv:2405.16700 (cross-list from cs.CV) [pdf, html, other]

Title: Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs

Mustafa Shukor, Matthieu Cord

Comments: NeurIPS 2024. Code: this https URL. Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1452] arXiv:2405.16712 (cross-list from cs.LG) [pdf, html, other]

Title: Zamba: A Compact 7B SSM Hybrid Model

Paolo Glorioso, Quentin Anthony, Yury Tokpanov, James Whittington, Jonathan Pilault, Adam Ibrahim, Beren Millidge

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1453] arXiv:2405.16751 (cross-list from cs.AI) [pdf, html, other]

Title: REVECA: Adaptive Planning and Trajectory-based Validation in Cooperative Language Agents using Information Relevance and Relative Proximity

SeungWon Seo, SeongRae Noh, Junhyeok Lee, SooBin Lim, Won Hee Lee, HyeongYeop Kang

Comments: v2 is the AAAI'25 camera-ready version, including the appendix, which has been enhanced based on the reviewers' comments

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multiagent Systems (cs.MA)

[1454] arXiv:2405.16845 (cross-list from cs.LG) [pdf, other]

Title: On Mesa-Optimization in Autoregressively Trained Transformers: Emergence and Capability

Chenyu Zheng, Wei Huang, Rongzhen Wang, Guoqiang Wu, Jun Zhu, Chongxuan Li

Comments: Accepted by NeurIPS2024, 45 pages. The final version of the previous preprint

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1455] arXiv:2405.16869 (cross-list from cs.AI) [pdf, html, other]

Title: Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learning

Yichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu, Binbin Hu, Ziqi Liu, Wen Zhang, Huajun Chen

Comments: ICLR 2025 Camera-ready Version. Fix a caption typo in the current version

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1456] arXiv:2405.16919 (cross-list from cs.CV) [pdf, html, other]

Title: VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models

Zejun Li, Ruipu Luo, Jiwen Zhang, Minghui Qiu, Xuanjing Huang, Zhongyu Wei

Comments: Accepted by NAACL 2025 main conference

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1457] arXiv:2405.16994 (cross-list from cs.AI) [pdf, html, other]

Title: Vision-and-Language Navigation Generative Pretrained Transformer

Wen Hanlin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

[1458] arXiv:2405.17044 (cross-list from cs.AI) [pdf, html, other]

Title: Interesting Scientific Idea Generation using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaders

Xuemei Gu, Mario Krenn

Comments: 8 pages; 4 figures; Appendix: 6 pages, 5 figures, 2 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Digital Libraries (cs.DL); Machine Learning (cs.LG)

[1459] arXiv:2405.17076 (cross-list from cs.AI) [pdf, html, other]

Title: Leveraging small language models for Text2SPARQL tasks to improve the resilience of AI assistance

Felix Brei, Johannes Frey, Lars-Peter Meyer

Comments: To appear in Proceedings of the Workshop on Linked Data-driven Resilience Research 2024 (D2R2) co-located with Extended Semantic Web Conference 2024 (ESWC 2024)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1460] arXiv:2405.17088 (cross-list from cs.LG) [pdf, html, other]

Title: Phase Transitions in the Output Distribution of Large Language Models

Julian Arnold, Flemming Holtorf, Frank Schäfer, Niels Lörch

Comments: 21 pages, 4 figures

Subjects: Machine Learning (cs.LG); Statistical Mechanics (cond-mat.stat-mech); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1461] arXiv:2405.17104 (cross-list from cs.CV) [pdf, html, other]

Title: LLM-Optic: Unveiling the Capabilities of Large Language Models for Universal Visual Grounding

Haoyu Zhao, Wenhang Ge, Ying-cong Chen

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1462] arXiv:2405.17130 (cross-list from cs.LG) [pdf, html, other]

Title: Exploiting the Layered Intrinsic Dimensionality of Deep Models for Practical Adversarial Training

Enes Altinisik, Safa Messaoud, Husrev Taha Sencar, Hassan Sajjad, Sanjay Chawla

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1463] arXiv:2405.17217 (cross-list from cs.HC) [pdf, html, other]

Title: Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools

Daniel Buschek

Comments: 19 pages, 7 figures, 2 tables, ACM DIS 2024

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1464] arXiv:2405.17345 (cross-list from cs.AI) [pdf, html, other]

Title: Exploring and steering the moral compass of Large Language Models

Alejandro Tlaie

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1465] arXiv:2405.17382 (cross-list from cs.LG) [pdf, html, other]

Title: ReMoDetect: Reward Models Recognize Aligned LLM's Generations

Hyunseok Lee, Jihoon Tack, Jinwoo Shin

Comments: Published as a conference proceeding for NeurIPS 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1466] arXiv:2405.17390 (cross-list from cs.IR) [pdf, other]

Title: KSW: Khmer Stop Word based Dictionary for Keyword Extraction

Nimol Thuon, Wangrui Zhang, Sada Thuon

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1467] arXiv:2405.17423 (cross-list from cs.CV) [pdf, html, other]

Title: Privacy-Aware Visual Language Models

Laurens Samson, Nimrod Barazani, Sennay Ghebreab, Yuki M. Asano

Comments: preprint

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1468] arXiv:2405.17430 (cross-list from cs.CV) [pdf, html, other]

Title: Matryoshka Multimodal Models

Mu Cai, Jianwei Yang, Jianfeng Gao, Yong Jae Lee

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1469] arXiv:2405.17440 (cross-list from cs.LG) [pdf, html, other]

Title: CataLM: Empowering Catalyst Design Through Large Language Models

Ludi Wang, Xueqing Chen, Yi Du, Yuanchun Zhou, Yang Gao, Wenjuan Cui

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1470] arXiv:2405.17441 (cross-list from cs.NI) [pdf, html, other]

Title: When Large Language Models Meet Optical Networks: Paving the Way for Automation

Danshi Wang, Yidi Wang, Xiaotian Jiang, Yao Zhang, Yue Pang, Min Zhang

Subjects: Networking and Internet Architecture (cs.NI); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Systems and Control (eess.SY)

[1471] arXiv:2405.17459 (cross-list from cs.LG) [pdf, other]

Title: Integrating Medical Imaging and Clinical Reports Using Multimodal Deep Learning for Advanced Disease Analysis

Ziyan Yao, Fei Lin, Sheng Chai, Weijie He, Lu Dai, Xinghui Fei

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1472] arXiv:2405.17470 (cross-list from cs.LG) [pdf, html, other]

Title: Athena: Efficient Block-Wise Post-Training Quantization for Large Language Models Using Second-Order Matrix Derivative Information

Yanshu Wang, Wenyang He, Tong Yang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1473] arXiv:2405.17475 (cross-list from cs.CV) [pdf, html, other]

Title: How Culturally Aware are Vision-Language Models?

Olena Burda-Lassen, Aman Chadha, Shashank Goswami, Vinija Jain

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1474] arXiv:2405.17503 (cross-list from cs.SE) [pdf, other]

Title: Code Repair with LLMs gives an Exploration-Exploitation Tradeoff

Hao Tang, Keya Hu, Jin Peng Zhou, Sicheng Zhong, Wei-Long Zheng, Xujie Si, Kevin Ellis

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Programming Languages (cs.PL)

[1475] arXiv:2405.17505 (cross-list from cs.LG) [pdf, html, other]

Title: Predicting Rental Price of Lane Houses in Shanghai with Machine Learning Methods and Large Language Models

Tingting Chen, Shijing Si

Comments: 13 pages, 11 figures, 39 references

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1476] arXiv:2405.17537 (cross-list from cs.AI) [pdf, html, other]

Title: CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale

ZeMing Gong, Austin T. Wang, Xiaoliang Huo, Joakim Bruslund Haurum, Scott C. Lowe, Graham W. Taylor, Angel X. Chang

Comments: 31 pages with 14 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1477] arXiv:2405.17587 (cross-list from cs.IR) [pdf, html, other]

Title: RAGSys: Item-Cold-Start Recommender as RAG System

Emile Contal, Garrin McGoldrick

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1478] arXiv:2405.17604 (cross-list from cs.LG) [pdf, html, other]

Title: LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters

Klaudia Bałazy, Mohammadreza Banaei, Karl Aberer, Jacek Tabor

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1479] arXiv:2405.17613 (cross-list from cs.CV) [pdf, html, other]

Title: Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning

Divyam Madaan, Taro Makino, Sumit Chopra, Kyunghyun Cho

Comments: Accepted to NeurIPS 2024. Code available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1480] arXiv:2405.17653 (cross-list from cs.LG) [pdf, html, other]

Title: InversionView: A General-Purpose Method for Reading Information from Neural Activations

Xinting Huang, Madhur Panwar, Navin Goyal, Michael Hahn

Comments: NeurIPS 2024; ICML 2024 Mechanistic Interpretability Workshop oral

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1481] arXiv:2405.17658 (cross-list from cs.IR) [pdf, html, other]

Title: Generative Query Reformulation Using Ensemble Prompting, Document Fusion, and Relevance Feedback

Kaustubh D. Dhole, Ramraj Chandradevan, Eugene Agichtein

Comments: Extended Work of GenQREnsemble: Zero-Shot LLM Ensemble Prompting for Generative Query Reformulation, Dhole and Agichtein, ECIR 2024. arXiv admin note: text overlap with arXiv:2404.03746

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1482] arXiv:2405.17703 (cross-list from cs.LG) [pdf, html, other]

Title: Mechanistic Interpretability of Binary and Ternary Transformers

Jason Li

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1483] arXiv:2405.17710 (cross-list from cs.SI) [pdf, html, other]

Title: Does Geo-co-location Matter? A Case Study of Public Health Conversations during COVID-19

Paiheng Xu, Louiqa Raschid, Vanessa Frias-Martinez

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL)

[1484] arXiv:2405.17767 (cross-list from cs.LG) [pdf, html, other]

Title: Linguistic Collapse: Neural Collapse in (Large) Language Models

Robert Wu, Vardan Papyan

Comments: NeurIPS 2024; 35 pages; 30 figures; reverted to log mean norms for NC2

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1485] arXiv:2405.17799 (cross-list from cs.LG) [pdf, html, other]

Title: Exploring Activation Patterns of Parameters in Language Models

Yudong Wang, Damai Dai, Zhifang Sui

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1486] arXiv:2405.17849 (cross-list from cs.LG) [pdf, html, other]

Title: I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models

Xing Hu, Yuan Cheng, Dawei Yang, Zhihang Yuan, Jiangyong Yu, Chen Xu, Sifan Zhou

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1487] arXiv:2405.17871 (cross-list from cs.CV) [pdf, html, other]

Title: Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment

Xin Xiao, Bohong Wu, Jiacong Wang, Chunyuan Li, Xun Zhou, Haoyuan Guo

Comments: NeurlPS 2024, Camera ready

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1488] arXiv:2405.17890 (cross-list from cs.IR) [pdf, html, other]

Title: SLMRec: Distilling Large Language Models into Small for Sequential Recommendation

Wujiang Xu, Qitian Wu, Zujie Liang, Jiaojiao Han, Xuying Ning, Yunxiao Shi, Wenfang Lin, Yongfeng Zhang

Comments: International Conference on Learning Representations (ICLR 2025)

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1489] arXiv:2405.17902 (cross-list from cs.AI) [pdf, html, other]

Title: Boosting Protein Language Models with Negative Sample Mining

Yaoyao Xu, Xinjian Zhao, Xiaozhuang Song, Benyou Wang, Tianshu Yu

Comments: 16 pages, 4 figures. Accepted by ECML-PKDD 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1490] arXiv:2405.17927 (cross-list from cs.AI) [pdf, html, other]

Title: The Evolution of Multimodal Model Architectures

Shakti N. Wadekar, Abhishek Chaurasia, Aman Chadha, Eugenio Culurciello

Comments: 30 pages, 6 tables, 7 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1491] arXiv:2405.17976 (cross-list from cs.AI) [pdf, other]

Title: Yuan 2.0-M32: Mixture of Experts with Attention Router

Shaohua Wu, Jiangang Luo, Xi Chen, Lingjun Li, Xudong Zhao, Tong Yu, Chao Wang, Yue Wang, Fei Wang, Weixu Qiao, Houbo He, Zeru Zhang, Zeyu Sun, Junxiong Mao, Chong Shen

Comments: 14 pages,3 figures, 7 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1492] arXiv:2405.17998 (cross-list from cs.IR) [pdf, html, other]

Title: Source Echo Chamber: Exploring the Escalation of Source Bias in User, Data, and Recommender System Feedback Loop

Yuqi Zhou, Sunhao Dai, Liang Pang, Gang Wang, Zhenhua Dong, Jun Xu, Ji-Rong Wen

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1493] arXiv:2405.18208 (cross-list from cs.AI) [pdf, html, other]

Title: A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Models

Chengxing Xie, Difan Zou

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1494] arXiv:2405.18258 (cross-list from cs.CV) [pdf, html, other]

Title: Text-only Synthesis for Image Captioning

Qing Zhou, Junlin Huang, Qiang Li, Junyu Gao, Qi Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1495] arXiv:2405.18320 (cross-list from cs.CV) [pdf, html, other]

Title: Self-Supervised Learning Based Handwriting Verification

Mihir Chauhan, Mohammad Abuzar Hashemi, Abhishek Satbhai, Mir Basheer Ali, Bina Ramamurthy, Mingchen Gao, Siwei Lyu, Sargur Srihari

Comments: 8 pages, 2 figures, 2 tables, Accepted at Irish Machine Vision and Image Processing Conference 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1496] arXiv:2405.18380 (cross-list from cs.LG) [pdf, html, other]

Title: OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning

Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei Liu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1497] arXiv:2405.18406 (cross-list from cs.CV) [pdf, html, other]

Title: RACCooN: A Versatile Instructional Video Editing Framework with Auto-Generated Narratives

Jaehong Yoon, Shoubin Yu, Mohit Bansal

Comments: The first two authors contribute equally. Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1498] arXiv:2405.18415 (cross-list from cs.CV) [pdf, html, other]

Title: Why are Visually-Grounded Language Models Bad at Image Classification?

Yuhui Zhang, Alyssa Unell, Xiaohan Wang, Dhruba Ghosh, Yuchang Su, Ludwig Schmidt, Serena Yeung-Levy

Comments: Published at NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1499] arXiv:2405.18542 (cross-list from cs.AI) [pdf, html, other]

Title: Automatic detection of cognitive impairment in elderly people using an entertainment chatbot with Natural Language Processing capabilities

Francisco de Arriba-Pérez, Silvia García-Méndez, Francisco J. González-Castaño, Enrique Costa-Montenegro

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[1500] arXiv:2405.18570 (cross-list from cs.CV) [pdf, html, other]

Title: It's Not a Modality Gap: Characterizing and Addressing the Contrastive Gap

Abrar Fahim, Alex Murphy, Alona Fyshe

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)