Computation and Language

Authors and titles for May 2024

[1326] arXiv:2405.11273 (cross-list from cs.AI) [pdf, html, other]

Title: Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts

Yunxin Li, Shenyuan Jiang, Baotian Hu, Longyue Wang, Wanqi Zhong, Wenhan Luo, Lin Ma, Min Zhang

Comments: 22 pages, 13 figures. Project Website: this https URL. Working in progress

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[1327] arXiv:2405.11424 (cross-list from cs.DM) [pdf, html, other]

Title: Metric Dimension and Resolvability of Jaccard Spaces

Manuel E. Lladser, Alexander J. Paradise

Comments: 13 pages, 1 table

Subjects: Discrete Mathematics (cs.DM); Computation and Language (cs.CL); Combinatorics (math.CO); Probability (math.PR)

[1328] arXiv:2405.11441 (cross-list from cs.IR) [pdf, other]

Title: EmbSum: Leveraging the Summarization Capabilities of Large Language Models for Content-Based Recommendations

Chiyu Zhang, Yifei Sun, Minghao Wu, Jun Chen, Jie Lei, Muhammad Abdul-Mageed, Rong Jin, Angli Liu, Ji Zhu, Sem Park, Ning Yao, Bo Long

Comments: Accepted by RecSys 2024

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1329] arXiv:2405.11459 (cross-list from eess.SP) [pdf, html, other]

Title: Du-IN: Discrete units-guided mask modeling for decoding speech from Intracranial Neural signals

Hui Zheng, Hai-Teng Wang, Wei-Bang Jiang, Zhong-Tao Chen, Li He, Pei-Yang Lin, Peng-Hu Wei, Guo-Guang Zhao, Yun-Zhe Liu

Subjects: Signal Processing (eess.SP); Computation and Language (cs.CL); Neurons and Cognition (q-bio.NC)

[1330] arXiv:2405.11461 (cross-list from cs.IR) [pdf, html, other]

Title: DocReLM: Mastering Document Retrieval with Language Model

Gengchen Wei, Xinle Pang, Tianning Zhang, Yu Sun, Xun Qian, Chen Lin, Han-Sen Zhong, Wanli Ouyang

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1331] arXiv:2405.11582 (cross-list from cs.CV) [pdf, html, other]

Title: SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization

Jialong Guo, Xinghao Chen, Yehui Tang, Yunhe Wang

Comments: ICML 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1332] arXiv:2405.11640 (cross-list from cs.AI) [pdf, html, other]

Title: Inquire, Interact, and Integrate: A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoning

Zishan Gu, Fenglin Liu, Changchang Yin, Ping Zhang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1333] arXiv:2405.11685 (cross-list from cs.CV) [pdf, html, other]

Title: ColorFoil: Investigating Color Blindness in Large Vision and Language Models

Ahnaf Mozib Samin, M. Firoz Ahmed, Md. Mushtaq Shahriyar Rafee

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1334] arXiv:2405.11783 (cross-list from cs.LG) [pdf, other]

Title: Inverse Design of Metal-Organic Frameworks Using Quantum Natural Language Processing

Shinyoung Kang, Jihan Kim

Comments: 45 pages, 7 figures, 6 supplementary figures, 1 table, 1 supplementary table

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Quantum Physics (quant-ph)

[1335] arXiv:2405.11817 (cross-list from cs.ET) [pdf, other]

Title: Systematic Review on Healthcare Systems Engineering utilizing ChatGPT

Jungwoo Kim, Ji-Su Lee, Huijae Kim, Taesik Lee

Subjects: Emerging Technologies (cs.ET); Computation and Language (cs.CL)

[1336] arXiv:2405.11880 (cross-list from cs.LG) [pdf, html, other]

Title: Quantifying In-Context Reasoning Effects and Memorization Effects in LLMs

Siyu Lou, Yuntian Chen, Xiaodan Liang, Liang Lin, Quanshi Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1337] arXiv:2405.11919 (cross-list from cs.LG) [pdf, other]

Title: On Efficient and Statistical Quality Estimation for Data Annotation

Jan-Christoph Klie, Juan Haladjian, Marc Kirchner, Rahul Nair

Comments: Accepted to ACL 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1338] arXiv:2405.12035 (cross-list from cs.AI) [pdf, html, other]

Title: KG-RAG: Bridging the Gap Between Knowledge and Creativity

Diego Sanmartin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1339] arXiv:2405.12107 (cross-list from cs.CV) [pdf, html, other]

Title: Imp: Highly Capable Large Multimodal Models for Mobile Devices

Zhenwei Shao, Zhou Yu, Jun Yu, Xuecheng Ouyang, Lihao Zheng, Zhenbiao Gai, Mingyang Wang, Jiajun Ding

Comments: fix some typos and correct a few number in the tables

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1340] arXiv:2405.12119 (cross-list from cs.IR) [pdf, html, other]

Title: Reindex-Then-Adapt: Improving Large Language Models for Conversational Recommendation

Zhankui He, Zhouhang Xie, Harald Steck, Dawen Liang, Rahul Jha, Nathan Kallus, Julian McAuley

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1341] arXiv:2405.12147 (cross-list from cs.AI) [pdf, html, other]

Title: Eliciting Problem Specifications via Large Language Models

Robert E. Wray, James R. Kirk, John E. Laird

Comments: 18 pages, Appendix. Revised in response to reviewer feedback. Accepted for Advances in Cognitive Systems (Jun 2024, Palermo)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1342] arXiv:2405.12250 (cross-list from cs.LG) [pdf, html, other]

Title: Your Transformer is Secretly Linear

Anton Razzhigaev, Matvey Mikhalchuk, Elizaveta Goncharova, Nikolai Gerasimenko, Ivan Oseledets, Denis Dimitrov, Andrey Kuznetsov

Comments: 9 pages, 9 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1343] arXiv:2405.12368 (cross-list from cs.AI) [pdf, html, other]

Title: Layout Agnostic Human Activity Recognition in Smart Homes through Textual Descriptions Of Sensor Triggers (TDOST)

Megha Thukral, Sourish Gunesh Dhekane, Shruthi K. Hiremath, Harish Haresamudram, Thomas Ploetz

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1344] arXiv:2405.12438 (cross-list from cs.HC) [pdf, html, other]

Title: CoCo Matrix: Taxonomy of Cognitive Contributions in Co-writing with Intelligent Agents

Ruyuan Wan, Simret Gebreegziabhe, Toby Jia-Jun Li, Karla Badillo-Urquiola

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1345] arXiv:2405.12564 (cross-list from q-bio.QM) [pdf, html, other]

Title: ProtT3: Protein-to-Text Generation for Text-based Protein Understanding

Zhiyuan Liu, An Zhang, Hao Fei, Enzhi Zhang, Xiang Wang, Kenji Kawaguchi, Tat-Seng Chua

Comments: ACL 2024, 9 pages

Subjects: Quantitative Methods (q-bio.QM); Computation and Language (cs.CL); Multimedia (cs.MM)

[1346] arXiv:2405.12705 (cross-list from cs.CV) [pdf, html, other]

Title: Multimodal Adaptive Inference for Document Image Classification with Anytime Early Exiting

Omar Hamed, Souhail Bakkali, Marie-Francine Moens, Matthew Blaschko, Jordy Van Landeghem

Comments: Accepted at ICDAR 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1347] arXiv:2405.12712 (cross-list from cs.SE) [pdf, html, other]

Title: From Human-to-Human to Human-to-Bot Conversations in Software Engineering

Ranim Khojah, Francisco Gomes de Oliveira Neto, Philipp Leitner

Comments: Accepted at the 1st ACM International Conference on AI-powered Software (AIware) 2024

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1348] arXiv:2405.12715 (cross-list from cs.IR) [pdf, html, other]

Title: RecGPT: Generative Pre-training for Text-based Recommendation

Hoang Ngo, Dat Quoc Nguyen

Comments: Accepted to the ACL 2024 main conference

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1349] arXiv:2405.12775 (cross-list from cs.MM) [pdf, html, other]

Title: Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterances

Hanlei Zhang, Hua Xu, Fei Long, Xin Wang, Kai Gao

Comments: Accepted by ACL 2024, Main Conference, Long Paper

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1350] arXiv:2405.12856 (cross-list from stat.ML) [pdf, other]

Title: LLM Processes: Numerical Predictive Distributions Conditioned on Natural Language

James Requeima, John Bronskill, Dami Choi, Richard E. Turner, David Duvenaud

Subjects: Machine Learning (stat.ML); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1351] arXiv:2405.12875 (cross-list from cs.CV) [pdf, other]

Title: Diffusion-RSCC: Diffusion Probabilistic Model for Change Captioning in Remote Sensing Images

Xiaofei Yu, Yitong Li, Jie Ma

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1352] arXiv:2405.12981 (cross-list from cs.LG) [pdf, html, other]

Title: Reducing Transformer Key-Value Cache Size with Cross-Layer Attention

William Brandon, Mayank Mishra, Aniruddha Nrusimha, Rameswar Panda, Jonathan Ragan Kelly

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1353] arXiv:2405.12990 (cross-list from q-fin.ST) [pdf, other]

Title: BERT vs GPT for financial engineering

Edward Sharkey, Philip Treleaven

Subjects: Statistical Finance (q-fin.ST); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1354] arXiv:2405.13052 (cross-list from cs.HC) [pdf, html, other]

Title: Large Language Models Can Infer Personality from Free-Form User Interactions

Heinrich Peters, Moran Cerf, Sandra C. Matz

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1355] arXiv:2405.13077 (cross-list from cs.CR) [pdf, html, other]

Title: GPT-4 Jailbreaks Itself with Near-Perfect Success Using Self-Explanation

Govind Ramesh, Yao Dou, Wei Xu

Comments: Accepted to EMNLP 2024 Main Conference

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1356] arXiv:2405.13127 (cross-list from cs.CV) [pdf, html, other]

Title: Towards Retrieval-Augmented Architectures for Image Captioning

Sara Sarto, Marcella Cornia, Lorenzo Baraldi, Alessandro Nicolosi, Rita Cucchiara

Comments: ACM Transactions on Multimedia Computing, Communications and Applications (2024)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1357] arXiv:2405.13144 (cross-list from cs.AI) [pdf, html, other]

Title: Mamo: a Mathematical Modeling Benchmark with Solvers

Xuhan Huang, Qingning Shen, Yan Hu, Anningzhe Gao, Benyou Wang

Comments: Project: this https URL Updates: 1. include more models 2. minor modification of the metric with new results 3. fix some typos 4. add error analysis with examples

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1358] arXiv:2405.13203 (cross-list from cs.LG) [pdf, html, other]

Title: Modeling Real-Time Interactive Conversations as Timed Diarized Transcripts

Garrett Tanzer, Gustaf Ahdritz, Luke Melas-Kyriazi

Comments: GT and GA contributed equally

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1359] arXiv:2405.13219 (cross-list from cs.AI) [pdf, html, other]

Title: How Reliable AI Chatbots are for Disease Prediction from Patient Complaints?

Ayesha Siddika Nipu, K M Sajjadul Islam, Praveen Madiraju

Comments: 24th IEEE International Conference on Information Reuse and Integration (IEEE IRI 2024), San Jose, CA, USA

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1360] arXiv:2405.13245 (cross-list from cs.RO) [pdf, html, other]

Title: A Survey of Robotic Language Grounding: Tradeoffs between Symbols and Embeddings

Vanya Cohen, Jason Xinyu Liu, Raymond Mooney, Stefanie Tellex, David Watkins

Comments: IJCAI 2024 Survey Track

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1361] arXiv:2405.13344 (cross-list from eess.AS) [pdf, html, other]

Title: Contextualized Automatic Speech Recognition with Dynamic Vocabulary

Yui Sudo, Yosuke Fukumoto, Muhammad Shakeel, Yifan Peng, Shinji Watanabe

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1362] arXiv:2405.13401 (cross-list from cs.CR) [pdf, html, other]

Title: TrojanRAG: Retrieval-Augmented Generation Can Be Backdoor Driver in Large Language Models

Pengzhou Cheng, Yidong Ding, Tianjie Ju, Zongru Wu, Wei Du, Ping Yi, Zhuosheng Zhang, Gongshen Liu

Comments: 19 pages, 14 figures, 4 tables

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1363] arXiv:2405.13511 (cross-list from cs.LG) [pdf, html, other]

Title: Latent Space Alignment for Semantic Channel Equalization

Tomás Hüttebräucker, Mohamed Sana, Emilio Calvanese Strinati

Comments: Accepted for publication at 2024 IEEE ICMLCN

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Information Theory (cs.IT)

[1364] arXiv:2405.13514 (cross-list from eess.AS) [pdf, html, other]

Title: Joint Optimization of Streaming and Non-Streaming Automatic Speech Recognition with Multi-Decoder and Knowledge Distillation

Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe

Comments: Accepted to IEEE ICASSP 2024 workshop Hands-free Speech Communication and Microphone Arrays (HSCMA 2024)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1365] arXiv:2405.13517 (cross-list from cs.CR) [pdf, html, other]

Title: WaterPool: A Watermark Mitigating Trade-offs among Imperceptibility, Efficacy and Robustness

Baizhou Huang, Xiaojun Wan

Comments: 9 pages

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1366] arXiv:2405.13522 (cross-list from cs.LG) [pdf, html, other]

Title: Beyond Trend and Periodicity: Guiding Time Series Forecasting with Textual Cues

Zhijian Xu, Yuxuan Bian, Jianyuan Zhong, Xiangyu Wen, Qiang Xu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1367] arXiv:2405.13536 (cross-list from cs.LG) [pdf, html, other]

Title: Attention Mechanisms Don't Learn Additive Models: Rethinking Feature Importance for Transformers

Tobias Leemann, Alina Fastowski, Felix Pfeiffer, Gjergji Kasneci

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1368] arXiv:2405.13548 (cross-list from cs.SE) [pdf, html, other]

Title: ECLIPSE: Semantic Entropy-LCS for Cross-Lingual Industrial Log Parsing

Wei Zhang, Xianfu Cheng, Yi Zhang, Jian Yang, Hongcheng Guo, Zhoujun Li, Xiaolin Yin, Xiangyuan Guan, Xu Shi, Liangfan Zheng, Bo Zhang

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1369] arXiv:2405.13568 (cross-list from cs.CR) [pdf, html, other]

Title: CPE-Identifier: Automated CPE identification and CVE summaries annotation with Deep Learning and NLP

Wanyu Hu, Vrizlynn L. L. Thing

Comments: International Conference on Information Systems Security and Privacy 2024

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1370] arXiv:2405.13602 (cross-list from cs.AI) [pdf, html, other]

Title: COTET: Cross-view Optimal Transport for Knowledge Graph Entity Typing

Zhiwei Hu, Víctor Gutiérrez-Basulto, Zhiliang Xiang, Ru Li, Jeff Z. Pan

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1371] arXiv:2405.13803 (cross-list from cs.HC) [pdf, html, other]

Title: "I Like Sunnie More Than I Expected!": Exploring User Expectation and Perception of an Anthropomorphic LLM-based Conversational Agent for Well-Being Support

Siyi Wu, Julie Y. A. Cachia, Feixue Han, Bingsheng Yao, Tianyi Xie, Xuan Zhao, Dakuo Wang

Comments: In Submission

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1372] arXiv:2405.13868 (cross-list from cs.LG) [pdf, html, other]

Title: Automatically Identifying Local and Global Circuits with Linear Computation Graphs

Xuyang Ge, Fukang Zhu, Wentao Shu, Junxuan Wang, Zhengfu He, Xipeng Qiu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1373] arXiv:2405.13872 (cross-list from cs.AI) [pdf, html, other]

Title: Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models

Qiji Zhou, Ruochen Zhou, Zike Hu, Panzhong Lu, Siyang Gao, Yue Zhang

Comments: Correct the case title

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1374] arXiv:2405.13873 (cross-list from cs.AI) [pdf, html, other]

Title: FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answering

Yuan Sui, Yufei He, Nian Liu, Xiaoxin He, Kun Wang, Bryan Hooi

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1375] arXiv:2405.13911 (cross-list from cs.CV) [pdf, html, other]

Title: TOPA: Extending Large Language Models for Video Understanding via Text-Only Pre-Alignment

Wei Li, Hehe Fan, Yongkang Wong, Mohan Kankanhalli, Yi Yang

Comments: NeurIPS 2024 (Spotlight)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)