Computation and Language

Authors and titles for May 2024

[1451] arXiv:2405.16682 (cross-list from cs.LG) [pdf, html, other]

Title: A Systematic Review of Federated Generative Models

Ashkan Vedadi Gargary, Emiliano De Cristofaro

Comments: 24 Pages, 3 Figures, 5 Tables

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1452] arXiv:2405.16700 (cross-list from cs.CV) [pdf, html, other]

Title: Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs

Mustafa Shukor, Matthieu Cord

Comments: NeurIPS 2024. Code: this https URL. Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1453] arXiv:2405.16712 (cross-list from cs.LG) [pdf, html, other]

Title: Zamba: A Compact 7B SSM Hybrid Model

Paolo Glorioso, Quentin Anthony, Yury Tokpanov, James Whittington, Jonathan Pilault, Adam Ibrahim, Beren Millidge

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1454] arXiv:2405.16751 (cross-list from cs.AI) [pdf, other]

Title: LLM-Based Cooperative Agents using Information Relevance and Plan Validation

SeungWon Seo, Junhyeok Lee, SeongRae Noh, HyeongYeop Kang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multiagent Systems (cs.MA)

[1455] arXiv:2405.16845 (cross-list from cs.LG) [pdf, other]

Title: On Mesa-Optimization in Autoregressively Trained Transformers: Emergence and Capability

Chenyu Zheng, Wei Huang, Rongzhen Wang, Guoqiang Wu, Jun Zhu, Chongxuan Li

Comments: Accepted by NeurIPS2024, 45 pages. The final version of the previous preprint

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1456] arXiv:2405.16869 (cross-list from cs.AI) [pdf, html, other]

Title: Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learning

Yichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu, Binbin Hu, Ziqi Liu, Wen Zhang, Huajun Chen

Comments: Work in progress. Code and data will be released at this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1457] arXiv:2405.16919 (cross-list from cs.CV) [pdf, html, other]

Title: VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models

Zejun Li, Ruipu Luo, Jiwen Zhang, Minghui Qiu, Zhongyu Wei

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1458] arXiv:2405.16994 (cross-list from cs.AI) [pdf, html, other]

Title: Vision-and-Language Navigation Generative Pretrained Transformer

Wen Hanlin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

[1459] arXiv:2405.17044 (cross-list from cs.AI) [pdf, html, other]

Title: Interesting Scientific Idea Generation Using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaders

Xuemei Gu, Mario Krenn

Comments: 6 pages; 4 figures; Appendix: 3 pages, 2 figures, 2 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Digital Libraries (cs.DL); Machine Learning (cs.LG)

[1460] arXiv:2405.17076 (cross-list from cs.AI) [pdf, html, other]

Title: Leveraging small language models for Text2SPARQL tasks to improve the resilience of AI assistance

Felix Brei, Johannes Frey, Lars-Peter Meyer

Comments: To appear in Proceedings of the Workshop on Linked Data-driven Resilience Research 2024 (D2R2) co-located with Extended Semantic Web Conference 2024 (ESWC 2024)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1461] arXiv:2405.17088 (cross-list from cs.LG) [pdf, html, other]

Title: Phase Transitions in the Output Distribution of Large Language Models

Julian Arnold, Flemming Holtorf, Frank Schäfer, Niels Lörch

Comments: 21 pages, 4 figures

Subjects: Machine Learning (cs.LG); Statistical Mechanics (cond-mat.stat-mech); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1462] arXiv:2405.17104 (cross-list from cs.CV) [pdf, html, other]

Title: LLM-Optic: Unveiling the Capabilities of Large Language Models for Universal Visual Grounding

Haoyu Zhao, Wenhang Ge, Ying-cong Chen

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1463] arXiv:2405.17130 (cross-list from cs.LG) [pdf, html, other]

Title: Exploiting the Layered Intrinsic Dimensionality of Deep Models for Practical Adversarial Training

Enes Altinisik, Safa Messaoud, Husrev Taha Sencar, Hassan Sajjad, Sanjay Chawla

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1464] arXiv:2405.17217 (cross-list from cs.HC) [pdf, html, other]

Title: Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools

Daniel Buschek

Comments: 19 pages, 7 figures, 2 tables, ACM DIS 2024

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1465] arXiv:2405.17345 (cross-list from cs.AI) [pdf, html, other]

Title: Exploring and steering the moral compass of Large Language Models

Alejandro Tlaie

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1466] arXiv:2405.17382 (cross-list from cs.LG) [pdf, html, other]

Title: ReMoDetect: Reward Models Recognize Aligned LLM's Generations

Hyunseok Lee, Jihoon Tack, Jinwoo Shin

Comments: 20 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1467] arXiv:2405.17390 (cross-list from cs.IR) [pdf, other]

Title: KSW: Khmer Stop Word based Dictionary for Keyword Extraction

Nimol Thuon, Wangrui Zhang, Sada Thuon

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1468] arXiv:2405.17423 (cross-list from cs.CV) [pdf, other]

Title: Privacy-Aware Visual Language Models

Laurens Samson, Nimrod Barazani, Sennay Ghebreab, Yuki M. Asano

Comments: preprint

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1469] arXiv:2405.17430 (cross-list from cs.CV) [pdf, html, other]

Title: Matryoshka Multimodal Models

Mu Cai, Jianwei Yang, Jianfeng Gao, Yong Jae Lee

Comments: Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1470] arXiv:2405.17440 (cross-list from cs.LG) [pdf, html, other]

Title: CataLM: Empowering Catalyst Design Through Large Language Models

Ludi Wang, Xueqing Chen, Yi Du, Yuanchun Zhou, Yang Gao, Wenjuan Cui

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1471] arXiv:2405.17441 (cross-list from cs.NI) [pdf, html, other]

Title: When Large Language Models Meet Optical Networks: Paving the Way for Automation

Danshi Wang, Yidi Wang, Xiaotian Jiang, Yao Zhang, Yue Pang, Min Zhang

Subjects: Networking and Internet Architecture (cs.NI); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Systems and Control (eess.SY)

[1472] arXiv:2405.17459 (cross-list from cs.LG) [pdf, other]

Title: Integrating Medical Imaging and Clinical Reports Using Multimodal Deep Learning for Advanced Disease Analysis

Ziyan Yao, Fei Lin, Sheng Chai, Weijie He, Lu Dai, Xinghui Fei

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1473] arXiv:2405.17470 (cross-list from cs.LG) [pdf, html, other]

Title: Athena: Efficient Block-Wise Post-Training Quantization for Large Language Models Using Second-Order Matrix Derivative Information

Yanshu Wang, Wenyang He, Tong Yang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1474] arXiv:2405.17475 (cross-list from cs.CV) [pdf, html, other]

Title: How Culturally Aware are Vision-Language Models?

Olena Burda-Lassen, Aman Chadha, Shashank Goswami, Vinija Jain

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1475] arXiv:2405.17503 (cross-list from cs.SE) [pdf, other]

Title: Code Repair with LLMs gives an Exploration-Exploitation Tradeoff

Hao Tang, Keya Hu, Jin Peng Zhou, Sicheng Zhong, Wei-Long Zheng, Xujie Si, Kevin Ellis

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Programming Languages (cs.PL)