Computation and Language

Authors and titles for May 2024

[1526] arXiv:2405.19334 (cross-list from cs.AI) [pdf, html, other]

Title: LLMs Meet Multimodal Generation and Editing: A Survey

Yingqing He, Zhaoyang Liu, Jingye Chen, Zeyue Tian, Hongyu Liu, Xiaowei Chi, Runtao Liu, Ruibin Yuan, Yazhou Xing, Wenhai Wang, Jifeng Dai, Yong Zhang, Wei Xue, Qifeng Liu, Yike Guo, Qifeng Chen

Comments: 52 Pages with 16 Figures, 12 Tables, and 545 References. GitHub Repository at: this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD)

[1527] arXiv:2405.19335 (cross-list from cs.CV) [pdf, html, other]

Title: X-VILA: Cross-Modality Alignment for Large Language Model

Hanrong Ye, De-An Huang, Yao Lu, Zhiding Yu, Wei Ping, Andrew Tao, Jan Kautz, Song Han, Dan Xu, Pavlo Molchanov, Hongxu Yin

Comments: Technical Report

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1528] arXiv:2405.19342 (cross-list from cs.SD) [pdf, html, other]

Title: Sonos Voice Control Bias Assessment Dataset: A Methodology for Demographic Bias Assessment in Voice Assistants

Chloé Sekkat, Fanny Leroy, Salima Mdhaffar, Blake Perry Smith, Yannick Estève, Joseph Dureau, Alice Coucke

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1529] arXiv:2405.19343 (cross-list from cs.SD) [pdf, html, other]

Title: Luganda Speech Intent Recognition for IoT Applications

Andrew Katumba, Sudi Murindanyi, John Trevor Kasule, Elvis Mugume

Comments: Presented as a conference paper at ICLR 2024/AfricaNLP

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1530] arXiv:2405.19534 (cross-list from cs.LG) [pdf, html, other]

Title: Preference Learning Algorithms Do Not Learn Preference Rankings

Angelica Chen, Sadhika Malladi, Lily H. Zhang, Xinyi Chen, Qiuyi Zhang, Rajesh Ranganath, Kyunghyun Cho

Comments: NeurIPS 2024 camera-ready

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1531] arXiv:2405.19544 (cross-list from cs.AI) [pdf, html, other]

Title: One-Shot Safety Alignment for Large Language Models via Optimal Dualization

Xinmeng Huang, Shuo Li, Edgar Dobriban, Osbert Bastani, Hamed Hassani, Dongsheng Ding

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)

[1532] arXiv:2405.19550 (cross-list from cs.LG) [pdf, html, other]

Title: Stress-Testing Capability Elicitation With Password-Locked Models

Ryan Greenblatt, Fabien Roger, Dmitrii Krasheninnikov, David Krueger

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1533] arXiv:2405.19561 (cross-list from cs.AI) [pdf, html, other]

Title: Quo Vadis ChatGPT? From Large Language Models to Large Knowledge Models

Venkat Venkatasubramanian, Arijit Chakraborty

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1534] arXiv:2405.19562 (cross-list from cs.CY) [pdf, html, other]

Title: Selective Explanations

Lucas Monteiro Paes, Dennis Wei, Flavio P. Calmon

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1535] arXiv:2405.19567 (cross-list from cs.AI) [pdf, html, other]

Title: Dr-LLaVA: Visual Instruction Tuning with Symbolic Clinical Grounding

Shenghuan Sun, Alexander Schubert, Gregory M. Goldgof, Zhiqing Sun, Thomas Hartvigsen, Atul J. Butte, Ahmed Alaa

Comments: Code available at: this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1536] arXiv:2405.19592 (cross-list from cs.LG) [pdf, html, other]

Title: Why Larger Language Models Do In-context Learning Differently?

Zhenmei Shi, Junyi Wei, Zhuoyan Xu, Yingyu Liang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1537] arXiv:2405.19597 (cross-list from cs.LG) [pdf, html, other]

Title: SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors

Vijay Lingam, Atula Tejaswi, Aditya Vavre, Aneesh Shetty, Gautham Krishna Gudur, Joydeep Ghosh, Alex Dimakis, Eunsol Choi, Aleksandar Bojchevski, Sujay Sanghavi

Comments: 17 pages, 5 figures, 14 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1538] arXiv:2405.19616 (cross-list from cs.AI) [pdf, html, other]

Title: Easy Problems That LLMs Get Wrong

Sean Williams, James Huckle

Comments: AutogenAI Ltd. GitHub Repo: this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1539] arXiv:2405.19653 (cross-list from cs.LG) [pdf, html, other]

Title: SysCaps: Language Interfaces for Simulation Surrogates of Complex Systems

Patrick Emami, Zhaonan Li, Saumya Sinha, Truc Nguyen

Comments: 21 pages. Under review

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Systems and Control (eess.SY)

[1540] arXiv:2405.19716 (cross-list from cs.CV) [pdf, html, other]

Title: Enhancing Large Vision Language Models with Self-Training on Image Comprehension

Yihe Deng, Pan Lu, Fan Yin, Ziniu Hu, Sheng Shen, James Zou, Kai-Wei Chang, Wei Wang

Comments: 19 pages, 14 figures, 6 tables

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1541] arXiv:2405.19732 (cross-list from cs.CV) [pdf, html, other]

Title: Two Optimizers Are Better Than One: LLM Catalyst Empowers Gradient-Based Optimization for Prompt Tuning

Zixian Guo, Ming Liu, Zhilong Ji, Jinfeng Bai, Yiwen Guo, Wangmeng Zuo

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1542] arXiv:2405.19782 (cross-list from cs.SE) [pdf, html, other]

Title: Dataflow-Guided Retrieval Augmentation for Repository-Level Code Completion

Wei Cheng, Yuhan Wu, Wei Hu

Comments: Accepted in the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024)

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1543] arXiv:2405.19877 (cross-list from cs.AI) [pdf, html, other]

Title: KNOW: A Real-World Ontology for Knowledge Capture with Large Language Models

Arto Bendiken

Comments: 5 pages, 1 figure

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1544] arXiv:2405.19883 (cross-list from cs.LG) [pdf, html, other]

Title: From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems

Jianliang He, Siyu Chen, Fengzhuo Zhang, Zhuoran Yang

Comments: 47 pages, accepted by ICML 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1545] arXiv:2405.19893 (cross-list from cs.LG) [pdf, html, other]

Title: Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts

Chunjing Gan, Dan Yang, Binbin Hu, Hanxiao Zhang, Siyuan Li, Ziqi Liu, Yue Shen, Lin Ju, Zhiqiang Zhang, Jinjie Gu, Lei Liang, Jun Zhou

Comments: 12 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1546] arXiv:2405.19954 (cross-list from cs.CR) [pdf, html, other]

Title: GenKubeSec: LLM-Based Kubernetes Misconfiguration Detection, Localization, Reasoning, and Remediation

Ehud Malul, Yair Meidan, Dudu Mimran, Yuval Elovici, Asaf Shabtai

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[1547] arXiv:2405.19988 (cross-list from cs.RO) [pdf, html, other]

Title: Video-Language Critic: Transferable Reward Functions for Language-Conditioned Robotics

Minttu Alakuijala, Reginald McLean, Isaac Woungang, Nariman Farsad, Samuel Kaski, Pekka Marttinen, Kai Yuan

Comments: 10 pages in the main text, 16 pages including references and supplementary materials. 4 figures and 3 tables in the main text, 1 table in supplementary materials

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1548] arXiv:2405.20003 (cross-list from cs.LG) [pdf, html, other]

Title: Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similarities

Alexander Nikitin, Jannik Kossen, Yarin Gal, Pekka Marttinen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1549] arXiv:2405.20015 (cross-list from cs.AI) [pdf, html, other]

Title: Efficient LLM-Jailbreaking by Introducing Visual Modality

Zhenxing Niu, Yuyao Sun, Haodong Ren, Haoxuan Ji, Quan Wang, Xiaoke Ma, Gang Hua, Rong Jin

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1550] arXiv:2405.20018 (cross-list from cs.MA) [pdf, other]

Title: Safe Multi-agent Reinforcement Learning with Natural Language Constraints

Ziyan Wang, Meng Fang, Tristan Tomilin, Fei Fang, Yali Du

Comments: 23 pages, 6 figures

Subjects: Multiagent Systems (cs.MA); Computation and Language (cs.CL); Machine Learning (cs.LG)