Computation and Language

Authors and titles for June 2024

[2111] arXiv:2406.10902 (cross-list from cs.CV) [pdf, html, other]

Title: Light Up the Shadows: Enhance Long-Tailed Entity Grounding with Concept-Guided Vision-Language Models

Yikai Zhang, Qianyu He, Xintao Wang, Siyu Yuan, Jiaqing Liang, Yanghua Xiao

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2112] arXiv:2406.10903 (cross-list from cs.LG) [pdf, html, other]

Title: New Solutions on LLM Acceleration, Optimization, and Application

Yingbing Huang, Lily Jiaxin Wan, Hanchen Ye, Manvi Jha, Jinghua Wang, Yuhong Li, Xiaofan Zhang, Deming Chen

Comments: This is an expanded and more comprehensive study based on our invited DAC-24 paper with the same title and co-authors

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Software Engineering (cs.SE)

[2113] arXiv:2406.10906 (cross-list from cs.LG) [pdf, html, other]

Title: Breaking the Attention Bottleneck

Kalle Hilsenbek

Comments: 6 pages, 4 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2114] arXiv:2406.10918 (cross-list from cs.LG) [pdf, html, other]

Title: Multi-LLM QA with Embodied Exploration

Bhrij Patel, Vishnu Sashank Dorbala, Amrit Singh Bedi, Dinesh Manocha

Comments: 16 pages, 9 Figures, 5 Tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2115] arXiv:2406.10923 (cross-list from cs.CV) [pdf, html, other]

Title: Investigating Video Reasoning Capability of Large Language Models with Tropes in Movies

Hung-Ting Su, Chun-Tong Chao, Ya-Ching Hsu, Xudong Lin, Yulei Niu, Hung-Yi Lee, Winston H. Hsu

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2116] arXiv:2406.10937 (cross-list from cs.AI) [pdf, html, other]

Title: Understanding Understanding: A Pragmatic Framework Motivated by Large Language Models

Kevin Leyton-Brown, Yoav Shoham

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2117] arXiv:2406.10958 (cross-list from math.OC) [pdf, html, other]

Title: City-LEO: Toward Transparent City Management Using LLM with End-to-End Optimization

Zihao Jiao, Mengyi Sha, Haoyu Zhang, Xinyu Jiang, Wei Qi

Comments: 26 pages, 8 figures, 5 tables

Subjects: Optimization and Control (math.OC); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[2118] arXiv:2406.10976 (cross-list from cs.LG) [pdf, html, other]

Title: Promoting Data and Model Privacy in Federated Learning through Quantized LoRA

JianHao Zhu, Changze Lv, Xiaohua Wang, Muling Wu, Wenhao Liu, Tianlong Li, Zixuan Ling, Cenyuan Zhang, Xiaoqing Zheng, Xuanjing Huang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[2119] arXiv:2406.11011 (cross-list from cs.LG) [pdf, html, other]

Title: Data Shapley in One Training Run

Jiachen T. Wang, Prateek Mittal, Dawn Song, Ruoxi Jia

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[2120] arXiv:2406.11016 (cross-list from cs.LG) [pdf, html, other]

Title: Optimized Speculative Sampling for GPU Hardware Accelerators

Dominik Wagner, Seanie Lee, Ilja Baumann, Philipp Seeberger, Korbinian Riedhammer, Tobias Bocklet

Comments: Accepted at EMNLP 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2121] arXiv:2406.11025 (cross-list from cs.SD) [pdf, html, other]

Title: Large Language Models for Dysfluency Detection in Stuttered Speech

Dominik Wagner, Sebastian P. Bayerl, Ilja Baumann, Korbinian Riedhammer, Elmar Nöth, Tobias Bocklet

Comments: Accepted at Interspeech 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2122] arXiv:2406.11069 (cross-list from cs.CV) [pdf, html, other]

Title: WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences

Yujie Lu, Dongfu Jiang, Wenhu Chen, William Yang Wang, Yejin Choi, Bill Yuchen Lin

Comments: link: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2123] arXiv:2406.11087 (cross-list from cs.CR) [pdf, html, other]

Title: DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models

Yanming Liu, Xinyue Peng, Yuwei Zhang, Xiaolan Ke, Songhang Deng, Jiannan Cao, Chen Ma, Mengchen Fu, Xuhong Zhang, Sheng Cheng, Xun Wang, Jianwei Yin, Tianyu Du

Comments: 9 pages second version

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2124] arXiv:2406.11171 (cross-list from cs.CV) [pdf, html, other]

Title: SUGARCREPE++ Dataset: Vision-Language Model Sensitivity to Semantic and Lexical Alterations

Sri Harsha Dumpala, Aman Jaiswal, Chandramouli Sastry, Evangelos Milios, Sageev Oore, Hassan Sajjad

Comments: Added the dataset link to the abstract

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2125] arXiv:2406.11200 (cross-list from cs.LG) [pdf, html, other]

Title: AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning

Shirley Wu, Shiyu Zhao, Qian Huang, Kexin Huang, Michihiro Yasunaga, Kaidi Cao, Vassilis N. Ioannidis, Karthik Subbian, Jure Leskovec, James Zou

Comments: NeurIPS 2024 main conference

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2126] arXiv:2406.11217 (cross-list from cs.AI) [pdf, other]

Title: WeatherQA: Can Multimodal Language Models Reason about Severe Weather?

Chengqian Ma, Zhanxiang Hua, Alexandra Anderson-Frey, Vikram Iyer, Xin Liu, Lianhui Qin

Comments: 26 pages, 9 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Atmospheric and Oceanic Physics (physics.ao-ph)

[2127] arXiv:2406.11230 (cross-list from cs.LG) [pdf, html, other]

Title: Multimodal Needle in a Haystack: Benchmarking Long-Context Capability of Multimodal Large Language Models

Hengyi Wang, Haizhou Shi, Shiwei Tan, Weiyi Qin, Wenyuan Wang, Tunyu Zhang, Akshay Nambi, Tanuja Ganu, Hao Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2128] arXiv:2406.11231 (cross-list from cs.RO) [pdf, html, other]

Title: Enabling robots to follow abstract instructions and complete complex dynamic tasks

Ruaridh Mon-Williams, Gen Li, Ran Long, Wenqian Du, Chris Lucas

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2129] arXiv:2406.11233 (cross-list from cs.LG) [pdf, html, other]

Title: Probing the Decision Boundaries of In-context Learning in Large Language Models

Siyan Zhao, Tung Nguyen, Aditya Grover

Comments: Accepted at NeurIPS 2024, code at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2130] arXiv:2406.11285 (cross-list from cs.CR) [pdf, other]

Title: Self and Cross-Model Distillation for LLMs: Effective Methods for Refusal Pattern Alignment

Jie Li, Yi Liu, Chongyang Liu, Xiaoning Ren, Ling Shi, Weisong Sun, Yinxing Xue

Comments: The method used in the paper has obvious problems and ambiguities. The security enhancement method we used cannot be considered distillation, but it is described as distillation in the paper, and the experiment lacks comparison and baseline, which has been criticized by many peers. In order to avoid further dissemination, we have decided to withdraw the paper

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[2131] arXiv:2406.11290 (cross-list from cs.IR) [pdf, html, other]

Title: Iterative Utility Judgment Framework via LLMs Inspired by Relevance in Philosophy

Hengran Zhang, Keping Bi, Jiafeng Guo, Xueqi Cheng

Comments: 22 pages

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2132] arXiv:2406.11301 (cross-list from cs.AI) [pdf, html, other]

Title: Enhancing and Assessing Instruction-Following with Fine-Grained Instruction Variants

Jiuding Yang, Weidong Guo, Kaitong Yang, Xiangyang Li, Yu Xu, Di Niu

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2133] arXiv:2406.11303 (cross-list from cs.CV) [pdf, html, other]

Title: VideoVista: A Versatile Benchmark for Video Understanding and Reasoning

Yunxin Li, Xinyu Chen, Baotian Hu, Longyue Wang, Haoyuan Shi, Min Zhang

Comments: 38 pages, 44 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2134] arXiv:2406.11317 (cross-list from cs.AI) [pdf, html, other]

Title: GUICourse: From General Vision Language Models to Versatile GUI Agents

Wentong Chen, Junbo Cui, Jinyi Hu, Yujia Qin, Junjie Fang, Yue Zhao, Chongyi Wang, Jun Liu, Guirong Chen, Yupeng Huo, Yuan Yao, Yankai Lin, Zhiyuan Liu, Maosong Sun

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

[2135] arXiv:2406.11353 (cross-list from cs.LG) [pdf, html, other]

Title: $\texttt{MoE-RBench}$: Towards Building Reliable Language Models with Sparse Mixture-of-Experts

Guanjie Chen, Xinyu Zhao, Tianlong Chen, Yu Cheng

Comments: 9 pages, 8 figures, camera ready on ICML2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)