Computation and Language

Authors and titles for November 2024

[1251] arXiv:2411.16709 (cross-list from cs.AI) [pdf, html, other]

Title: A Brief Summary of Explanatory Virtues

Ingrid Zukerman

Comments: 10 pages, 2 tables

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1252] arXiv:2411.16730 (cross-list from cs.CR) [pdf, other]

Title: "Moralized" Multi-Step Jailbreak Prompts: Black-Box Testing of Guardrails in Large Language Models for Verbal Attacks

Libo Wang

Comments: This paper has been submitted to Nature Machine Intelligence and OpenReview preprints. It has 7 pages of text, 3 figures, and 3 tables

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1253] arXiv:2411.16750 (cross-list from cs.CV) [pdf, html, other]

Title: PriorDiffusion: Leverage Language Prior in Diffusion Models for Monocular Depth Estimation

Ziyao Zeng, Jingcheng Ni, Daniel Wang, Patrick Rim, Younjoon Chung, Fengyu Yang, Byung-Woo Hong, Alex Wong

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1254] arXiv:2411.16769 (cross-list from cs.LG) [pdf, html, other]

Title: In-Context Experience Replay Facilitates Safety Red-Teaming of Text-to-Image Diffusion Models

Zhi-Yi Chin, Mario Fritz, Pin-Yu Chen, Wei-Chen Chiu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

[1255] arXiv:2411.16789 (cross-list from cs.CV) [pdf, html, other]

Title: Leveraging the Power of MLLMs for Gloss-Free Sign Language Translation

Jungeun Kim, Hyeongwoo Jeon, Jongseong Bae, Ha Young Kim

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1256] arXiv:2411.16796 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Efficient Model-Heterogeneity Federated Learning for Large Models

Ruofan Jia, Weiying Xie, Jie Lei, Haonan Qin, Jitao Ma, Leyuan Fang

Comments: 8pages, 5figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

[1257] arXiv:2411.16863 (cross-list from cs.CV) [pdf, html, other]

Title: Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering

Federico Cocchi, Nicholas Moratelli, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara

Comments: CVPR 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1258] arXiv:2411.16905 (cross-list from cs.AI) [pdf, html, other]

Title: Boundless Socratic Learning with Language Games

Tom Schaul

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1259] arXiv:2411.17066 (cross-list from cs.CV) [pdf, html, other]

Title: Relations, Negations, and Numbers: Looking for Logic in Generative Text-to-Image Models

Colin Conwell, Rupert Tawiah-Quashie, Tomer Ullman

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Symbolic Computation (cs.SC)

[1260] arXiv:2411.17135 (cross-list from cs.AI) [pdf, html, other]

Title: LLM-Based Offline Learning for Embodied Agents via Consistency-Guided Reward Ensemble

Yujeong Lee, Sangwoo Shin, Wei-Jin Park, Honguk Woo

Comments: Findings of EMNLP-2024 Camera Ready Version

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1261] arXiv:2411.17188 (cross-list from cs.CV) [pdf, other]

Title: Interleaved Scene Graphs for Interleaved Text-and-Image Generation Assessment

Dongping Chen, Ruoxi Chen, Shu Pu, Zhaoyi Liu, Yanru Wu, Caixi Chen, Benlin Liu, Yue Huang, Yao Wan, Pan Zhou, Ranjay Krishna

Comments: Accepted by ICLR 2025 as Spotlight. Project homepage: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1262] arXiv:2411.17284 (cross-list from cs.LG) [pdf, html, other]

Title: AutoElicit: Using Large Language Models for Expert Prior Elicitation in Predictive Modelling

Alexander Capstick, Rahul G. Krishnan, Payam Barnaghi

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1263] arXiv:2411.17299 (cross-list from cs.IR) [pdf, html, other]

Title: 2D Matryoshka Training for Information Retrieval

Shuai Wang, Shengyao Zhuang, Bevan Koopman, Guido Zuccon

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1264] arXiv:2411.17404 (cross-list from cs.AI) [pdf, html, other]

Title: BPP-Search: Enhancing Tree of Thought Reasoning for Mathematical Modeling Problem Solving

Teng Wang, Wing-Yin Yu, Zhenqi He, Zehua Liu, Xiongwei Han, Hailei Gong, Han Wu, Wei Shi, Ruifeng She, Fangzhou Zhu, Tao Zhong

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1265] arXiv:2411.17451 (cross-list from cs.CV) [pdf, other]

Title: VLRewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models

Lei Li, Yuancheng Wei, Zhihui Xie, Xuqing Yang, Yifan Song, Peiyi Wang, Chenxin An, Tianyu Liu, Sujian Li, Bill Yuchen Lin, Lingpeng Kong, Qi Liu

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1266] arXiv:2411.17454 (cross-list from cs.CV) [pdf, html, other]

Title: FLEX-CLIP: Feature-Level GEneration Network Enhanced CLIP for X-shot Cross-modal Retrieval

Jingyou Xie, Jiayi Kuang, Zhenzhou Lin, Jiarui Ouyang, Zishuo Zhao, Ying Shen

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1267] arXiv:2411.17465 (cross-list from cs.CV) [pdf, html, other]

Title: ShowUI: One Vision-Language-Action Model for GUI Visual Agent

Kevin Qinghong Lin, Linjie Li, Difei Gao, Zhengyuan Yang, Shiwei Wu, Zechen Bai, Weixian Lei, Lijuan Wang, Mike Zheng Shou

Comments: Technical Report. Github: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1268] arXiv:2411.17685 (cross-list from cs.LG) [pdf, html, other]

Title: Attamba: Attending To Multi-Token States

Yash Akhauri, Safeen Huda, Mohamed S. Abdelfattah

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1269] arXiv:2411.17691 (cross-list from cs.LG) [pdf, html, other]

Title: Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens

Xu Ouyang, Tao Ge, Thomas Hartvigsen, Zhisong Zhang, Haitao Mi, Dong Yu

Comments: Work in Progress

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1270] arXiv:2411.17708 (cross-list from cs.AI) [pdf, html, other]

Title: Towards Efficient Neurally-Guided Program Induction for ARC-AGI

Simon Ouellette

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1271] arXiv:2411.17799 (cross-list from cs.CV) [pdf, html, other]

Title: Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generator

Ronglai Zuo, Rolandos Alexandros Potamias, Evangelos Ververas, Jiankang Deng, Stefanos Zafeiriou

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1272] arXiv:2411.17991 (cross-list from cs.CV) [pdf, html, other]

Title: VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format

Yueqian Wang, Xiaojun Meng, Yuxuan Wang, Jianxin Liang, Jiansheng Wei, Huishuai Zhang, Dongyan Zhao

Comments: 9 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1273] arXiv:2411.18010 (cross-list from eess.AS) [pdf, html, other]

Title: JPPO: Joint Power and Prompt Optimization for Accelerated Large Language Model Services

Feiran You, Hongyang Du, Kaibin Huang, Abbas Jamalipour

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1274] arXiv:2411.18138 (cross-list from eess.AS) [pdf, html, other]

Title: SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generation

Wenyi Yu, Siyin Wang, Xiaoyu Yang, Xianzhao Chen, Xiaohai Tian, Jun Zhang, Guangzhi Sun, Lu Lu, Yuxuan Wang, Chao Zhang

Comments: Technical report

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[1275] arXiv:2411.18203 (cross-list from cs.CV) [pdf, html, other]

Title: Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoning

Di Zhang, Junxian Li, Jingdi Lei, Xunzhi Wang, Yujie Liu, Zonglin Yang, Jiatong Li, Weida Wang, Suorong Yang, Jianbo Wu, Peng Ye, Wanli Ouyang, Dongzhan Zhou

Comments: 16 pages, 11 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1276] arXiv:2411.18217 (cross-list from cs.SD) [pdf, html, other]

Title: How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenario

Shih-Heng Wang, Zih-Ching Chen, Jiatong Shi, Ming-To Chuang, Guan-Ting Lin, Kuan-Po Huang, David Harwath, Shang-Wen Li, Hung-yi Lee

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1277] arXiv:2411.18279 (cross-list from cs.AI) [pdf, other]

Title: Large Language Model-Brained GUI Agents: A Survey

Chaoyun Zhang, Shilin He, Jiaxu Qian, Bowen Li, Liqun Li, Si Qin, Yu Kang, Minghua Ma, Guyue Liu, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang

Comments: The collection of papers reviewed in this survey will be hosted and regularly updated on the GitHub repository: this https URL Additionally, a searchable webpage is available at this https URL for easier access and exploration

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1278] arXiv:2411.18564 (cross-list from cs.AI) [pdf, html, other]

Title: Dspy-based Neural-Symbolic Pipeline to Enhance Spatial Reasoning in LLMs

Rong Wang, Kun Sun, Jonas Kuhn

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1279] arXiv:2411.18620 (cross-list from cs.AI) [pdf, html, other]

Title: Cross-modal Information Flow in Multimodal Large Language Models

Zhi Zhang, Srishti Yadav, Fengze Han, Ekaterina Shutova

Journal-ref: CVPR2025

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1280] arXiv:2411.18636 (cross-list from cs.SD) [pdf, html, other]

Title: Towards Advanced Speech Signal Processing: A Statistical Perspective on Convolution-Based Architectures and its Applications

Nirmal Joshua Kapu, Raghav Karan

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1281] arXiv:2411.18651 (cross-list from cs.CV) [pdf, html, other]

Title: Verbalized Representation Learning for Interpretable Few-Shot Generalization

Cheng-Fu Yang, Da Yin, Wenbo Hu, Nanyun Peng, Bolei Zhou, Kai-Wei Chang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1282] arXiv:2411.18699 (cross-list from cs.CR) [pdf, html, other]

Title: An indicator for effectiveness of text-to-image guardrails utilizing the Single-Turn Crescendo Attack (STCA)

Ted Kwartler, Nataliia Bagan, Ivan Banny, Alan Aqrawi, Arian Abbasi

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1283] arXiv:2411.18711 (cross-list from cs.CV) [pdf, other]

Title: Evaluating Vision-Language Models as Evaluators in Path Planning

Mohamed Aghzal, Xiang Yue, Erion Plaku, Ziyu Yao

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1284] arXiv:2411.18729 (cross-list from cs.LG) [pdf, html, other]

Title: Multi-Task Model Merging via Adaptive Weight Disentanglement

Feng Xiong, Runxi Cheng, Wang Chen, Zhanqiu Zhang, Yiwen Guo, Chun Yuan, Ruifeng Xu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1285] arXiv:2411.18755 (cross-list from cs.LG) [pdf, html, other]

Title: Cyber-Attack Technique Classification Using Two-Stage Trained Large Language Models

Weiqiu You, Youngja Park

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1286] arXiv:2411.18797 (cross-list from cs.LG) [pdf, html, other]

Title: UOE: Unlearning One Expert Is Enough For Mixture-of-experts LLMS

Haomin Zhuang, Yihua Zhang, Kehan Guo, Jinghan Jia, Gaowen Liu, Sijia Liu, Xiangliang Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1287] arXiv:2411.18807 (cross-list from cs.CV) [pdf, html, other]

Title: Reconstructing Animals and the Wild

Peter Kulits, Michael J. Black, Silvia Zuffi

Comments: 12 pages; project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1288] arXiv:2411.18888 (cross-list from cs.HC) [pdf, other]

Title: ArEEG_Words: Dataset for Envisioned Speech Recognition using EEG for Arabic Words

Hazem Darwish, Abdalrahman Al Malah, Khloud Al Jallad, Nada Ghneim

Comments: arXiv admin note: substantial text overlap with arXiv:2402.15733

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1289] arXiv:2411.18895 (cross-list from cs.LG) [pdf, html, other]

Title: Evaluating Sparse Autoencoders on Targeted Concept Erasure Tasks

Adam Karvonen, Can Rager, Samuel Marks, Neel Nanda

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1290] arXiv:2411.18915 (cross-list from cs.LG) [pdf, html, other]

Title: MATATA: A weakly-supervised MAthematical Tool-Assisted reasoning for Tabular Applications

Vishnou Vinayagame, Gregory Senay, Luis Martí

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1291] arXiv:2411.19103 (cross-list from cs.CV) [pdf, html, other]

Title: VARCO-VISION: Expanding Frontiers in Korean Vision-Language Models

Jeongho Ju, Daeyoung Kim, SunYoung Park, Youngjune Kim

Comments: 24 pages, 15 figures, 4 tables. Model weights at this https URL. Benchmarks released at NCSOFT's HuggingFace repositories (K-MMBench, K-SEED, K-MMStar, K-DTCBench, K-LLaVA-W). VARCO-VISION is an open-source Korean-English VLM with OCR, grounding, and referring capabilities

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1292] arXiv:2411.19140 (cross-list from cs.CY) [pdf, other]

Title: Examining Multimodal Gender and Content Bias in ChatGPT-4o

Roberto Balestri

Comments: 17 pages, 4 figures, 3 tables. Conference: "14th International Conference on Artificial Intelligence, Soft Computing and Applications (AIAA 2024), London, 23-24 November 2024" It will be published in the proceedings "David C. Wyld et al. (Eds): IoTE, CNDC, DSA, AIAA, NLPTA, DPPR - 2024"

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Other Statistics (stat.OT)

[1293] arXiv:2411.19331 (cross-list from cs.CV) [pdf, html, other]

Title: Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentation

Luca Barsellotti, Lorenzo Bianchi, Nicola Messina, Fabio Carrara, Marcella Cornia, Lorenzo Baraldi, Fabrizio Falchi, Rita Cucchiara

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1294] arXiv:2411.19346 (cross-list from cs.CV) [pdf, html, other]

Title: CLIP meets DINO for Tuning Zero-Shot Classifier using Unlabeled Image Collections

Mohamed Fazli Imam, Rufael Fedaku Marew, Jameel Hassan, Mustansar Fiaz, Alham Fikri Aji, Hisham Cholakkal

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1295] arXiv:2411.19378 (cross-list from cs.CV) [pdf, html, other]

Title: Libra: Leveraging Temporal Images for Biomedical Radiology Analysis

Xi Zhang, Zaiqiao Meng, Jake Lever, Edmond S. L. Ho

Comments: 30 pages, 5 figures, Adding Appendix

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1296] arXiv:2411.19434 (cross-list from cs.CV) [pdf, html, other]

Title: Actions and Objects Pathways for Domain Adaptation in Video Question Answering

Safaa Abdullahi Moallim Mohamud, Ho-Young Jung

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1297] arXiv:2411.19504 (cross-list from cs.AI) [pdf, html, other]

Title: TQA-Bench: Evaluating LLMs for Multi-Table Question Answering with Scalable Context and Symbolic Extension

Zipeng Qiu, You Peng, Guangxin He, Binhang Yuan, Chen Wang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1298] arXiv:2411.19539 (cross-list from cs.AI) [pdf, html, other]

Title: Knowledge Management for Automobile Failure Analysis Using Graph RAG

Yuta Ojima, Hiroki Sakaji, Tadashi Nakamura, Hiroaki Sakata, Kazuya Seki, Yuu Teshigawara, Masami Yamashita, Kazuhiro Aoyama

Comments: 7 pages, 6 figures, to be published in 2024 IEEE International Conference on Bid Data (BigData)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1299] arXiv:2411.19628 (cross-list from cs.CV) [pdf, html, other]

Title: Accelerating Multimodal Large Language Models via Dynamic Visual-Token Exit and the Empirical Findings

Qiong Wu, Wenhao Lin, Weihao Ye, Yiyi Zhou, Xiaoshuai Sun, Rongrong Ji

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1300] arXiv:2411.19650 (cross-list from cs.RO) [pdf, html, other]

Title: CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo

Comments: Project Webpage: this https URL

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)